Equipment control methods, chips, terminal equipment and media

By detecting swipe gestures on the terminal device and displaying prompts, and predicting user intent, the system allows users to access the control center or notification center on demand using the same swipe gesture. This solves the problems of cumbersome operation and accidental triggering in existing technologies, thus improving the user experience.

CN123067772APending Publication Date: 2026-11-10HUAWEI TECH CO LTD
View PDF 0 Cites 0 Cited by

Patent Information

Application Number
CN202510592125.6
Authority / Receiving Office
CN · China
Patent Type
Applications(China)
Current Assignee / Owner
Filing Date
2025-05-08
Publication Date
2026-11-10

AI Technical Summary

Technical Problem

With an increasing number of control buttons and notification messages on existing terminal devices, users need to use different operations to call up the control center and notification center separately, which makes the operation cumbersome and prone to accidental triggering, thus affecting the user experience.

Method used

By detecting target swipe actions, displaying prompts, and predicting user intent, users can access the control center or notification center on demand using the same swipe action, simplifying the operation process.

Benefits of technology

This feature allows users to access the control center or notification center with a single swipe, improving the user experience, simplifying the operation process, and reducing accidental triggering.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure CN123067772A_ABST
    Figure CN123067772A_ABST
Patent Text Reader

Abstract

This application provides a device control method, chip, terminal device, and medium, relating to the field of terminal device technology. The method, applied to a terminal device, includes: detecting a target swipe operation on a target screen, the target screen being the screen of the terminal device in a working state; responding to the target swipe operation, displaying a first prompt message, the first prompt message indicating that if the swipe ends, the first information will be displayed, which is either a notification center or a control center; detecting the end of the target swipe operation while the first prompt message is displayed on the target screen, then displaying the first information; and / or, detecting the end of the target swipe operation while the first prompt message is no longer displayed on the target screen, then displaying second information, which is either a notification center or a control center. This application supports users in calling up the control center / notification center on demand through the same operation, improving the user experience.
Need to check novelty before this filing date? Find Prior Art

Description

Technical Field

[0001] This application relates to the field of terminal equipment technology, and in particular to a device control method, a chip, a terminal device, and a medium. Background Technology

[0002] As smart devices become increasingly feature-rich while physical buttons become fewer, human-computer interaction methods are becoming more complex. Faced with a growing number of control buttons in the control center and notification messages in the notification center, terminal devices can support users accessing the control center / notification center separately through different operations. However, this approach is cumbersome and negatively impacts the user experience. Summary of the Invention

[0003] This application provides a device control method, chip, terminal device, and medium that allows users to call up the control center / notification center on demand through the same operation, thereby improving the user experience.

[0004] In a first aspect, embodiments of this application provide a device control method applied to a terminal device, comprising: detecting a target swipe operation on a target screen, the target screen being a screen of the terminal device in a working state; responding to the target swipe operation, displaying a first prompt message, the first prompt message being used to prompt if the swipe ends, the first message being one of a notification center and a control center; detecting the end of the target swipe operation while the target screen displays the first prompt message, and then displaying the first message; and / or, detecting the end of the target swipe operation while the target screen stops displaying the first prompt message, and then displaying second message, the second message being another of a notification center and a control center.

[0005] For example, the terminal device can be a user mobile terminal such as a smartphone, tablet, or wearable device.

[0006] For example, the target swipe operation can be a swipe operation from the edge of the target screen toward the inside of the target screen, such as a swipe operation from the top of the target screen downwards.

[0007] Optionally, the target sliding operation can be a continuous sliding operation or a continuous sliding operation with intervals.

[0008] Understandably, the phrase "if the swipe ends now" can mean that the target swipe operation ends at any point during the display of the first prompt information. Based on the display of the first prompt information, or based on the switching between displaying and stopping the display of the first prompt information, users can easily decide when to end the swipe based on whether the first prompt information is displayed, thereby calling up the first or second information as needed.

[0009] Understandably, the above-mentioned "stop displaying the first prompt message" can mean not displaying the first prompt message, or that the first prompt message is not displayed.

[0010] Understandably, the "and / or" mentioned above can mean that for a target swipe operation, based on the selectivity of the swipe end time, when the target swipe operation ends, the terminal device can display either the first information or the second information.

[0011] For example, in some feasible examples, the terminal device responds to the target swipe operation by displaying the first prompt information, and if the target swipe operation ends during the display of the first prompt information, the first information is displayed when the end of the swipe is detected, so as to meet the user's need to perform the target swipe operation to call up the first information.

[0012] For example, in other feasible examples, the terminal device responds to the target swipe operation by first displaying a first prompt message, then stopping the display of the first prompt message, and detecting the end of the target swipe operation during the period when the first prompt message is stopped. Then, when the end of the swipe is detected, a second message is displayed to meet the user's need to perform the target swipe operation to call up the second message.

[0013] In some embodiments, the notification center may be empty (i.e., there are no new notification messages) when the first prompt message is displayed, while in other embodiments, the notification center may not be empty when the first prompt message is displayed; there is no limitation on this.

[0014] Taking the first message as the notification center and the second message as the control center as an example, the first notification message may include a thumbnail of the notification center, such as... Figure 5a Image 501 in the example shown (see details) Figure 5a1 Image 502 (see details) Figure 5a2 Image 503 (see details) Figure 5a3 This prompts the user that ending the swipe will bring up the notification center. This allows users to easily see the content to be displayed on their device based on the real-time changes in the initial prompt (the displayed content reflects what will be displayed when the user ends the swipe), thus enabling them to choose the appropriate time to end the swipe and preventing accidental operation.

[0015] If a user needs to access the notification center, they can stop swiping during the initial notification display on the device to allow the notification center to be displayed. The corresponding display interface can be as follows: Figure 7a As shown. By displaying the notification center separately, users can easily view as many notification messages as possible, such as the complete notification message. This facilitates user operations, such as viewing the details of any notification message as needed.

[0016] In some examples, if a user needs to access the control center, they can stop swiping while the terminal device is no longer displaying the initial prompt message, allowing the terminal device to display the control center. The corresponding display interface can be as follows: Figure 8a As shown. By displaying the control center separately, users can easily see as many control buttons as possible, such as a complete set of control buttons. This facilitates user operation, such as viewing / setting the status of any control button as needed.

[0017] The swipe-to-end times for calling the notification center and the swipe-to-end times for calling the control center are different feasible end times for a single swipe operation, rather than separate end times for two swipe operations. Thus, the terminal device supports users calling the control center / notification center on demand using the same swipe operation, i.e., a unified swipe gesture, and also supports users calling the control center / notification center with a single swipe operation.

[0018] In this embodiment, the operation of calling the control center and the operation of calling the notification center are the same operation (without distinguishing the starting position of the swipe), rather than... Figure 2a The different operations shown in the implementation (distinguishing between the starting positions of the slide) may not exist. Figure 2a The implementation shown has the following problems: users need to remember the starting position of the swipe to call up the control center / notification center, it is easy to trigger accidentally, and it is inconvenient to operate with one hand.

[0019] In this embodiment, the user can access the control center / notification center with a single operation, rather than... Figure 2b / Figure 2c The implementation shown requires two steps to bring up the control center, which simplifies user operations and improves the user experience.

[0020] In one embodiment of this application, before displaying the first prompt information, the device control method further includes: obtaining a user intent based on the context information of the terminal device, the user intent including a first intent, the first intent being used to describe the terminal device's prediction result of the content the user expects to call out; if the first intent indicates that the user expects to call out the notification center, the first information is the notification center, so as to support the terminal device to prioritize displaying information for prompting that the notification center will be displayed if the current swipe ends at the start of the target swipe operation; if the first intent indicates that the user expects to call out the control center, the first information is the control center, so as to support the terminal device to prioritize displaying information for prompting that the control center will be displayed if the current swipe ends at the start of the target swipe operation.

[0021] Optionally, the context information includes at least one of the following: whether a new notification message has been received within a preset time period, whether the notification center is empty, the content of the notification message in the notification center, the status of the control buttons in the control center, the device battery level, the light sensing result, and the execution frequency of the target swipe operation.

[0022] For example, if the determined user intent is that the user wants to access the notification center, the terminal device supports prioritizing the display of the notification center, rather than displaying it after the user switches. In this way, the terminal device can, upon detecting a target swipe operation, prioritize displaying information indicating that the notification center will be displayed if the swipe ends, such as... Figure 5a Image 501 in the example shown (see details) Figure 5a1 ).

[0023] This embodiment can prioritize calling out the predicted user-expected content based on the prediction of user intent, so that the user can perform simple operations (such as...) Figure 10 The user can quickly access the desired content by swiping down (as shown in the image) without having to switch the content displayed on the terminal device, thus providing convenience for one-handed operation.

[0024] In one embodiment of this application, after detecting a target swipe operation on the target screen, the device control method further includes: obtaining a user intent based on the context information of the terminal device, the user intent including a second intent, the second intent being used to describe the terminal device's prediction result for the control buttons that the user expects to set; if the second intent includes one or more control buttons, then displaying a quick settings button panel when the target swipe operation ends; and displaying the one or more control buttons in the quick settings button panel.

[0025] like Figure 7b As shown, the terminal device can display the notification center when the user ends the swipe, and display the quick settings button panel 701 on the top of the notification center to display the control buttons for the user's desired settings.

[0026] like Figure 8b As shown, the terminal device can display the control center when the user ends the swipe, and display the quick settings button panel 801 on the upper side of the control center to display the control buttons that the user intends to set.

[0027] Instead of having users search through all the control buttons in the control center to find the control button they need to configure, displaying the control button that the user wants to configure along with the control center / notification center makes it easier for users to find the control button they need to configure, making button configuration simpler and easier to use.

[0028] In addition, by displaying the control buttons predicted by the device for the user's expected settings when displaying the notification center, it can also deal with situations such as incorrect judgment of user intent or temporary changes in user needs, so as to avoid causing users additional operation steps and troubles due to misjudgment of intent as much as possible, and enable users to quickly modify the control buttons with fewer steps.

[0029] In one embodiment of this application, after detecting a target swipe operation on the target screen, the device control method further includes: obtaining a user intent based on the context information of the terminal device, wherein the user intent includes a third intent, which describes the terminal device's prediction result for the control buttons that the user expects to set; if the third intent includes one or more control buttons, and one or more control buttons are respectively associated with one or more notification messages in the notification center, then when displaying the notification center, the associated control buttons are displayed on one side of the notification messages.

[0030] Understandably, the third intent in this embodiment and the second intent described above may be the same intent.

[0031] like Figure 13a As shown, the terminal device can display the notification center when the user ends the swipe, and show the associated control buttons to the right of the notification message. By presenting the control buttons that the device anticipates the user's desired settings near the notification message, a more convenient and intuitive experience can be provided to the user, and situations such as errors in judging user intent or users changing their needs temporarily can be addressed.

[0032] In one embodiment of this application, obtaining user intent based on the context information of a terminal device includes: obtaining user intent based on the context information of the terminal device, combined with at least one of a mapping relationship and user historical behavior data; wherein, the mapping relationship is used to describe the user intent mapped to the context information of the terminal device; the user historical behavior data is used to describe the relevant historical data of the user performing the target swipe operation; the user historical behavior data includes the context information of the terminal device when the user performs the target swipe operation, and also includes at least one of the information displayed by the terminal device at the end of the target swipe operation and the control buttons used by the user after performing the target swipe operation.

[0033] Optionally, after displaying the first / second information, the device control method may further include: associating the context information currently acquired by the terminal device with the first / second information, and adding the association result to the user's historical behavior data to update the user's historical behavior data in real time.

[0034] Optionally, preset rules can be used to describe the mapping relationship between contextual information and user intent. For example, if a new notification message is received within a preset time, the corresponding user intent is to call the notification center; if the device battery is low, the corresponding user intent is to turn on power saving mode. Determining user intent based on preset rules helps to accurately predict user intent when user historical behavior data is not used, or when the amount of user historical behavior data is small and the regularity is weak.

[0035] User historical behavior data can reflect the relationship between a user's past outgoing content and its corresponding contextual information, as well as the differences in the user's behavioral habits when performing target swipe operations under different contextual information. The result of each target swipe operation can help influence the judgment of user intent in the latest execution, thus achieving increasingly accurate judgment of user intent.

[0036] In one embodiment of this application, the device control method further includes: displaying a second prompt message when the target screen stops displaying the first prompt message, the second prompt message being displayed to indicate if the current swipe ends; detecting the end of the target swipe operation when the target screen stops displaying the first prompt message includes: detecting the end of the target swipe operation when the target screen displays the second prompt message.

[0037] Understandably, in this embodiment, "if the swipe ends now" can mean that the target swipe operation ends at any time during the display of the second prompt information. Based on the switching between displaying the first and second prompt information, users can easily decide when to end the swipe based on the real-time displayed content, thereby calling up either the first or second information as needed.

[0038] Taking the first message as the notification center and the second message as the control center as an example, the first notification message may include a thumbnail of the notification center, such as... Figure 5a Image 501 in the example shown (see details) Figure 5a1 Image 502 (see details) Figure 5a2 Image 503 (see details) Figure 5a2 This prompts the user that if they stop swiping, the notification center will be brought up. The second prompt may include a thumbnail of the control center, such as... Figure 5a Image 504 in the example shown (see details) Figure 5a5 This prompts the user that ending the swipe will bring up the control center. Users can then decide when to end the swipe by viewing the first and second prompts.

[0039] If the user needs to access the notification center, they can stop swiping during the initial notification display to allow the terminal device to show the notification center. The corresponding display interface can be as follows: Figure 7a As shown. If the user needs to access the control center, they can stop swiping during the second prompt message display to allow the terminal device to display the notification center. The corresponding display interface can be as follows. Figure 8a As shown.

[0040] By switching between the first and second prompts, the prompts can be kept consistent with the content to be displayed, allowing users to decide when to end the swipe as needed, thus improving the user experience.

[0041] In one embodiment of this application, the device control method further includes: displaying a switching animation between displaying the first prompt information and displaying the second prompt information, so that the user can intuitively perceive when the terminal device switches the content to be displayed.

[0042] For example, in Figure 5a In the example shown, one of the interfaces for switching animation effects can be like interface 515 (see details). Figure 5a4 As shown in ), Figure 5b In the example shown, one of the interfaces for switching animation effects can be like interface 516 (see details). Figure 5b4 As shown in the image, the switching animation can provide an animated flipping effect.

[0043] In one embodiment of this application, the device control method further includes: displaying a third prompt message when the target screen stops displaying the first prompt message and the second prompt message, the third prompt message being used to prompt that if the current swipe ends, the notification center and the control center will be displayed; and detecting that the target swipe operation has ended when the target screen displays the third prompt message, then simultaneously displaying the notification center and the control center.

[0044] Understandably, in this embodiment, "if the swipe ends now" can mean that the target swipe operation ends at any time during the display of the third prompt information. Based on the switching changes between displaying the first prompt information, displaying the second prompt information, and displaying the third prompt information, users can easily decide when to end the swipe based on the real-time displayed content, thereby calling the notification center, the control center, or both simultaneously as needed.

[0045] In this embodiment, when a user performs a swipe gesture, they can choose to call up the control center alone, the notification center alone, or both the control center and the notification center simultaneously, rather than... Figure 2a The implementation shown allows only simultaneous calls to the control center and notification center, and not separate calls to either the control center or the notification center. This ensures that the content displayed meets the user's personalized needs.

[0046] Optionally, the terminal device determines whether to switch the content to be displayed based on different screen areas. In one embodiment of this application, the target screen includes a first area and a second area; the situation in which the target screen stops displaying the first prompt information includes: the sliding position of the target sliding operation is in the second area; displaying the first prompt information includes: displaying the first prompt information when the sliding position of the target sliding operation is in the first area.

[0047] For example, the first region and the second region can be respectively Figure 4a , Figure 4b , Figure 4c Region 1 and Region 2 are shown in the diagram.

[0048] The initial prompt reflects the impact of the user's real-time swipe position changes on the displayed content. This eliminates the need for users to memorize the screen areas corresponding to different content; instead, they can accurately determine when to end the swipe by referring to the prompt, thus precisely accessing the desired content. Because this allows users to quickly and accurately access the required content without increasing their memory burden, it enhances the user experience.

[0049] In one embodiment of this application, the target sliding operation includes a first sliding operation and a second sliding operation, wherein the sliding directions of the first sliding operation and the second sliding operation are opposite.

[0050] For example, the first swipe operation and the second swipe operation can be respectively Figure 4b The sliding operation shown can be either a downward slide or a re-slide upward slide, or they can be respectively... Figure 6a / Figure 6b The example shown illustrates either a swipe down or a swipe up. In this way, the terminal device can repeatedly switch the content to be displayed while the user is swiping.

[0051] By supporting multiple switching, terminal devices allow users to quickly access the desired content by adjusting the current swipe operation (such as swiping up again after swiping down) in case of accidental operation or temporary change of needs, without having to perform the swipe operation again. This simplifies user operation and improves user experience.

[0052] In one embodiment of this application, the first prompt information is further used to indicate that if the swiping is stopped without displaying the first prompt information, a second information will be displayed. This allows users to know in advance what content will be displayed after the switch based on the real-time changes of the first prompt information, and thus accurately decide whether to stop or continue swiping as needed.

[0053] For example, in Figure 5a In the example shown, the first prompt message may include not only image 502 (see details) Figure 5a2This can be used to prompt the display of the notification center if the current swipe ends, and may also include image 509 (see details). Figure 5a2 This prompts the user to switch to displaying the control center if they stop swiping.

[0054] Understandably, the first prompt message may include thumbnails of both the first and second information, with each thumbnail having a different prompting effect within the first prompt message. Similarly, the second prompt message may also include thumbnails of both the first and second information, with each thumbnail having a different prompting effect within the second prompt message. Not displaying the first prompt message does not mean that these two thumbnails are not displayed.

[0055] In this embodiment, the first prompt reflects the impact of the user's real-time swiping position changes on the switching of content to be displayed. Therefore, the user does not need to remember the screen areas corresponding to different content to be displayed; instead, they can accurately determine when to end the swipe by checking the first prompt, thus accurately accessing the desired content. Since this allows users to quickly and accurately access the desired content without increasing their memory burden, the user experience is improved.

[0056] In one embodiment of this application, the first prompt information includes a thumbnail of the first information and a thumbnail of the second information, and the size of the thumbnail of the first information is larger than the size of the thumbnail of the second information, so that the user can intuitively distinguish between the two prompt information.

[0057] For example, see Figure 5a As shown in the example, when the user swipes within the top area of ​​the screen, the notification center thumbnail is larger than the control center thumbnail, as in image 502 (see details). Figure 5a2 The image size is larger than image 509 (see details). Figure 5a2 The image size is adjusted so that users know whether ending the swipe will bring up the notification center or continuing to swipe will switch to the control center.

[0058] When the user swipes within the bottom area of ​​the screen, the control center thumbnail is larger than the notification center thumbnail, for example, image 504 (see details). Figure 5a5 The image size is larger than image 511 (see details). Figure 5a5 The image size is adjusted so that users know that ending the swipe will bring up the control center, while swiping up again will switch to the notification center.

[0059] In one embodiment of this application, the device control method further includes: displaying a notification message summary panel when the control center is displayed but the notification center is not displayed; and displaying a summary of the notification messages in the notification center in the notification message summary panel.

[0060] Optionally, the summary of the notification message can be the application icon of the application from which the notification message originated.

[0061] See Figure 9 When displaying the control center, the terminal device can also display the notification message summary panel 901 on the top of the control center. The notification message summary panel 901 can display information such as the summary of each notification message in the notification center and the total number of notification messages.

[0062] By displaying a notification message summary panel simultaneously with the control center, users can easily access the general information about the notification center when they call it out, without significantly affecting the display effect of the control center.

[0063] In one embodiment of this application, after displaying a summary of the notification message in the notification center, the device control method further includes: in response to a trigger operation on the notification message summary panel, displaying the notification center, or simultaneously displaying the notification center and the control center, to meet the user's need to view the notification message.

[0064] For example, if the user clicks Figure 9 The notification message summary panel 901 shown in the image allows the phone to display... Figure 9 The interface shown has switched to display. Figure 7a The interface shown.

[0065] In one embodiment of this application, displaying a first prompt message in response to a target swipe operation includes: detecting whether the notification center includes a notification message in response to the target swipe operation; and displaying the first prompt message if the notification center includes a notification message. Based on this, the device control method further includes: displaying a control center and displaying information to prompt that the notification center does not include a notification message if the notification center does not include a notification message.

[0066] Optionally, when displaying the control center, the terminal device may also display a prompt message indicating that the notification center is empty, such as displaying the prompt message above the control center.

[0067] When the notification center is empty, users typically do not need to, and do not require, to call up the notification center. Therefore, by always displaying the control center when the notification center is empty, without switching the content to be displayed, the terminal device can avoid the user's experience being affected by calling up the empty notification center.

[0068] In one embodiment of this application, displaying a first prompt message in response to a target swipe operation includes: displaying the first prompt message when the terminal device meets a first condition in response to the target swipe operation; the device control method further includes: displaying a notification center and a control center simultaneously when the target swipe operation ends in response to a target swipe operation when the terminal device meets a second condition.

[0069] The first condition for a terminal device to meet this condition includes: the resolution of the target screen is not greater than a first threshold. For example, the target screen could be the screen of a smartwatch, the outer screen of a foldable phone, etc.

[0070] Alternatively, the terminal device meeting the first condition includes: the target screen's resolution being greater than a first threshold and not greater than a second threshold, and the target screen's aspect ratio being not less than a third threshold. For example, the target screen could be the screen of a non-foldable phone in portrait mode, the folded screen of a left-right folding phone in portrait mode, or the single-screen screen of a left-right tri-folding phone in portrait mode, etc.

[0071] The second condition for the terminal device to meet the requirement includes: the resolution of the target screen is greater than the second threshold. For example, the target screen can be a tablet screen, a PC touch screen, the unfolded screen of a left-right folding phone, the dual-screen screen of a left-right tri-folding phone, or the triple-screen screen of a left-right tri-folding phone, etc.

[0072] Alternatively, the terminal device may meet the second condition, including: the target screen's resolution being greater than the first threshold and not greater than the second threshold, and the target screen's aspect ratio being less than the third threshold. For example, the target screen could be the screen of a non-foldable phone in landscape mode, the folded screen of a left-right folding phone in landscape mode, or the single-screen screen of a left-right tri-folding phone in landscape mode, etc.

[0073] This embodiment helps to simplify user operations while ensuring display quality by differentiating between different types of terminal devices.

[0074] The specific technical implementation of any of the methods in the first aspect above can be found in the relevant technical descriptions in other embodiments of this application, and will not be repeated here.

[0075] Secondly, embodiments of this application provide a device control apparatus applied to a terminal device, comprising: a detection module for detecting a target swipe operation on a target screen, the target screen being the screen of the terminal device in a working state; a first processing module for responding to the target swipe operation by displaying a first prompt message, the first prompt message indicating that if the swipe ends, first information will be displayed, the first information being either a notification center or a control center; a second processing module for detecting the end of the target swipe operation when the first prompt message is displayed on the target screen, and then displaying the first information; and / or, detecting the end of the target swipe operation when the first prompt message is no longer displayed on the target screen, and then displaying second information, the second information being either a notification center or a control center.

[0076] Thirdly, embodiments of this application provide a chip, including: a processor, which is configured to execute computer program instructions stored in a memory, wherein when the computer program instructions are executed by the processor, the chip is triggered to execute the method as described in any of the first aspects.

[0077] Fourthly, embodiments of this application provide a terminal device, which includes one or more memories for storing computer program instructions and one or more processors, wherein when the computer program instructions are executed by one or more processors, the terminal device is triggered to execute the method as described in any of the first aspects.

[0078] Fifthly, embodiments of this application provide a computer-readable storage medium storing a computer program that, when run on a computer, causes the computer to perform the method as described in any of the first aspects.

[0079] In a sixth aspect, embodiments of this application provide a computer program product, which includes a computer program that, when run on a computer, causes the computer to perform the method as described in any of the first aspects.

[0080] The technical effects of the aforementioned aspects can be referenced from each other, and will not be elaborated further here. Attached Figure Description

[0081] To more clearly illustrate the technical solutions of the embodiments of this application, the accompanying drawings used in the embodiments will be briefly described below.

[0082] Figure 1 A diagram illustrating one implementation method for allowing users to simultaneously access the control center and notification center;

[0083] Figures 2a-2c A schematic diagram illustrating one implementation method for allowing users to separately call up the control center and notification center;

[0084] Figure 3 Schematic diagram of a terminal device provided in some embodiments of this application;

[0085] Figures 4a-4c This is a schematic diagram illustrating how users can call up different content in some embodiments of this application;

[0086] Figure 5a , Figures 5a1 to 5a5 , Figure 5b , Figures 5b1 to 5b5 A schematic diagram of the interface of a terminal device responding to a user's swipe gesture, provided in some embodiments of this application;

[0087] Figures 6a-6b A schematic diagram of a terminal device responding to a user's swipe gesture, provided for other embodiments of this application;

[0088] Figures 7a-7b This application provides schematic diagrams illustrating the display interface of a notification center for some embodiments.

[0089] Figures 8a-8b This application provides schematic diagrams illustrating the control center's interface in some embodiments.

[0090] Figure 9 This is a schematic diagram of the display interface of the control center provided in another embodiment of this application;

[0091] Figures 10-12 A flowchart illustrating a user intent-based device control process provided for some embodiments of this application;

[0092] Figure 13a A flowchart illustrating a user intent-based device control process provided in another embodiment of this application;

[0093] Figures 13b-13c This application provides schematic diagrams illustrating the display interface of the notification center for other embodiments.

[0094] Figure 14 A schematic flowchart illustrating a device control method provided in one embodiment of this application;

[0095] Figure 15 This is a schematic diagram of the structure of a terminal device provided in one embodiment of this application;

[0096] Figure 16 This is a schematic diagram of the software architecture of a terminal device provided in one embodiment of this application. Detailed Implementation

[0097] To better understand the technical solution of this application, the embodiments of this application will be described in detail below with reference to the accompanying drawings.

[0098] It should be understood that the described embodiments are merely some, not all, of the embodiments in this application. All other embodiments obtained by those skilled in the art based on the embodiments in this application without inventive effort are within the scope of protection of this application.

[0099] The terminology used in the embodiments of this application is for the purpose of describing particular embodiments only and is not intended to be limiting of this application. The singular forms “a,” “the,” and “the” used in the embodiments of this application and the appended claims are also intended to include the plural forms unless the context clearly indicates otherwise.

[0100] It should be understood that the term "at least one" as used in this document refers to one or more, and "more than one" refers to two or more. The term "and / or" as used in this document is merely a description of the relationship between related objects, indicating that three relationships can exist. For example, A and / or B can represent: A alone, A and B simultaneously, and B alone. A and B can be singular or plural. Additionally, the character " / " in this document generally indicates that the preceding and following related objects are in an "or" relationship. "At least one of the following" and similar expressions refer to any combination of these items, including any combination of singular or plural items. For example, at least one of a, b, and c can represent: a, b, c, ab, ac, bc, or abc, where a, b, and c can be single or multiple.

[0101] It should be understood that although the terms "first," "second," etc., may be used to describe the set thresholds in the embodiments of this application, these set thresholds should not be limited to these terms. These terms are only used to distinguish the set thresholds from each other. For example, without departing from the scope of the embodiments of this application, the first set threshold may also be referred to as the second set threshold, and similarly, the second set threshold may also be referred to as the first set threshold.

[0102] As smart devices become increasingly feature-rich and physical buttons become fewer, human-computer interaction methods are becoming more complex. Optionally, terminal devices can support users to simultaneously call up (or open) the control center and notification center with a single operation. For example, if a user swipes down from the top of the screen, the terminal device can display both the control center and notification center simultaneously, arranged vertically.

[0103] The notification center displays all notification messages on the terminal device, while the control center displays all control buttons that support quick settings for the device system. By simultaneously displaying both the control center and the notification center, the terminal device allows users to conveniently use either one as needed.

[0104] For example, see Figure 1If a user swipes down from the top of the phone screen to perform a swipe gesture A, the phone will simultaneously display the Control Center and the Notification Center, with the Control Center located above the Notification Center.

[0105] Because terminal devices need to display both the control center and notification center simultaneously, the display areas for both on the screen are relatively small. Furthermore, displaying both simultaneously results in a long display panel, especially when there are many control buttons in the control center or many notification messages in the notification center, making it inconvenient for users to operate. For example, with many control buttons and notification messages, users may not be able to see the entire list of control buttons or notification messages.

[0106] In this way, when faced with an increasing number of control buttons in the control center and an increasing number of notification messages in the notification center, the terminal device can support users to call up the control center / notification center through different operations.

[0107] In one feasible implementation, the terminal device supports users calling up the control center / notification center from different positions at the top of the screen. For example, the terminal device may support users swiping down from the top / top left of the screen to call up the notification center, swiping down from the top right corner of the screen to call up the control center, or swiping down from the top left of the screen to call up the notification center and swiping down from the top right of the screen to call up the control center.

[0108] After a user calls up the control center / notification center from different locations, the terminal device also supports switching between the control center and notification center if the user swipes left or right on the screen, in order to meet the needs of users to avoid accidental operation and easy one-handed operation.

[0109] For example, see Figure 2a If a user swipes down from the top left of the phone screen to perform swipe gesture B, the phone will display the notification center. While the notification center is displayed, if the user needs to access the control center, they can swipe left or right on the screen to switch from displaying the notification center to displaying the control center. Alternatively, they can swipe up to return and then swipe down from the top right of the screen to display the control center.

[0110] If a user swipes down from the top right of the phone screen to perform a swipe gesture (C), the phone can display the Control Center. While the Control Center is displayed, if the user needs to access the Notification Center, they can swipe left or right on the screen to switch the display to the Notification Center. Alternatively, they can swipe up to return and then swipe down from the top left of the screen to display the Notification Center.

[0111] As can be seen, compared to displaying the Control Center and Notification Center simultaneously, the above implementation increases the display area of ​​the Control Center / Notification Center on the screen by displaying them separately, avoiding a long display panel and facilitating user operation. However, users need to remember the specific locations to access the Control Center / Notification Center, and there are issues with accidental triggering and inconvenience for one-handed operation (e.g., difficulty in reaching the top right side of the screen with the left hand), leading to difficulties in use. If a user accidentally triggers the control center / notification center, they need to perform another operation, such as swiping left / right to switch, or swiping up to return and then swiping down again from the correct location to access the desired content, which impacts the user experience.

[0112] In another feasible implementation, the terminal device supports the user to call up the notification center when swiping down from the top of the screen for the first time, and a small number of control buttons can also be displayed on the notification panel (i.e., a part of the control center is displayed). When the user swipes down from the top of the screen / on the screen again, the control center is called up.

[0113] For example, see Figure 2b If a user swipes down from the top of the screen for the first time to perform a swipe gesture D, the phone will simultaneously display a few control buttons and the notification center. If the user needs to view / set other buttons in the control center, they can swipe down again on the screen to perform a swipe gesture E, at which point the phone will display the control center.

[0114] For example, see Figure 2c When a phone receives a notification message, it can display a corresponding indicator icon on the status bar to remind the user. To view more information about the icon, the user can swipe down from the top of the phone screen to drag the status bar down, which will display a notification panel 201. The notification panel 201 displays a few control buttons 203 and a notification center 204, allowing the user to view notification message details, view / set the various control buttons, and use other controls shown on the notification panel 201 (such as system settings controls, "notification settings" controls, etc.).

[0115] When the notification panel 201 is displayed on the phone, the user can swipe up on the phone screen to close the notification panel 201, or swipe down on the phone screen again to bring up the control panel 202, which displays the control center.

[0116] As can be seen, in the above implementation method, users need to perform two swipe operations to bring up the control center, which is cumbersome and affects the user experience.

[0117] The following describes some embodiments of this application. The implementation methods and beneficial effects of different embodiments can be referred to each other. Although described separately, multiple embodiments can be implemented simultaneously on the same terminal device, and this application does not limit this.

[0118] In one embodiment of this application, the terminal device can display different content at different times when the user performs a target swipe operation on the target screen. That is, the content to be displayed by the terminal device (such as the control center / notification center) can be switched during the swipe. Here, the target screen is the screen of the terminal device in its working state, that is, the screen currently used by the terminal device.

[0119] For example, if the target swipe operation ends at a certain moment, the terminal device displays the control center; if the target swipe operation continues and ends at another moment, the terminal device displays the notification center. These two moments represent different feasible end times for a single swipe operation, not the individual end times of two separate swipe operations. In this way, the terminal device supports users in accessing the control center / notification center on demand using the same swipe operation, i.e., a unified swipe gesture, and also supports users in accessing the control center / notification center with a single swipe operation.

[0120] Optionally, the notification center can be empty (i.e., no new notification messages) or not; there is no limitation on this. New notification messages can refer to notification messages that the terminal device has received but the user has not yet acknowledged as received, such as notification messages that the terminal device has received but has not yet displayed to the user.

[0121] In other embodiments of this application, when the notification center is empty, the terminal device can always display the control center when the user performs a target swipe operation, without switching the content to be displayed. Optionally, when displaying the control center, the terminal device can also display a prompt message indicating that the notification center is empty, for example, the prompt message can be displayed above the control center.

[0122] When the notification center is empty, users typically do not need to, and do not require, to call up the notification center. Therefore, by always displaying the control center when the notification center is empty, without switching the content to be displayed, the terminal device can avoid the user's experience being affected by calling up the empty notification center.

[0123] Optionally, the terminal device may include one or more screens, and the folding attribute of the screen may be foldable or non-foldable.

[0124] Optionally, the target swipe operation could be, for example, a swipe down from the top of the target screen. Taking a non-foldable phone as an example, when the phone is in portrait mode, the top of the target screen is located at the top of the phone; when the phone is in landscape mode, the top of the target screen is located on the left / right side of the phone. The top of the phone is the side of the phone closest to the front-facing camera.

[0125] Optionally, the target sliding operation can be a continuous sliding operation or a continuous sliding operation with intervals, without limitation.

[0126] In some embodiments of this application, the aforementioned terminal device can be any terminal device, meaning that any terminal device can display different content at different times after the user performs a target swipe operation on the target screen. Thus, the target screen can be the screen of a non-foldable phone (e.g., Figure 3 The screen shown is 301), the external screen of a clamshell (or flip-up) phone (e.g., Figure 3 Screen 303 shown), the inner screen of a vertically folding phone (e.g., Figure 3 The screen shown is 302), and the outer screen of a left-right folding phone (e.g., Figure 3 The screen shown is 305), the inner screen of a left-right folding phone (e.g., Figure 3 The screen shown is 304), the screen of a left-right folding phone in its unfolded state (e.g., Figure 3 The screen shown is 306), and the screen of a left-right folding phone in its folded state (e.g., Figure 3 The screen shown is 307), a single-screen display of a left-right tri-folding phone, a dual-screen display of a left-right tri-folding phone, a triple-screen display of a left-right tri-folding phone, and a touchscreen of a smartwatch (e.g., Figure 3 Screen 308 shown), the touchscreen of a tablet computer (e.g.) Figure 3 The screen shown is 309), and the PC's touchscreen (e.g.) Figure 3 Screen 310 is shown, etc. Among them, screen 307 is a part of screen 306.

[0127] In other embodiments of this application, when a user performs a target swipe operation on a target screen, if the terminal device meets a first condition, it will display different content at different swipe end times; if the terminal device meets a second condition, it will simultaneously display the control center and the notification center at the end of the swipe, meaning that the content to be displayed will not be switched during the swipe process.

[0128] In one embodiment, the terminal device satisfying the first condition may include the target screen's resolution not exceeding a first threshold. For example, the target screen could be the screen of a smartwatch, the outer screen of a foldable phone, etc.

[0129] In one embodiment, the terminal device satisfying the first condition may include the target screen's resolution being greater than a first threshold and not greater than a second threshold, and the target screen's aspect ratio being not less than a third threshold. For example, the target screen may be the screen of a non-foldable phone in portrait mode, the folded screen of a left-right folding phone in portrait mode, or the single-screen screen of a left-right tri-folding phone in portrait mode, etc.

[0130] The screen aspect ratio is the ratio of the screen length to the screen width. The screen length is the distance from the top to the bottom of the screen, and the screen width is the distance between the two sides of the screen.

[0131] If the terminal device meets the first condition, it means that the terminal device cannot provide a good display effect when displaying the control center and the notification center at the same time. In this case, the control center and the notification center can be displayed separately to ensure the display effect.

[0132] In one embodiment, the terminal device satisfying the second condition may include: the resolution of the target screen is greater than a first threshold and not greater than a second threshold (the second threshold is greater than the first threshold), and the aspect ratio of the target screen is less than a third threshold. For example, the target screen may be the screen of a non-foldable phone in landscape mode, the folded screen of a left-right folding phone in landscape mode, or the single-screen screen of a left-right tri-folding phone in landscape mode, etc.

[0133] Optionally, in this embodiment, the terminal device can display the control center and the notification center simultaneously in a left-right arrangement.

[0134] In one embodiment, the terminal device satisfying the second condition may include: the resolution of the target screen is greater than a second threshold. For example, the target screen may be a tablet screen, a PC touchscreen, the unfolded screen of a left-right folding phone, the dual-screen screen of a left-right tri-folding phone, or the triple-screen screen of a left-right tri-folding phone, etc.

[0135] Optionally, in this embodiment, the terminal device can display the control center and the notification center simultaneously in a top-bottom or left-right distribution manner.

[0136] If the terminal device meets the second condition, it means that the terminal device can provide a good display effect when displaying the control center and the notification center at the same time. In this way, the control center and the notification center can always be displayed at the same time, so as to simplify user operation while ensuring the display effect.

[0137] In some embodiments of this application, when a user performs a target swipe operation on a target screen, if the terminal device meets the second and third conditions, different content will be displayed at different swipe end times; if the terminal device meets the second condition but not the third condition, the control center and notification center will be displayed simultaneously at the end of the swipe.

[0138] The third condition may include: the difference between the probability that the user expects to call the control center and the probability that the user expects to call the notification center is greater than a difference threshold. This probability can be obtained by judging the user's intent. The specific technical implementation for judging the user's intent can be found in the relevant descriptions in other embodiments of this application, and will not be described in detail here.

[0139] For example, if the probability of a user calling the control center is 90% and the probability of a user calling the notification center is 10%, then the terminal device meets the third condition. If the terminal device also meets the second condition, then the terminal device displays different content at different times when the swipe ends.

[0140] For example, if the probability of a user expecting to call the control center and the probability of a user expecting to call the notification center are both 50%, then the terminal device does not meet the third condition. If the terminal device also meets the second condition, then the terminal device will display both the control center and the notification center when the swipe ends.

[0141] Optionally, the switching of the content to be displayed on the terminal device (i.e., the content displayed when the user ends the swipe) may depend on factors such as the position of the user's swipe, the time taken, and the pressure applied to the touchscreen.

[0142] In one embodiment, different screen regions can be divided, for example... Figure 4a / Figure 4b The areas shown are 1 and 2. Figure 4c As shown in areas 1 to 3, the terminal device decides whether to switch the content to be displayed based on different screen areas. For example, if the user's swipe from the top of the target screen ends in one screen area, the terminal device will display either the control center or the notification center; if the user's swipe ends in another screen area, the terminal device will display the other screen area.

[0143] For example, see Figure 4a If the user swipes down from point F1 at the top of the screen to point F2 and then stops swiping, the phone displays the control center. If the user swipes down from point F1 to point F3 and then stops swiping, the phone displays the notification center.

[0144] For example, see Figure 4b If the user swipes down from point G1 at the top of the screen to point G2 and then stops swiping, the phone displays the notification center. If the user swipes down from point G1 to point G3 and then stops swiping, the phone displays the control center.

[0145] For example, see Figure 5a As shown in the example, if the user swipes down from the top of the screen to any position within the upper part of the screen and then ends the swipe, the phone displays the notification center, and the display interface can be as follows: Figure 7a As shown, if the user swipes down from the top of the screen to any position in the bottom area and then stops swiping, the phone displays the control center, and the interface can be as follows: Figure 8a As shown.

[0146] For example, see Figure 5bAs shown in the example, if the user swipes down from the top of the screen to any position within the upper part of the screen and then ends the swipe, the phone displays the control center, and the interface can be as follows: Figure 8a As shown, if the user swipes down from the top of the screen to any position in the bottom area and then stops swiping, the phone displays the notification center, and the display interface can be as follows: Figure 7a As shown.

[0147] See Figure 7a By displaying the notification center separately, users can easily view as many notification messages as possible, such as the complete notification message. This facilitates user operation, such as viewing the details of any notification message as needed. See also Figure 8a By displaying the control center separately, users can easily see as many control buttons as possible, such as a complete set of control buttons, which facilitates user operation, such as viewing / setting the status of any control button as needed.

[0148] exist Figure 2a In the example shown, the swipe gesture B used to access the notification center and the swipe gesture C used to access the control center are different gestures, and their starting positions (i.e., gesture origins) must differ. In contrast, in... Figure 4a / Figure 4b / Figure 5a / Figure 5b In the example shown, the swipe gesture used to bring up the notification center and the swipe gesture used to bring up the control center are the same gesture. The starting position of the swipe to bring up the control center / notification center does not need to be distinguished, for example, it can be any position at the top of the target screen.

[0149] As can be seen, in this embodiment, the operation of calling the control center and the operation of calling the notification center are the same operation (without distinguishing the starting position of the swipe), rather than... Figure 2a The different operations shown in the implementation (distinguishing between the starting positions of the slide) may not exist. Figure 2a The implementation shown has the following problems: users need to remember the starting position of the swipe to call up the control center / notification center, it is easy to trigger accidentally, and it is inconvenient to operate with one hand.

[0150] exist Figure 2b / Figure 2c In the example shown, the user needs to swipe down twice to access the control center. In contrast, in... Figure 4a / Figure 4b / Figure 5a / Figure 5b In the example shown, the user can bring up the control center by swiping down once.

[0151] As can be seen, in this embodiment of the application, the user can call up the control center / notification center with a single operation, rather than... Figure 2b / Figure 2c The implementation shown requires two steps to bring up the control center, which simplifies user operations and improves the user experience.

[0152] For example, see Figure 4c If the user swipes down from point H1 at the top of the screen to point H2 and then stops swiping, the phone displays the control center. If the user swipes down from point H1 to point H3 and then stops swiping, the phone displays the notification center. If the user swipes down from point H1 to point H4 and then stops swiping, the phone displays both the notification center and the control center.

[0153] exist Figure 1 In the example shown, a user performing a swipe gesture can only bring up both the Control Center and Notification Center simultaneously; it cannot bring up the Control Center / Notification Center separately. This differs from other examples. Figure 4c In the example shown, when a user performs a swipe gesture, they can choose to call up the control center alone, the notification center alone, or both the control center and the notification center simultaneously, thus allowing the content displayed to meet the user's personalized needs.

[0154] In one embodiment, different time intervals can be set, such as less than n seconds (n can be 1, 2, 3, etc.) and not less than n seconds, or each second can be a time interval. The terminal device decides whether to switch the content to be displayed based on different time intervals. For example, if the time taken for the user to swipe down from the top of the target screen falls within a certain time interval, the terminal device displays either the control center or the notification center; if the time taken for the user to swipe down from the top of the target screen falls within another time interval, the terminal device displays the other of the control center and the notification center.

[0155] Optionally, during the user's target swipe operation, the terminal device can switch the content to be displayed once or multiple times. The number of switches can depend on the settings of the aforementioned influencing factors, such as setting two time intervals: less than 1 second and not less than 1 second, or a time interval of 1 second. It can also depend on the swipe trajectory, swipe duration, etc., for example, in a single swipe operation, the user can simply swipe down, swipe down first and then swipe up, or switch between swipe up and swipe down. The swipe trajectory can be determined by the user as needed.

[0156] By supporting multiple switching, terminal devices allow users to quickly access the desired content by adjusting the current swipe operation (such as swiping up again after swiping down) in case of accidental operation or temporary change of needs, without having to perform the swipe operation again. This simplifies user operation and improves user experience.

[0157] For example, see Figure 4bIf the user swipes down from point G1 to point G2 and then stops swiping, the phone displays the notification center. If the user swipes down from point G1 to point G3 and then stops swiping, the phone displays the control center. If the user swipes up from point G1 to point G3 and then swipes back up to point G4 and stops swiping, the phone displays the notification center.

[0158] For example, see Figure 6a As shown in the example, if the user swipes down directly from the top of the screen, then swipes up again after swiping down, or swipes down again after swiping up to any position within the upper part of the screen, the phone displays the notification center. If the user swipes down directly from the top of the screen, then swipes up again after swiping down, or swipes down again after swiping up to any position within the lower part of the screen, the phone displays the control center.

[0159] like Figure 6a As shown in the example, when the user swipes down from the top of the screen to the bottom, the content to be displayed switches from the Notification Center to the Control Center; conversely, when the user swipes up from the bottom of the screen to the top, the content to be displayed switches back from the Control Center to the Notification Center.

[0160] See Figure 6b As shown in the example, if the user swipes down directly from the top of the screen, then swipes up again after swiping down, or swipes down again after swiping up to any position within the upper part of the screen, the phone displays the control center. If the user swipes down directly from the top of the screen, then swipes up again after swiping down, or swipes down again after swiping up to any position within the lower part of the screen, the phone displays the notification center.

[0161] like Figure 6b As shown in the example, when the user swipes down from the top of the screen to the bottom, the content to be displayed switches from the Control Center to the Notification Center; conversely, when the user swipes up from the bottom of the screen to the top, the content to be displayed switches back from the Notification Center to the Control Center.

[0162] Optionally, the terminal device can display a prompt message 'a' during the user's target swipe operation, indicating the content the terminal device will display if the user ends the swipe. This allows the user to know the content to be displayed based on the real-time changes of the prompt message 'a', thus enabling them to choose when to end the swipe as needed and avoiding accidental user operations.

[0163] Taking the example that switching the content to be displayed on a terminal device depends on the swipe position, the prompt message 'a' reflects the impact of the user's real-time swipe position changes on the displayed content. Therefore, users don't need to remember the screen areas corresponding to different content to be displayed; they can accurately determine when to stop swiping simply by checking prompt message 'a, thus accurately accessing the desired content. Since this allows users to quickly and accurately access the desired content without increasing their memory burden, it improves the user experience.

[0164] In one embodiment, the prompt message 'a' can be a thumbnail of the content displayed by the terminal device if the current swipe ends.

[0165] For example, see Figure 5a As shown in the example, when the user swipes to any position in the upper area of ​​the screen, the notification message 'a' is a thumbnail of the notification center, for example... Figure 5a Images 501 to 503 in the example shown (see details) Figure 5a1 ~See details Figure 5a3 When the user swipes to any position in the bottom area of ​​the screen, the prompt message 'a' is a thumbnail of the control center, for example... Figure 5a Image 504 in the example shown (see details) Figure 5a5 ).

[0166] See Figure 5b As shown in the example, when the user swipes to any position in the upper area of ​​the screen, the prompt message 'a' is a thumbnail of the control center, for example... Figure 5b Images 505 to 507 in the example shown (see details) Figures 5b1 to 5b3 When the user swipes to any position in the bottom area of ​​the screen, the notification message 'a' is a thumbnail of the notification center, for example... Figure 5b Image 508 in the example shown (see details) Figure 5b5 ).

[0167] Optionally, during the user's target swipe operation, the terminal device can display not only prompt message a, indicating the content to be displayed if the user ends the swipe, but also prompt message b, indicating the content to be switched if the user continues swiping. This allows the user to know in advance the content to be displayed based on the real-time changes in prompt message b, thus enabling them to accurately decide whether to end or continue swiping as needed.

[0168] Taking the switching of content to be displayed on a terminal device depending on the swipe position as an example, prompt message 'b' reflects the impact of the user's real-time swipe position changes on the switching of content to be displayed. Therefore, users do not need to remember the screen areas corresponding to different content to be displayed; instead, they can accurately determine when to end the swipe by checking prompt message 'b, thus accurately accessing the desired content. Since this allows users to quickly and accurately access the desired content without increasing their memory burden, it improves the user experience.

[0169] In one embodiment, the prompt message b can be a thumbnail of the content that the terminal device will switch to display if the swipe continues.

[0170] For example, see Figure 5aAs shown in the example, when the user swipes to any position in the upper area of ​​the screen, the prompt message 'b' is a thumbnail of the control center, for example... Figure 5a Image 509 in the example shown (see details) Figure 5a2 Image 510 (see details) Figure 5a3 When the user swipes to any position in the bottom area of ​​the screen, the notification message b is a thumbnail of the notification center, for example... Figure 5a Image 511 in the example shown (see details) Figure 5a5 ).

[0171] See Figure 5b As shown in the example, when the user swipes to any position in the upper part of the screen, the notification message b is a thumbnail of the notification center, such as... Figure 5b Images 512-513 in the example shown (see details) Figures 5b2-5b3 When the user swipes to any position in the bottom area of ​​the screen, the prompt message b is a thumbnail of the control center, for example... Figure 5b Image 514 in the example shown (see details) Figure 5b5 ).

[0172] Optionally, the image size of prompt a can be larger than the image size of prompt b, so that users can intuitively distinguish between the two prompts.

[0173] For example, see Figure 5a As shown in the example, when the user swipes within the top area of ​​the screen, the notification center thumbnail is larger than the control center thumbnail, as in image 502 (see details). Figure 5a2 The image size is larger than image 509 (see details). Figure 5a2 Image size, image 503 (see details) Figure 5a3 The image size is larger than image 510 (see details). Figure 5a3 The image size is adjusted so that users know that ending the swipe will bring up the Notification Center, while continuing to swipe will switch to the Control Center. When the user's swipe is located in the lower area of ​​the screen, the Control Center thumbnail is larger than the Notification Center thumbnail, for example, image 504 (see details). Figure 5a5 The image size is larger than image 511 (see details). Figure 5a5 The image size is adjusted so that users know that ending the swipe will bring up the control center, while swiping up again will switch to the notification center.

[0174] Optionally, the image sizes of both prompt a and prompt b can gradually change, so that users can intuitively perceive when the terminal device switches the content to be displayed, and thus accurately decide to end / continue scrolling as needed.

[0175] For example, see Figure 5aAs shown in the example, as the user swipes down from the top of the screen to the middle, the image size of the notification message a (i.e., the thumbnail of the notification center) gradually increases to present a dynamic effect of calling up the notification center; as the user swipes down from the middle of the screen to the top, the image size of the notification message a (i.e., the thumbnail of the control center) gradually increases to present a dynamic effect of calling up the control center.

[0176] For example, see Figure 5a As shown in the example, as you swipe down from the top of the screen to the middle, the image size of the prompt message b (i.e., the control center thumbnail) gradually increases to indicate that continuing to swipe down will switch the content to be displayed, and the content to be displayed after the switch is the control center; as you swipe up from the bottom of the screen to the middle, the image size of the prompt message b (i.e., the notification center thumbnail) gradually increases to indicate that continuing to swipe up will switch the content to be displayed, and the content to be displayed after the switch is the notification center.

[0177] Optionally, the terminal device can display a switching animation when changing the content to be displayed, so that users can intuitively perceive when the terminal device switches the content to be displayed. For example, in Figure 5a In the example shown, one of the interfaces for switching animation effects can be like interface 515 (see details). Figure 5a4 As shown in ), Figure 5b In the example shown, one of the interfaces for switching animation effects can be like interface 516 (see details). Figure 5b4 As shown in the image, the switching animation can provide an animated flipping effect.

[0178] Optionally, each frame in the transition animation can include thumbnails of the content to be displayed before and after the transition, to make the interface change during the transition smoother. For example... Figure 5a and Figure 5b As shown in the example, each frame of the switching animation can include a thumbnail from the notification center and a thumbnail from the control center.

[0179] See Figure 5a and Figure 5b As shown in the example, when a user swipes from the top of the screen to the bottom, the phone can display a transition animation as the user swipes to the middle of the screen.

[0180] In one embodiment, when displaying the control center instead of the notification center, the terminal device may display a notification message summary panel, which displays a summary of the notification messages in the notification center, the total number of notification messages, etc.

[0181] Optionally, the summary of the notification message can be the application icon of the source application of the notification message, and the notification message summary panel can also display the number of notification messages for each application.

[0182] Optionally, the terminal device may display a notification message summary panel on the top of the control center.

[0183] For example, in Figure 5a / Figure 5b / Figure 6a / Figure 6b In the example shown, the notification center includes 7 notification messages, and the source applications of these 7 notification messages are applications 1 to 5, respectively. The display interface of the control center can then be as follows: Figure 9 As shown. See also Figure 9 The terminal device can display the control center and notification message summary panel 901. The notification message summary panel 901 displays the application icons of each source application of the 7 notification messages, the number of notification messages of each source application, and the total number of notification messages.

[0184] By displaying a notification message summary panel simultaneously with the control center, users can easily access the general information about the notification center when they call it out, without significantly affecting the display effect of the control center.

[0185] In one embodiment, the terminal device can switch from displaying the control center to displaying the notification center, or switch to displaying both the control center and the notification center simultaneously, when the user triggers the notification message summary panel. Optionally, the terminal device can also display a switching animation during the switch. For example, if the user clicks... Figure 9 The notification message summary panel 901 shown in the image allows the phone to display... Figure 9 The interface shown has switched to display. Figure 7a The interface shown will display a switching animation during transitions. For example, one of the interfaces with the switching animation could be... Figure 5a Interface 515 in the example shown (see details) Figure 5a4 ).

[0186] In one embodiment, when a user triggers any application icon in the notification message summary panel, the terminal device can switch from displaying the control center to displaying various notification messages of that application, or switch to displaying the application's interface. For example, if the user clicks... Figure 9 The phone can display the icon of application 1 in the notification message summary panel 901. Figure 9 The interface shown has switched to display the application interface of application 1.

[0187] Optionally, when a user performs a target swipe operation, the terminal device can determine the user's intent based on the context information of the terminal device. For example, it can determine the content the user expects to call up or the control buttons the user expects to set, and respond to the target swipe operation according to the determined user intent. Understandably, the user intent determined by the terminal device is the result of the terminal device's prediction (or inference) of the content the user expects to call up or the control buttons the user expects to set.

[0188] Optionally, based on the content the user expects to display as described by the user's intent, the terminal device can prioritize displaying information indicating that the content will be displayed if the current swipe ends at the start of the target swipe operation. This means it supports prioritizing the display of the predicted user-expected content, allowing the user to easily access it through simple operations (such as...). Figure 10 The short swipe down (as shown) allows users to quickly access the desired content without having to switch between different content displayed on the device, thus providing convenience for one-handed operation. See also... Figure 10 / Figure 11 The terminal device can determine the user's intention—the content the user expects to call out—based on the device's context information.

[0189] In one embodiment, when the terminal device meets the first condition, if it determines that the user expects to call the control center, the terminal device supports prioritizing the call to the control center; if it determines that the user expects to call the notification center, the terminal device supports prioritizing the call to the notification center.

[0190] In one embodiment, when the terminal device meets the second condition, if it determines that the user expects to call the control center, the terminal device supports prioritizing calling the control center; if it determines that the user expects to call the notification center, the terminal device supports prioritizing calling the notification center; if the probability that the user expects to call the control center and the probability that the user expects to call the notification center are not significantly different (for example, the absolute value of the difference between the two probabilities is less than the difference threshold), the terminal device supports prioritizing simultaneous calls to the control center and the notification center.

[0191] Optionally, based on the user's expected settings described by the user's intent, the terminal device can display these control buttons at the end of the target swipe operation; that is, display the settings that the device system predicts the user is most likely to change their action on. See, for example... Figure 12 / Figure 13. The terminal device can determine the user's intention to set the control button based on the context information of the device.

[0192] In one embodiment, the terminal device can display these control buttons when displaying the notification center / control center to facilitate user operation. For example, a quick settings button panel can be displayed above the notification center / control center, and these control buttons can be displayed in the quick settings button panel. If, based on user intent determination, it is determined that there is no control button that the user expects to set, the quick settings button panel can be hidden (i.e., not displayed).

[0193] Instead of having users search through all the control buttons in the control center to find the control button they need to configure, displaying the control button that the user wants to configure along with the control center / notification center makes it easier for users to find the control button they need to configure, making button configuration simpler and easier to use.

[0194] In addition, by displaying the control buttons that the user expects to set when showing the notification center, it can also deal with situations such as incorrect judgment of user intent or temporary changes in user needs, so as to avoid causing users additional operation steps and troubles due to misjudgment of intent, and enable users to quickly modify the control buttons with fewer steps.

[0195] In one embodiment, the terminal device can display the control buttons associated with the notification message when displaying the notification center, for example, by displaying the associated control buttons on one side of the notification message. By presenting the control buttons that the user expects to set near the notification message, a more convenient and intuitive experience can be provided to the user, and situations such as errors in judging user intent or temporary changes in user needs can be addressed.

[0196] In some feasible implementations, besides displaying the desired control buttons at the end of the swipe, a prompt message can also be displayed during the swipe to indicate that the desired control buttons will be displayed if the swipe ends. For example, prompt message a above could include a thumbnail of the quick settings button panel, and prompt message b above could include a thumbnail of the quick settings button panel. This ensures consistency between the prompt message and the displayed content, improving the user experience.

[0197] Below, some embodiments of device control based on user intent will be described separately.

[0198] See Figure 10 One embodiment of this application provides a device control process based on user intent, which may include the following steps 1001 to 1005. The executing entity of this embodiment may be a terminal device such as a mobile phone.

[0199] Step 1001: Respond to the swipe-down gesture from the top of the screen.

[0200] Optionally, the terminal device can sense and detect various gestures performed by the user on the target screen. If a target swipe operation, such as a swipe gesture from the top of the screen, is detected, then step 1001 is executed.

[0201] Step 1002: Obtain the device's context information. The device's context information can include various information and states involved in the device's operation.

[0202] Optionally, the context information obtained in step 1002 may include whether a new notification message has been received within a preset time period, whether the notification center is empty, the content of the notification message in the notification center, the status of control buttons in the control center (such as airplane mode status, flashlight on / off status, network status, etc.), device battery level, light sensing results, and the execution frequency of the target swipe operation (such as whether it is executed more than twice in a short period of time). The network status may include, for example, the WiFi connection / disconnection status.

[0203] In one embodiment, the terminal device can collect the device's context information in real time when it detects a target swipe operation, and determine the user's intent based on the information collected in real time.

[0204] In another embodiment, the terminal device can periodically collect the device's context information and, upon detecting a target swipe operation, determine the user's intent based on the latest information collected (such as the last one or within a preset time period before the current moment).

[0205] In another embodiment, the terminal device can collect the device's context information when the device's context information changes based on preset collection rules, and determine the user's intent based on the latest collected information when a target swipe operation is detected.

[0206] By using contextual information collected before the target swipe action is detected, it is helpful to speed up the response time to the user's target swipe action.

[0207] Step 1003: The swipe gesture response decision system determines the user's intent. If the user's intent is to open the notification center, proceed to step 1004. If the user's intent is to open the control center, proceed to step 1005.

[0208] In one embodiment, the swipe gesture response decision system may include a user intent judgment model (or user intent prediction model), which can be used to automatically determine the user's current swipe intent based on the device's context information.

[0209] Optionally, the user intent determination model can be obtained through model training. For example, the algorithm used by the user intent determination model can be a decision tree, random forest, long short-term memory network (LSTM), etc.

[0210] Optionally, the sample set used to train the user intent judgment model may include multiple samples, and a sample may be one or more contextual information. The labels of the samples may include the content that the user expects to be called up and the control buttons that the user expects to set.

[0211] For example, a sample for model training is the context information "current battery level is 25%, not charging", and the labels of the sample include "user expects to call the control center, user expects to set power saving mode".

[0212] For example, a sample for model training is the context information "A new notification message comes from the xx chat application, the new notification message contains the keyword 'meeting', the current time is 9:00 AM, and the silent mode is not currently enabled". The labels of this sample include "the user expects to call the notification center" and "the user expects to set the silent mode".

[0213] Optionally, the swipe gesture response decision system can input the context information obtained in step 1002 into the user intent judgment model and obtain the output of the user intent judgment model as the judged user intent.

[0214] Optionally, the swipe gesture response decision system can update the parameters of the user intent judgment model based on the user's historical behavior data, so that the model output is as consistent as possible with the user's historical behavior data. For example, see the following... Figure 11 In steps 1109 to 1110 and steps 1116 to 1118 of the embodiment shown, the swipe gesture response decision system can optimize the user intent judgment model based on the user's historical behavior data.

[0215] For example, user historical behavior data can include contextual information about when the device previously performed the target swipe operation, as well as the results of the user's previous target swipe operation (such as the content called out, the control buttons set after calling the control center, and the notification messages viewed after calling the notification center). This data can reflect the differences in the user's behavioral habits when performing the target swipe operation under different contextual information. For example, if the user repeatedly calls the notification center and views the battery notification message when the contextual information includes the existence of a new notification message, and the new notification message includes a battery notification message, then after optimizing the model accordingly, the model's output in that contextual information can include the user's expectation to call the notification center and the user's expectation to set the power saving mode control button. In this way, the result of each target swipe operation performed by the user can have an auxiliary influence on the judgment of the user's intent in the latest execution, thus achieving increasingly accurate judgment of user intent.

[0216] In one embodiment, the swipe gesture response decision system can determine the user's intent based on the context information obtained in step 1002, combined with the user's historical behavior data and / or mapping relationships.

[0217] Optionally, preset rules can be used to describe the mapping relationship between device context information and user intent. For example, if there is a new notification message within a preset time, the corresponding user intent is that the user expects to call the notification center; if there is no new notification message within a preset time, the corresponding user intent is that the user expects to call the control center; if the device battery is low, the corresponding user intent is that the user expects to turn on power saving mode; if the light perception result indicates a low-light environment, the corresponding user intent is that the user expects to turn on the flashlight.

[0218] By judging user intent based on preset rules, it is helpful to accurately predict user intent when user historical behavior data is not used, or when the amount of user historical behavior data is small and the regularity is weak.

[0219] Optionally, the device's context information may include multiple pieces of information / combinations. Different pieces of information / combinations may map to the same, different, or opposite user intents. This allows for the determination of user intent by combining the weights of various pieces of information / combinations. Optionally, the sum of the weights of various pieces of information / combinations may be 1.

[0220] For example, if some contextual information maps to the user's intent to call the notification center, while other contextual information maps to the user's intent to call the control center, then by weighted summation, the probability that the user expects to call the notification center and the probability that the user expects to call the control center can be calculated, and then the content that the user expects to call can be determined based on the probability.

[0221] In one embodiment, the weights of various information / information combinations can be preset values.

[0222] In another embodiment, the weights of various information / information combinations can be dynamically changed. For example, the weight can be optimized based on whether the result of each user's target swipe operation matches the determined user intent. For instance, if the user intent mapped to a certain context information is that the user expects to call the control center, but the result of each target swipe operation performed by the user in that context information is to call the notification center, then the weight of that context information can be reduced when determining the user intent based on the mapping relationship.

[0223] Optionally, the absolute value of the difference between the probability that a user expects to call the notification center and the probability that a user expects to call the control center can be used, combined with a difference threshold, to determine whether the two probabilities are not significantly different. If the absolute value of the difference between the two probabilities is greater than the difference threshold, it can be determined that the two probabilities are significantly different (i.e., one probability is significantly higher than the other), otherwise, they are not significantly different.

[0224] For example, if the probability of a user expecting to call the notification center is significantly higher than the probability of a user expecting to call the control center, it can be determined that the user's intention is to call the notification center; if the probability of a user expecting to call the notification center is significantly lower than the probability of a user expecting to call the control center, it can be determined that the user's intention is to call the control center.

[0225] Optionally, the probability of any control button can be set according to the user's expectations and a set threshold to determine the control button that the user expects to set.

[0226] For example, some contextual information maps to the user's intent to control the state of the flashlight control button, while other contextual information maps to the user's intent to control the state of the motion data control button. If the probability that the user wants to set the flashlight is higher than a set threshold, while the probability that the user wants to set the motion data is lower than a set threshold, it can be determined that the user's intent is that the user wants to set the flashlight and the user does not want to set the motion data.

[0227] Optionally, if the terminal device determines the user's intent based on both the user's historical behavior data and the mapping relationship, the determination of the user's intent may also depend on the weights of the mapping relationship and the user's historical behavior data. Optionally, the sum of the weights of the mapping relationship and the user's historical behavior data can be 1.

[0228] In one embodiment, the weights of user historical behavior data and the weights of the mapping relationship can be preset values.

[0229] In another embodiment, the weights of user historical behavior data and mapping relationships can be dynamically changed. For example, the weights of mapping relationships can be dynamically adjusted based on real-time changes in user historical behavior data. For instance, as user historical behavior data increases, the weight of the user historical behavior data can be continuously increased while the weight of the mapping relationships decreases, so that the judgment of user intent depends more on user behavior habits. This helps to make the judgment of user intent more aligned with the personalized needs of each user.

[0230] Step 1004: When you finish swiping, open the notification center.

[0231] If the user's intention is to open the notification center, the terminal device can display information at the start of the target swipe operation, indicating that the notification center will be displayed if the swipe ends. For example... Figure 5a As shown in the example, in response to a user's swipe-down gesture from the top of the screen, the phone prioritizes displaying prompt message 501 (i.e., image 501, see details). Figure 5a1 This is done to prioritize the notification center. Thus, if the swipe ends within the top area of ​​the screen, the device will display the notification center when the swipe ends.

[0232] like Figure 10 As shown, since the end position of the swipe gesture at the top of the screen is located in the upper part of the screen, if the user intends to open the notification center, the phone will open the notification center when the swipe ends.

[0233] Step 1005: When the swipe ends, open the control center.

[0234] If the user's intention is to open the control center, the terminal device can display information at the start of the target swipe operation, indicating that the control center will be displayed if the swipe ends. For example... Figure 5b As shown in the example, in response to a user's swipe-down gesture from the top of the screen, the phone prioritizes displaying prompt message 505 (i.e., image 505, see details). Figure 5b1 This is to prioritize the access to the control center. Thus, if the swipe ends within the upper part of the screen, the control center will be displayed on the device when the swipe ends.

[0235] like Figure 10 As shown, since the end position of the swipe gesture at the top of the screen is located in the upper part of the screen, if the user intends to open the control center, the phone will open the control center when the swipe ends.

[0236] Figure 10The illustrated embodiment supports prioritizing the call of predicted user intent based on the prediction of user expectations. This allows users to quickly access the desired content with a simple operation, without having to switch the terminal device to display the content, thus providing convenience for one-handed operation.

[0237] See Figure 11 One embodiment of this application provides a device control process based on user intent, which may include the following steps 1101 to 1118. The executing entity of this embodiment may be a terminal device such as a mobile phone.

[0238] Step 1101: Respond to the swipe-down gesture from the top of the screen. Same as step 1001.

[0239] Step 1102: Obtain the device context information. Same as step 1002.

[0240] Step 1103: Determine the user's intent. If the user's intent is to view the notification center, proceed to step 1104. If the user's intent is to view the control center, proceed to step 1111. Same as step 1003.

[0241] Step 1104: Instruct the notification center (i.e., display the above prompt message a), prompt the control center (i.e., display the above prompt message b), and execute step 1105.

[0242] If the user intends to view the notification center, the terminal device supports prioritizing the access to the notification center. In response to a swipe-down gesture from the top of the screen, the terminal device can prioritize the notification center and simultaneously prompt the control center.

[0243] For example, see Figure 5a As shown in the example, if the user's intention is to open the notification center, the terminal device can prioritize displaying a thumbnail of the notification center when it detects the target swipe action, such as image 501 (see details). Figure 5a1 Image 502 (see details) Figure 5a2 This indicates that the notification center should be brought up if the current swipe ends, and also displays a thumbnail of the control center, such as in image 509 (see details). Figure 5a2 This prompts the control center, indicating that if you continue swiping, you will be switched to calling up the control center.

[0244] Step 1105: Determine if the swiping has ended. If yes, proceed to step 1108; otherwise, proceed to step 1106.

[0245] Optionally, the terminal device can determine whether the swiping has ended in real time or periodically.

[0246] Step 1106: Determine the sliding position. If it is in the upper half, proceed to step 1104; if it is in the lower half, proceed to step 1107.

[0247] If the user does not end the swipe, the terminal device will determine whether to continue instructing the notification center and prompting the control center based on the swipe position.

[0248] For example, if the user intends to view the notification center, the terminal device supports prioritizing the call to the notification center. Thus, the upper area of ​​the screen near the top of the target screen (i.e., the starting position of the swipe) can be used to call up the notification center, and the lower area of ​​the screen can be used to call up the control center. The threshold for switching the display is the intersection of the upper and lower areas of the screen.

[0249] exist Figure 11 In the example shown, the threshold for switching displays is the middle position along the screen's length, meaning the top area of ​​the screen is the upper half, and the bottom area is the lower half. In other examples, the threshold for switching displays can also be other positions on the screen, such as 1 / 3 or 1 / 4 of the screen's length from the top.

[0250] See Figure 5a In the example shown, when the user swipes down from the top to the upper half of the screen, if the result indicates a swipe to the upper half, then the notification center and control center can be prompted. Figure 5a As shown in the example, image 502 can be displayed when the user swipes to the upper area of ​​the screen (see details). Figure 5a2 To instruct the notification center to display image 509 (see details) Figure 5a2 This will prompt the control center.

[0251] Step 1107: Instruct the control center, prompt the notification center, and execute step 1105.

[0252] See Figure 5a As shown in the example, when the user swipes down from the top to the bottom area of ​​the screen, if the result indicates a swipe to the lower half, the system can switch to displaying the control center indicator and prompting the notification center. For example... Figure 5a The example shown can display image 504 when the user swipes to the bottom area of ​​the screen (see details). Figure 5a5 To instruct the control center to display image 511 (see details) Figure 5a5 (This will be displayed in the notification center.)

[0253] join Figure 6a As shown in the example, the terminal device can display a switching animation when the user swipes down / up to near the middle of the screen.

[0254] Step 1108: Determine the sliding position. If it is in the upper half, proceed to step 1109; if it is in the lower half, proceed to step 1110.

[0255] If the user ends the swipe, the terminal device determines the content to display based on the swipe position determination.

[0256] Step 1109: Display the notification center, record a successful result, and proceed to step 1118.

[0257] See Figure 5a In the example shown, when the user swipes down from the top to the upper half of the screen, the result is determined to be a swipe to the upper half, and the notification center can be displayed. Since the determined user intent matches the actual content the user calls out, a correct user intent determination can be recorded.

[0258] Step 1110: Display the control center, record an error, and proceed to step 1118.

[0259] See Figure 5a In the example shown, when the user swipes down from the top to the bottom area of ​​the screen, the result is determined to be a swipe to the lower half, and the control center can be displayed. Since the determined user intent is inconsistent with the actual content called by the user, a user intent judgment error can be recorded.

[0260] Step 1111: Instruct the control center, prompt the notification center, and execute step 1112.

[0261] Step 1112: Determine if the swiping has ended. If yes, proceed to step 1115; otherwise, proceed to step 1113.

[0262] Step 1113: Determine the sliding position. If it is in the upper half, execute step 1111; if it is in the lower half, execute step 1114.

[0263] Step 1114: Instruct the notification center to prompt the control center and execute step 1112.

[0264] Step 1115: Determine the sliding position. If it is in the upper half, proceed to step 1116; if it is in the lower half, proceed to step 1117.

[0265] Step 1116: Display the control center, record a successful result, and proceed to step 1118.

[0266] Step 1117: Display the notification center, record an error, and proceed to step 1118.

[0267] The technical implementation logic of steps 1111 to 1117 is consistent with that of steps 1104 to 1109, and will not be repeated here.

[0268] In one example, the device interface changes in steps 1104 to 1109 can be as follows: Figure 5a / Figure 6aThe interface changes shown in the example, and the device interface changes in steps 1111 to 1117, can be as follows: Figure 5b / Figure 6b The interface changes shown in the example.

[0269] Step 1118: Optimize the user intent judgment model.

[0270] The execution of steps 1109, 1110, 1116, and 1117 reflects the user's behavioral data in the current context. The terminal device can input this data as the user's historical behavior data into the user intent judgment model to optimize and train the model, thereby providing an auxiliary influence on the next judgment of user intent and making the judgment of user intent closer to the user's personalized needs.

[0271] By continuously optimizing the user intent judgment model based on historical user behavior data, the model's predictive accuracy is enhanced, thereby gradually improving the accuracy of user intent recognition. As the number of user actions increases, users can more easily and quickly access the content they need, achieving an experience where each simple swipe (e.g., a short swipe without switching) brings up the desired content without needing to view prompts about the currently displayed content or the content to be displayed after switching.

[0272] In other feasible embodiments, if the user intent judgment model does not judge the user intent based on the user's historical behavior data, then the step of recording a correct / incorrect result is not executed, and step 1118 is not executed. This application does not limit this.

[0273] See Figure 12 One embodiment of this application provides a device control process based on user intent, which may include the following steps 1201 to 1204. The executing entity of this embodiment may be a terminal device such as a mobile phone.

[0274] Step 1201: Determine the user's intent in setting the control buttons. (Same as the description in step 1003.)

[0275] like Figure 12 As shown, the terminal device can execute in parallel. Figure 10 The illustrated embodiments and Figure 11 The illustrated embodiment determines not only the user's intention to call up content, but also the user's intention to set control buttons, based on the device's context information.

[0276] Step 1202: Determine if the number of control buttons the user expects to set is greater than 0. If yes, proceed to step 1203; otherwise, proceed to step 1204.

[0277] The terminal device can execute step 1202 based on the determination result of the control button that the user expects to set. If it is determined that the control button that the user expects to set exists, the quick settings button panel is displayed; otherwise, it is hidden so that the quick settings button panel is not displayed.

[0278] Step 1203: In the quick settings button panel, display the control buttons that the user expects to set.

[0279] For example, see Figure 5a / Figure 5b / Figure 6a / Figure 6b As shown in the example, if the user intent determination result indicates that the user expects to set three control buttons: flashlight, mobile data, and ringtone, then when the terminal device ends the swipe to display the notification center / control center, it will display these three control buttons through the quick settings button panel. The corresponding display interface can be as follows: Figure 7b / Figure 8b As shown.

[0280] See Figure 7b By displaying a quick settings button panel 701 at the top of the notification center, users can easily access control buttons that the device is likely to set when they call up the notification center, thus providing convenience for user operation.

[0281] See Figure 8b By displaying the quick settings button panel 801 on the upper side of the control center when it is displayed, users can quickly use the control buttons that the device is likely to set when calling up the control center, thus providing convenience for user operation.

[0282] like Figure 7b / Figure 8b As shown, by displaying the control buttons that users want to set at the top of the control center and notification center, users can see the control buttons they are most likely to want to change in the most easily accessible and noticeable screen position with just one swipe down, making user operation simpler and faster.

[0283] Step 1204: Hide the quick settings button panel.

[0284] For example, see Figure 5a / Figure 5b / Figure 6a / Figure 6b As shown in the example, if the user intent determination result indicates that the control button expected by the user does not exist, the terminal device will not display the quick settings button panel when ending the swipe to show the notification center / control center. The corresponding display interface can be as follows: Figure 7a / Figure 8a As shown.

[0285] By displaying a quick settings button panel, users can quickly find the control buttons they want to set, making button settings simpler and easier to use.

[0286] See Figure 13a One embodiment of this application provides a device control process based on user intent, which may include the following steps 1301 to 1304. The executing entity of this embodiment may be a terminal device such as a mobile phone.

[0287] Step 1301: Respond to the swipe-down gesture from the top of the screen. Same as step 1001.

[0288] Step 1302: Obtain the device's context information (including notification message content).

[0289] Step 1302 is basically the same as step 1002, the main difference being that the context information in step 1002 may or may not include the notification message content, and there is no limitation on this, while the context information in step 1302 must include the notification message content.

[0290] Optionally, the terminal device can obtain a list of notification messages from the notification center, perform content analysis on each notification message, and then infer the message scenario based on the content analysis results to obtain the control buttons that the user expects to set under that message scenario.

[0291] Step 1303: Determine if the user intends to set control buttons related to notification messages. If yes, proceed to step 1304; otherwise, proceed to step 1305. Same as the description in step 1003.

[0292] The terminal device can execute step 1303 based on the judgment result of the control button that the user expects to set.

[0293] Optionally, if it is determined that a control button that the user expects to set exists, the control button may be associated with a notification message or may not be associated with any notification effect. If a control button related to a notification message exists, then step 1304 is executed; otherwise, step 1305 is executed.

[0294] Step 1304: Display the corresponding control buttons that the user expects to set on the side of the notification message.

[0295] For example, see Figure 13aIf the user intent determination result is that the user expects to set three control buttons: flashlight, mobile data, and ringtone, where the flashlight is associated with notification message 1306, the mobile data is associated with notification message 1307, and there is no corresponding notification message for ringtone, then when the terminal device displays the notification center, it can display the corresponding control button for flashlight on the right side of notification message 1306 and the corresponding control button for mobile data on the right side of notification message 1307.

[0296] If the corresponding control buttons that the user wants to set are not displayed on the side of the notification message, the user needs to first swipe down to bring up the notification center, view the notification message, and then swipe down again to bring up the control center to set the control buttons associated with the notification message, which is quite cumbersome for the user. The embodiment shown in Figure 13, however, displays the corresponding control buttons that the user wants to set on the side of the notification message, making it convenient for the user to quickly set the corresponding control buttons after viewing the notification message, thus providing greater convenience for the user.

[0297] For example, see Figure 13b When the terminal device displays the notification center, for control buttons that correspond to notification messages in the user intent judgment results, the corresponding control buttons can be displayed on the side of the notification message, and a quick settings button panel 1308 can be displayed to show each control button in the user intent judgment results. This makes it convenient for users to quickly use the control buttons that the device predicts the user's expected settings when calling the notification center.

[0298] For example, see Figure 13c When the terminal device displays the notification center, for control buttons that correspond to notification messages in the user intent judgment results, the corresponding control buttons can be displayed on the side of the notification message, but not displayed repeatedly in the quick settings button panel 1309. For control buttons that do not correspond to notification messages in the user intent judgment results, they are displayed in the quick settings button panel 1309. This makes it convenient for users to quickly use the control buttons that the device predicts the user expects to set when calling the notification center.

[0299] Step 1305: Display a notification message. There are no control buttons on the side of the notification message that the user expects to set.

[0300] If the intent determination determines that there is no control button associated with the notification message, then only the notification message can be displayed, meaning that no control button is displayed on the side of the notification message.

[0301] See Figure 14 One embodiment of the device control method provided in this application may include the following steps 1401 to 1404. The executing entity of this embodiment may be a terminal device such as a mobile phone.

[0302] Step 1401: Detect the target swipe operation on the target screen, where the target screen is the screen of the terminal device in operation.

[0303] Step 1402: In response to the target swipe operation, display the first prompt information. The first prompt information is used to indicate that if the swipe ends, the first information will be displayed. The first information is either the notification center or the control center. Then execute step 1403 or step 1404.

[0304] Step 1403: If the target swipe operation ends while the target screen is displaying the first prompt message, then display the first message.

[0305] Step 1404: If the target swipe operation ends when the target screen stops displaying the first prompt information, then display the second information, which is another one from the notification center and control center.

[0306] Figure 14 The specific technical implementation of the illustrated embodiment can be found in the relevant technical descriptions in other embodiments of this application, and will not be repeated here.

[0307] The method provided in any embodiment of this application can be applied to terminal devices such as mobile phones, tablets, personal digital assistants (PDAs), desktops, laptops, notebook computers, ultra-mobile personal computers (UMPCs), handheld computers, netbooks, and wearable devices. This application does not impose any special restrictions on the specific form of the aforementioned terminal devices.

[0308] The method provided in any embodiment of this application can be applied to... Figure 15 The terminal device 100 shown. Figure 15 A schematic diagram of the terminal device 100 is shown.

[0309] Terminal device 100 may include a processor 110, an external memory interface 120, an internal memory 121, a universal serial bus (USB) interface 130, a charging management module 140, a power management module 141, a battery 142, antenna 1, antenna 2, a mobile communication module 150, a wireless communication module 160, an audio module 170, a speaker 170A, a receiver 170B, a microphone 170C, a headphone jack 170D, a sensor module 180, buttons 190, a motor 191, an indicator 192, a camera 193, a display screen 194, and a subscriber identification module (SIM) card interface 195, etc. The sensor module 180 may include pressure sensors, gyroscope sensors, barometric pressure sensors, magnetic sensors, accelerometers, distance sensors, proximity sensors, fingerprint sensors, temperature sensors, touch sensors, ambient light sensors, bone conduction sensors, etc.

[0310] It is understood that the structures illustrated in the embodiments of this application do not constitute a specific limitation on the terminal device 100. In other embodiments of this application, the terminal device 100 may include more or fewer components than illustrated, or combine some components, or split some components, or have different component arrangements. The illustrated components may be implemented in hardware, software, or a combination of software and hardware.

[0311] Processor 110 may include one or more processing units, such as: application processor (AP), modem processor, graphics processing unit (GPU), image signal processor (ISP), controller, video codec, digital signal processor (DSP), baseband processor, and / or neural network processing unit (NPU). Different processing units may be independent devices or integrated into one or more processors. The controller can generate operation control signals based on instruction opcodes and timing signals to control instruction fetching and execution.

[0312] The processor 110 may also include a memory for storing instructions and data. In some embodiments, the memory in the processor 110 is a cache memory. This memory can store instructions or data that the processor 110 has just used or that are used repeatedly. If the processor 110 needs to use the instruction or data again, it can retrieve it directly from the memory. This avoids repeated accesses, reduces the waiting time of the processor 110, and thus improves the efficiency of the system.

[0313] In some embodiments, the processor 110 may include one or more interfaces. Interfaces may include an inter-integrated circuit (I2C) interface, an inter-integrated circuit sound (I2S) interface, a pulse code modulation (PCM) interface, a universal asynchronous receiver / transmitter (UART) interface, a mobile industry processor interface (MIPI), a general-purpose input / output (GPIO) interface, a subscriber identity module (SIM) interface, and / or a universal serial bus (USB) interface, etc.

[0314] It is understood that the interface connection relationships between the modules illustrated in the embodiments of this application are merely illustrative and do not constitute a structural limitation on the terminal device 100. In other embodiments of this application, the terminal device 100 may also adopt different interface connection methods or a combination of multiple interface connection methods as described in the above embodiments.

[0315] Terminal device 100 implements display functions through a GPU, display screen 194, and application processor. The GPU is a microprocessor for image processing, connected to the display screen 194 and the application processor. The GPU is used to perform mathematical and geometric calculations and for graphics rendering. Processor 110 may include one or more GPUs, which execute program instructions to generate or modify display information.

[0316] The display screen 194 is used to display images, videos, etc. The display screen 194 includes a display panel. In some embodiments, the terminal device 100 may include one or N display screens 194, where N is a positive integer greater than 1.

[0317] Internal memory 121 can be used to store computer executable program code, which includes instructions. Internal memory 121 may include a program storage area and a data storage area. The program storage area may store the operating system, at least one application program required for a function (such as sound playback, image playback, etc.), etc. The data storage area may store data created during the use of terminal device 100 (such as audio data, phonebook, etc.). Furthermore, internal memory 121 may include high-speed random access memory, and may also include non-volatile memory, such as at least one disk storage device, flash memory device, universal flash storage (UFS), etc. Processor 110 executes various functional applications and data processing of terminal device 100 by running instructions stored in internal memory 121 and / or instructions stored in memory located in the processor.

[0318] A pressure sensor is used to sense pressure signals and convert them into electrical signals. In some embodiments, the pressure sensor may be located on the display screen 194. There are many types of pressure sensors, such as resistive pressure sensors, inductive pressure sensors, and capacitive pressure sensors. A capacitive pressure sensor may include at least two parallel plates with conductive material. When a force is applied to the pressure sensor, the capacitance between the electrodes changes. The terminal device 100 determines the pressure intensity based on the change in capacitance. When a touch operation is applied to the display screen 194, the terminal device 100 detects the intensity of the touch operation based on the pressure sensor. The terminal device 100 may also calculate the touch position based on the detection signal from the pressure sensor. In some embodiments, touch operations applied to the same touch position but with different touch operation intensities may correspond to different operation commands.

[0319] A touch sensor, also known as a "touch device," can be located on the display screen 194. The touch sensor and the display screen 194 together form a touchscreen, also called a "touchscreen." The touch sensor detects touch operations applied to or near it. The touch sensor can then transmit the detected touch operation to the application processor to determine the type of touch event. Visual output related to the touch operation can be provided through the display screen 194. In some embodiments, the touch sensor may also be located on the surface of the terminal device 100, in a different position than the display screen 194.

[0320] In addition, the terminal device runs an operating system on top of the aforementioned components. For example... operating system, operating system, Operating systems, etc. Applications can be installed and run on an operating system.

[0321] The software system of terminal device 100 can adopt a layered architecture, event-driven architecture, microkernel architecture, microservice architecture, or cloud architecture. This application embodiment uses the layered architecture Android system as an example to exemplify the software structure of terminal device 100.

[0322] Figure 16 This is a software structure block diagram of the terminal device 100 according to an embodiment of this application. The layered architecture divides the software into several layers, each with a clear role and division of labor. The layers communicate with each other through software interfaces. In some embodiments, the Android system is divided into multiple layers, from top to bottom: application layer, framework layer (Framework, FWK), system service layer, and kernel layer.

[0323] The application layer can include a series of application packages, such as Control Center, Notification Center, Settings, and other applications.

[0324] The framework layer provides application programming interfaces (APIs) and programming frameworks for applications in the application layer. For example... Figure 16 As shown, the framework layer can include user program framework, notification framework, etc.

[0325] The system service layer includes desktop services, AI subsystem, event notification subsystem, telephone subsystem, power management service, network subsystem, etc.

[0326] See Figure 16 The desktop service can invoke the AI ​​subsystem to determine the user's intent. For example, the AI ​​subsystem may include the user intent determination model described in other embodiments of this application.

[0327] When the touchscreen driver detects a user's swipe gesture, the desktop service can notify the AI ​​subsystem to determine the user's intent and receive the user's intent determined by the AI ​​subsystem.

[0328] The AI ​​subsystem can determine the user's intent based on the collected contextual information.

[0329] For example, the AI ​​subsystem can collect contextual information such as whether there are new notification messages on the terminal device based on the event notification subsystem; collect contextual information such as whether the terminal device is in silent mode based on the telephone subsystem; collect contextual information such as the battery level of the terminal device based on the power management service; and collect contextual information such as whether the terminal device is in airplane mode based on the network subsystem.

[0330] Optionally, user intent may include predictions from the AI ​​subsystem regarding the content the user expects to be displayed and the control buttons the user expects to set. See also Figure 16If the user intends to access the control center, the desktop service supports prioritizing the display of the control center, rather than displaying it after switching. Similarly, if the user intends to access the notification center, the desktop service supports prioritizing the display of the notification center, rather than displaying it after switching. This allows users to easily access the notification center through simple operations (such as...). Figure 10 The user can quickly access the desired content by swiping down (as shown in the image) without having to switch the content displayed on the terminal device, thus providing convenience for one-handed operation.

[0331] After displaying the notification center or control center, the desktop service can update the user's historical behavior data based on the displayed content. The AI ​​subsystem can then use this updated historical behavior data to determine the user's intent for the next instance. For example, the AI ​​subsystem can optimize the parameters of the user intent determination model based on the updated historical behavior data to improve the accuracy of user intent determination.

[0332] The kernel layer is the layer between hardware and software. It can include touchscreen drivers, driver subsystems, kernel subsystems, and more. The kernel layer is the foundation of the Android system, through which the system's final functionalities are implemented.

[0333] See Figure 16 Touchscreen drivers can be executed by the user, for example... Figure 4a When the user performs a swipe down, the system detects the swipe gesture and notifies the desktop service.

[0334] Understandable, Figure 16 The layers in the illustrated software structure and the components contained in each layer do not constitute a specific limitation on the terminal device 100. In other embodiments of this application, the terminal device 100 may include more or fewer layers than illustrated, and each layer may include more or fewer components; this application does not impose any limitations.

[0335] Figure 16 The specific technical implementation of the embodiment shown in response to the user's swipe-down operation can be found in the relevant technical descriptions in other embodiments of this application, and will not be repeated here.

[0336] This application also provides a chip, which is installed in a terminal device. The chip includes a processor for executing computer program instructions stored in a memory. When the computer program instructions are executed by the processor, the chip is triggered to execute the method steps provided in any method embodiment of this application.

[0337] This application also proposes a terminal device, which includes a communication module, a memory for storing computer program instructions, and a processor for executing the program instructions. When the computer program instructions are executed by the processor, the terminal device is triggered to execute the method steps provided in any method embodiment of this application.

[0338] This application also proposes a server device, which includes a communication module, a memory for storing computer program instructions, and a processor for executing the program instructions. When the computer program instructions are executed by the processor, the server device is triggered to execute the method steps provided in any method embodiment of this application.

[0339] This application also provides a terminal device, which includes multiple antennas, a memory for storing computer program instructions, a processor for executing the computer program instructions, and a communication device (such as a communication module that can implement 5G communication based on the NR protocol). When the computer program instructions are executed by the processor, the terminal device is triggered to execute the method steps provided in any method embodiment of this application.

[0340] Specifically, in the embodiments of this application, one or more computer programs are stored in the aforementioned memory, and the one or more computer programs include instructions that, when executed by the aforementioned device, cause the aforementioned device to perform the method steps described in the embodiments of this application.

[0341] Furthermore, the devices, apparatuses, and modules described in the embodiments of this application may be implemented by computer chips or physical entities, or by products with certain functions.

[0342] Those skilled in the art will understand that embodiments of this application can be provided as methods, apparatus, or computer program products. Therefore, this application can take the form of a completely hardware embodiment, a completely software embodiment, or an embodiment combining software and hardware aspects. Furthermore, this application can take the form of a computer program product implemented on one or more computer-usable storage media containing computer-usable program code.

[0343] In the several embodiments provided in this application, any function, if implemented as a software functional unit and sold or used as an independent product, can be stored in a computer-readable storage medium. Based on this understanding, the technical solution of this application, in essence, or the part that contributes to the prior art, or part of the technical solution, can be embodied in the form of a software product. This computer software product is stored in a storage medium and includes several instructions to cause a computer device (which may be a personal computer, a server, or a network device, etc.) to execute all or part of the steps of the methods described in the various embodiments of this application.

[0344] Specifically, this application also provides a computer-readable storage medium storing a computer program that, when run on a computer, causes the computer to execute the method steps provided in this application.

[0345] This application also provides a computer program product, which includes a computer program that, when run on a computer, causes the computer to perform the method steps provided in this application.

[0346] In this application, the terms "comprising," "including," or any other variations thereof are intended to cover non-exclusive inclusion, such that a process, method, article, or apparatus that comprises a list of elements includes not only those elements but also other elements not expressly listed, or elements inherent to such a process, method, article, or apparatus. Without further limitation, an element defined by the phrase "comprising one..." does not exclude the presence of other identical elements in the process, method, article, or apparatus that includes said element.

[0347] Those skilled in the art will readily understand that, for the sake of convenience and brevity, the same or similar parts between the various embodiments of this application can be referred to mutually. For example, the specific working processes of the systems, devices, and units described in the embodiments of this application can be referred to the corresponding processes in the method embodiments of this application, and will not be repeated here.

[0348] The above description is merely a specific embodiment of this application and is not intended to limit this application. The scope of protection of this application shall be determined by the claims.

Claims

1. A device control method, characterized in that, Applied to terminal devices, including: A target swipe operation is detected on the target screen, which is the screen of the terminal device in operation. In response to the target swipe operation, a first prompt message is displayed. The first prompt message is used to indicate that if the swipe ends, a first message will be displayed. The first message is either a notification center or a control center. If the target swipe operation is detected to have ended while the first prompt information is displayed on the target screen, then the first information is displayed; and / or, If the target swipe operation is detected to have ended when the target screen stops displaying the first prompt information, then the second information is displayed, which is another one of the notification center and the control center.

2. The method according to claim 1, characterized in that, Before displaying the first prompt message, the method further includes: Based on the context information of the terminal device, the user intent is obtained. The user intent includes a first intent, which describes the prediction result of the terminal device on the content that the user expects to call out. In the case where the first intention indicates that the user expects to call the notification center, the first information is the notification center; In the case where the first intention indicates that the user expects to call the control center, the first information is the control center.

3. The method according to claim 1, characterized in that, After detecting the target swipe operation on the target screen, the method further includes: Based on the context information of the terminal device, the user intent is obtained, and the user intent includes a second intent, which is used to describe the prediction result of the terminal device for the control buttons that the user expects to set; If the second intention includes one or more control buttons, then when the target swipe operation ends, the quick settings button panel is displayed; The quick settings button panel displays one or more control buttons.

4. The method according to claim 1, characterized in that, After detecting the target swipe operation on the target screen, the method further includes: Based on the context information of the terminal device, the user intent is obtained, and the user intent includes a third intent, which is used to describe the prediction result of the terminal device for the control buttons that the user expects to set. If the third intent includes one or more control buttons, and the one or more control buttons are respectively associated with one or more notification messages in the notification center, then when the notification center is displayed, the associated control buttons are displayed on one side of the notification messages.

5. The method according to any one of claims 2-4, characterized in that, Based on the context information of the terminal device, the user intent is obtained, including: The user intent is obtained based on the context information of the terminal device, combined with at least one of the mapping relationship and user historical behavior data; The mapping relationship is used to describe the user intent mapped to the context information of the terminal device; The user history behavior data is used to describe the relevant historical data of the user performing the target swipe operation; The user history behavior data includes context information of the terminal device when the user performs the target swipe operation, and also includes at least one of the information displayed by the terminal device at the end of the target swipe operation and the control buttons used by the user after performing the target swipe operation.

6. The method according to any one of claims 2-4, characterized in that, The context information includes at least one of the following: Whether a new notification message is received within a preset time period, whether the notification center is empty, the content of the notification message in the notification center, the status of the control buttons in the control center, the device battery level, the light sensing result, and the execution frequency of the target sliding operation.

7. The method according to claim 1, characterized in that, The method further includes: When the target screen stops displaying the first prompt information, a second prompt information is displayed. The second prompt information is used to indicate that the swipe will end if the current swipe ends. Detecting the end of the target swipe operation when the target screen stops displaying the first prompt information includes: detecting the end of the target swipe operation when the target screen displays the second prompt information.

8. The method according to claim 7, characterized in that, The method further includes: A switching animation is displayed between showing the first prompt message and showing the second prompt message.

9. The method according to claim 7, characterized in that, The method further includes: When the target screen stops displaying the first prompt information and the second prompt information, a third prompt information is displayed. The third prompt information is used to indicate that if the current swipe ends, the notification center and the control center will be displayed. If the target swipe operation ends when the third prompt information is displayed on the target screen, then the notification center and the control center are displayed simultaneously.

10. The method according to claim 1, characterized in that, The target screen includes a first region and a second region; The situations in which the target screen stops displaying the first prompt information include: the sliding position of the target sliding operation is within the second area; The display of the first prompt information includes: displaying the first prompt information when the sliding position of the target sliding operation is within the first area.

11. The method according to claim 1, characterized in that, The target sliding operation includes a first sliding operation and a second sliding operation in succession, wherein the sliding directions of the first sliding operation and the second sliding operation are opposite.

12. The method according to claim 1, characterized in that, The first prompt message is also used to indicate that if the swiping is stopped without displaying the first prompt message, the second message will be displayed.

13. The method according to claim 12, characterized in that, The first prompt information includes a thumbnail of the first information and a thumbnail of the second information, and the size of the thumbnail of the first information is larger than the size of the thumbnail of the second information.

14. The method according to any one of claims 1-13, characterized in that, The method further includes: When the control center is displayed but the notification center is not displayed, a notification message summary panel is displayed; The notification message summary panel displays a summary of the notification messages in the notification center.

15. The method according to claim 14, characterized in that, After displaying a summary of the notification message in the notification center, the method further includes: In response to a trigger operation on the notification message summary panel, the notification center is displayed, or both the notification center and the control center are displayed simultaneously.

16. The method according to any one of claims 1-13, characterized in that, In response to the target swipe operation, a first prompt message is displayed, including: In response to the target swipe operation, detect whether the notification center includes a notification message; If a notification message is detected in the notification center, the first prompt message is displayed; The method further includes: If the notification center is found to not contain notification messages, the control center is displayed, along with information indicating that the notification center does not contain notification messages.

17. The method according to any one of claims 1-13, characterized in that, In response to the target swipe operation, a first prompt message is displayed, including: In response to the target swipe operation, if the terminal device meets the first condition, the first prompt information is displayed; The method further includes: In response to the target swipe operation, if the terminal device meets the second condition, when the target swipe operation ends, the notification center and the control center are displayed simultaneously. The terminal device satisfies the first condition including: the resolution of the target screen is not greater than a first threshold, or the terminal device satisfies the first condition including: the resolution of the target screen is greater than the first threshold and not greater than a second threshold, and the aspect ratio of the target screen is not less than a third threshold. The terminal device satisfies the second condition as follows: the resolution of the target screen is greater than the second threshold, or the terminal device satisfies the second condition as follows: the resolution of the target screen is greater than the first threshold and not greater than the second threshold, and the aspect ratio of the target screen is less than the third threshold.

18. The method according to any one of claims 1-13, characterized in that, The target sliding operation includes: sliding from the edge of the target screen toward the interior of the target screen.

19. A chip, characterized in that, include: A processor for executing computer program instructions stored in memory, wherein when the computer program instructions are executed by the processor, the chip is triggered to perform the method as described in any one of claims 1-18.

20. A terminal device, characterized in that, The terminal device includes one or more memories for storing computer program instructions and one or more processors, wherein when the computer program instructions are executed by the one or more processors, the terminal device is triggered to perform the method as described in any one of claims 1-18.

21. A computer-readable storage medium, characterized in that, The computer-readable storage medium stores a computer program that, when run on a computer, causes the computer to perform the method as described in any one of claims 1-18.

22. A computer program product, characterized in that, The computer program product includes a computer program that, when run on a computer, causes the computer to perform the method as described in any one of claims 1-18.