Methods and devices for opening banner notifications
The method and device use eye-tracking to enhance the flexibility and accuracy of expanding banner notifications and opening application interfaces on terminal devices by detecting user gaze, addressing the challenge of triggering notifications in the top display area.
Patent Information
- Authority / Receiving Office
- JP · JP
- Patent Type
- Patents
- Current Assignee / Owner
- Filing Date
- 2023-05-19
- Publication Date
- 2026-03-25
AI Technical Summary
Users face difficulties in triggering banner notifications in the top area of a display, making it inconvenient to expand or open the corresponding application interface.
A method and device that utilize eye-tracking technology to detect the user's gaze point, allowing the terminal device to expand banner notifications or open the associated application interface based on the user's attention, with controls to manage the display duration and presence of gaze cursors.
Enhances the flexibility and accuracy of expanding banner notifications and opening application interfaces by leveraging eye-tracking, improving user interaction with terminal devices.
Smart Images

Figure 0007835890000001 
Figure 0007835890000002 
Figure 0007835890000003
Abstract
Description
Technical Field
[0004] ,
[0003] , ,
[0001] This application claims the priority of Chinese Patent Application No. 202210549604.6, titled "Display Method and Electronic Device", filed with the China National Intellectual Property Administration on May 20, 2022; Chinese Patent Application No. 202210549347.6, titled "Display Method and Electronic Device", filed with the China National Intellectual Property Administration on May 20, 2022; Chinese Patent Application No. 202210761048.9, titled "Calibration Method and Device", filed with the China National Intellectual Property Administration on June 30, 2022; Chinese Patent Application No. 202210764445.1, titled "Display Method and Electronic Device", filed with the China National Intellectual Property Administration on June 30, 2022; Chinese Patent Application No. 202310216799.7, titled "Calibration Method and Device", filed with the China National Intellectual Property Administration on February 27, 2023; and Chinese Patent Application No. 202310226969.X, titled "Method and Device for Opening a Banner Notification", filed with the China National Intellectual Property Administration on February 27, 2023, and all of them are incorporated herein by reference in their entirety. Technical Field
[0002] This application relates to the field of terminal technologies, and particularly to a method and device for opening a banner notification.
Background Art
[0003] With the development of terminal technologies, the functional requirements of users for terminal devices are becoming increasingly diverse. For example, users can interact with terminal devices to control them.
[0004] Generally, upon receiving a message, a terminal device may display a banner notification corresponding to the message in the upper area of the display, thereby allowing the user to perceive changes in the message content in a timely manner. Furthermore, upon receiving a trigger action performed by the user on the banner notification, the terminal device may open the banner notification, for example, by expanding the banner notification, and / or open the application interface corresponding to the banner notification.
[0005] However, in many scenarios, it is difficult for users to trigger banner notifications in the top area of the display. [Overview of the project] [Problems that the invention aims to solve]
[0006] Embodiments of the present invention provide a method and apparatus for opening banner notifications, which simplifies the method of opening banner notifications in the upper area of a display. [Means for solving the problem]
[0007] According to a first aspect, an embodiment of the present application provides a method for opening a banner notification. This method includes: a terminal device displays a first interface; the first interface includes a first banner notification; the first banner notification is located in a first area; the first banner notification is a banner notification initiated by a first application; the terminal device displays a second banner notification on the first interface when it detects that the point of attention is located in the first area; the second banner notification is an expanded version of the first banner notification; the message content in the second banner notification is greater than the message content in the first banner notification; or alternatively, the terminal device displays a second interface when it detects that the point of attention is located in the first area; the second interface is a displayed interface of the first application; the second interface includes message content in the second banner notification. In this way, based on the status of the user's attention on the banner notification, the terminal device can conveniently expand the banner notification or display the application interface corresponding to the banner notification.
[0008] The first interface may be an interface for receiving banner notifications, and the second interface may be an application interface that corresponds to banner notifications.
[0009] In one possible implementation, the method further includes the following: When the terminal device detects that the gaze point is within a first area, it displays a second banner notification on the first interface and then displays the second interface. In this way, based on the status of the user gazing at the banner notification, the terminal device may also edit the expanded banner notification and display the application interface corresponding to the banner notification.
[0010] In one possible implementation, when the terminal device detects that the point of focus is within a first area, the terminal device displays a second banner notification on the first interface, and then displays the second interface, which includes the first banner notification being allowed to be expanded, and the terminal device displays a second banner notification on the first interface, and then displays the second interface, when the point of focus is within the first area. In this way, when the point of focus is detected to be within the first area, the terminal device can determine whether the banner notification is allowed to be expanded based on the status of whether the banner notification is allowed to be expanded, and then display the application interface corresponding to the banner notification.
[0011] In one possible implementation, a first switch and a second switch are located on the terminal device, the first switch is configured to deploy a first banner notification when it is detected that the point of focus is within a first area, and the second switch is configured to open a first application when it is detected that the point of focus is within a first or second area, the second area being the area where the second banner notification is located. Allowing the first banner notification to be deployed, and the terminal device detecting that the point of focus is within the first area, the terminal device displaying the second banner notification on the first interface and then the second interface includes the first switch being on, the second switch being on, allowing the first banner notification to be deployed, and the terminal device detecting that the point of focus is within the first area, the terminal device displaying the second banner notification on the first interface and then the second interface. In this way, the terminal device may configure the first and second switches according to the requirements, thereby enabling the terminal device to control whether to deploy a banner notification and / or open the application corresponding to the banner notification in the eye-tracking function, based on the status of the first and second switches and the status of whether the banner notification is deployed.
[0012] It can be understood that when the terminal device completes the calibration of the eye-tracking function, the first switch and the second switch are in the ON state by default. Therefore, the first switch being OFF and / or the second switch being OFF as described in this embodiment of the present application can be understood as the user turning off the first switch and / or the second switch after the first switch and the second switch have been in the ON state by default.
[0013] In one possible implementation, the method further includes: If the duration for which the first banner notification is displayed is equal to or greater than a first duration, the terminal device cancels the display of the first banner notification. Alternatively, if the total duration for which the first and second banner notifications are displayed is equal to or greater than a first duration, the terminal device cancels the display of the second banner notification. In this way, the terminal device may cancel the display of banner notifications when it determines that the duration for which the banner notifications are displayed has reached a first duration.
[0014] In one possible implementation, when a terminal device detects that a point of focus is within a first region, the terminal device displays a second banner notification on the first interface and then displays the second interface, which includes: when the terminal device detects that the duration for which the point of focus has been within the first region is greater than or equal to a second duration, the terminal device displays a second banner notification on the first interface; and after the terminal device has displayed the second banner notification, when the terminal device detects that the duration for which the point of focus has been within the second region is greater than or equal to a seventh duration, the terminal device displays the second interface.
[0015] In one possible implementation, the seventh duration includes the third and fifth durations, and the first interface further includes a gaze cursor, which is used to indicate the position of the gaze point on the display. When the terminal device detects that the duration of the gaze point being in the second region is greater than or equal to the seventh duration, the terminal device displays the second interface, which includes the terminal device displaying a first progress bar at the starting position of the outer edge of the gaze cursor when the terminal device detects that the duration of the gaze point being in the second region is greater than or equal to the third duration; and, after the terminal device has displayed the first progress bar at the starting position, when the terminal device detects that the duration of the gaze point being in the second region is greater than or equal to the fifth duration, the terminal device displays the first progress bar at the ending position of the outer edge of the gaze point and further displays the second interface. In this way, the terminal device can determine the position of the gaze point on the display based on the gaze cursor, decide whether to start a progress bar based on a third duration, decide whether to open the interface corresponding to the banner notification based on a fifth duration, and appropriately identify the user's gaze status to improve the accuracy of opening banner notifications.
[0016] In one possible implementation, when a terminal device detects that the gaze point is within a first area, the terminal device displays a second banner notification on the first interface, provided that the first switch is ON, the second switch is OFF, and the first banner notification is allowed to be deployed, and the terminal device displays a second banner notification on the first interface when it detects that the gaze point is within the first area. In this way, the terminal device may configure the first and second switches according to requirements, thereby enabling the terminal device to control whether to deploy a banner notification and / or open the application corresponding to the banner notification in the eye-tracking function, based on the status of the first and second switches and the status of whether the banner notification is deployed.
[0017] It can be understood that when either the first or second switch is ON, the terminal device monitors banner notifications, and when it detects a banner notification, it may decide whether to expand the banner notification and enable eye-tracking functionality. Since the second switch is OFF, when a banner notification is expanded, the terminal device will not open the application interface corresponding to the banner notification, even if the gaze point is continuously over the expanded banner notification.
[0018] In one possible implementation, when a terminal device detects that the point of focus is within a first area, the display of a second banner notification on the first interface includes when the terminal device detects that the duration for which the point of focus has been within the first area is equal to or greater than a second duration.
[0019] In one possible implementation, when a terminal device detects that the gaze point is within a first area, the terminal device displays a second interface, which includes determining that a pre-configured condition is met, and then, when the terminal device detects that the gaze point is within the first area, the terminal device displays a second interface. The pre-configured condition includes that the first switch is off, the second switch is on, and the first banner notification is allowed to be deployed, or that the first switch is on, the second switch is on, and the first banner notification is not allowed to be deployed, or that the first switch is off, the second switch is on, and the first banner notification is not allowed to be deployed. In this way, the terminal device may configure the first and second switches according to requirements, thereby enabling the terminal device to control whether to deploy a banner notification and / or open the application corresponding to the banner notification in the eye-tracking function, based on the status of the first and second switches and the status of whether the banner notification is deployed.
[0020] It can be understood that when both the first and second switches are off, the terminal device does not monitor banner notifications and therefore cannot enable the eye-tracking function.
[0021] In one possible implementation, the terminal device displaying a second interface when it detects that the gaze point is within a first region includes the terminal device displaying a second interface when it detects that the duration for which the gaze point has been within the first region is equal to or greater than an eighth duration.
[0022] In one possible implementation, the eighth duration includes the fourth and fifth durations, and the first interface further includes a gaze cursor, which is used to indicate the position of the gaze point on the display. When the terminal device detects that the duration for which the gaze point has been in the first region is equal to or greater than the eighth duration, the terminal device displays the second interface, which includes the terminal device displaying a second progress bar at the starting position of the outer edge of the gaze cursor when the terminal device detects that the duration for which the gaze point has been in the first region is equal to or greater than the fourth duration; and, after the terminal device has displayed the second progress bar at the starting position, when the terminal device detects that the duration for which the gaze point has been in the first region is equal to or greater than the fifth duration, the terminal device displays a second progress bar at the ending position of the outer edge of the gaze point and further displays the second interface. In this way, the terminal device can determine the position of the gaze point on the display based on the gaze cursor, decide whether to start a progress bar based on a fourth duration, decide whether to open the interface corresponding to the banner notification based on a fifth duration, and appropriately identify the user's gaze status to improve the accuracy of opening banner notifications.
[0023] In one possible implementation, the method further includes the following: The terminal device displays a gaze cursor on a first interface when it detects that the gaze point is within a predefined area. The predefined area includes the first area. The predefined area is one-third of the display. The gaze cursor is used to indicate the position of the gaze point on the display. In this way, the terminal device can display a gaze cursor on the display to indicate the position of the gaze point when it detects that the gaze point is within the predefined area, thereby improving the user experience when using eye-tracking functionality.
[0024] In one possible implementation, a third switch is placed on the terminal device and configured to enable or disable the display of the gaze cursor, and the terminal device displays the gaze cursor on the first interface when it detects that the gaze point is within a predefined area, which includes the terminal device displaying the gaze cursor on the first interface when it detects that the gaze point is within a predefined area and the third switch is on. In this way, the user can turn the third switch on or off according to their eye-tracking usage habits. The terminal device can display the gaze cursor when the gaze point is within a predefined area and the third switch is on, improving the flexibility of the user's use of the eye-tracking function.
[0025] In one possible implementation, the method includes the following: When the terminal device detects that the gaze point is not within a pre-defined area, or when the duration for which the gaze point has been outside the first or second area is six or longer, the terminal device cancels the display of the gaze cursor. In this way, when the terminal device detects that the gaze point is not within a pre-defined area, or when the duration for which the gaze point has been outside the first or second area is six or longer, the terminal device may decide, based on the gaze status, that the user no longer needs to open the banner notification. Therefore, the terminal device may cancel the display of the gaze cursor, thereby reducing the gaze cursor's interference with the interface display.
[0026] In one possible implementation, the method further includes the following. When the terminal device determines that a pre-set function is not enabled and receives a third banner notification for the first time, the terminal device displays a third interface. The third interface includes the third banner notification and a first control used to enable the pre-set function. The terminal device displays a fourth interface in response to an operation on the first control. The fourth interface includes an identifier used to indicate that the pre-set function is not enabled. In this way, when the terminal device receives a banner notification for the first time and detects that the eye tracking function is not enabled, the terminal device may prompt the user to enable the eye tracking function and improve the user experience of using the eye tracking function.
[0027] The pre-set function may be the eye tracking function described in this embodiment of the present application. When the third interface may be the interface shown in FIG. 3A, the third banner notification may be the banner notification 301 in FIG. 3A, and the first control may be the control 303. Alternatively, when the third interface may be the interface shown in FIG. 3B, the third banner notification may be the banner notification 304 in FIG. 3B, and the first control may be the control 306. The fourth interface may be the interface shown in FIG. 3C.
[0028] In a possible implementation, after the terminal device displays the third interface, the method further includes the following. When the terminal device receives a first operation on the third interface, the terminal device displays a fifth interface. The fifth interface corresponds to the notification center of the terminal device. The fifth interface includes a first control and information used to indicate a recommendation for enabling a preset function. In this way, the terminal device can gently implement notifications in the notification center and recommend to the user to use the eye-tracking function when the use of another function by the user is not interfered with.
[0029] The fifth interface may be the interface shown in FIG. 4A. The first control may be control 403.
[0030] According to a second aspect, an embodiment of the present application provides a device for opening a banner notification. The device for opening a banner includes a display unit and a processing unit. The display unit is configured to display a first interface. The first interface includes a first banner notification. The first banner notification is located in a first area. The first banner notification is a banner notification started by a first application. When the processing unit detects that the gaze point is within the first area, the display unit is further configured to display a second banner notification on the first interface. The second banner notification is an expanded first banner notification. The message content of the second banner notification is more than the message content of the first banner notification. Alternatively, when the processing unit detects that the gaze point is within the first area, the display unit is further configured to display a second interface. The second interface is the displayed interface of the first application. The second interface includes the message content within the second banner notification.
[0031] In one possible implementation, the display unit is configured to display a second banner notification on the first interface and then display the second interface when the processing unit detects that the point of focus is within the first area.
[0032] In one possible implementation, it is permitted that a first banner notification is deployed, and when the processing unit detects that the point of attention is within the first region, the display unit is further configured to display a second banner notification on the first interface, and then display the second interface.
[0033] In one possible implementation, a first switch and a second switch are located on the terminal device, the first switch is configured to deploy a first banner notification when it is detected that the point of focus is within a first area, and the second switch is configured to open a first application when it is detected that the point of focus is within either the first or second area, the second area being the area where the second banner notification is located. When the first switch is ON, the second switch is ON, and the first banner notification is allowed to be deployed, and the processing unit detects that the point of focus is within the first area, the display unit is further configured to display the second interface after displaying the second banner notification on the first interface.
[0034] In one possible implementation, if the duration for which the first banner notification is displayed is greater than or equal to a first duration, the processing unit is further configured to cancel the display of the first banner notification. Alternatively, if the total duration for which the first and second banner notifications are displayed is greater than or equal to a first duration, the processing unit is further configured to cancel the display of the second banner notification.
[0035] In one possible implementation, when the processing unit detects that the duration for which the gaze point has been in a first region is greater than or equal to a second duration, the display unit is further configured to display a second banner notification on the first interface; after the display unit has displayed the second banner notification, the display unit is further configured to display the second interface when the processing unit detects that the duration for which the gaze point has been in a second region is greater than or equal to a seventh duration.
[0036] In one possible implementation, the seventh duration includes the third and fifth durations, and the first interface further includes a gaze cursor, which is used to indicate the position of the gaze point on the display. When the processing unit detects that the duration of the gaze point being in the second region is greater than or equal to the third duration, the display unit is further configured to display a first progress bar at the starting position of the outer edge of the gaze cursor. After the display unit has displayed the first progress bar at the starting position, when the processing unit detects that the duration of the gaze point being in the second region is greater than or equal to the fifth duration, the display unit is further configured to display a first progress bar at the ending position of the outer edge of the gaze point and to further display a second interface.
[0037] In one possible implementation, the display unit is allowed to have a first switch on and a second switch off, and a first banner notification to be deployed, and the processing unit is further configured to display a second banner notification on the first interface when it detects that the point of focus is within a first area.
[0038] In one possible implementation, the display unit is further configured to display a second banner notification on the first interface when the processing unit detects that the duration for which the point of focus is within a first area is equal to or greater than a second duration.
[0039] In one possible implementation, the display unit is further configured to display a second interface when the processing unit determines that a pre-configured condition is met and the processing unit detects that the point of focus is within a first area. The pre-configured condition includes the first switch being off and the second switch being on and allowing the first banner notification to be deployed, or the first switch being on and the second switch being on and not allowing the first banner notification to be deployed, or the first switch being off and the second switch being on and not allowing the first banner notification to be deployed.
[0040] In one possible implementation, the display unit is further configured to display a second interface when the processing unit detects that the duration for which the point of focus has been in a first region is equal to or greater than an eighth duration.
[0041] In one possible implementation, the eighth duration includes the fourth and fifth durations, and the first interface further includes a gaze cursor, which is used to indicate the position of the gaze point on the display. When the processing unit detects that the duration of the gaze point being in the first region is greater than or equal to the fourth duration, the display unit is further configured to display a second progress bar at the starting position of the outer edge of the gaze cursor. After the display unit has displayed the second progress bar at the starting position, when the processing unit detects that the duration of the gaze point being in the first region is greater than or equal to the fifth duration, the display unit is further configured to display a second progress bar at the ending position of the outer edge of the gaze point and to display a second interface.
[0042] In one possible implementation, the display unit is further configured to display a gaze cursor on a first interface when the processing unit detects that the gaze point is within a pre-configured area. The pre-configured area includes the first area, which is one-third of the display. The gaze cursor is used to indicate the position of the gaze point on the display.
[0043] In one possible implementation, a third switch is located on the terminal device and is configured to enable or disable the display of the gaze cursor, and a processing unit is further configured to detect that the gaze point is within a pre-configured area and, when the third switch is on, the display unit displays the gaze cursor on the first interface.
[0044] In one possible implementation, the processing unit is further configured to cancel the display of the gaze cursor when it detects that the gaze point is not within a predefined area, or that the duration for which the gaze point has been outside the first or second area is equal to or greater than the sixth duration.
[0045] In one possible implementation, when the processing unit determines that a pre-configured feature is not enabled and receives a third banner notification for the first time, the display unit is further configured to display a third interface. The third interface includes the third banner notification and a first control used to enable the pre-configured feature. The display unit is further configured to display a fourth interface in response to an operation on the first control. The fourth interface includes an identifier used to indicate that the pre-configured feature is not enabled.
[0046] In one possible implementation, the display unit is further configured to display a fifth interface when the processing unit receives a first operation on a third interface. The fifth interface is an interface corresponding to the notification center of the terminal device. The fifth interface includes a first control and information used to indicate recommendations to enable pre-configured functions.
[0047] According to a third aspect, one embodiment of the present application provides a terminal device including a processor and memory. The memory is configured to store code instructions. The processor is configured to execute code instructions such that the electronic device performs the methods described in the first aspect or any implementation of the first aspect.
[0048] According to a fourth aspect, one embodiment of the present application provides a computer-readable storage medium. The computer-readable storage medium stores instructions. When an instruction is executed, the computer performs the method described in the first aspect or any implementation of the first aspect.
[0049] According to the fifth aspect, a computer program product includes a computer program. When a computer program is executed, the computer performs the actions described in the first aspect or any implementation of the first aspect.
[0050] Aspects 2 through 5 of this application correspond to the technical solutions in Aspect 1 of this application, and it should be understood that the beneficial effects obtained in these aspects and their corresponding feasible implementations are similar. Further details are again not described herein. [Brief explanation of the drawing]
[0051] [Figure 1A] This is a schematic diagram of a scenario according to one embodiment of the present invention. [Figure 1B] This is a schematic diagram of a scenario according to one embodiment of the present invention. [Figure 1C] This is a schematic diagram of a scenario according to one embodiment of the present invention.
[0052] [Figure 2] This is a schematic diagram of the hardware structure of a terminal device according to one embodiment of the present invention.
[0053] [Figure 3A]This is a schematic diagram of an interface that recommends eye-tracking functionality according to one embodiment of the present invention. [Figure 3B] This is a schematic diagram of an interface that recommends eye-tracking functionality according to one embodiment of the present invention. [Figure 3C] This is a schematic diagram of an interface that recommends eye-tracking functionality according to one embodiment of the present invention. [Figure 3D] This is a schematic diagram of an interface that recommends eye-tracking functionality according to one embodiment of the present invention.
[0054] [Figure 4A] This is a schematic diagram of another interface that recommends eye-tracking functionality according to one embodiment of the present invention. [Figure 4B] This is a schematic diagram of another interface that recommends eye-tracking functionality according to one embodiment of the present invention. [Figure 4C] This is a schematic diagram of another interface that recommends eye-tracking functionality according to one embodiment of the present invention.
[0055] [Figure 5A] This is a schematic diagram of an interface for opening a banner notification according to one embodiment of the present invention. [Figure 5B] This is a schematic diagram of an interface for opening a banner notification according to one embodiment of the present invention. [Figure 5C] This is a schematic diagram of an interface for opening a banner notification according to one embodiment of the present invention. [Figure 5D] This is a schematic diagram of an interface for opening a banner notification according to one embodiment of the present invention. [Figure 5E] This is a schematic diagram of an interface for opening a banner notification according to one embodiment of the present invention. [Figure 5F] This is a schematic diagram of an interface for opening a banner notification according to one embodiment of the present invention.
[0056] [Figure 6A]This is a schematic diagram of an interface for opening another banner notification according to one embodiment of the present invention. [Figure 6B] This is a schematic diagram of an interface for opening another banner notification according to one embodiment of the present invention.
[0057] [Figure 7A] This is a schematic diagram of an interface for opening yet another banner notification according to one embodiment of the present invention. [Figure 7B] This is a schematic diagram of an interface for opening yet another banner notification according to one embodiment of the present invention. [Figure 7C] This is a schematic diagram of an interface for opening yet another banner notification according to one embodiment of the present invention. [Figure 7D] This is a schematic diagram of an interface for opening yet another banner notification according to one embodiment of the present invention.
[0058] [Figure 8A] This is a schematic diagram of an interface for opening yet another banner notification according to one embodiment of the present invention. [Figure 8B] This is a schematic diagram of an interface for opening yet another banner notification according to one embodiment of the present invention. [Figure 8C] This is a schematic diagram of an interface for opening yet another banner notification according to one embodiment of the present invention. [Figure 8D] This is a schematic diagram of an interface for opening yet another banner notification according to one embodiment of the present invention. [Figure 8E] This is a schematic diagram of an interface for opening yet another banner notification according to one embodiment of the present invention.
[0059] [Figure 9A] This is a schematic diagram of an interface in which the gaze cursor disappears, according to one embodiment of the present invention. [Figure 9B] This is a schematic diagram of an interface in which the gaze cursor disappears, according to one embodiment of the present invention. [Figure 9C]This is a schematic diagram of an interface in which the gaze cursor disappears, according to one embodiment of the present invention. [Figure 9D] This is a schematic diagram of an interface in which the gaze cursor disappears, according to one embodiment of the present invention. [Figure 9E] This is a schematic diagram of an interface in which the gaze cursor disappears, according to one embodiment of the present invention.
[0060] [Figure 10A] This is a schematic diagram illustrating the procedure for opening a banner notification according to one embodiment of the present invention. [Figure 10B] This is a schematic diagram illustrating the procedure for opening a banner notification according to one embodiment of the present invention. [Figure 10C] This is a schematic diagram illustrating the procedure for opening a banner notification according to one embodiment of the present invention. [Figure 10D] This is a schematic diagram illustrating the procedure for opening a banner notification according to one embodiment of the present invention.
[0061] [Figure 11] This is a schematic diagram of the structure of a device for opening banner notifications according to one embodiment of the present invention.
[0062] [Figure 12] This is a schematic diagram of the hardware structure of another terminal device according to an embodiment of the present invention. [Modes for carrying out the invention]
[0063] To clearly illustrate the technical solutions in the embodiments of this application, terms such as “first” and “second” are used in the embodiments of this application to distinguish the same or similar items that provide essentially the same function or purpose. For example, “first value” and “second value” are used simply to distinguish different values and are not intended to limit their sequence. Those skilled in the art will understand that terms such as “first” and “second” do not limit the quantity and execution sequence, and that terms such as “first” and “second” do not need to define differences.
[0064] In this application, terms such as “example” or “for example” are used to indicate that an example, illustration, or explanation is being given. No embodiment or design described herein as “example” or “for example” should be construed as being preferable or advantageous to another embodiment or design. In particular, terms such as “example” or “for example” as used herein are intended to specifically present the relevant concepts.
[0065] In this application, “at least one” refers to one or more, and “multiple” refers to two or more. The term “and / or” describes an association between related objects and indicates that three relationships may exist. For example, A and / or B could refer to three cases: only A exists, both A and B exist, or only B exists. Here, A and B can be singular or plural. The symbol “ / ” generally indicates that the related objects are in an “or” relationship. “At least one of the following items” or similar expressions refer to any combination of these items, including a single item or any combination of multiple items. For example, at least one of a, b, or c may refer to a, b, c, a and b, a and c, b and c, or a, b, and c, where a, b, and c can be singular or plural.
[0066] An expandable banner notification may be a banner notification that is permitted to be expanded. For example, a terminal device may display a banner notification, and the banner notification may include controls used to expand the banner notification. When the terminal device receives an action performed by the user on the controls for expanding the banner notification, the terminal device displays the expanded banner notification. The message content of the expanded banner notification is greater than the message content of the non-expanded banner notification.
[0067] A non-expandable banner notification may be a banner notification that is not permitted to be expanded. For example, a terminal device may display a banner notification. When the terminal device receives a trigger action performed by the user at any point within the banner notification, the terminal device opens the application interface corresponding to the banner notification. The application interface contains the message content within the banner notification. A non-expandable banner notification does not contain the controls used to expand the banner notification.
[0068] For example, Figures 1A, 1B, and 1C are schematic diagrams of a scenario according to one embodiment of the present application. In the embodiments corresponding to Figures 1A, 1B, and 1C, an example is used for illustrative purposes in which the terminal device is a mobile phone and the banner notification is a banner notification sent by a messaging application. This example does not constitute a limitation of the present application to this embodiment.
[0069] When a terminal device receives a message, it may display the interface shown in Figure 1A. The interface may include a banner notification 101. The banner notification 101 may include one or more of the following: message content, controls 102 used to expand the banner notification, controls used to reply to the message, or controls used to mark the message as read. The message content may be sent by user A. The message content may be displayed as "Have you booked tickets for Saturday's concert? Saturday..." When it is permitted for the banner notification 101 to be expanded, it may be understood that the banner notification 101 may include controls 102.
[0070] The interface shown in Figure 1A may be the home screen of the terminal device, or it may be another interface. The home screen may display applications such as a clock application, calendar application, gallery application, notepad application, camera application, contacts application, phone application, messaging application, etc. In this embodiment of the present application, the content displayed on the home screen of the terminal device and the interface covered by the banner notification 101 are not particularly limited.
[0071] On the interface shown in Figure 1A, when a terminal device receives a trigger operation performed by the user on the message content within the deployed banner notification 101, the terminal device may display the interface shown in Figure 1B. On the interface shown in Figure 1B, the interface may be a message application interface corresponding to the banner notification 101. The interface may include information 103. The complete information content may be displayed in information 103. The complete information content may be, "Have you booked tickets for the concert on Saturday? What are your plans for Saturday? Shall we have lunch together? I saw a restaurant with a high score yesterday. Shall we have lunch together if it's not urgent?" Furthermore, the user may reply to the message or view the complete message content on the interface shown in Figure 1B.
[0072] On the interface shown in Figure 1A, when a terminal device receives a trigger operation performed by a user on control 102, the terminal device may display the interface shown in Figure 1C. On the interface shown in Figure 1C, the interface may include an expanded banner notification 104. The complete message content may be displayed in the expanded banner notification 104. The complete message content is consistent with the message content displayed on the interface shown in Figure 1B. Further details are not described herein.
[0073] In one possible implementation, when the terminal device receives a trigger operation performed by the user on the message content within the expanded banner notification 104 on the interface shown in Figure 1C, the terminal device may also display the interface shown in Figure 1B.
[0074] The unexpandable banner notification does not include control 102. The application interface corresponding to the banner notification can be opened directly by tapping any location on the unexpandable banner notification.
[0075] For the two types of banner notifications mentioned above, in scenarios where it is inconvenient for the user to trigger the notification on their device, it is difficult to flexibly deploy the banner notification or open an application interface that responds to the banner notification. Scenarios where it is inconvenient for the user to trigger the notification on their device may include scenarios such as meeting scenarios, mobile phones held in one hand, or cooking scenarios. An application that responds to banner notifications may be understood as an application for sending banner notifications.
[0076] In view of this, one embodiment of the present invention provides a method for opening a banner notification so that a terminal device can flexibly unfold a banner notification and / or open an application interface corresponding to the banner notification when it detects that the user's gaze position (or gaze point) is within the area where the banner notification is located.
[0077] The aforementioned terminal devices may also be called terminals, user equipment (UE), mobile stations (MS), mobile terminals (MT), etc. Terminal devices may include mobile phones, smart TVs, wearable devices, tablet computers (Pads), computers with wireless transmission and reception capabilities, virtual reality (VR) terminal devices, augmented reality (AR) terminal devices, wireless terminals in industrial control, wireless terminals in self-driving, wireless terminals in remote medical surgery, wireless terminals in smart grids, wireless terminals in transportation safety, wireless terminals in smart cities, and / or wireless terminals in smart homes. The specific technologies and device forms used by terminal devices are not limited to the embodiments of this application.
[0078] Therefore, in order to better understand the embodiments of the present invention, the structure of the terminal device in the embodiments of the present invention will be described below. For example, Figure 2 is a schematic diagram of the hardware structure of a terminal device according to one embodiment of the present invention.
[0079] The terminal device may include a processor 110, an external memory interface 120, internal memory 121, a universal serial bus (USB) interface 130, a charging management module 140, a power management module 141, antenna 1, antenna 2, a mobile communication module 150, a wireless communication module 160, an audio module 170, a speaker 170A, a telephone receiver 170B, a microphone 170C, a headset jack 170D, a sensor module 180, a button 190, an indicator 192, a camera 193, a display 194, and the like.
[0080] The sensor module 180 may include one or more of the following: for example, it may include sensors such as a pressure sensor, gyroscope sensor, barometric pressure sensor, magnetic sensor, accelerometer, distance sensor, optical proximity sensor, fingerprint sensor, temperature sensor, touch sensor, ambient light sensor, or bone conduction sensor.
[0081] It should be understood that the structures shown in this embodiment of the present application do not constitute any particular limitation on terminal devices. In some other embodiments of the present application, terminal devices may include more or fewer components than those shown in the figures, or some components may be combined, or some components may be separated, or different component arrangements may be used. The components in the figures may be implemented by hardware, software, or a combination of software and hardware.
[0082] The processor 110 may include one or more processing units. Different processing units may be separate devices or may be integrated into one or more processors. The processor 110 may further include memory configured to store instructions and data.
[0083] The USB interface 130 is an interface compliant with the USB standard, and may specifically be a Mini USB interface, Micro USB interface, USB Type C interface, etc. The USB interface 130 may be configured to connect to a charger to charge a terminal device, or to transmit data between a terminal device and a peripheral device, or to connect to a headset to play audio through the headset. Alternatively, the interface may be configured to connect to another device, such as an AR device.
[0084] The charging management module 140 is configured to receive a charging input from the charger. The charger may be a wireless charger or a wired charger. The power management module 141 is configured to connect to the charging management module 140 and the processor 110.
[0085] The wireless communication function of the terminal device may be implemented by using antenna 1, antenna 2, mobile communication module 150, wireless communication module 160, modem, baseband processor, etc.
[0086] Antennas 1 and 2 are configured to transmit and receive electromagnetic wave signals. The antennas in the terminal device may be configured to cover one or more communication frequency bands. Different antennas may be multiplexed to improve antenna utilization.
[0087] The mobile communication module 150 can provide a solution for wireless communication such as 2G / 3G / 4G / 5G applied to terminal devices. The mobile communication module 150 may include at least one filter, switch, power amplifier, low noise amplifier (LNA), etc. The mobile communication module 150 can receive electromagnetic waves through antenna 1, perform processing such as filtering or amplification on the received electromagnetic waves, and transmit the electromagnetic waves to the modem for demodulation.
[0088] The wireless communication module 160 can provide solutions for wireless communication, including wireless local area networks (WLAN) (such as wireless fidelity (Wi-Fi) networks), Bluetooth (BT), global navigation satellite systems (GNSS), and frequency modulation (FM), which are applicable to terminal devices.
[0089] The modem may include a modulator and a demodulator. The modulator is configured to modulate a low-frequency baseband signal to be transmitted into a mid-to-high frequency signal. The demodulator is configured to demodulate the received electromagnetic signal into a low-frequency baseband signal. The demodulator then transmits the low-frequency baseband signal obtained through demodulation to a baseband processor for processing. The low-frequency baseband signal is processed by the baseband processor and then sent to an application processor. The application processor outputs an acoustic signal through an audio device (not limited to a speaker, handset, etc.) or displays images or videos through a display 194. In some embodiments, the modem may be a separate device. In some other embodiments, the modem may be independent of the processor 110 and be located in the same device as the mobile communication module 150 or another functional module.
[0090] The terminal device may implement display functionality by using a GPU, a display 194, an application processor, etc. The GPU is a microprocessor for image processing and is connected to the display 194 and the application processor. The GPU is configured to perform mathematical calculations, geometric calculations, and graphics rendering.
[0091] The display 194 is configured to display images, videos, and the like. The display 194 includes a display panel. In some embodiments, the terminal device may include one or N displays 194, where N is a positive integer greater than 1.
[0092] The terminal device may implement the shooting function by using an ISP, camera 193, video codec, GPU, display 194, application processor, etc.
[0093] Camera 193 is configured to capture still images or video. In some embodiments, the terminal device may include one or N cameras 193, where N is a positive integer greater than 1.
[0094] The external memory interface 120 may be configured to connect to an external storage card, such as a microSD card, in order to expand the storage capacity of the terminal device. The external storage card communicates with the processor 110 through the external memory interface 120 to implement data storage functions. For example, files such as music and videos are stored on the external storage card.
[0095] The internal memory 121 may be configured to store computer-executable program code. Executable program code includes instructions. The internal memory 121 may include a program storage area and a data storage area.
[0096] The terminal device can perform audio functions, such as music playback and recording, by using an audio module 170, a speaker 170A, a telephone receiver 170B, a microphone 170C, a headset jack 170D, an application processor, and the like.
[0097] The audio module 170 is configured to convert digital audio information into an analog audio signal for output, and is also configured to convert an analog audio input into a digital audio signal. The speaker 170A, also called the "horn," is configured to convert an electrical audio signal into a sound signal. The terminal device can use the speaker 170A to listen to music or answer calls in hands-free mode. The telephone receiver 170B, also called the "earphone," is configured to convert an electrical audio signal into a sound signal. When the terminal device receives a call or voice message, the receiver 170B can be positioned near the ear to receive the sound. The headset jack 170D is configured to connect to a wired headset. The microphone 170C, also called the "mic" or "microphone," is configured to convert a sound signal into an electrical signal. In this embodiment of the present application, the terminal device may have one microphone 170C.
[0098] Button 190 includes a power button, volume buttons, etc. Button 190 may be a mechanical button or a touch key. The terminal device may receive button input and generate button signal inputs related to user settings and function control of the terminal device. Indicator 192 may be an indicator light, may be configured to show the charging status or power change, or may be configured to show messages, missed calls, notifications, etc.
[0099] In addition, an operating system, such as the iOS operating system, the Android operating system, or the Windows® operating system, runs on top of the aforementioned components of the device. Applications can be installed and run on top of the operating system.
[0100] The software system of the terminal device may use a layered architecture, an event-driven architecture, a microkernel architecture, a microservices architecture, a cloud architecture, etc. Details are not provided here.
[0101] The following describes in detail, using specific embodiments, the technical solutions of the present application and how the aforementioned technical problems are solved in accordance with these technical solutions. Some of the following specific embodiments may be implemented independently or in combination with one another, and the same or similar concepts or processes may not be described repeatedly in some embodiments.
[0102] The terminal device described in the embodiments of the present application may support eye-tracking functionality. Eye-tracking functionality may be understood as follows: The terminal device tracks the location of a gaze point and, through tracking the location of the gaze point, determines whether or not to deploy a banner notification and / or whether or not to open the application corresponding to the banner notification.
[0103] When a banner notification is received for the first time and the device detects that eye-tracking is not enabled, the terminal device may recommend eye-tracking by using a prompt capsule (see embodiments corresponding to Figures 3A, 3B, 3C, and 3D) and / or by using a gentle notification feature in the notification bar (see embodiments corresponding to Figures 4A, 4B, and 4C).
[0104] Furthermore, if the user does not enable the eye-tracking feature when it is first recommended, the device may recommend the eye-tracking feature again using a gentle notification in the notification bar after a predetermined time period (for example, 7 or 14 days) starting from the initial recommendation (see embodiments corresponding to Figures 4A, 4B, and 4C).
[0105] In this specification, “first time” may mean that a banner notification is received for the first time in the following cases: 1. The user purchases a new mobile phone, and the new mobile phone includes eye-tracking functionality corresponding to the method described in this embodiment of the Application. 2. The user upgrades the software system of an old mobile phone, and the upgraded system version includes eye-tracking functionality corresponding to the method described in this embodiment of the Application.
[0106] For example, Figures 3A, 3B, 3C, and 3D are schematic diagrams of an interface that recommends eye-tracking functionality according to one embodiment of the present invention.
[0107] The terminal device may display the interface shown in Figure 3A when it receives a banner notification for the first time, detects that eye-tracking is not enabled, and determines that the banner notification supports expansion (as shown in Figure 1C). Alternatively, the terminal device may display the interface shown in Figure 3B when it receives a banner notification for the first time, detects that eye-tracking is not enabled, and determines that the banner notification does not support expansion.
[0108] In the interface shown in Figure 3A, the interface may include a banner notification 301 and a prompt capsule 302. The banner notification 301 includes a control used to expand the banner notification. The prompt capsule 302 includes a control 303 used to enable eye-tracking functionality. The prompt capsule 302 is used to prompt the user to focus on the banner notification to expand it. The prompt capsule 302 may be displayed as "Focus to expand notification". The control 303 may be displayed as "Tap to open".
[0109] Regarding the interface shown in Figure 3B, the interface may include a banner notification 304 and a prompt capsule 305. The banner notification 304 does not include a control used to expand the banner notification. The prompt capsule 305 includes a control 306 used to enable eye-tracking functionality. The prompt capsule 305 is used to prompt the user to focus on the banner notification in order to open the application interface corresponding to the banner notification. The prompt capsule 305 may be displayed as "Focus on notification to open". The control 306 may be displayed as "Tap to open".
[0110] Referring to the interfaces shown in Figure 3A and Figure 3B, it can be understood that different content may be displayed within the prompt capsule depending on whether the banner notification supports expansion. For example, if banner notification 301 supports expansion, prompt capsule 302 may prompt the user that the notification can be expanded through attention, or if banner notification 304 does not support expansion, prompt capsule 305 may prompt the user that the application corresponding to the banner notification can be opened through attention.
[0111] Furthermore, when the terminal device receives a trigger operation performed by the user on control 303 shown in Figure 3A, or on control 306 on the interface shown in Figure 3B, the terminal device may display the interface shown in Figure 3C. Regarding the interface shown in Figure 3C, the interface may be a configuration interface corresponding to the smart sensing function in the terminal device's system settings. The interface may include control 307 (or referred to as eye-tracking control 307) used to enable and calibrate the eye-tracking function. The word “Uncalibrated” may be displayed near control 307. The word “Uncalibrated” may be used to indicate that the user has not enabled the eye-tracking function.
[0112] When the terminal device receives a trigger operation performed by the user on control 307 and completes calibration for eye tracking on the interface shown in Figure 3C, the terminal device may display the interface shown in Figure 3D. The interface shown in Figure 3D may include a first switch 308, a second switch 309, a switch description, and a third switch 310. The first switch 308, the second switch 309, and the third switch 310 may all be turned on by default after calibration is complete.
[0113] It can be understood that once the terminal device has completed calibration for eye tracking, it may then set the on / off status of the first switch 308, the second switch 309, and the third switch 310 without further calibration. Also, once the terminal device has completed calibration for eye tracking and reopens the interface shown in Figure 3C, the word "Calibrated" may appear around control 307 on the interface. The word "Calibrated" is used to indicate that the user has calibrated the eye tracking function. The on / off status of the three switches on the interface shown in Figure 3D indicates whether the eye tracking function is enabled (specific cases are described below).
[0114] Switch descriptions are used to indicate that a terminal device can dynamically track human-eye-based assistive screen operations and perform actions indicated by a first or second switch when focus on a banner notification is recognized.
[0115] When the first switch 308 is ON, the terminal device expands the content of a banner notification that supports expansion when it detects that the user is looking at the banner notification. When the first switch 308 is OFF, the terminal device cannot expand the content of a banner notification that supports expansion, even if it detects that the user is looking at the banner notification.
[0116] It can be understood that the first switch 308 is applicable to banner notifications that support deployment, but not to banner notifications that do not support deployment. Even when the first switch 308 is turned on, banner notifications that do not support deployment cannot be deployed through user attention.
[0117] When the second switch 309 is ON, the terminal device can open the application corresponding to the banner notification when it detects that the user is looking at the banner notification, for both banner notifications that support deployment and banner notifications that do not support deployment. When the second switch 309 is OFF, the terminal device cannot open the application corresponding to the banner notification, even if it detects that the user is looking at the banner notification, for both banner notifications that support deployment and banner notifications that do not support deployment.
[0118] It can be understood that the second switch 309 is applicable to banner notifications that support deployment and banner notifications that do not support deployment. When the second switch 309 is on, applications that support banner notifications can be opened through the user's attention for both banner notifications that support deployment and banner notifications that do not support deployment. Alternatively, when the second switch 309 is off, applications that support banner notifications cannot be opened through the user's attention for either banner notifications that support deployment or banner notifications that do not support deployment.
[0119] Assume that the first switch 308 or the second switch 309 is ON. When the third switch 310 is ON and the terminal device receives a banner notification, the terminal device enables the eye-tracking function described in this embodiment of the present application. The terminal device may display a gaze cursor when the terminal device detects eye movement data and the gaze point indicated in the eye movement data is within a pre-set area of the display.
[0120] When the third switch 310 is in the off state, the gaze cursor is not displayed even if the terminal device detects eye movement data and the point of fixation indicated in the eye movement data is within a pre-set area on the display.
[0121] Alternatively, when both the first switch 308 and the second switch 309 are in the off state, the terminal device cannot enable the eye-tracking function even if the third switch 310 is in the on state.
[0122] Eye movement data can be understood as the position of a human face, the position of a human eye, and / or similar. Eye movement data is not biometric data that identifies the user. The area of the pre-set region occupies one-third of the total display area. The pre-set region is the upper area of the display.
[0123] It can be understood that any interface described in the following embodiments corresponding to Figures 5A to 9E may be an interface that is displayed when the third switch 310 is ON. In one possible implementation, when the third switch 310 is OFF, the terminal device may not be able to display a gaze cursor based on the user's gaze status, nor can it display a progressive motion effect on the outer edge of the gaze cursor based on the user's gaze status, however, the content indicated by the first switch and / or the second switch may still be performed based on the user's gaze status for banner notifications.
[0124] On the interface shown in Figure 3D, the terminal device can then configure the first switch 308, the second switch 309, and the third switch 310, which are on by default, according to user requirements.
[0125] According to the aforementioned embodiment of the present application, when the terminal device receives a banner notification for the first time and detects that the eye-tracking function is not enabled, it may prompt the user to enable the eye-tracking function in order to improve the user's experience using the eye-tracking function.
[0126] For example, Figures 4A, 4B, and 4C are schematic diagrams of another interface that recommends eye-tracking functionality according to one embodiment of the present invention.
[0127] The terminal device receives a banner notification for the first time and detects that eye-tracking is not enabled. The terminal device may display the interface shown in Figure 3A or Figure 3B, or it may display a Tips application notification in the notification center. For example, when the terminal device receives a swipe operation from the user from the top of the display downwards, the terminal device displays the interface shown in Figure 4A. The interface may include a Tips application notification. The content of the notification includes information indicating eye-tracking functionality.
[0128] Regarding the interface shown in Figure 4A, the interface may include a notification 401 initiated by the hint application. Notification 401 is used to encourage the user to use the eye-tracking feature. Notification 401 may include text information 402 used to encourage the use of the eye-tracking feature and a control 403 used to enable the eye-tracking feature. The text information 402 may be displayed as "Look at the screen to expand the banner notification and open the application Learn more". The control 403 may be displayed as Enable.
[0129] On the interface shown in Figure 4A, when a terminal device receives a trigger operation performed by the user on control 403, the terminal device may display the interface shown in Figure 4B. The interface shown in Figure 4B may include control 404. The word “Uncalibrated” may be displayed around control 404. The word “Uncalibrated” may be used to indicate that the user has not enabled the eye-tracking function.
[0130] When the terminal device receives a trigger operation performed by the user on control 404 and completes calibration for eye tracking on the interface shown in Figure 4B, the terminal device may display the interface shown in Figure 4C. The interface shown in Figure 4C is the same as the interface shown in Figure 3D. Further details are again not described herein.
[0131] In one possible implementation, if the user does not enable eye-tracking when it is first recommended, the device may again recommend eye-tracking to the user by using a gentle notification in the notification bar. For example, the device may again display a hint application notification in the notification center after a predetermined time period (e.g., 7 or 14 days) starting from the initial recommendation of eye-tracking. When the user pulls down from the top of the device to view the notification center, the device displays the interface shown in Figure 4A. The interface shown in Figure 4A includes a hint application notification. The content of the notification includes information indicating eye-tracking functionality.
[0132] If a user enabled eye-tracking the first time they were recommended to use it, the device may understand that it does not need to display the hint application notification again in the notification center.
[0133] Based on this, the device may implement several recommendations regarding the eye-tracking function to improve the frequency of user use of the eye-tracking function and the user experience of using the eye-tracking function.
[0134] Based on embodiments corresponding to Figures 3A, 3B, 3C, and 3D, or Figures 4A, 4B, and 4C, when eye-tracking functionality is enabled on a terminal device, the terminal device may determine how to perform the display when the gaze point is on a banner notification, based on the user's configuration status for the first and second switches and whether the banner notification supports deployment.
[0135] Any interface described in the following embodiments corresponding to Figures 5A to 8E may be an interface that is displayed when the third switch 310 is ON.
[0136] Regarding banner notifications that support deployment:
[0137] When both the first and second switches are on, and the terminal device detects a banner notification and determines that the banner notification supports deployment, the terminal device may enable eye-tracking functionality. For example, if the device detects that the gaze point is within the area where the banner notification is located, the terminal device deploys the banner notification and opens the application corresponding to the banner notification (see embodiments corresponding to Figures 5A, 5B, 5C, 5D, 5E, and 5F).
[0138] When the first switch is ON and the second switch is OFF, and the terminal device detects a banner notification and determines that the banner notification supports deployment, the terminal device may enable the eye-tracking function. For example, if the point of gaze is detected to be within the area where the banner notification is located, the terminal device deploys the banner notification (see embodiments corresponding to Figures 6A and 6B).
[0139] When the first switch is off and the second switch is on, and the terminal device detects a banner notification and determines that the banner notification supports deployment, the terminal device may enable eye-tracking functionality. For example, when the point of gaze is detected to be within the area where the banner notification is located, the terminal device opens the application corresponding to the banner notification (see embodiments corresponding to Figures 7A, 7B, 7C, and 7D).
[0140] When both the first and second switches are off, the terminal device does not need to monitor banner notifications and therefore cannot enable the eye-tracking function.
[0141] It can be understood that when the terminal device completes the calibration of the eye-tracking function, the first switch and the second switch are in the ON state by default. Therefore, the first switch being OFF and / or the second switch being OFF as described in this embodiment of the present application can be understood as the user turning off the first switch and / or the second switch after the first switch and the second switch have been in the ON state by default.
[0142] When both the first and second switches are off, it can be understood that calibration for the eye-tracking function is complete, but the eye-tracking function is disabled, and therefore the terminal device does not need to monitor banner notifications. When either the first or second switch is on, the terminal device monitors banner notifications and, upon detecting a banner notification, may decide whether to enable the eye-tracking function based on whether the banner notification supports deployment.
[0143] Regarding banner notifications that do not support deployment:
[0144] When both the first and second switches are on, and the terminal device detects a banner notification and determines that the banner notification does not support deployment, the terminal device may enable eye-tracking functionality. For example, when the gaze point is detected to be within the area where the banner notification is located, the terminal device opens the application corresponding to the banner notification (see embodiments corresponding to Figures 8A, 8B, 8C, 8D, and 8E).
[0145] When the first switch is on and the second switch is off, and the terminal device detects a banner notification and determines that the banner notification does not support deployment, the terminal device does not need to enable the eye-tracking function.
[0146] When the first switch is off and the second switch is on, and the terminal device detects a banner notification and determines that the banner notification does not support deployment, the terminal device may enable eye tracking. For example, when the gaze point is detected to be within the area where the banner notification is located, the terminal device opens the application corresponding to the banner notification (see embodiments corresponding to Figures 8A, 8B, 8C, 8D, and 8E).
[0147] When both the first and second switches are off, the terminal device does not need to monitor banner notifications and therefore cannot enable the eye-tracking function.
[0148] In one implementation, when both the first and second switches are on, and the terminal device detects a banner notification and determines that the banner notification supports expansion, the terminal device can enable eye-tracking functionality. For example, when the point of focus is detected to be within the area where the banner notification is located, the terminal device expands the banner notification and opens the application corresponding to the banner notification.
[0149] For example, Figures 5A, 5B, 5C, 5D, 5E, and 5F are schematic diagrams of a banner notification open interface according to one embodiment of the present invention.
[0150] When both the first and second switches are on, the terminal device can monitor banner notifications. For example, when the terminal device detects a banner notification and determines that the banner notification supports deployment, the terminal device enables eye-tracking functionality. When the user gazes at a pre-configured area, the terminal device displays the interface shown in Figure 5A. The interface may include a gaze cursor 501, a banner notification 502, and a prompt capsule 503. The banner notification 502 may include controls 504 used to deploy the banner notification.
[0151] The attention cursor 501 is used to indicate the user's point of focus. The attention cursor 501 is not located in the area where the banner notification 502 is located. However, the attention cursor 501 is located in a pre-set area of the display. The attention cursor 501 may be a semi-transparent icon containing two concentric circles. The two circles have different depths. The inner circle is darker in color than the outer circle. The attention cursor 501 also presents the same display effect in different display modes of the terminal device. Different display modes may include dark mode, light mode, etc.
[0152] After eye-tracking is enabled, it may be understood that the terminal device does not need to display the gaze cursor 501 when the user's gaze point is not in a pre-set area. When it is detected that the user's gaze point has moved from an area outside the pre-set area of the display to the pre-set area, the terminal device may display a black dot at the location of the gaze point, expand the dot within a duration such as 200ms, and display the dot transparently until the gaze cursor 501 is displayed.
[0153] The area of the aforementioned pre-configured area occupies one-third of the total display area. The pre-configured area is the upper area of the display. For example, the pre-configured area may be the area within the dashed rectangle in Figure 5A. The pre-configured area includes the banner notification 502.
[0154] The prompt capsule 503 is used to prompt the user that the content of the banner notification can be expanded and that by paying attention to the banner notification, the corresponding interface can be opened. The prompt capsule 503 can be displayed when eye tracking is enabled and the banner notification appears for the first two (or first three) times, etc., to indicate to the user to pay attention to the banner notification. After that, the prompt capsule 503 does not need to be displayed anymore.
[0155] On the interface shown in Figure 5A, when a terminal device detects that the gaze point has moved to the area where the banner notification 502 is located, the terminal device may display the interface shown in Figure 5B. On the interface shown in Figure 5B, the gaze cursor 501 is within the area where the banner notification 502 is located. Compared to the banner notification 502 on the interface shown in Figure 5A, the banner notification 502 on the interface shown in Figure 5B may be enlarged based on a magnification ratio. The magnification ratio may be a value such as 102%.
[0156] It can be understood that the duration from the display to the disappearance of a banner notification may be a first duration. That is, the banner notification may disappear when the display duration reaches the first duration. The first duration may be 5 seconds, or the acceptable range of the first duration may be from 5 seconds to 10 seconds.
[0157] Regarding the process of deploying the banner notification 502, when the terminal device detects that the duration for which the gaze point has been continuously on the banner notification 502 has reached a second duration, the terminal device deploys the banner notification 502, and the interface displayed by the terminal device switches from Figure 5B to Figure 5C. For example, on the interface shown in Figure 5B, when the terminal device detects that the gaze point has been continuously within the area where the banner notification 502 is located for a second duration, the terminal device may display the interface shown in Figure 5C. The second duration may be the duration for deploying the banner notification. The second duration may be 500 milliseconds. The acceptable range for the second duration may be 400 milliseconds to 1 second.
[0158] Regarding the interface shown in Figure 5C, the interface may include an expanded banner notification 502. The complete information content may be displayed in the expanded banner notification 502. The gaze cursor 501 is within the area where the expanded banner notification 502 is located. The area occupied by the expanded banner notification 502 shown in Figure 5C may be larger than the area occupied by the banner notification 502 shown in Figure 5B.
[0159] In the process of starting the progress bar of the gaze cursor 501, when the terminal device detects that the duration of the gaze point over the continuously unfolding banner notification 502 has reached a third duration, the terminal device starts the progress bar at the outer edge of the gaze cursor 501, and the interface displayed by the terminal device switches from the interface shown in Figure 5C to the interface shown in Figure 5D. On the interface shown in Figure 5C, when the terminal device detects that the duration of the gaze point within the area where the unfolded banner notification 502 is located has reached a third duration and determines that the second switch is turned on, the terminal device may start a circular progress bar at the outer edge of the gaze cursor 501, thereby placing the progress bar in its starting position. The interface shown in Figure 5C switches to the interface shown in Figure 5D. The third duration may be the duration from when the banner notification is unfolded until the progress bar starts at the outer edge of the gaze cursor, for example, the duration until the interface shown in Figure 5C switches to the interface shown in Figure 5D. The third duration can be 2 seconds. The acceptable range for the third duration can be 1.5 seconds to 4 seconds.
[0160] In the process of completing the movement of the gaze cursor 501, when the terminal device detects that the duration for which the gaze point has been continuously located on the expanded banner notification 502 has reached a fifth duration, the terminal device completes the rotation of the gaze cursor 501. The interface displayed by the terminal device switches from the interface shown in Figure 5D to the interface shown in Figure 5E. In the interface shown in Figure 5D, if it is determined that the duration from the start of the progress bar at the outer edge of the gaze cursor to the completion of its movement has reached a fifth duration, the progress bar is at its end position. The terminal device displays the interface shown in Figure 5E. The terminal device may also display the interface shown in Figure 5F when the cursor movement is complete. The fifth duration may be the duration from the start of the gaze cursor to the completion of the gaze cursor, for example, the duration for which the interface shown in Figure 5C switches to the interface shown in Figure 5F. The fifth duration may be 800 milliseconds. The allowable range for the fifth duration may be from 500 milliseconds to 2 seconds.
[0161] In the interface shown in Figure 5D, the terminal device starts a circular progress bar at the outer edge of the gaze cursor 501. The progress bar at the outer edge of the gaze cursor 501 starts rotating clockwise from true north and darkens at the rotation position. As the progress bar rotates, the length of the dark area gradually increases until the progress bar at the outer edge of the gaze cursor 501 is completely dark. The progress of the gaze cursor 501 is completed, as shown on the interface in Figure 5E.
[0162] On the interface shown in Figure 5C, when the terminal device detects that the duration of time spent continuously on the expanded banner notification 502 has reached the seventh duration, the terminal device may start the progress bar of the gaze cursor 501, complete the progress bar of the gaze cursor 501, and further open the application corresponding to the banner notification. The seventh duration may be the sum of the third duration and the fifth duration.
[0163] In one possible implementation, the brightness at which the progress bar on the outer edge of the gaze cursor 501 is displayed may differ in different display modes of the terminal device.
[0164] Regarding the interface shown in Figure 5F, the interface may correspond to the expanded banner notification 502. The banner notification and the attention cursor can be canceled on the interface. Information 505 may be displayed on the interface. The information content of Information 505 may match the information content of the expanded banner notification 502. Details are not explained here.
[0165] In one possible implementation, when a terminal device detects a new banner notification on any interface shown in Figures 5B to 5E, the terminal device may interrupt eye tracking of the banner notification in Figures 5B to 5E and enable eye tracking of the new banner notification based on the status of the new banner notification being unfolded. The process of performing eye tracking for a new banner notification may be the same as the method for initiating eye tracking in the embodiments corresponding to Figures 5A, 5B, 5C, 5D, 5E, and 5F. Further details are again not described herein.
[0166] On any interface shown in Figures 5B to 5D, the display of a banner notification may be canceled when the display duration reaches the duration after which the banner notification disappears, and the display of the gaze cursor may be canceled when the duration for which the user's gaze point is away from the banner notification reaches a sixth duration, or when the gaze point leaves a pre-set area. For example, when the duration for which the user's gaze point is away from the banner notification reaches a sixth duration, the eye-tracking function is disabled and the gaze cursor disappears. The sixth duration may be the duration at which the eye-tracking function terminates. The acceptable range for the sixth duration may be 500 milliseconds to 2 seconds. For example, the sixth duration may be 1 second.
[0167] In another implementation, if the first switch is on and the second switch is off, and the terminal device detects a banner notification and determines that the banner notification supports expansion, the terminal device may enable eye-tracking functionality. For example, if the terminal device detects that there is a point of focus within the area where the banner notification is located, it expands the banner notification.
[0168] For example, Figures 6A and 6B are schematic diagrams of another banner notification opening interface according to one embodiment of the present invention.
[0169] When the first switch is ON and the second switch is OFF, the terminal device may monitor banner notifications. For example, when the terminal device receives a banner notification and determines that the banner notification supports expansion, the terminal device may enable eye-tracking functionality. When it detects that the gaze point is within the area where the banner notification is located, the terminal device may display the interface shown in Figure 6A. The interface may include a gaze cursor 601, a banner notification 602, and a prompt capsule 603. The banner notification 602 may include controls 604 used to expand the banner notification. The gaze cursor 601 is within the area where the banner notification 602 is located. For the function and display content of the prompt capsule 603, see the description of the prompt capsule 503 shown in Figure 5A. Further details are not described herein.
[0170] Regarding the process of deploying the banner notification 602, when the terminal device detects that the duration for which the gaze point has been continuously located on the banner notification 602 has reached a second duration, the terminal device deploys the banner notification 602, and the interface displayed by the terminal device switches from Figure 6A to Figure 6B. On the interface shown in Figure 6A, when the terminal device detects that the duration for which the gaze point has been continuously located within the area where the banner notification 602 is located has reached a second duration, the terminal device may display the interface shown in Figure 6B. On the interface shown in Figure 6B, the gaze cursor 601 is within the area where the deployed banner notification 602 is located, and the content displayed on the interface shown in Figure 6B may be the same as that of the interface shown in Figure 5C. Further details are not described herein.
[0171] Since the second switch is in the off state, it can be understood that when a banner notification is expanded, the terminal device will not open the application interface corresponding to the banner notification, even if the focus of attention is continuously on the expanded banner notification.
[0172] On any interface shown in Figure 6A or Figure 6B, the display of a banner notification may be canceled when the display duration reaches the duration after which the banner notification disappears, and the display of the gaze cursor may be canceled when the duration for which the user's gaze point is away from the banner notification reaches a sixth duration, or when the gaze point leaves the pre-configured area.
[0173] In yet another implementation, if the first switch is off and the second switch is on, and the terminal device detects a banner notification and determines that the banner notification supports deployment, the terminal device may enable eye-tracking functionality. For example, if the terminal device detects that there is an object of focus within the area where the banner notification is located, it opens the application corresponding to the banner notification.
[0174] For example, Figures 7A, 7B, 7C, and 7D are schematic diagrams of yet another interface for opening banner notifications according to one embodiment of the present invention.
[0175] When the first switch is off and the second switch is on, the terminal device may monitor banner notifications. For example, when the terminal device receives a banner notification and determines that the banner notification supports deployment, the terminal device may enable eye-tracking functionality. When it detects that there is a point of focus within the area where the banner notification is located, the terminal device may display the interface shown in Figure 7A. The content displayed on the interface may be similar to that of the interface shown in Figure 5B. Further details are again not described herein.
[0176] In the process of initiating the gaze cursor, when the terminal device detects that the duration for which the gaze point has been continuously on the banner notification has reached a fourth duration, the terminal device starts a progress bar on the outer edge of the gaze cursor, and the interface displayed by the terminal device switches from the interface shown in Figure 7A to the interface shown in Figure 7B. On the interface shown in Figure 7A, when the terminal device detects that the duration for which the gaze point has been continuously within the area where the banner notification is located has reached a fourth duration, the terminal device may start rotating the progress bar on the outer edge of the gaze cursor and display the interface shown in Figure 7B. The fourth duration may be the duration from when the gaze cursor is moved to the banner notification until the rotation of the gaze cursor's progress bar begins. The fourth duration may be 500 milliseconds. The allowable range of values for the fourth duration may be 400 milliseconds to 2 seconds.
[0177] In the process of completing the movement of the gaze cursor 501, when the terminal device detects that the duration for which the gaze point has been continuously within the area where the banner notification is located has reached a fifth duration, the terminal device completes the rotation of the progress bar. The interface displayed by the terminal device switches from the interface shown in Figure 7B to the interface shown in Figure 7C. Furthermore, after displaying the interface shown in Figure 7C, the terminal device may open the application corresponding to the banner notification and display the interface shown in Figure 7D.
[0178] When a terminal device detects that the duration for which the gaze point has been continuously on the banner notification has reached an eighth duration, the terminal device may start the gaze cursor progress bar, complete the gaze cursor progress bar, and further, open the application corresponding to the banner notification. The eighth duration may be the sum of the fourth duration and the fifth duration.
[0179] In yet another implementation, when both the first and second switches are on, and the terminal device detects a banner notification and determines that the banner notification does not support expansion, the terminal device may enable eye tracking. For example, when it detects that there is a point of focus in the area where the banner notification is located, the terminal device opens the application corresponding to the banner notification. Alternatively, when the first switch is off and the second switch is on, and the terminal device detects a banner notification and determines that the banner notification does not support expansion, the terminal device may enable eye tracking. For example, when it detects that there is a point of focus in the area where the banner notification is located, the terminal device opens the application corresponding to the banner notification.
[0180] Since banner notifications do not support deployment, it can be understood that terminal devices cannot deploy banner notifications, regardless of whether the first switch is ON or OFF. Turning the first switch ON or OFF does not affect the process of enabling eye tracking and opening the application corresponding to the banner notification when the terminal device receives a banner notification that does not support deployment. Figures 8A, 8B, 8C, 8D, and 8E illustrate opening the application corresponding to a banner notification by using an example where the first switch is OFF, the second switch is ON, and the banner notification does not support deployment.
[0181] For example, Figures 8A, 8B, 8C, 8D, and 8E are schematic diagrams of yet another interface for opening a banner notification according to one embodiment of the present application. In the embodiments corresponding to Figures 8A, 8B, 8C, 8D, and 8E, it is used as an example for illustrative purposes that the banner notification is a banner notification 802 sent by a social application. The banner notification 802 does not support deployment.
[0182] When the first switch is off and the second switch is on, the terminal device can monitor banner notifications. For example, when the terminal device detects a banner notification and determines that the banner notification does not support deployment, the terminal device can enable eye-tracking functionality. When it detects that the gaze point is within a pre-configured area, the terminal device displays the interface shown in Figure 8A. The interface may include a gaze cursor 801, a banner notification 802, and a prompt capsule 803.
[0183] The prompt capsule 803 is used to prompt the user to open the interface corresponding to the banner notification by paying attention to the banner notification. The prompt capsule 803 can be displayed when eye tracking is enabled and the banner notification appears for the first two (or first three) times, etc., to indicate to the user to pay attention to the banner notification. The attention cursor 801 is located in a pre-configured area. For a description of the pre-configured area, see the embodiments corresponding to Figures 5A, 5B, 5C, 5D, 5E, and 5F.
[0184] On the interface shown in Figure 8A, when the terminal device detects that the gaze point has moved to the area where the banner notification 802 is located, the terminal device may display the interface shown in Figure 8B. On the interface shown in Figure 8B, the gaze cursor 801 is within the area where the banner notification 802 is located. The banner notification 802 on the interface shown in Figure 8B may be magnified based on a magnification ratio. The magnification ratio may be a value such as 102%.
[0185] In the process of starting the gaze cursor 801, when the terminal device detects that the duration for which the gaze point has been continuously on the banner notification 802 has reached a fourth duration, the terminal device starts a progress bar on the outer edge of the gaze cursor 801, and the interface displayed by the terminal device switches from the interface shown in Figure 8B to the interface shown in Figure 8C.
[0186] In the process of completing the movement of the gaze cursor 801, when the terminal device detects that the duration for which the gaze point has been continuously within the area where the banner notification 802 is located has reached a fifth duration, the terminal device completes the rotation of the progress bar. The interface displayed by the terminal device switches from the interface shown in Figure 8C to the interface shown in Figure 8D. Furthermore, after displaying the interface shown in Figure 8D, the terminal device may open the application corresponding to the banner notification 802 and display the interface shown in Figure 8E.
[0187] On the interface shown in Figure 8E, the interface may be a social application interface. The interface may include information 804. The information content within the banner notification 802 may be fully displayed within information 804. Furthermore, the user can view the full content within the banner notification 802 or reply to the message on the interface shown in Figure 8E. In any of the interfaces shown in Figures 8B to 8D, the display of the banner notification may be canceled when the display duration reaches the duration after which the banner notification disappears, and the display of the gaze cursor may be canceled when the duration for which the user's gaze point is away from the banner notification reaches a sixth duration, or when the gaze point leaves a pre-defined area.
[0188] When a terminal device detects that the duration for which the gaze point has been continuously on the banner notification has reached an eighth duration, the terminal device may start the gaze cursor progress bar, complete the gaze cursor progress bar, and further, open the application corresponding to the banner notification. The eighth duration may be the sum of the fourth duration and the fifth duration.
[0189] Based on embodiments corresponding to Figures 5A to 8E, the terminal device can flexibly deploy the banner notification and / or open the application interface corresponding to the banner notification when it detects that there is a gaze point within the area where the banner notification is located and that the gaze duration meets certain conditions.
[0190] For example, Figures 9A, 9B, 9C, 9D, and 9E are schematic diagrams of an interface in which the gaze cursor disappears, according to one embodiment of the present invention.
[0191] In embodiments corresponding to Figures 9A, 9B, 9C, 9D, and 9E, the gaze cursor display may be canceled when the duration for which the user's gaze point has left the banner notification reaches a sixth duration, or when the gaze point leaves a pre-set area.
[0192] In one implementation, the terminal device displays the interface shown in Figure 9A, and the gaze cursor 901 on the interface is within the area where the banner notification is located. When the terminal device detects that the user's gaze point has left the banner notification, the gaze cursor 901 moves along with the user's gaze point to a pre-configured area on the interface shown in Figure 9B (the dashed area on the interface shown in Figure 9B). The banner notification display box is reduced in size, and timing begins.
[0193] When the terminal device detects that the duration for which the user's gaze has left the banner notification has reached the sixth duration, the terminal device may terminate the eye-tracking procedure and further cancel the display of the gaze cursor 901. In the process of canceling the display of the gaze cursor 901, the terminal device may switch from the interface shown in Figure 9B to the interface shown in Figure 9C. The gaze cursor 901 gradually contracts inward, and the color of the gaze cursor 901 gradually darkens.
[0194] On the interface shown in Figure 9C, the gaze cursor 901 is displayed as the dot with the deepest color. Furthermore, the gaze cursor 901 on the interface shown in Figure 9C may disappear.
[0195] In another implementation, the terminal device displays the interface shown in Figure 9A, and the gaze cursor 901 on the interface is within the area where the banner notification is located. When the terminal device detects that the user's gaze point has left the pre-set area, the gaze cursor 901 moves along with the user's gaze point to the lower side of the pre-set area on the interface shown in Figure 9D, and the display of the gaze cursor 901 is gradually removed. During the process of removing the display of the gaze cursor 901, the terminal device can switch from the interface shown in Figure 9D to the interface shown in Figure 9E. The gaze cursor 901 gradually shrinks inward, and the color of the gaze cursor 901 gradually darkens.
[0196] On the interface shown in Figure 9E, the gaze cursor 901 is displayed as the dot with the deepest color. Furthermore, the gaze cursor 901 on the interface shown in Figure 9E may disappear.
[0197] In embodiments corresponding to Figures 9A, 9B, 9C, 9D, and 9E, in the process of the gaze cursor 901 disappearing, it can be understood that the display duration of the banner notification may not reach the duration at which the banner disappears later, and therefore the position of the banner notification may not change.
[0198] In one possible implementation, on the interface shown in Figure 9A, when the terminal device detects that the banner notification has reached the duration at which the banner notification will disappear, both the banner notification and the attention cursor 901 disappear.
[0199] With respect to the interface shown in Figure 9B or Figure 9C, if the terminal device detects that the duration for which the gaze point has been away from the banner notification has not reached the sixth duration, and the terminal device detects that the gaze point has returned to the banner notification, the terminal device may display the interface shown in Figure 9A. With respect to the interface shown in Figure 9D or Figure 9E, if the terminal device detects that the gaze point has returned to the banner notification, the terminal device may display the interface shown in Figure 9A.
[0200] Based on embodiments corresponding to Figures 3A to 9E, one embodiment of the present application provides a method for opening a banner notification. For example, Figures 10A, 10B, 10C, and 10D are schematic diagrams of the procedure for opening a banner notification according to one embodiment of the present application.
[0201] As shown in Figures 10A, 10B, 10C, and 10D, the method for opening a banner notification may include the following steps:
[0202] S1001: The terminal device displays a banner notification.
[0203] A banner notification may be one that supports deployment or one that does not. For example, when a terminal device receives a message sent by any application, the terminal device may display a banner notification corresponding to the message. The banner notification may carry an identifier used to indicate whether deployment is supported.
[0204] S1002: The terminal device determines whether banner notifications support deployment.
[0205] If the terminal device determines that the banner notification supports deployment, the terminal device may perform the steps shown in S1014. Alternatively, if the terminal device determines that the banner notification does not support deployment, the terminal device may perform the steps shown in S1003.
[0206] S1003: The terminal device determines whether the second switch is on.
[0207] For the meaning of the second switch, please refer to the description of the embodiment corresponding to Figures 3A, 3B, 3C, and 3D. Further details are not described herein.
[0208] When the terminal device determines that the second switch is on, the terminal device may perform the steps shown in S1005. Alternatively, when the terminal device determines that the second switch is not on, the terminal device may perform the steps shown in S1004.
[0209] S1004: The terminal device does not have eye-tracking functionality enabled.
[0210] It can be understood that the terminal device may cancel the display of a banner notification if eye tracking is not enabled and the terminal device determines that the duration for which the banner notification is displayed has reached the duration for which the banner notification will disappear.
[0211] S1005: The terminal device enables eye-tracking functionality and detects gaze on banner notifications.
[0212] Detecting attention to a banner notification may be understood as the terminal device detecting that the user's gaze point is within the area where the banner notification is located. For example, the terminal device may enable eye-tracking and, upon detecting attention to a banner notification, display the interface shown in Figure 8B.
[0213] S1006: The terminal device determines whether attention to the banner notification has reached a fourth duration.
[0214] If the fourth duration is 500 milliseconds, and the terminal device determines that the gaze on the banner notification has reached 500 milliseconds, the terminal device may perform the steps shown in S1007. Alternatively, if the terminal device determines that the gaze on the banner notification has not reached 500 milliseconds, the terminal device may perform the steps shown in S1010. Reaching 500 milliseconds of gaze on the banner notification may be understood as the duration for which the gaze point is within the area where the banner notification is located being 500 milliseconds or more. Not reaching 500 milliseconds of gaze on the banner notification may be understood as the duration for which the gaze point is within the area where the banner notification is located being less than 500 milliseconds.
[0215] S1007: The terminal device begins advancing the gaze cursor.
[0216] The gaze cursor progression may be understood as a progress bar for initiating the display of the gaze cursor as described in the embodiments corresponding to Figures 5A to 8E. For example, a terminal device may display the interface shown in Figure 8C during the process of initiating gaze cursor progression.
[0217] S1008: The terminal device determines whether cursor progression is complete (fifth duration).
[0218] The fifth duration may be 800 milliseconds. When the terminal device determines that cursor progression is complete, the terminal device may perform the steps shown in S1009. Alternatively, when the terminal device determines that cursor progression is not complete, the terminal device may perform the steps shown in S1010.
[0219] S1009: The terminal device opens the application that supports the banner notification.
[0220] For example, when a terminal device opens an application that supports banner notifications, it may display the interface shown in Figure 8D.
[0221] S1010: The terminal device determines whether the duration of time the gaze has been away from the banner notification has reached the sixth duration.
[0222] If the sixth duration is 1 second, and the terminal device determines that the duration for which the gaze leaves the banner notification has reached 1 second, it may be understood that the user does not currently need to open the banner notification by using the eye-tracking function. Therefore, the terminal device may perform the steps shown in S1011. Alternatively, if the terminal device determines that the duration for which the gaze leaves the banner notification has not reached 1 second, it may be understood that the user needs to proceed with opening the banner notification by using the eye-tracking function, and that the gaze may only be averted for a short time. Therefore, the terminal device may perform the steps shown in S1012.
[0223] S1011: When the duration for which the banner notification will disappear has been reached, the terminal device will disable the eye-tracking function and cancel the display of the banner notification.
[0224] The terminal device may cancel the display of the gaze cursor if it decides to disable the eye-tracking function.
[0225] S1012: The terminal device determines whether the duration for the banner notification to disappear has been reached.
[0226] The duration until the banner notification disappears may alternatively be the first duration. When the terminal device determines that the duration for which the banner notification is displayed has reached the duration until the banner notification disappears, the terminal device may perform the steps shown in S1013. Alternatively, if the terminal device determines that the duration for which the banner notification is displayed has not reached the duration until the banner notification disappears, the terminal device may perform the steps shown in S1005 to detect the status of the user paying attention to the banner notification.
[0227] For example, if a banner notification lasts for 5 seconds before disappearing, and the terminal device detects that the user is staring at the banner at the 4th second after the banner notification is displayed, and that the staring has reached 500 milliseconds, the terminal device may restart the staring cursor progression and open the application corresponding to the banner notification when the cursor progression is complete.
[0228] In one possible implementation, if the duration of the banner notification until it disappears is 5 seconds, and the terminal device detects that the user is staring at the banner at the 4th second of the banner notification's display and that the staring has reached 500 milliseconds, the terminal device may restart the staring cursor movement. Furthermore, if the terminal device detects that the time the staring leaves the banner notification is less than 1 second, but the duration the banner notification is displayed is approximately 5.5 seconds, which is longer than the duration of the banner notification until it disappears (5 seconds), the terminal device may cancel the display of the banner notification and the staring cursor.
[0229] S1013: The terminal device cancels the display of the banner notification.
[0230] The process of opening a banner notification is interrupted after the terminal device cancels the display of the banner notification. In this case, if the attention cursor is present on the interface, it disappears accordingly. The next time a banner notification is detected, the terminal device may restart the process of opening the banner notification.
[0231] S1014: The terminal device determines whether the first switch is turned on.
[0232] For the meaning of the first switch, please refer to the description of the embodiment corresponding to Figures 3A, 3B, 3C, and 3D. Further details are not described herein.
[0233] When the terminal device determines that the first switch is on, the terminal device may perform the steps shown in S1015. Alternatively, when the terminal device determines that the first switch is not on, the terminal device may perform the steps shown in S1003.
[0234] S1015: The terminal device enables eye-tracking functionality to detect attention to banner notifications.
[0235] For example, a terminal device may enable eye-tracking functionality and, when it detects that there is a point of focus within the area where the banner notification is located, display the interface shown in Figure 5B (or Figure 6A).
[0236] S1016: The terminal device determines whether attention to the banner notification has reached a second duration.
[0237] If the second duration is 500 milliseconds, and the terminal device determines that attention to the banner notification has reached 500 milliseconds, the terminal device may execute the steps shown in S1019. Alternatively, if the terminal device determines that attention to the banner notification has not reached 500 milliseconds, the terminal device may execute the steps shown in S1017.
[0238] S1017: The terminal device determines whether the period for the banner notification to disappear has elapsed.
[0239] If the terminal device determines that the duration for which the banner notification is displayed has reached the duration for which the banner notification disappears, the terminal device may perform the steps shown in S1018. Alternatively, if the terminal device determines that the duration for which the banner notification is displayed has not reached the duration for which the banner notification disappears, the terminal device may perform the steps shown in S1015 to detect the status of the user paying attention to the banner notification.
[0240] S1018: The terminal device cancels the display of the banner notification.
[0241] S1019: The terminal device deploys a banner notification.
[0242] For example, when deploying a banner notification, the terminal device may display the interface shown in Figure 5C (or Figure 6B).
[0243] S1020: The terminal device determines whether the second switch is on.
[0244] When the terminal device determines that the second switch is on, the terminal device may perform the steps shown in S1024. Alternatively, when the terminal device determines that the second switch is not on, the terminal device may perform the steps shown in S1021.
[0245] When the terminal device determines that the second switch is not on, it will not open the application corresponding to the banner notification, regardless of how it views the banner notification. Therefore, the terminal device may perform the steps shown in S1021-S1023 to cancel the display of the banner notification.
[0246] S1021: The terminal device determines whether the duration of attention leaving the banner notification has reached the sixth duration.
[0247] If the sixth duration is 1 second and the terminal device determines that the duration for which attention leaves the banner notification has reached 1 second, the terminal device may perform the steps shown in S1022. Alternatively, if the terminal device determines that the duration for which attention leaves the banner notification has not reached 1 second, the terminal device may perform the steps shown in S1023.
[0248] S1022: When the time limit for the banner notification to disappear has been reached, the terminal device disables the eye-tracking function and cancels the display of the banner notification.
[0249] S1023: The terminal device cancels the display of the banner notification once the banner notification disappears.
[0250] S1024: The terminal device detects continuous attention to a banner notification.
[0251] S1025: The terminal device determines whether the continuous gaze time has reached the third duration.
[0252] If the third duration is 2 seconds and the terminal device determines that the continuous gaze time has reached 2 seconds, the terminal device may perform the steps shown in S1030. Alternatively, if the terminal device determines that the continuous gaze time has not reached 2 seconds, the terminal device may perform the steps shown in S1026.
[0253] S1026: The terminal device determines whether the duration of attention leaving the banner notification has reached the sixth duration.
[0254] If the sixth duration is 1 second and the terminal device determines that the duration for which attention leaves the banner notification has reached 1 second, the terminal device may perform the steps shown in S1027. Alternatively, if the terminal device determines that the duration for which attention leaves the banner notification has not reached 1 second, the terminal device may perform the steps shown in S1028.
[0255] S1027: When the duration for which the banner notification will disappear has been reached, the terminal device will disable the eye-tracking function and cancel the display of the banner notification.
[0256] S1028: The terminal device determines whether the duration for the banner notification to disappear has been reached.
[0257] If the terminal device determines that the duration for which the banner notification is displayed has reached the duration for which the banner notification disappears, the terminal device may perform the steps shown in S1029. Alternatively, if the terminal device determines that the duration for which the banner notification is displayed has not reached the duration for which the banner notification disappears, the terminal device may perform the steps shown in S1024 to detect the status of the user paying attention to the banner notification.
[0258] S1029: The terminal device cancels the display of the banner notification.
[0259] S1030: The terminal device begins advancing the gaze cursor.
[0260] For example, a terminal device may display the interface shown in Figure 5D during the process of initiating the gaze cursor progression.
[0261] S1031: The terminal device determines whether cursor progression is complete (fifth duration).
[0262] When the terminal device determines that cursor progression is complete, the terminal device may perform the steps shown in S1032. Alternatively, when the terminal device determines that cursor progression is not complete, the terminal device may perform the steps shown in S1026.
[0263] S1032: The terminal device opens the application that supports banner notifications.
[0264] For example, when a terminal device decides to open an application that responds to a banner notification, it may display the interface shown in Figure 5E.
[0265] In one possible implementation, if the terminal device detects in any of steps S1002 to S1032 that the user has triggered the terminal device by using a finger, mouse, etc., the terminal device may interrupt the process of opening the banner notification and proceed to execute at least one of steps S1002 to S1032 in the next time the banner notification was detected. It can be understood that in the process of executing the eye-tracking function, the priority of the user's trigger operation is higher than the execution priority of the eye-tracking function.
[0266] In one possible implementation, the terminal device does not detect the user's attention status if it detects that the user has turned off the first and second switches when the banner notification pops up (or during the process in which the banner notification pops up). Alternatively, the terminal device may detect the user's attention status if it detects that the user has turned on the first or second switch when the banner notification pops up (or during the process in which the banner notification pops up). It can be understood that during the process in which the banner notification appears, the terminal device may always detect the status of the first and second switches and decide whether to respond to the user's attention based on the status of the first and second switches.
[0267] In one possible implementation, a landscape-mode terminal device pops up a banner notification. When the terminal device switches from landscape mode to portrait mode, if the banner notification has not reached its duration until it disappears, the terminal device may proceed to detect the user's gaze status. It can be understood that the switch between landscape mode and portrait mode does not affect the default duration until the banner notification disappears.
[0268] Based on this, an embodiment of the present application provides a method for opening a banner notification, whereby the terminal device can flexibly expand the banner notification and / or open the application interface corresponding to the banner notification when it detects that the user's gaze position is within the area where the banner notification is located and the gaze duration meets specific conditions, thereby improving the user experience of using the eye-tracking function.
[0269] Regarding the description in the embodiments corresponding to FIGS. 3A to 10D, the method for opening a banner notification provided in this embodiment of the present application is not limited to opening the banner notifications of social applications and message applications, and can be further applied to opening the banner notifications of other types of applications such as news application banner notifications or short video application banner notifications. This is not particularly limited in this embodiment of the present application. In addition, the method for opening a banner notification provided in this embodiment of the present application can also be applied to expanding any notification from the notification bar and / or opening the application interface corresponding to any notification. This is not limited in this embodiment of the present application.
[0270] It can be understood that the method of opening the banner notification provided in this embodiment of the present application does not affect the current display logic of the banner notification on the terminal device. For example, when the terminal device detects a new banner notification during the process of opening an old banner notification (for example, performing any step shown in S901 - S932), the new banner notification is normally displayed, and the process of opening the old banner notification fails. In this case, the user can interact with the new banner notification through eye movement.
[0271] It should be noted that the user information (including but not limited to user device information, user personal information, etc.) and data (including but not limited to data used for analysis, stored data, displayed data, etc.) related to the present application are all information and data approved by the user or fully approved by each party. In addition, the collection, use, and processing of related data need to comply with relevant laws, regulations, and standards, and corresponding operation entries are provided for the user to select approval or rejection.
[0272] The method provided in the embodiment of the present application has been described above with reference to FIGS. 3A to 10D, and an apparatus for executing the method in the embodiment of the present application will be described below. As shown in FIG. 11, FIG. 11 is a schematic diagram of the structure of an apparatus for opening a banner notification according to an embodiment of the present application. The apparatus for opening a banner notification may be the terminal device in the embodiment of the present application, or may be a chip or a chip system within the terminal device.
[0273] As shown in Figure 11, the banner notification opening device 1100 may be used in a communication device, circuit, hardware component, or chip, and the banner notification opening device includes a display unit 1101 and a processing unit 1102. The display unit 1101 is configured to support the banner notification opening device 1100 in performing display steps. The processing unit 1102 is configured to support the banner notification opening device 1100 in performing information processing steps.
[0274] Specifically, this embodiment of the present application provides a device 1100 for opening banner notifications. The banner notification device 1100 includes a display unit 1101 and a processing unit 1102. The display unit 1101 is configured to display a first interface. The first interface includes a first banner notification. The first banner notification is located in a first area. The first banner notification is a banner notification initiated by a first application. When the processing unit 1102 detects that the point of attention is located in the first area, the display unit 1101 is further configured to display a second banner notification on the first interface. The second banner notification is an expanded version of the first banner notification. The message content of the second banner notification is greater than the message content of the first banner notification. Alternatively, when the processing unit 1102 detects that the point of attention is located in the first area, the display unit 1101 is further configured to display a second interface. The second interface is a displayed interface of a first application. The second interface includes the message content within the second banner notification.
[0275] In one possible implementation, the device 1100 that opens the banner notification may also include a communication unit 1103. Specifically, the communication unit is configured to support the device 1100 that opens the banner notification in performing data transmission and data reception steps. For example, the communication unit 1103 may be an input or output interface, a pin, or a circuit.
[0276] In one possible embodiment, the device for opening banner notifications may further include a storage unit 1104. A processing unit 1102 is connected to the storage unit 1104 via a line. The storage unit 1104 may include one or more memories. A memory may be one or more components configured to store a program or data in a device or circuit. The storage unit 1104 may exist independently and be connected to the processing unit 1102 included in the device for opening banner notifications via a communication line. Alternatively, the storage unit 1104 may be integrated with the processing unit 1102.
[0277] The storage unit 1104 may store computer-executable instructions for a method in a terminal device, thereby enabling the processing unit 1102 to execute the method in the above-described embodiment. The storage unit 1104 may be a register, cache, RAM, etc., and may be integrated with the processing unit 1102. The storage unit 1104 may be a read-only memory (ROM) or another type of static storage device capable of storing static information and instructions. The storage unit 1104 may be independent of the processing unit 1102.
[0278] Figure 12 is a schematic diagram of the hardware structure of another terminal device according to one embodiment of the present invention. As shown in Figure 12, the terminal device includes a processor 1201, a communication line 1204, and at least one communication interface (communication interface 1203 is used as an example for illustrative purposes in Figure 12).
[0279] The processor 1201 may be a general-purpose central processing unit (CPU), a microprocessor, an application-specific integrated circuit (ASIC), or one or more integrated circuits configured to control the program execution of the solution of the present invention.
[0280] The communication line 1204 may include a circuit for transferring information between the above-mentioned components.
[0281] The communication interface 1203 is any device, such as a transceiver, and is configured to communicate with another device or communication network, such as Ethernet® or a wireless local area network (WLAN).
[0282] Possible candidates include additional memory 1202.
[0283] Memory 1202 may be a read-only memory (ROM) or another type of static storage device capable of storing static information and instructions, or a random access memory (RAM) or another type of dynamic storage device capable of storing information and instructions, or it may be an electrically erasable programmable read-only memory (EEPROM), a compact disc read-only memory (CD-ROM) or another compact disc storage, an optical disc storage (including compact discs, laser discs, optical discs, digital multipurpose discs, Blu-ray® optical discs, etc.), a magnetic disk storage medium or another magnetic storage device, or any other medium that can be used to carry or store expected program code in the form of instructions or data structures and can be accessed by a computer. Memory may exist independently and be connected to the processor via a communication line 1204. Alternatively, memory may be integrated with the processor.
[0284] Memory 1202 is configured to store computer-executable instructions for performing the solution of the present invention, and processor 1201 controls the execution. Processor 1201 is configured to execute the computer-executable instructions stored in memory 1202 to perform the method provided in the embodiments of the present invention.
[0285] Possibly, the computer executable instructions in this embodiment of the present application may also be called application code. This is not particularly limited to this embodiment of the present application.
[0286] In a specific implementation, in one embodiment, the processor 1201 may include one or more CPUs, for example, CPU0 and CPU1 in Figure 12.
[0287] In specific implementations, in some embodiments, the terminal device may include one or more processors, for example, processors 1201 and 1205 in Figure 12. Each of these processors may be a single-core (single-CPU) processor or a multi-core (multi-CPU) processor. A processor as used herein may be one or more devices, circuits, and / or processing cores configured to process data (e.g., computer program instructions).
[0288] A computer program product includes one or more computer instructions. When a computer program instruction is loaded into a computer and executed, it generates all or part of a procedure or function according to an embodiment of the present application. The computer may be a general-purpose computer, a dedicated computer, a computer network, or another programmable device. The computer instructions may be stored in a computer-readable storage medium or transmitted from one computer-readable storage medium to another. For example, the computer instructions may be transmitted by wired means (e.g., coaxial cable, fiber optic cable, or digital subscriber line (DSL)) or wireless means (e.g., infrared, radio waves, or microwaves) from one website, computer, server, or data center to another. The computer-readable storage medium may be any available medium that can be stored in a computer, or a data storage device such as a server or data center that integrates one or more available media. For example, usable media may include magnetic media (e.g., floppy disks, hard disks, or magnetic tapes), optical media (e.g., digital versatile discs (DVDs)), or semiconductor media (e.g., solid state disks (SSDs)).
[0289] One embodiment of the present application further provides a computer-readable storage medium. All or some of the methods described in the above embodiments may be implemented by software, hardware, firmware, or any combination thereof. The computer-readable medium may include a computer storage medium and a communication medium, and may further include any medium on which a computer program can be transferred from one place to another. The storage medium may be any target medium accessible to a computer.
[0290] In a possible design, the computer-readable medium may include compact disc read-only memory (CD-ROM), RAM, ROM, EEPROM, or other optical disc memory. The computer-readable medium may also include magnetic disk memory or other magnetic disk storage devices. Any connecting line may also be referred to as the computer-readable medium, as appropriate. For example, if software is transmitted from a website, server, or another remote source using coaxial cable, fiber optic cable, twisted pair, DSL, or wireless technology (such as infrared, radio waves, or microwaves), then that coaxial cable, fiber optic cable, twisted pair, DSL, or wireless technology such as infrared, radio waves, or microwaves is included in the definition of the medium. As used herein, magnetic disks and optical disks include compact discs (CDs), laserdiscs, optical disks, digital versatile discs (DVDs), floppy disks, and Blu-ray discs. Magnetic disks typically reproduce data magnetically, while optical disks reproduce data optically using lasers.
[0291] The aforementioned combinations should also be included within the scope of computer-readable media. The above description is merely an example of an individual implementation of the present invention, and the scope of protection of the present invention is not limited to these. Any modifications or substitutions readily conceivable by those skilled in the art within the technical scope disclosed herein shall fall within the scope of protection of the present invention. Accordingly, the scope of protection of the present invention shall be subject to the scope of protection of the claims.
Claims
1. A method for opening a banner notification, and this method is: A step in which a terminal device displays a first interface, the first interface includes a first banner notification, the first banner notification is in a first area, and the first banner notification is a banner notification initiated by a first application; A step in which, when the terminal device detects that the point of focus is in the first area, the terminal device displays a second banner notification on the first interface, and after displaying the second banner notification on the first interface, displays the second interface, wherein the second banner notification is an expanded first banner notification, the message content in the second banner notification is greater than the message content in the first banner notification, and the second interface is a displayed interface of the first application, and the second interface includes the message content in the second banner notification; or The process includes the step of the terminal device displaying a second interface when it detects that the point of focus is in the first region, The first interface further includes a gaze cursor, which is used to indicate the position of a point of gaze on the display, and a progress bar is provided on the outer edge of the gaze cursor, and the method further includes: The steps include: when the terminal device detects that the gaze point is in a pre-set area, the terminal device displays the gaze cursor, rotates the progress bar clockwise, and then displays the second interface when the progress bar is at the end position; When the terminal device detects that the gaze point is not within the pre-set area, the terminal device does not display the gaze cursor. Further including, method.
2. When the terminal device detects that the point of focus is in the first region, the step of displaying the second interface after displaying the second banner notification on the first interface is: The first banner notification is permitted to be deployed, and when the terminal device detects that the point of attention is in the first area, the terminal device displays the second banner notification on the first interface and then displays the second interface, The method according to claim 1.
3. A first switch and a second switch are located on the terminal device, the first switch is configured to deploy the first banner notification when it is detected that the point of attention is in the first region, and the second switch is configured to open the first application when it is detected that the point of attention is in the first or second region, the second region being the region where the second banner notification is located; The first banner notification is permitted to be deployed, and when the terminal device detects that the point of attention is in the first area, the terminal device displays the second banner notification on the first interface and then displays the second interface, which includes the first switch being on, the second switch being on, the first banner notification being permitted to be deployed, and when the terminal device detects that the point of attention is in the first area, the terminal device displays the second banner notification on the first interface and then displays the second interface, The method according to claim 2.
4. The method further: The terminal device cancels the display of the first banner notification when the duration for which the first banner notification is displayed is equal to or greater than the first duration, or the terminal device cancels the display of the second banner notification when the total duration for which the first and second banner notifications are displayed is equal to or greater than the first duration. The method according to any one of claims 1 to 3.
5. When the terminal device detects that the point of focus is in the first region, the step of displaying the second interface after displaying the second banner notification on the first interface is: When the terminal device detects that the duration for which the point of focus is in the first region is equal to or greater than the second duration, the terminal device displays the second banner notification on the first interface; The terminal device displays the second interface when, after displaying the second banner notification, the terminal device detects that the duration for which the point of attention is in the second area is equal to or greater than the seventh duration, the terminal device displays the second interface. The method according to claim 3.
6. The seventh duration includes the third duration and the fifth duration; When the terminal device detects that the duration for which the point of focus is in the second region is equal to or greater than the seventh duration, the terminal device may display the second interface: When the terminal device detects that the duration for which the gaze point is in the second region is equal to or greater than the third duration, the terminal device displays a first progress bar at the starting position on the outer edge of the gaze cursor; The terminal device, after displaying the first progress bar at the starting position, detects that the duration for which the point of focus is in the second region is equal to or greater than the fifth duration, and then displays the first progress bar at the end position on the outer edge of the point of focus, and further displays the second interface. The method according to claim 5.
7. The step of the terminal device displaying a second banner notification on the first interface when the terminal device detects that the point of focus is in the first region is: The first switch is ON, the second switch is OFF, and the first banner notification is permitted to be deployed, and the terminal device detects that the point of attention is in the first area, and the terminal device displays the second banner notification on the first interface, The method according to claim 5 or 6.
8. The step of the terminal device displaying a second banner notification on the first interface when the terminal device detects that the point of focus is in the first region is: The terminal device includes, when it detects that the duration for which the point of focus is in the first area is equal to or greater than the second duration, displaying the second banner notification on the first interface. The method according to claim 7.
9. When the terminal device detects that the point of focus is in the first region, the terminal device performs the step of displaying the second interface: The terminal device determines that a pre-configured condition is met, and when the terminal device detects that the point of focus is in the first area, the terminal device displays the second interface, wherein the pre-configured condition includes: the first switch being off, the second switch being on, and the first banner notification being allowed to be deployed; or the first switch being on, the second switch being on, and the first banner notification not being allowed to be deployed; or the first switch being off, the second switch being on, and the first banner notification not being allowed to be deployed. The method according to claim 5.
10. When the terminal device detects that the point of focus is in the first region, the terminal device performs the step of displaying the second interface: The method according to claim 9, wherein the terminal device displays the second interface when it detects that the duration for which the point of focus is in the first region is equal to or greater than an eighth duration.
11. The eighth duration mentioned above includes the fourth duration and the fifth duration, When the terminal device detects that the duration for which the point of focus is in the first region is equal to or greater than the eighth duration, the terminal device displays the second interface: When the terminal device detects that the duration for which the gaze point is in the first region is equal to or greater than the fourth duration, the terminal device displays a second progress bar at the starting position on the outer edge of the gaze cursor; The terminal device, after displaying the second progress bar at the starting position, detects that the duration for which the point of focus has been in the first region is equal to or greater than the fifth duration, and the terminal device then displays the second progress bar at the end position on the outer edge of the point of focus, and further displays the second interface. The method according to claim 10.
12. The pre-set region includes the first region, and the pre-set region is 1 / 3 of the display. The method according to claim 1.
13. A third switch is located on the terminal device, and the third switch is configured to enable or disable the display of the gaze cursor, and when the terminal device detects that the gaze point is in a pre-defined area, the terminal device displays the gaze cursor on the first interface: The terminal device detects that the gaze point is in the pre-configured area, and when the third switch is on, the terminal device displays the gaze cursor on the first interface, The method according to claim 12.
14. The method further: The terminal device includes canceling the display of the gaze cursor when it detects that the gaze point is not in the pre-set area, or when the duration for which the gaze point is outside the first or second area is equal to or greater than the sixth duration. The method according to claim 12.
15. The method further: Steps include: when the terminal device determines that a pre-configured function is not enabled and receives a third banner notification for the first time, the terminal device displays a third interface, the third interface including the third banner notification and a first control used to enable the pre-configured function; The terminal device includes a step of displaying a fourth interface in response to an operation on the first control, wherein the fourth interface includes an identifier used to indicate that the pre-configured function is not enabled. The method according to claim 14.
16. After the terminal device displays the third interface, the method further: The process includes a step in which the terminal device displays a fifth interface when it receives a first operation on the third interface, the fifth interface being an interface corresponding to the terminal device's notification center, and the fifth interface including the first control and information used to indicate recommendations for enabling the pre-configured function. The method according to claim 15.
17. One or more processors; One or more memory units; Modules with multiple applications installed and An electronic device having, The memory stores one or more programs, and when the one or more programs are executed by the processor, the electronic device proceeds through the following steps: A step of displaying a first interface, wherein the first interface includes a first banner notification, the first banner notification is in a first area, and the first banner notification is a banner notification initiated by a first application; A step in which, upon detecting that the point of focus is in the first region, a second banner notification is displayed on the first interface, and after displaying the second banner notification on the first interface, the second interface is displayed, wherein the second banner notification is an expanded first banner notification, the message content in the second banner notification is greater than the message content in the first banner notification, and the second interface is a displayed interface of the first application, and the second interface includes the message content in the second banner notification; or When it is detected that the point of focus is in the first region, the system is configured to perform the step of displaying a second interface. The first interface further includes a gaze cursor, which is used to indicate the position of a point of gaze on the display, and a progress bar is provided on the outer edge of the gaze cursor, and the electronic device further includes: The steps include: displaying the gaze cursor when it is detected that the gaze point is in a pre-set area, rotating the progress bar clockwise, and displaying the second interface when the progress bar is at the end position; When it is detected that the gaze point is not within the pre-set area, the gaze cursor is not displayed. It is made possible to execute Electronic devices.
18. A computer storage medium having a computer program that, when executed by a processor, causes the processor to perform an operation, wherein the operation is: A step in which a terminal device displays a first interface, the first interface includes a first banner notification, the first banner notification is in a first area, and the first banner notification is a banner notification initiated by a first application; A step in which, when the terminal device detects that the point of focus is in the first area, the terminal device displays a second banner notification on the first interface, and after displaying the second banner notification on the first interface, displays the second interface, wherein the second banner notification is an expanded first banner notification, the message content in the second banner notification is greater than the message content in the first banner notification, and the second interface is a displayed interface of the first application, and the second interface includes the message content in the second banner notification; or The process includes the step of the terminal device displaying a second interface when it detects that the point of focus is in the first region, The first interface further includes a gaze cursor, which is used to indicate the position of a point of focus on the display, and a progress bar is provided on the outer edge of the gaze cursor, and the computer program further provides the processor with: The steps include: when the terminal device detects that the gaze point is in a pre-set area, the terminal device displays the gaze cursor, rotates the progress bar clockwise, and then displays the second interface when the progress bar is at the end position; When the terminal device detects that the gaze point is not within the pre-set area, the terminal device does not display the gaze cursor. Perform an action that includes Computer storage medium.
Citation Information
Patent Citations
Eye tracking user interface
JP2014132459A
Terminal device and program
JP2018010702A
Electronic device and its control method
JP2021174295A
Information processing device, information processing method, and program
WO2015064165A1