Display method and device

Abstract

The invention discloses a display method and device, relates to the technical field of communication, and is used for improving user operation convenience. The method comprises the steps that an electronic device displays a banner notification window and an interaction panel corresponding to the banner notification window, and the interaction panel is used for achieving all or part of functions of the banner notification window; wherein if the electronic equipment is in a left hand operation state, the interaction panel is displayed on the left side of the display screen; if the electronic equipment is in the right hand operation state, the interaction panel is displayed on the right side of the display screen. Therefore, the problem that banner notification operation is inconvenient can be solved.

Description

Technical Field

[0001] This application relates to the field of communication technology, and in particular to a display method and apparatus. Background Technology

[0002] Currently, electronic devices can support multitasking. In some display solutions, after receiving a notification message, the electronic device displays a banner notification window, through which the user can open the corresponding application interface to proceed to the next step. However, this display method can be inconvenient for users in certain scenarios. For example, when a user holds the electronic device with their right hand, they cannot conveniently operate the banner notification window with their right hand. Summary of the Invention

[0003] This application provides a display method and apparatus to improve the convenience of window operation, thereby enhancing the user experience.

[0004] The embodiments of this application can be applied to electronic devices, or components such as modules or chips within electronic devices. The electronic device has a display screen that can display a user interface (UI). The electronic device can be referred to as user equipment (UE), terminal, etc. For example, the electronic device can be a mobile phone (e.g., a non-foldable screen phone, or a foldable screen phone), a tablet, a personal computer (PC), an ultra-mobile personal computer (UMPC), a netbook, a personal digital assistant (PDA), a handheld device with wireless communication capabilities, a computing device, an in-vehicle device, or a wearable device; a virtual reality (VR) terminal device; an augmented reality (AR) terminal device; a wireless terminal in industrial control; a wireless terminal in a smart home, etc.

[0005] In a first aspect, a display method is provided, which is applied to an electronic device having a display screen. The method includes: displaying a banner notification window and an interactive panel corresponding to the banner notification window, wherein the interactive panel is used to implement some or all of the functions of the banner notification window; wherein, if the electronic device is in a left-hand operation state, the interactive panel is displayed on the left side of the display screen; if the electronic device is in a right-hand operation state, the interactive panel is displayed on the right side of the display screen.

[0006] In the above implementation, since the interactive panel can realize all or part of the functions of the banner notification window, and the position of the interactive panel is related to the usage status of the electronic device, that is, the interactive panel is located on the side that is convenient for the user to operate, the convenience of user operation can be improved. In other words, the user can replace the operation of the banner notification window by operating the interactive panel.

[0007] Optionally, the banner notification window may be displayed at the top of the display screen, or in other locations that are not easily accessible to the user's fingers.

[0008] In one possible implementation, the display of the banner notification window and the corresponding interactive panel includes: receiving a notification from a first application and displaying the banner notification window corresponding to the first application and the interactive panel. Specifically, when a notification from the first application is received, if the electronic device is in a holding state, then the banner notification window corresponding to the first application and the interactive panel are displayed.

[0009] In one possible implementation, when a notification from the first application is received, if the electronic device is in a non-held state, a banner notification window corresponding to the first application is displayed instead of the interaction panel; when the electronic device switches from a non-held state to a held state, the interaction panel is displayed.

[0010] In one possible implementation, when the electronic device switches from a non-held state to a right-handed operation state, the interaction panel is displayed on the right side of the display screen; and / or, when the electronic device switches from a non-held state to a left-handed operation state, the interaction panel is displayed on the left side of the display screen.

[0011] The above implementation methods can coexist or one method can be selected. In one possible implementation, detecting or determining whether the electronic device is in a held state can be achieved using sensors on the electronic device. Distinguishing between held and non-held states is to account for situations where the user can directly click the banner notification in a non-held state, or where the interaction panel cannot provide effective operational support even if the user cannot click the banner notification, thus the interaction panel is not displayed. In one scenario, for example, when the user picks up the phone, the electronic device detects that it has switched to a held state, and then the interaction panel can be displayed, specifically on which side it is displayed based on the user's grip. Furthermore, displaying the interaction panel can also be subject to preconditions, such as displaying the interaction panel only after a certain period of time following the receipt or display of the banner notification, or displaying the interaction panel only while the banner notification is still displayed.

[0012] In one possible implementation, the interactive panel displays an instant message from a first user, and the method further includes: in response to a user operation on the interactive panel, obtaining reply information input by the user; and sending the reply information to the first user.

[0013] In one possible implementation, acquiring user-inputted response information in response to a user operation on the interaction panel includes: acquiring the user's voice in response to a user operation on the interaction panel that triggers a voice response; sending the response information to the first user includes: ending voice acquisition in response to a user operation that ends the voice response, and sending the acquired voice to the first user; or, ending voice acquisition in response to a user operation that ends the voice response, displaying the text corresponding to the voice, and sending the voice and / or text to the first user in response to a user operation that confirms sending.

[0014] In one possible implementation, the banner notification window is used to display notification information of the first application; the method further includes: receiving a first user operation applied to the interactive panel, the first user operation being used to expand the interactive panel into a window of the first application; in response to the first user operation, collapsing the banner notification window and displaying a first window, the first window being a window of the first application.

[0015] Optionally, the first user operation is to slide the interactive panel, with the sliding direction pointing in the opposite direction to the side where the interactive panel is located (or pointing in the center of the display screen); or, the first user operation is to click the interactive panel.

[0016] In one possible implementation, the first user operation is a sliding operation of the interactive panel; the method further includes: when the sliding distance reaches a first threshold, playing a vibration to prompt that if the sliding ends, the interactive panel will not be expanded into a window of the first application.

[0017] In one possible implementation, the method further includes: receiving a second user operation applied to the first window, the second user operation being used to collapse the first window; in response to the second user operation, collapsing the first window and displaying the interaction panel; wherein, if the electronic device is in a left-handed operation state, the interaction panel is displayed on the left side of the display screen; if the electronic device is in a right-handed operation state, the interaction panel is displayed on the right side of the display screen.

[0018] In one possible implementation, the second user operation is sliding the first window; the method further includes: when the sliding distance reaches a third threshold, playing a vibration to prompt that if the sliding ends, the first window will not be collapsed.

[0019] One possible implementation further includes: receiving a third user operation applied to the interactive panel, the third user operation being used to collapse the interactive panel; responding to the third user operation, collapsing the interactive panel, and displaying a first control corresponding to the interactive panel, the first control being used to display the interactive panel; wherein, if the interactive panel is displayed on the left side of the display screen, the first control is displayed on the left side of the display screen; if the interactive panel is displayed on the right side of the display screen, the first control is displayed on the right side of the display screen.

[0020] In the above implementation, the interactive panel can be collapsed into the first control. Since the size of the first control is small, the occlusion of the interactive panel on the interface can be reduced, making it easier for users to operate or view the interface.

[0021] One possible implementation further includes: in response to the third user's action, the banner notification window is minimized or collapsed.

[0022] One possible implementation further includes: when the electronic device switches from a left-hand operation state to a right-hand operation state, the first control switches from the left side of the display screen to the right side of the display screen; or, when the electronic device switches from a right-hand operation state to a left-hand operation state, the first control switches from the right side of the display screen to the left side of the display screen.

[0023] One possible implementation further includes: receiving a fourth user operation applied to the first control, the fourth user operation being used to expand the interactive panel; and displaying the interactive panel in response to the fourth user operation; wherein, if the first control is displayed on the left side of the display screen, the interactive panel is displayed on the left side of the display screen; and if the first control is displayed on the right side of the display screen, the interactive panel is displayed on the right side of the display screen.

[0024] One possible implementation further includes: in response to the fourth user action, displaying the collapsed banner notification window, or expanding the shrunk banner notification window.

[0025] Optionally, the fourth user operation is to slide the floating bar, and the direction of the slide is opposite to the side of the floating bar on the display screen.

[0026] In one possible implementation, the banner notification window is used to display notification information of the first application; the method further includes: receiving a fifth user operation applied to the floating bar, the fifth user operation being used to expand the floating bar into a first window; in response to the fifth user operation, collapsing the banner notification window and displaying the first window, the first window being a full-screen window of the first application.

[0027] Optionally, the fifth user operation is to slide the floating bar, and the direction of the slide is opposite to the side of the floating bar on the display screen.

[0028] One possible implementation further includes: receiving a sixth user operation applied to the first window, the sixth user operation being used to collapse the first window; responding to the sixth user operation, collapsing the first window, and displaying a floating bar corresponding to the interactive panel; wherein, if the electronic device is in a left-handed operation state, the floating bar is displayed on the left side of the display screen; if the electronic device is in a right-handed operation state, the floating bar is displayed on the right side of the display screen.

[0029] One possible implementation further includes: when the electronic device switches from a left-hand operation mode to a right-hand operation mode, the interaction panel switches from the left side of the display screen to the right side of the display screen; or, when the electronic device switches from a right-hand operation mode to a left-hand operation mode, the interaction panel switches from the right side of the display screen to the left side of the display screen.

[0030] In the above implementation, when the usage status of the electronic device changes, the interactive panel can switch to the side that is easier for the user to operate, thereby improving the convenience of user operation.

[0031] One possible implementation also includes: retracting the interaction panel when the electronic device switches from a left-hand operation state or a right-hand operation state to a non-holding state.

[0032] In one possible implementation, after displaying the interactive panel, the method further includes: displaying a second window; if the second window and the display panel are located on the left side of the display screen, then moving the display panel below or to the right side of the second window; if the second window and the display panel are located on the right side of the display screen, then moving the display panel below or to the left side of the second window.

[0033] With the above implementation, when the interactive panel conflicts with the position of other windows, the interactive panel can avoid the conflict by avoiding other windows.

[0034] In one possible implementation, a second window is displayed on the screen before the interactive panel is displayed; before displaying the interactive panel, the method further includes: if the second window is displayed on the left side of the display and the electronic device is in a left-hand operation state, then the second window is closed; if the second window is displayed on the right side of the display and the electronic device is in a right-hand operation state, then the second window is closed.

[0035] With the above implementation, when the interactive panel conflicts with the position of other windows already existing on the screen, the other windows can be closed to display the interactive panel, thereby avoiding conflicts between the interactive panel and the other windows.

[0036] In one possible implementation, the banner notification window is dimmed.

[0037] In one possible implementation, the banner notification window and the interactive panel each include a first control, which is used to perform a first processing operation in response to a user operation.

[0038] In one possible implementation, the banner notification window is a telephone call notification window, and the first control includes an answer button and / or a hang-up button.

[0039] One possible implementation further includes: detecting the holding hand and the interaction hand; and determining the usage state of the electronic device based on the detected holding hand and interaction hand.

[0040] Optionally, the left-hand operation state includes: left-hand grip and left-hand interaction (i.e., both the gripping hand and the interaction hand are left hands), right-hand grip and left-hand interaction (i.e., the gripping hand is the right hand and the interaction hand is the left hand), two-hand grip and left-hand interaction (i.e., both gripping hands are the same and the interaction hand is the left hand), left-hand interaction (i.e., the interaction hand is the left hand and the electronic device is not gripped), or left-hand grip (i.e., the gripping hand is the left hand and there is no interaction hand).

[0041] Optionally, the right-hand operation state includes: right-hand grip and right-hand interaction (i.e., both the gripping hand and the interaction hand are right-hand), left-hand grip and right-hand interaction (i.e., the gripping hand is left-hand and the interaction hand is right-hand), two-hand grip and right-hand interaction (i.e., both gripping hands are right-hand and the interaction hand is right-hand), right-hand interaction (i.e., the interaction hand is right-hand and the electronic device is not gripped), or right-hand grip (i.e., the gripping hand is right-hand and there is no interaction hand).

[0042] In one possible implementation, detecting the gripping hand includes determining the gripping hand based on detection data from an inertial measurement unit in the electronic device.

[0043] In a second aspect, an electronic device is provided. It includes a unit or module for performing the method described in any one of the first aspects. Specifically, the electronic device may include a processing unit and a display unit. Under the control of the processing unit, the display unit displays a banner notification window and a corresponding interactive panel. The interactive panel is used to implement some or all of the functions of the banner notification window; wherein, if the electronic device is in a left-handed operation state, the interactive panel is displayed on the left side of the display screen; if the electronic device is in a right-handed operation state, the interactive panel is displayed on the right side of the display screen.

[0044] In one possible implementation, the processing unit is specifically configured to: receive a notification from a first application; if the electronic device is in a left-hand operation state, control the display unit to display a banner notification window corresponding to the first application and display the interactive panel on the left side of the display screen; if the electronic device is in a right-hand operation state, control the display unit to display a banner notification window corresponding to the first application and display the interactive panel on the right side of the display screen.

[0045] In one possible implementation, the processing unit is specifically configured to: receive a notification from a first application; if the electronic device is in a non-held state, control the display unit to display a banner notification window corresponding to the first application; when the electronic device switches from a non-held state to a right-hand operation state, control the display unit to display the interaction panel on the right side of the display screen; or, when the electronic device switches from a non-held state to a left-hand operation state, control the display unit to display the interaction panel on the left side of the display screen.

[0046] In one possible implementation, the banner notification window is used to display notification information of the first application; the processing unit is further configured to: receive a first user operation applied to the interactive panel, the first user operation being used to expand the interactive panel into a window of the first application; in response to the first user operation, control the display unit to collapse the banner notification window and display a first window, the first window being a window of the first application.

[0047] In one possible implementation, the first user operation is a sliding operation of the interactive panel; the processing unit is further configured to: when the sliding distance reaches a first threshold, play vibration to prompt that if the sliding ends, the interactive panel will not be expanded into a window of the first application.

[0048] In one possible implementation, the processing unit is further configured to: receive a second user operation applied to the first window, the second user operation being used to close the first window; and in response to the second user operation, control the display unit to close the first window and display the interactive panel; wherein, if the electronic device is in a left-handed operation state, the interactive panel is displayed on the left side of the display screen; and if the electronic device is in a right-handed operation state, the interactive panel is displayed on the right side of the display screen.

[0049] In one possible implementation, the second user operation is sliding the first window; the processing unit is further configured to: when the sliding distance reaches a third threshold, play vibration to prompt that if the sliding ends, the first window will not be collapsed.

[0050] In one possible implementation, the processing unit is further configured to: receive a third user operation applied to the interactive panel, the third user operation being used to collapse the interactive panel; in response to the third user operation, control the display unit to collapse the interactive panel and display a first control corresponding to the interactive panel, the first control being used to display the interactive panel; wherein, if the interactive panel is displayed on the left side of the display screen, the first control is displayed on the left side of the display screen; if the interactive panel is displayed on the right side of the display screen, the first control is displayed on the right side of the display screen.

[0051] In one possible implementation, the processing unit is further configured to: in response to the third user's operation, control the display unit to shrink or collapse the banner notification window.

[0052] In one possible implementation, the processing unit is further configured to: control the display unit to switch the first control from the left side of the display screen to the right side of the display screen when the electronic device switches from a left-hand operation state to a right-hand operation state; or, control the display unit to switch the first control from the right side of the display screen to the left side of the display screen when the electronic device switches from a right-hand operation state to a left-hand operation state.

[0053] In one possible implementation, the processing unit is further configured to: receive a fourth user operation applied to the first control, the fourth user operation being used to expand the interactive panel; and, in response to the fourth user operation, control the display unit to display the interactive panel; wherein, if the first control is displayed on the left side of the display screen, the interactive panel is displayed on the left side of the display screen; and if the first control is displayed on the right side of the display screen, the interactive panel is displayed on the right side of the display screen.

[0054] In one possible implementation, the processing unit is further configured to: in response to the fourth user operation, control the display unit to display the collapsed banner notification window, or expand the shrunk banner notification window.

[0055] In one possible implementation, the banner notification window is used to display notification information of the first application; the processing unit is further configured to: receive a fifth user operation acting on the floating bar, the fifth user operation being used to expand the floating bar into a first window; in response to the fifth user operation, control the display unit to collapse the banner notification window and display the first window, the first window being a full-screen window of the first application.

[0056] In one possible implementation, the processing unit is further configured to: receive a sixth user operation applied to the first window, the sixth user operation being used to collapse the first window; in response to the sixth user operation, control the display unit to collapse the first window and display a floating bar corresponding to the interactive panel; wherein, if the electronic device is in a left-hand operation state, the floating bar is displayed on the left side of the display screen; if the electronic device is in a right-hand operation state, the floating bar is displayed on the right side of the display screen.

[0057] In one possible implementation, the processing unit is further configured to: control the display unit to switch the interactive panel from the left side of the display screen to the right side of the display screen when the electronic device switches from a left-hand operation state to a right-hand operation state; or, control the display unit to switch the interactive panel from the right side of the display screen to the left side of the display screen when the electronic device switches from a right-hand operation state to a left-hand operation state.

[0058] In one possible implementation, the processing unit is further configured to: control the display unit to retract the interactive panel when the electronic device switches from a left-hand operation state or a right-hand operation state to a non-holding state.

[0059] In one possible implementation, after displaying the interactive panel, the processing unit is further configured to: control the display unit to display a second window; if the second window and the display panel are located on the left side of the display screen, then move the display panel below the second window or to the right side of the second window; if the second window and the display panel are located on the right side of the display screen, then move the display panel below the second window or to the left side of the second window.

[0060] In one possible implementation, a second window is displayed on the screen before the interactive panel is displayed; the processing unit is further configured to: close the second window if the second window is displayed on the left side of the display and the electronic device is in a left-hand operation state before the interactive panel is displayed; close the second window if the second window is displayed on the right side of the display and the electronic device is in a right-hand operation state.

[0061] In one possible implementation, the banner notification window is dimmed.

[0062] In one possible implementation, the banner notification window and the interactive panel each include a first control, which is used to perform a first processing operation in response to a user operation.

[0063] In one possible implementation, the banner notification window is a telephone call notification window, and the first control includes an answer button and / or a hang-up button.

[0064] In one possible implementation, the processing unit is further configured to: detect the holding hand and the interaction hand; and determine the usage state of the electronic device based on the detected holding hand and interaction hand.

[0065] In one possible implementation, the processing unit is specifically used to: determine the holding hand based on the detection data from the inertial measurement unit in the electronic device.

[0066] Thirdly, an electronic device is provided, comprising: one or more processors configured to perform the method as described in any one of the first aspects above.

[0067] Fourthly, embodiments of this application provide a chip for reading a computer program stored in a memory and executing the method provided in the first aspect above. Optionally, the chip may include a processor coupled to the memory for reading the computer program stored in the memory and implementing the method provided in the above embodiments. Optionally, the chip may further include components such as a memory, a communication interface, and a power supply module. The memory is used to store the computer program, the communication interface is used to receive and send data, and the power supply module is used to supply power to the processor.

[0068] Fifthly, embodiments of this application also provide a chip system including a processor for supporting a computer device in implementing the methods provided in any of the above aspects. In one possible design, the chip system further includes a memory for storing programs and data necessary for the computer device. The chip system may be composed of chips or may include chips and other discrete devices.

[0069] In a sixth aspect, embodiments of this application provide a readable storage medium storing a program or instructions that, when executed on an electronic device, cause the electronic device to perform the method as described in any one of the first aspects above.

[0070] In a seventh aspect, a program product is provided, the program product comprising a program; when the program is run on a computer, the computer performs the method as described in any one of the first aspects above. Attached Figure Description

[0071] Figure 1 This is a schematic diagram of a banner notification window corresponding to a call application in an embodiment of this application;

[0072] Figure 2 This is a schematic diagram of a banner notification window corresponding to a recorder application in an embodiment of this application;

[0073] Figure 3 This is a schematic diagram of a banner notification window corresponding to a short message application in an embodiment of this application;

[0074] Figure 4 This is a schematic diagram of a banner notification window corresponding to a social application in an embodiment of this application;

[0075] Figure 5 This is a schematic diagram of the hardware structure of the electronic device in the embodiments of this application;

[0076] Figure 6 This is a schematic diagram illustrating the states of some users using electronic devices in the embodiments of this application;

[0077] Figure 7 This is a schematic diagram of the touch points, coordinate system, and capacitance values ​​during user interaction with an electronic device, as described in an embodiment of this application.

[0078] Figure 8 A schematic diagram of a settings page for a convenient interactive function for banner notifications provided in an embodiment of this application;

[0079] Figure 9 A schematic flowchart illustrating a display method provided in an embodiment of this application;

[0080] Figure 10 A schematic diagram illustrating the implementation process of the display method in the software system architecture in this application embodiment;

[0081] Figure 11 This is a schematic diagram of an interactive panel corresponding to the banner notification window displayed on the side of the screen by an electronic device when an incoming call is received, based on the usage status.

[0082] Figure 12 This is a schematic diagram illustrating how to open and close a call application window based on interactive operations with an interactive panel, as described in this application embodiment.

[0083] Figure 13 This is a schematic diagram illustrating how the interactive panel is collapsed into a floating bar and how the floating bar is expanded into an interactive panel in an embodiment of this application.

[0084] Figure 14 This is a schematic diagram illustrating how the floating bar is expanded into the interface of a calling application and how the window of the calling application is collapsed into the floating bar in this embodiment of the application.

[0085] Figure 15 This is a schematic diagram illustrating how the interactive panel avoids the second window in an embodiment of this application;

[0086] Figure 16 This is a schematic diagram illustrating the closing of the second window when the interactive panel conflicts with the second window in an embodiment of this application;

[0087] Figure 17 This is a schematic diagram illustrating how a banner notification window is switched to a vertical notification window and displayed on the side in an embodiment of this application.

[0088] Figure 18 This is a schematic diagram illustrating the processing method for multiple banner notification windows in an embodiment of this application;

[0089] Figure 19 This is a schematic diagram showing the display of the notification window in landscape mode under single-handed and two-handed holding states in an embodiment of this application.

[0090] Figure 20 This is a schematic diagram illustrating the switching to the notification center interface in an embodiment of this application;

[0091] Figure 21 This is a schematic diagram illustrating voice response via an interactive panel in an embodiment of this application;

[0092] Figure 22 This is a schematic diagram of the structure of an electronic device provided in an embodiment of this application;

[0093] Figure 23 This is a schematic diagram of the structure of another electronic device provided in an embodiment of this application. Detailed Implementation

[0094] To make the objectives, technical solutions, and advantages of the embodiments of this application clearer, the embodiments of this application will be further described in detail below with reference to the accompanying drawings. In the description of the embodiments of this application, the terms "first" and "second" are used for descriptive purposes only and should not be construed as indicating or implying relative importance or implicitly specifying the number of indicated technical features. Therefore, a feature defined with "first" and "second" may explicitly or implicitly include one or more of that feature.

[0095] It should be understood that in the embodiments of this application, "at least one" means one or more, and "more than one" means two or more. "And / or" describes the relationship between related objects, indicating that three relationships can exist. For example, A and / or B can represent: A alone, A and B simultaneously, or B alone, where A and B can be singular or plural. The character " / " generally indicates that the preceding and following related objects are in an "or" relationship. "At least one of the following" or similar expressions refer to any combination of these items, including any combination of single or plural items. For example, at least one of a, b, or c can represent: a, b, c, a and b, a and c, b and c, or a, b, and c, where a, b, and c can be single or multiple.

[0096] It is understood that the various numerical designations used in the embodiments of this application are merely for descriptive convenience and are not intended to limit the scope of the embodiments of this application. The order of the process numbers described above does not imply the order of execution; the execution order of each process should be determined by its function and internal logic.

[0097] Since the top area of ​​an electronic device's display screen is within the user's visual comfort zone, it is often used to display banner notification windows (also known as notification cards). These banner notification windows can display the content of the notification message and provide interactive functionality. For example, users can view the specific content of the notification message through the banner notification window. For instance, a user can perform a user action such as clicking on the banner notification window corresponding to a chat application. In response to this user action, the electronic device displays the chat application window, which then displays the specific content of the message notified by the banner notification window. Furthermore, the banner notification window may include one or more controls (such as button-type controls), which users can click to perform corresponding actions.

[0098] In this embodiment, notification messages from various types of applications can be displayed via a banner notification window. Based on the application type, the notification messages can be broadly categorized into the following types:

[0099] (1) High-urgency notification messages. These types of notification messages typically require timely processing by the user or need to attract the user's attention promptly. For example, these types of notification messages may include incoming call notifications from call applications or Voice over Internet Protocol (VoIP) applications, alarm reminders from clock applications, etc.

[0100] See Figure 1 This is an example of a banner notification window corresponding to a calling application. For example... Figure 1 As shown, the electronic device is running a video application, and the application's interface 10 is displayed on the screen. When a call comes in, a banner notification window 11 corresponding to the calling application is displayed at the top of the screen. The banner notification window 11 includes the following controls: an answer button 12 and a hang-up button 13. Clicking the banner notification window 11 opens the calling application's interface 14, which can be a full-screen interface or a non-full-screen interface (or a small window); clicking the answer button 12 answers the call; clicking the hang-up button 13 hangs up the call and closes the banner notification window 11.

[0101] (2) Live notifications. This type of notification message has a lower urgency level than high-urgency notification messages. For example, this type of notification message may include notification messages for a recorder application, notification messages for a ride-hailing application, etc.

[0102] See Figure 2 This is an example of a banner notification window corresponding to a recorder application. For example... Figure 2 As shown, the electronic device is running a video application and a recorder application. The video application interface 20 is displayed on the screen, and a banner notification window 21 for the recorder application is displayed at the top of the screen. The banner notification window 21 includes the following controls: a pause button 22 and a stop button 23. Clicking the banner notification window opens the recorder application interface 24, which can be a full-screen or non-full-screen interface. Clicking the pause button 22 pauses recording; clicking the stop button 23 stops recording and closes the banner notification window 21.

[0103] (3) Quick Action Notification Messages. These notification messages are mainly used to provide users with quick actions. For example, these notification messages may include notification messages corresponding to SMS applications, or more specifically, notification messages for sending verification codes.

[0104] See Figure 3 This is an example of a banner notification window corresponding to a short messaging application. For example... Figure 3As shown, the electronic device is running a video application, and the application's interface 30 is displayed on the screen. When the electronic device receives a new short message that is used to notify a verification code, a banner notification window 31 corresponding to the short message application is displayed at the top of the screen. The banner notification window 31 displays the source information of the short message, as well as the following controls: a view button 32 and a copy button 33. Clicking the banner notification window 31 opens the short message application's interface 34, which can be a full-screen or non-full-screen interface; clicking the view button 32 opens the short message interface and displays the content of the short message; clicking the copy button 33 copies the verification code included in the short message.

[0105] (4) Other notification messages. This type of notification message may include, for example, messages pushed by applications, or more specifically, weather notifications pushed by weather applications, or notifications of new messages arriving by social applications.

[0106] See Figure 4 This is an example of a banner notification window corresponding to a social application. For example... Figure 4 As shown, the electronic device is running a video application, and the application's interface 40 is displayed on the screen. When the electronic device receives a new message from the social application, a banner notification window 41 corresponding to the social application is displayed at the top of the screen. The notification content is displayed in the banner notification window 41. Clicking the banner notification window 41 opens the social application's interface 44, which can be either full-screen or non-full-screen, and displays the specific content of the new message.

[0107] The shape, size, and other attributes of the banner notification window in the above examples are only some possible examples. It is understood that the embodiments of this application do not limit the shape, size, etc. of the banner notification window.

[0108] The above example describes the display of a banner notification window on an electronic device while playing a video. It is understood that in other scenarios, the electronic device may display a banner notification window while running other applications (such as games) or while displaying the desktop interface. This application does not limit this.

[0109] The above are just a few possible notification messages. It is understood that this application does not limit the type of notification message.

[0110] It is understood that whether an electronic device displays a banner notification window for an application can be preset by the system or set by the user through the settings interface, and this application does not impose any restrictions on this.

[0111] When users operate electronic devices with one hand, banner notification windows are typically outside their comfort zone. If a user needs to answer a call or perform other actions through the banner notification window, they have to change their grip. For example, when holding a tablet or an unfolded foldable phone with a wide screen, a user cannot easily interact with the banner notification window using the same hand and must adjust their grip or use their other hand. This reduces the convenience of interacting with the banner notification window, negatively impacting the user experience. Over time, this can also lead to user fatigue and even health problems (such as tendonitis).

[0112] Therefore, embodiments of this application provide an interaction method and related apparatus for implementing the method. In this embodiment, when a banner notification window appears, the user's current interaction state with the electronic device can be sensed, allowing the user to easily realize the functions provided by the banner notification window without changing their grip posture.

[0113] It is understood that, in the embodiments of this application, a window may also be described as a user interface, application interface, or interface, etc. Optionally, for an application, one or more windows may be displayed on the screen of an electronic device.

[0114] The method provided in this application can be applied to electronic devices or to systems that include electronic devices.

[0115] The electronic device has a display screen, which can display windows (or user interfaces). The electronic device can be referred to as user equipment (UE), terminal, etc. For example, electronic device 100 can be a mobile phone (e.g., a non-foldable screen phone, or a foldable screen phone), a tablet, a personal computer (PC), an ultra-mobile personal computer (UMPC), a netbook, a personal digital assistant (PDA), a handheld device with wireless communication capabilities, a computing device, an in-vehicle device, or a wearable device, a virtual reality (VR) terminal device, an augmented reality (AR) terminal device, a wireless terminal in industrial control, a wireless terminal in a smart home, etc. The form of the electronic device is not specifically limited in this application embodiment. The operating system installed on the above-mentioned electronic device includes, but is not limited to, […]. Alternatively, other operating systems may be used. This application does not limit the specific type of the aforementioned electronic device or the operating system installed on it.

[0116] See Figure 5 This is one possible hardware structure for the electronic device in the embodiments of this application.

[0117] like Figure 5 As shown, the electronic device 100 may include a processor 110, an external memory interface 120, an internal memory 121, a universal serial bus (USB) interface 130, a charging management module 140, a power management module 141, a battery 142, an antenna 1, an antenna 2, a mobile communication module 150, a wireless communication module 160, an audio module 170, a speaker 170A, an earpiece 170B, a microphone 170C, a headphone jack 170D, a sensor module 180, buttons 190, a motor 191, an indicator 192, a camera 193, a display screen 194, and a subscriber identification module (SIM) card interface 195, etc. The sensor module 180 may include a pressure sensor 180A, a gyroscope sensor 180B, a barometric pressure sensor 180C, a magnetic sensor 180D, an accelerometer sensor 180E, a distance sensor 180F, a proximity sensor 180G, a fingerprint sensor 180H, a temperature sensor 180J, a touch sensor 180K, an ambient light sensor 180L, a bone conduction sensor 180M, etc.

[0118] Processor 110 may include one or more processing units, such as application processors (APs), modem processors, graphics processing units (GPUs), image signal processors (ISPs), microcontroller units (MCUs), controllers, memory, video codecs, digital signal processors (DSPs), baseband processors, and / or neural network processing units (NPUs). An MCU is a single chip integrating a processor core, memory, input / output interfaces, and other peripheral device interfaces (such as timers, analog-to-digital converters (ADCs), communication interfaces, etc.). Compared to a CPU processor core, the MCU's processor core has a lower frequency and specifications, thus resulting in lower power consumption.

[0119] Different processing units can be independent devices or integrated into one or more processors. The controller can serve as the nerve center and command center of the electronic device 100. The controller can generate operation control signals based on instruction opcodes and timing signals to control instruction fetching and execution. The processor 110 can also include a memory for storing instructions and data. In some embodiments, the memory in the processor 110 is a cache memory. This memory can store instructions or data that the processor 110 has just used or is repeatedly using. If the processor 110 needs to reuse the instruction or data, it can directly retrieve it from the memory. This avoids repeated access, reduces the processor 110's waiting time, and thus improves system efficiency. In this embodiment, the execution of the audio playback method can be controlled by the processor 110 or by calling other components, such as calling the processing program of this embodiment stored in the internal memory 121, or calling the processing program of this embodiment stored in a third-party device through the external memory interface 120. This allows the electronic device 100 to automatically switch audio playback modes, solving the problem of low efficiency caused by manual switching of audio playback modes in the prior art. Furthermore, in this embodiment of the application, when the electronic device 100 determines that the user intends to switch audio playback modes (e.g., the electronic device 100 moves closer to or further away from the user's head), it can adaptively adjust the audio playback state or audio playback volume. For example, when switching audio playback modes (e.g., switching from a first audio playback mode to a second audio playback mode), it can pause audio playback, or gradually reduce the volume of the audio when played in the first audio playback mode and gradually reduce the volume of the audio when played in the second audio playback mode. This ensures that the user experience is not affected by sudden changes in audio playback volume when switching audio playback modes, thus adapting to the user's needs.

[0120] Internal memory 121 can be used to store computer executable program code, which includes instructions. Processor 110 executes various functional applications and data processing of electronic device 100 by running the instructions stored in internal memory 121. Internal memory 121 may include a program storage area and a data storage area. The program storage area may store the operating system and software code for at least one application (e.g., iQiyi application, WeChat application, etc.). The data storage area may store data generated during the use of electronic device 100 (e.g., images, videos, etc.). Furthermore, internal memory 121 may include high-speed random access memory and may also include non-volatile memory, such as at least one disk storage device, flash memory device, universal flash storage (UFS), etc.

[0121] The external memory interface 120 can be used to connect an external memory card, thereby expanding the storage capacity of the electronic device 100. The external memory card communicates with the processor 110 through the external memory interface 120 to perform data storage functions. For example, images, videos, and other files can be saved on the external memory card.

[0122] In some embodiments, processor 110 may include one or more interfaces. Interfaces may include an inter-integrated circuit (I2C) interface, an inter-integrated circuit sound (I2S) interface, a pulse code modulation (PCM) interface, a universal asynchronous receiver / transmitter (UART) interface, a mobile industry processor interface (MIPI), a general-purpose input / output (GPIO) interface, a subscriber identity module (SIM) interface, and / or a USB interface 130, etc.

[0123] It is understood that the interface connection relationships between the modules illustrated in the embodiments of this application are merely illustrative and do not constitute a structural limitation on the electronic device 100. In other embodiments of this application, the electronic device 100 may also employ different interface connection methods or combinations of multiple interface connection methods as described in the above embodiments.

[0124] Understandable, Figure 5 The components shown do not constitute a specific limitation on the electronic device. The electronic device in the embodiments of this application may include, but is not limited to, components that are... Figure 5 More or fewer parts. Furthermore, Figure 5 The combination / connection relationships between the components can also be adjusted and modified.

[0125] This application relates to the usage status of electronic devices. The usage status of electronic devices and the method for detecting the usage status are described below.

[0126] In this embodiment, the usage state of the electronic device refers to the user's way of using or operating the electronic device, which can be specifically represented by the user's holding hand and interactive hand when using the electronic device. The interactive hand refers to the hand used to perform various operations on the electronic device, that is, the hand used to operate the electronic device to display windows. The holding hand refers to the hand used to grasp the electronic device. It is understood that the interactive hand and the holding hand may coexist, or only one of them may exist. One or more interactive hands may coexist (e.g., one or both interactive hands), and one or more holding hands may coexist (e.g., one or both holding hands).

[0127] The usage status of electronic devices can include left-hand operation, right-hand operation, two-hand operation, and non-holding status.

[0128] The left-hand operation state can include the following states: both the holding hand and the interaction hand are left-handed (i.e., left-handed holding and left-handed interaction); or the holding hand is right-handed and the interaction hand is left-handed (i.e., right-handed holding and left-handed interaction); or both holding hands and the interaction hand is left-handed (i.e., both-handed holding and left-handed interaction); or the holding hand is left-handed and there is no interaction hand (i.e., only left-handed holding); or there is no holding hand and the interaction hand is left-handed (i.e., only left-handed operation). In the state of holding only the left hand, although there is no interaction hand, there is a possibility that the user may later use the holding hand (left hand) to operate the electronic device; that is, the holding hand (left hand) may become the subsequent interaction hand. Therefore, this state is classified as a left-handed operation state.

[0129] Right-hand operation states can include the following: both the holding hand and the interaction hand are right-handed (i.e., right-handed grip and right-handed interaction); or the holding hand is left-handed and the interaction hand is right-handed (i.e., left-handed grip and right-handed interaction); or both holding hands are right-handed and the interaction hand is right-handed (i.e., both-handed grip and right-handed interaction); or the holding hand is right-handed and there is no interaction hand (i.e., only right-handed grip); or there is no holding hand and the interaction hand is right-handed (i.e., only right-handed operation). In the state of holding only the right hand, although there is no interaction hand, there is a possibility that the user may later use the holding hand (right-handed hand) to operate the electronic device; that is, the holding hand (right-handed hand) may become the subsequent interaction hand. Therefore, this state is classified as a right-handed operation state.

[0130] Two-handed operation states include the following: holding hands with both hands (i.e., holding only with both hands), or interacting hands with both hands (i.e., operating only with both hands), or holding hands with one hand and interacting hands with both hands, or both holding hands and operating hands with both hands. Among these, in the state of holding only with both hands, although there is no interacting hand, there is a possibility that the user may use the holding hand (both hands) to operate the electronic device later. That is, the holding hand (both hands) may become the subsequent interacting hand. Therefore, this state is classified as a two-handed operation state.

[0131] Non-holding states include situations where there is neither a holding hand nor an interactive hand, such as when an electronic device is placed on a desk and the user is not operating it.

[0132] Further considering the usage orientation of electronic devices (i.e., landscape or portrait mode), the usage states of electronic devices can be further subdivided into: landscape left-hand operation state, landscape right-hand operation state, landscape two-hand operation state, portrait left-hand operation state, portrait right-hand operation state, and portrait two-hand operation state, landscape two-hand operation state, portrait two-hand operation state, landscape non-holding state, and portrait non-holding state.

[0133] The following is combined Figure 6 Some usage states of the electronic devices in the embodiments of this application are described.

[0134] like Figure 6 As shown in (1), the user holds the electronic device with their left hand and operates it with their left thumb. That is, there is both a holding hand and an interactive hand, and both are left-handed. Figure 6 As shown in (2), the user holds the electronic device with their right hand and operates it with their right thumb. In other words, there is both a holding hand and an interactive hand, and both are right-handed. Figure 6 As shown in (3), the user operates the electronic device with the index finger of their left hand and does not hold the electronic device; that is, only the interactive hand exists, and the interactive hand is the left hand. Figure 6 As shown in (4), the user operates the electronic device with their right index finger and does not hold the electronic device; that is, only the interactive hand exists, and the interactive hand is the right hand. Figure 6 As shown in (5), the user holds the electronic device with their left hand and operates it with their right index finger. In other words, there is both a holding hand and an interactive hand, with the holding hand being the left and the interactive hand being the right. Figure 6 As shown in (6), the user holds the electronic device with their right hand and operates it with their left index finger. In other words, there is both a holding hand and an interactive hand, with the holding hand being the right hand and the interactive hand being the left hand. Figure 6 As shown in (7), the user holds the electronic device with both their left and right hands, and operates the electronic device using both their left and right thumbs. That is, there is both a holding hand and an interactive hand, and both the holding hand and the interactive hand include the left and right hands. Figure 6 As shown in (8), the user holds the electronic device with their left hand and operates it using their left thumb and right index finger. In other words, there is both a holding hand and an interactive hand, with the holding hand being the left hand and the interactive hands being both the left and right hands. Figure 6As shown in Figure (9), the user holds the electronic device with his right hand and operates the electronic device with his left index finger and right thumb. That is to say, there is a holding hand and an interactive hand at the same time, and the holding hand is the right hand, while the interactive hand is the left and right hands.

[0135] Figure 6 Examples (1), (3), and (6) in the text belong to the left-hand operation state. Figure 6 Examples (2), (4), and (5) in the text belong to the right-hand operation state. Figure 6 (7), (8) and (9) in the text belong to the two-handed operation state.

[0136] For example, one state in which the left hand holds an electronic device can be as follows: Figure 6 As shown in (10) of the table.

[0137] In some embodiments of this application, the two-hand operation state can be classified into a left-hand operation state and a right-hand operation state based on the interaction operations within a historical period or based on the last interaction operation.

[0138] For example, when holding a hand grip, if in a recent period the number of operations performed by the left hand as the interacting hand is higher than the number of operations performed by the right hand as the interacting hand, then it can be determined that the hand is in a left-hand operating state. Similarly, when holding a hand grip, if in a recent period the number of operations performed by the right hand as the interacting hand is higher than the number of operations performed by the left hand as the interacting hand, then it can be determined that the hand is in a right-hand operating state.

[0139] For example, when holding the device with both hands, if the last interaction was performed with the left hand, then it can be determined that the device is in a left-handed operation state. Similarly, when holding the device with both hands, if the last interaction was performed with the right hand, then it can be determined that the device is in a right-handed operation state.

[0140] After determining the holding hand and the interaction hand, the usage state of the electronic device can be determined according to the definition of the usage state of the electronic device in the embodiments of this application.

[0141] The detection methods for the holding hand and the interacting hand are explained below.

[0142] Method 1 for detecting interactive hands: Detect interactive hands based on the shape and area of ​​the touch points.

[0143] When a user interacts with an electronic device screen using their finger, corresponding touch points are formed on the screen. The touch points formed differ depending on which hand is used (e.g., left hand, right hand). For example, when a user interacts with an electronic device using their left thumb, such as... Figure 6The interactive scenario shown in (1) can form touch points as follows: Figure 7 As shown in (1). When a user interacts with an electronic device using their right index finger, as... Figure 6 The interactive scenario shown in (4) can form touch points as follows: Figure 7 As shown in (2). Optional, Figure 7 Middle (1) and Figure 7 The contact point shown in (2) is an example of a contact point formed when a user interacts with an electronic device using the pad of their finger. When a user interacts with an electronic device using the tip of their finger, the resulting contact point can interact with... Figure 7 Middle (1) and Figure 7 The example shown in (2) is different. For example, when a user interacts with an electronic device using the tip of their left thumb, the touch point formed on the screen can be as follows: Figure 7 As shown in (4). When a user interacts with an electronic device using the tip of their right index finger, the touch point formed on the screen can be as follows: Figure 7 As shown in (3).

[0144] Based on this, in some embodiments of this application, the electronic device can determine the user's interaction hand by detecting at least one parameter, such as the shape and area of ​​the touch point. In some implementations, the shape of the touch point can be based on, for example... Figure 7 At least one of the following is determined: the ratio between the major axis a and the minor axis b; the angle between the line in the direction of the major axis a and the preset coordinate axis; and the angle between the line in the direction of the minor axis b and the preset coordinate axis. The preset coordinate axis can be a coordinate axis in a preset coordinate system. For example, using a preset coordinate system... Figure 7 As shown in Figure (5), taking the rectangular coordinate system with the lower left corner of the electronic device screen as the origin o, the positive x-axis to the right, and the positive y-axis upward as an example, the preset coordinate axes can be... Figure 7 The x-axis shown in (5) can also be the y-axis. Of course, in practical applications, the preset coordinate axis can also be set in other ways, and this application embodiment does not impose specific restrictions on this.

[0145] When a touch point is formed on the screen of an electronic device, the screen parameters of the area corresponding to that touch point may change. Based on this, in some embodiments of this application, the electronic device can determine the position of the touch point by detecting the screen parameters, and then detect at least one of the touch point's shape, area, etc. For example, taking an electronic device screen implemented as a capacitive touch screen, the screen parameter can be the capacitance value. Of course, when the electronic screen is implemented as other types of touch screens, such as resistive touch screens, the screen parameters can also be other parameters. In this embodiment of the application, the screen parameter is taken as the capacitance value.

[0146] Method 2 for detecting interactive hands: Detect interactive hands based on the touch signal characteristics of a single interaction.

[0147] The characteristics of the touch signal generated when a user performs a touch operation on the display screen of an electronic device using their left hand may differ from those generated when using their right hand. For example, the touch signals generated by left-handed and right-handed touch operations may differ in one or more of the following aspects:

[0148] Capacitance values ​​differ: the capacitance between a finger and the screen depends on the contact area and pressure. Because the size of fingers on the left and right hands may differ slightly (right-hand fingers are typically slightly larger), the contact area between the fingers on the screen will also differ slightly. Additionally, since most people are right-handed, they may apply more pressure, resulting in a higher capacitance value.

[0149] There are differences in touch angles and shapes: the way left-handed and right-handed operators operate may result in different touch angles and shapes. For example, when operating with the left hand, fingers may tend to touch the screen sideways or at an angle; when operating with the right hand, fingers are usually more perpendicular to the screen, and the contact area is more regular.

[0150] Differences exist in swipe paths and speeds: Left and right hands have different operating habits and dexterity. For example, left-handed users may swipe more to the left or counter-clockwise; right-handed users may swipe more to the right or clockwise. The right hand is generally more dexterous than the left, and swipes may be faster.

[0151] There are differences in touch pressure: the force distribution and control ability of the left and right hands are different. For example, the right hand can usually apply more pressure, especially when fine control is required; the left hand may be gentler and apply less pressure in some situations.

[0152] There are differences in signal stability: the stability of the left and right hands is affected by muscle control ability and operating habits. For example, the signal may be more stable when using the right hand because most people are better at precise movements with their right hand; when using the left hand, the signal may fluctuate slightly, especially after prolonged use.

[0153] Based on this, electronic devices can determine whether the interacting hand is the left or right hand based on the characteristics of the touch signal generated by a single interaction.

[0154] Method 3 for detecting interactive hands: Detect interactive hands by combining the detection results of multiple interaction signals.

[0155] In some embodiments, the electronic device can determine whether the interacting hand is left-handed or right-handed by combining the detection results of multiple interactive operations (e.g., detecting whether it is a left-handed or right-handed operation). For example, if multiple interactive operations are performed within a certain period of time, the electronic device can determine whether the current interacting hand is left-handed or right-handed based on the number (or frequency) of operations performed with the left hand as the interacting hand and / or the number (or frequency) of operations performed with the right hand as the interacting hand.

[0156] For example, if the number (or frequency) of operations performed by the left hand as the interaction hand is higher than the number (or frequency) of operations performed by the right hand as the interaction hand, then the left hand is determined to be the current interaction hand; if the number (or frequency) of operations performed by the right hand as the interaction hand is higher than the number (or frequency) of operations performed by the left hand as the interaction hand, then the right hand is determined to be the current interaction hand.

[0157] For another example, if the percentage of operations performed by the left hand as the interaction hand is higher than the percentage of operations performed by the right hand as the interaction hand, then the left hand is determined to be the current interaction hand; if the percentage of operations performed by the right hand as the interaction hand is higher than the percentage of operations performed by the left hand as the interaction hand, then the right hand is determined to be the current interaction hand.

[0158] Optionally, if the number of operations (or frequency or percentage) performed by the left hand as the interaction hand is equal to the number of operations (or frequency or percentage) performed by the right hand as the interaction hand, then the interaction hand used in the most recent interaction operation can be used as the interaction hand, or either the right hand or the left hand can be selected as the interaction hand.

[0159] Method 1 for detecting the gripping hand: Detect the gripping hand based on screen parameters (such as capacitance value) at the screen edge.

[0160] When a user holds a capacitive touchscreen, their hand may touch the edge of the screen, causing changes in screen parameters at the edge. For example, such as... Figure 7 As shown in Figure (6), when a user holds the electronic device with their left hand, the capacitance value in region 1 of the electronic device screen changes. Region 1 can include multiple capacitor units, and each "#" in region 1 represents the capacitance value of one capacitor unit. Based on this, in some embodiments of this application, the electronic device can determine whether a hand is holding the device by detecting screen parameters (such as capacitance values) at the edge of the screen. Similarly, when the user uses different hands (such as left or right), the location of the changing screen parameters may be different. For example, when the user holds the electronic device with their left hand, the screen parameters at the left edge of the screen may change. When the user holds the electronic device with their right hand, the screen parameters at the right edge of the screen may change. Based on this, in some embodiments of this application, the electronic device can also determine whether the hand is left or right by detecting the location of the changing screen parameters.

[0161] Method 2 for detecting the gripping hand: Detect the gripping hand based on joint motion parameters.

[0162] When a user holds an electronic device in different ways, the vibrations produced vary depending on the restricted joint movement of the user's hands. For example, in grip posture a, the user holds the electronic device with their left hand, using four fingers (excluding the thumb) to support it; that is, the user supports the device with their left palm. When the user operates the device with their left thumb or right hand, this operation will cause a slight vibration in the user's left hand or left arm. Similarly, in grip posture b, the user holds the electronic device with their left hand, using their left arm to support it; that is, the user supports the device with one arm. When the user operates the device with four fingers (excluding the thumb) or right hand, this operation will cause a slight vibration in the user's left hand or left arm. Because grip posture b differs from grip posture a, the method of supporting the electronic device is different, and the vibrations are different due to the restricted joint movement, the resulting vibrations also differ. Finally, in grip posture c, the user holds the electronic device with both hands, using four fingers (excluding the thumbs) of both hands to support it; that is, the user supports the device with both palms. When a user operates an electronic device with their left or right thumb, the operation causes slight vibrations in the user's hands or arms. Because grip posture c differs from grip postures a and b, and because of the different ways the electronic device is supported and the limitations imposed on joint movement, the resulting vibrations also differ.

[0163] The aforementioned vibrations can be detected by an inertial measurement unit (IMU, or inertial sensor) in electronic devices. An IMU can detect acceleration, tilting, impact, vibration, rotation, and multi-degree-of-freedom motion. An IMU may include accelerometers, angular velocity sensors, and single-axis, dual-axis, or triaxial combinations thereof.

[0164] Based on this, in some embodiments of this application, the electronic device can determine the changes in the detection data over a period of time based on the detection data of the IMU, thereby determining the holding method of the electronic device (e.g., holding with one hand or holding with both hands). Optionally, the electronic device can combine the detection of the interacting hand to further determine the holding hand.

[0165] It is understood that in other embodiments, the electronic device may also detect the presence of a holding hand through other sensors, such as sensors on the side or back of the electronic device, or pressure sensors, and if a holding hand is determined to be present, further determine whether the holding hand is the left hand, the right hand, or both hands.

[0166] The above content explains how electronic devices determine the interactive hand and the holding hand, and how they determine the left-hand operation state and the right-hand operation state. The following section explains how the electronic device displays windows in the left-hand operation state and the right-hand operation state.

[0167] In this embodiment, the electronic device can display the interactive panel corresponding to the banner notification window on the left or right side of the display screen according to the current usage state. For example, if the electronic device is currently in a left-handed operation state, the interactive panel is displayed on the left side of the display screen so that the user can interact with the interactive panel using their left hand; if the electronic device is currently in a right-handed operation state, the interactive panel is displayed on the right side of the display screen so that the user can interact with the interactive panel using their right hand. The interactive panel can provide all or part of the functions provided by the banner notification window, allowing the user to interact with the interactive panel instead of directly interacting with the banner notification window. Displaying the interactive panel on the same side as the user's hand, i.e., achieving hand-responsive window display, makes the interactive panel easily accessible, improving the convenience of interaction between the user and the window, and making the window display more in line with user needs.

[0168] Specifically, the interactive panel can be a floating window, which can be seen as a simplified or miniaturized banner notification window.

[0169] In some embodiments, the height of the interactive panel window is greater than its width, that is, it is generally a vertical strip shape, such as a capsule shape. Optionally, the size of the interactive panel can be set based on the following principle: while facilitating user operation and accommodating the required controls, the size of the interactive panel should be as small as possible to minimize obstruction of other windows or interfaces. It is understood that the embodiments of this application do not limit the shape of the interactive panel.

[0170] In this embodiment, all or part of the functions provided by the banner notification window can be implemented by an interactive panel. For example, a user can open an application window through the interactive panel. Taking the banner notification window as the notification window corresponding to the first application as an example, the interactive panel corresponding to the banner notification window can have the following functions: when the user performs a first user operation on the interactive panel, the banner notification window is collapsed and a first window is displayed, which is the window of the first application.

[0171] Optionally, the first user operation can be a sliding operation on the interactive panel, with the sliding direction pointing in the opposite direction to the side where the interactive panel is located, or towards the center of the display screen. For example, if the interactive panel is located on the left side of the display screen, the user can open the window of the first application by sliding the interactive panel to the right; if the interactive panel is located on the right side of the display screen, the user can open the window of the first application by sliding the interactive panel to the left.

[0172] Optionally, the first user action can also be clicking on an interactive panel. When the user clicks on the area of ​​the interactive panel, the window of the first application is opened in response.

[0173] This application does not limit the type of user operation. The window of the first application can be a full-screen window or a non-full-screen window.

[0174] If the banner notification window includes one or more controls, then the corresponding interactive panel can also include one or more controls, providing the same functionality as the corresponding controls in the banner notification window. For example, ... Figure 11 As shown, the banner window used to implement incoming call notification includes two controls: an answer button and a hang-up button. The corresponding interactive panel of the banner notification window also includes an answer button and a hang-up button. The answer button in the interactive panel and the answer button in the banner notification window have the same function, and the hang-up button in the interactive panel and the hang-up button in the banner notification window have the same function.

[0175] Optionally, the controls in the interactive panel can be arranged vertically.

[0176] To enhance flexibility, some embodiments of this application allow users to choose to enable or disable the convenient interactive function for banner notifications. If this function is enabled, the electronic device can display an interactive panel corresponding to the banner notification window in the manner provided in this application.

[0177] Figure 8 An example is shown: a settings page for a convenient interactive feature in banner notifications, through which users can enable or disable this feature. Specifically, as shown... Figure 8 As shown, if the "Banner Notification Convenient Interaction" function 810 in the settings interface 800 is enabled (e.g.) Figure 8 If the "Banner Notification Convenient Interaction" function 810 is turned off, the electronic device can display the interactive panel corresponding to the banner notification window in accordance with the method provided in the embodiments of this application. If the "Banner Notification Convenient Interaction" function 810 is turned off, the electronic device will not display the interactive panel corresponding to the banner notification window.

[0178] Optionally, the settings interface can also display an image 820, which describes the display effect when the function is enabled, so that users can understand the meaning of "banner notification convenient interaction" and thus make it easier for users to choose whether to enable or disable the function.

[0179] It is understood that the above is merely an example of one method for enabling or disabling related functions, and this application does not limit the method for enabling or disabling related functions.

[0180] The following is combined with Figure 9 and Figure 10 The display method provided in the embodiments of this application will be described.

[0181] See Figure 9 This is a flowchart illustrating a display method provided in an embodiment of this application, as shown below. Figure 9 As shown, the process may include the following steps:

[0182] Step 901: The electronic device receives a notification message from the first application.

[0183] The first application can be a calling application, a clock application, a text messaging application, a social application, or a weather application, etc. This application does not limit the type of the first application.

[0184] Step 902: The electronic device displays a banner notification window corresponding to the first application.

[0185] Optionally, banner notification windows are typically displayed at the top of the screen. An example of a banner notification window can be found here. Figures 1 to 4 .

[0186] Step 903: The electronic device determines the display position of the interactive panel corresponding to the banner notification window based on the current usage status of the electronic device.

[0187] In this step, the electronic device can determine its usage status by detecting the interacting hand and the holding hand.

[0188] Specifically, the gripping hand can be detected by a gripping state detection service in the electronic device. Optionally, the gripping state detection service can be an always-on service (or a resident service), which can run after the electronic device is powered on, or after the convenient interactive function of the banner notification is enabled. Specific detection methods can be found in the aforementioned embodiments.

[0189] The interaction hand can be detected by an interaction hand detection service in the electronic device. Optionally, the interaction state detection service can be an always-on service (or a resident service), which can run after the electronic device is powered on, or after the convenient interaction function of the banner notification is enabled. Specific detection methods can be found in the foregoing embodiments.

[0190] Step 904: If the electronic device is currently in left-hand operation mode, display the interactive panel corresponding to the banner notification window on the left side of the screen.

[0191] In this step, "the interactive panel is displayed on the left side of the display screen" means that the interactive panel is displayed on the left side of the display area of ​​the display screen. For example, the right edge of the interactive panel may overlap with, connect with, or be separated from the left edge of the display area by a small distance. In the vertical direction, the interactive panel may be located in the center of the display area, or it may be located in the upper or lower part of the display area; this application does not impose any restrictions.

[0192] Step 905: If the electronic device is currently in right-hand operation mode, then display the interactive panel corresponding to the banner notification window on the right side of the display screen.

[0193] In this step, "the interactive panel is displayed on the right side of the display screen" means that the interactive panel is displayed on the right side of the display area of ​​the display screen. For example, the left edge of the interactive panel may overlap, connect with, or be separated from the right edge of the display area by a small distance. In the vertical direction, the interactive panel may be located in the center of the display area, or it may be located in the upper or lower part of the display area; this application does not impose any restrictions.

[0194] In steps 904 and 905 above, the interactive panel can be dimmed. Dimming the display can be understood as reducing the brightness of the image. This implementation makes the interactive panel relatively prominent, prompting the user to operate through the interactive panel and improving the visual experience.

[0195] In one possible implementation of steps 904 and 905 above, if an interactive hand is detected, the side of the display screen on which the interactive panel is displayed is determined based on the interactive hand, regardless of whether a holding hand is detected. Specifically, if the interactive hand is the left hand, the interactive panel is displayed on the left; if the interactive hand is the right hand, the interactive panel is displayed on the right. Optionally, if both hands are used, the interactive hand can be determined based on the number of interactions using the left hand and the right hand in a recent period. For a specific implementation, refer to the aforementioned embodiments. Through this implementation, the electronic device can display the interactive panel corresponding to the banner notification window on the same side as the interactive hand. Since the interactive hand is used to operate the electronic device, displaying the interactive panel on the side of the interactive hand facilitates user interaction with the window using the interactive hand, improving interaction convenience.

[0196] In another possible implementation of steps 904 and 905 above, if no interactive hand is detected but a holding hand is detected, the side of the display screen where the interactive panel is displayed is determined based on the holding hand. Specifically, if the holding hand is left-handed, the interactive panel is displayed on the left; if the holding hand is right-handed, the interactive panel is displayed on the right. Optionally, if both hands are holding the device, considering that most users are accustomed to using their right hand for operation, the interactive panel is displayed on the right side of the display screen. Through this implementation, the electronic device can display the interactive panel corresponding to the banner notification window on the same side as the holding hand. Thus, since there is no interactive hand—that is, the user has not yet operated the electronic device—but a holding hand is present, there is a possibility that the user will later use the holding hand to operate the electronic device. That is, the holding hand at this time may become the subsequent interactive hand, and thus displaying the interactive panel on the side of the holding hand facilitates subsequent user interaction with the window using that hand, improving interaction convenience.

[0197] In another scenario, when the electronic device is not held (e.g., placed on a table and not being held or operated by the user), upon receiving a new message from the first application, the device can display a banner notification window corresponding to the first application at the top of its screen. In this case, because the device is not held or operated by the user, the interactive panel corresponding to the banner notification window is not displayed. When the device is held or operated by the user, it can determine its usage status by detecting the holding hand and the interacting hand, and thus display the interactive panel corresponding to the banner notification window on the left or right side of the screen based on the usage status. For example, when the user picks up the electronic device from the desk with their right hand, the device can display the interactive panel corresponding to the banner notification window on the right side of the screen.

[0198] In some embodiments, when the electronic device switches from a left-handed or right-handed operating state to a non-held state, the interactive panel retracts. The banner notification window may still be displayed at the top of the display. Since the electronic device is not being held or operated by the user at this time, there is no need to display the interactive panel corresponding to the banner notification window.

[0199] In some embodiments, when a banner notification window is displayed on an electronic device, if the electronic device switches from a non-held state to a left-hand operation state, an interactive panel corresponding to the banner notification window is displayed on the left side of the display screen; if the electronic device switches from a non-held state to a right-hand operation state, an interactive panel corresponding to the banner notification window is displayed on the right side of the display screen.

[0200] In some embodiments, when a banner notification window is displayed on the electronic device, the position of the interactive panel changes as the usage state of the electronic device changes. For example, when the electronic device switches from left-handed operation to right-handed operation, the interactive panel moves from the left side of the display to the right side; when the electronic device switches from right-handed operation to left-handed operation, the interactive panel moves from the right side of the display to the left side.

[0201] Software system architecture based on electronic devices, the above Figure 9 The implementation process of the illustrated flow in the software system architecture can be found by referring to... Figure 10 .

[0202] like Figure 10 As shown, the software system architecture of an electronic device can be a layered architecture. For example, the software can be divided into several layers, and the layers communicate with each other through software interfaces. In some embodiments, the operating system is divided into five layers, from top to bottom: application layer, application framework layer (FWK), hardware abstraction layer (HAL), kernel layer, and hardware layer.

[0203] The application layer can include a series of application packages. For example... Figure 10 As shown, the application layer can include video applications, calling applications, etc. The application layer can also include UI development frameworks, such as ArkUI. ArkUI is a declarative UI development framework that provides two development paradigms (declarative and web-like paradigms), supports cross-device responsive layouts, animations, interactions, and high-performance rendering, and is suitable for application development across all scenarios. The application layer can also include context-aware services, such as Awareness Kit. Awareness Kit is a context-aware service designed to provide a smarter and more personalized user experience by acquiring information such as the user's current time and space, location, activity state, audio device status, ambient light, weather, and beacons.

[0204] The application framework layer provides application programming interfaces and a programming framework for applications. The application framework layer includes some predefined functions. For example... Figure 10 As shown, the application framework layer may include interaction state detection service, grip state detection service, touch service, etc.

[0205] HAL (Hardware Abstraction Layer) abstracts hardware, hiding the hardware interface details of a specific platform. It provides a virtual hardware platform for the operating system, making it hardware-independent and portable across multiple platforms. Touch algorithms can be included in the HAL layer.

[0206] The kernel layer is the layer between hardware and software. The kernel layer can include display drivers and sensor drivers (such as the Context Hub Driver).

[0207] The hardware layer can include various sensors, such as accelerometers, gravity sensors, touch sensors, IMUs, and may also include displays.

[0208] Based on the above software system architecture Figure 9 The display process shown may include:

[0209] Data detected by the IMU or other sensors is transmitted to the interaction state detection service and grip state detection service in the application framework layer via the corresponding sensor driver. Data detected by hardware such as touch sensors is processed by touch algorithms to obtain touch events. Relevant information about the touch events (such as the location of the user's operation) is passed to the touch service and, via the kernel driver, to the interaction state detection service.

[0210] The interaction state detection service determines the interacting hand based on the received data, and the grip state detection service determines the gripping hand based on the received data, and then passes the detection results to the application layer.

[0211] The UI development framework and context-aware service in the application layer determine the position of the interactive panel corresponding to the banner notification window based on the detection results of the interaction state detection service and the grip state detection service, and then render the user interface, which includes the interactive panel. The rendered user interface is then displayed through the display driver.

[0212] In the above process, the implementation of the interaction state detection service to detect the interaction hand can refer to the aforementioned embodiments, and the method of the grip state detection service to detect the gripping hand can refer to the aforementioned embodiments.

[0213] The following section introduces the implementation of interactive panels for displaying left and right hand operation status on electronic devices, using different application scenarios as examples.

[0214] Scenario 1: Taking the banner notification window corresponding to the call application as an example, describe the process of the electronic device displaying the interactive panel corresponding to the banner notification window on the side of the screen when an incoming call is received, based on the usage status.

[0215] See Figure 11 When an incoming call comes in, the electronic device displays a banner notification window 1210 at the top of the screen and shows the corresponding interactive panel.

[0216] like Figure 11As shown in (a), since the user holds and operates the electronic device with their left hand, the interaction panel 1220 is displayed on the left side of the screen, thus facilitating user interaction with the panel using their left hand. Figure 11 As shown in (b), since the user holds and operates the electronic device with their right hand, the interaction panel 1220 is displayed on the far side of the screen, thus facilitating user interaction with the interaction panel using their right hand. Figure 11 As shown in (c), since the user holds the electronic device with both hands and the right hand is the interaction hand, the interaction panel 1220 is displayed on the right side of the display screen, so that the user can use the right hand to interact with the interaction panel.

[0217] Optionally, the interactive panel 1120 includes an answer button 1121, which performs the same function as the answer button 1111 in the banner notification window 1110. When the user clicks the answer button 1121 in the interactive panel 1120, the call can be answered. The interactive panel 1120 may also include a hang-up button 1122, which performs the same function as the hang-up button 1112 in the banner notification window 1110. When the user clicks the hang-up button 1122 in the interactive panel 1120, the call can be hung up.

[0218] Optionally, to facilitate user operation and minimize the size of the interactive panel 1120, the interactive panel 1120 can be presented in a capsule shape, with the answer and hang-up buttons arranged vertically. The incoming call information (such as contact name, phone number, etc.) in the banner notification window 1110 can be hidden or partially displayed in the interactive panel 1120. In other words, the interactive panel 1120 can be considered a simplified version of the banner notification window.

[0219] It is understood that this application does not limit the shape, size, etc. of the interactive panel 1120. Similarly, this application does not limit the arrangement and order of the answer button 1121 and hang-up button 1122 in the interactive panel 1120.

[0220] Optionally, the banner notification window 1110 can be dimmed, for example, the brightness of the banner notification window 1110 is reduced, so that the interactive panel 1120 is highlighted, which can remind the user to operate the interactive panel 1120.

[0221] Optionally, the banner notification window 1110 can be automatically closed after being displayed for a period of time, and correspondingly, the interactive panel 1120 is also closed when the banner notification window 1110 is closed.

[0222] In some embodiments, a user can interact with the interactive panel through a first user action to open a window of a first application. This process is described in the following scenario two.

[0223] Scenario 2: Taking the banner notification window corresponding to the call application as an example, describe the process of opening the call application window and closing the call application window by interacting with the interactive panel.

[0224] See Figure 12 In (a) of the diagram, a banner notification window 1210 is displayed at the top of the electronic device's screen, and an interactive panel 1220 is displayed on the right side of the screen. When the user presses the interactive panel 1220 and slides it to the left (or towards the center of the screen) (as an example of a first user operation, as shown by the arrow in the diagram), the interactive panel 1220 expands into a call application interface 1230. The interface 1230 can be a full-screen interface or a non-full-screen interface; here, a full-screen interface is used as an example.

[0225] Optionally, when sliding the interactive panel 1220, the interactive panel 1220 may be stretched or widened.

[0226] Optionally, a first threshold can be preset. If the distance the user slides the interactive panel 1220 reaches the first threshold, the electronic device can play a vibration, such as a slight vibration, to prompt the user to lift their finger (i.e., end the sliding operation) to prevent the interactive panel from expanding into the interface of the first application. If the user ends the sliding operation at this time, the interactive panel 1220 returns to its original state.

[0227] Optionally, a second threshold can be preset, which is greater than the first threshold. When the distance of the user sliding the interactive panel 1220 reaches the second threshold, the interface 1230 of the call application is opened.

[0228] Optionally, when the interface of the call application is expanded, both the banner notification window 1210 and the interactive panel 1220 are collapsed.

[0229] Another user action that expands the interactive panel into the interface of the first application is clicking the interactive panel. For example, when the user clicks interactive panel 1220, the interface of the calling application can be displayed, such as... Figure 1 As shown, the interface of the call application can be either a full-screen interface or a non-full-screen interface.

[0230] In some embodiments, after the interactive panel is expanded into the interface of the first application, the interface can also be collapsed into an interactive panel through a second user operation.

[0231] See Figure 12In (b), when the user slides the interface 1230 of the first application, for example, swiping up from the lower left or upper left corner (as an example of a second user operation, as shown by the arrow in the figure), or swiping from the left or right side of the interface 1230 towards the center (as an example of a second user operation), to collapse the interface 1230, the electronic device can respond to the user operation by collapsing the interface 1230 and displaying the interactive panel 1220, that is, collapsing the interface 1230 into the interactive panel 1220.

[0232] Optionally, in one possible implementation, if the interactive panel 1220 was located on the left side of the display screen before being expanded into interface 1230, then after the interface 1230 is collapsed, the interactive panel 1220 is still displayed on the left side of the display screen; if the interactive panel 1220 was located on the right side of the display screen before being expanded into interface 1230, then after the interface 1230 is collapsed, the interactive panel 1220 is still displayed on the right side of the display screen.

[0233] Alternatively, in another possible implementation, when the user closes the interface 1230 of the first application, the electronic device can detect the current usage state. If the current usage state is left-handed operation, the interaction panel 1220 is displayed on the left side of the screen; if the current usage state is right-handed operation, the interaction panel 1220 is displayed on the right side of the screen. For example, if the interaction panel 1220 is located on the right side of the screen, after expanding the interaction panel 1220 into the full-screen interface of the call application and then closing the full-screen interface with the left hand, the interaction panel 1220 will then be displayed on the left side of the screen. This allows the interaction panel to be displayed on the side of the user's current operating hand according to the current usage state of the electronic device, making it easier for the user to operate the interaction panel.

[0234] Optionally, a third threshold can be preset. If the distance the user swipes across interface 1230 reaches the third threshold, the electronic device can vibrate, for example, play a slight vibration, to prompt the user to lift their finger (i.e., end the swipe operation) to prevent interface 1230 from being collapsed. If the user ends the swipe operation at this time, the interface of the call application returns to its original state.

[0235] Optionally, a fourth threshold can be preset. If the distance of the user sliding the interactive panel 1220 reaches the fourth threshold, the interface 1230 of the call application will be collapsed.

[0236] Optionally, after the interface 1330 of the calling application is collapsed, the electronic device can restore the display of the banner notification window 1310 on its screen.

[0237] In some embodiments, a user can interact with the interactive panel through a third-party user operation to collapse the interactive panel into a first control. The first control is used to display (or bring up) the interactive panel; that is, by operating the first control, it can be expanded into an interactive panel. Optionally, the first control can be a floating bar, a floating ball, or other forms of control, which is not limited in this application. The size of the first control can be set to a small size to avoid obscuring other interface elements as much as possible. This process is described through the following scenario three.

[0238] Scenario 3: Taking the banner notification window as an example of the banner notification window corresponding to the call application, describe the process of collapsing the interactive panel into a floating bar, and the process of expanding the floating bar into an interactive panel.

[0239] See Figure 13 In (a), a banner notification window 1310 is displayed at the top of the electronic device's display screen, and an interactive panel 1320 is displayed on the right side of the display screen. When the user presses the interactive panel 1320 and slides it towards the right edge of the display screen (as an example of a third user operation, as shown by the arrow in the figure), the interactive panel 1320 is collapsed into a floating bar 1330.

[0240] Optionally, if the interactive panel 1320 is displayed on the right, the corresponding floating bar 1330 is also displayed on the right, for example, on the right edge of the display screen; if the interactive panel 1320 is displayed on the left, the corresponding floating bar 1330 is also displayed on the left, for example, on the left edge of the display screen.

[0241] Optionally, the floating bar 1330 can be displayed roughly in the center of the screen in the vertical direction to facilitate user operation.

[0242] Optionally, when the interactive panel 1320 is collapsed into a floating bar 1330, the banner notification window 1310 is minimized or collapsed (the figure illustrates this by showing the banner notification window being minimized), for example... Figure 13 In (a) of the above, the banner notification window 1310 is minimized and displayed at the top left of the screen. Optionally, the banner notification window may include some content from the banner notification window 1310, such as an answer button. This implementation minimizes the obstruction of other interface elements by the banner notification window and interactive panel. For example, if a user is watching a video and does not want to be interrupted by new messages, they can collapse the banner notification window and interactive panel using the above operation.

[0243] Optionally, a fifth threshold can be preset. If the distance the user slides on the interface 1330 reaches the fifth threshold, the electronic device can play a vibration, such as a slight vibration, to prompt the user to lift their finger at this time (i.e., end the sliding operation) so that the interactive panel 1320 is not collapsed into a floating bar.

[0244] Optionally, a sixth threshold can be preset. If the distance the user slides the interactive panel 1320 reaches the sixth threshold, the interactive panel 1320 is collapsed into a floating bar 1330.

[0245] In some embodiments, the position of the first control changes as the usage state of the electronic device changes. For example, when the electronic device switches from a left-hand operation state to a right-hand operation state, the first control moves from the left side of the display screen to the right side of the display screen; when the electronic device switches from a right-hand operation state to a left-hand operation state, the first control moves from the right side of the display screen to the left side of the display screen.

[0246] In some embodiments, when the interactive panel is collapsed into a first control, if the electronic device switches from a left-hand operation state or a right-hand operation state to a non-holding state, the first control may remain displayed so that when the user holds or operates the electronic device again, the interactive panel can be expanded through the first control, or the interface of the first application can be expanded through the first control; alternatively, the first control may no longer be displayed.

[0247] In some embodiments, after the interactive panel is collapsed into a first control, the first control can be expanded into an interactive panel through a fourth user operation.

[0248] See Figure 13 In (b), a minimized banner notification window 1310 is displayed at the top of the electronic device, and a floating bar 1330 corresponding to the interactive panel 1320 is displayed on the right side of the screen. When the user slides the floating bar 1330 to the left side of the screen (or towards the center of the screen) (as shown by the arrow in the figure), the interactive panel 1320 is expanded.

[0249] Optionally, when the interactive panel 1320 is expanded, the collapsed banner notification window 1310 can be redisplayed at the top of the display, or the shrunk banner notification window 1310 can be expanded and displayed at the top of the display.

[0250] Optionally, a seventh threshold can be preset. If the distance the user slides the floating bar 1330 reaches the seventh threshold, the electronic device can play a vibration, such as a slight vibration, to prompt the user to lift their finger at this time (i.e., end the sliding operation) so that the floating bar 1330 is not expanded into the interactive panel 1320.

[0251] Optionally, an eighth threshold can be preset. If the distance the user slides the floating bar 1330 reaches the seventh threshold, the floating bar 1330 will be expanded into an interactive panel 1320.

[0252] In some embodiments, when a first control is displayed on the left side of the electronic device's display screen, the first control switches from the left side of the display screen to the right side of the display screen when the electronic device switches from a left-hand operation state to a right-hand operation state; when a first control is displayed on the right side of the electronic device's display screen, the first control switches from the right side of the display screen to the left side of the display screen when the electronic device switches from a right-hand operation state to a left-hand operation state.

[0253] In some embodiments, a user can expand the first control into an interface corresponding to the first application through a fifth user operation. This process is described in the following scenario four.

[0254] Scenario 4: Taking the banner notification window as an example of the banner notification window corresponding to the call application, describe the process of expanding the floating bar into the interface of the call application, and the process of collapsing the window of the call application into the floating bar.

[0255] See Figure 14 In (a), the floating bar 1430 is displayed on the right side of the screen. When the user slides the floating bar 1430 to the left (or towards the center of the screen, as shown by the arrow in the figure), the interface 1440 of the calling application is displayed, that is, the floating bar 1430 is directly expanded into the interface 1440 of the calling application.

[0256] Optionally, when the floating bar 1430 is expanded into the interface 1440 of the calling application, the banner notification window can also be collapsed.

[0257] Optionally, depending on the user's swiping distance, the floating bar may be expanded into an interactive panel or into the interface of a calling application. Specifically, if the swiping distance of the floating bar is large (e.g., exceeding a set threshold), the floating bar can be expanded into the interface of a calling application; if the swiping distance of the floating bar is small (e.g., not exceeding the set threshold), the floating bar can be expanded into an interactive panel.

[0258] In some instances, after an interactive panel or first control is expanded into a window of the first application, it can also be collapsed into a first control via a sixth user action.

[0259] See Figure 14In (b), when a user slides the interface 1440 of the first application, for example, swiping up from the lower left or upper left corner (as an example of the sixth user operation), or swiping from the left or right side of the interface 1440 towards the center (as an example of the sixth user operation), to collapse the interface 1440, the electronic device can respond to the user operation by collapsing the interface 1440 and displaying the floating bar 1430, that is, collapsing the interface 1440 into the floating bar 1430.

[0260] Optionally, in one possible implementation, if the floating bar 1430 was located on the left side of the display screen before being expanded into interface 1440, then after the interface 1440 is collapsed, the floating bar 1430 is still displayed on the left side of the display screen; if the floating bar 1430 was located on the right side of the display screen before being expanded into interface 1440, then after the interface 1440 is collapsed, the floating bar 1430 is still displayed on the right side of the display screen.

[0261] Alternatively, in another possible implementation, when the user closes the interface 1440 of the first application, the electronic device can detect the current usage state. If the current usage state is a left-handed operation state, a floating bar 1430 is displayed on the left side of the display screen; if the current usage state is a right-handed operation state, a floating bar 1430 is displayed on the right side of the display screen. In this way, the floating bar 1430 can be displayed on the side of the user's current interactive hand according to the current usage state of the electronic device, thereby facilitating the user's operation of the floating bar.

[0262] Optionally, a ninth threshold can be preset. If the distance the user slides the interface 1440 reaches the ninth threshold, the electronic device can play a vibration, such as a slight vibration, to prompt the user to lift their finger (i.e., end the sliding operation) so that the interface 1440 is not collapsed.

[0263] Optionally, a tenth threshold can be preset. The tenth threshold is greater than the ninth threshold. If the distance the user slides on the interface 1440 reaches the tenth threshold, the interface 1440 is collapsed into a floating bar 1430.

[0264] Optionally, after the call application interface 1440 is collapsed, the electronic device can restore the banner notification window 1410 on its display screen or display a minimized banner notification window.

[0265] In some embodiments, when the interactive panel conflicts with the second window (i.e., the display area of ​​the interactive panel overlaps with the display area of ​​the second window), the interactive panel can change its display position to avoid overlapping with the second window. For example, if both the second window and the interactive panel are located on the left side of the display and a conflict occurs, the interactive panel is moved below or to the right of the second window; if both the second window and the interactive panel are located on the right side of the display and a conflict occurs, the interactive panel is moved below or to the left of the second window. Optionally, the interactive panel can first move downwards to avoid the second window; if there is insufficient space to move downwards, it can then move towards the center to avoid the second window.

[0266] Optionally, the second window can be a side dock or a volume settings window, etc. The side dock can display icons for one or more applications, such as video application icons, memo application icons, chat application icons, etc. These application icons can be used to open the corresponding application window and float on the electronic device. This application does not limit the scope of the second window.

[0267] See Figure 15 As shown in (a), the electronic device displays an interactive panel 1510 on the right side of its screen. When the electronic device opens the volume setting window 1520 based on user interaction, the display position of the volume setting window 1520 defaults to the right, thus conflicting with the display position of the interactive panel 1510. In this case, since there is sufficient space below the volume setting window 1520 to accommodate the interactive panel 1510, the electronic device moves the interactive panel 1510 downwards to avoid overlapping with the volume setting window 1520.

[0268] like Figure 15 As shown in (b), the electronic device displays an interactive panel 1530 on the left side of its screen. When the electronic device opens (or brings up) the side dock 1540 based on a user operation, the side dock 1540 needs to be displayed on the left side of the screen (for example, the operation of bringing up the side dock is triggered by the user sliding the left edge of the screen), thus conflicting with the display position of the interactive panel 1530. In this case, since there is not enough space below the side dock 1540 to accommodate the interactive panel 1530, the electronic device moves the interactive panel 1530 towards the center, thereby displaying it on one side of the side dock 1540 to avoid overlapping with the side dock 1540.

[0269] In some embodiments, if a second window is displayed on the screen before the electronic device displays the interactive panel, when the electronic device displays the interactive panel, if the interactive panel conflicts with the second window, the second window is closed to avoid overlap between the display panel and the second window; if the interactive panel does not conflict with the second window, the second window does not need to be closed.

[0270] See Figure 16 In (a), a volume setting window 1610 is displayed on the right side of the electronic device's screen. When a call comes in, the electronic device displays a banner notification window 1620. Since the current usage mode of the electronic device is right-handed, the interactive panel needs to be displayed on the right side of the screen, which would cause a conflict with the volume setting window 1610. Therefore, the electronic device closes the volume setting window 1610 and displays the interactive panel 1630 on the right side of the screen.

[0271] See Figure 16 In (b), a side dock 1640 is displayed on the left side of the electronic device's screen. When a call comes in, the electronic device displays a banner notification window 1650. Since the electronic device is currently operated with the right hand, an interactive panel 1660 is displayed on the right side of the screen.

[0272] In other embodiments of this application, when the electronic device receives a new message, a notification window can be displayed on the left or right side of the display screen according to the operating state of the electronic device. That is, in this implementation, a banner notification window is no longer displayed; instead, a notification window is displayed on the left or right side of the display screen according to the operating state of the electronic device. The height of this notification window is greater than its width, therefore it can be called a vertical notification window. In other words, in this implementation, the notification window that would normally be displayed as a banner is transformed into a vertical display, and the display position is related to the usage state of the electronic device. For example, as... Figure 17 As shown, if the electronic device is in left-hand operation mode, a notification window 1710 is displayed on the left side of the screen; if the electronic device is in right-hand operation mode, a notification window 1710 is displayed on the right side of the screen.

[0273] Optionally, the content contained in the vertical notification window is the same as that contained in the horizontal notification window. For example, taking a calling application as an example, if its banner notification window includes answer and hang-up buttons, then the vertical notification window will also include answer and hang-up buttons, for example... Figure 17 In the middle, window 1710 includes an answer button 1711 and a hang-up button 1712.

[0274] In some embodiments, when the electronic device is not held, a banner notification window is displayed when a new message arrives. There can be multiple banner notification windows; that is, when new messages arrive from multiple applications, multiple banner notification windows can be displayed at the top of the display, such as... Figure 18 As shown in (a), the top of the display shows a banner notification window 1801 for the call application and a banner notification window 1802 for the recorder application.

[0275] When a user holds an electronic device and is in a left-handed operating mode (e.g., picking up the device with their left hand), one or more banner notification windows can switch to portrait mode and be displayed on the left side of the screen. Similarly, when a user holds an electronic device and is in a right-handed operating mode (e.g., picking up the device with their right hand), one or more banner notification windows can switch to portrait mode and be displayed on the right side of the screen.

[0276] Optionally, for high-urgency notifications (such as incoming call notifications in a calling application), the banner notification window can be switched to a portrait notification window; for other types of notifications, only the banner notification window can be displayed. Taking a calling application as an example... Figure 18 As shown in (a), when the user picks up the electronic device with their left hand, the banner notification window 1801 corresponding to the call application switches to a vertical format, while the banner notification window 1802 corresponding to the recorder application remains unchanged.

[0277] In some embodiments, when both a banner notification window and a portrait notification window are displayed, if the user slides the banner notification window to the top of the display to collapse it, the banner notification window at the top of the display is collapsed, while the portrait notification window remains unchanged. For example, as Figure 18 As shown in (b), when the user slides the banner notification window 1802 corresponding to the video recorder application upwards to collapse the banner notification window, the banner notification window 1802 is collapsed, while the vertical banner notification window 1801 corresponding to the call application remains unchanged.

[0278] In some embodiments, the methods described above in the embodiments of this application may not be used in certain situations. For example, when a new message arrives, it is not necessary to switch the banner notification window to a portrait notification window and display the portrait notification window according to the usage status of the electronic device; instead, only the banner notification window may be displayed. For example, if the electronic device is being held, the holding posture can determine whether the electronic device is in landscape or portrait mode. If the electronic device is currently in landscape mode and is held with both hands, the methods provided in the embodiments of this application may not be used.

[0279] For example, such as Figure 19As shown in (a), when a user holds the electronic device with one hand and the device is in landscape mode, to facilitate user operation, when an incoming call comes in, the banner notification window is switched to a portrait notification window and displayed on the left side of the screen. Figure 19 As shown in (b), when the user holds the electronic device with both hands and the electronic device is in landscape mode, a banner notification window is displayed at the top of the screen when an incoming call comes in.

[0280] In some embodiments of this application, if a user swipes down from the top of the display screen, a notification center interface can be brought up (displayed), where notification messages from one or more applications can be displayed as a banner notification window. For example, Figure 20 As shown, the display screen shows an interactive panel, floating bar, or vertical notification window corresponding to the calling application. Whenever the electronic device detects a user operation that brings up the notification center interface, the notification center interface will be displayed, which shows a banner notification window of the calling application.

[0281] In some embodiments of this application, users can reply to notifications such as instant messages via an interactive panel, for example, by providing text or voice replies, without needing to open the corresponding application interface, thereby improving the convenience of interactive operations. The following describes... Figure 21 Please provide an explanation.

[0282] like Figure 21 As shown, when the electronic device receives a new instant message, a banner notification window 2110 is displayed at the top of the screen. Since the electronic device is currently in right-hand operation mode, an interactive window 2120 is displayed on the right side of the screen. The content of the instant message is displayed in the interactive panel 2120.

[0283] Optionally, if the message is lengthy (or has a lot of content), a summary of the instant message can be displayed.

[0284] Optionally, if the message content is extensive (or the message is long), the size of the interactive panel can be increased appropriately to display the message content as much as possible.

[0285] When a user presses and holds the interaction panel 2120, the electronic device triggers a voice response. In response to this operation, the electronic device begins capturing voice data. While the interaction panel 2120 is pressed, the electronic device continues to capture voice data. During this process, the electronic device can convert the voice data into text and display it on the interaction panel 2120. The interaction panel 2120 may also display a cancel button 2121 and a back button 2122 (or a clear button). When the user raises their hand and clicks the cancel button 2121, the voice response operation can be canceled. Optionally, after the user cancels the voice response operation, the interaction panel 2120 and the banner notification window 2110 are closed. When the user raises their hand, they can clear part or all of the text displayed on the interaction panel by clicking, repeatedly clicking, or pressing and holding the back button 2122. When the user presses and holds the interaction panel 2120 again, they can continue the voice response.

[0286] Once the user finishes voice input and raises their hand, the electronic device ends voice recording, and the send button 2123 can be displayed on the interaction panel 2120. The user can view the reply content displayed on the interaction panel 2120, and if it is correct, they can send the voice and / or text to the sender of the message by clicking the send button 2123.

[0287] In another possible implementation, the electronic device collects the user's voice while the user is pressing and holding the interactive panel; when the user raises their hand, the electronic device sends the collected voice to the sender of the message.

[0288] It is understood that the above description only takes triggering a voice reply by long-pressing as an example, and the embodiments of this application do not restrict the user operation that triggers a voice reply.

[0289] It is understood that the above example only describes the situation when the electronic device is operated by the right hand. When the electronic device is operated by the left hand, the interaction panel is displayed on the left side of the screen, and the way to implement voice response through the interaction panel is the same as the above example, so it will not be described again.

[0290] It is understood that, in order to achieve the functions in the above embodiments, the network device and terminal device include hardware structures and / or software modules corresponding to perform each function. Those skilled in the art should readily recognize that, based on the units and method steps of the various examples described in conjunction with the embodiments disclosed in this application, this application can be implemented in the form of computer software or hardware, or a combination of hardware and computer software. Whether a function is executed by hardware or by computer software driving hardware depends on the specific application scenario and design constraints of the technical solution.

[0291] Figure 22 and Figure 23This is a schematic diagram of a possible electronic device provided for embodiments of this application. This electronic device can be used to implement the functions described in the method embodiments above, and therefore can also achieve the beneficial effects of the method embodiments described above. In the embodiments of this application, the electronic device can be a device such as a mobile phone or tablet computer, or it can be a module (such as a chip) applied to these devices.

[0292] like Figure 22 As shown, the electronic device 2200 includes a processing unit 2210 and a display unit 2220. The electronic device 2200 is used to implement the above-described... Figure 9 The function of the electronic device in the method embodiment.

[0293] When electronic device 2200 is used to achieve Figure 9 In the method embodiment shown: under the control of the processing unit 2210, the display unit 2220 displays a banner notification window and an interactive panel corresponding to the banner notification window; wherein, if the electronic device is in a left-hand operation state, the interactive panel is displayed on the left side of the display screen; if the electronic device is in a right-hand operation state, the interactive panel is displayed on the right side of the display screen.

[0294] For a more detailed description of the processing unit 2210 and the display unit 2220, please refer to [link / reference needed]. Figure 9 The relevant descriptions in the method embodiments shown are directly obtained and will not be repeated here.

[0295] like Figure 23 As shown, the electronic device 2300 includes a processor 2310 and an interface circuit 2320. The processor 2310 and the interface circuit 2320 are coupled to each other. Optionally, the electronic device 2300 may also include a memory 2330 for storing instructions executed by the processor 2310, or storing input data required by the processor 2310 to execute instructions, or storing data generated after the processor 2310 executes instructions.

[0296] When electronic device 2300 is used to achieve Figure 9 When the method is shown, the processor 2310 is used to implement the functions of the processing unit 2210 described above.

[0297] When the aforementioned electronic device is a chip applied to an electronic device, the chip implements the functions of the electronic device in the above method embodiments. The chip receives information from other modules in the electronic device; or, the chip sends information to other modules in the electronic device.

[0298] It is understood that the processor in the embodiments of this application may be a Central Processing Unit (CPU), or other general-purpose processors, digital signal processors (DSPs), application-specific integrated circuits (ASICs), field-programmable gate arrays (FPGAs), or other programmable logic devices, transistor logic devices, hardware components, or any combination thereof. A general-purpose processor may be a microprocessor or any conventional processor.

[0299] This application provides another example of an electronic device, which includes at least one processor and at least one memory coupled together. The at least one memory stores instructions that, when executed by the at least one processor, cause the electronic device to perform the methods described in the above embodiments. For example, an electronic device including one processor and one memory... Figure 23 As shown, the electronic device 2300 includes a processor 2310 and a memory 2330. The processor 2310 and the memory 2330 are coupled. The memory 2330 stores instructions. When the instructions stored in the memory 2330 are executed by the processor 2310, the electronic device 2300 performs the method of the above embodiment.

[0300] It should be understood that the processor 2310 and the memory 2330 can also be integrated together, for example, integrated into a single chip.

[0301] The method steps in the embodiments of this application can be implemented in hardware or in software instructions executable by a processor. The software instructions can consist of corresponding software modules, which can be stored in random access memory, flash memory, read-only memory, programmable read-only memory, erasable programmable read-only memory, electrically erasable programmable read-only memory, registers, hard disks, portable hard disks, CD-ROMs, or any other form of storage medium known in the art. An exemplary storage medium is coupled to a processor, enabling the processor to read information from and write information to the storage medium. The storage medium can also be a component of the processor. The processor and storage medium can reside in an ASIC. Alternatively, the ASIC can reside in a network device or terminal. The processor and storage medium can also exist as discrete components in a network device or terminal.

[0302] In the above embodiments, implementation can be achieved entirely or partially through software, hardware, firmware, or any combination thereof. When implemented using software, it can be implemented entirely or partially in the form of a computer program product. The computer program product includes one or more computer programs or instructions. When the computer program or instructions are loaded and executed on a computer, the processes or functions described in the embodiments of this application are performed entirely or partially. The computer can be a general-purpose computer, a special-purpose computer, a computer network, a network device, a user equipment, or other programmable device. The computer program or instructions can be stored in a computer-readable storage medium or transferred from one computer-readable storage medium to another. For example, the computer program or instructions can be transferred from one website, computer, server, or data center to another website, computer, server, or data center via wired or wireless means. The computer-readable storage medium can be any available medium that a computer can access or a data storage device such as a server or data center that integrates one or more available media. The available medium can be a magnetic medium, such as a floppy disk, hard disk, or magnetic tape; it can also be an optical medium, such as a digital video optical disc; or it can be a semiconductor medium, such as a solid-state drive. The computer-readable storage medium may be a volatile or non-volatile storage medium, or may include both types of storage media.

[0303] In the various embodiments of this application, unless otherwise specified or in case of logical conflict, the terminology and / or descriptions of different embodiments are consistent and can be referenced by each other. The technical features of different embodiments can be combined to form new embodiments according to their inherent logical relationship.

Claims

1. A display method, characterized in that, Applied to an electronic device having a display screen, the method includes: Display a banner notification window and a corresponding interactive panel for the banner notification window, wherein the interactive panel is used to implement all or part of the functions of the banner notification window; Specifically, if the electronic device is in a left-hand operation mode, the interaction panel is displayed on the left side of the display screen; if the electronic device is in a right-hand operation mode, the interaction panel is displayed on the right side of the display screen.

2. The method as described in claim 1, characterized in that, The banner notification window and the corresponding interactive panel include: Receive a notification from the first application and display the banner notification window corresponding to the first application and the interactive panel.

3. The method according to any one of claims 1-2, characterized in that, The interactive panel displays real-time messages from the first user, and the method further includes: In response to user actions on the interactive panel, obtain the user's input reply information; The reply information is sent to the first user.

4. The method as described in claim 3, characterized in that, The process of obtaining user-inputted response information in response to a user action on the interactive panel includes: In response to a user action performed on the interactive panel and used to trigger a voice response, the user's voice is collected; Sending the reply information to the first user includes: In response to a user's action to end a voice reply, the voice recording is terminated, and the recorded voice is sent back to the first user; or, In response to a user's action to end a voice reply, the voice acquisition is terminated and the text corresponding to the voice is displayed. In response to a user's action to confirm sending, the voice and / or text is sent to the first user.

5. The method according to any one of claims 1-4, characterized in that, The banner notification window is used to display notification information from the first application; the method further includes: Receive a first user operation applied to the interactive panel, the first user operation being used to expand the interactive panel into a window of the first application; In response to the first user action, the banner notification window is collapsed and a first window is displayed, which is the window of the first application.

6. The method as described in claim 5, characterized in that, The first user operation is a swipe operation on the interactive panel; the method further includes: When the sliding distance reaches a first threshold, vibration is played to indicate that if the sliding ends, the interactive panel will not be expanded into a window of the first application.

7. The method according to any one of claims 5-6, characterized in that, The method further includes: Receive a second user operation applied to the first window, the second user operation being used to collapse the first window; In response to the second user action, the first window is collapsed and the interactive panel is displayed; Specifically, if the electronic device is in a left-hand operation mode, the interaction panel is displayed on the left side of the display screen; if the electronic device is in a right-hand operation mode, the interaction panel is displayed on the right side of the display screen.

8. The method as described in claim 7, characterized in that, The second user operation is the operation of sliding the first window; the method further includes: When the sliding distance reaches the third threshold, vibration is played to indicate that if the sliding ends, the first window will remain open.

9. The method according to any one of claims 1-2, characterized in that, Also includes: Receive a third user operation applied to the interactive panel, the third user operation being used to collapse the interactive panel; In response to the third user's operation, the interactive panel is collapsed and a first control corresponding to the interactive panel is displayed, the first control being used to display the interactive panel; Wherein, if the interactive panel is displayed on the left side of the display screen, then the first control is displayed on the left side of the display screen; If the interactive panel is displayed on the right side of the display screen, then the first control is displayed on the right side of the display screen.

10. The method as described in claim 9, characterized in that, Also includes: In response to the third user's action, the banner notification window is minimized or collapsed.

11. The method according to any one of claims 9-10, characterized in that, Also includes: When the electronic device switches from a left-hand operation mode to a right-hand operation mode, the first control switches from the left side of the display screen to the right side of the display screen; or, When the electronic device switches from a right-hand operation mode to a left-hand operation mode, the first control switches from the right side of the display screen to the left side of the display screen.

12. The method according to any one of claims 9-11, characterized in that, Also includes: The system receives a fourth user action applied to the first control, the fourth user action being used to expand the interactive panel. In response to the fourth user action, the interaction panel is displayed; Wherein, if the first control is displayed on the left side of the display screen, the interactive panel is displayed on the left side of the display screen; if the first control is displayed on the right side of the display screen, the interactive panel is displayed on the right side of the display screen.

13. The method as described in claim 12, characterized in that, Also includes: In response to the fourth user action, the collapsed banner notification window is displayed, or the minimized banner notification window is expanded.

14. The method according to any one of claims 8-11, characterized in that, The banner notification window is used to display notification information from the first application; the method further includes: The system receives a fifth user operation applied to the floating bar, the fifth user operation being used to expand the floating bar into a first window; In response to the fifth user action, the banner notification window is collapsed and a first window is displayed, which is the full-screen window of the first application.

15. The method as described in claim 5 or 14, characterized in that, Also includes: Receive a sixth user operation applied to the first window, the sixth user operation being used to collapse the first window; In response to the sixth user operation, the first window is collapsed and the floating bar corresponding to the interactive panel is displayed; Specifically, if the electronic device is operated with the left hand, the floating bar is displayed on the left side of the display screen; if the electronic device is operated with the right hand, the floating bar is displayed on the right side of the display screen.

16. The method according to any one of claims 1-8 and 12-13, characterized in that, Also includes: When the electronic device switches from left-hand operation mode to right-hand operation mode, the interaction panel switches from the left side of the display screen to the right side of the display screen; or, When the electronic device switches from a right-hand operation mode to a left-hand operation mode, the interaction panel switches from the right side of the display screen to the left side of the display screen.

17. The method according to any one of claims 1-8, 12-13, and 16, characterized in that, Also includes: When the electronic device switches from a left-hand operation mode or a right-hand operation mode to a non-grip mode, the interaction panel is retracted.

18. The method according to any one of claims 1-17, characterized in that, After displaying the interactive panel, it also includes: Display a second window; If the second window and the display panel are located on the left side of the display screen, then the display panel is moved to the bottom of the second window or to the right side of the second window; If the second window and the display panel are located on the right side of the display screen, then the display panel is moved below the second window or to the left side of the second window.

19. The method according to any one of claims 1-18, characterized in that, Before the interactive panel is displayed, a second window is displayed on the screen; Before displaying the interactive panel, the following are also included: If the second window is displayed on the left side of the display and the electronic device is in a left-hand operation mode, then the second window is closed. If the second window is displayed on the right side of the display and the electronic device is in a right-hand operation mode, then the second window is closed.

20. The method according to any one of claims 1-19, characterized in that, The banner notification window is dimmed.

21. The method according to any one of claims 1-20, characterized in that, The banner notification window and the interactive panel each include a first control, which is used to perform a first processing operation in response to user operation.

22. The method as described in claim 21, characterized in that, The banner notification window is a telephone call notification window, and the first control includes an answer button and / or a hang-up button.

23. The method according to any one of claims 1-22, characterized in that, Also includes: Detect the holding hand and the interacting hand; The usage status of the electronic device is determined based on the detected gripping hand and interacting hand; The detection gripping hand includes: The gripping hand is determined based on the detection data from the inertial measurement unit in the electronic device.

24. The method according to any one of claims 1-23, characterized in that, The banner notification window and the corresponding interactive panel include: When the electronic device is held, the banner notification window and the corresponding interactive panel are displayed.

25. The method as described in claim 24, characterized in that, Also includes: When the electronic device is not in a handheld state, the banner notification window is displayed, but the corresponding interactive panel is not displayed.

26. An electronic device, characterized in that, Includes units or modules for performing the method as described in any one of claims 1-25.

27. An electronic device, characterized in that, include: One or more processors are configured to perform the method as described in any one of claims 1-25.

28. A readable storage medium, characterized in that, The readable storage medium stores a program or instructions that, when executed on an electronic device, cause the electronic device to perform the method as described in any one of claims 1-25.

29. A chip system, characterized in that, Includes a processor for enabling electronic devices to implement the method as described in any one of claims 1-25.

30. A program product, characterized in that, The program product includes a program; when the program is run on a computer, it causes the computer to perform the method as described in any one of claims 1-25.

Images