Systems, devices and methods for dynamically providing user interface controls on a touch-sensitive secondary display - Patents.com
Patent Information
- Application Number
- JP2023184930
- Authority / Receiving Office
- JP · JP
- Patent Type
- Patents
- Current Assignee / Owner
- Priority Date
- 2016-10-25
- Filing Date
- 2023-10-27
- Publication Date
- 2025-02-14
- Estimated Expiration
- 2037-07-13
Smart Images

Figure 0007629969000001 
Figure 0007629969000002 
Figure 0007629969000003
Abstract
Description
[Technical Field]
[0001] The disclosed embodiments relate to keyboards, and more particularly to improved techniques for receiving input via dynamic input / output (I / O) devices. [Background technology]
[0002] Existing keyboards include any number of physical keys for inputting information (e.g., characters) into a computing device. Typically, a user presses or otherwise movably activates a key to provide input corresponding to the key. In addition to providing character input, a keyboard may also include movably activated keys associated with function input. For example, a keyboard may include an "escape" or "esc" key to allow a user to activate an escape or exit function. In many keyboards, a set of function keys for function input is arranged in a "function row." Typically, a set of alphanumeric keys is located in a portion of the keyboard closest to the user, and a function row is located adjacent to the alphanumeric keys and further away from the user. A keyboard may also include function keys that are not part of the function row described above.
[0003] With the advent and popularity of portable computing devices such as laptop computers, the area consumed by a dedicated keyboard may be limited by the corresponding size of the display. Compared to an external keyboard for a desktop computer, a dedicated keyboard that is a component of a portable computing device may have fewer keys, smaller keys, or keys that are closer together to allow for the smaller overall size of the portable computing device.
[0004] Existing dedicated keyboards are static and fixed in time, despite changes in the display. Furthermore, the functionality of software applications displayed on the screen is typically accessed through toolbars and menus that the user interacts with using a mouse. This requires the user to periodically switch modes and relocate their hands between the keyboard and mouse. Alternatively, application functionality is accessed through complex key combinations that require memorization and practice. Therefore, it is desirable to provide an I / O device (and method for an I / O device) that addresses the shortcomings of existing systems. Summary of the Invention
[0005] The embodiments described herein address the above shortcomings by providing dynamic and space-efficient I / O devices and methods. Such devices and methods optionally complement or replace existing input devices and methods. Such devices and methods also reduce the amount of mode switching required from the user (e.g., moving one's hands between the keyboard and mouse and one's eyes from the keyboard to the display), thereby reducing the number of inputs required to activate a desired function (e.g., reducing the number of inputs required to select a menu option, as described in more detail below). Such devices and methods also make more information available on a limited screen (e.g., a touch-sensitive secondary display is used to provide more information to the user, and this information is presented efficiently using limited screen space). Such devices and methods also provide improved human-machine interfaces, for example, by providing highlighting effects that make information more distinguishable on the touch-sensitive secondary display 104, by providing sustained interaction so that successive inputs from the user directed at either the touch-sensitive secondary display or the primary display cause the device to provide an output that is then used to prompt further input from the user (e.g., as described below, a color picker is provided that allows a user to quickly preview how information will be rendered on the primary display by providing input on the touch-sensitive secondary display), and by requiring less interaction from the user to achieve a desired result (e.g., allowing a user to log in to their device using a single biometric input, as described below). For these reasons and those described below, the devices and methods described herein reduce power usage and improve battery life of electronic devices.
[0006] (A1) According to some embodiments, a method is performed in a computing system (e.g., computing system 100 or system 200, FIGS. 1A-2D ) that includes one or more processors, memory, a first housing that includes a primary display (e.g., housing 110 that includes display 102 or housing 204 that includes display 102), and a second housing that at least partially includes a physical keyboard (e.g., keyboard 106, FIG. 1A ) and a touch-sensitive secondary display (e.g., dynamic function row 104, FIG. 1A , also referred to as a “touchscreen display”). In some embodiments, the touch-sensitive secondary display is separate from the physical keyboard (e.g., the touch-sensitive secondary display is included as part of external input mechanism 222 (i.e., a standalone display) or the touch-sensitive display is integrated with another device, such as touchpad 108, FIG. 2C ). The method includes displaying a first user interface on a primary display, the first user interface comprising one or more user interface elements; identifying an active user interface element from the one or more user interface elements that has focus on the primary display; determining whether the active user interface element that has focus on the primary display is associated with an application executed by the computing system; and, in accordance with a determination that the active user interface element that has focus on the primary display is associated with the application executed by the computing system, displaying a second user interface on the touchscreen display that includes (A) a first set of one or more affordances corresponding to the application and (B) at least one system-level affordance corresponding to at least one system-level function.
[0007] Displaying application-specific system-level affordances in the touch-sensitive secondary display in response to a change of focus made on the primary display provides the user with accessible affordances that are directly available via the touch-sensitive secondary display. Providing the user with accessible affordances that are directly accessible via the touch-sensitive secondary display improves the operability of the computing system (e.g., by helping the user access desired functionality directly through the touch-sensitive secondary display with fewer interactions and without having to waste time navigating hierarchical menus to find the desired functionality) and makes the user device interface more efficient, thereby further reducing device power usage and improving battery life by allowing the user to access desired functionality more quickly and efficiently. Similarly, displaying application-specific affordances on the touch-sensitive secondary display indicates the internal state of the device by providing affordances associated with the application that is currently in focus on the primary display.
[0008] (A2) In some embodiments of the method of A1, the computing system further comprises: (i) a primary computing device comprising a primary display, a processor, a memory, and primary computing device communication circuitry; and (ii) an input device comprising a housing, a touchscreen display, a physical input mechanism, and input device communication circuitry in communication with the primary computing device communication circuitry, wherein the input device is separate and distinct from the primary computing device.
[0009] (A3) In some embodiments of any one of the methods A1-A2, the physical input mechanism comprises a plurality of physical keys.
[0010] (A4) In some embodiments of any one of the methods A1-A3, the physical input mechanism comprises a touchpad.
[0011] (A5) In some embodiments of any one of the methods A1-A4, the application is executed by the processor in the foreground of the first user interface.
[0012] (A6) In some embodiments of any one of the methods of A1-A5, the at least one system-level affordance is configured to, when selected, cause the display of a plurality of system-level affordances corresponding to the system-level functions on the touchscreen display.
[0013] (A7) In some embodiments of at least one of the methods of A1-A3, the at least one system level affordance corresponds to one of a power control or an escape control.
[0014] (A8) In some embodiments of any one of the methods of A1-A7, at least one of the affordances displayed on the second user interface is a multi-function affordance.
[0015] (A9) In some embodiments of the method of A8, the method further includes detecting a user touch input selecting a multi-function affordance, and performing a first function associated with the multi-function affordance in accordance with a determination that the user touch input corresponds to a first type, and performing a second function associated with the multi-function affordance in accordance with a determination that the user touch input corresponds to a second type distinct from the first type.
[0016] (A10) In some embodiments of any one of the methods of A1-A9, the method further includes, in accordance with a determination that the active user interface element is not associated with an application executed by the computing system, (C) displaying a third user interface on the touchscreen display, the third user interface including a second set of one or more affordances corresponding to operating system controls of the computing system, the second set of one or more affordances being separate from the first set of one or more affordances.
[0017] (A11) In some embodiments of the method of A10, the second set of one or more affordances is (B) an expanded set of operating system controls that includes at least one system-level affordance corresponding to at least one system-level function.
[0018] (A12) In some embodiments of the methods of any one of A1-A11, the method further includes detecting user touch input selecting one of the first set of affordances, and in response to detecting the user touch input, displaying a different set of affordances corresponding to functionality of the application, and maintaining display of at least one system-level affordance.
[0019] (A13) In some embodiments of the method of A12, the method further includes detecting a subsequent user touch input selecting at least one system-level affordance, and in response to detecting the subsequent user touch input, displaying a plurality of system-level affordances corresponding to system-level functions and at least one application-level affordance corresponding to the application.
[0020] (A14) In some embodiments of any one of the methods of A1-A13, the method further includes, after displaying the second user interface on the touchscreen display, identifying a second active user interface element among the one or more user interface elements that has focus on the primary display, determining whether the second active user interface element corresponds to a different application executed by the computing device, and, in accordance with a determination that the second active user interface element corresponds to the different application, displaying a fourth user interface on the touchscreen display, the fourth user interface including (D) a third set of one or more affordances corresponding to the different application, and (E) at least one system-level affordance corresponding to at least one system-level function.
[0021] (A15) In some embodiments of any one of the methods of A1-A14, the method further includes, after identifying the second active user interface element, determining whether the media item is being played by the computing system, where the media item is not associated with a different application, and displaying at least one persistent affordance on the touchscreen display for controlling the media item in accordance with a determination that the media item is being played by the computing system.
[0022] (A16) In some embodiments of the method of A15, the at least one persistent affordance displays feedback corresponding to the media item.
[0023] (A17) In some embodiments of the methods of any one of A1-A16, the method further includes detecting a user input corresponding to an override key, and in response to detecting the user input, ceasing to display at least a first set of one or more affordances of the second user interface on the touch screen display, and displaying a first set of default function keys.
[0024] (A18) In some embodiments of the method of A17, the method further includes, after displaying the first set of default function keys, detecting a swipe gesture on the touch screen display in a direction that is generally parallel to a major axis of the touch screen display, and displaying a second set of default function keys having at least one distinct function key in response to detecting the swipe gesture.
[0025] (A19) In another aspect, a computing system is provided, the computing system including one or more processors, a memory, a first housing including a primary display, and a second housing at least partially including a physical keyboard and a touch-sensitive secondary display. One or more programs are stored in the memory and configured for execution by the one or more processors, the one or more programs including instructions that perform or cause the execution of any one of the methods of A1-A18.
[0026] (A20) In an additional aspect, a non-transitory computer-readable storage medium is provided having stored thereon one or more programs, the one or more programs including instructions that, when executed by one or more processors of a computing system having a memory, a first housing including a primary display, and a second housing including, at least in part, a physical keyboard and a touch-sensitive secondary display separate from the primary display, cause the computing system to perform or cause the performance of any one of the methods of A1-A18.
[0027] (A21) In a further aspect, a graphical user interface on a computing system having one or more processors, a memory, a first housing including a primary display, and a second housing including at least in part a physical input mechanism and a touch-sensitive secondary display separate from the primary display, the graphical user interface comprising a user interface displayed according to any of the methods of claims A1-A18.
[0028] (A22) In another aspect, a computing device is provided, the computing device including a first housing including a primary display, a second housing including at least in part a physical keyboard and a touch-sensitive secondary display separate from the primary display, and means for performing or causing the performance of any of the methods of claims A1-A18.
[0029] (B1) According to some embodiments, an input device is provided, the input device including a housing at least partially enclosing a plurality of components, the plurality of components including: (i) a plurality of physical keys (e.g., on keyboard 106, FIG. 1A ), the plurality of physical keys including at least a separate key for each letter of an alphabet, (ii) a touch-sensitive secondary display (also referred to as a “touchscreen display”) disposed adjacent to the plurality of physical keys, and (iii) short-range communications circuitry configured to communicate with a computing device (e.g., computing system 100 or 200) disposed adjacent to the input device, the computing device including a computing device display, a processor, and memory, the short-range communications circuitry configured to transmit key presses of any of the plurality of physical keys and touch inputs on the touchscreen display to the computing device and to receive instructions to change a display of affordances on the touchscreen display based on a current focus on the computing device display. In some embodiments, when an application has focus on the computing device display, the touchscreen display is configured to display (A) one or more affordances corresponding to the application in focus and (B) at least one system-level affordance, the at least one system-level affordance configured, when selected, to cause the display of multiple affordances corresponding to system-level functions.
[0030] Displaying application-specific system-level affordances in the touch-sensitive secondary display in response to focus changes made on the primary display provides the user with accessible affordances that are directly available via the touch-sensitive secondary display. Providing the user with accessible affordances that are directly accessible via the touch-sensitive secondary display improves the operability of the computing system (e.g., by helping the user access desired functionality directly through the touch-sensitive secondary display with fewer interactions and without having to waste time navigating hierarchical menus to find the functionality they need) and makes the user device interface more efficient, thereby further reducing device power usage and improving battery life by allowing the user to access desired functionality more quickly and efficiently. Furthermore, by dynamically updating the affordances displayed in the touch-sensitive secondary display based on focus changes in the primary display, the touch-sensitive secondary display can make more information available on a limited screen and helps ensure that desired options are provided to the user when they are needed (thereby reducing power usage and extending battery life because the user does not have to waste power and battery life searching through hierarchical menus to locate these desired options).
[0031] (B2) In some embodiments of the input device of B1, when an application has focus on the computing device display, the touchscreen display is further configured to display at least one of a power control affordance and an escape affordance.
[0032] (B3) In some embodiments of the input device of any one of B1 to B2, the input device is a keyboard.
[0033] (B4) In some embodiments of the input device of B3, the computing device is a laptop computer that includes a keyboard.
[0034] (B5) In some embodiments of the input device of B3, the computing device is a desktop computer and the keyboard is separate from the desktop computer.
[0035] (B6) In some embodiments of the input device of any one of B1-B5, the input device is integrated in a laptop computer.
[0036] (B7) In some embodiments of the input device of any one of B1 to B6, the plurality of physical keys comprises a QWERTY keyboard.
[0037] (B8) In some embodiments of the input device of any one of B1 to B7, the alphabet corresponds to the Latin alphabet.
[0038] (B9) In some embodiments of the input device of any one of B1-B8, the input device includes a touchpad.
[0039] (B10) In some embodiments of the input device of any one of B1-B9, the input device has a major dimension that is at least 18 inches (45.72 cm) in length.
[0040] (B11) In some embodiments of the input device of any one of B1-B10, the short-range communications circuitry is configured to communicate to the computing device less than 15 feet (4.572 m).
[0041] (B12) In some embodiments of the input device of any one of B1-B11, the short-range communications circuitry supports a wired or wireless connection to a computing device.
[0042] (B13) In some embodiments of the input device of any one of B1-B12, the input device includes a fingerprint sensor embedded in the touchscreen display.
[0043] (C1) According to some embodiments, a method is performed in a computing system (e.g., system 100 or system 200, FIGS. 1A-2D ) that includes one or more processors, memory, a first housing that includes a primary display (e.g., housing 110 that includes display 102 or housing 204 that includes display 102), and a second housing that at least partially includes a physical keyboard (e.g., keyboard 106, FIG. 1A ) and a touch-sensitive secondary display (e.g., dynamic function row 104, FIG. 1A , also referred to as a “touchscreen display”). In some embodiments, the touch-sensitive secondary display is separate from the physical keyboard (e.g., the touch-sensitive secondary display is a standalone display 222 or the touch-sensitive display is integrated with another device, such as touchpad 108, FIG. 2C ).The method includes displaying a first user interface on the primary display for an application executed by the computing system; displaying a second user interface on the touchscreen display, the second user interface comprising a first set of one or more affordances corresponding to the application, the first set of one or more affordances corresponding to a first portion of the application; detecting a swipe gesture on the touchscreen display; and displaying a second set of one or more affordances corresponding to the application on the touchscreen display according to a determination that the swipe gesture was performed in a first direction. wherein at least one affordance in the second set of one or more affordances is distinct from the first set of one or more affordances, the second set of one or more affordances also corresponding to a first portion of the application; and displaying a third set of one or more affordances corresponding to the application on the touch screen display in accordance with determining that the swipe gesture has been performed in a second direction substantially perpendicular to the first direction, wherein the third set of one or more affordances is distinct from the second set of one or more affordances, and the third set of one or more affordances corresponds to a second portion of the application that is distinct from the first portion of the application.
[0044] Enabling a user to quickly navigate application-specific affordances in the touch-sensitive secondary display in response to a swipe gesture provides a user with a convenient way to scroll through and quickly locate a desired function via the touch-sensitive secondary display. Providing a user with a convenient way to scroll through and quickly locate a desired function via the touch-sensitive secondary display improves the operability of the computing system (e.g., by helping a user access desired functions directly through the touch-sensitive secondary display with fewer interactions and without having to waste time navigating hierarchical menus to find the desired function) and makes the user device interface more efficient, which in turn reduces device power usage and improves battery life by allowing a user to access desired functions more quickly and efficiently. Additionally, by dynamically updating the affordances displayed in the touch-sensitive secondary display in response to swipe gestures on the secondary display, the secondary display can make more information available on a limited screen, helping to ensure that desired options are provided to the user when they are needed (thereby reducing power usage and extending battery life because the user does not have to waste power and battery life searching through hierarchical menus to locate these desired options).
[0045] (C2) In some embodiments of the method of C1, the second portion is displayed on the primary display in a compact view within the first user interface prior to detecting the swipe gesture, and the method includes displaying the second portion on the primary display in an expanded view within the first user interface pursuant to a determination that the swipe gesture was performed in a second direction that is approximately perpendicular to the first direction.
[0046] (C3) In some embodiments of the method of C1, a first user interface for an application executed by the computing system is displayed on the primary display in full-screen mode, and a first set of one or more affordances displayed on the touchscreen display includes controls corresponding to the full-screen mode.
[0047] (C4) In some embodiments of any one of the methods of C1-C3, the second set of one or more affordances and the third set of one or more affordances include at least one system-level affordance corresponding to at least one system-level function.
[0048] (C5) In some embodiments of any one of the methods of C1-C4, the method includes detecting user input selecting a first portion on the first user interface after displaying a third set of one or more affordances on the touchscreen display; and in response to detecting the user input, ceasing to display the third set of one or more affordances on the touchscreen display, wherein the third set of one or more affordances corresponds to a second portion of the application; and displaying a second set of one or more affordances, wherein the second set of one or more affordances corresponds to the first portion of the application.
[0049] (C6) In some embodiments of the methods of any one of C1-C5, the first direction is generally parallel to a major dimension of the touch screen display.
[0050] (C7) In some embodiments of the methods of any one of C1-C5, the first direction is approximately perpendicular to a major dimension of the touch screen display.
[0051] (C8) In some embodiments of any one of methods C1 to C7, the first part is one of a menu, tab, folder, toolset, or toolbar of the application, and the second part is one of a menu, tab, folder, toolset, or toolbar of the application.
[0052] (C9) In another aspect, a computing system is provided, the computing system including one or more processors, a memory, a first housing including a primary display, and a second housing at least partially including a physical keyboard and a touch-sensitive secondary display. One or more programs are stored in the memory and configured for execution by the one or more processors, the one or more programs including instructions that perform or cause the execution of any one of the methods of C1-C8.
[0053] (C10) In an additional aspect, a non-transitory computer-readable storage medium is provided having stored thereon one or more programs, the one or more programs including instructions that, when executed by one or more processors of a computing system having a memory, a first housing including a primary display, and a second housing including at least in part a physical keyboard and a touch-sensitive secondary display separate from the primary display, cause the computing system to perform or cause the performance of any one of the methods of C1-C8.
[0054] (C11) In a further aspect, a graphical user interface on a computing system having one or more processors, a memory, a first housing including a primary display, and a second housing including at least in part a physical input mechanism and a touch-sensitive secondary display separate from the primary display, the graphical user interface comprising a user interface displayed according to any of the methods of claims C1-C8.
[0055] (C12) In another aspect, a computing device is provided, the computing device including a first housing including a primary display, a second housing including at least in part a physical keyboard and a touch-sensitive secondary display separate from the primary display, and means for performing or causing the performance of any of the methods of claims C1-C8.
[0056] (D1) According to some embodiments, a method for maintaining application functionality while in full-screen mode is performed in a computing system (e.g., system 100 or system 200, FIGS. 1A-2D ) including one or more processors, memory, a first housing including a primary display (e.g., housing 110 including display 102 or housing 204 including display 102), and a second housing at least partially including a physical keyboard (e.g., keyboard 106, FIG. 1A ) and a touch-sensitive secondary display (e.g., dynamic function row 104, FIG. 1A , also referred to as a “touchscreen display”). In some embodiments, the touch-sensitive secondary display is separate from the physical keyboard (e.g., the touch-sensitive secondary display is a standalone display 222 or the touch-sensitive display is integrated with another device, such as touchpad 108, FIG. 2C ). The method includes displaying a first user interface for an application executed by the computing system on a primary display in a normal mode, the first user interface comprising a first set of one or more affordances associated with the application; detecting a user input that displays at least a portion of the first user interface for the application in a full-screen mode on the primary display; in response to detecting the user input, ceasing to display the first set of one or more affordances associated with the application in the first user interface on the primary display; displaying the portion of the first user interface for the application on the primary display in the full-screen mode; and automatically, without human intervention, displaying a second set of one or more affordances for controlling the application on the touchscreen display, the second set of one or more affordances corresponding to the first set of one or more affordances.
[0057] Providing affordances for controlling an application via the touch-sensitive secondary display while portions of the application are displayed in full-screen mode on the primary display allows a user to continue to access functionality that may no longer be directly displayed on the primary display. Enabling a user to continue to access functionality that may no longer be directly displayed on the primary display provides the user with a quick and convenient way to access functionality that may have been buried on the primary display, thereby improving the operability of the computing system (e.g., by helping the user access desired functionality directly through the touch-sensitive secondary display with fewer interactions and without having to waste time navigating hierarchical menus to find the desired functionality) and making the user device interface more efficient, which in turn reduces device power usage and improves battery life by allowing users to access desired functionality more quickly and efficiently. Thus, by shifting menu options from the primary display to the touch-sensitive secondary display to ensure that content can be presented in full-screen mode (without obstruction), users can continue to interact with the device, and their workflow is not interrupted when shifting to full-screen mode. Furthermore, because menu options that might otherwise be buried behind content on the primary display are presented on the touch-sensitive secondary display for easy and quick access (and without the need to exit full-screen mode and then hunt around for menu options), less interaction is required to access menu options while viewing full-screen content, thereby reducing the device's power usage and improving battery life.
[0058] (D2) In some embodiments of the method of D1, the second set of one or more affordances is the first set of one or more affordances.
[0059] (D3) In some embodiments of any one of the methods D1-D2, the second set of one or more affordances includes a control corresponding to a full-screen mode.
[0060] (D4) In some embodiments of any one of methods D1-D3, the method includes detecting a user touch input selecting one of a second set of affordances displayed on the touchscreen display, and in response to detecting the user touch input, modifying a portion of a first user interface for the application displayed in full-screen mode on the primary display according to the selected one of the second set of affordances.
[0061] (D5) In some embodiments of any one of methods D1-D4, the method includes: after displaying a portion of a first user interface for the application in full-screen mode on the primary display, detecting a subsequent user input to exit the full-screen mode; and in response to detecting the subsequent user input, displaying a first user interface for the application executed by the computing system on the primary display in normal mode, the first user interface comprising a first set of one or more affordances associated with the application; and maintaining display of at least a subset of a second set of one or more affordances for controlling the application on the touchscreen display, the second set of one or more affordances corresponding to the first set of one or more affordances.
[0062] (D6) In some embodiments of any one of methods D1-D5, the user input that displays at least a portion of the first user interface for the application in full screen mode on the primary display is at least one of a touch input detected on the touchscreen display and a control selected within the first user interface on the primary display.
[0063] (D7) In some embodiments of any one of methods D1-D6, the second set of one or more affordances includes at least one system-level affordance corresponding to at least one system-level function.
[0064] (D8) In another aspect, a computing system is provided, the computing system including one or more processors, a memory, a first housing including a primary display, and a second housing including at least a physical keyboard and a touch-sensitive secondary display. One or more programs are stored in the memory and configured for execution by the one or more processors, the one or more programs including instructions that perform or cause the execution of any one of the methods of D1-D7.
[0065] (D9) In an additional aspect, a non-transitory computer-readable storage medium is provided having stored thereon one or more programs, the one or more programs including instructions that, when executed by one or more processors of a computing system having a memory, a first housing including a primary display, and a second housing including, at least in part, a physical keyboard and a touch-sensitive secondary display separate from the primary display, cause the computing system to perform or cause the performance of any one of the methods of D1-D7.
[0066] (D10) In a further aspect, a graphical user interface on a computing system having one or more processors, a memory, a first housing including a primary display, and a second housing including at least in part a physical input mechanism and a touch-sensitive secondary display separate from the primary display, the graphical user interface comprising a user interface displayed according to any of the methods of claims D1-D7.
[0067] (D11) In another aspect, a computing device is provided, the computing device including a first housing including a primary display, a second housing including at least in part a physical keyboard and a touch-sensitive secondary display separate from the primary display, and means for performing or causing the performance of any of the methods of claims D1-D7.
[0068] (E1) According to some embodiments, a method is performed in a computing system (e.g., system 100 or system 200, FIGS. 1A-2D ) that includes one or more processors, memory, a first housing that includes a primary display (e.g., housing 110 that includes display 102 or housing 204 that includes display 102), and a second housing that at least partially includes a physical keyboard (e.g., keyboard 106, FIG. 1A ) and a touch-sensitive secondary display (e.g., dynamic function row 104, FIG. 1A , also referred to as a “touchscreen display”). In some embodiments, the touch-sensitive secondary display is separate from the physical keyboard (e.g., the touch-sensitive secondary display is a standalone display 222 or the touch-sensitive display is integrated with another device, such as touchpad 108, FIG. 2C ). The method includes displaying a first user interface for an application executed by the computing system on a primary display; displaying a second user interface on a touchscreen display, the second user interface comprising a set of one or more affordances corresponding to the application; detecting a notification; and in response to detecting the notification, simultaneously displaying on the touchscreen display the set of one or more affordances corresponding to the application and at least a portion of the detected notification in the second user interface, wherein the detected notification is not displayed on the primary display.
[0069] Displaying received notifications on the touch-sensitive secondary display allows users to continue their work on the primary display in an uninterrupted manner and allows them to interact with the received notifications via the touch-sensitive secondary display. Enabling users to continue their work on the primary display in an uninterrupted manner and allowing users to interact with received notifications via the touch-sensitive secondary display provides users with a quick and convenient way to review and interact with received notifications, thereby improving the operability of the computing system and making the user device interface more efficient (e.g., by helping users conveniently access received notifications directly through the touch-sensitive secondary display and without having to interrupt their workflow to handle the received notifications). Furthermore, displaying received notifications on the touch-sensitive secondary display provides a highlighting effect to the received notifications on the touch-sensitive secondary display because the received notifications, in some embodiments, are displayed superimposed on other affordances in the touch-sensitive secondary display, thus ensuring that the received notifications are visible and easily accessible on the touch-sensitive secondary display.
[0070] (E2) In some embodiments of the method of E1, the method includes, prior to detecting the notification, detecting user input selecting a notification setting to display notifications on the touchscreen display but not on the primary display.
[0071] (E3) In some embodiments of any one of methods E1-E2, the method includes detecting a user touch input on the touchscreen display corresponding to a portion of the detected notification; ceasing to display the portion of the detected notification on the touchscreen display in the second user interface in accordance with a determination that the user touch input corresponds to a first type; and performing an action associated with the detected notification in accordance with a determination that the user touch input corresponds to a second type distinct from the first type.
[0072] (E4) In some embodiments of any one of methods E1-E3, the portion of the notification displayed on the touchscreen display prompts a user of the computing system to select one of a plurality of options for responding to the detected notification.
[0073] (E5) In some embodiments of any one of the methods E1-E4, the portion of the notification displayed on the touchscreen display includes one or more suggested responses to the detected notification.
[0074] (E6) In some embodiments of the methods of any one of E1-E5, the notification corresponds to at least one of an incoming instant message, an SMS, an email, a voice call, or a video call.
[0075] (E6) In some embodiments of any one of methods E1-E5, the notification corresponds to a modal alert issued by an application being executed by a processor of the computing system in response to user input closing the application or performing an action within the application.
[0076] (E7) In some embodiments of any one of methods E1-E7, the set of one or more affordances includes at least one system-level affordance corresponding to at least one system-level function, and the notification corresponds to one or more portions of the input mechanism or user input selecting at least one of the system-level affordances.
[0077] (E8) In another aspect, a computing system is provided, the computing system including one or more processors, a memory, a first housing including a primary display, and a second housing at least partially including a physical keyboard and a touch-sensitive secondary display. One or more programs are stored in the memory and configured for execution by the one or more processors, the one or more programs including instructions that perform or cause the execution of any one of the methods of E1-E7.
[0078] (E9) In an additional aspect, a non-transitory computer-readable storage medium is provided having stored thereon one or more programs, the one or more programs including instructions that, when executed by one or more processors of a computing system having a memory, a first housing including a primary display, and a second housing including, at least in part, a physical keyboard and a touch-sensitive secondary display separate from the primary display, cause the computing system to perform or cause the performance of any one of the methods of E1-E7.
[0079] (E10) In a further aspect, a graphical user interface on a computing system having one or more processors, a memory, a first housing including a primary display, and a second housing including at least in part a physical input mechanism and a touch-sensitive secondary display separate from the primary display, the graphical user interface comprising a user interface displayed according to any of the methods of claims E1-E7.
[0080] (E11) In another aspect, a computing device is provided, the computing device including a first housing including a primary display, a second housing including at least in part a physical keyboard and a touch-sensitive secondary display separate from the primary display, and means for performing or causing the performance of any of the methods of claims E1-E7.
[0081] (F1) According to some embodiments, a method for moving a user interface portion is performed in a computing system (e.g., system 100 or system 200, FIGS. 1A-2D) including one or more processors, memory, a first housing including a primary display (e.g., housing 110 including display 102 or housing 204 including display 102), and a second housing at least partially including a physical keyboard (e.g., keyboard 106, FIG. 1A) and a touch-sensitive secondary display (e.g., dynamic function row 104, FIG. 1A). In some embodiments, the touch-sensitive secondary display is separate from the physical keyboard (e.g., the touch-sensitive secondary display is a standalone display 222 or the touch-sensitive display is integrated with another device, such as touchpad 108, FIG. 2C). The method includes displaying a user interface on a primary display, the user interface comprising one or more user interface elements; identifying an active user interface element from the one or more user interface elements that has focus on the primary display, the active user interface element being associated with an application executed by the computing system; in response to identifying the active user interface element, displaying a set of one or more affordances corresponding to the application on the touchscreen display; detecting user input moving through respective portions of the user interface; in response to detecting the user input and in accordance with a determination that the user input satisfies predefined action criteria, ceasing to display at least a subset of the set of one or more affordances on the touchscreen display; and displaying a representation of the respective portions of the user interface on the touchscreen display.
[0082] Enabling a user to quickly move user interface portions (e.g., menus, notifications, etc.) from the primary display to the touch-sensitive secondary display provides the user with a convenient and customized way to access user interface portions. Providing a user with a convenient and customized way to access user interface portions via the touch-sensitive secondary display improves the operability of a computing system (e.g., by helping the user access user interface portions directly through the touch-sensitive secondary display with fewer interactions and without having to waste time searching for previously viewed (possibly buried) user interface portions) and makes the user device interface more efficient, thereby further reducing device power usage and improving battery life by allowing the user to access needed user interface portions more quickly and efficiently. Furthermore, displaying user interface portions on the touch-sensitive secondary display in response to user input provides a highlighting effect to the user interface portions on the touch-sensitive secondary display, as each user interface portion, in some embodiments, is displayed as overlaid on other affordances in the touch-sensitive secondary display, thus ensuring that each user interface portion is visible and easily accessible on the touch-sensitive secondary display.
[0083] (F2) In some embodiments of the method of F1, each portion of the user interface is a menu corresponding to an application executed by the computing system.
[0084] (F3) In some embodiments of any one of the methods F1-F2, the respective portion of the user interface is one of a notification and a mode alert.
[0085] (F4) In some embodiments of any one of methods F1-F3, the predefined action criteria is satisfied when the user input is a dragging gesture that drags a respective portion of the user interface to a predefined location on the primary display.
[0086] (F5) In some embodiments of any one of methods F1-F3, the predefined action criteria is satisfied when the user input is a predetermined input corresponding to moving a respective portion of the user interface to the touchscreen display.
[0087] (F6) In some embodiments of any one of the methods of F1-F5, the method includes, in response to detecting a user input and in accordance with a determination that the user input does not satisfy predefined action criteria, maintaining display of a respective portion of the user interface on the primary display and maintaining display of a set of one or more affordances on the touchscreen display.
[0088] (F7) In some embodiments of any one of the methods of F1-F6, the set of one or more affordances includes at least one system-level affordance corresponding to at least one system-level function, and the method includes maintaining a display of the at least one system-level affordance on the touchscreen display after displaying a representation of the respective portion of the user interface on the touchscreen display.
[0089] (F8) In some embodiments of any one of the methods F1-F7, a representation of the respective portion of the user interface is overlaid on a set of one or more affordances on the touchscreen display.
[0090] (F9) In another aspect, a computing system is provided, the computing system including one or more processors, a memory, a first housing including a primary display, and a second housing including at least a physical keyboard and a touch-sensitive secondary display. One or more programs are stored in the memory and configured for execution by the one or more processors, the one or more programs including instructions that perform or cause the execution of any one of the methods of F1-F8.
[0091] (F10) In an additional aspect, a non-transitory computer-readable storage medium is provided having stored thereon one or more programs, the one or more programs including instructions that, when executed by one or more processors of a computing system having a memory, a first housing including a primary display, and a second housing including, at least in part, a physical keyboard and a touch-sensitive secondary display separate from the primary display, cause the computing system to perform or cause the performance of any one of the methods of F1-F8.
[0092] (F11) In a further aspect, a graphical user interface on a computing system having one or more processors, a memory, a first housing including a primary display, and a second housing including at least in part a physical input mechanism and a touch-sensitive secondary display separate from the primary display, the graphical user interface comprising a user interface displayed according to any of the methods of claims F1-F8.
[0093] (F12) In another aspect, a computing device is provided, the computing device including a first housing including a primary display, a second housing including at least in part a physical keyboard and a touch-sensitive secondary display separate from the primary display, and means for performing or causing the performance of any of the methods of claims F1-F8.
[0094] (G1) According to some embodiments, a method is performed in a computing system (e.g., system 100 or system 200, FIGS. 1A-2D) that includes one or more processors, memory, a first housing that includes a primary display (e.g., housing 110 that includes display 102 or housing 204 that includes display 102), and a second housing that at least partially includes a physical keyboard (e.g., keyboard 106, FIG. 1A) and a touch-sensitive secondary display (e.g., dynamic function row 104, FIG. 1A). In some embodiments, the touch-sensitive secondary display is separate from the physical keyboard (e.g., the touch-sensitive secondary display is a standalone display 222 or the touch-sensitive display is integrated with another device, such as touchpad 108, FIG. 2C). The method includes receiving a request to open an application. In response to receiving the request, the method includes (i) displaying on the primary display a plurality of user interface objects associated with an application running on the computing system (e.g., the plurality of user interface objects corresponding to tabs in Safari, individual photos in a photo browsing application, individual frames of video in a video editing application, etc.), the plurality of user interface objects including first user interface objects displayed with associated content and other user interface objects displayed without associated content, and (ii) displaying on the touch-sensitive secondary display a set of affordances, each of which represents (i.e., corresponds to) one of the plurality of user interface objects. The method also includes detecting a swipe gesture via the touch-sensitive secondary display in a direction from a first affordance in the set of affordances toward a second affordance in the set of affordances.In some embodiments, the first affordance represents a first user interface object and the second affordance represents a second user interface object that is distinct from the first user interface object. In response to detecting a swipe gesture, the method includes updating the primary display (e.g., during the swipe gesture) to cease displaying associated content of the first user interface object and to display associated content of the second user interface object.
[0095] Enabling a user to quickly navigate user interface objects on a primary display (e.g., a browser tab) by providing input on a touch-sensitive secondary display provides a user with a convenient way to quickly navigate user interface objects. Providing a user with a convenient way to quickly navigate user interface objects via a touch-sensitive secondary display (and reducing the number of inputs needed to navigate user interface objects, and therefore less interaction needed to navigate user interface objects) improves the operability of a computing system (e.g., by requiring a single input or gesture on the touch-sensitive secondary display to navigate user interface objects on the primary display) and makes the user device interface more efficient, which in turn reduces device power usage and improves battery life by allowing a user to more quickly and efficiently navigate user interface objects on the primary display. Moreover, when a user provides input (e.g., a swipe gesture) on the touch-sensitive display to navigate user interface objects on the primary display, each contact affordance on the touch-sensitive display (corresponding to one of the user interface objects) is visually distinguished from the other affordances (e.g., each contact affordance may be enlarged and have a highlighted edge), and in this way, the information displayed on the touch-sensitive secondary display becomes more distinguishable to the user.
[0096] (G2) In some embodiments of the method of G1, the method includes detecting continuous movement of a swipe gesture across the touch-sensitive secondary display, the swipe gesture including the swipe gesture contacting a third affordance representing a third user interface object. In response to detecting the swipe gesture contacting the third affordance, the method includes updating the primary display to display associated content of the third user interface object.
[0097] (G3) In some embodiments of the methods of any one of G1-G2, each affordance in the set of affordances includes a representation of respective associated content for a respective user interface object of the plurality.
[0098] (G4) In some embodiments of the methods of any one of G1-G3, the method includes detecting initial contact with the touch-sensitive secondary display on the first affordance before detecting the swipe gesture. In response to detecting the initial contact, the method includes increasing a magnification level (or display size) of the first affordance.
[0099] (G5) In some embodiments of any one of the methods of G1-G4, the application is a web browsing application, and the plurality of user interface objects each correspond to a web browsing tab.
[0100] (G6) In some embodiments of the method of G6, the method includes detecting input in a URL entry portion of a web browsing application on the primary display. In response to detecting the input, the method includes updating the touch-sensitive secondary display to include a representation of the favorite URL.
[0101] (G7) In some embodiments of any one of the methods G1-G4, the application is a photo browsing application, and the plurality of user interface objects each correspond to a separate photo.
[0102] (G8) In some embodiments of any one of the methods G1-G4, the application is a video editing application, and the plurality of user interface objects each correspond to a respective frame in a respective video.
[0103] (G9) In another aspect, a computing system is provided, the computing system including one or more processors, a memory, a first housing including a primary display, and a second housing including at least a physical keyboard and a touch-sensitive secondary display. One or more programs are stored in the memory and configured for execution by the one or more processors, the one or more programs including instructions that perform or cause the execution of any one of the methods of G1-G8.
[0104] (G10) In an additional aspect, a non-transitory computer-readable storage medium is provided having stored thereon one or more programs, the one or more programs including instructions that, when executed by one or more processors of a computing system having a memory, a first housing including a primary display, and a second housing including at least in part a physical keyboard and a touch-sensitive secondary display separate from the primary display, cause the computing system to perform or cause the performance of any one of the methods of G1-G8.
[0105] (G11) In a further aspect, a graphical user interface on a computing system having one or more processors, a memory, a first housing including a primary display, and a second housing including at least in part a physical input mechanism and a touch-sensitive secondary display separate from the primary display, the graphical user interface comprising a user interface displayed according to any of the methods of claims G1-G8.
[0106] (G12) In another aspect, a computing device is provided, the computing device including a first housing including a primary display, a second housing including at least in part a physical keyboard and a touch-sensitive secondary display separate from the primary display, and means for performing or causing the performance of any of the methods of claims G1-G8.
[0107] (H1) According to some embodiments, a method is performed in a computing system (e.g., system 100 or system 200, FIGS. 1A-2D ) including one or more processors, memory, a first housing including a primary display (e.g., housing 110 including display 102 or housing 204 including display 102), and a second housing at least partially including a physical keyboard (e.g., keyboard 106, FIG. 1A ) and a touch-sensitive secondary display (e.g., dynamic function row 104, FIG. 1A ). In some embodiments, the touch-sensitive secondary display is separate from the physical keyboard (e.g., the touch-sensitive secondary display is standalone display 222 or the touch-sensitive display is integrated with another device, such as touchpad 108, FIG. 2C ). The method includes receiving a request to search within content displayed on the primary display of the computing device (e.g., the request corresponds to a request to search for text within displayed web page content). In response to receiving the request, the method includes (i) displaying, on the primary display, a plurality of search results responsive to the search, with focus on a first search result of the plurality of search results; and (ii) displaying, on the touch-sensitive secondary display, a respective representation corresponding to each search result of the plurality of search results. The method also includes detecting a touch input (e.g., a tap or swipe) via the touch-sensitive secondary display that selects an representation of the respective representations, the representation corresponding to a second search result of the plurality of search results that is distinct from the first search result. In response to detecting the input, the method includes changing focus on the primary display to the second search result.
[0108] Enabling a user to quickly navigate search results on the primary display by providing input on the touch-sensitive secondary display provides a user with a convenient way to quickly navigate search results. Providing a user with a convenient way to quickly navigate search results via the touch-sensitive secondary display (and reducing the number of inputs required to navigate search results, and therefore less interaction from the user required to quickly browse a large number of search results) improves the operability of the computing system (e.g., by requiring a single input or gesture on the touch-sensitive secondary display to navigate a large number of search results on the primary display) and makes the user device interface more efficient, which in turn reduces device power usage and improves battery life by allowing a user to more quickly and efficiently navigate search results on the primary display. Moreover, when a user provides input (e.g., a swipe gesture) on the touch-sensitive display to navigate a search on the primary display, each contact affordance on the touch-sensitive display (corresponding to one of the search results) is visually distinguished from the other affordances (e.g., each contact affordance may be enlarged and have a highlighted border), and in this way, the information displayed on the touch-sensitive secondary display becomes more distinguishable to the user.
[0109] (H2) In some embodiments of the method of H1, changing the focus includes modifying the visual characteristics of the particular search result on the primary display (e.g., displaying the particular search result in a larger font size).
[0110] (H3) In some embodiments of the methods of any one of H1-H2, the method includes detecting a gesture on the touch-sensitive secondary display that moves across at least two of the respective representations. In response to detecting the gesture, the method includes changing focus on the primary display to respective search results that correspond to at least two of the respective representations as the swipe gesture moves across the at least two of the respective representations.
[0111] (H4) In some embodiments of the method of H3, the method includes, pursuant to a determination that the velocity of the gesture exceeds a threshold velocity, changing focus on the primary display to each search result in addition to those corresponding to at least two of the respective representations (e.g., cycling through more search results in addition to those contacted during the swipe when the threshold velocity is exceeded).
[0112] (H5) In some embodiments of the method of any one of H3-H4, the gesture is a swipe gesture.
[0113] (H6) In some embodiments of any one of the methods H3-H4, the gesture is a flick gesture.
[0114] (H7) In some embodiments of any one of the methods H1-H6, the representation is a tick mark corresponding to each search result in the search results.
[0115] (H8) In some embodiments of the method of H7, the tick marks are displayed in rows on the touch-sensitive secondary display in an order that corresponds to an ordering of the search results on the primary display.
[0116] (H9) In some embodiments of any one of methods H1-H8, the request to search within the content is a request to locate a search string within the content, and the plurality of search results each include at least the search string.
[0117] (H9) In some embodiments of the method of H8, displaying the plurality of search results includes highlighting the search string for each of the plurality of search results.
[0118] (H10) In another aspect, a computing system is provided, the computing system including one or more processors, a memory, a first housing including a primary display, and a second housing including at least in part a physical keyboard and a touch-sensitive secondary display. One or more programs are stored in the memory and configured for execution by the one or more processors, the one or more programs including instructions that perform or cause the execution of any one of the methods of H1-H9.
[0119] (H11) In an additional aspect, a non-transitory computer-readable storage medium is provided having stored thereon one or more programs, the one or more programs including instructions that, when executed by one or more processors of a computing system having a memory, a first housing including a primary display, and a second housing including, at least in part, a physical keyboard and a touch-sensitive secondary display separate from the primary display, cause the computing system to perform or cause the performance of any one of the methods of H1-H9.
[0120] (H12) In a further aspect, a graphical user interface on a computing system having one or more processors, a memory, a first housing including a primary display, and a second housing including at least in part a physical input mechanism and a touch-sensitive secondary display separate from the primary display, the graphical user interface comprising a user interface displayed according to any of the methods of claims H1-H9.
[0121] (H13) In another aspect, a computing device is provided, the computing device including a first housing including a primary display, a second housing including at least in part a physical keyboard and a touch-sensitive secondary display separate from the primary display, and means for performing or causing the performance of any of the methods of claims H1-H9.
[0122] (I1) According to some embodiments, a method is performed in a computing system (e.g., system 100 or system 200, FIGS. 1A-2D ) including one or more processors, memory, a first housing including a primary display (e.g., housing 110 including display 102 or housing 204 including display 102), and a second housing at least partially including a physical keyboard (e.g., keyboard 106, FIG. 1A ) and a touch-sensitive secondary display (e.g., dynamic function row 104, FIG. 1A ). In some embodiments, the touch-sensitive secondary display is separate from the physical keyboard (e.g., the touch-sensitive secondary display is standalone display 222 or the touch-sensitive display is integrated with another device, such as touchpad 108, FIG. 2C ). The method includes displaying a calendar application on the primary display. The method also includes receiving a request to display information about an event associated with the calendar application (e.g., the request corresponds to selecting an event displayed within the calendar application on the primary display). In response to receiving the request, the method includes: (i) displaying, on the primary display, event details for the first event, the event details including a start time and an end time of the event; and (ii) displaying, on the touch-sensitive secondary display, an affordance (e.g., a user interface control) indicating a range of time including at least the start time and the end time.
[0123] Enabling a user to quickly and easily edit event details on a touch-sensitive secondary display provides a user with a convenient way to quickly edit event details without having to perform extraneous input (e.g., without having to jump back and forth between using a keyboard and using a trackpad to modify the event details). Providing a user with a convenient way to quickly edit event details via a touch-sensitive secondary display (and reducing the number of inputs required to edit the event details, and therefore less interaction required to achieve a desired result of editing the event details) improves the operability of the computing system (e.g., by requiring a single input or gesture on the touch-sensitive secondary display to quickly edit some event details) and makes the user device interface more efficient, which in turn reduces device power usage and improves battery life by allowing a user to edit event details more quickly and efficiently. Furthermore, by updating the primary display in response to input on the touch-sensitive secondary display (e.g., to show updated start and end times for the event), a user can continue to interact with the device in an efficient manner by providing input that modifies the event and then immediately seeing those modifications reflected on the primary display, thus enabling the user to then determine whether to provide additional input.
[0124] (I2) In some embodiments of the method of I1, the method includes detecting, via the touch-sensitive secondary display, an input in a user interface control that modifies a range of time, and in response to detecting the input, (i) modifying at least one of a start time and an end time of the event according to the input, and (ii) displaying the modified range of time of the event on the primary display according to the input.
[0125] (I3) In some embodiments of the method of I2, the method includes saving the event with the modified start and / or end times in a memory of the computing system.
[0126] (I4) In some embodiments of any one of methods I1-I3, the input that modifies the time range is a press input that remains in contact with the affordance on the touch-sensitive secondary display for more than a threshold time and then moves at least a portion of the affordance.
[0127] (I5) In some embodiments of any one of methods I1-I3, the input that modifies the time range is a swipe gesture that moves across the touch-sensitive secondary display and causes the computing system to select a new start time and a new end time for the event, the new start time and end time corresponding to a time slot of the same duration as covered by the start time and end time.
[0128] (I6) In another aspect, a computing system is provided, the computing system including one or more processors, a memory, a first housing including a primary display, and a second housing at least partially including a physical keyboard and a touch-sensitive secondary display. One or more programs are stored in the memory and configured for execution by the one or more processors, the one or more programs including instructions that perform or cause the execution of any one of the methods of I1-I5.
[0129] (I7) In an additional aspect, a non-transitory computer-readable storage medium is provided having stored thereon one or more programs, the one or more programs including instructions that, when executed by one or more processors of a computing system having a memory, a first housing including a primary display, and a second housing including, at least in part, a physical keyboard and a touch-sensitive secondary display separate from the primary display, cause the computer to perform or cause the performance of any one of the methods of I1-I5.
[0130] (I8) In a further aspect, a graphical user interface on a computing system having one or more processors, a memory, a first housing including a primary display, and a second housing including at least in part a physical input mechanism and a touch-sensitive secondary display separate from the primary display, the graphical user interface comprising a user interface displayed according to any of the methods of claims I1-I5.
[0131] (I9) In another aspect, a computing device is provided, the computing device including a first housing including a primary display, a second housing including at least in part a physical keyboard and a touch-sensitive secondary display separate from the primary display, and means for performing or causing the performance of any of the methods of claims I1-I5.
[0132] (J1) According to some embodiments, a method is performed in a computing system (e.g., system 100 or system 200, FIGS. 1A-2D ) that includes one or more processors, memory, a first housing that includes a primary display (e.g., housing 110 that includes display 102 or housing 204 that includes display 102), and a second housing that at least partially includes a physical keyboard (e.g., keyboard 106, FIG. 1A ) and a touch-sensitive secondary display (e.g., dynamic function row 104, FIG. 1A ). In some embodiments, the touch-sensitive secondary display is separate from the physical keyboard (e.g., the touch-sensitive secondary display is a standalone display 222 or the touch-sensitive display is integrated with another device, such as touchpad 108, FIG. 2C ). The method includes detecting a new connection between the computing system and an external device that is separate from the computing system (e.g., connecting a new monitor, connecting headphones via Bluetooth or a headphone jack, etc.). In response to detecting the new connection, the method includes displaying, on the touch-sensitive secondary display, a plurality of affordances corresponding to functionality available via the external device.
[0133] Enabling a user to efficiently utilize an external device via a touch-sensitive secondary display provides the user with a convenient way to access features that might otherwise be buried in a menu. Providing a user with a convenient way to access features of an external device that might otherwise be buried in a menu (and therefore reducing the number of inputs needed to access the features, thus requiring less interaction to use the external device) improves the operability of the computing system (e.g., by requiring a single input or gesture on the touch-sensitive secondary display to perform some functions of the external device) and makes the user device interface more efficient, which in turn reduces the device's power usage and improves battery life by allowing the user to interact with the external device more quickly and efficiently. In this way, the touch-sensitive secondary display also conveys information about the internal state of the device (by reflecting the connection status between the device and the external device and allowing the user to easily interact with the external device).
[0134] (J2) In some embodiments of the method of J1, the method includes receiving, via the touch-sensitive secondary display, a selection of a first affordance corresponding to a first function available via the external device. In response to receiving the selection, the method includes commencing execution of the first function.
[0135] (J3) In some embodiments of any one of the methods J1-J2, the external device is an additional display separate from the primary display and the touch-sensitive display.
[0136] (J4) In some embodiments of the method of J3, the plurality of affordances includes a first affordance that, when selected, causes the computing system to initiate execution of a display mirroring function via the additional display.
[0137] (J5) In another aspect, a computing system is provided, the computing system including one or more processors, a memory, a first housing including a primary display, and a second housing including at least a physical keyboard and a touch-sensitive secondary display. One or more programs are stored in the memory and configured for execution by the one or more processors, the one or more programs including instructions that perform or cause the execution of any one of the methods of J1-J4.
[0138] (J6) In an additional aspect, a non-transitory computer-readable storage medium is provided having stored thereon one or more programs, the one or more programs including instructions that, when executed by one or more processors of a computing system having a memory, a first housing including a primary display, and a second housing including at least in part a physical keyboard and a touch-sensitive secondary display separate from the primary display, cause the computing system to perform or cause the performance of any one of the methods of J1-J4.
[0139] (J7) In a further aspect, a graphical user interface on a computing system having one or more processors, a memory, a first housing including a primary display, and a second housing including at least in part a physical input mechanism and a touch-sensitive secondary display separate from the primary display, the graphical user interface comprising a user interface displayed according to any of the methods of claims J1-J4.
[0140] (J8) In another aspect, a computing device is provided, the computing device including a first housing including a primary display, a second housing including at least in part a physical keyboard and a touch-sensitive secondary display separate from the primary display, and means for performing or causing the performance of any of the methods of claims J1-J4.
[0141] (K1) According to some embodiments, a method is performed in a computing system (e.g., system 100 or system 200, FIGS. 1A-2D ) that includes one or more processors, memory, a first housing that includes a primary display (e.g., housing 110 that includes display 102 or housing 204 that includes display 102), and a second housing that at least partially includes a physical keyboard (e.g., keyboard 106, FIG. 1A ) and a touch-sensitive secondary display (e.g., dynamic function row 104, FIG. 1A ). In some embodiments, the touch-sensitive secondary display is separate from the physical keyboard (e.g., the touch-sensitive secondary display is standalone display 222 or the touch-sensitive display is integrated with another device, such as touchpad 108, FIG. 2C ). The method includes displaying a user interface for an application running on the computing system on the primary display and detecting a first input at a particular location within the user interface. In response to detecting the first input, the method includes displaying, on the touch-sensitive secondary display, a set of affordances that each correspond to a distinct character.
[0142] Enabling a user to quickly and easily preview what characters will look like within an application on the primary display by providing intuitive input on the touch-sensitive secondary display provides a user with a convenient way to quickly preview what characters will look like within an application. Providing a user with a convenient way to quickly preview what characters will look like within an application improves the operability of the computing system (e.g., by requiring a single input or gesture on the touch-sensitive secondary display to quickly preview what characters will look like, and therefore less interaction is required to preview what those characters will look like on the primary display) and makes the user device interface more efficient, thereby further reducing device power usage and improving battery life by allowing users to preview characters more quickly and efficiently. In this way, users are provided with efficient and sustained interaction with their device, as they are permitted to continue previewing characters and then continue providing input until the desired character is found.
[0143] (K2) In some embodiments of the method of K1, the method includes detecting, via the touch-sensitive secondary display, a second input over a first affordance corresponding to a first character of the distinct characters. In response to detecting the second input, the method includes displaying a preview of the first character at a particular location on the primary display while the input remains in contact with the first affordance.
[0144] (K3) In some embodiments of the method of K2, the method includes detecting, via the touch-sensitive secondary display, movement of a second input from the first affordance to a second affordance corresponding to a second character of the distinct characters. In response to detecting the movement of the second input from the first affordance to the second affordance, the method includes replacing a preview of the first character with a preview of the second character.
[0145] (K4) In some embodiments of any one of methods K1-K3, the method includes determining affordances to include in the set of affordances based at least in part on textual content included in the user interface.
[0146] (K5) In some embodiments of the method of K4, the determining is performed in response to detecting that a user has modified textual content included in the user interface.
[0147] (K6) In some embodiments of the methods of any one of K1-K5, the method includes detecting lift-off of the second input while the second input is in contact with the second affordance. In response to detecting lift-off, the method includes updating the user interface to include the second user interface element.
[0148] (K7) In some embodiments of the methods of any one of K1-K5, the method includes detecting an additional input while the second input is in contact with the second affordance. In response to detecting the additional input, the method includes updating the user interface to include the second user interface element.
[0149] (K8) In some embodiments of the methods of any one of K1-K7, the method includes displaying a preview of each character of the distinct characters such that a corresponding affordance in the set of affordances is contacted by the second input as the second input continues to move across the touch-sensitive secondary display.
[0150] (K9) In some embodiments of the methods of any one of K1-K8, the preview of the second character remains displayed on the primary display while the input remains in contact with the second affordance.
[0151] (K10) In another aspect, a computing system is provided, the computing system including one or more processors, a memory, a first housing including a primary display, and a second housing at least partially including a physical keyboard and a touch-sensitive secondary display. One or more programs are stored in the memory and configured for execution by the one or more processors, the one or more programs including instructions that perform or cause the execution of any one of the methods of K1-K9.
[0152] (K11) In an additional aspect, a non-transitory computer-readable storage medium is provided having stored thereon one or more programs, the one or more programs including instructions that, when executed by one or more processors of a computing system having a memory, a first housing including a primary display, and a second housing including at least in part a physical keyboard and a touch-sensitive secondary display separate from the primary display, cause the computing system to perform or cause the performance of any one of the methods of K1-K9.
[0153] (K12) In a further aspect, a graphical user interface on a computing system having one or more processors, a memory, a first housing including a primary display, and a second housing including at least in part a physical input mechanism and a touch-sensitive secondary display separate from the primary display, the graphical user interface comprising a user interface displayed according to any of the methods of claims K1-K9.
[0154] (K13) In another aspect, a computing device is provided, the computing device including: a first housing including a primary display; a second housing including at least in part a physical keyboard and a touch-sensitive secondary display separate from the primary display; and means for performing or causing the performance of any of the methods of claims K1-K9.
[0155] (L1) According to some embodiments, a method is performed in a computing system (e.g., system 100 or system 200, FIGS. 1A-2D) including one or more processors, memory, a first housing including a primary display (e.g., housing 110 including display 102 or housing 204 including display 102), and a second housing at least partially including a physical keyboard (e.g., keyboard 106, FIG. 1A) and a touch-sensitive secondary display (e.g., dynamic function row 104, FIG. 1A). In some embodiments, the touch-sensitive secondary display is separate from the physical keyboard (e.g., the touch-sensitive secondary display is a standalone display 222 or the touch-sensitive display is integrated with another device, such as touchpad 108, FIG. 2C). The method includes receiving a request to open a content editing application (an application for creating and editing documents, drawings, photos, etc.). In response to receiving the request, the method includes (i) displaying a content editing application on the primary display; and (ii) displaying a user interface control on the touch-sensitive secondary display that modifies at least one visual characteristic used to render content within the content editing application (e.g., a color picker including a sliding scale of color values used to select a color for content displayed within the content editing application).
[0156] Thus, a user is provided with an intuitive way to modify visual properties used to render content within a content editing application on the primary display by providing input on the touch-sensitive secondary display. Providing a user with an intuitive way to modify visual properties in this manner improves the operability of the computing system (e.g., by requiring a single input or gesture on the touch-sensitive secondary display to quickly preview what certain visual properties will look like when used to render content on the primary display) and makes the user device interface more efficient, which in turn reduces device power usage and improves battery life by allowing users to preview changes to visual properties in a quicker and more efficient manner. In this way, users are provided with efficient and sustained interaction with their device because they are permitted to continue previewing what modifications to visual properties will look like on the primary display and then continue providing input until they find the desired modification to the visual property.
[0157] (L2) In some embodiments of the method of L1, the method includes detecting, via the touch-sensitive secondary display, an input on a user interface control that selects a first value of at least one visual characteristic. After detecting the input, the method includes rendering content in the content editing application using the first value of the at least one visual characteristic (e.g., rendering all new content added to the content editing application using the first value and / or rendering currently selected content using the first value).
[0158] (L3) In some embodiments of any one of the methods of L1-L2, the user interface controls include respective controls corresponding to respective values of the at least one visual characteristic along a sliding scale of values.
[0159] (L4) In some embodiments of the method of L3, the sliding scale of values represents distinct shades of color.
[0160] (L5) In some embodiments of the method of L4, the first value corresponds to a first shade of the first color, and the method includes, pursuant to a determination that the input meets a predetermined criterion (remains in contact for longer than a threshold time), modifying a user interface control on the touch-sensitive secondary display to include an option to select another shade of the first color, distinct from the first shade of the first color.
[0161] (L6) In some embodiments of any one of the methods of L1-L5, the method includes receiving a selection of content before rendering the content, and rendering the content includes presenting a preview of the content using a first value of the at least one visual characteristic.
[0162] (L7) In some embodiments of the method of L6, the preview is presented while the input remains in contact with the touch-sensitive secondary display.
[0163] (L8) In some embodiments of the method of L7, the method includes ceasing to display the preview in response to detecting lift-off of the input.
[0164] (L9) In some embodiments of the method of L8, the method includes, in response to detecting lift-off of the input, displaying the portion of the editable content with a modified value of the at least one visual characteristic.
[0165] (L10) In another aspect, a computing system is provided, the computing system including one or more processors, a memory, a first housing including a primary display, and a second housing including at least a physical keyboard and a touch-sensitive secondary display. One or more programs are stored in the memory and configured for execution by the one or more processors, the one or more programs including instructions that perform or cause the execution of any one of the methods of L1-L9.
[0166] (L11) In an additional aspect, a non-transitory computer-readable storage medium is provided having stored thereon one or more programs, the one or more programs including instructions that, when executed by one or more processors of a computing system having a memory, a first housing including a primary display, and a second housing including, at least in part, a physical keyboard and a touch-sensitive secondary display separate from the primary display, cause the computing system to perform or cause the performance of any one of the methods of L1-L9.
[0167] (L12) In a further aspect, a graphical user interface on a computing system having one or more processors, a memory, a first housing including a primary display, and a second housing including at least in part a physical input mechanism and a touch-sensitive secondary display separate from the primary display, the graphical user interface comprising a user interface displayed according to any of the methods of claims L1-L9.
[0168] (L13) In another aspect, a computing device is provided, the computing device including a first housing including a primary display, a second housing including at least in part a physical keyboard and a touch-sensitive secondary display separate from the primary display, and means for performing or causing the performance of any of the methods of claims L1-L9.
[0169] (M1) According to some embodiments, a method is performed in an electronic device (e.g., system 100 or system 200, FIGS. 1A-2D ) that includes one or more processors, memory, a first housing that includes a primary display (e.g., housing 110 including display 102 or housing 204 including display 102, also referred to as “display”), and a second housing that at least partially includes a physical keyboard (e.g., keyboard 106, FIG. 1A ) and a touch-sensitive secondary display (e.g., dynamic function row 104, FIG. 1A ). In some embodiments, the touch-sensitive secondary display is separate from the physical keyboard (e.g., the touch-sensitive secondary display is a standalone display 222 or the touch-sensitive display is integrated with another device, such as touchpad 108, FIG. 2C ). In some embodiments, the electronic device also includes a biometric sensor that is integrated with the touch-sensitive secondary display or is a separate component located adjacent to the touch-sensitive secondary display in the second housing. The method includes displaying respective login user interfaces associated with logging in to a plurality of user accounts, including a first user account and a second user account, while the device is in a locked state (e.g., a locked state in which one or more functions of the device are disabled, prohibiting access to sensitive information or the ability to modify or delete information). While displaying the login user interfaces, the method includes receiving biometric information regarding the users.In response to receiving the biometric information, the method includes (i) displaying a prompt on the display to enter login credentials for the first user account in accordance with a determination that the biometric information matches biometric information for a first user account of the plurality of user accounts while the first user account does not have an active session on the device, and (ii) displaying a prompt on the display to enter login credentials for a second user account in accordance with a determination that the biometric information matches biometric information for a second user account of the plurality of user accounts while the second user account does not have an active session on the device.
[0170] Thus, a user is provided with an intuitive way to access a user-specific login page by providing a single input at the biometric sensor. Providing a user with an intuitive way to access a user-specific login page in this manner improves the operability of the computing system (e.g., by requiring a single input or gesture at the biometric sensor to quickly access the user-specific login page in a timely manner, and therefore less interaction is required to reach the user-specific login page), makes the user device interface more efficient, and thereby further reduces device power usage and improves battery life by allowing a user to access the login page via a single input.
[0171] (M2) In some embodiments of the method of M1, the method includes, in response to receiving the biometric information, unlocking the device for the first user account (e.g., without requiring additional user input) in accordance with a determination that the biometric information matches biometric information of a first user account of the multiple user accounts while the first user account has an active session on the device.
[0172] (M3) In some embodiments of any one of methods M1-M2, the method includes, in response to receiving the biometric information, unlocking the device for the second user account (e.g., without requiring additional user input) in accordance with a determination that the biometric information matches biometric information of a second user account of the plurality of user accounts while the second user account has an active session on the device.
[0173] (M4) In some embodiments of any one of methods M1-M3, the method includes, in response to receiving the biometric information, maintaining the device in a locked state in accordance with a determination that the biometric information does not match biometric information of any user account on the device.
[0174] (M5) In some embodiments of any one of the methods M1-M4, the login user interface includes a plurality of selectable affordances corresponding to a plurality of user accounts.
[0175] (M6) In some embodiments of any one of the methods M1-M5, the method includes receiving entry of login credentials while displaying a prompt to enter login credentials for a first user account. In response to receiving the entry of the login credentials, the method includes (i) unlocking the device with respect to the first user account in accordance with a determination that the login credentials match the login credentials for the first user account, and (ii) maintaining the device in a locked state in accordance with a determination that the login credentials do not match the login credentials for the first user account.
[0176] (M7) In some embodiments of any one of the methods M1-M6, the method includes receiving entry of login credentials while displaying a prompt to enter login credentials for a second user account. In response to receiving the entry of the login credentials, (i) unlocking the device with respect to the first user account in accordance with a determination that the login credentials match the login credentials for the second user account, and (ii) maintaining the device in a locked state in accordance with a determination that the login credentials do not match the login credentials for the second user account.
[0177] (M8) In some embodiments of any one of the methods M1-M7, the login user interface includes instructions to provide biometric information.
[0178] (M9) In some embodiments of any one of methods M1-M8, the device includes a secondary display (e.g., a touch-sensitive secondary display) adjacent to the biometric sensor, and the method includes displaying instructions on the secondary display to provide biometric information via the biometric sensor while displaying a login user interface on a display of the device.
[0179] (M10) In some embodiments of any one of the methods M1-M9, the biometric sensor is a fingerprint sensor.
[0180] (M11) In some embodiments of any one of the methods M1 to M9, the biometric sensor is a face detection sensor.
[0181] (M12) In some embodiments of any one of the methods M1-M9, the biosensor is a retinal scanner.
[0182] (M13) In another aspect, an electronic device is provided, the electronic device including one or more processors, a memory, a display, and a biosensor. One or more programs are stored in the memory and configured for execution by the one or more processors, the one or more programs including instructions for performing or causing the performance of any one of the methods of M1-M12.
[0183] (M14) In an additional aspect, a non-transitory computer-readable storage medium is provided having stored thereon one or more programs, the one or more programs including instructions that, when executed by one or more processors of a computing system having a display and a biometric sensor, cause the computing system to perform or cause the execution of any one of the methods of M1 to M12.
[0184] (M15) In a further aspect, a graphical user interface is provided on a computing system having one or more processors, memory, a display, and a biometric sensor, the graphical user interface comprising a user interface displayed according to any of the methods of claims M1-M12.
[0185] (M16) In another aspect, there is provided a computing device, the computing device including a display and a biometric sensor, and means for performing or causing the performance of any of the methods of claims M1-M12.
[0186] (N1) According to some embodiments, a method is performed in an electronic device (e.g., system 100 or system 200, FIGS. 1A-2D ) that includes one or more processors, memory, a first housing that includes a primary display (e.g., housing 110 including display 102 or housing 204 including display 102, also referred to as “display”), and a second housing that at least partially includes a physical keyboard (e.g., keyboard 106, FIG. 1A ) and a touch-sensitive secondary display (e.g., dynamic function row 104, FIG. 1A ). In some embodiments, the touch-sensitive secondary display is separate from the physical keyboard (e.g., the touch-sensitive secondary display is a standalone display 222 or the touch-sensitive display is integrated with another device, such as touchpad 108, FIG. 2C ). In some embodiments, the electronic device also includes a biometric sensor that is integrated with the touch-sensitive secondary display or is a separate component located adjacent to the touch-sensitive secondary display in the second housing. The method includes displaying a user interface associated with a first user account (e.g., a home screen or desktop of the first user account) while the device is logged into the first user account. The device is associated with multiple user accounts, including the first user account and a second user account, the second user account being associated with biometric information that enables logging into the second user account. While displaying the user interface associated with the first user account, the method includes receiving input via an input element having an integrated biometric sensor.In response to receiving input via an input element having an integrated biometric sensor, the method includes: (i) unlocking the device with respect to the second user account; (ii) locking the device with respect to the first user account; and (iii) replacing the display of a user interface associated with the first account with a user interface associated with the second user account in accordance with a determination that the input satisfies second user switching criteria while the second user account has an active session on the device, the second user switching criteria including a requirement that biometric information detected during input using the input element matches biometric information of a second user account of the plurality of user accounts.
[0187] Thus, a user is provided with an intuitive way to access an active user-specific session on an electronic device by providing a single input at a biometric sensor. Providing a user with an intuitive way to access an active user-specific session in this manner improves the operability of the electronic device (e.g., by requiring a single input or gesture at the biometric sensor to gain immediate access to the active session, thus requiring less interaction to switch user accounts and log into the device), makes the user device interface more efficient, and thereby further reduces device power usage and improves battery life by allowing a user to access the active session via a single input.
[0188] (N2) In some embodiments of the method of N1, the method includes, in response to receiving the biometric information, displaying a prompt on the display to enter login credentials for the second user account in accordance with a determination that the input satisfies second user switching criteria while the second user account does not have an active session on the device, the second user switching criteria including a requirement that the biometric information detected during the input using the input element matches biometric information of a second user account of the plurality of user accounts.
[0189] (N3) In some embodiments of any one of methods N1-N2, the method includes, in response to receiving the biometric information, determining that the input satisfies third user switching criteria while a third user account has an active session on the device, the third user switching criteria including a requirement that the biometric information detected during the input using the input element matches biometric information of a third user account among the plurality of user accounts, (i) unlocking the device with respect to the third user account; (ii) locking the device with respect to the first user account; and (iii) replacing the display of a user interface associated with the first account with a user interface associated with the third user account.
[0190] (N4) In some embodiments of any one of methods N1-N3, the method includes, in response to receiving the biometric information, displaying a prompt on the display to enter login credentials for the third user account in accordance with a determination that the input satisfies third user switching criteria while the third user account does not have an active session on the device, the third user switching criteria including a requirement that the biometric information detected during input using the input element matches biometric information of a third user account among the plurality of user accounts.
[0191] (N5) In some embodiments of any one of methods N1-N2, the input element is a button, and the input via the input element having an integrated biosensor includes detecting a press input via the button.
[0192] (N6) In some embodiments of the method of N5, the second user switching criterion includes a criterion that the press input lasts for less than a first threshold time, and the method includes, in accordance with a determination that the press input using the button lasts for longer than the first threshold time, placing the device into a low power mode in response to receiving the press input via an input element having an integrated biometric sensor (e.g., the low power mode corresponds to a suspended state of the electronic device with the display turned off).
[0193] (N7) In some embodiments of the method of N5, the second user switching criterion includes a criterion that the button press is shorter than a first threshold time, and the method includes, in response to receiving input via an input element having an integrated biometric sensor, (i) placing the device in a low power mode in accordance with a determination that the button press input lasts longer than the first threshold time and shorter than a second threshold time (e.g., the low power mode corresponds to a sleep / suspend state of the electronic device with the display turned off, and the low power mode is entered upon termination of the press input), and (ii) displaying a menu of options for changing the state of the device in accordance with a determination that the button press input lasts longer than the second threshold time (e.g., the menu of options includes shutdown, restart, and sleep / suspend options that, when selected, shut down, restart, or sleep / suspend the device, respectively).
[0194] (N8) In some embodiments of the method of N7, the method includes, in response to receiving input via an input element having an integrated biometric sensor, rebooting the device in accordance with a determination that the button press input lasts for more than a third threshold time that is greater than the second threshold time.
[0195] (N9) In some embodiments of the methods of any one of N1-N8, the method includes, after replacing a display of a user interface associated with a first account with a user interface associated with a second user account, receiving a second input via an input element having an integrated biometric sensor while displaying the user interface associated with the second user account. In response to receiving the second input via the input element having the integrated biometric sensor, while the first user account has an active session on the device, determining that the second input satisfies first user switching criteria, the first user switching criteria including a requirement that biometric information detected during input with the input element matches biometric information of a first user account of the plurality of user accounts, (i) unlocking the device with respect to the first user account, (ii) locking the device with respect to the second user account, and (iii) replacing the display of the user interface associated with the second account with the user interface associated with the first user account.
[0196] (N10) In another aspect, an electronic device is provided, the electronic device including one or more processors, a memory, a display, and a biosensor. One or more programs are stored in the memory and configured for execution by the one or more processors, the one or more programs including instructions for performing or causing the performance of any one of the methods of N1-N9.
[0197] (N11) In an additional aspect, a non-transitory computer-readable storage medium is provided that stores one or more programs, the one or more programs including instructions that, when executed by one or more processors of a computing system having a display and a biometric sensor, cause the computing system to perform or cause the execution of any one of the methods of N1 to N9.
[0198] (N12) In a further aspect, a graphical user interface is provided on a computing system having one or more processors, memory, a display, and a biometric sensor, the graphical user interface comprising a user interface displayed according to any of the methods of claims N1-N9.
[0199] (N13) In another aspect, a computing device is provided, the computing device including a display and a biometric sensor, and means for performing or causing the performance of any of the methods of claims N1-N9.
[0200] For a better understanding of the various described embodiments, reference should be made to the following detailed description in conjunction with the following drawings, in which like reference numerals refer to corresponding parts throughout the drawings, in which: [Brief explanation of the drawings]
[0201] [Figure 1A] 1 is an illustrative diagram of a portable computing system (e.g., a laptop computer) according to some embodiments. [Figure 1B] 1B is an exemplary diagram of a main body portion of the portable computing system of FIG. 1A according to some embodiments. [Figure 2A] FIG. 1 is an illustrative diagram of a first implementation of a desktop computing system, according to some embodiments. [Figure 2B] FIG. 2 is an illustrative diagram of a second implementation of a desktop computing system, according to some embodiments. [Figure 2C] FIG. 10 is an illustrative diagram of a third implementation of a desktop computing system according to some embodiments. [Figure 2D] FIG. 10 is an illustrative diagram of a fourth implementation of a desktop computing system according to some embodiments. [Figure 3A]FIG. 1 is a block diagram of an electronic device, according to some embodiments. [Figure 3B] FIG. 3B is a block diagram of components for event processing of FIG. 3A according to some embodiments. [Figure 3C] 1 illustrates an example of a dynamic intensity threshold, according to some embodiments. [Figure 3D] 1 illustrates an example of a dynamic intensity threshold, according to some embodiments. [Figure 3E] 1 illustrates an example of a dynamic intensity threshold, according to some embodiments. [Figure 4] FIG. 1 is a block diagram of an external electronic device, according to some embodiments. [Figure 5A] 1 illustrates an exemplary user interface that dynamically provides user interface control on a touch-sensitive secondary display, according to some embodiments. [Figure 5B] 1 illustrates an exemplary user interface that dynamically provides user interface control on a touch-sensitive secondary display, according to some embodiments. [Figure 5C] 1 illustrates an exemplary user interface that dynamically provides user interface control on a touch-sensitive secondary display, according to some embodiments. [Figure 5D] 1 illustrates an exemplary user interface that dynamically provides user interface control on a touch-sensitive secondary display, according to some embodiments. [Figure 5E] 1 illustrates an exemplary user interface that dynamically provides user interface control on a touch-sensitive secondary display, according to some embodiments. [Figure 6A] 1 illustrates an exemplary user interface that dynamically provides user interface control on a touch-sensitive secondary display, according to some embodiments. [Figure 6B] 1 illustrates an exemplary user interface that dynamically provides user interface control on a touch-sensitive secondary display, according to some embodiments. [Figure 6C] 1 illustrates an exemplary user interface that dynamically provides user interface control on a touch-sensitive secondary display, according to some embodiments. [Figure 6D] 1 illustrates an exemplary user interface that dynamically provides user interface control on a touch-sensitive secondary display, according to some embodiments. [Figure 6E] 1 illustrates an exemplary user interface that dynamically provides user interface control on a touch-sensitive secondary display, according to some embodiments. [Figure 6F] 1 illustrates an exemplary user interface that dynamically provides user interface control on a touch-sensitive secondary display, according to some embodiments. [Figure 7A] 1 illustrates an exemplary user interface that dynamically provides user interface control on a touch-sensitive secondary display, according to some embodiments. [Figure 7B] 1 illustrates an exemplary user interface that dynamically provides user interface control on a touch-sensitive secondary display, according to some embodiments. [Figure 7C] 1 illustrates an exemplary user interface that dynamically provides user interface control on a touch-sensitive secondary display, according to some embodiments. [Figure 7D] 1 illustrates an exemplary user interface that dynamically provides user interface control on a touch-sensitive secondary display, according to some embodiments. [Figure 8A] 1 illustrates an exemplary user interface that dynamically provides user interface control on a touch-sensitive secondary display, according to some embodiments. [Figure 8B] 1 illustrates an exemplary user interface that dynamically provides user interface control on a touch-sensitive secondary display, according to some embodiments. [Figure 8C] 1 illustrates an exemplary user interface that dynamically provides user interface control on a touch-sensitive secondary display, according to some embodiments. [Figure 8D] 1 illustrates an exemplary user interface that dynamically provides user interface control on a touch-sensitive secondary display, according to some embodiments. [Figure 8E] 1 illustrates an exemplary user interface that dynamically provides user interface control on a touch-sensitive secondary display, according to some embodiments. [Figure 8F] 1 illustrates an exemplary user interface that dynamically provides user interface control on a touch-sensitive secondary display, according to some embodiments. [Figure 8G] 1 illustrates an exemplary user interface that dynamically provides user interface control on a touch-sensitive secondary display, according to some embodiments. [Figure 8H] 1 illustrates an exemplary user interface that dynamically provides user interface control on a touch-sensitive secondary display, according to some embodiments. [Figure 9] 1 illustrates an exemplary user interface that dynamically provides user interface control on a touch-sensitive secondary display, according to some embodiments. [Figure 10A] 1 illustrates an exemplary user interface that dynamically provides user interface control on a touch-sensitive secondary display, according to some embodiments. [Figure 10B] 1 illustrates an exemplary user interface that dynamically provides user interface control on a touch-sensitive secondary display, according to some embodiments. [Figure 10C] 1 illustrates an exemplary user interface that dynamically provides user interface control on a touch-sensitive secondary display, according to some embodiments. [Figure 10D]1 illustrates an exemplary user interface that dynamically provides user interface control on a touch-sensitive secondary display, according to some embodiments. [Figure 10E] 1 illustrates an exemplary user interface that dynamically provides user interface control on a touch-sensitive secondary display, according to some embodiments. [Figure 10F] 1 illustrates an exemplary user interface that dynamically provides user interface control on a touch-sensitive secondary display, according to some embodiments. [Figure 10G] 1 illustrates an exemplary user interface that dynamically provides user interface control on a touch-sensitive secondary display, according to some embodiments. [Figure 10H] 1 illustrates an exemplary user interface that dynamically provides user interface control on a touch-sensitive secondary display, according to some embodiments. [Figure 11A] 1 illustrates an exemplary user interface that dynamically provides user interface control on a touch-sensitive secondary display, according to some embodiments. [Figure 11B] 1 illustrates an exemplary user interface that dynamically provides user interface control on a touch-sensitive secondary display, according to some embodiments. [Figure 11C] 1 illustrates an exemplary user interface that dynamically provides user interface control on a touch-sensitive secondary display, according to some embodiments. [Figure 11D] 1 illustrates an exemplary user interface that dynamically provides user interface control on a touch-sensitive secondary display, according to some embodiments. [Figure 11E] 1 illustrates an exemplary user interface that dynamically provides user interface control on a touch-sensitive secondary display, according to some embodiments. [Figure 11F]1 illustrates an exemplary user interface that dynamically provides user interface control on a touch-sensitive secondary display, according to some embodiments. [Figure 11G] 1 illustrates an exemplary user interface that dynamically provides user interface control on a touch-sensitive secondary display, according to some embodiments. [Figure 11H] 1 illustrates an exemplary user interface that dynamically provides user interface control on a touch-sensitive secondary display, according to some embodiments. [Figure 12A] 1 illustrates an exemplary user interface that dynamically provides user interface control on a touch-sensitive secondary display, according to some embodiments. [Figure 12B] 1 illustrates an exemplary user interface that dynamically provides user interface control on a touch-sensitive secondary display, according to some embodiments. [Figure 12C] 1 illustrates an exemplary user interface that dynamically provides user interface control on a touch-sensitive secondary display, according to some embodiments. [Figure 12D] 1 illustrates an exemplary user interface that dynamically provides user interface control on a touch-sensitive secondary display, according to some embodiments. [Figure 12E] 1 illustrates an exemplary user interface that dynamically provides user interface control on a touch-sensitive secondary display, according to some embodiments. [Figure 12F] 1 illustrates an exemplary user interface that dynamically provides user interface control on a touch-sensitive secondary display, according to some embodiments. [Figure 12G] 1 illustrates an exemplary user interface that dynamically provides user interface control on a touch-sensitive secondary display, according to some embodiments. [Figure 12H]1 illustrates an exemplary user interface that dynamically provides user interface control on a touch-sensitive secondary display, according to some embodiments. [Figure 13A] 1 illustrates an exemplary user interface that dynamically provides user interface control on a touch-sensitive secondary display, according to some embodiments. [Figure 13B] 1 illustrates an exemplary user interface that dynamically provides user interface control on a touch-sensitive secondary display, according to some embodiments. [Figure 13C] 1 illustrates an exemplary user interface that dynamically provides user interface control on a touch-sensitive secondary display, according to some embodiments. [Figure 14A] 1 illustrates an exemplary user interface that dynamically provides user interface control on a touch-sensitive secondary display, according to some embodiments. [Figure 14B] 1 illustrates an exemplary user interface that dynamically provides user interface control on a touch-sensitive secondary display, according to some embodiments. [Figure 14C] 1 illustrates an exemplary user interface that dynamically provides user interface control on a touch-sensitive secondary display, according to some embodiments. [Figure 14D] 1 illustrates an exemplary user interface that dynamically provides user interface control on a touch-sensitive secondary display, according to some embodiments. [Figure 14E] 1 illustrates an exemplary user interface that dynamically provides user interface control on a touch-sensitive secondary display, according to some embodiments. [Figure 15A] 1 illustrates an exemplary user interface that dynamically provides user interface control on a touch-sensitive secondary display, according to some embodiments. [Figure 15B]1 illustrates an exemplary user interface that dynamically provides user interface control on a touch-sensitive secondary display, according to some embodiments. [Figure 15C] 1 illustrates an exemplary user interface that dynamically provides user interface control on a touch-sensitive secondary display, according to some embodiments. [Figure 15D] 1 illustrates an exemplary user interface that dynamically provides user interface control on a touch-sensitive secondary display, according to some embodiments. [Figure 15E] 1 illustrates an exemplary user interface that dynamically provides user interface control on a touch-sensitive secondary display, according to some embodiments. [Figure 15F] 1 illustrates an exemplary user interface that dynamically provides user interface control on a touch-sensitive secondary display, according to some embodiments. [Figure 15G] 1 illustrates an exemplary user interface that dynamically provides user interface control on a touch-sensitive secondary display, according to some embodiments. [Figure 15H] 1 illustrates an exemplary user interface that dynamically provides user interface control on a touch-sensitive secondary display, according to some embodiments. [Figure 16A] 1 illustrates an exemplary user interface that dynamically provides user interface control on a touch-sensitive secondary display, according to some embodiments. [Figure 16B] 1 illustrates an exemplary user interface that dynamically provides user interface control on a touch-sensitive secondary display, according to some embodiments. [Figure 16C] 1 illustrates an exemplary user interface that dynamically provides user interface control on a touch-sensitive secondary display, according to some embodiments. [Figure 16D]1 illustrates an exemplary user interface that dynamically provides user interface control on a touch-sensitive secondary display, according to some embodiments. [Figure 16E] 1 illustrates an exemplary user interface that dynamically provides user interface control on a touch-sensitive secondary display, according to some embodiments. [Figure 16F] 1 illustrates an exemplary user interface that dynamically provides user interface control on a touch-sensitive secondary display, according to some embodiments. [Figure 16G] 1 illustrates an exemplary user interface that dynamically provides user interface control on a touch-sensitive secondary display, according to some embodiments. [Figure 16H] 1 illustrates an exemplary user interface that dynamically provides user interface control on a touch-sensitive secondary display, according to some embodiments. [Figure 16I] 1 illustrates an exemplary user interface that dynamically provides user interface control on a touch-sensitive secondary display, according to some embodiments. [Figure 16J] 1 illustrates an exemplary user interface that dynamically provides user interface control on a touch-sensitive secondary display, according to some embodiments. [Figure 16K] 1 illustrates an exemplary user interface that dynamically provides user interface control on a touch-sensitive secondary display, according to some embodiments. [Figure 16L] 1 illustrates an exemplary user interface that dynamically provides user interface control on a touch-sensitive secondary display, according to some embodiments. [Figure 16M] 1 illustrates an exemplary user interface that dynamically provides user interface control on a touch-sensitive secondary display, according to some embodiments. [Figure 16N]1 illustrates an exemplary user interface that dynamically provides user interface control on a touch-sensitive secondary display, according to some embodiments. [Figure 16O] 1 illustrates an exemplary user interface that dynamically provides user interface control on a touch-sensitive secondary display, according to some embodiments. [Figure 16P] 1 illustrates an exemplary user interface that dynamically provides user interface control on a touch-sensitive secondary display, according to some embodiments. [Figure 16Q] 1 illustrates an exemplary user interface that dynamically provides user interface control on a touch-sensitive secondary display, according to some embodiments. [Figure 16R] 1 illustrates an exemplary user interface that dynamically provides user interface control on a touch-sensitive secondary display, according to some embodiments. [Figure 16S] 1 illustrates an exemplary user interface that dynamically provides user interface control on a touch-sensitive secondary display, according to some embodiments. [Figure 16T] 1 illustrates an exemplary user interface that dynamically provides user interface control on a touch-sensitive secondary display, according to some embodiments. [Figure 17A] 1 illustrates an exemplary user interface that dynamically provides user interface control on a touch-sensitive secondary display, according to some embodiments. [Figure 17B] 1 illustrates an exemplary user interface that dynamically provides user interface control on a touch-sensitive secondary display, according to some embodiments. [Figure 17C] 1 illustrates an exemplary user interface that dynamically provides user interface control on a touch-sensitive secondary display, according to some embodiments. [Figure 17D]1 illustrates an exemplary user interface that dynamically provides user interface control on a touch-sensitive secondary display, according to some embodiments. [Figure 17E] 1 illustrates an exemplary user interface that dynamically provides user interface control on a touch-sensitive secondary display, according to some embodiments. [Figure 17F] 1 illustrates an exemplary user interface that dynamically provides user interface control on a touch-sensitive secondary display, according to some embodiments. [Figure 17G] 1 illustrates an exemplary user interface that dynamically provides user interface control on a touch-sensitive secondary display, according to some embodiments. [Figure 18A] 1 illustrates an exemplary user interface that dynamically provides user interface control on a touch-sensitive secondary display, according to some embodiments. [Figure 18B] 1 illustrates an exemplary user interface that dynamically provides user interface control on a touch-sensitive secondary display, according to some embodiments. [Figure 18C] 1 illustrates an exemplary user interface that dynamically provides user interface control on a touch-sensitive secondary display, according to some embodiments. [Figure 18D] 1 illustrates an exemplary user interface that dynamically provides user interface control on a touch-sensitive secondary display, according to some embodiments. [Figure 18E] 1 illustrates an exemplary user interface that dynamically provides user interface control on a touch-sensitive secondary display, according to some embodiments. [Figure 18F] 1 illustrates an exemplary user interface that dynamically provides user interface control on a touch-sensitive secondary display, according to some embodiments. [Figure 18G]1 illustrates an exemplary user interface that dynamically provides user interface control on a touch-sensitive secondary display, according to some embodiments. [Figure 18H] 1 illustrates an exemplary user interface that dynamically provides user interface control on a touch-sensitive secondary display, according to some embodiments. [Figure 18I] 1 illustrates an exemplary user interface that dynamically provides user interface control on a touch-sensitive secondary display, according to some embodiments. [Figure 19A] 1 illustrates an exemplary user interface that dynamically provides user interface control on a touch-sensitive secondary display, according to some embodiments. [Figure 19B] 1 illustrates an exemplary user interface that dynamically provides user interface control on a touch-sensitive secondary display, according to some embodiments. [Figure 19C] 1 illustrates an exemplary user interface that dynamically provides user interface control on a touch-sensitive secondary display, according to some embodiments. [Figure 19D] 1 illustrates an exemplary user interface that dynamically provides user interface control on a touch-sensitive secondary display, according to some embodiments. [Figure 19E] 1 illustrates an exemplary user interface that dynamically provides user interface control on a touch-sensitive secondary display, according to some embodiments. [Figure 19F] 1 illustrates an exemplary user interface that dynamically provides user interface control on a touch-sensitive secondary display, according to some embodiments. [Figure 19G] 1 illustrates an exemplary user interface that dynamically provides user interface control on a touch-sensitive secondary display, according to some embodiments. [Figure 19H]1 illustrates an exemplary user interface that dynamically provides user interface control on a touch-sensitive secondary display, according to some embodiments. [Figure 19I] 1 illustrates an exemplary user interface that dynamically provides user interface control on a touch-sensitive secondary display, according to some embodiments. [Figure 19J] 1 illustrates an exemplary user interface that dynamically provides user interface control on a touch-sensitive secondary display, according to some embodiments. [Figure 19K] 1 illustrates an exemplary user interface that dynamically provides user interface control on a touch-sensitive secondary display, according to some embodiments. [Figure 20A] 1 illustrates an exemplary user interface that dynamically provides user interface control on a touch-sensitive secondary display, according to some embodiments. [Figure 20B] 1 illustrates an exemplary user interface that dynamically provides user interface control on a touch-sensitive secondary display, according to some embodiments. [Figure 20C] 1 illustrates an exemplary user interface that dynamically provides user interface control on a touch-sensitive secondary display, according to some embodiments. [Figure 20D] 1 illustrates an exemplary user interface that dynamically provides user interface control on a touch-sensitive secondary display, according to some embodiments. [Figure 20E] 1 illustrates an exemplary user interface that dynamically provides user interface control on a touch-sensitive secondary display, according to some embodiments. [Figure 20F] 1 illustrates an exemplary user interface that dynamically provides user interface control on a touch-sensitive secondary display, according to some embodiments. [Figure 20G]1 illustrates an exemplary user interface that dynamically provides user interface control on a touch-sensitive secondary display, according to some embodiments. [Figure 21A] 1 illustrates an exemplary user interface that dynamically provides user interface control on a touch-sensitive secondary display, according to some embodiments. [Figure 21B] 1 illustrates an exemplary user interface that dynamically provides user interface control on a touch-sensitive secondary display, according to some embodiments. [Figure 21C] 1 illustrates an exemplary user interface that dynamically provides user interface control on a touch-sensitive secondary display, according to some embodiments. [Figure 21D] 1 illustrates an exemplary user interface that dynamically provides user interface control on a touch-sensitive secondary display, according to some embodiments. [Figure 21E] 1 illustrates an exemplary user interface that dynamically provides user interface control on a touch-sensitive secondary display, according to some embodiments. [Figure 21F] 1 illustrates an exemplary user interface that dynamically provides user interface control on a touch-sensitive secondary display, according to some embodiments. [Figure 21G] 1 illustrates an exemplary user interface that dynamically provides user interface control on a touch-sensitive secondary display, according to some embodiments. [Figure 21H] 1 illustrates an exemplary user interface that dynamically provides user interface control on a touch-sensitive secondary display, according to some embodiments. [Figure 21I] 1 illustrates an exemplary user interface that dynamically provides user interface control on a touch-sensitive secondary display, according to some embodiments. [Figure 21J]1 illustrates an exemplary user interface that dynamically provides user interface control on a touch-sensitive secondary display, according to some embodiments. [Figure 22A] 1 illustrates an exemplary user interface that dynamically provides user interface control on a touch-sensitive secondary display, according to some embodiments. [Figure 22B] 1 illustrates an exemplary user interface that dynamically provides user interface control on a touch-sensitive secondary display, according to some embodiments. [Figure 22C] 1 illustrates an exemplary user interface that dynamically provides user interface control on a touch-sensitive secondary display, according to some embodiments. [Figure 23A] 1 illustrates an exemplary user interface that dynamically provides user interface control on a touch-sensitive secondary display, according to some embodiments. [Figure 23B] 1 illustrates an exemplary user interface that dynamically provides user interface control on a touch-sensitive secondary display, according to some embodiments. [Figure 24A] 1 illustrates an exemplary user interface that dynamically provides user interface control on a touch-sensitive secondary display, according to some embodiments. [Figure 24B] 1 illustrates an exemplary user interface that dynamically provides user interface control on a touch-sensitive secondary display, according to some embodiments. [Figure 24C] 1 illustrates an exemplary user interface that dynamically provides user interface control on a touch-sensitive secondary display, according to some embodiments. [Figure 24D] 1 illustrates an exemplary user interface that dynamically provides user interface control on a touch-sensitive secondary display, according to some embodiments. [Figure 24E]1 illustrates an exemplary user interface that dynamically provides user interface control on a touch-sensitive secondary display, according to some embodiments. [Figure 24F] 1 illustrates an exemplary user interface that dynamically provides user interface control on a touch-sensitive secondary display, according to some embodiments. [Figure 24G] 1 illustrates an exemplary user interface that dynamically provides user interface control on a touch-sensitive secondary display, according to some embodiments. [Figure 24H] 1 illustrates an exemplary user interface that dynamically provides user interface control on a touch-sensitive secondary display, according to some embodiments. [Figure 24I] 1 illustrates an exemplary user interface that dynamically provides user interface control on a touch-sensitive secondary display, according to some embodiments. [Figure 24J] 1 illustrates an exemplary user interface that dynamically provides user interface control on a touch-sensitive secondary display, according to some embodiments. [Figure 24K] 1 illustrates an exemplary user interface that dynamically provides user interface control on a touch-sensitive secondary display, according to some embodiments. [Figure 24L] 1 illustrates an exemplary user interface that dynamically provides user interface control on a touch-sensitive secondary display, according to some embodiments. [Figure 24M] 1 illustrates an exemplary user interface that dynamically provides user interface control on a touch-sensitive secondary display, according to some embodiments. [Figure 24N] 1 illustrates an exemplary user interface that dynamically provides user interface control on a touch-sensitive secondary display, according to some embodiments. [Figure 25A]1 illustrates an exemplary user interface that dynamically provides user interface control on a touch-sensitive secondary display, according to some embodiments. [Figure 25B] 1 illustrates an exemplary user interface that dynamically provides user interface control on a touch-sensitive secondary display, according to some embodiments. [Figure 25C] 1 illustrates an exemplary user interface that dynamically provides user interface control on a touch-sensitive secondary display, according to some embodiments. [Figure 26A] 1 illustrates an exemplary user interface that dynamically provides user interface control on a touch-sensitive secondary display, according to some embodiments. [Figure 26B] 1 illustrates an exemplary user interface that dynamically provides user interface control on a touch-sensitive secondary display, according to some embodiments. [Figure 26C] 1 illustrates an exemplary user interface that dynamically provides user interface control on a touch-sensitive secondary display, according to some embodiments. [Figure 26D] 1 illustrates an exemplary user interface that dynamically provides user interface control on a touch-sensitive secondary display, according to some embodiments. [Figure 26E] 1 illustrates an exemplary user interface that dynamically provides user interface control on a touch-sensitive secondary display, according to some embodiments. [Figure 27A] 1 illustrates an exemplary user interface that dynamically provides user interface control on a touch-sensitive secondary display, according to some embodiments. [Figure 27B] 1 illustrates an exemplary user interface that dynamically provides user interface control on a touch-sensitive secondary display, according to some embodiments. [Figure 27C]1 illustrates an exemplary user interface that dynamically provides user interface control on a touch-sensitive secondary display, according to some embodiments. [Figure 27D] 1 illustrates an exemplary user interface that dynamically provides user interface control on a touch-sensitive secondary display, according to some embodiments. [Figure 27E] 1 illustrates an exemplary user interface that dynamically provides user interface control on a touch-sensitive secondary display, according to some embodiments. [Figure 27F] 1 illustrates an exemplary user interface that dynamically provides user interface control on a touch-sensitive secondary display, according to some embodiments. [Figure 27G] 1 illustrates an exemplary user interface that dynamically provides user interface control on a touch-sensitive secondary display, according to some embodiments. [Figure 27H] 1 illustrates an exemplary user interface that dynamically provides user interface control on a touch-sensitive secondary display, according to some embodiments. [Figure 27I] 1 illustrates an exemplary user interface that dynamically provides user interface control on a touch-sensitive secondary display, according to some embodiments. [Figure 27J] 1 illustrates an exemplary user interface that dynamically provides user interface control on a touch-sensitive secondary display, according to some embodiments. [Figure 27K] 1 illustrates an exemplary user interface that dynamically provides user interface control on a touch-sensitive secondary display, according to some embodiments. [Figure 27L] 1 illustrates an exemplary user interface that dynamically provides user interface control on a touch-sensitive secondary display, according to some embodiments. [Figure 27M]1 illustrates an exemplary user interface that dynamically provides user interface control on a touch-sensitive secondary display, according to some embodiments. [Figure 27N] 1 illustrates an exemplary user interface that dynamically provides user interface control on a touch-sensitive secondary display, according to some embodiments. [Figure 27O] 1 illustrates an exemplary user interface that dynamically provides user interface control on a touch-sensitive secondary display, according to some embodiments. [Figure 28A] 1 illustrates an exemplary user interface that dynamically provides user interface control on a touch-sensitive secondary display, according to some embodiments. [Figure 28B] 1 illustrates an exemplary user interface that dynamically provides user interface control on a touch-sensitive secondary display, according to some embodiments. [Figure 28C] 1 illustrates an exemplary user interface that dynamically provides user interface control on a touch-sensitive secondary display, according to some embodiments. [Figure 28D] 1 illustrates an exemplary user interface that dynamically provides user interface control on a touch-sensitive secondary display, according to some embodiments. [Figure 28E] 1 illustrates an exemplary user interface that dynamically provides user interface control on a touch-sensitive secondary display, according to some embodiments. [Figure 28F] 1 illustrates an exemplary user interface that dynamically provides user interface control on a touch-sensitive secondary display, according to some embodiments. [Figure 28G] 1 illustrates an exemplary user interface that dynamically provides user interface control on a touch-sensitive secondary display, according to some embodiments. [Figure 28H]1 illustrates an exemplary user interface that dynamically provides user interface control on a touch-sensitive secondary display, according to some embodiments. [Figure 28I] 1 illustrates an exemplary user interface that dynamically provides user interface control on a touch-sensitive secondary display, according to some embodiments. [Figure 28J] 1 illustrates an exemplary user interface that dynamically provides user interface control on a touch-sensitive secondary display, according to some embodiments. [Figure 28K] 1 illustrates an exemplary user interface that dynamically provides user interface control on a touch-sensitive secondary display, according to some embodiments. [Figure 28L] 1 illustrates an exemplary user interface that dynamically provides user interface control on a touch-sensitive secondary display, according to some embodiments. [Figure 28M] 1 illustrates an exemplary user interface that dynamically provides user interface control on a touch-sensitive secondary display, according to some embodiments. [Figure 28N] 1 illustrates an exemplary user interface that dynamically provides user interface control on a touch-sensitive secondary display, according to some embodiments. [Figure 28O] 1 illustrates an exemplary user interface that dynamically provides user interface control on a touch-sensitive secondary display, according to some embodiments. [Figure 28P] 1 illustrates an exemplary user interface that dynamically provides user interface control on a touch-sensitive secondary display, according to some embodiments. [Figure 29A] 1 illustrates an exemplary user interface that dynamically provides user interface control on a touch-sensitive secondary display, according to some embodiments. [Figure 29B]1 illustrates an exemplary user interface that dynamically provides user interface control on a touch-sensitive secondary display, according to some embodiments. [Figure 29C] 1 illustrates an exemplary user interface that dynamically provides user interface control on a touch-sensitive secondary display, according to some embodiments. [Figure 29D] 1 illustrates an exemplary user interface that dynamically provides user interface control on a touch-sensitive secondary display, according to some embodiments. [Figure 29E] 1 illustrates an exemplary user interface that dynamically provides user interface control on a touch-sensitive secondary display, according to some embodiments. [Figure 29F] 1 illustrates an exemplary user interface that dynamically provides user interface control on a touch-sensitive secondary display, according to some embodiments. [Figure 29G] 1 illustrates an exemplary user interface that dynamically provides user interface control on a touch-sensitive secondary display, according to some embodiments. [Figure 29H] 1 illustrates an exemplary user interface that dynamically provides user interface control on a touch-sensitive secondary display, according to some embodiments. [Figure 29I] 1 illustrates an exemplary user interface that dynamically provides user interface control on a touch-sensitive secondary display, according to some embodiments. [Figure 29J] 1 illustrates an exemplary user interface that dynamically provides user interface control on a touch-sensitive secondary display, according to some embodiments. [Figure 29K] 1 illustrates an exemplary user interface that dynamically provides user interface control on a touch-sensitive secondary display, according to some embodiments. [Figure 29L]1 illustrates an exemplary user interface that dynamically provides user interface control on a touch-sensitive secondary display, according to some embodiments. [Figure 29M] 1 illustrates an exemplary user interface that dynamically provides user interface control on a touch-sensitive secondary display, according to some embodiments. [Figure 29N] 1 illustrates an exemplary user interface that dynamically provides user interface control on a touch-sensitive secondary display, according to some embodiments. [Figure 29O] 1 illustrates an exemplary user interface that dynamically provides user interface control on a touch-sensitive secondary display, according to some embodiments. [Figure 29P] 1 illustrates an exemplary user interface that dynamically provides user interface control on a touch-sensitive secondary display, according to some embodiments. [Figure 29Q] 1 illustrates an exemplary user interface that dynamically provides user interface control on a touch-sensitive secondary display, according to some embodiments. [Figure 29R] 1 illustrates an exemplary user interface that dynamically provides user interface control on a touch-sensitive secondary display, according to some embodiments. [Figure 29S] 1 illustrates an exemplary user interface that dynamically provides user interface control on a touch-sensitive secondary display, according to some embodiments. [Figure 29T] 1 illustrates an exemplary user interface that dynamically provides user interface control on a touch-sensitive secondary display, according to some embodiments. [Figure 30A] 1 illustrates an exemplary user interface that dynamically provides user interface control on a touch-sensitive secondary display, according to some embodiments. [Figure 30B]1 illustrates an exemplary user interface that dynamically provides user interface control on a touch-sensitive secondary display, according to some embodiments. [Figure 30C] 1 illustrates an exemplary user interface that dynamically provides user interface control on a touch-sensitive secondary display, according to some embodiments. [Figure 30D] 1 illustrates an exemplary user interface that dynamically provides user interface control on a touch-sensitive secondary display, according to some embodiments. [Figure 30E] 1 illustrates an exemplary user interface that dynamically provides user interface control on a touch-sensitive secondary display, according to some embodiments. [Figure 30F] 1 illustrates an exemplary user interface that dynamically provides user interface control on a touch-sensitive secondary display, according to some embodiments. [Figure 31A] 1 illustrates an exemplary user interface that dynamically provides user interface control on a touch-sensitive secondary display, according to some embodiments. [Figure 31B] 1 illustrates an exemplary user interface that dynamically provides user interface control on a touch-sensitive secondary display, according to some embodiments. [Figure 32A] 1 illustrates an exemplary user interface that dynamically provides user interface control on a touch-sensitive secondary display, according to some embodiments. [Figure 32B] 1 illustrates an exemplary user interface that dynamically provides user interface control on a touch-sensitive secondary display, according to some embodiments. [Figure 32C] 1 illustrates an exemplary user interface that dynamically provides user interface control on a touch-sensitive secondary display, according to some embodiments. [Figure 32D]1 illustrates an exemplary user interface that dynamically provides user interface control on a touch-sensitive secondary display, according to some embodiments. [Figure 32E] 1 illustrates an exemplary user interface that dynamically provides user interface control on a touch-sensitive secondary display, according to some embodiments. [Figure 33A] 1 illustrates an exemplary user interface that dynamically provides user interface control on a touch-sensitive secondary display, according to some embodiments. [Figure 33B] 1 illustrates an exemplary user interface that dynamically provides user interface control on a touch-sensitive secondary display, according to some embodiments. [Figure 33C] 1 illustrates an exemplary user interface that dynamically provides user interface control on a touch-sensitive secondary display, according to some embodiments. [Figure 33D] 1 illustrates an exemplary user interface that dynamically provides user interface control on a touch-sensitive secondary display, according to some embodiments. [Figure 33E] 1 illustrates an exemplary user interface that dynamically provides user interface control on a touch-sensitive secondary display, according to some embodiments. [Figure 33F] 1 illustrates an exemplary user interface that dynamically provides user interface control on a touch-sensitive secondary display, according to some embodiments. [Figure 33G] 1 illustrates an exemplary user interface that dynamically provides user interface control on a touch-sensitive secondary display, according to some embodiments. [Figure 33H] 1 illustrates an exemplary user interface that dynamically provides user interface control on a touch-sensitive secondary display, according to some embodiments. [Figure 33I]1 illustrates an exemplary user interface that dynamically provides user interface control on a touch-sensitive secondary display, according to some embodiments. [Figure 33J] 1 illustrates an exemplary user interface that dynamically provides user interface control on a touch-sensitive secondary display, according to some embodiments. [Figure 33K] 1 illustrates an exemplary user interface that dynamically provides user interface control on a touch-sensitive secondary display, according to some embodiments. [Figure 34A] 1 illustrates an exemplary user interface that dynamically provides user interface control on a touch-sensitive secondary display, according to some embodiments. [Figure 34B] 1 illustrates an exemplary user interface that dynamically provides user interface control on a touch-sensitive secondary display, according to some embodiments. [Figure 34C] 1 illustrates an exemplary user interface that dynamically provides user interface control on a touch-sensitive secondary display, according to some embodiments. [Figure 35A] 1 illustrates an exemplary user interface that dynamically provides user interface control on a touch-sensitive secondary display, according to some embodiments. [Figure 35B] 1 illustrates an exemplary user interface that dynamically provides user interface control on a touch-sensitive secondary display, according to some embodiments. [Figure 36A] 1 illustrates an exemplary user interface that dynamically provides user interface control on a touch-sensitive secondary display, according to some embodiments. [Figure 36B] 1 illustrates an exemplary user interface that dynamically provides user interface control on a touch-sensitive secondary display, according to some embodiments. [Figure 36C]1 illustrates an exemplary user interface that dynamically provides user interface control on a touch-sensitive secondary display, according to some embodiments. [Figure 36D] 1 illustrates an exemplary user interface that dynamically provides user interface control on a touch-sensitive secondary display, according to some embodiments. [Figure 36E] 1 illustrates an exemplary user interface that dynamically provides user interface control on a touch-sensitive secondary display, according to some embodiments. [Figure 36F] 1 illustrates an exemplary user interface that dynamically provides user interface control on a touch-sensitive secondary display, according to some embodiments. [Figure 36G] 1 illustrates an exemplary user interface that dynamically provides user interface control on a touch-sensitive secondary display, according to some embodiments. [Figure 36H] 1 illustrates an exemplary user interface that dynamically provides user interface control on a touch-sensitive secondary display, according to some embodiments. [Figure 36I] 1 illustrates an exemplary user interface that dynamically provides user interface control on a touch-sensitive secondary display, according to some embodiments. [Figure 36J] 1 illustrates an exemplary user interface that dynamically provides user interface control on a touch-sensitive secondary display, according to some embodiments. [Figure 36K] 1 illustrates an exemplary user interface that dynamically provides user interface control on a touch-sensitive secondary display, according to some embodiments. [Figure 36L] 1 illustrates an exemplary user interface that dynamically provides user interface control on a touch-sensitive secondary display, according to some embodiments. [Figure 36M]1 illustrates an exemplary user interface that dynamically provides user interface control on a touch-sensitive secondary display, according to some embodiments. [Figure 36N] 1 illustrates an exemplary user interface that dynamically provides user interface control on a touch-sensitive secondary display, according to some embodiments. [Figure 36O] 1 illustrates an exemplary user interface that dynamically provides user interface control on a touch-sensitive secondary display, according to some embodiments. [Figure 36P] 1 illustrates an exemplary user interface that dynamically provides user interface control on a touch-sensitive secondary display, according to some embodiments. [Figure 36Q] 1 illustrates an exemplary user interface that dynamically provides user interface control on a touch-sensitive secondary display, according to some embodiments. [Figure 36R] 1 illustrates an exemplary user interface that dynamically provides user interface control on a touch-sensitive secondary display, according to some embodiments. [Figure 36S] 1 illustrates an exemplary user interface that dynamically provides user interface control on a touch-sensitive secondary display, according to some embodiments. [Figure 36T] 1 illustrates an exemplary user interface that dynamically provides user interface control on a touch-sensitive secondary display, according to some embodiments. [Figure 36U] 1 illustrates an exemplary user interface that dynamically provides user interface control on a touch-sensitive secondary display, according to some embodiments. [Figure 36V] 1 illustrates an exemplary user interface that dynamically provides user interface control on a touch-sensitive secondary display, according to some embodiments. [Figure 36W]1 illustrates an exemplary user interface that dynamically provides user interface control on a touch-sensitive secondary display, according to some embodiments. [Figure 37A] 1 illustrates an exemplary user interface that dynamically provides user interface control on a touch-sensitive secondary display, according to some embodiments. [Figure 37B] 1 illustrates an exemplary user interface that dynamically provides user interface control on a touch-sensitive secondary display, according to some embodiments. [Figure 37C] 1 illustrates an exemplary user interface that dynamically provides user interface control on a touch-sensitive secondary display, according to some embodiments. [Figure 37D] 1 illustrates an exemplary user interface that dynamically provides user interface control on a touch-sensitive secondary display, according to some embodiments. [Figure 37E] 1 illustrates an exemplary user interface that dynamically provides user interface control on a touch-sensitive secondary display, according to some embodiments. [Figure 37F] 1 illustrates an exemplary user interface that dynamically provides user interface control on a touch-sensitive secondary display, according to some embodiments. [Figure 37G] 1 illustrates an exemplary user interface that dynamically provides user interface control on a touch-sensitive secondary display, according to some embodiments. [Figure 37H] 1 illustrates an exemplary user interface that dynamically provides user interface control on a touch-sensitive secondary display, according to some embodiments. [Figure 37I] 1 illustrates an exemplary user interface that dynamically provides user interface control on a touch-sensitive secondary display, according to some embodiments. [Figure 37J]1 illustrates an exemplary user interface that dynamically provides user interface control on a touch-sensitive secondary display, according to some embodiments. [Figure 37K] 1 illustrates an exemplary user interface that dynamically provides user interface control on a touch-sensitive secondary display, according to some embodiments. [Figure 37L] 1 illustrates an exemplary user interface that dynamically provides user interface control on a touch-sensitive secondary display, according to some embodiments. [Figure 37M] 1 illustrates an exemplary user interface that dynamically provides user interface control on a touch-sensitive secondary display, according to some embodiments. [Figure 38A] 1 illustrates an exemplary user interface that dynamically provides user interface control on a touch-sensitive secondary display, according to some embodiments. [Figure 38B] 1 illustrates an exemplary user interface that dynamically provides user interface control on a touch-sensitive secondary display, according to some embodiments. [Figure 38C] 1 illustrates an exemplary user interface that dynamically provides user interface control on a touch-sensitive secondary display, according to some embodiments. [Figure 38D] 1 illustrates an exemplary user interface that dynamically provides user interface control on a touch-sensitive secondary display, according to some embodiments. [Figure 38E] 1 illustrates an exemplary user interface that dynamically provides user interface control on a touch-sensitive secondary display, according to some embodiments. [Figure 38F] 1 illustrates an exemplary user interface that dynamically provides user interface control on a touch-sensitive secondary display, according to some embodiments. [Figure 38G]1 illustrates an exemplary user interface that dynamically provides user interface control on a touch-sensitive secondary display, according to some embodiments. [Figure 38H] 1 illustrates an exemplary user interface that dynamically provides user interface control on a touch-sensitive secondary display, according to some embodiments. [Figure 38I] 1 illustrates an exemplary user interface that dynamically provides user interface control on a touch-sensitive secondary display, according to some embodiments. [Figure 38J] 1 illustrates an exemplary user interface that dynamically provides user interface control on a touch-sensitive secondary display, according to some embodiments. [Figure 39] 1 illustrates an exemplary user interface that dynamically provides user interface control on a touch-sensitive secondary display, according to some embodiments. [Figure 40] 1 illustrates an exemplary user interface that dynamically provides user interface control on a touch-sensitive secondary display, according to some embodiments. [Figure 41A] 1 illustrates an exemplary user interface that dynamically provides user interface control on a touch-sensitive secondary display, according to some embodiments. [Figure 41B] 1 illustrates an exemplary user interface that dynamically provides user interface control on a touch-sensitive secondary display, according to some embodiments. [Figure 41C] 1 illustrates an exemplary user interface that dynamically provides user interface control on a touch-sensitive secondary display, according to some embodiments. [Figure 41D] 1 illustrates an exemplary user interface that dynamically provides user interface control on a touch-sensitive secondary display, according to some embodiments. [Figure 41E]1 illustrates an exemplary user interface that dynamically provides user interface control on a touch-sensitive secondary display, according to some embodiments. [Figure 42A] 1 illustrates an exemplary user interface that dynamically provides user interface control on a touch-sensitive secondary display, according to some embodiments. [Figure 42B] 1 illustrates an exemplary user interface that dynamically provides user interface control on a touch-sensitive secondary display, according to some embodiments. [Figure 43A] 1 illustrates an exemplary user interface that dynamically provides user interface control on a touch-sensitive secondary display, according to some embodiments. [Figure 43B] 1 illustrates an exemplary user interface that dynamically provides user interface control on a touch-sensitive secondary display, according to some embodiments. [Figure 43C] 1 illustrates an exemplary user interface that dynamically provides user interface control on a touch-sensitive secondary display, according to some embodiments. [Figure 43D] 1 illustrates an exemplary user interface that dynamically provides user interface control on a touch-sensitive secondary display, according to some embodiments. [Figure 44A] FIG. 1 is a flow diagram of a method for updating dynamic input and output devices, according to some embodiments. [Figure 44B] FIG. 1 is a flow diagram of a method for updating dynamic input and output devices, according to some embodiments. [Figure 44C] FIG. 1 is a flow diagram of a method for updating dynamic input and output devices, according to some embodiments. [Figure 44D] FIG. 1 is a flow diagram of a method for updating dynamic input and output devices, according to some embodiments. [Figure 45A] FIG. 1 is a flow diagram of a method for updating dynamic input and output devices, according to some embodiments. [Figure 45B] FIG. 1 is a flow diagram of a method for updating dynamic input and output devices, according to some embodiments. [Figure 45C] FIG. 1 is a flow diagram of a method for updating dynamic input and output devices, according to some embodiments. [Figure 46A] FIG. 1 is a flow diagram of a method for maintaining application functionality while in full-screen mode, according to some embodiments. [Figure 46B] FIG. 1 is a flow diagram of a method for maintaining application functionality while in full-screen mode, according to some embodiments. [Figure 47A] FIG. 1 is a flow diagram of a method for displaying notifications on a touchscreen display, according to some embodiments. [Figure 47B] FIG. 1 is a flow diagram of a method for displaying notifications on a touchscreen display, according to some embodiments. [Figure 48A] FIG. 1 is a flow diagram of a method for moving a user interface portion according to some embodiments. [Figure 48B] FIG. 1 is a flow diagram of a method for moving a user interface portion according to some embodiments. [Figure 48C] FIG. 1 is a flow diagram of a method for moving a user interface portion according to some embodiments. [Figure 49] FIG. 1 is a flow diagram of a method for browsing user interface objects on a primary display by providing input at a touch-sensitive secondary display, according to some embodiments. [Figure 50] FIG. 1 is a flow diagram of a method for browsing search results on a primary display by providing input on a touch-sensitive secondary display, according to some embodiments. [Figure 51] FIG. 10 is a flow diagram of a method for modifying event details displayed on a primary display by providing input on a touch-sensitive secondary display, according to some embodiments. [Figure 52] FIG. 1 is a flow diagram of a method for presenting actionable information on a touch-sensitive secondary display about external devices connected to a computing system including the touch-sensitive secondary display, according to some embodiments. [Figure 53] FIG. 1 is a flow diagram of a method for previewing text displayed in an application on a primary display by providing input on a touch-sensitive secondary display, according to some embodiments. [Figure 54] FIG. 1 is a flow diagram of a method for modifying visual characteristics used to render content in a content editing application on a primary display by providing input on a touch-sensitive secondary display, according to some embodiments. [Figure 55] 1 illustrates a functional block diagram of an electronic device, according to some embodiments. [Figure 56] 1 illustrates a functional block diagram of an electronic device, according to some embodiments. [Figure 57] 1 illustrates a functional block diagram of an electronic device, according to some embodiments. [Figure 58] 1 illustrates a functional block diagram of an electronic device, according to some embodiments. [Figure 59] 1 illustrates a functional block diagram of an electronic device, according to some embodiments. [Figure 60] 1 illustrates a functional block diagram of an electronic device, according to some embodiments. [Figure 61] 1 illustrates a functional block diagram of an electronic device, according to some embodiments. [Figure 62] 1 illustrates a functional block diagram of an electronic device, according to some embodiments. [Figure 63] 1 illustrates a functional block diagram of an electronic device, according to some embodiments. [Figure 64] 1 illustrates a functional block diagram of an electronic device, according to some embodiments. [Figure 65]1 illustrates a functional block diagram of an electronic device, according to some embodiments. [Figure 66] FIG. 1 is a flow diagram of a method for using a biometric sensor to enable efficient login, according to some embodiments. [Figure 67] FIG. 1 is a flow diagram of a method for using a biometric sensor to enable efficient fast switching between logged-in user accounts, according to some embodiments. [Figure 68] 1 illustrates a functional block diagram of an electronic device, according to some embodiments. [Figure 69] 1 illustrates a functional block diagram of an electronic device, according to some embodiments. [Figure 70A] FIG. 1 is a schematic diagram of a primary display and a touch-sensitive secondary display used to illustrate a user interface that dynamically provides controls on the touch-sensitive secondary display for use with a map application, according to some embodiments. [Figure 70B] FIG. 1 is a schematic diagram of a primary display and a touch-sensitive secondary display used to illustrate a user interface that dynamically provides controls on the touch-sensitive secondary display for use with a map application, according to some embodiments. [Figure 70C] FIG. 1 is a schematic diagram of a touch-sensitive secondary display used to illustrate a user interface that dynamically provides controls on the touch-sensitive secondary display for use with a map application, according to some embodiments. [Figure 70D] FIG. 1 is a schematic diagram of a touch-sensitive secondary display used to illustrate a user interface that dynamically provides controls on the touch-sensitive secondary display for use with a map application, according to some embodiments. [Figure 71A]FIG. 1 is a schematic diagram of a primary display and a touch-sensitive secondary display used to illustrate a user interface that dynamically provides controls on the touch-sensitive secondary display for use with a video editing application, according to some embodiments. [Figure 71B] FIG. 1 is a schematic diagram of a primary display and a touch-sensitive secondary display used to illustrate a user interface that dynamically provides controls on the touch-sensitive secondary display for use with a video editing application, according to some embodiments. [Figure 71C] FIG. 1 is a schematic diagram of a touch-sensitive secondary display used to illustrate a user interface that dynamically provides controls on a touch-sensitive secondary display for use with a video editing application, according to some embodiments. [Figure 71D1] FIG. 1 is a schematic diagram of a touch-sensitive secondary display used to illustrate a user interface that dynamically provides controls on a touch-sensitive secondary display for use with a video editing application, according to some embodiments. [Figure 71D2] FIG. 1 is a schematic diagram of a touch-sensitive secondary display used to illustrate a user interface that dynamically provides controls on a touch-sensitive secondary display for use with a video editing application, according to some embodiments. [Figure 71E] FIG. 1 is a schematic diagram of a touch-sensitive secondary display used to illustrate a user interface that dynamically provides controls on a touch-sensitive secondary display for use with a video editing application, according to some embodiments. [Figure 71F] FIG. 1 is a schematic diagram of a touch-sensitive secondary display used to illustrate a user interface that dynamically provides controls on a touch-sensitive secondary display for use with a video editing application, according to some embodiments. [Figure 71G]FIG. 1 is a schematic diagram of a touch-sensitive secondary display used to illustrate a user interface that dynamically provides controls on a touch-sensitive secondary display for use with a video editing application, according to some embodiments. [Figure 71H] FIG. 1 is a schematic diagram of a touch-sensitive secondary display used to illustrate a user interface that dynamically provides controls on a touch-sensitive secondary display for use with a video editing application, according to some embodiments. [Figure 71I] FIG. 1 is a schematic diagram of a touch-sensitive secondary display used to illustrate a user interface that dynamically provides controls on a touch-sensitive secondary display for use with a video editing application, according to some embodiments. [Figure 71J] FIG. 1 is a schematic diagram of a touch-sensitive secondary display used to illustrate a user interface that dynamically provides controls on a touch-sensitive secondary display for use with a video editing application, according to some embodiments. [Figure 71K] FIG. 1 is a schematic diagram of a touch-sensitive secondary display used to illustrate a user interface that dynamically provides controls on a touch-sensitive secondary display for use with a video editing application, according to some embodiments. [Figure 71L] FIG. 1 is a schematic diagram of a touch-sensitive secondary display used to illustrate a user interface that dynamically provides controls on a touch-sensitive secondary display for use with a video editing application, according to some embodiments. [Figure 71M] FIG. 1 is a schematic diagram of a touch-sensitive secondary display used to illustrate a user interface that dynamically provides controls on a touch-sensitive secondary display for use with a video editing application, according to some embodiments. [Figure 72A]FIG. 1 is a schematic diagram of a primary display and a touch-sensitive secondary display used to present a user interface that dynamically provides controls for use with a video editing application, according to some embodiments. [Figure 72B] FIG. 1 is a schematic diagram of a touch-sensitive secondary display used to present a user interface that dynamically provides controls for use with a video editing application, according to some embodiments. [Figure 72C1] FIG. 1 is a schematic diagram of a touch-sensitive secondary display used to present a user interface that dynamically provides controls for use with a video editing application, according to some embodiments. [Figure 72C2] FIG. 1 is a schematic diagram of a touch-sensitive secondary display used to present a user interface that dynamically provides controls for use with a video editing application, according to some embodiments. [Figure 72D] FIG. 1 is a schematic diagram of a touch-sensitive secondary display used to present a user interface that dynamically provides controls for use with a video editing application, according to some embodiments. [Figure 72E] FIG. 1 is a schematic diagram of a touch-sensitive secondary display used to present a user interface that dynamically provides controls for use with a video editing application, according to some embodiments. [Figure 72F] FIG. 1 is a schematic diagram of a touch-sensitive secondary display used to present a user interface that dynamically provides controls for use with a video editing application, according to some embodiments. [Figure 72G] FIG. 1 is a schematic diagram of a touch-sensitive secondary display used to present a user interface that dynamically provides controls for use with a video editing application, according to some embodiments. [Figure 72H]FIG. 1 is a schematic diagram of a touch-sensitive secondary display used to present a user interface that dynamically provides controls for use with a video editing application, according to some embodiments. [Figure 72I] FIG. 1 is a schematic diagram of a touch-sensitive secondary display used to present a user interface that dynamically provides controls for use with a video editing application, according to some embodiments. [Figure 72J] FIG. 1 is a schematic diagram of a touch-sensitive secondary display used to present a user interface that dynamically provides controls for use with a video editing application, according to some embodiments. [Figure 72K] FIG. 1 is a schematic diagram of a touch-sensitive secondary display used to present a user interface that dynamically provides controls for use with a video editing application, according to some embodiments. [Figure 73A] FIG. 1 is a schematic diagram of a touch-sensitive secondary display used to present a user interface that dynamically provides controls for use with a video editing application, according to some embodiments. [Figure 73B] FIG. 1 is a schematic diagram of a touch-sensitive secondary display used to present a user interface that dynamically provides controls for use with a video editing application, according to some embodiments. [Figure 73C] FIG. 1 is a schematic diagram of a touch-sensitive secondary display used to present a user interface that dynamically provides controls for use with a video editing application, according to some embodiments. [Figure 73D] FIG. 1 is a schematic diagram of a touch-sensitive secondary display used to present a user interface that dynamically provides controls for use with a video editing application, according to some embodiments. [Figure 73E]FIG. 1 is a schematic diagram of a touch-sensitive secondary display used to present a user interface that dynamically provides controls for use with a video editing application, according to some embodiments. [Figure 73F] FIG. 1 is a schematic diagram of a touch-sensitive secondary display used to present a user interface that dynamically provides controls for use with a video editing application, according to some embodiments. [Figure 73G] FIG. 1 is a schematic diagram of a touch-sensitive secondary display used to present a user interface that dynamically provides controls for use with a video editing application, according to some embodiments. [Figure 73H] FIG. 1 is a schematic diagram of a touch-sensitive secondary display used to present a user interface that dynamically provides controls for use with a video editing application, according to some embodiments. [Figure 73I] FIG. 1 is a schematic diagram of a touch-sensitive secondary display used to present a user interface that dynamically provides controls for use with a video editing application, according to some embodiments. [Figure 73J] FIG. 1 is a schematic diagram of a touch-sensitive secondary display used to present a user interface that dynamically provides controls for use with a video editing application, according to some embodiments. [Figure 73K] FIG. 1 is a schematic diagram of a touch-sensitive secondary display used to present a user interface that dynamically provides controls for use with a video editing application, according to some embodiments. [Figure 73L] FIG. 1 is a schematic diagram of a touch-sensitive secondary display used to present a user interface that dynamically provides controls for use with a video editing application, according to some embodiments. [Figure 73M]FIG. 1 is a schematic diagram of a touch-sensitive secondary display used to present a user interface that dynamically provides controls for use with a video editing application, according to some embodiments. [Figure 73N] FIG. 1 is a schematic diagram of a touch-sensitive secondary display used to present a user interface that dynamically provides controls for use with a video editing application, according to some embodiments. [Figure 74A] FIG. 1 is a schematic diagram of a touch-sensitive secondary display used to present a user interface that dynamically provides controls for use with a video editing application, according to some embodiments. [Figure 74B] FIG. 1 is a schematic diagram of a touch-sensitive secondary display used to present a user interface that dynamically provides controls for use with a video editing application, according to some embodiments. [Figure 74C] FIG. 1 is a schematic diagram of a touch-sensitive secondary display used to present a user interface that dynamically provides controls for use with a video editing application, according to some embodiments. [Fig. 74D] FIG. 1 is a schematic diagram of a touch-sensitive secondary display used to present a user interface that dynamically provides controls for use with a video editing application, according to some embodiments. [Figure 74E] FIG. 1 is a schematic diagram of a touch-sensitive secondary display used to present a user interface that dynamically provides controls for use with a video editing application, according to some embodiments. [Figure 74F] FIG. 1 is a schematic diagram of a touch-sensitive secondary display used to present a user interface that dynamically provides controls for use with a video editing application, according to some embodiments. [Figure 74G]FIG. 1 is a schematic diagram of a touch-sensitive secondary display used to present a user interface that dynamically provides controls for use with a video editing application, according to some embodiments. [Figure 74H] FIG. 1 is a schematic diagram of a touch-sensitive secondary display used to present a user interface that dynamically provides controls for use with a video editing application, according to some embodiments. [Figure 75] 1A-1C are schematic diagrams illustrating example glyphs that may be displayed on a touch-sensitive secondary display for use with various video editing applications, according to some embodiments. DETAILED DESCRIPTION OF THE INVENTION
[0202] Figures 1A-1B, 2A-2D, 3A-3E, and 4 provide an example device description. Figures 5A-14E show an example user interface for updating dynamic input and output devices. Figures 44A-44D are a flow diagram of a method 600 for updating dynamic input and output devices. Figures 45A-45C are a flow diagram of a method 700 for updating dynamic input and output devices. Figures 46A-46B are a flow diagram of a method 800 for maintaining application functionality while in full-screen mode. Figures 47A-47B are a flow diagram of a method 900 for displaying notifications on a touchscreen display. Figures 48A-48C are a flow diagram of a method 1000 for moving user interface portions. The user interfaces of FIGS. 5A-14E are used to illustrate the methods and / or processes of FIGS. 44A-44D, 45A-45C, 46A-46B, 47A-47B, and 48A-48C.
[0203] Figures 49-54 and 66-67 include flow diagrams of methods for utilizing a touch-sensitive secondary display to enable efficient interaction in a computing system. The user interfaces of Figures 15A-43D are used to illustrate the methods and / or processes of Figures 49-54 and 66-67. Exemplary Devices and Systems
[0204] Reference will now be made in detail to the embodiments, examples of which are illustrated in the accompanying drawings. In the following detailed description, numerous specific details are set forth to provide a thorough understanding of the various embodiments being described. However, it will be apparent to those skilled in the art that the various embodiments being described may be practiced without these specific details. In other instances, well-known methods, procedures, components, circuits, and networks have not been described in detail so as not to unnecessarily obscure aspects of the embodiments.
[0205] In this specification, terms such as "first," "second," etc. are used in some instances to describe various elements, but it should be understood that these elements should not be limited by these terms. These terms are used only to distinguish one element from another. For example, a first contact can be referred to as a second contact, and similarly, a second contact can be referred to as a first contact, without departing from the scope of the various embodiments described. Although a first contact and a second contact are both contacts, they are not the same contact.
[0206] The terminology used in the description of the various embodiments described herein is for the purpose of describing particular embodiments only and is not intended to be limiting. As used in the description of the various embodiments described and in the appended claims, the singular forms "a," "an," and "the" are intended to include the plural forms as well, unless the context clearly dictates otherwise. As used herein, the term "and / or" should also be understood to refer to and include any and all possible combinations of one or more of the associated listed items. It should be further understood that the terms "includes," "including," "comprises," and / or "comprising," when used herein, specify the presence of stated features, integers, steps, operations, elements, and / or components, but do not exclude the presence or addition of one or more other features, integers, steps, operations, elements, components, and / or groups thereof.
[0207] As used herein, the term "if" is, optionally, interpreted to mean "when," "upon," "in response to determining," or "in response to detecting," depending on the context. Similarly, the phrases "if it is determined" or "if (a stated condition or event) is detected" are, optionally, interpreted to mean "upon determining" or "in response to determining," or "upon detecting (the stated condition or event)" or "in response to detecting (the stated condition or event)," depending on the context.
[0208] FIG. 1A is an exemplary diagram of a portable computing system 100 according to some embodiments. Portable computing system 100 may be, for example, a laptop computer such as a MACBOOK® device, or any other portable computing device. Portable computing system 100 includes (A) a display portion 110 (also referred to herein as first housing 110 or housing 110) with a primary display 102, and (B) a body portion 120 (also referred to herein as second housing 120 or housing 120) with a dynamic function row 104, a set of physical (i.e., movably actuated) keys 106, and a touchpad 108, which are partially contained within the same housing. Display portion 110 is typically mechanically, electrically, and communicatively coupled to body portion 120 of portable computing system 100. For example, portable computing system 100 may include a hinge, which allows display portion 110 to be rotated relative to body portion 120. Portable computing system 100 includes one or more processors and memory that stores one or more programs that the one or more processors execute to perform any of the embodiments described herein. In some embodiments, dynamic function row 104, described in more detail with reference to FIG. 1B, is a touchscreen display that uses resistive, acoustic, capacitive, optical, infrared, or other sensing to detect user touch inputs and selections. In some embodiments, primary display 102 of display portion 110 is also a touchscreen display.
[0209] 1B is an exemplary diagram of a body portion 120 of a portable computing system 100, according to some embodiments. The body portion 120 includes a set of physical keys 106 (also referred to herein as “physical keys 106” and “keyboard 106”), a dynamic function row 104, and a touchpad 108, all contained partially within the same housing. In some embodiments, the dynamic function row 104, which is a touchscreen, replaces the function row of the set of physical keys 106, which allows the space consumed by the set of physical keys 106 to be reduced, allows for a smaller overall body portion 120, or allows other portions, such as the touchpad 108, to be larger. In some embodiments, the length of the dynamic function row 104 is approximately 18 inches relative to the major dimension of the set of physical keys 106. While referred to as a “row” for ease of explanation, in some other embodiments, the touchscreen including the dynamic function row 104 of FIG. 1A may take any other form, such as a rectangle, a circle, multiple rows, a column, multiple columns, multiple separate sectors, etc. Although FIGS. 1A-1B show dynamic function row 104 replacing a function row of set of physical keys 106, in some other embodiments, dynamic function row 104 may additionally and / or alternatively replace a numeric keypad section, an edit / function section, etc. of set of physical keys 106.
[0210] Each physical key in the set of physical keys 106 has at least one associated input. The input may be a printable character, a non-printable character, a function, or other input. The input associated with a physical key may be indicated by a letter, word, symbol, or other indicia shown (e.g., printed) on the surface of the key in Latin, Arabic, Kanji, or any other script. For example, a particular physical key designated 138 is associated with the alphabetic character "z," as indicated by the letter z shown on the key. In another embodiment, a physical key labeled with the word "command" may be associated with a command function. For example, the set of physical keys 106 may be associated with a QWERTY, Dvorak, or other keyboard layout with alphanumeric, numeric, and / or edit / function sections (e.g., standard, extended, or compact) conforming to ISO / IEC 9995, ANSI-INCITS 154-1988, JIS X 6002-1980, or other similar standards.
[0211] A signal corresponding to an input associated with a physical key may be received by a processor of the portable computing system 100 (or the computing device 202 of FIGS. 2A-2D or the external keyboard 206 of FIGS. 2A-2B) when the key is activated by a user. In an exemplary embodiment, each key in the set of physical keys 106 includes two plates and a spring. A user can activate the key by pressing down on it, which compresses the spring. When the spring is compressed, the two plates can come into contact, which allows current to flow through the connected plates. An input corresponding to the key may be provided to the processor in response to the flow of current through the connected plates. For example, in response to activation of one of the set of keys 106 of the external keyboard 206 of FIG. 2C, an input corresponding to the activated key may be provided to the computing device 202. It will be appreciated that other systems for movably actuating keys may be used.
[0212] In some embodiments, dynamic function row 104 is a touchscreen display (also referred to herein as a touch-sensitive secondary display) that displays one or more user-selectable symbols 142 (sometimes referred to herein as “user interface elements,” “user interface components,” “affordances,” “buttons,” or “soft keys”). For example, dynamic function row 104 replaces the function row keys on a typical keyboard. A user can select a particular one of the one or more user-selectable symbols 142 by touching a location on the touchscreen display that corresponds to the particular one of the one or more user-selectable symbols 142. For example, a user can select a user-selectable symbol represented by a magnifying glass symbol 144 by tapping dynamic function row 104 so that the user's finger contacts dynamic function row 104 at the location of magnifying glass indicator 214. In some embodiments, a tap contact or tap gesture includes a touchdown of contact and a liftoff of contact within a predetermined time (e.g., 250 ms, etc.). In some embodiments, the touchscreen display of dynamic function row 104 is implemented using resistive sensing, acoustic sensing, capacitive sensing, optical sensing, infrared sensing, etc. to detect user inputs and selections.
[0213] When a user selects a particular symbol among one or more user-selectable symbols 142, a signal corresponding to the particular symbol among one or more user-selectable symbols 142 is generated by dynamic function row 104. For example, when a user taps "esc" on dynamic function row 104, dynamic function row 104 transmits a signal to a processor of portable computing system 100 (or to a processor of computing device 202 of FIGS. 2A-2D, or to a processor of external keyboard 206 of FIGS. 2A-2B, or to a processor of first input mechanism 212, FIG. 2C, or to a processor of external input mechanism 222, FIG. 2D) indicating a user input corresponding to the escape function.
[0214] In some embodiments, when a particular one of the one or more user-selectable symbols 142 is selected, dynamic function row 104 transmits to a processor of portable computing system 100 (or to a processor of computing device 202 of FIGS. 2A-2D , or to a processor of external keyboard 206 of FIGS. 2A-2B , or to a processor of first input mechanism 212, FIG. 2C , or to a processor of external input mechanism 222, FIG. 2D ) a signal corresponding to the location on the touchscreen display where the particular one of the one or more user-selectable symbols 142 is displayed. For example, dynamic function row 104 may transmit a signal including a position value (0-20) that depends on the location on the touchscreen display of the particular one of the selected user-selectable symbols 142. In the illustrative example of FIG. 1B , the “esc” symbol may have a position value of 0, the magnifying glass symbol 144 may have a position value of 16, etc. A processor of portable computing system 100 (or computing device 202 of FIGS. 2A-2D, or a processor of external keyboard 206 of FIGS. 2A-2B, or a processor of first input mechanism 212, FIG. 2C, or a processor of external input mechanism 222, FIG. 2D) may receive a signal indicating the position value of the selected user-selectable symbol and interpret the position value using contextual information, such as an element of a graphical user interface displayed on primary display 102 of display portion 110 (or external display device 204, FIGS. 2A-2D) that is currently active or has focus.
[0215] Each of the one or more user-selectable symbols 142 may include an indicator such as a symbol (e.g., a magnifying glass symbol as shown at 144), an abbreviation (e.g., "esc"), a fully-formed word, a letter, an image, an animated image, a video, etc. In some embodiments, each symbol of the one or more user-selectable symbols 142 is capable of receiving user input(s).
[0216] An input may be associated with each of the one or more user-selectable symbols 142. The input may be a function, a character, a number, etc. Each symbol of the one or more user-selectable symbols 142 may include an indicator corresponding to the input for that symbol. For example, in FIG. 1B , a user-selectable symbol with the abbreviation “esc” indicates to the user that an escape function is associated with the user-selectable symbol. A function associated with one or more user-selectable symbols 142 may be activated when the user selects the user-selectable symbol. For example, an escape function may be activated when the user selects a user-selectable symbol with the indicator “esc.” Activating a function may have different effects depending on the current state of the portable computing system 100 (or the computing device 202 of FIGS. 2A-2D ). For example, when a dialog box is open on the primary display 102 of the display portion 110 (or the external display device 204, FIGS. 2A-2D ), activating the escape function on the dynamic function row 104 can close the dialog box. In another embodiment, when a game application is being executed by the processor of portable computing system 100 (or computing device 202 of Figures 2A-2D), the game can be paused by activating the escape function on dynamic function row 104.
[0217] In some embodiments, a function may be associated with a combination of movably activated keys and / or user-selectable symbols. For example, simultaneous activation of the Command key and the "c" key (i.e., Command+c) may be associated with a "copy" function. In another example, simultaneous activation of the Command key and selection of a user-selectable symbol with an "esc" indicator (i.e., Command+esc) may activate a function that opens a particular application, such as a media player application. In yet another example, simultaneous selection of two user-selectable symbols (e.g., a user-selectable symbol with an "esc" indicator and a user-selectable symbol 144 with a magnifying glass indicator) may result in activation of a function, such as a special search function.
[0218] In some embodiments, a first subset 146 of one or more user-selectable symbols 142 in dynamic function row 104 may be associated with one group of functions, and a second subset 148 of one or more user-selectable symbols 142 in dynamic function row 104 may be associated with a second group of functions. For example, the user-selectable symbols in first subset 146 may be global functions (e.g., system-level functions or affordances), and the user-selectable symbols in second subset 148 may be application-specific functions. Thus, the user-selectable symbols in second subset 148 change when focus shifts from a first element of a graphical user interface displayed on primary display 102 (e.g., a first window corresponding to an Internet browser application) to a second element of the graphical user interface (e.g., a second window corresponding to an email application). In contrast, the user-selectable symbols in first subset 146 are maintained when focus shifts from the first element of the graphical user interface to the second element of the graphical user interface.
[0219] In some embodiments, the user-selectable symbols in second subset 148 are determined based on the active user interface element representation on primary display 102 that has focus. In some embodiments, the term "in focus" may refer to an active element of a user interface (e.g., a window associated with an application, a particular toolbar or menu associated with an application, or the operating system) that is currently in the foreground, actively operating, or controllable by input received from a user of the computing system, such as a key press, a mouse click, a voice command, a gestural movement, or the like.
[0220] In some embodiments, a first subset 146 of one or more user-selectable symbols 142 corresponding to global user-selectable symbols occupies a first area of dynamic function row 104 (e.g., the left half of dynamic function row 104), and a second subset 148 of one or more user-selectable symbols 142 occupies a second area of dynamic function row 104 (e.g., the right half of dynamic function row 104). It will be appreciated that other portions of dynamic function row 104 may be allocated to first subset 146 and second subset 148. In some embodiments, when no application has focus, the second area of dynamic function row 104 cannot contain any user-selectable symbols. In some embodiments, dynamic function row 104 includes three or more subsets of user-selectable symbols. In some embodiments, dynamic function row 104 includes a single set of user-selectable symbols that is not divided into subsets. Although a single row of user-selectable symbols is shown in dynamic function row 104 in FIG. 1B, it will be appreciated that dynamic function row 104 can include multiple rows of user-selectable symbols.
[0221] In some embodiments, the change in focus changes which elements of the graphical user interface displayed on primary display 102 of display portion 110 (or external display device 204, FIGS. 2A-2D) are active and which elements receive user input. User input may be received from a keyboard, mouse, touchpad, or other user input device. Additionally and / or alternatively, in some embodiments, the change in focus changes which elements are shown in the foreground of the graphical user interface displayed on primary display 102 of display portion 110 (or external display device 204, FIGS. 2A-2D).
[0222] In some embodiments, the change of focus occurs in response to user input, such as user selection of an element (e.g., a different window) of a graphical user interface displayed on primary display 102 of display portion 110 (or external display device 204, FIGS. 2A-2D ) or user selection of a user-selectable symbol (e.g., one of the affordances / symbols displayed in dynamic function row 104). User selection may be a keystroke, a mouse click, a mouse over, a command-tab input, or the like. In some embodiments, the change of focus occurs in response to a determination by the operating system of portable system 100 (or computing device 202 of FIGS. 2A-2D ). For example, when a user closes an application window that has focus, the operating system may give focus to a different application, such as the application that had focus prior to the closed application window. In another example, when a user closes an application window that has focus, the operating system may give focus to a dialog box that prompts the user to save changes made to a document via the application.
[0223] In some embodiments, the change of focus may be from one element associated with an application to another element associated with the same application (e.g., from an email composition window in an email application to an inbox list window in the email application, or from one tab in an internet browser application to another tab in the internet browser application). In some embodiments, the change of focus may be from an element associated with one application to an element associated with another application (e.g., from an internet browser window to an email application window). Further, in some embodiments, the change of focus may be from an element associated with an application to an element associated with the operating system, such as a system dialog box, a system settings control (e.g., a volume control), a window associated with a file / folder navigation application (e.g., Apple Inc.'s FINDER application), or the like. Additionally, focus may also be directed to a dialog box, a file directory, a settings control (e.g., a volume control), or any other element of a graphical user interface in which information may be presented to a user and / or in which user input may be received.
[0224] 2A is an illustrative diagram of a first implementation of a desktop computing system 200, according to some embodiments. The desktop computing system 200 includes a computing device 202, an external display device 204 with a primary display 102, an external keyboard 206, and an external mouse 208. The computing device 202 includes one or more processors and memory that stores one or more programs executed by the one or more processors. In some embodiments, the external display device 204 may be integrated with the computing device 202, such as an iMAC® device. In some embodiments, the primary display 102 of the external display device 204 is a touchscreen display. In FIG. 2A , the external display device 204 (also referred to herein as a first housing 204 or housing 204), the external keyboard 206, and the external mouse 208 are communicatively coupled to the computing device 202 via a wired connection, such as USB or PS / 2, or via a wireless communication link using a communication protocol, such as Bluetooth or Wi-Fi®. For example, external keyboard 206 (also referred to herein as second enclosure 206 or enclosure 206) is no more than 15 feet (e.g., about 3 feet) from computing device 202. In FIG. 2A , external keyboard 206 includes dynamic function row 104 and set of physical keys 106 that are at least partially contained within the same enclosure. In some embodiments, dynamic function row 104, which will be described in more detail with reference to FIG. 1B , is a touchscreen display. In some embodiments, external keyboard 206 includes one or more processors and memory that stores one or more programs that can be executed by the one or more processors of external keyboard 206 to perform any of the embodiments described herein.In some embodiments, external keyboard 206 relays signals indicative of user input (e.g., keystrokes and selections of user-selectable symbols / affordances displayed by dynamic function row 104) to computing device 202.
[0225] 2B is an illustrative diagram of a second implementation of a desktop computing system 200, according to some embodiments. In FIG. 2B, the desktop computing system 200 includes a computing device 202, an external display device 204 with a primary display 102, and an external keyboard 206. In FIG. 2B, the external display device 204 and the external keyboard 206 are communicatively coupled to the computing device 202 via a wired connection, such as USB or PS / 2, or via a wireless communication link using a communication protocol, such as Bluetooth or Wi-Fi. In FIG. 2B, the external keyboard 206 includes a dynamic function row 104, a set of physical keys 106, and a touchpad 108, all of which are contained at least partially within the same housing. In some embodiments, the dynamic function row 104, which will be described in more detail with reference to FIG. 1B, is a touchscreen display. In some embodiments, the external keyboard 206 includes one or more processors and a memory that stores one or more programs that can be executed by the one or more processors of the external keyboard 206 to perform any of the embodiments described herein. In some embodiments, external keyboard 206 relays signals indicative of user input (e.g., keystrokes, user interactions with touchpad 108, and selections of user-selectable symbols / affordances displayed by dynamic function row 104) to computing device 202.
[0226] 2C is an illustrative diagram of a third implementation of a desktop computing system 200, according to some embodiments. In FIG. 2C, the desktop computing system 200 includes a computing device 202, an external display device 204 with a primary display 102, an external keyboard 206, and a first external input mechanism 212. In FIG. 2C, the external display device 204, the external keyboard 206, and the first external input mechanism 212 are communicatively coupled to the computing device 202 via a wired connection, such as USB or PS / 2, or via a wireless communication link using a communication protocol, such as Bluetooth or Wi-Fi. In FIG. 2C, the external keyboard 206 includes a set of physical keys 106, and the first external input mechanism 212 includes a dynamic function row 104 and a touchpad 108 that are at least partially contained within the same housing. In some embodiments, the dynamic function row 104, which will be described in more detail with reference to FIG. 1B, is a touchscreen display. In some embodiments, first external input mechanism 212 includes one or more processors and memory that stores one or more programs that can be executed by the one or more processors of first external input mechanism 212 to perform any of the embodiments described herein. In some embodiments, first external input mechanism 212 relays signals indicative of user input (e.g., user interaction with touchpad 108 and user selection of user-selectable symbols / affordances displayed by dynamic function row 104) to computing device 202.
[0227] 2D is an illustrative diagram of a fourth implementation of a desktop computing system 200, according to some embodiments. In FIG. 2D , the desktop computing system 200 includes a computing device 202, an external display device 204 with a primary display 102, an external keyboard 206, an external mouse 208, and a second external input mechanism 222. In FIG. 2D , the external display device 204, the external keyboard 206, the external mouse 208, and the second external input mechanism 222 are communicatively coupled to the computing device 202 via a wired connection, such as USB or PS / 2, or via a wireless communication link using a communication protocol, such as Bluetooth or Wi-Fi. In FIG. 2A , the external keyboard 206 includes a dynamic function row 104 and a set of physical keys 106. In FIG. 2D , the external keyboard 206 includes a set of physical keys 106, and the second external input mechanism 222 includes a dynamic function row 104 that is at least partially contained within the housing of the second external input mechanism 222. 1B is a touchscreen display. In some embodiments, second external input mechanism 222 includes one or more processors and memory that stores one or more programs that can be executed by the one or more processors of second external input mechanism 222 to perform any of the embodiments described herein. In some embodiments, second external input mechanism 222 relays signals indicative of user input (e.g., user selection of a user-selectable symbol / affordance displayed by dynamic function row 104) to computing device 202.
[0228] 3A is a block diagram of electronic device 300, according to some embodiments. In some embodiments, electronic device 300 is a portable electronic device such as a laptop (e.g., portable computing system 100, FIG. 1A). In some embodiments, electronic device 300 is not a portable device but rather a desktop computer (e.g., computing device 202 of desktop computing system 200, FIGS. 2A-2D) that is communicatively coupled to an external display system (e.g., external display device 204, FIGS. 2A-2D) and, optionally, an external touch-sensitive surface (e.g., touchpad 108, FIGS. 2B-2C, a touch-sensitive display such as external display device 204, FIGS. 2A-2D, and / or dynamic function row 104, FIGS. 2A-2D).
[0229] The electronic device 300 typically supports a variety of applications, such as one or more of a drawing application, a presentation application, a word processing application, a website creation application, a disc authoring application, a spreadsheet application, a gaming application, a video conferencing application, an email application, an instant messaging application, a picture management application, a digital camera application, a digital video camera application, a web browser application, and / or a media player application.
[0230] Various applications running on electronic device 300 optionally use at least one common physical user interface device, such as a touch-sensitive surface. One or more features of the touch-sensitive surface and corresponding information displayed by electronic device 300 are optionally adjusted and / or changed for each application and / or within an application. In this way, the common physical architecture (such as the touch-sensitive surface) of electronic device 300 optionally supports various applications with user interfaces that are intuitive and transparent to the user.
[0231] Electronic device 300 includes memory 302 (optionally including one or more computer-readable storage media), a memory controller 322, one or more processing units (CPUs) 320, a peripherals interface 318, RF circuitry 308, audio circuitry 310, a speaker 311, a microphone 313, an input / output (I / O) subsystem 306, other input or control devices 316, and an external port 324. Electronic device 300 optionally includes a display system 312 (e.g., primary display 102 of display portion 110, FIG. 1A and / or dynamic function row 104, FIGS. 1A-1B), which may be a touch-sensitive display (sometimes referred to herein as a “touchscreen” or “touchscreen display”). Electronic device 300 optionally includes one or more optical sensors 364. Electronic device 300 optionally includes one or more intensity sensors 365 that detect the intensity of a contact on a touch-sensitive surface, such as a touch-sensitive display or touchpad. Electronic device 300 optionally includes one or more tactile output generators 367 that generate tactile output on a touch-sensitive surface, such as a touch-sensitive display or touchpad (e.g., touchpad 108, FIGS. 1A-1B). These components optionally communicate via one or more communication buses or signal lines 303.
[0232] As used herein, the term “intensity” of a contact on a touch-sensitive surface refers to the force or pressure (force per unit area) of a contact (e.g., a finger contact) on the touch-sensitive surface, or a proxy for the force or pressure of a contact on the touch-sensitive surface. The intensity of a contact has a range of values that includes at least four distinct values, and more typically includes hundreds (e.g., at least 256) distinct values. The intensity of a contact is optionally determined (or measured) using various techniques and various sensors or combinations of sensors. For example, one or more force sensors beneath or adjacent to the touch-sensitive surface are optionally used to measure force at various points on the touch-sensitive surface. In some implementations, force measurements from multiple force sensors are combined (e.g., a weighted average) to determine an estimated force of the contact. Similarly, the pressure-sensitive tip of a stylus is optionally used to determine the pressure of the stylus on the touch-sensitive surface. Alternatively, the size and / or change in the contact area detected on the touch-sensitive surface, the capacitance and / or change in the capacitance of the touch-sensitive surface proximate the contact, and / or the resistance and / or change in the capacitance of the touch-sensitive surface proximate the contact are optionally used as proxies for the force or pressure of the contact on the touch-sensitive surface. In some implementations, the surrogate measure of the force or pressure of the contact is used directly to determine whether an intensity threshold is exceeded (e.g., the intensity threshold is stated in units corresponding to the surrogate measure). In some implementations, the surrogate measure of the force or pressure of the contact is converted to an estimated force or pressure, and the estimated force or pressure is used to determine whether an intensity threshold is exceeded (e.g., the intensity threshold is a pressure threshold measured in units of pressure).
[0233] As used herein and in the claims, the term “tactile output” refers to a physical displacement of a device relative to a previous position of the device, a physical displacement of a component of the device (e.g., a touch-sensitive surface) relative to another component of the device (e.g., a housing), or a displacement of a component relative to the center of mass of the device, that will be detected by a user with the user's sense of touch. For example, in a situation where a device or a component of a device is in contact with a touch-sensitive surface of a user (e.g., the fingers, palm, or other part of the user's hand), the tactile output produced by the physical displacement will be interpreted by the user as a tactile sensation corresponding to a perceived change in a physical property of the device or a component of the device. For example, movement of a touch-sensitive surface (e.g., a touch-sensitive display or touch / trackpad) is optionally interpreted by the user as a “downclick” or “upclick” of a physical actuator button. In some cases, a user feels a tactile sensation such as a “downclick” or “upclick” even when no movement of a physical actuator button associated with the touch-sensitive surface is physically pressed (e.g., displaced) by the user's action. As another example, movement of the touch-sensitive surface is optionally interpreted or perceived by a user as "roughness" of the touch-sensitive surface, even when there is no change in the smoothness of the touch-sensitive surface. Such interpretation of touch by a user depends on the user's personal sensory perception, but there are many sensory perceptions of touch that are common to the majority of users. Thus, when a tactile output is described as corresponding to a particular sensory perception of a user (e.g., an "upclick," "downclick," "roughness"), unless otherwise specified, the generated tactile output corresponds to a physical displacement of the device, or a component of the device, that produces the described sensory perception for a typical (or average) user.
[0234] It should be appreciated that electronic device 300 is only one example, and that electronic device 300 optionally has more or fewer components than those shown, optionally combines two or more components, or optionally has a different configuration or arrangement of its components. The various components shown in Figure 3A are implemented in hardware, software, firmware, or a combination thereof, including one or more signal processing circuits and / or application specific integrated circuits.
[0235] Memory 302 optionally includes high-speed random-access memory and, optionally, non-volatile memory, such as one or more magnetic disk storage devices, flash memory devices, or other non-volatile solid-state memory devices. Access to memory 302 by other components of electronic device 300, such as CPU(s) 320 and peripheral interface 318, is optionally controlled by memory controller 322. Peripheral interface 318 may be used to couple input and output peripherals to CPU(s) 320 and memory 302. One or more processing units 320 operate or execute various software programs and / or instruction sets stored in memory 302 to perform various functions and process data for electronic device 300. In some embodiments, peripheral interface 318, CPU(s) 320, and memory controller 322 are optionally implemented on a single chip, such as chip 304. In some other embodiments, they are optionally implemented on separate chips.
[0236] The radio frequency (RF) circuitry 308 transmits and receives RF signals, also called electromagnetic signals. The RF circuitry 308 converts electrical signals to or from electromagnetic signals and communicates with communication networks and other communication devices via electromagnetic signals. The RF circuitry 308 optionally includes well-known circuits for performing these functions, including, but not limited to, an antenna system, an RF transceiver, one or more amplifiers, a tuner, one or more oscillators, a digital signal processor, a CODEC chipset, a subscriber identity module (SIM) card, memory, etc. The RF circuitry 308 optionally communicates via wireless communication with networks, such as the Internet, also called the World Wide Web (WWW), an intranet, and / or wireless networks, such as cellular telephone networks, wireless local area networks (LANs) and / or metropolitan area networks (MANs), and other devices. The wireless communication optionally uses any of a plurality of communication standards, protocols, and technologies, including Global System for Mobile Communications (GSM), Enhanced Data GSM Environment (EDGE), high-speed downlink packet access (HSDPA), high-speed uplink packet access (HSUPA), Evolution, Data-Only (EV-DO), HSPA, HSPA+, Dual-Cell HSPA (DC-HSPA), Long Term Evolution (LTE), Near Field Communication (NFC), and the like.Near Field Communication (NFC), wideband code division multiple access (W-CDMA), code division multiple access (CDMA), time division multiple access (TDMA), Bluetooth, Wireless Fidelity (Wi-Fi) (e.g., IEEE 802.11a, IEEE 802.11b, IEEE 802.11g, and / or IEEE 802.11n), voice over Internet Protocol (VoIP), Wi-MAX®, protocols for email (e.g., Internet message access protocol (IMAP) and / or post office protocol (POP)), instant messaging (e.g., extensible messaging and presence protocol (XMPP)), Session Initiation Protocol for Instant Messaging and Presence Leveraging (SIP)), and protocols for instant messaging and presence (e.g., Session Initiation Protocol for Instant Messaging and Presence Leveraging). Examples of suitable communication protocols include, but are not limited to, SIMPLE (Simple Message Extensions), Instant Messaging and Presence Service (IMPS), and / or Short Message Service (SMS), or any other suitable communication protocol, including communication protocols not yet developed as of the filing date of this document.
[0237] The audio circuit 310, speaker 311, and microphone 313 provide an audio interface between a user and the electronic device 300. The audio circuit 310 receives audio data from the peripherals interface 318, converts the audio data into electrical signals, and transmits the electrical signals to the speaker 311. The speaker 311 converts the electrical signals into sound waves audible to humans. The audio circuit 310 also receives electrical signals converted from sound waves by the microphone 313. The audio circuit 310 converts the electrical signals into audio data and transmits the audio data to the peripherals interface 318 for processing. The audio data is optionally retrieved from and / or transmitted to the memory 302 and / or the RF circuit 308 by the peripherals interface 318. In some embodiments, the audio circuit 310 also includes a headset jack. The headset jack provides an interface between the audio circuitry 310 and a detachable audio input / output peripheral such as an output-only headphone or a headset with both an output (e.g., single or double ear headphones) and an input (e.g., a microphone).
[0238] I / O subsystem 306 couples input / output peripherals of electronic device 300, such as display system 312 and other input or output devices 316, to peripheral interface 318. I / O subsystem 306 optionally includes a display controller 356, a light sensor controller 358, an intensity sensor controller 359, a haptic feedback controller 361, and one or more other input controllers 360 for other input or control devices. One or more other input controllers 360 receive electrical signals from and send electrical signals to other input or control devices 316. Other input or control devices 316 optionally include physical buttons (e.g., push buttons, rocker buttons, etc.), dials, slider switches, joysticks, click wheels, etc. In some alternative embodiments, other input controller(s) 360 are optionally coupled to any (or none) of a keyboard, an infrared port, a USB port, and a pointer device such as a mouse. The one or more physical buttons optionally include up / down buttons for volume control of the speaker 311 and / or microphone 313.
[0239] Display system 312 (e.g., primary display 102, FIG. 1A and / or dynamic function row 104, FIGS. 1A-1B of display portion 110) provides an output interface (and, optionally, an input interface when it is a touch-sensitive display) between electronic device 300 and a user. Display controller 356 receives and / or sends electrical signals from display system 312. Display system 312 displays visual output to the user. The visual output optionally includes graphics, text, icons, video, and any combination thereof (collectively referred to as "graphics"). In some embodiments, some or all of the visual output corresponds to user interface objects / elements.
[0240] In some embodiments, display system 312 (e.g., primary display 102, FIG. 1A, and / or dynamic function row 104, FIGS. 1A-1B, of display portion 110) is a touch-sensitive display that includes a touch-sensitive surface, sensor, or set of sensors that accepts input from a user based on haptic and / or tactile contact. Accordingly, display system 312 and display controller 356 (along with any associated modules and / or instruction sets in memory 302) detect contacts (and any movement or disruption of contact) on display system 312 and translate the detected contacts into interactions with user interface objects (e.g., one or more softkeys, icons, web pages, or images) displayed on display system 312. In one exemplary embodiment, the point of contact between display system 312 and the user corresponds to the area under the user's finger.
[0241] Display system 312 (e.g., primary display 102, FIG. 1A and / or dynamic function row 104, FIGS. 1A-1B of display portion 110) optionally uses liquid crystal display (LCD), light emitting polymer display (LPD), light emitting diode (LED), or organic light emitting diode (OLED) technology, although other display technologies are used in other embodiments. In some embodiments, when display system 312 is a touch-sensitive display, display system 312 and display controller 356 optionally detect a touch and any movement or disruption of that contact using any of a number of now-known or later-developed touch-sensing technologies, including, but not limited to, capacitive, resistive, infrared, and surface acoustic wave technologies, as well as other proximity sensor arrays or other elements that determine one or more points of contact with display system 312. In one exemplary embodiment, projected mutual capacitance sensing technology is used, such as that found in the iPHONE®, iPODTOUCH®, and iPAD® from Apple Inc. of Cupertino, California.
[0242] Display system 312 (e.g., primary display 102 of display portion 110, FIG. 1A and / or dynamic function row 104, FIGS. 1A-1B) optionally has a video resolution in excess of 400 dpi (e.g., 500 dpi, 800 dpi, or higher). In some embodiments, display system 312 is a touch-sensitive display to which a user optionally makes contact using a stylus, finger, or the like. In some embodiments, the user interface is designed to work primarily with finger contacts and gestures. In some embodiments, electronic device 300 translates coarse finger input into precise pointer / cursor position or commands to perform actions desired by the user.
[0243] In some embodiments, in addition to display system 312, electronic device 300 optionally includes a touchpad (e.g., touchpad 108, FIGS. 1A-1B ) that activates or deactivates certain functions. In some embodiments, the touchpad is a touch-sensitive area of electronic device 300 that, unlike display system 312, does not display visual output. In some embodiments, when display system 312 is a touch-sensitive display, the touchpad is optionally a touch-sensitive surface that is separate from display system 312 or an extension of the touch-sensitive surface formed by display system 312.
[0244] Electronic device 300 also includes a power system 362 that provides power to the various components. Power system 362 optionally includes a power management system, one or more power sources (e.g., batteries, alternating current (AC), etc.), a recharging system, power failure detection circuitry, power converters or inverters, power status indicators (e.g., light emitting diodes (LEDs)), and any other components associated with the generation, management, and distribution of electrical power within a portable device.
[0245] Electronic device 300 also optionally includes one or more light sensors 364 coupled to light sensor controller 358 in I / O subsystem 306. Light sensor(s) 364 optionally include charge-coupled device (CCD) or complementary metal-oxide semiconductor (CMOS) phototransistors. Light sensor(s) 364 receive light from the environment projected through one or more lenses and convert the light into data representing an image. In cooperation with imaging module 343, light sensor(s) 364 optionally capture still images or video. In some embodiments, a light sensor is located on the front of electronic device 300 to optionally obtain an image of the user for video conferencing while the user views other video conference participants on display system 312.
[0246] Electronic device 300 also optionally includes one or more contact intensity sensors 365 coupled to intensity sensor controller 359 in I / O subsystem 306. Contact intensity sensor(s) 365 optionally include one or more piezoresistive strain gauges, capacitive force sensors, electric force sensors, piezoelectric force sensors, optical force sensors, capacitive touch-sensitive surfaces, or other intensity sensors (e.g., sensors used to measure the force (or pressure) of a contact on a touch-sensitive surface). Contact intensity sensor(s) 365 receive contact intensity information (e.g., pressure information or a proxy for pressure information) from the environment. In some embodiments, at least one contact intensity sensor is collocated with or proximate to the touch-sensitive surface (e.g., touchpad 108, FIGS. 1A-1B, or display system 312 when it is a touch-sensitive display).
[0247] Electronic device 300 also optionally includes one or more tactile output generators 367 coupled to haptic feedback controller 361 in I / O subsystem 306. Tactile output generator(s) 367 optionally include one or more electroacoustic devices, such as speakers or other audio components, and / or electromechanical devices that convert energy into linear motion, such as motors, solenoids, electroactive polymers, piezoelectric actuators, electrostatic actuators, or other tactile output generating components (e.g., components that convert electrical signals into tactile output on the device). Contact intensity sensor(s) 365 receive tactile feedback generation instructions from haptic feedback module 333 and generate a tactile output that can be sensed by a user of electronic device 300. In some embodiments, at least one tactile output generator is juxtaposed with or proximate to a touch-sensitive surface (e.g., touchpad 108, FIGS. 1A-1B, or display system 312 when it is a touch-sensitive display) and, optionally, generates a tactile output by moving the touch-sensitive surface vertically (e.g., in / out of the surface of electronic device 300) or horizontally (e.g., back and forth in the same plane as the surface of electronic device 300).
[0248] Electronic device 300 also optionally includes one or more proximity sensors 366 coupled to peripheral interface 318. Alternatively, proximity sensor(s) 366 are coupled to other input controller(s) 360 in I / O subsystem 306. Electronic device 300 also optionally includes one or more accelerometers 368 coupled to peripheral interface 318. Alternatively, accelerometer(s) 368 are coupled to other input controller(s) 360 in I / O subsystem 306.
[0249] In some embodiments, the software components stored in memory 302 include an operating system 326, a communications module 328 (or instruction set), a contact / motion module 330 (or instruction set), a graphics module 332 (or instruction set), an application 340 (or instruction set), and a dynamic function row module 350 (or instruction set). Additionally, in some embodiments, as shown in FIG. 3A, memory 302 stores device / global internal state 357 (or instruction set). The device / global internal state 357 includes one or more of: active application state, which indicates which application, if any, is currently active and / or in focus; display state, which indicates what applications, views, or other information occupy various areas of the display system 312 (e.g., primary display 102, FIG. 1A and / or dynamic function row 104, FIG. 1A-1B, of display portion 110) and / or external display system (e.g., primary display 102, FIG. 2A-2D and / or dynamic function row 104, FIG. 2A-2D, of external display device 204); sensor state, which includes information obtained from various sensors and input or control devices 316 of electronic device 300; and location information regarding the location and / or attitude of electronic device 300.
[0250] Operating system 326 (e.g., an embedded operating system such as DARWIN®, RTXC®, LINUX®, UNIX®, OS X®, WINDOWS®, or VXWorks®) includes various software components and / or drivers that control and manage general system tasks (e.g., memory management, storage device control, power management, etc.) and facilitate communication between various hardware and software components.
[0251] Communications module 328 facilitates communication with other devices (e.g., computing device 202, FIGS. 2A-2D , external mouse 208, FIGS. 2A-2D , external keyboard 206, FIGS. 2A-2B , first external input mechanism 212, FIG. 2C , and / or second external input mechanism 222, FIG. 2D ) via one or more external ports 324 and / or RF circuitry 308, and includes various software components that transmit / receive data via RF circuitry 308 and / or external port 324. External port 324 (e.g., Universal Serial Bus (USB), FIREWIRE®, etc.) is adapted to couple to other devices directly or indirectly via a network (e.g., the Internet, a wireless LAN, etc.). In some embodiments, external port 324 is a multi-pin (e.g., 30-pin) connector that is the same as, similar to, and / or compatible with the 30-pin connector used on iPod® devices.
[0252] Contact / motion module 330 optionally detects contact with display system 312 when it is a touch-sensitive display (in cooperation with display controller 356) and other touch-sensitive devices (e.g., a touchpad or physical click wheel). Contact / motion module 330 includes various software components that perform various operations related to detecting contact, such as determining whether contact has occurred (e.g., detecting a finger-down event), determining the intensity of the contact (e.g., the force or pressure of the contact, or a surrogate for the force or pressure of the contact), determining whether there is movement of the contact and tracking the movement across the touch-sensitive surface (e.g., detecting one or more finger-drag events), and determining whether the contact has stopped (e.g., detecting a finger-up event or an interruption of the contact). Contact / motion module 330 receives contact data from the touch-sensitive surface. Determining the movement of the contact, as represented by the series of contact data, optionally includes determining the speed (magnitude), velocity (magnitude and direction), and / or acceleration (change in magnitude and / or direction) of the contact. These actions are optionally applied to a single contact (e.g., a single finger contact) or multiple simultaneous contacts (e.g., "multi-touch" / multiple finger contacts). In some embodiments, contact / motion module 330 also detects contacts on a touchpad (e.g., touchpad 108, FIGS. 1A-1B).
[0253] In some embodiments, the contact / motion module 330 uses a set of one or more intensity thresholds to determine whether an action has been performed by the user (e.g., whether the user has selected or “clicked” on an affordance). In some embodiments, at least a subset of the intensity thresholds are determined according to software parameters (e.g., the intensity thresholds are not determined by the activation threshold of a particular physical actuator and may be adjusted without modifying the physical hardware of the electronic device 300). For example, the mouse “click” threshold of a trackpad or touchscreen display may be set to any of a wide range of pre-defined thresholds without modifying the hardware of the trackpad or touchscreen display. Additionally, in some implementations, a user of the device is provided with a software setting to adjust one or more of the set of intensity thresholds (e.g., by adjusting individual intensity thresholds and / or by adjusting multiple intensity thresholds at once via a system-level click “intensity” parameter).
[0254] Contact / motion module 330 optionally detects gesture input by a user. Different gestures on the touch-sensitive surface have different contact patterns (e.g., different movements, timing, and / or strength of the detected contact). Thus, gestures are optionally detected by detecting particular contact patterns. For example, detecting a finger tap contact includes detecting a finger down event, followed by detecting a finger lift (lift-off) event at the same location (or substantially the same location) as the finger down event (e.g., at the location of an icon). As another example, detecting a finger swipe gesture on the touch-sensitive surface includes detecting a finger down event, followed by one or more finger drag events, and in some embodiments also followed by detecting a finger lift (lift-off) event.
[0255] Graphics module 332 includes various known software components that render and cause the display of graphics on primary display 102 (e.g., primary display 102 of display portion 110, FIG. 1A or primary display 102 of external display device 204, FIGS. 2A-2D ) or other displays, including components that modify the visual effects (e.g., brightness, transparency, saturation, contrast, or other visual characteristics) of the displayed graphics. As used herein, the term “graphics” includes any object that can be displayed to a user, including, but not limited to, text, web pages, icons (e.g., user interface objects including soft keys), digital images, video, animation, and the like. In some embodiments, graphics module 332 stores data representing the graphics used. Each graphic is optionally assigned a corresponding code. Graphics module 332 receives, from an application or the like, one or more codes specifying the graphics to be displayed, along with coordinate data and other graphic characteristic data, as necessary, and then generates screen image data to output to display controller 356.
[0256] The haptic feedback module 333 includes various software components that generate instructions used by the tactile output generator(s) 367 to generate tactile outputs at one or more locations on the electronic device 300 in response to user interactions with the electronic device 300.
[0257] Application 340 optionally includes the following modules (or instruction sets), or a subset or superset thereof: an email client module 341 for receiving, sending, composing, and viewing emails (sometimes referred to herein as a “mail app” or “email app”); an imaging module 342 for capturing still and / or video images; an image management module 343 for editing and viewing still and / or video images (sometimes referred to herein as the “photo app”); a media player module 344 (sometimes referred to herein as a “media player app”) that plays audio and / or video; and A web browsing module 345 (sometimes referred to herein as a "web browser") for connecting to and browsing the Internet.
[0258] Examples of other applications 340 optionally stored in memory 302 include messaging and communication applications, word processing applications, other image editing applications, drawing applications, presentation applications, JAVA®-enabled applications, encryption applications, digital rights management applications, voice recognition applications, and voice duplication applications.
[0259] In cooperation with RF circuitry 308, display system 312 (e.g., primary display 102 of display portion 110, FIG. 1A and / or dynamic function row 104, FIGS. 1A-1B), display controller 356, and one or more of contact module 330 and graphics module 332, email client module 341 includes executable instructions for composing, sending, receiving, and managing emails in response to user commands. In cooperation with image management module 343, email client module 341 greatly facilitates composing and sending emails with still or video images captured by imaging module 342.
[0260] In cooperation with one or more of the display system 312 (e.g., the primary display 102 of the display portion 110, FIG. 1A and / or the dynamic function row 104, FIGS. 1A-1B), the display controller 356, the light sensor(s) 364, the light sensor controller 358, the contact module 330, the graphics module 332, and the image management module 343, the imaging module 342 includes executable instructions for capturing still images or video (including video streams) and storing them in the memory 302, changing the characteristics of the still images or video, or deleting the still images or video from the memory 302.
[0261] In cooperation with one or more of the display system 312 (e.g., the primary display 102 of the display portion 110, FIG. 1A and / or the dynamic function row 104, FIGS. 1A-1B), the display controller 356, the contact module 330, the graphics module 332, and the imaging module 342, the image management module 343 includes executable instructions for arranging, modifying (e.g., editing), or otherwise manipulating, labeling, deleting, presenting (e.g., in a digital slide show or album), and storing still and / or video images.
[0262] In cooperation with one or more of display system 312 (e.g., primary display 102 of display portion 110, FIG. 1A and / or dynamic function row 104, FIGS. 1A-1B), display controller 356, contact module 330, graphics module 332, audio circuitry 310, speaker 311, RF circuitry 308, and web browsing module 345, media player module 344 includes executable instructions that enable a user to download and play recorded music or other sound files stored in one or more file formats, such as MP3 or AAC files, as well as executable instructions for displaying, presenting, or otherwise playing video (e.g., on primary display 102 of display portion 110, FIG. 1A or primary display 102 of external display device 2014 connected via external port 324, FIGS. 2A-2B).
[0263] In cooperation with one or more of RF circuitry 308, display system 312 (e.g., primary display 102 of display portion 110, FIG. 1A and / or dynamic function row 104, FIGS. 1A-1B), display controller 356, contact module 330, and graphics module 332, web browsing module 345 includes executable instructions for browsing the Internet according to user commands, including retrieving, linking to, receiving, and displaying web pages or portions thereof, as well as attachments and other files linked to web pages.
[0264] Dynamic function row (DFR) module 350 includes focus determination module 351, DFR determination module 352, and DFR presentation module 353. In some embodiments, focus determination module 351 is configured to determine an active user interface element that has focus in a graphical user interface displayed by display system 312 (e.g., primary display 102 of display portion 110, FIG. 1A) or an external display system (e.g., external display device 204, FIGS. 2A-2D). In some embodiments, DFR determination module 352 is configured to determine a graphic (e.g., a set of one or more affordances) based on the active user interface element that has focus. In some embodiments, DFR presentation module 353 is configured to render the graphic determined by DFR determination module 352 on display system 312 (e.g., dynamic function row 104, FIGS. 1A-1B). DFR presentation module 353 includes various known software components that render and cause the display of graphics on display system 312 (e.g., dynamic function row 104, FIGS. 1A-1B), including components that modify the visual effects (e.g., brightness, transparency, saturation, contrast, or other visual characteristics) of the displayed graphics. As used herein, the term "graphic" includes any object that can be displayed to a user, including, but not limited to, text, web pages, icons (e.g., user interface objects, including soft keys), digital images, video, animation, etc.In some embodiments, DFR module 350 includes other modules, such as a module for adjusting the sensitivity of dynamic function row 104, a module for adjusting the audible and / or tactile feedback provided by dynamic function row 104, a module for adjusting the settings of affordances and information (e.g., size, brightness, font, language, etc.) displayed by dynamic function row 104, and a module for adjusting the current power mode (e.g., normal mode and low power mode) of dynamic function row 104.
[0265] In some embodiments, the dynamic function line module 350 interfaces with components that enable providing predicted / pre-emptive / suggested content items (including predicted recipients, suggested text termination strings, pre-suggested applications, etc.) Pre-emptively suggesting content items is described in more detail in U.S. Application No. 15 / 167,713, which is incorporated herein by reference in its entirety.
[0266] Each of the above-identified modules and applications corresponds to a set of executable instructions for performing one or more of the functions described above and methods described in the present application (e.g., computer-implemented methods and other information processing methods described herein). These modules (i.e., sets of instructions) need not be implemented as separate software programs, procedures, or modules; thus, in various embodiments, various subsets of these modules are optionally combined or otherwise rearranged. In some embodiments, memory 302 optionally stores a subset of the above-identified modules and data structures. Additionally, memory 302 optionally stores additional modules and data structures not described above.
[0267] 3B is a block diagram of components for event processing of FIG. 3A, in some embodiments. In some embodiments, memory 302 (FIG. 3A) includes event sorter 370 (e.g., in operating system 326) and application 340-1 (e.g., any of applications 341, 342, 343, 344, or 345 described above).
[0268] Event sorter 370 receives the event information and determines application 340-1 and application view 391 of application 340-1 to which the event information should be delivered. Event sorter 370 includes event monitor 371 and event dispatcher module 374. In some embodiments, application 340-1 includes application internal state 392, which indicates the current application view(s) to be displayed on display system 312 (e.g., primary display 102, FIG. 1A and / or dynamic function row 104, FIGS. 1A-1B of display portion 110) when the application is active or running. In some embodiments, device / global internal state 357 is used by event sorter 370 to determine which application(s) is / are currently active or in focus, and application internal state 392 is used by event sorter 370 to determine application view 391 to which the event information should be delivered.
[0269] In some embodiments, application internal state 392 includes additional information such as one or more of resume information used when application 340-1 resumes execution, user interface state information indicating information being displayed or ready to be displayed by application 340-1, a state queue that allows the user to return to a previous state or view of application 340-1, and a redo / undo queue of previous actions taken by the user.
[0270] Event monitor 371 receives event information from peripherals interface 318. The event information includes information about sub-events (e.g., a user touch on display system 312 when it is a touch-sensitive display, as part of a multi-touch gesture). Peripherals interface 318 transmits information it receives from I / O subsystem 306 or sensors such as proximity sensor(s) 366, accelerometer(s) 368, and / or microphone 313 (via audio circuitry 310). Information that peripherals interface 318 receives from I / O subsystem 306 includes information from display system 312 when it is a touch-sensitive display or another touch-sensitive surface (e.g., touchpad 108, FIGS. 1A-1B).
[0271] In some embodiments, event monitor 371 sends requests to peripherals interface 318 at predetermined intervals. In response, peripherals interface 318 transmits event information. In other embodiments, peripherals interface 318 transmits event information only when there is a significant event (e.g., receiving an input that exceeds a predetermined noise threshold and / or is longer than a predetermined duration).
[0272] In some embodiments, event sorter 370 also includes a hit view determination module 372 and / or an active event recognizer determination module 373 .
[0273] The hit view determination module 372 provides software procedures that determine where a sub-event occurred within one or more views, when the display system 312 displays two or more views, and where the views are composed from the controls and other elements visible to the user on the display.
[0274] Another aspect of a user interface associated with an application is the set of views, sometimes referred to herein as application views or user interface windows, in which information is displayed and touch gestures occur. The application view (of an application) at which the touch is detected optionally corresponds to a programmatic level within the application's programmatic or view hierarchy. For example, the lowest-level view at which the touch is detected is optionally referred to as the hit view, and the set of events that are recognized as suitable inputs is optionally determined based at least in part on the hit view of the initial touch that initiates the touch gesture.
[0275] The hit view determination module 372 receives information related to sub-events of a touch gesture. When an application has multiple views organized in a hierarchy, the hit view determination module 372 identifies the hit view as the lowest view in the hierarchy that should process the sub-events. In most situations, the hit view is the lowest-level view in which the initiating sub-event occurs (i.e., the first sub-event in the sequence of sub-events that form the event or potential event). Once a hit view is identified by the hit view determination module, the hit view typically receives all sub-events related to the same touch or input source for which it was identified as the hit view.
[0276] The active event recognizer determination module 373 determines which view(s) in the view hierarchy should receive the particular sequence of sub-events. In some embodiments, the active event recognizer determination module 373 determines that only the hit view should receive the particular sequence of sub-events. In other embodiments, the active event recognizer determination module 373 determines that all views that contain the physical location of the sub-events are actively participating views, and therefore determines that all actively participating views should receive the particular sequence of sub-events. In other embodiments, even if the touch sub-event is completely confined to the area associated with one particular view, views higher in the hierarchy still remain actively participating views.
[0277] Event dispatcher module 374 dispatches event information to event recognizers (e.g., event recognizer 380). In embodiments that include active event recognizer determination module 373, event dispatcher module 374 delivers event information to the event recognizers determined by active event recognizer determination module 373. In some embodiments, event dispatcher module 374 stores event information obtained by each event receiver 382 in an event queue.
[0278] In some embodiments, operating system 326 includes event sorter 370. Alternatively, application 340-1 includes event sorter 370. In still other embodiments, event sorter 370 is a stand-alone module or is part of another module stored in memory 302, such as contact / motion module 330.
[0279] In some embodiments, application 340-1 includes multiple event handlers 390 and one or more application views 391, each containing instructions for processing touch events that occur within a respective view of the application's user interface. Each application view 391 of application 340-1 includes one or more event recognizers 380. Typically, an application view 391 includes multiple event recognizers 380. In other embodiments, one or more of the event recognizers 380 are part of a separate module, such as a user interface kit (not shown) or a higher-level object from which application 340-1 inherits methods and other properties. In some embodiments, each event handler 390 includes one or more of a data updater 376, an object updater 377, a GUI updater 378, and / or event data 379 received from event sorter 370. Event handler handler 390 optionally utilizes or invokes data updater 376, object updater 377, or GUI updater 378 to update application internal state 392. Alternatively, one or more of the application views 391 include one or more respective event handlers 390. Also, in some embodiments, one or more of the data updater 376, object updater 377, and GUI updater 378 are included in the application view 391.
[0280] Each event recognizer 380 receives event information (e.g., event data 379) from event sorter 370 and identifies an event from the event information. Event recognizer 380 includes an event receiver 382 and an event comparator 384. In some embodiments, event recognizer 380 also includes metadata 383 and at least a subset of event delivery instructions 388 (optionally including sub-event delivery instructions).
[0281] Event receiver 382 receives event information from event sorter 370. The event information includes information about a sub-event, e.g., information about a touch or touch movement. Depending on the sub-event, the event information also includes additional information, such as the location of the sub-event. When the sub-event involves touch movement, the event information also optionally includes the speed and direction of the sub-event. In some embodiments, the event includes a device rotation from one orientation to another (e.g., from portrait to landscape or vice versa), and the event information includes corresponding information about the device's current orientation (also called device attitude).
[0282] The event comparator 384 compares the event information to predefined event or sub-event definitions and determines the event or sub-event, or determines or updates the state of the event or sub-event, based on the comparison. In some embodiments, the event comparator 384 includes an event definition 386. The event definition 386 includes definitions of events (e.g., a predefined sequence of sub-events), such as Event 1 (387-1), Event 2 (387-2), etc. In some embodiments, sub-events in Event 387 include, for example, touch start, touch end, touch movement, touch cessation, and multiple touches. In one example, the definition for Event 1 (387-1) is a double tap on a displayed object. The double tap includes, for example, a first touch (touch start) for a predetermined phase on the displayed object, a first lift-off (touch end) for the predetermined phase, a second touch (touch start) for the predetermined phase on the displayed object, and a second lift-off (touch end) for the predetermined phase. In another example, the definition for event 2 (387-2) is a drag on a displayed object. Drag includes, for example, a touch (or contact) to a predetermined stage on a displayed object, a movement of the touch across the display system 312 when it is a touch-sensitive display, and a lift-off of the touch (end of the touch). In some embodiments, the event also includes information about one or more associated event handlers 390.
[0283] In some embodiments, event definition 387 includes a definition of the event for each user interface object. In some embodiments, event comparator 384 performs a hit test to determine which user interface object is associated with the sub-event. For example, in an application view in which three user interface objects are displayed on display system 312, when a touch is detected on display system 312 when it is a touch-sensitive display, event comparator 384 performs a hit test to determine which of the three user interface objects is associated with the touch (sub-event). If each displayed object is associated with a respective event handler 390, the event comparator uses the results of the hit test to determine which event handler 390 to activate. For example, event comparator 384 selects the event handler associated with the sub-event and object that triggers the hit test.
[0284] In some embodiments, the definition for each event 387 also includes a delay action that delays delivery of the event information until it is determined whether the sequence of sub-events corresponds to the event recognizer's event type.
[0285] When a respective event recognizer 380 determines that the sequence of sub-events does not match any of the events in the event definition 386, the respective event recognizer 380 enters an event disabled, event failed, or event finished state and thereafter ignores subsequent sub-events of the touch gesture. In this situation, any other event recognizers that remain active for the hit view continue to track and process sub-events of the ongoing touch gesture.
[0286] In some embodiments, each event recognizer 380 includes metadata 383 with configurable properties, flags, and / or lists that indicate to actively participating event recognizers how the event delivery system should perform sub-event delivery. In some embodiments, metadata 383 includes configurable properties, flags, and / or lists that indicate how event recognizers interact with each other or how event recognizers are enabled to interact with each other. In some embodiments, metadata 383 includes configurable properties, flags, and / or lists that indicate whether sub-events are delivered to various levels in the view or programmatic hierarchy.
[0287] In some embodiments, each event recognizer 380 activates an event handler 390 associated with an event when one or more specific sub-events of the event are recognized. In some embodiments, each event recognizer 380 delivers event information associated with the event to the event handler 390. Activating the event handler 390 is separate from sending (and postponing sending) sub-events to the respective hit view. In some embodiments, the event recognizer 380 pops a flag associated with the recognized event, and the event handler 390 associated with the flag captures the flag and performs a predetermined process.
[0288] In some embodiments, the event delivery instructions 388 include sub-event delivery instructions that deliver event information about a sub-event without activating an event handler. Instead, the sub-event delivery instructions deliver the event information to an event handler associated with a set of sub-events or to an actively participating view. The event handler associated with the set of sub-events or the actively participating view receives the event information and performs a predetermined process.
[0289] In some embodiments, data updater 376 creates and updates data used by application 340-1. For example, data updater 376 stores video files used by media player module 344. In some embodiments, object updater 377 creates and updates objects used by application 340-1. For example, object updater 376 creates new user interface objects or updates the positions of user interface objects. GUI updater 378 updates the GUI. For example, GUI updater 378 prepares display information and sends it to graphics module 332 for display on display system 312 (e.g., primary display 102, FIG. 1A and / or dynamic function row 104, FIGS. 1A-1B, of display portion 110).
[0290] In some embodiments, event handler(s) 390 include or have access to data updater 376, object updater 377, and GUI updater 378. In some embodiments, data updater 376, object updater 377, and GUI updater 378 are included in a single module of application 340-1 or application view 391. In other embodiments, they are included in two or more software modules.
[0291] It should be understood that the foregoing discussion regarding event processing of user touches on a touch-sensitive display also applies to other forms of user input for operating electronic device 300 using input devices, not all of which are initiated on a touchscreen. For example, mouse movements and mouse button presses, touch movements such as tapping, dragging, scrolling on a touchpad, optionally coordinated with single or multiple keyboard presses or holds, pen stylus input, device movement, verbal commands, detected eye movement, biometric input, and / or any combination thereof, optionally utilize as inputs corresponding to sub-events that define the event to be recognized.
[0292] 4 is a block diagram of an external electronic device 400, according to some embodiments. In some embodiments, external electronic device 400 is an external input and output device that includes, at least in part, dynamic function row 104, a physical input mechanism such as a set of physical keys (e.g., physical key set 106, FIGS. 2A-2B), and / or a touchpad (e.g., touchpad 108, FIGS. 2B-2C) within the same housing. Examples of external electronic device 400 include an external keyboard (e.g., external keyboard 206, FIGS. 2A-2B), an external touch-sensitive surface (e.g., first external input mechanism 212, FIG. 2C), or other external input mechanism (e.g., second external input mechanism 222, FIG. 2D). External electronic device 400 is communicatively coupled to computing device 202 (FIGS. 2A-2D). For example, external electronic device 400 is communicatively coupled to computing device 202 via a wired connection, such as USB or PS / 2, or via a wireless communication link using a communication protocol, such as Bluetooth, Wi-Fi, etc. External electronic device 400 may rely on some of the components or procedures in electronic device 300 (FIG. 3A), or some of these components or procedures may be completed by, located in, or stored by external electronic device 400 instead of electronic device 300.
[0293] In some embodiments, external electronic device 400 includes one or more of memory 402 (optionally including one or more computer-readable storage media), a memory controller 422, one or more processing units (CPUs) 420, a peripherals interface 418, RF circuitry 408, audio circuitry 410, a speaker 411, a microphone 413, an input / output (I / O) subsystem 406, other input or control devices 416, and an external port 424. External electronic device 400 includes a touch-sensitive display system 412 (sometimes referred to herein as a “touch-sensitive display,” “touchscreen,” or “touchscreen display”) (e.g., dynamic function row 104; FIGS. 2A-2D ).
[0294] External electronic device 400 optionally includes one or more intensity sensors 465 that detect the intensity of a contact on a touch-sensitive surface, such as touch-sensitive display system 412 or a touchpad (e.g., touchpad 108, FIGS. 2B-2C). External electronic device 400 optionally includes one or more tactile output generators 467 that generate a tactile output on a touch-sensitive surface, such as touch-sensitive display system 412 or a touchpad (e.g., touchpad 108, FIGS. 2B-2C). These components optionally communicate via one or more communication buses or signal lines 403.
[0295] Memory 402 optionally includes high-speed random-access memory and, optionally, non-volatile memory, such as one or more magnetic disk storage devices, flash memory devices, or other non-volatile solid-state memory devices. Access to memory 402 by other components of external electronic device 400, such as CPU(s) 420 and peripheral interface 418, is optionally controlled by memory controller 422. Peripheral interface 418 may be used to couple CPU(s) 420 and memory 402 to I / O subsystem 406 and other circuits. One or more processing units 420 operate or execute various software programs and / or instruction sets stored in memory 402 to perform various functions and process data for external electronic device 400. In some embodiments, peripheral interface 418, CPU(s) 420, and memory controller 422 are optionally implemented on a single chip, such as chip 404. In some other embodiments, they are optionally implemented on separate chips.
[0296] RF (radio frequency) circuitry 408 transmits and receives RF signals, also called electromagnetic signals. RF circuitry 408 converts electrical signals to or from electromagnetic signals and communicates with communication networks and other communication devices via electromagnetic signals. RF circuitry 408 optionally includes well-known circuits for performing these functions, including, but not limited to, an antenna system, an RF transceiver, one or more amplifiers, a tuner, one or more oscillators, a digital signal processor, a CODEC chipset, a subscriber identity module (SIM) card, memory, etc. The wireless communication optionally uses any of a number of communication standards, protocols, and technologies, including, but not limited to, near field communication (NFC), Bluetooth, Wireless Fidelity (Wi-Fi) (e.g., IEEE 802.11a, IEEE 802.11b, IEEE 802.11g, and / or IEEE 802.11n), Wi-MAX, or any other suitable communication protocol, including communication protocols not yet developed as of the filing date of this document.
[0297] The optional audio circuitry 410, speaker 411, and microphone 413 provide an audio interface between a user and the external electronic device 400. The audio circuitry 410 receives audio data from the peripherals interface 418, converts the audio data into electrical signals, and transmits the electrical signals to the speaker 411. The speaker 411 converts the electrical signals into sound waves audible to humans. The audio circuitry 410 also receives electrical signals converted from sound waves by the microphone 413. The audio circuitry 410 converts the electrical signals into audio data and transmits the audio data to the peripherals interface 418 for processing. The audio data is optionally retrieved from and / or transmitted to the memory 402 and / or the RF circuitry 408 by the peripherals interface 418. In some embodiments, the audio circuitry 410 also includes a headset jack. The headset jack provides an interface between audio circuitry 410 and a detachable audio input / output peripheral such as an output-only headphone or a headset with both an output (e.g., single or double ear headphones) and an input (e.g., a microphone).
[0298] I / O subsystem 406 couples input / output peripherals of external electronic device 400, such as touch-sensitive display system 412 (e.g., dynamic function row 104, FIGS. 2A-2D ), to peripheral interface 418. I / O subsystem 406 optionally includes a display controller 456, an intensity sensor controller 459, a haptic feedback controller 461, and one or more input controllers 460 for other input or control devices 416. One or more other input controllers 460 receive electrical signals from and send electrical signals to other input or control devices 416. Other input or control devices 416 optionally include physical buttons (e.g., push buttons, rocker buttons, etc.), dials, slider switches, joysticks, click wheels, sets of physical keys, touchpads, etc.
[0299] Touch-sensitive display system 412 (e.g., dynamic function row 104, FIGS. 2A-2D) provides an input / output interface between external electronic device 400 and a user. Touch-sensitive display (TSD) controller 456 receives electrical signals from and / or sends electrical signals to touch-sensitive display system 412. Touch-sensitive display system 412 displays visual output to the user. The visual output optionally includes graphics, text, icons, video, and any combination thereof (collectively referred to as "graphics"). In some embodiments, some or all of the visual output corresponds to user interface objects / elements.
[0300] Touch-sensitive display system 412 (e.g., dynamic function row 104; FIGS. 2A-2D ) includes a touch-sensitive surface, sensor, or set of sensors that accepts input from a user based on haptic and / or tactile contact. Thus, touch-sensitive display system 412 and TSD controller 456 (along with any associated modules and / or instruction sets in memory 402) detect contact (and any movement or breaking of contact) on touch-sensitive display system 412 and convert the detected contact into signals used to select or control user interface objects (e.g., one or more softkeys, icons, web pages, or images) displayed on touch-sensitive display system 412. In one exemplary embodiment, the point of contact between touch-sensitive display system 412 and the user corresponds to the area of touch-sensitive display system 412 that is in contact with the user's finger.
[0301] Touch-sensitive display system 412 (e.g., dynamic function row 104; FIGS. 2A-2D ) optionally uses LCD (liquid crystal display), LPD (light emitting polymer display), LED (light emitting diode), or OLED (organic light emitting diode) technology, although other display technologies are used in other embodiments. Touch-sensitive display system 412 and TSD controller 456 optionally use any of a number of now-known or later-developed touch sensing technologies to detect a touch and any movement or disruption of that contact, including, but not limited to, capacitive, resistive, infrared, and surface acoustic wave technologies, as well as other proximity sensor arrays or other elements that determine one or more points of contact with touch-sensitive display system 412. In one exemplary embodiment, projected mutual capacitance sensing technology is used, such as that found in the iPhone, iPODTOUCH, and iPAD from Apple Inc. of Cupertino, California.
[0302] Touch-sensitive display system 412 (e.g., dynamic function row 104, FIGS. 2A-2D) optionally has a video resolution in excess of 400 dpi (e.g., 500 dpi, 800 dpi, or higher). In some embodiments, a user makes contact with touch-sensitive display system 412 using a stylus, a finger, or the like. In some embodiments, the user interface is designed to work primarily with finger contacts and gestures.
[0303] In some embodiments, in addition to touch-sensitive display system 412, external electronic device 400 optionally includes a touchpad (e.g., touchpad 108, FIGS. 2B-2C ). In some embodiments, the touchpad is a touch-sensitive area of external electronic device 400 that, unlike touch-sensitive display system 412, does not display visual output. In some embodiments, the touchpad is optionally a touch-sensitive surface that is separate from touch-sensitive display system 412 or an extension of the touch-sensitive surface formed by touch-sensitive display system 412.
[0304] The external electronic device 400 also includes a power system 462 that provides power to the various components. The power system 462 optionally includes a power management system, one or more power sources (e.g., batteries, alternating current (AC), etc.), a recharging system, power failure detection circuitry, power converters or inverters, power status indicators (e.g., light emitting diodes (LEDs)), and any other components associated with the generation, management, and distribution of electrical power within a portable device.
[0305] External electronic device 400 also optionally includes one or more contact intensity sensors 465 coupled to intensity sensor controller 459 in I / O subsystem 406. Contact intensity sensor(s) 465 optionally include one or more piezoresistive strain gauges, capacitive force sensors, electric force sensors, piezoelectric force sensors, optical force sensors, capacitive touch-sensitive surfaces, or other intensity sensors (e.g., sensors used to measure the force (or pressure) of a contact on a touch-sensitive surface). Contact intensity sensor(s) 465 receive contact intensity information (e.g., pressure information or a proxy for pressure information) from the environment. In some embodiments, at least one contact intensity sensor is collocated with or proximate to the touch-sensitive surface (e.g., touch-sensitive display system 412 and / or touchpad 108; FIGS. 2B-2C ).
[0306] External electronic device 400 also optionally includes one or more tactile output generators 467 coupled to haptic feedback controller 461 in I / O subsystem 406. Tactile output generator(s) 467 optionally include one or more electroacoustic devices, such as speakers or other audio components, and / or electromechanical devices that convert energy into linear motion, such as motors, solenoids, electroactive polymers, piezoelectric actuators, electrostatic actuators, or other tactile output generating components (e.g., components that convert electrical signals into tactile output on the device). Contact intensity sensor(s) 465 receive tactile feedback generation instructions from haptic feedback module 433 and generate a tactile output that can be sensed by a user of external electronic device 400. In some embodiments, at least one tactile output generator is juxtaposed with or proximate to a touch-sensitive surface (e.g., touch-sensitive display system 412 and / or touchpad 108; FIGS. 2B-2C ) and, optionally, generates a tactile output by moving the touch-sensitive surface vertically (e.g., in / out of the surface of external electronic device 400) or horizontally (e.g., back and forth in the same plane as the surface of external electronic device 400).
[0307] In some embodiments, software components stored in memory 402 include an operating system 426, a communications module 428 (or instruction set), a contact / motion module 430 (or instruction set), and a dynamic function row module 450 (or instruction set). Additionally, in some embodiments, memory 402 stores device state 457, including a display state that indicates what views or other information occupy various areas of touch-sensitive display system 412 (e.g., dynamic function row 104, FIGS. 2A-2D ).
[0308] Operating system 426 includes various software components and / or drivers that control and manage general system tasks (e.g., memory management, storage device control, power management, etc.) and facilitates communication between various hardware and software components.
[0309] Communications module 428 facilitates communication with other devices (e.g., computing device 202, FIGS. 2A-2D) via one or more external ports 424 and / or RF circuitry 408, and includes various software components that transmit / receive data via RF circuitry 408 and / or external port 424. External port 424 (e.g., Universal Serial Bus (USB), FIREWIRE, etc.) is adapted to couple to other devices directly or indirectly via a network (e.g., the Internet, wireless LAN, etc.).
[0310] Contact / motion module 430 optionally detects contact with touch-sensitive display system 412 and other touch-sensitive devices (e.g., a touchpad or physical click wheel). Contact / motion module 430 includes various software components that perform various operations related to detecting contact, such as determining whether contact has occurred (e.g., detecting a finger-down event), determining the intensity of the contact (e.g., the force or pressure of the contact, or a surrogate for the force or pressure of the contact), determining whether there is movement of the contact and tracking the movement across the touch-sensitive surface (e.g., detecting one or more finger-drag events), and determining whether the contact has stopped (e.g., detecting a finger-up event or an interruption of the contact). Contact / motion module 430 receives contact data from the touch-sensitive surface. Determining the movement of the contact, as represented by the series of contact data, optionally includes determining the speed (magnitude), velocity (magnitude and direction), and / or acceleration (change in magnitude and / or direction) of the contact. These actions are optionally applied to a single contact (e.g., a single finger contact) or multiple simultaneous contacts (e.g., "multi-touch" / multiple finger contacts). In some embodiments, contact / motion module 430 also detects contacts on a touchpad (e.g., touchpad 108, FIGS. 2B-2C).
[0311] In some embodiments, the contact / motion module 430 uses a set of one or more intensity thresholds to determine whether an action has been performed by the user (e.g., whether the user has selected or “clicked” on an affordance). In some embodiments, at least a subset of the intensity thresholds are determined according to software parameters (e.g., the intensity thresholds are not determined by the activation threshold of a particular physical actuator and may be adjusted without modifying the physical hardware of the external electronic device 400). For example, the mouse “click” threshold of a trackpad or touchscreen display may be set to any of a wide range of pre-defined thresholds without modifying the hardware of the trackpad or touchscreen display. Additionally, in some implementations, a user of the device is provided with a software setting to adjust one or more of the set of intensity thresholds (e.g., by adjusting individual intensity thresholds and / or by adjusting multiple intensity thresholds at once via a system-level click “intensity” parameter).
[0312] Contact / motion module 430 optionally detects gesture input by a user. Different gestures on the touch-sensitive surface have different contact patterns (e.g., different movements, timing, and / or strength of the detected contact). Thus, gestures are optionally detected by detecting particular contact patterns. For example, detecting a finger tap contact includes detecting a finger down event, followed by detecting a finger lift (lift-off) event at the same location (or substantially the same location) as the finger down event (e.g., at the location of an icon). As another example, detecting a finger swipe gesture on the touch-sensitive surface includes detecting a finger down event, followed by one or more finger drag events, and in some embodiments also followed by detecting a finger lift (lift-off) event.
[0313] The haptic feedback module 433 includes various software components that generate instructions used by the tactile output generator(s) 467 to generate tactile outputs at one or more locations on the external electronic device 400 in response to user interactions with the external electronic device 400.
[0314] Dynamic function row (DFR) module 450 includes focus obtaining module 451, DFR determination module 452, and DFR presentation module 453. In some embodiments, focus obtaining module 451 is configured to obtain from computing device 202 ( FIGS. 2A-2D ) an indication of an active user interface element that is currently in focus of a graphical user interface displayed on primary display 102 of external display device 204 ( FIGS. 2A-2D ). In some embodiments, DFR determination module 452 is configured to determine a graphic (e.g., a set of one or more affordances) based on the active user interface element that is currently in focus. Alternatively, in some embodiments, computing device 202 ( FIGS. 2A-2D ) determines a graphic (e.g., a set of one or more affordances) based on the active user interface element that is in focus and provides the graphic to external electronic device 400 or a component thereof (e.g., DFR module 450) for display on touch-sensitive display system 412 (e.g., dynamic function row 104, FIGS. 2A-2D ). In some embodiments, DFR presentation module 453 is configured to render graphics determined by DFR determination module 452 (or provided by computing device 202) on touch-sensitive display system 412 (e.g., dynamic function row 104, FIGS. 2A-2D ). DFR presentation module 453 includes various known software components that render and cause the display of graphics on touch-sensitive display system 412, including components that modify the visual effects (e.g., brightness, transparency, saturation, contrast, or other visual characteristics) of the displayed graphics.In some embodiments, DFR module 450 includes other modules, such as a module for adjusting the sensitivity of dynamic function row 104, a module for adjusting the audible and / or tactile feedback provided by dynamic function row 104, a module for adjusting the settings of affordances and information (e.g., size, brightness, font, language, etc.) displayed by dynamic function row 104, and a module for adjusting the current power mode (e.g., normal mode and low power mode) of dynamic function row 104.
[0315] In some embodiments, memory 402 includes (e.g., within operating system 426) event sorter 470. In some embodiments, event sorter 470 performs the same functions as event sorter 370 (FIG. 3B) and includes a subset or superset of the modules, procedures, and instructions of event sorter 370 (FIG. 3B). As such, event sorter 470 will not be described for the sake of brevity.
[0316] It should be appreciated that external electronic device 400 is only an example, and that external electronic device 400 optionally has more or fewer components than those shown, optionally combines two or more components, or optionally has a different configuration or arrangement of those components. The various components shown in Figure 4 are implemented in hardware, software, firmware, or a combination thereof, including one or more signal processing circuits and / or application specific integrated circuits.
[0317] Each of the above-identified modules corresponds to a set of executable instructions for performing one or more functions described above, as well as methods described in the present application (e.g., computer-implemented methods and other information processing methods described herein). These modules (i.e., sets of instructions) need not be implemented as separate software programs, procedures, or modules; thus, various subsets of these modules are optionally combined or otherwise rearranged in various embodiments. In some embodiments, memory 402 optionally stores a subset of the above-identified modules and data structures. Additionally, memory 402 optionally stores additional modules and data structures not described above.
[0318] As used herein, the term “focus selector” refers to an input element that indicates the current portion of a user interface with which a user is interacting. In some implementations including a cursor or other location marker, the cursor acts as the “focus selector” such that when input (e.g., a press input) is detected on a touch-sensitive surface (e.g., touchpad 355 in FIG. 3 or touch-sensitive surface 451 in FIG. 4B ) while the cursor is over a particular user interface element (e.g., a button, window, slider, or other user interface element), the particular user interface element is adjusted according to the detected input. In some implementations including a touchscreen display that allows direct interaction with user interface elements on the touchscreen display, a contact detected on the touchscreen acts as the “focus selector” such that when input (e.g., a press input by a contact) is detected on the touchscreen display at the location of a particular user interface element (e.g., a button, window, slider, or other user interface element), the particular user interface element is adjusted according to the detected input. In some implementations, focus moves from one region of the user interface to another region of the user interface without a corresponding movement of a cursor or contact on the touchscreen display (e.g., by using the tab key or arrow keys to move focus from one button to another). In these implementations, the focus selector moves to follow the movement of focus between various regions of the user interface. Regardless of the specific form taken by the focus selector, the focus selector is generally a user interface element (or contact on a touchscreen display) that is controlled by the user to communicate the user's intended interaction with the user interface (e.g., by indicating to the device the element of the user interface with which the user intends to interact).For example, the position of a focus selector (e.g., cursor, contact, or selection box) over a respective button while a press input is detected on a touch-sensitive surface (e.g., a touchpad or touchscreen) indicates that the user intends to activate the respective button (as opposed to other user interface elements shown on the device's display).
[0319] As used herein and in the claims, the term “intensity” of a contact on a touch-sensitive surface refers to the force or pressure (force per unit area) of a contact (e.g., a finger contact or a stylus contact) on the touch-sensitive surface, or a proxy for the force or pressure of a contact on the touch-sensitive surface. The intensity of a contact has a range of values that includes at least four distinct values and more typically includes hundreds (e.g., at least 256) distinct values. The intensity of a contact is optionally determined (or measured) using various techniques and various sensors or combinations of sensors. For example, one or more force sensors under or adjacent to the touch-sensitive surface are optionally used to measure force at various points on the touch-sensitive surface. In some implementations, force measurements from multiple force sensors are combined (e.g., weighted average or sum) to determine an estimated force of the contact. Similarly, a pressure-sensitive tip of a stylus is optionally used to determine the pressure of the stylus on the touch-sensitive surface. Alternatively, the size and / or change in the contact area detected on the touch-sensitive surface, the capacitance and / or change in the capacitance of the touch-sensitive surface proximate the contact, and / or the resistance and / or change in the capacitance of the touch-sensitive surface proximate the contact are optionally used as a surrogate for the force or pressure of the contact on the touch-sensitive surface. In some implementations, the surrogate measure for the force or pressure of the contact is used directly to determine whether an intensity threshold is exceeded (e.g., the intensity threshold is described in units corresponding to the surrogate measure). In some implementations, the surrogate measure for the force or pressure of the contact is converted to an estimated force or pressure, and the estimated force or pressure is used to determine whether an intensity threshold is exceeded (e.g., the intensity threshold is a pressure threshold measured in units of pressure).Using the intensity of contact as an attribute of user input allows a user to access additional device functionality that may not otherwise be easily accessible by the user on devices of reduced size with limited assets for displaying affordances (e.g., on a touch-sensitive display) and / or receiving user input (e.g., via a touch-sensitive display, touch-sensitive surface, or physical / mechanical controls such as knobs or buttons).
[0320] In some embodiments, contact / motion module 130 uses a set of one or more intensity thresholds to determine whether an action has been performed by a user (e.g., whether a user has “clicked” on an icon). In some embodiments, at least a subset of the intensity thresholds are determined according to software parameters (e.g., the intensity thresholds are not determined by the activation threshold of a particular physical actuator and can be adjusted without modifying the physical hardware of system 100). For example, the mouse “click” threshold of a trackpad or touchscreen display can be set to any of a wide range of pre-defined thresholds without modifying the trackpad or touchscreen display hardware. Furthermore, in some implementations, a device user is provided with software settings to adjust one or more of the set of intensity thresholds (e.g., by adjusting individual intensity thresholds and / or by adjusting multiple intensity thresholds at once with a system-level click “intensity” parameter).
[0321] As used herein and in the claims, the term "characteristic intensity" of a contact refers to a characteristic of that contact based on one or more intensities of the contact. In some embodiments, the characteristic intensity is based on a plurality of intensity samples. The characteristic intensity is optionally based on a predetermined number of intensity samples, i.e., a set of intensity samples collected during a predetermined time period (e.g., 0.05, 0.1, 0.2, 0.5, 1, 2, 5, 10 seconds) associated with a predetermined event (e.g., after detecting the contact, before detecting lift-off of the contact, before or after detecting the start of contact movement, before detecting the end of the contact, before or after detecting an increase in the intensity of the contact, and / or before or after detecting a decrease in the intensity of the contact). The characteristic intensity of the contact is optionally based on one or more of the maximum intensity of the contact, the median intensity of the contact, the average intensity of the contact, the top 10 percent of the intensity of the contact, half the maximum intensity of the contact, 90 percent of the maximum intensity of the contact, etc. In some embodiments, the duration of the contact is used in determining the characteristic intensity (e.g., when the characteristic intensity is an average of the intensity of the contact over time). In some embodiments, the characteristic intensity is compared to a set of one or more intensity thresholds to determine whether an operation is performed by the user. For example, the set of one or more intensity thresholds may include a first intensity threshold and a second intensity threshold. In this example, a contact having a characteristic intensity that does not exceed the first threshold results in a first operation, a contact having a characteristic intensity that exceeds the first intensity threshold but not exceeding a second intensity threshold results in a second operation, and a contact having a characteristic intensity that exceeds the second intensity threshold results in a third operation. In some embodiments, the comparison between the characteristic intensity and the one or more intensity thresholds is not used to determine whether to perform the first operation or the second operation, but rather to determine whether to perform one or more operations (e.g., perform a respective option or refrain from performing a respective operation).
[0322] In some embodiments, a portion of the gesture is identified for purposes of determining the characteristic intensity. For example, a touch-sensitive surface may receive a continuous swipe contact (e.g., a drag gesture) that transitions from a start position to an end position, at which point the intensity of the contact increases. In this example, the characteristic intensity of the contact at the end position may be based on only a portion of the continuous swipe contact (e.g., only the portion of the swipe contact at the end position) rather than the entire swipe contact. In some embodiments, a smoothing algorithm may be applied to the intensity of the swipe contact before determining the characteristic intensity of the contact. For example, the smoothing algorithm optionally includes one or more of an unweighted moving average smoothing algorithm, a triangular smoothing algorithm, a median filter smoothing algorithm, and / or an exponential smoothing algorithm. In some situations, these smoothing algorithms eliminate small increases or decreases in the intensity of the swipe contact for purposes of determining the characteristic intensity.
[0323] In some embodiments, one or more predefined intensity thresholds are used to determine whether a particular input meets the intensity-based criteria. For example, the one or more predefined intensity thresholds may include: (i) a touch-detection intensity threshold IT0; (ii) a light pressure intensity threshold IT10; L , (iii) (e.g., at least initially I L Higher) deep pressure intensity threshold IT D , and / or (iv) one or more other intensity thresholds (e.g., I L Lower Intensity Threshold I H) In some embodiments, the light pressure intensity threshold corresponds to an intensity at which the device performs an action typically associated with clicking a physical mouse button or trackpad. In some embodiments, the deep pressure intensity threshold corresponds to an intensity at which the device performs an action different from an action typically associated with clicking a physical mouse button or trackpad. In some embodiments, when a contact is detected having a characteristic intensity below the light pressure intensity threshold (e.g., above a nominal contact-detection intensity threshold IT0 below which contact is no longer detected), the device moves the focus selector according to the movement of the contact on the touch-sensitive surface without performing an action associated with the light or deep pressure intensity threshold. In general, unless otherwise specified, these intensity thresholds are consistent across the various sets of user interface diagrams.
[0324] In some embodiments, the device's response to an input detected by the device depends on criteria based on the intensity of the contact during the input. For example, for some "light press" inputs, the intensity of the contact during the input that exceeds a first intensity threshold triggers a first response. In some embodiments, the device's response to an input detected by the device depends on criteria that include both the intensity of the contact during the input and time-based criteria. For example, for some "deep press" inputs, the intensity of the contact during the input that exceeds a second intensity threshold that is greater than the first intensity threshold for a light press triggers a second response only if a delay time has elapsed between meeting the first intensity threshold and meeting the second intensity threshold. This delay time is typically less than 200 ms in duration (e.g., 40 ms, 100 ms, or 120 ms, depending on the magnitude of the second intensity threshold, with the delay time increasing as the second intensity threshold increases). This delay time helps to avoid accidental deep press inputs. As another example, for some "deep press" inputs, there is a period of reduced sensitivity that occurs after the first intensity threshold is met. During the period of decreased sensitivity, the second intensity threshold is increased. This temporary increase in the second intensity threshold also helps to avoid accidental deep pressure inputs. For other deep pressure inputs, the response to the detection of a deep pressure input does not depend on a time-based criterion.
[0325] In some embodiments, one or more of the input intensity threshold and / or corresponding output vary based on one or more factors, such as user settings, contact movement, input timing, running application, rate at which intensity is applied, number of simultaneous inputs, user history, environmental factors (e.g., ambient noise), position of focus selector, etc. Exemplary factors are described in U.S. Patent Application Publication Nos. 14 / 399,606 and 14 / 624,296, which are incorporated herein by reference in their entireties.
[0326] For example, FIG. 3C illustrates a dynamic intensity threshold 480 that varies over time based in part on the intensity of touch input 476 over time. Dynamic intensity threshold 480 is the sum of two components: a first component 474 that decays over time after a predetermined delay time p1 from when touch input 476 is first detected, and a second component 478 that tracks the intensity of touch input 476 over time. The initial high intensity threshold of first component 474 reduces accidental triggering of a "deep press" response while still allowing an immediate "deep press" response if touch input 476 provides sufficient intensity. The second component 478 reduces unintentional triggering of a "deep press" response due to gradual intensity variations of the touch input. In some embodiments, a "deep press" response is triggered when touch input 476 meets dynamic intensity threshold 480 (e.g., at point 481 in FIG. 3C ).
[0327] FIG. 3D illustrates another dynamic intensity threshold 486 (e.g., intensity threshold I D ) Figure 3D shows two other intensity thresholds: the first intensity threshold I H and a second intensity threshold I L 3D also shows that touch input 484 reaches the first intensity threshold I before time p2. H and a second intensity threshold I L , but no response is provided until a delay p2 has elapsed at time 482. Also in FIG. 3D , the dynamic intensity threshold 486 decays over time, and the decay occurs after a predetermined delay p1 has elapsed from time 482 (the second intensity threshold I L This type of dynamic intensity threshold begins at time 488 (when the response associated with the first intensity threshold I H or the second intensity threshold I L A dynamic intensity threshold I is triggered immediately or simultaneously with triggering a response associated with a lower intensity threshold, such as D Reduce accidental triggering of responses associated with
[0328] FIG. 3E illustrates yet another dynamic intensity threshold 492 (e.g., intensity threshold I D ) is shown. In Figure 3E, the intensity threshold I LThe response associated with the intensity threshold I is triggered after a delay time p2 from when the touch input 490 is first detected. At the same time, the dynamic intensity threshold 492 decays after a predetermined delay time p1 from when the touch input 490 is first detected. Thus, the intensity threshold I is triggered after a predetermined delay time p1 from when the touch input 490 is first detected. L The decrease in intensity of touch input 490 after triggering a response associated with the touch input 490 may occur when the intensity of touch input 490 exceeds another intensity threshold, e.g., intensity threshold I L Even when the intensity threshold I D A response associated with the
[0329] Light pressure intensity threshold IT L From an intensity below the threshold IT L and deep pressure intensity threshold IT D The increase in the characteristic intensity of contact to an intensity between is sometimes referred to as a "light press" input. D From an intensity below the threshold IT D An increase in the characteristic intensity of a touch from an intensity below the touch detection intensity threshold IT0 to an intensity above the touch detection intensity threshold IT0 and a light pressure intensity threshold IT L An increase in the characteristic intensity of the contact to an intensity between ITO and ITO may be referred to as detecting a contact on the touch surface. A decrease in the characteristic intensity of the contact from an intensity above the contact-detection intensity threshold IT0 to an intensity below the contact-detection intensity threshold IT0 may be referred to as detecting lift-off of the contact from the touch surface. In some embodiments, IT0 is zero. In some embodiments, IT0 is greater than zero. In some examples, shaded circles or ellipses are used to represent the intensity of the contacts on the touch-sensitive surface. In some examples, unshaded circles or ellipses are used to represent each contact on the touch-sensitive surface without specifying the intensity of each contact.
[0330] In some embodiments described herein, one or more actions are performed in response to detecting a gesture including the respective pressure input or in response to detecting the respective pressure input performed on the respective contact(s), where the respective pressure inputs are detected based at least in part on detecting an increase in intensity of the contact(s) above a pressure input intensity threshold. In some embodiments, the respective actions are performed in response to detecting an increase in intensity of the respective contact(s) above a pressure input intensity threshold (e.g., the respective actions are performed on the “downstroke” of the respective pressure input). In some embodiments, the pressure input includes an increase in intensity of the respective contact(s) above a pressure input intensity threshold and a subsequent decrease in intensity of the contact(s) below the pressure input intensity threshold, where the respective actions are performed in response to detecting a subsequent decrease in intensity of the respective contact(s) below the pressure input threshold (e.g., the respective actions are performed on the “upstroke” of the respective pressure input).
[0331] In some embodiments, the device employs intensity hysteresis to avoid accidental input, sometimes referred to as “jitter,” and the device defines or selects a hysteresis intensity threshold that has a predetermined relationship to the pressure input intensity threshold (e.g., the hysteresis intensity threshold is X intensity units below the pressure input intensity threshold, or the hysteresis intensity threshold is 75%, 90%, or some reasonable percentage of the pressure input intensity threshold). Thus, in some embodiments, the pressure input includes an increase in the intensity of each contact above the pressure input intensity threshold and a subsequent decrease in the intensity of the contact below the hysteresis intensity threshold corresponding to the pressure input intensity threshold, and respective actions are performed in response to detecting the subsequent decrease in intensity of each contact below the hysteresis intensity threshold (e.g., the respective actions are performed on the “upstroke” of the respective pressure input). Similarly, in some embodiments, a pressure input is detected only when the device detects an increase in the intensity of the contact from an intensity below the hysteresis intensity threshold to an intensity above the pressure input intensity threshold, and optionally a subsequent decrease in the intensity of the contact to an intensity below the hysteresis intensity, and a respective action is performed in response to detecting the pressure input (e.g., an increase in the intensity of the contact or a decrease in the intensity of the contact, as the case may be).
[0332] For ease of explanation, descriptions of operations performed in response to a pressure input associated with a pressure input intensity threshold or in response to a gesture including a pressure input are, optionally, triggered in response to detecting an increase in the intensity of the contact above the pressure input intensity threshold, an increase in the intensity of the contact from an intensity below a hysteresis intensity threshold to an intensity above the pressure input intensity threshold, a decrease in the intensity of the contact below the pressure input intensity threshold, or a decrease in the intensity of the contact below a hysteresis intensity threshold corresponding to the pressure input intensity threshold. Further, in examples where an operation is described as being performed in response to detecting a decrease in the intensity of the contact below a pressure input intensity threshold, the operation is optionally performed in response to detecting a decrease in the intensity of the contact below a hysteresis intensity threshold corresponding to and lower than the pressure input intensity threshold. As noted above, in some embodiments, the triggering of these responses also depends on time-based criteria being met (e.g., a delay time elapses between the first intensity threshold being met and the second intensity threshold being met). User Interface and Related Processes
[0333] Attention is now directed to embodiments of user interfaces ("UI") and associated processes that may be implemented by portable computing system 100 (FIG. 1A) or desktop computing system 200 (FIGS. 2A-2D). In some embodiments, primary display 102 is implemented in display portion 110 (FIG. 1A) of portable computing system 100. Alternatively, in some embodiments, primary display 102 is implemented in external display device 204 (FIGS. 2A-2D). In some embodiments, dynamic function...
Claims
1. 1. An electronic device having a display and an input element with an integrated biosensor, comprising: displaying a user interface associated with a first user account while the electronic device is unlocked for the first user account; wherein the electronic device is associated with a plurality of user accounts, including the first user account and a second user account; the second user account is associated with biometric information that enables unlocking the electronic device for the second user account; receiving input via the input element having the integral biometric sensor while displaying the user interface associated with the first user account; in response to a determination that the input satisfies a second user switching criterion including a requirement that biometric information detected during the input with the input element matches biometric information of the second user account of the plurality of user accounts while the second user account has an active session on the electronic device; unlocking the electronic device for the second user account; locking the electronic device for the first user account; replacing a display of the user interface associated with the first user account with a user interface associated with the second user account; A method comprising:
2. In response to receiving the biometric information, 2. The method of claim 1, further comprising: displaying a prompt on the display to enter login credentials for the second user account in accordance with a determination that the input satisfies second user switching criteria while the second user account does not have an active session on the electronic device, the second user switching criteria including a requirement that biometric information detected during the input with the input element matches biometric information of the second user account of the plurality of user accounts.
3. In response to receiving the biometric information, in accordance with a determination that the input satisfies a third user switching criterion while a third user account has an active session on the electronic device, the third user switching criterion including a requirement that biometric information detected during the input with the input element matches biometric information of the third user account of the plurality of user accounts; unlocking the electronic device for the third user account; locking the electronic device for the first user account; replacing a display of the user interface associated with the first user account with a user interface associated with the third user account; The method of claim 1 , comprising:
4. In response to receiving the biometric information, 2. The method of claim 1, further comprising: displaying a prompt on the display to enter login credentials for the third user account in accordance with a determination that the input satisfies third user switching criteria while a third user account does not have an active session on the electronic device, the third user switching criteria including a requirement that biometric information detected during the input with the input element matches biometric information of the third user account of the plurality of user accounts.
5. the input element is a button; The method of claim 1 , wherein the input via the input element with the integrated biosensor includes detecting a press input via the button.
6. the second user switching criterion includes a criterion that the press input lasts less than a first threshold time; 6. The method of claim 5, further comprising: in response to receiving the press input via the input element having the integral biometric sensor, placing the electronic device into a low power mode in accordance with a determination that the press input using the button lasts longer than the first threshold time.
7. the second user switching criterion includes a criterion that the press input lasts less than a first threshold time; The method includes, in response to receiving the pressure input via the input element having the integral biosensor, placing the electronic device in a low power mode in response to a determination that the press input using the button lasts longer than the first threshold time and shorter than a second threshold time; displaying a menu of options for changing a state of the electronic device in response to a determination that the pressure input lasts longer than the second threshold time; The method of claim 5 , comprising:
8. in response to receiving the input via the input element having the integral biosensor; The method of claim 7 , further comprising rebooting the electronic device pursuant to a determination that the press input with the button lasts longer than a third threshold time period that is greater than the second threshold time period.
9. replacing a display of the user interface associated with the first user account with a user interface associated with the second user account; receiving a second input via the input element having the integral biometric sensor while displaying the user interface associated with the second user account; in response to receiving the second input via the input element having the integral biosensor; in response to a determination that the second input satisfies a first user switching criterion including a requirement that biometric information detected during the input with the input element matches biometric information of the first user account of the plurality of user accounts while the first user account has an active session on the electronic device; unlocking the electronic device for the first user account; locking the electronic device for the second user account; replacing a display of the user interface associated with the second user account with a user interface associated with the first user account; The method of claim 1 , comprising:
10. 1. A computer-readable storage medium storing instructions that, when executed by one or more processors of an electronic device having a display and an input element with an integrated biometric sensor, cause the electronic device to: displaying a user interface associated with a first user account while the electronic device is unlocked for the first user account; wherein the electronic device is associated with a plurality of user accounts, including the first user account and a second user account; the second user account is associated with biometric information that enables unlocking the electronic device for the second user account; receiving input via the input element having the integral biometric sensor while displaying the user interface associated with the first user account; in response to a determination that the input satisfies a second user switching criterion including a requirement that biometric information detected during the input with the input element matches biometric information of the second user account of the plurality of user accounts while the second user account has an active session on the electronic device; unlocking the electronic device for the second user account; locking the electronic device with respect to the first user account; replacing a display of the user interface associated with the first user account with a user interface associated with the second user account; A computer-readable storage medium.
11. 11. The computer-readable storage medium of claim 10, wherein the instructions, when executed by one or more processors of an electronic device, cause the electronic device to perform the method of any one of claims 1 to 9.
12. 1. An electronic device comprising: one or more processors; A display and an input element having an integrated biosensor; and a memory storing one or more programs configured to be executed by the one or more processors, the one or more programs comprising: displaying a user interface associated with a first user account while the electronic device is unlocked for the first user account; wherein the electronic device is associated with a plurality of user accounts, including the first user account and a second user account; the second user account is associated with biometric information that enables unlocking the electronic device for the second user account; receiving input via the input element having the integral biometric sensor while displaying the user interface associated with the first user account; in response to a determination that the input satisfies a second user switching criterion including a requirement that biometric information detected during the input with the input element matches biometric information of the second user account of the plurality of user accounts while the second user account has an active session on the electronic device; unlocking the electronic device for the second user account; locking the electronic device for the first user account; replacing a display of the user interface associated with the first user account with a user interface associated with the second user account; An electronic device comprising:
13. 13. An electronic device according to claim 12, wherein the one or more programs comprise instructions for performing or to cause to be performed a method according to any one of claims 1 to 9.
Citation Information
Patent Citations
Operation processing apparatus
JP2009134638A
Information processing device
JP2015201131A
Method, user terminal and recovering medium for logging in using fingerprints
KR1020140036582A
System for and method of finger initiated actions
US20050169503A1