Device, method and graphical user interface for manipulating user interface object with visual and / or haptic feedback
By employing sensors to detect contact intensity on touch sensing surfaces, the method streamlines user interface operations on electronic devices, improving efficiency and reducing energy consumption.
Patent Information
- Application Number
- JP2025013167
- Authority / Receiving Office
- JP · JP
- Patent Type
- Applications
- Current Assignee / Owner
- Priority Date
- 2015-09-30
- Filing Date
- 2025-01-29
- Publication Date
- 2025-06-10
AI Technical Summary
Existing methods for operating user interfaces on electronic devices with touch sensing surfaces are cumbersome and inefficient, particularly in battery-operated devices where they consume unnecessary energy.
The implementation of a method that uses sensors to detect the intensity of contact on a touch sensing surface, allowing for the dynamic visualization of user interface objects based on contact intensity, thereby reducing the number of inputs required from the user.
This approach enhances the efficiency of user interface operations by reducing the time and energy consumed, while also extending battery life in portable devices.
Smart Images
Figure 2025087676000001_ABST
Abstract
Description
Technical Field
[0001] This application generally relates to an electronic device having a touch sensing surface, and examples of such electronic devices include, but are not limited to, an electronic device having a touch sensing surface for detecting an input for operating a user interface.
Background Art
[0002] The use of touch sensing surfaces as input devices for computers and other electronic computing devices has increased significantly in recent years. Exemplary touch sensing surfaces include touch pads and touch screen displays. Such surfaces are widely used to operate user interfaces on displays.
[0003] Exemplary operations include adjusting the position and / or size of one or more user interface objects, or activating a button, or opening a file / application represented by a user interface object, and associating metadata with one or more user interface objects, or otherwise operating the user interface. Exemplary user interface objects include digital images, videos, text, icons, control elements such as buttons, and other graphics.
[0004] In some situations, the user may use a file management program (e.g., Finder of Apple Inc. in Cupertino, California), a messaging application (e.g., Messages of Apple Inc. in Cupertino, California), an image management application (e.g., Photos of Apple Inc. in Cupertino, California), a camera application (e.g., Camera of Apple Inc. in Cupertino, California), a map application (e.g., Map of Apple Inc. in Cupertino, California), a note-taking application (e.g., Notes of Apple Inc. in Cupertino, California), a digital content (e.g., video and music) management application (e.g., Music and iTunes of Apple Inc. in Cupertino, California), a news application (e.g., News of Apple Inc. in Cupertino, California), a phone application (e.g., Phone of Apple Inc. in Cupertino, California), an email application (e.g., Mail of Apple Inc. in Cupertino, California), a browser application (e.g., Safari of Apple Inc. in Cupertino, California), a drawing application, a presentation application (e.g., Keynote of Apple Inc. in Cupertino, California), a word processing application (e.g., Pages of Apple Inc. in Cupertino, California), a spreadsheet application (e.g., Numbers of Apple Inc. in Cupertino, California), a reader application (e.g., iBooks of Apple Inc. in Cupertino, California), a video creation application (e.g., Apple Inc. in Cupertino, Californiasuch operations need to be performed on user interface objects within iMovie), and / or location-based applications (e.g., Find Friends and Find iPhone of Apple Inc. in Cupertino, California).
[0005] However, existing methods for performing these operations are cumbersome and inefficient. Moreover, existing methods waste energy by taking an unnecessarily long time. This latter consideration is particularly important in battery-operated devices. SUMMARY OF THE INVENTION
[0006] Accordingly, there is a need for an electronic device having a faster and more efficient method and interface for operating a user interface. Such method and interface optionally complement or replace conventional methods for operating a user interface. Such method and interface reduce the number, degree, and / or nature of inputs from a user, creating a more efficient human-machine interface. In the case of battery-operated devices, such method and interface conserve power and extend the time intervals between battery charges.
[0007] The above-described deficiencies and other problems associated with user interfaces for electronic devices having a touch-sensing surface are reduced or eliminated by the disclosed devices. In some embodiments, the device is a desktop computer. In some embodiments, the device is portable (e.g., a notebook computer, a tablet computer, or a handheld device). In some embodiments, the device is a personal electronic device (e.g., a wearable electronic device such as a wristwatch). In some embodiments, the device has a touchpad. In some embodiments, the device has a touch-sensing display (also known as a “touch screen” or “touch screen display”). In some embodiments, the device has a graphical user interface (GUI), one or more processors, memory, and one or more modules, programs, or sets of instructions stored in the memory for performing a plurality of functions. In some embodiments, the user interacts with the GUI on the touch-sensing surface primarily via stylus and / or finger contact and gestures. In some embodiments, these functions optionally include image editing, drawing, presenting, word processing, spreadsheet creation, game play, making a phone call, video conferencing, sending an email, instant messaging, training support, taking a digital photo, taking a digital video, web browsing, playing digital music, taking notes, and / or playing a digital video. The executable instructions for performing these functions are optionally included in a non-transitory computer-readable storage medium or other computer program product configured to be executed by one or more processors.
[0008] According to some embodiments, a method is performed on an electronic device having a touch sensing surface and a display. The device includes one or more sensors for detecting the intensity of contact with the touch sensing surface. The device displays a plurality of user interface objects on a first user interface on the display. The device detects a contact at a location on the touch sensing surface when a focus selector is at the location of the first user interface object among the plurality of user interface objects on the display. When the focus selector is at the location of the first user interface object on the display, the device detects that the characteristic intensity of the contact has increased to a first intensity threshold, and in response to detecting that the characteristic intensity of the contact has increased to the first intensity threshold, the device visually obscures a plurality of user interface objects other than the first user interface object while maintaining the display of the first user interface object without visually obscuring the first user interface object in the first user interface. The device detects that the characteristic intensity of the contact continues to increase and exceeds the first intensity threshold, and in response to detecting that the characteristic intensity of the contact continues to increase and exceeds the first intensity threshold, the device dynamically increases the amount by which a plurality of user interface objects other than the first user interface object in the first user interface are visually blurred while maintaining the display of the first user interface object without visually obscuring the first user interface object.
[0009] According to some embodiments, an electronic device includes a display unit configured to display user interface objects, a touch sensing surface unit configured to receive contacts, one or more sensor units configured to detect the intensity of the contacts, the touch sensing surface unit, and a processing unit coupled to the touch sensing surface unit, the display unit, and the one or more sensor units. The processing unit enables the display of a plurality of user interface objects in a first user interface on the display unit, and a focus selector detects a contact at a location on the touch sensing surface unit while the focus selector is at the location of a first user interface object among the plurality of user interface objects on the display unit, and the processing unit detects that the characteristic intensity of the contact has increased to a first intensity threshold while the focus selector is at the location of the first user interface object on the display unit, and in response to detecting that the characteristic intensity of the contact has increased to the first intensity threshold, the processing unit visually obscures a plurality of user interface objects other than the first user interface object in the first user interface while maintaining the display of the first user interface object without visually obscuring the first user interface object, and the processing unit detects that the characteristic intensity of the contact continues to increase and exceeds the first intensity threshold, and in response to detecting that the characteristic intensity of the contact continues to increase and exceeds the first intensity threshold, the processing unit dynamically increases the amount by which a plurality of user interface objects other than the first user interface object in the first user interface are visually blurred while maintaining the display of the first user interface object without visually obscuring the first user interface object.
[0010] According to some embodiments, a method is performed on an electronic device having a touch sensing surface and a display. The device includes one or more sensors for detecting the intensity of contact with the touch sensing surface. The device displays a plurality of user interface objects on a first user interface on the display. The device detects an input by contact while a focus selector is over a first user interface object among the plurality of user interface objects on the display. In accordance with a determination that the input meets a selection criterion, the device displays a second user interface that is separate from the first user interface in response to detecting the input. In accordance with a determination that a first portion of the input meets a preview criterion, the device displays a preview area that includes a reduced representation of the second user interface overlapping at least some of the plurality of user interface objects within the first user interface in response to detecting the first portion of the input. In accordance with a determination that a second portion of the input by contact, detected after the first portion of the input, meets a user interface replacement criterion, the device replaces the display of the first user interface and the overlapping preview area with the display of the second user interface. In accordance with a determination that the second portion of the input by contact meets a preview area non-display criterion, the device stops displaying the preview area and displays the first user interface after the input has ended.
[0011] According to some embodiments, an electronic device includes a display unit configured to display user interface objects, a touch sensing surface unit configured to receive contacts, one or more sensor units configured to detect the intensity of the contact with the touch sensing surface unit, and a processing unit coupled to the display unit, the touch sensing surface unit, and the one or more sensor units. The processing unit is configured to enable the display of a plurality of user interface objects in a first user interface on the display unit. The processing unit is configured to detect an input by contact while a focus selector is on a first user interface object among the plurality of user interface objects on the display unit. According to a determination that the input meets a selection criterion, the processing unit is configured to enable the display of a second user interface that is separate from the first user interface in response to detecting the input. According to a determination that a first portion of the input meets a preview criterion, the processing unit is configured to enable the display of a preview area including a reduced representation of a preview area of the second user interface that overlaps at least some of the plurality of user interface objects in the first user interface in response to detecting the first portion of the input. According to a determination that a second portion of the input by contact detected after the first portion of the input meets a user interface replacement criterion, the processing unit is configured to replace the display of the first user interface and the overlapping preview area with the display of the second user interface. According to a determination that the second portion of the input by contact meets a preview area non-display criterion, the processing unit is configured to stop displaying the preview area and enable the display of the first user interface after the input ends.
[0012] According to some embodiments, a method is performed on an electronic device having a touch sensing surface and a display. The device includes one or more sensors for detecting the intensity of contact with the touch sensing surface. The device displays a plurality of user interface objects on a first user interface on the display. The device detects a first portion of a press input due to contact at a location on the touch sensing surface corresponding to the location of a first user interface object among the plurality of user interface objects on the display. While detecting the first portion of the press input due to contact at the location on the touch sensing surface corresponding to the location of the first user interface object among the plurality of user interface objects on the display, the device selects the first user interface object and detects that the intensity of the contact has increased to a second intensity threshold. In response to detecting that the intensity of the contact has increased to the second intensity threshold, the device displays a preview area overlapping at least some of the plurality of user interface objects on the first user interface. After detecting the first portion of the press input, the device detects a second portion of the press input of the contact. In response to detecting the second portion of the press input of the contact, according to a determination that the second portion of the press input of the contact meets a user interface replacement criterion, the device replaces the display of the first user interface with a second user interface that is separate from the first user interface. According to a determination that the second portion of the press input of the contact meets a preview area maintenance criterion, the device maintains the display of the preview area overlapping at least some of the plurality of user interface objects within the first user interface even after the press input ends. According to a determination that the second portion of the press input of the contact meets a preview area non-display criterion, the device stops displaying the preview area and maintains the display of the first user interface even after the press input ends.
[0013] According to some embodiments, a method is performed on an electronic device comprising a display, a touch sensing surface, and one or more sensors for detecting the intensity of contact with the touch sensing surface. The method includes displaying, on the display, a first user interface including a plurality of selectable user interface objects including one or more user interface objects of a first type and one or more user interface objects of a second type, distinct from the first type. While the device is displaying the first user interface on the display, the device performs a first part of a first input by detecting that the characteristic intensity of a first contact on the touch sensing surface has increased and exceeded a first intensity threshold while a focus selector is over each of the plurality of selectable user interface objects. In response to detecting the first part of the first input, the device displays supplementary information associated with each user interface object. While the device is displaying the supplementary information associated with each user interface object, the device detects an end of the first input. In response to detecting the end of the first input, the device stops displaying the supplementary information associated with each user interface object according to a determination that each user interface object is a user interface object of the first type, and maintains the display of the supplementary information associated with each user interface object after detecting the end of the first input according to a determination that each user interface object is a user interface object of the second type.
[0014] According to some embodiments, an electronic device comprises a display unit configured to display content items, a touch sensing surface unit configured to receive user input, one or more sensor units configured to detect the intensity of contact with the touch sensing surface unit, and a processing unit coupled to the display unit, the touch sensing surface unit, and the one or more sensor units. The processing unit enables the display on the display unit of a first user interface including a plurality of selectable user interface objects including one or more user interface objects of a first type and one or more user interface objects of a second type distinct from the first type, and while the first user interface is being displayed on the display unit, detects a first portion of a first input including detecting that while a focus selector is over each of the plurality of selectable user interface objects, a characteristic intensity of a first contact increases on the touch sensing surface and exceeds a first intensity threshold, enables the display of supplementary information associated with each user interface object in response to detecting the first portion of the first input, detects the end of the first input while the supplementary information associated with each user interface object is being displayed, and in response to detecting the end of the first input, discontinues enabling the display of the supplementary information associated with each user interface object according to a determination that each user interface object is a user interface object of the first type, and maintains the display of the supplementary information associated with each user interface object after detecting the end of the first input according to a determination that each user interface object is a user interface object of the second type.
[0015] According to some embodiments, a method is performed on an electronic device comprising a display, a touch sensing surface, and one or more sensors for detecting the intensity of contact with the touch sensing surface. The device displays on the display a first user interface that includes a first appearance and a background that includes one or more foreground objects. While the device is displaying the first user interface on the display, the device detects a first input due to a first contact on the touch sensing surface while a first focus selector is at a location within the first user interface corresponding to the background of the first user interface. In response to detecting the first input due to the first contact, according to a determination that the first contact has a characteristic intensity that exceeds a first intensity threshold, the device dynamically changes the appearance of the background of the first user interface without changing the appearance of the one or more foreground objects in the first user interface. The dynamic change in the appearance of the background of the first user interface is at least partially based on the characteristic intensity of the first contact. While the device is dynamically changing the appearance of the background of the first user interface, the device detects an end of the first input due to the first contact, and in response to detecting the end of the first input due to the first contact, the device returns the background of the first user interface to its first appearance.
[0016] According to some embodiments, an electronic device includes a display unit configured to display a user interface, a background and foreground objects, a touch sensing surface unit configured to receive user input, one or more sensor units configured to detect the intensity of contact with the touch sensing surface unit, and a processing unit coupled to the display unit, the touch sensing surface unit, and the one or more sensor units. The processing unit is configured to enable the display of a first user interface including a background having a first appearance and one or more foreground objects on the display. While the first user interface is being displayed on the display, the processing unit is configured to detect a first input due to a first contact on the touch sensing surface unit while a first focus selector is at a location within the first user interface corresponding to the background of the first user interface. In response to detecting the first input due to the first contact, and according to a determination that the first contact has a characteristic intensity exceeding a first intensity threshold, the processing unit is configured to dynamically change the appearance of the background of the first user interface without changing the appearance of the one or more foreground objects in the first user interface. The dynamic change in the appearance of the background of the first user interface is at least partially based on the characteristic intensity of the first contact. While dynamically changing the appearance of the background of the first user interface, the processing unit detects the end of the first input due to the first contact, and in response to detecting the end of the first input due to the first contact, the processing unit is configured to return the background of the first user interface to its first appearance.
[0017] According to some embodiments, a method is performed in an electronic device comprising a display, a touch sensing surface, and one or more sensors for detecting the intensity of contact with the touch sensing surface. The device displays on the display a first user interface including a first appearance and a background including one or more foreground objects. While the first user interface is being displayed on the display, the device detects an input on the touch sensing surface by a first contact having a characteristic intensity above a first intensity threshold. In response to detecting the input by the first contact, during that input, according to a determination that a focus selector is at a location within the first user interface corresponding to the background of the user interface, the device dynamically changes the appearance of the background of the first user interface without changing the appearance of the one or more foreground objects in the first user interface. The dynamic change in the appearance of the background of the first user interface is at least partially based on the characteristic intensity of the first contact, and according to a determination that the focus selector is at a location within the first user interface corresponding to each of the one or more foreground objects in the first user interface, the device maintains the first appearance of the background of the first user interface.
[0018] According to some embodiments, an electronic device includes a display unit configured to display a user interface, a background and foreground objects, a touch sensing surface unit configured to receive user input, one or more sensor units configured to detect the intensity of contact with the touch sensing surface unit, and a processing unit coupled to the display unit, the touch sensing surface unit, and the one or more sensor units. The processing unit is configured to enable the display of a first user interface on the display unit that includes a background having a first appearance and one or more foreground objects. While the first user interface is being displayed on the display unit, the processing unit is configured to detect, on the touch sensing surface unit, an input due to a first contact having a characteristic intensity that exceeds a first intensity threshold. In response to detecting the input due to the first contact, during the input, according to a determination that a focus selector is at a location within the first user interface corresponding to the background of the user interface, the processing unit is configured to dynamically change the appearance of the background of the first user interface without changing the appearance of one or more foreground objects within the first user interface. The dynamic change in the appearance of the background of the first user interface is at least partially based on the characteristic intensity of the first contact. According to a determination that the focus selector is at a location within the first user interface corresponding to each of the one or more foreground objects within the first user interface, the processing unit is configured to maintain the first appearance of the background of the first user interface.
[0019] According to some embodiments, a method is performed in an electronic device comprising a display, a touch sensing surface, and one or more sensors for detecting the intensity of contact with the touch sensing surface. The device displays on the display a first user interface including a background and a foreground area that overlaps a portion of the background and includes a plurality of user interface objects. The device detects an input by contact on the touch sensing surface while a first focus selector is on a first user interface object among the plurality of user interface objects within the foreground area. In response to detecting the input by contact, the device performs a first predetermined action corresponding to the first user interface object within the foreground area according to a determination that the input by contact satisfies one or more first pressing criteria including a criterion satisfied when the characteristic intensity of the contact remains below a first intensity threshold during the input, and the device performs a second action distinct from the first predetermined action corresponding to the first user interface object within the foreground area according to a determination that the input by contact satisfies one or more second pressing criteria including a criterion satisfied when the characteristic intensity of the contact increases and exceeds the first intensity threshold during the input.
[0020] According to some embodiments, an electronic device includes a display unit configured to display a user interface and user interface objects, a touch sensing surface unit configured to receive user input, one or more sensor units configured to detect the intensity of contact with the touch sensing surface unit, and a processing unit coupled to the display unit, the touch sensing surface unit, and the one or more sensor units. The processing unit is configured to enable the display of a first user interface on the display unit that includes a background having a first appearance and one or more foreground objects. While the first user interface is being displayed on the display unit, the processing unit is configured to detect, on the touch sensing surface unit, an input by a first contact having a characteristic intensity that exceeds a first intensity threshold. In response to detecting the input by the first contact, during that input, according to a determination that a focus selector is at a location within the first user interface corresponding to the background of the user interface, the processing unit is configured to dynamically change the appearance of the background of the first user interface without changing the appearance of one or more foreground objects within the first user interface. The dynamic change in the appearance of the background of the first user interface is at least partially based on the characteristic intensity of the first contact. According to a determination that the focus selector is at a location within the first user interface corresponding to each of the one or more foreground objects within the first user interface, the processing unit is configured to maintain the first appearance of the background of the first user interface.
[0021] According to some embodiments, a method is performed on an electronic device comprising a display, a touch sensing surface, and one or more sensors for detecting the intensity of contact with the touch sensing surface. The device displays on the display an application launch user interface that includes a plurality of application icons for launching corresponding applications. While the application launch user interface is being displayed, the device detects a first contact input, including detecting a first contact at a location on the touch sensing surface corresponding to a first application icon of the plurality of application icons. The first application icon is an icon for launching a first application associated with one or more corresponding quick actions. In response to detecting the first contact input in accordance with a determination that the first contact input meets one or more application launch criteria, the device launches the first application. In accordance with a determination that the first contact input meets one or more quick action display criteria, including criteria that are satisfied when a characteristic intensity of the first contact increases and exceeds respective intensity thresholds, the device displays, simultaneously with the first application icon, one or more quick action objects associated with the first application without launching the first application.
[0022] According to some embodiments, an electronic device includes a display unit configured to display user interface objects, a touch sensing surface unit configured to receive user input, one or more sensor units configured to detect the intensity of contact with the touch sensing surface unit, and a processing unit coupled to the display unit, the touch sensing surface unit, and the one or more sensor units. The processing unit is configured to enable the display unit to display an application launch user interface including a plurality of application icons for launching corresponding applications. While the application launch user interface is being displayed, the processing unit is configured to detect a first contact input including detecting a first contact at a location on the touch sensing surface unit corresponding to a first application icon of the plurality of application icons, the first application icon being an icon for launching a first application associated with one or more corresponding quick actions. In response to detecting the first contact input, the processing unit is configured to launch the first application according to a determination that the first contact input meets one or more application launch criteria. According to a determination that the first contact input meets one or more quick action display criteria including a criterion satisfied when the characteristic intensity of the first contact increases and exceeds respective intensity thresholds, the processing unit enables the display of one or more quick action objects associated with the first application simultaneously with the first application icon without launching the first application.
[0023] According to some embodiments, a method is performed on an electronic device having a display and one or more input devices. The electronic device displays, on the display, a first user interface including a plurality of user interface objects each associated with a corresponding set of menu options. The device detects, via the one or more input devices, a first input corresponding to a request to display menu options for a first user interface object of the plurality of user interface objects. In response to detecting the first input, the device displays, in a menu, menu items corresponding to the first user interface object. Displaying the menu includes displaying, in the menu, the menu items corresponding to the first user interface object in a first order according to a determination that the first user interface object is at a first location within the first user interface, and displaying, in the menu, the menu items corresponding to the first user interface object in a second order different from the first order according to a determination that the first user interface object is at a second location within the first user interface different from the first location.
[0024] According to some embodiments, an electronic device includes a display unit configured to display content items, one or more input devices configured to receive user input, and a processing unit coupled to the display unit and the one or more input devices. The processing unit is configured to enable, on the display unit, the display of a first user interface including a plurality of user interface objects each associated with a corresponding set of menu options. The processing unit is configured to detect, via the one or more input devices, a first input corresponding to a request to display menu options for a first user interface object among the plurality of user interface objects. In response to detecting the first input, the processing unit enables the display of a menu item corresponding to the first user interface object in the menu. Enabling the display of the menu includes displaying, in a first order in the menu, the menu item corresponding to the first user interface object according to a determination that the first user interface object is at a first location within the first user interface, and displaying, in a second order different from the first order in the menu, the menu item corresponding to the first user interface object according to a determination that the first user interface object is at a second location within the first user interface different from the first location.
[0025] According to some embodiments, a method is performed in an electronic device comprising a display, a touch sensing surface, and one or more sensors for detecting the intensity of contact with the touch sensing surface. The device displays on the display a user interface including selectable user interface objects associated with a plurality of actions for interacting with the user interface, the plurality of actions including a direct selection action and one or more other actions. The device detects an input, including detecting a contact on the touch sensing surface while a focus selector is over a selectable user interface object while the user interface including the selectable user interface object is being displayed. In response to detecting the input, including detecting the contact, the device displays on the display a menu including a graphical representation of a plurality of actions including the direct selection action and one or more other actions, and according to a determination that the input meets a direct selection criterion including a criterion that is met when the characteristic intensity of the contact increases and exceeds respective intensity thresholds, the device performs the direct selection action.
[0026] According to some embodiments, an electronic device includes a display unit configured to display content items, a touch sensing surface unit configured to receive user input, one or more sensor units configured to detect the intensity of contact with the touch sensing surface unit, and a processing unit coupled to the display unit, the touch sensing surface unit, and the one or more sensor units. The processing unit is configured to enable, on the display unit, a display of a user interface including selectable user interface objects associated with a plurality of actions for interacting with the user interface, the plurality of actions including a direct selection action and one or more other actions. The processing unit is configured to detect an input including detecting a contact on the touch sensing surface unit while the focus selector is over a selectable user interface object while displaying a user interface including the selectable user interface objects. In response to detecting the input including detecting the contact, according to a determination that the input meets a selection criterion, the processing unit is configured to enable, on the display unit, a display of a menu including a graphical representation of a plurality of actions including the direct selection action and the one or more other actions, and according to a determination that the input meets a direct selection criterion including a criterion that is met when the characteristic intensity of the contact increases and exceeds respective intensity thresholds, the processing unit is configured to execute the direct selection action.
[0027] There is a need for an electronic device with improved methods and interfaces for teaching users new user interface functions and features, such as new contact strength-based functions and features. Such methods and interfaces optionally complement or replace conventional methods for teaching users new user interface functions and features. Such methods reduce the number, degree, and / or nature of inputs from the user, creating a more efficient human-machine interface. In the case of battery-operated devices, such methods and interfaces save power and extend the battery charging time intervals.
[0028] According to some embodiments, a method is performed in an electronic device comprising a display, a touch sensing surface, and one or more sensors for detecting the intensity of contact with the touch sensing surface. The device displays a user interface on the display, the user interface including a plurality of user interface objects associated with respective object-specific actions triggered by a change in contact intensity, the plurality of user interface objects including a first object displayed at a first location within the user interface and a second object displayed at a second location within the user interface. While displaying the user interface including the plurality of user interface elements, the device detects a first input including detecting a first contact on the touch sensing surface and detecting that the characteristic intensity of the first contact has increased and exceeded a first intensity threshold. In response to detecting the first input, according to a determination that the focus selector is at the first location within the user interface where the first object is displayed, the device performs a first action associated with the first object, including displaying additional information associated with the first object on the display, and according to a determination that the focus selector is at the second location within the user interface where the second object is displayed, the device performs a second action associated with the second object, including displaying additional information associated with the second object on the display, the second action being distinct from the first action associated with the first object, and according to a determination that the focus selector is at a location within the user interface that is away from any object associated with an object-specific action triggered by a change in contact intensity, the device performs a third action including updating the user interface on the display to visually distinguish the first object and the second object simultaneously in the user interface.
[0029] According to some embodiments, an electronic device includes a display unit configured to display a user interface and user interface objects, a touch sensing surface unit configured to receive user input, one or more sensor units configured to detect the intensity of contact with the touch sensing surface unit, and a processing unit coupled to the display unit, the touch sensing surface unit, and the one or more sensor units.The processing unit enables the display on the display unit of a display of a user interface including a plurality of user interface elements, which are a plurality of user interface objects associated with respective object-specific operations triggered by a change in contact intensity, including a first object displayed at a first location within the user interface and a second object displayed at a second location within the user interface. While displaying a user interface including a plurality of user interface elements, the processing unit detects a first contact on the touch-sensitive surface unit and detects that the characteristic intensity of the first contact has increased and exceeded a first intensity threshold, thereby detecting a first input. In response to detecting the first input, the focus selector performs a first operation associated with the first object, including displaying additional information associated with the first object on the display according to a determination that the first object is at the first location within the user interface where the first object is displayed. The focus selector performs a second operation associated with the second object, which is separate from the first operation associated with the first object, including displaying additional information associated with the second object on the display unit according to a determination that the second object is at the second location within the user interface where the second object is displayed. The focus selector is configured to perform a third operation including updating the user interface on the display unit to visually distinguish the first object and the second object simultaneously in the user interface according to a determination that the focus selector is at a location within the user interface that is away from any object associated with an object-specific operation triggered by a change in contact intensity.
[0030] According to some embodiments, a method is performed on an electronic device comprising a display, a touch sensing surface, and one or more sensors for detecting the intensity of contact with the touch sensing surface. The device displays a user interface on the display that includes a first set of user interface elements, and for each user interface element in the first set of user interface elements, the device is configured to respond to a user input of a first input type by performing a plurality of operations corresponding to each user interface element at a location corresponding to each user interface element. For the remainder of the user interface, the device is not configured to respond to a user input of the first input type by performing a plurality of operations corresponding to the user interface elements within the remainder of the user interface at locations corresponding to the user interface elements within the remainder of the user interface. The device detects a first user input of the first input type while a focus selector is at a first location within the user interface. In response to detecting the first user input of the first input type while the focus selector is at the first location within the user interface, according to a determination that the first location corresponds to a first user interface element within the first set of user interface elements, the device performs a plurality of operations corresponding to the first user interface element, and according to a determination that the first location does not correspond to a user interface element within the first set of user interface elements, the device applies a visual effect for distinguishing between the first set of user interface elements and the remainder of the user interface on the display.
[0031] According to some embodiments, an electronic device includes a display unit configured to display a user interface and user interface elements, a touch sensing surface unit configured to receive user input, one or more sensor units configured to detect the intensity of contact with the touch sensing surface unit, and a processing unit coupled to the display unit, the touch sensing surface unit, and the one or more sensor units. The processing unit is configured to enable the display on the display unit of a user interface including a first set of user interface elements, and for each user interface element within the first set of user interface elements, the device is configured to respond to a user input of a first input type by performing a plurality of operations corresponding to each user interface element at a location corresponding to each user interface element. For the remainder of the user interface, the device is not configured to respond to a user input of the first input type by performing a plurality of operations corresponding to the user interface elements within the remainder of the user interface at locations corresponding to the user interface elements within the remainder of the user interface. The processing unit is configured to detect a first user input of the first input type while a focus selector is at a first location within the user interface, and in response to detecting the first user input of the first input type while the focus selector is at the first location within the user interface, perform a plurality of operations corresponding to the first user interface element according to a determination that the first location corresponds to the first user interface element within the first set of user interface elements, and apply a visual effect for distinguishing between the first set of user interface elements and the remainder within the user interface on the display unit according to a determination that the first location does not correspond to any user interface element within the first set of user interface elements.
[0032] In this way, an electronic device equipped with a display, a touch sensing surface, and one or more sensors for detecting the intensity of contact with the touch sensing surface is provided with a quick and efficient method and interface for indicating which user interface elements have contact intensity-based functions and features, thereby improving the effectiveness, efficiency, and user satisfaction of such a device. Such methods and interfaces can complement or replace conventional methods for teaching users new capabilities and functions (e.g., force-sensing or pressure-sensing user interface elements).
[0033] There is a need for an electronic device having an improved method and interface for previewing media content. Such methods and interfaces optionally complement or replace conventional methods for previewing media content. Such methods reduce the number, degree, and / or nature of user inputs, creating a more efficient human-machine interface. In the case of battery-operated devices, such methods and interfaces save power and extend the battery charging time intervals.
[0034] According to some embodiments, a method is performed on an electronic device having a display, a touch sensing surface, and one or more sensors for detecting an intensity of contact on the touch sensing surface. The method includes displaying on the display a user interface that includes a plurality of media objects including a first media object representing a first set of one or more media items and a second media object representing a second set of one or more media items different from the second set of media items. The method further includes detecting an input including a movement of contact on the touch sensing surface while a focus selector is over the first media object. The method includes, in accordance with a determination that the input detected on the touch sensing surface including the movement of the contact satisfies a media preview criterion including a criterion that a characteristic intensity of the contact increases and exceeds a media preview intensity threshold while the focus selector is over the first media object, outputting a preview of a media item from the first set of media items, stopping outputting a preview of a media item from the first set of media items in response to detecting the movement of the contact, outputting a preview of a media item from the second set of media items, and moving on the display the first media object and the second media object in accordance with the movement of the contact on the touch sensing surface in accordance with a determination that the input does not satisfy the media preview criterion.
[0035] According to some embodiments, an electronic device includes a display unit configured to display a user interface, a touch sensing surface unit for receiving contacts, one or more sensor units for detecting the intensity of contact with the touch sensing surface unit, and a processing unit coupled to the display unit, the touch sensing surface unit, and the one or more sensor units. An input including movement of a contact on the touch sensing surface is detected while a focus selector is on a first media object. The processing unit includes a plurality of media objects including a first media object representing a first set of one or more media items, different from a second set of media items, and a second media object representing the second set of one or more media items, and is configured to enable the display of the user interface on the display unit. The processing unit detects an input including movement of a contact on the touch sensing surface while the focus selector is on the first media object, and in response to detecting the input including movement of the contact on the touch sensing surface, outputs a preview of the media items from the first set of media items according to a determination that the input meets a media preview criterion including a criterion satisfied when the intensity of the contact increases and exceeds a media preview intensity threshold while the focus selector is on the first media object, stops outputting a preview of the media items from the first set of media items in response to detecting the movement of the contact, outputs a preview of the media items from the second set of media items, and is configured to move the first media object and the second media object on the display according to the movement of the contact on the touch sensing surface according to a determination that the input does not meet the media preview criterion.
[0036] In this way, a faster and more efficient method and interface for previewing media content are provided to an electronic device having a display, a touch sensing surface, and one or more sensors for detecting the intensity of contact with the touch sensing surface, thereby improving effectiveness, efficiency, and user satisfaction with such a device. Such a method and interface may complement or replace conventional methods for previewing media content.
[0037] According to some embodiments, a method is performed in an electronic device comprising a display, a touch sensing surface, and one or more sensors for detecting the intensity of contact with the touch sensing surface. The method includes displaying, on the display, a first portion of page-divided content within a user interface, the page-divided content including a plurality of sections, each section within the plurality of sections including a plurality of pages, the first portion of the page-divided content being part of a first section of the plurality of sections, the first portion of the page-divided content being between a previous consecutive page and a next consecutive page within the first section; detecting a first portion of an input, including detecting a contact on the touch sensing surface while a focus selector is within a first predefined region of the displayed first portion of the page-divided content on the display; determining, according to a determination that the first portion of the input meets a first content navigation criterion including a criterion satisfied when the device detects a lift-off of the contact from the touch sensing surface before a characteristic intensity of the contact reaches a first threshold intensity, to replace, on the display, the displayed first portion of the page-divided content with a second portion of the page-divided content including pages that are consecutively adjacent to the first portion of the page-divided content; and determining, according to a determination that the first portion of the input meets a second content navigation criterion including a criterion satisfied when the device detects that the characteristic intensity of the contact has increased and exceeded a first intensity threshold, to display an indication of the number of pages within a next consecutive page in the first section or an indication of the number of pages within a previous consecutive page in the first section while the focus selector is within the first predefined region of the displayed first portion of the page-divided content.
[0038] According to some embodiments, an electronic device includes a display unit configured to display content items, a touch-sensing surface unit configured to receive user input, one or more sensor units configured to detect the intensity of contact with the touch-sensing surface unit, and a processing unit coupled to the display unit, the touch-sensing surface unit, and the one or more sensor units. The processing unit enables the display on the display of a first portion of the page-split content within the user interface, the page-split content including a plurality of sections, each section within the plurality of sections including a plurality of pages, the first portion of the page-split content being part of the first section of the plurality of sections, the first portion of the page-split content being between a previous consecutive page and a next consecutive page within the first section, detecting a first portion of the input, including detecting a contact on the touch-sensing surface while a focus selector is within a first predefined region of the first portion of the page-split content displayed on the display, and according to a determination that the first portion of the input meets a first content navigation criterion including a criterion satisfied when the device detects a lift-off of the contact from the touch-sensing surface before the characteristic intensity of the contact reaches a first threshold intensity, replacing on the display the first portion of the page-split content with a second portion of the page-split content including a page that is continuously adjacent to the first portion of the page-split content, and being configured to enable an explicit display of the page number within the next consecutive page in the first section or an explicit display of the page number within the previous consecutive page in the first section while the focus selector is within the first predefined region of the first portion of the page-split content displayed on the display, according to a determination that the first portion of the input meets a second content navigation criterion including a criterion satisfied when the device detects that the characteristic intensity of the contact has increased and exceeded the first intensity threshold.
[0039] There is a need for an improved method and interface for an electronic device for displaying context information associated with a target location within a map. Such a method and interface optionally complement or replace a conventional method for displaying context information associated with a target location within a map. Such a method reduces the number, degree, and / or nature of inputs from a user and creates a more efficient human-machine interface. In the case of a battery-operated device, such a method and interface save power and extend the battery charging time interval.
[0040] According to some embodiments, a method is performed on an electronic device having a display, a touch-sensitive surface, and one or more sensors for detecting the intensity of contact on the touch-sensitive surface. The method includes displaying a view of a map including a plurality of target locations within a first user interface on the display. The method further includes detecting that the characteristic intensity of the contact on the touch-sensitive surface has increased and exceeded a preview threshold intensity while the view of the map including the plurality of target locations is being displayed and while a focus selector is at the location of each target location. The method further includes zooming the map to display context information near each target location in response to detecting that the characteristic intensity of the contact has increased and exceeded the preview threshold intensity. After zooming the map, the method includes detecting each input including detecting that the characteristic intensity of the contact on the touch-sensitive surface has decreased and fallen below a predetermined intensity threshold, and continuing to display context information near each target location according to a determination that the characteristic intensity of the contact increased and exceeded a context maintenance intensity threshold before detecting each input, and stopping displaying context information near the target location and redisplaying a view of the map including the plurality of target locations according to a determination that the characteristic intensity of the contact did not increase and exceed the context maintenance intensity threshold before detecting each input.
[0041] According to some embodiments, an electronic device includes a display unit, a touch sensing surface unit, one or more sensor units for detecting the intensity of contact on the touch sensing surface unit, and a processing unit coupled to the display unit, the touch sensing surface unit, and the one or more sensor units. The processing unit enables the display of a view of a map including a plurality of target locations within a first user interface on the display unit, while enabling the display of a view of a map including a plurality of target locations, and while a focus selector is at the location of each target location, detects that the characteristic intensity of contact on the touch sensing surface has increased and exceeded a preview threshold intensity, and in response to detecting that the characteristic intensity of the contact has increased and exceeded the preview threshold intensity, zooms the map and displays context information near each target location, and after zooming the map, detects that the characteristic intensity of the contact on the touch sensing surface has decreased and fallen below a predetermined intensity threshold, including detecting each input, including detecting the decrease in the characteristic intensity of the contact, and in response to detecting each input, according to a determination that the characteristic intensity of the contact has increased and exceeded a context maintenance intensity threshold before detecting each input, continues to enable the display of context information near each target location, and according to a determination that the characteristic intensity of the contact has not increased beyond the context maintenance intensity threshold until before detecting each input, stops enabling the display of context information near the target location and is configured to redisplay a view of a map including a plurality of target locations.
[0042] Therefore, an electronic device comprising a display, a touch sensing surface, and one or more sensors for detecting the intensity of contact with the touch sensing surface is provided with a faster and more efficient method and interface for displaying context information associated with a target location within a map, thereby improving the effectiveness, efficiency, and user satisfaction with such a device. Such a method and interface may complement or replace conventional methods for displaying context information associated with a target location within a map.
[0043] There is a need for an electronic device having an improved method and interface for zooming in on a map to display context information near a target location. Such a method and interface optionally complements or replaces conventional methods for zooming in on a map. Such a method reduces the number, degree, and / or nature of inputs from the user, creating a more efficient human-machine interface. In the case of battery-operated devices, such a method and interface saves power and extends the time interval between battery charges.
[0044] According to some embodiments, a method is performed on an electronic device having a display, a touch sensing surface, and one or more sensors for detecting the intensity of contact on the touch sensing surface. The method includes simultaneously displaying in a user interface on the display a map view including a plurality of target locations and a context area separate from the map view and including a representation of a first target location from the plurality of target locations and a representation of a second target location from the plurality of target locations. The method further includes detecting that the characteristic intensity of contact on the touch sensing surface has increased and exceeded respective intensity thresholds while the map view and the context area are simultaneously displayed on the display. The method includes, in response to detecting that the characteristic intensity of contact has increased and exceeded respective intensity thresholds, zooming the map view to display respective context information of the first target location in the map view near the first target location according to a determination that the focus selector was at the location of the representation of the first target location in the context area when it was detected that the characteristic intensity of contact had increased and exceeded respective intensity thresholds, and zooming the map view to display respective context information of the second target location in the map view near the second target location according to a determination that the focus selector was at the location of the representation of the second target location in the context area when it was detected that the characteristic intensity of contact had increased and exceeded respective intensity thresholds.
[0045] According to some embodiments, an electronic device includes a display unit, a touch sensing surface unit, one or more sensor units for detecting the intensity of contact on the touch sensing surface, and a processing unit coupled to the display unit, the touch sensing surface unit, and the one or more sensor units, the processing unit enabling simultaneous display of a map view including a plurality of target locations within a user interface on the display unit and a context area separate from the map view and including a representation of a first target location from the plurality of target locations and a representation of a second target location from the plurality of target locations, and while enabling simultaneous display of the map view and the context area on the display unit, detecting that the characteristic intensity of the contact on the touch sensing surface has increased and exceeded respective intensity thresholds, and in response to detecting that the characteristic intensity of the contact has increased and exceeded respective intensity thresholds, zooming the map view and displaying respective context information of the first target location within the map view near the first target location according to a determination that the focus selector was at the location of the representation of the first target location within the context area when it was detected that the characteristic intensity of the contact had increased and exceeded respective intensity thresholds, and zooming the map view and displaying respective context information of the second target location within the map view near the second target location according to a determination that the focus selector was at the location of the representation of the second target location within the context area when it was detected that the characteristic intensity of the contact had increased and exceeded respective intensity thresholds, and a processing unit configured as such.
[0046] Thus, a faster and more efficient method and interface for zooming a map are provided to an electronic device having a display, a touch sensing surface, and one or more sensors for detecting the intensity of contact with the touch sensing surface, thereby improving effectiveness, efficiency, and user satisfaction with such a device. Such a method and interface complement or replace conventional methods for zooming a map.
[0047] There is a need for an improved method and interface for an electronic device to display and use a menu containing contact information. Such method and interface optionally complement or replace a conventional method for displaying and using a menu containing contact information. Such method reduces the number, degree, and / or nature of inputs from a user and creates a more efficient human-machine interface. In the case of a battery-operated device, such method and interface conserve power and extend the time interval between battery charges.
[0048] According to some embodiments, a method is performed in an electronic device comprising a display, a touch-sensitive surface, and one or more sensors for detecting the intensity of contact with the touch-sensitive surface. The method includes displaying, on the display, a first user interface including a plurality of selectable objects associated with contact information, detecting an input, including detecting a contact on the touch-sensitive surface while the plurality of selectable objects are being displayed and while a focus selector is at a location corresponding to each selectable object, and in accordance with a determination that detecting the input includes detecting an increase in the intensity of the contact that satisfies an intensity criterion including a criterion that the detected input is satisfied when the characteristic intensity of the contact increases and exceeds each intensity threshold, displaying a menu of each selectable object including the contact information of each selectable object that overlays the first user interface including the plurality of selectable objects, and in accordance with a determination that detecting the input includes detecting a lift-off of the contact that does not satisfy the intensity criterion, replacing the display of the first user interface including the plurality of selectable objects with a display of a second user interface associated with each selectable object.
[0049] According to some embodiments, an electronic device includes a display unit configured to display a user interface, a touch sensing surface unit configured to receive user input, one or more sensor units configured to detect the intensity of contact with the touch sensing surface unit, and a processing unit coupled to the display unit, the touch sensing surface unit, and the one or more sensor units. The processing unit enables the display unit to display a first user interface including a plurality of selectable objects associated with contact information, and while enabling the display of the plurality of selectable objects and while the focus selector is at a location corresponding to each selectable object, detects an input including detecting a contact on the touch sensing surface unit, and in response to detecting the input, determines that detecting the input includes detecting an increase in the intensity of the contact that meets an intensity criterion including a criterion that is met when the characteristic intensity of the contact increases and exceeds each intensity threshold, and enables the display of a menu of each selectable object including the contact information of each selectable object that overlays the first user interface including the plurality of selectable objects, and determines that detecting the input includes detecting a lift-off of the contact without meeting the intensity criterion, and replaces the display of the first user interface including the plurality of selectable objects with the display of a second user interface associated with each selectable object.
[0050] In this way, a faster and more efficient method and interface are provided for displaying a menu including contact information on an electronic device having a display, a touch sensing surface, and one or more sensors for detecting the intensity of contact with the touch sensing surface, thereby improving the effectiveness, efficiency, and user satisfaction with such a device. Such a method and interface may complement or replace conventional methods for displaying a menu including contact information.
[0051] According to some embodiments, an electronic device includes a display, a touch sensing surface, optionally one or more sensors for detecting the intensity of contact with the touch sensing surface, one or more processors, a memory, and one or more programs. The one or more programs are stored in the memory and configured to be executed by the one or more processors. The one or more programs include instructions for performing any of the operations of the methods described herein or for causing the performance of the operations. According to some embodiments, a computer-readable storage medium stores instructions therein, and when the instructions are executed by an electronic device including a display, a touch sensing surface, and optionally one or more sensors for detecting the intensity of contact with the touch sensing surface, the instructions cause the device to perform any of the operations of the methods described herein or to cause the performance of the operations. According to some embodiments, an electronic device including a graphical user interface display, a touch sensing surface, optionally one or more sensors for detecting the intensity of contact with the touch sensing surface, a memory, and one or more processors for executing one or more programs stored in the memory includes one or more of the elements displayed in any of the methods described herein, and the elements are updated in response to input as described in any of the methods described herein. According to some embodiments, an electronic device includes a display, a touch sensing surface, and optionally one or more sensors for detecting the intensity of contact with the touch sensing surface, and means for performing or causing the performance of any of the operations of the methods described herein. According to some embodiments, an information processing apparatus for use in an electronic device including a display and a touch sensing surface, and optionally one or more sensors for detecting the intensity of contact with the touch sensing surface includes means for performing or causing the performance of any of the operations of the methods described herein.
[0052] In this way, a faster and more efficient method and interface for operating a user interface are provided for an electronic device having a display, a touch sensing surface, and optionally one or more sensors for detecting the intensity of contact with the touch sensing surface, thereby improving the effectiveness, efficiency, and user satisfaction with such a device. Such methods and interfaces can complement or replace conventional methods for operating a user interface.
Brief Description of the Drawings
[0053] For a better understanding of the various embodiments described, reference is made to the following "Description of Embodiments" in conjunction with the following drawings, in which like reference numerals refer to corresponding parts throughout the figures.
[0054]
Figure 1A
[0055]
Figure 1B
[0056]
Figure 2
[0057]
Figure 3
[0058]
Figure 4A
[0059]
Figure 4B
[0060]
Figure 4C
Figure 4D
Figure 4E
[0061]
Figure 5A
Figure 5B
Figure 5C
Figure 5D
Figure 5E
Figure 5F
Figure 5G
Figure 5H
Figure 5I
Figure 5J
Figure 5K
Figure 5L
Figure 5M
Figure 5N
Figure 5O
Figure 5P
Figure 5Q
Figure 5R
Figure 5S
Figure 5T
Figure 5U
Figure 5V
Figure 5W
Figure 5X
Figure 5Y
Figure 5Z
Figure 5AA
Figure 5AB
Figure 5AC
Figure 5AD
Figure 5AE
Figure 5AF
Figure 5AG
Figure 5AH
Figure 5AI
Figure 5AJ
Figure 5AK
Figure 5AL
Figure 5AM
Figure 5AN
Figure 5AO
Figure 5AP
Figure 5AQ
Figure 5AR
Figure 5AS
Figure 5AT
Figure 5AU
Figure 5AV
Figure 5AW
[0062]
Figure 6A
Figure 6B
Figure 6C
Figure 6D
Figure 6E
Figure 6F
Figure 6G
Figure 6H
Figure 6I
Figure 6J
Figure 6K
Figure 6L
Figure 6M
Figure 6N
Figure 6O
Figure 6P
Figure 6Q
Figure 6R
Figure 6S
Figure 6T
Figure 6U
Figure 6V
Figure 6W
Figure 6X
Figure 6Y
Figure 6Z
Figure 6AA
Figure 6AB
Figure 6AC
Figure 6AD
Figure 6AE
Figure 6AF
Figure 6AG
Figure 6AH
Figure 6AI
Figure 6AJ
Figure 6AK
Figure 6AL
Figure 6AM
Figure 6AN
Figure 6AO
Figure 6AP
Figure 6AQ
Figure 6AR
Figure 6AS
[0063]
Figure 7A
Figure 7B
Figure 7C
Figure 7D
Figure 7E
Figure 7F
Figure 7G
Figure 7H
Figure 7I
Figure 7J
Figure 7K
Figure 7L
Figure 7M
Figure 7N
Figure 7O
Figure 7P
Figure 7Q
Figure 7R
Figure 7S
Figure 7T
Figure 7U
Figure 7V
Figure 7W
Figure 7X
Figure 7Y
Figure 7Z
Figure 7AA
Figure 7AB
Figure 7AC
Figure 7AD
Figure 7AE
Figure 7AF
Figure 7AG
Figure 7AH
Figure 7AI
Figure 7AJ
Figure 7AK
Figure 7AL
Figure 7AM
Figure 7AN
Figure 7AO
Figure 7AP
Figure 7AQ
[0064]
Figure 8A
Figure 8B
Figure 8C
Figure 8D
Figure 8E
Figure 8F
Figure 8G
Figure 8H
Figure 8I
Figure 8J
Figure 8K
Figure 8L
Figure 8M
Figure 8N
Figure 8O
Figure 8P
Figure 8Q
Figure 8R
Figure 8S
Figure 8T
Figure 8U
Figure 8V
Figure 8W
Figure 8X
Figure 8Y
Figure 8Z
Figure 8AA
Figure 8AB
Figure 8AC
Figure 8AD
Figure 8AE
Figure 8AF
Figure 8AG
Figure 8AH
Figure 8AI
Figure 8AJ
Figure 8AK
Figure 8AL
Figure 8AM
Figure 8AN
Figure 8AO
Figure 8AP
Figure 8AQ
Figure 8AR
Figure 8AS
Figure 8AT
Figure 8AU
Figure 8AV
Figure 8AW
Figure 8AX
Figure 8AY
Figure 8AZ
Figure 8BA
Figure 8BB
Figure 8BC
Figure 8BD
Figure 8BE
Figure 8BF
Figure 8BG
Figure 8BH
Figure 8BI
Figure 8BJ
Figure 8BK
[0065]
Figure 9A
Figure 9B
Figure 9C
Figure 9D
Figure 9E
Figure 9F
Figure 9G
Figure 9H
Figure 9I
Figure 9J
Figure 9K
Figure 9L
Figure 9M
Figure 9N
Figure 9O
Figure 9P
Figure 9Q
Figure 9R
Figure 9S
[0066]
Figure 10A
Figure 10B
Figure 10C
Figure 10D
Figure 10E
Figure 10F
Figure 10G
Figure 10H
Figure 10I
Figure 10J
Figure 10K
Figure 10L
[0067]
Figure 11A
Figure 11B
Figure 11C
Figure 11D
Figure 11E
Figure 11F
Figure 11G
Figure 11H
Figure 11I
Figure 11J
Figure 11K
Figure 11L
Figure 11M
Figure 11N
Figure 11O
Figure 11P
Figure 11Q
Figure 11R
Figure 11S
Figure 11T
Figure 11U
Figure 11V
Figure 11W
Figure 11X
Figure 11Y
Figure 11Z
Figure 11AA
Figure 11AB
Figure 11AC
Figure 11AD
Figure 11AE
Figure 11AF
Figure 11AG
Figure 11AH
Figure 11AI
Figure 11AJ
Figure 11AK
Figure 11AL
Figure 11AM
Figure 11AN
Figure 11AO
Figure 11AP
Figure 11AQ
Figure 11AR
Figure 11AS
Figure 11AT
[0068]
Figure 12A
Figure 12B
Figure 12C
Figure 12D
Figure 12E
Figure 12F
Figure 12G
Figure 12H
Figure 12I
Figure 12J
Figure 12K
Figure 12L
Figure 12M
Figure 12N
Figure 12O
Figure 12P
Figure 12Q
Figure 12R
Figure 12S
Figure 12T
Figure 12U
Figure 12V
Figure 12W
Figure 12X
[0069]
Figure 13A
Figure 13B
Figure 13C
[0070]
Figure 14
[0071]
Figure 15A
Figure 15B
Figure 15C
Figure 15D
Figure 15E
Figure 15F
Figure 15G
[0072]
Figure 16
[0073]
Figure 17A
Figure 17B
Figure 17C
Figure 17D
Figure 17E
Figure 17F
Figure 17G
Figure 17H
[0074]
Figure 18
[0075]
Figure 19A
Figure 19B
Figure 19C
Figure 19D
Figure 19E
Figure 19F
[0076]
Figure 20
[0077]
Figure 21A
Figure 21B
Figure 21C
[0078]
Figure 22
[0079]
Figure 23A
Figure 23B
Figure 23C
[0080]
Figure 24
[0081]
Figure 25A
Figure 25B
Figure 25C
Figure 25D
Figure 25E
Figure 25F
Figure 25G
Figure 25H
[0082]
Figure 26
[0083]
Figure 27A
Figure 27B
Figure 27C
Figure 27D
Figure 27E
[0084]
Figure 28
[0085]
Figure 29A
Figure 29B
Figure 29C
[0086]
Figure 30
[0087]
Figure 31A
Figure 31B
Figure 31C
Figure 31D
Figure 31E
Figure 31F
Figure 31G
Figure 31H
Figure 31I
Figure 31J
Figure 31K
Figure 31L
Figure 31M
Figure 31N
Figure 31O
Figure 31P
Figure 31Q
[0088]
Figure 32A
Figure 32B
Figure 32C
Figure 32D
Figure 32E
[0089]
Figure 33
[0090]
Figure 34A
Figure 34B
Figure 34C
[0091]
Figure 35
[0092]
Figure 36A
Figure 36B
Figure 36C
Figure 36D
Figure 36E
Figure 36F
Figure 36G
Figure 36H
Figure 36I
Figure 36J
Figure 36K
Figure 36L
Figure 36M
Figure 36N
Figure 36O
Figure 36P
Figure 36Q
Figure 36R
Figure 36S
Figure 36T
Figure 36U
Figure 36V
[0093]
Figure 37A
Figure 37B
Figure 37C
Figure 37D
Figure 37E
Figure 37F
Figure 37G
Figure 37H
[0094]
Figure 38
[0095]
Figure 39A
Figure 39B
Figure 39C
Figure 39D
Figure 39E
Figure 39F
Figure 39G
Figure 39H
Figure 39I
Figure 39J
Figure 39K
[0096]
Figure 39L
[0097]
Figure 40A
Figure 40B
Figure 40C
Figure 40D
Figure 40E
[0098]
Figure 41
[0099]
Figure 42A
Figure 42B
Figure 42C
Figure 42D
Figure 42E
Figure 42F
Figure 42G
Figure 42H
Figure 42I
Figure 42J
Figure 42K
Figure 42L
Figure 42M
Figure 42N
[0100]
Figure 43A
Figure 43B
Figure 43C
Figure 43D
[0101]
Figure 44
[0102]
Figure 45A
Figure 45B
Figure 45C
Figure 45D
Figure 45E
Figure 45F
Figure 45G
Figure 45H
Figure 45I
Figure 45J
Figure 45K
Figure 45L
[0103]
Figure 46A
Figure 46B
Figure 46C
Figure 46D
[0104]
Figure 47
[0105]
Figure 48A
Figure 48B
Figure 48C
Figure 48D
Figure 48E
Figure 48F
Figure 48G
Figure 48H
Figure 48I
Figure 48J
Figure 48K
Figure 48L
Figure 48M
Figure 48N
Figure 48O
Figure 48P
Figure 48Q
Figure 48R
Figure 48S
Figure 48T
Figure 48U
Figure 48V
Figure 48W
Figure 48X
Figure 48Y
Figure 48Z
Figure 48AA
Figure 48BB
Figure 48CC
Figure 48DD
Figure 48EE
[0106]
Figure 49A
Figure 49B
Figure 49C
Figure 49D
Figure 49E
Figure 49F
[0107]
Figure 50
[0108] The methods, devices, and GUIs described herein provide visual feedback and / or haptic feedback that make the operation of user interface objects more efficient and intuitive for the user.
[0109] In some embodiments, in a system where a trackpad or touch screen display senses a range of contact intensities that includes one or more than two (e.g., more than simple on / off, binary intensity determination) specific intensity values, the user interface provides a response (e.g., visual and / or tactile cues) indicating the intensity of the contact within that range. This provides the user with a continuous response to the force or pressure of the user's contact, thereby providing the user with richer and more intuitive visual and / or haptic feedback. For example, such a continuous force response can allow the user to preview an action by lightly pressing and / or reach a predefined user interface state corresponding to that action by pressing deeper.
[0110] In some embodiments, for a device having a touch sensing surface that senses a range of contact intensities, a plurality of contact intensity thresholds are monitored by the device and different responses are mapped to the contact intensity thresholds.
[0111] In some embodiments, for a device having a touch sensing surface that senses a range of contact intensities, the device provides additional functionality by enabling a user to perform complex operations with a single continuous contact.
[0112] In some embodiments, for a device having a touch sensing surface that senses a range of contact intensities, the device provides additional functionality that complements conventional functionality. For example, additional functionality provided by intensity-based input (e.g., user interface previews and / or navigation shortcuts provided by light presses and / or deep press gestures) is seamlessly integrated with the conventional functionality provided by conventional tap and swipe gestures. A user can continue to use conventional gestures to perform conventional functions (e.g., tapping on an application icon on the home screen to launch the corresponding application) without accidentally activating the additional functionality. However, the user can also easily discover, understand, and use intensity-based input and the additional functionality (e.g., pressing on an application icon on the home screen brings up a quick action menu for the application, and lifting off on a menu item executes an action within that application).
[0113] Several different techniques for operating a user interface are described herein. Using one or more of these techniques (optionally, in combination with each other) helps provide a user interface that intuitively provides additional information and functionality to the user. By using one or more of these techniques (optionally, in combination with each other), the number, degree, and / or nature of inputs from the user is reduced, and a more efficient human-machine interface is provided. This enables the user to use a device having a touch sensing surface more quickly and efficiently. For battery-operated devices, these improvements result in power savings and longer battery charge intervals. Exemplary Devices
[0114] Here, refer in detail to the embodiments shown in the accompanying drawings. In the following detailed description, numerous specific details are set forth in order to provide a thorough understanding of the various embodiments described. However, it will be apparent to those skilled in the art that the various embodiments described may be practiced without these specific details. In other instances, well-known methods, procedures, components, circuits, and networks have not been described in detail so as not to unnecessarily obscure aspects of the embodiments.
[0115] In this specification, terms such as first, second, etc. are used in some embodiments to describe various elements, but it will also be understood that these elements should not be limited by these terms. These terms are only used to distinguish one element from another. For example, without departing from the scope of the various embodiments described, a first contact may be referred to as a second contact, and similarly, a second contact may be referred to as a first contact. The first contact and the second contact are both contacts, but they are not the same contact unless the context clearly indicates otherwise.
[0116] The terminology used in the description of the various embodiments described herein is for the purpose of describing particular embodiments only and is not intended to be limiting. As used in the description of the various described embodiments and in the appended claims, the singular forms “a,” “an,” and “the” are intended to include the plural forms as well, unless the context clearly indicates otherwise. It should also be understood that when the term “and / or” is used herein, it refers to and encompasses any and all possible combinations of one or more of the associated listed items. Further, the terms “includes,” “including,” “comprises,” and / or “comprising,” when used herein, specify the presence of the stated feature, integer, step, operation, element, and / or component, but do not preclude the presence or addition of one or more other features, integers, steps, operations, elements, components, and / or groups thereof.
[0117] As used herein, the term "if (in the case of ~)" is optionally construed to mean "when (when ~)", "upon (when ~)", "in response to determining (in response to the determination that ~)", or "in response to detecting (in response to the detection of ~)", depending on the context. Similarly, the phrase "if it is determined (if it is determined that ~)" or "if (a stated condition or event) is detected (if (the stated condition or event) is detected)" is optionally construed to mean "upon determining (when it is determined that ~)", or "in response to determining (in response to the determination of ~)", or "upon detecting (the stated condition or event) (when (the stated condition or event) is detected)", or "in response to detecting (the stated condition or event) (in response to the detection of (the stated condition or event))", depending on the context.
[0118] Embodiments of an electronic device, a user interface for such a device, and related processes for using such a device are described. In some embodiments, the device is a portable communication device such as a mobile phone that also includes other functions such as PDA functionality and / or music playback functionality. Exemplary embodiments of portable multifunctional devices include, without limitation, the iPhone®, iPod Touch®, and iPad® devices of Apple Inc. of Cupertino, California. Other portable electronic devices such as laptop or tablet computers having a touch-sensitive surface (e.g., a touch screen display and / or a touch pad) may also optionally be used. Also, in some embodiments, it should be understood that the device is a desktop computer having a touch-sensitive surface (e.g., a touch screen display and / or a touch pad) rather than a portable communication device.
[0119] In the following discussion, an electronic device having a display and a touch-sensitive surface is described. However, it should be understood that the electronic device may optionally include one or more other physical user interface devices such as a physical keyboard, a mouse, and / or a joystick.
[0120] The device generally supports various applications such as one or more of a drawing application, a presentation application, a word processing application, a website creation application, a disk authoring application, a spreadsheet application, a game application, a telephone application, a video conferencing application, an email application, an instant messaging application, a training support application, a photo management application, a digital camera application, a digital video camera application, a web browsing application, a digital music playback application, and / or a digital video playback application.
[0121] Various applications running on this device optionally use at least one common physical user interface device, such as a touch-sensitive surface. One or more functions of the touch-sensitive surface and the corresponding information displayed on the device optionally adjust and / or change from one application to the next and / or within each application. In this way, the common (e.g., touch-sensitive surface) physical architecture of the device optionally supports various applications having a user interface that is intuitive and transparent to the user.
[0122] Attention is now directed to embodiments of a portable device having a touch-sensitive display. FIG. 1A is a block diagram showing a portable multifunctional device 100 having a touch-sensitive display system 112, in accordance with some embodiments. The touch-sensitive display system 112 is sometimes referred to, for convenience, as a "touch screen" and may simply be referred to as a touch-sensitive display. Device 100 includes a memory 102 (optionally including one or more computer-readable storage media), a memory controller 122, one or more processing units (CPUs) 120, a peripheral device interface 118, an RF circuit 108, an audio circuit 110, a speaker 111, a microphone 113, an input / output (I / O) subsystem 106, other input or control devices 116, and an external port 124. Device 100 optionally includes one or more light sensors 164. Device 100 optionally includes one or more intensity sensors 165 for detecting the intensity of a contact on a touch-sensitive surface of device 100 (e.g., the touch-sensitive display system 112 of device 100). Device 100 optionally includes one or more haptic output generators 167 for generating a haptic output on device 100 (e.g., on a touch-sensitive surface such as the touch-sensitive display system 112 of device 100 or the touch pad 355 of device 300). These components optionally communicate via one or more communication buses or signal lines 103.
[0123] As used in this specification and the claims, the term "haptic output" refers to a physical displacement of a device relative to its previous position, a physical displacement of a component of the device (e.g., a touch-sensitive surface) relative to another component of the device (e.g., the housing), or a displacement of a component relative to the center of mass of the device, which is to be detected by the user's sense of touch. For example, in a situation where a device or a component of the device is in contact with a touch-sensitive surface of the user (e.g., the finger, palm, or other part of the user's hand), the haptic output generated by the physical displacement is interpreted by the user as a tactile sensation corresponding to a perceived change in the physical characteristics of the device or the component of the device. For example, the movement of a touch-sensitive surface (e.g., a touch-sensitive display or a trackpad) is optionally interpreted by the user as a "down click" or "up click" of a physical actuator button. In some cases, the user may feel a tactile sensation such as a "down click" or "up click" even when there is no movement of the physical actuator button associated with the touch-sensitive surface physically pushed (e.g., displaced) by the user's movement. As another example, the movement of the touch-sensitive surface is optionally interpreted or felt by the user as "roughness" of the touch-sensitive surface even when there is no change in the smoothness of the touch-sensitive surface. Such interpretation of the touch by the user depends on the user's individual sensory perception, but there are many sensory perceptions of touch common to most users. Thus, when a haptic output is described as corresponding to a particular sensory perception of the user (e.g., "up click", "down click", "roughness"), unless otherwise specified, the generated haptic output corresponds to a physical displacement of a device or a component of the device that produces the described sensory perception of a typical (or average) user.
[0124] Device 100 is merely an example of a portable multifunctional device, and it should be understood that device 100 may optionally have more or fewer components than those shown, may optionally combine two or more components, or may optionally have different configurations or arrangements of components. The various components shown in FIG. 1A are implemented in hardware, software, firmware, or a combination thereof, including one or more signal processing and / or application-specific integrated circuits.
[0125] Memory 102 optionally includes high-speed random access memory and also optionally includes non-volatile memory, such as one or more magnetic disk storage devices, flash memory devices, or other non-volatile semiconductor memory devices. Access to memory 102 by other components of device 100, such as CPU(s) 120 and peripheral interface 118, is optionally controlled by memory controller 122.
[0126] Peripheral interface 118 can be used to couple the input and output peripheral devices of this device to CPU(s) 120 and memory 102. One or more processors 120 run or execute various software programs and / or instruction sets stored in memory 102 to perform various functions for device 100 and to process data.
[0127] In some embodiments, peripheral interface 118, CPU(s) 120, and memory controller 122 are optionally implemented on a single chip, such as chip 104. In some other embodiments, these are optionally implemented on separate chips.
[0128] The RF (Radio Frequency) circuit 108 transmits and receives RF signals, also called electromagnetic signals. The RF circuit 108 converts electrical signals into electromagnetic signals or vice versa and communicates with communication networks and other communication devices via electromagnetic signals. The RF circuit 108 optionally includes well-known circuits for performing the above functions, including but not limited to an antenna system, an RF transceiver, one or more amplifiers, a tuner, one or more oscillators, a digital signal processor, a CODEC chipset, a subscriber identity module (SIM) card, memory, etc. The RF circuit 108 optionally communicates wirelessly with networks such as the Internet, also called the World Wide Web (WWW), intranets such as cellular telephone networks and / or wireless networks, wireless local area networks (LANs) and / or metropolitan area networks (MANs), and other devices.Wireless communication optionally uses any one of a plurality of communication standards, communication protocols, and communication technologies. These communication standards, communication protocols, and communication technologies include Global System for Mobile Communications (GSM) for mobile communication, Enhanced Data GSM Environment (EDGE), High-Speed Downlink Packet Access (HSDPA), High-Speed Uplink Packet Access (HSUPA), Evolution, Data-Only (EV-DO), HSPA, HSPA+, Dual Cell HSPA (DC-HSPDA), Long Term Evolution (LTE), Near Field Communication (NFC), Wideband Code Division Multiple Access (W-CDMA), Code Division Multiple Access (CDMA), Time Division Multiple Access (TDMA), Bluetooth (R), Wireless Fidelity (Wi-Fi) (R) (e.g., IEEE 802.11a, IEEE 802.11ac, IEEE 802.11ax, IEEE 802.11b, IEEE 802.11g and / or IEEE 802.11n), Voice over Internet Protocol (VoIP), Wi-MAX, protocols for e-mail (e.g., Internet Message Access Protocol (IMAP) and / or Post Office Protocol (POP)), instant messaging (e.g., Extensible Messaging and Presence Protocol (XMPP), Session Initiation Protocol for Instant Messaging and Presence Leveraging Extensions (SIMPLE), Instant Messaging and Presence Service (IMPS)), and / or Short Message Service (SMS), or any other suitable communication protocol including communication protocols not yet developed as of the filing date of this document, but not limited thereto.
[0129] The audio circuit 110, speaker 111, and microphone 113 provide an audio interface between the user and the device 100. The audio circuit 110 receives audio data from the peripheral interface 118, converts the audio data into an electrical signal, and transmits the electrical signal to the speaker 111. The speaker 111 converts the electrical signal into human audible sound waves. The audio circuit 110 also receives the electrical signal converted from sound waves by the microphone 113. The audio circuit 110 converts the electrical signal into audio data and sends the audio data to the peripheral interface 118 for processing. The audio data is optionally fetched from and / or sent to the memory 102 and / or the RF circuit 108 by the peripheral interface 118. In some embodiments, the audio circuitry 110 further includes a headset jack (e.g., 212 of FIG. 2). The headset jack provides an interface between the audio circuit 110 and a removable audio input / output peripheral device such as an output-only headset or a headset having both outputs (e.g., mono or stereo headphones) and inputs (e.g., a microphone).
[0130] The I / O subsystem 106 couples the input / output peripherals of the device 100, such as the touch sensing display system 112 and other input or control devices 116, to the peripheral interface 118. The I / O subsystem 106 optionally includes a display controller 156, a light sensor controller 158, an intensity sensor controller 159, a haptic feedback controller 161, and one or more input controllers 160 for other input or control devices. The one or more input controllers 160 receive / transmit electrical signals to / from the other input or control devices 116. The other input or control devices 116 optionally include physical buttons (e.g., push buttons, rocker buttons, etc.), dials, slider switches, joysticks, click wheels, etc. In some alternative embodiments, the input controller(s) 160 are optionally coupled to (or not coupled to any of) a pointer device such as a keyboard, infrared port, USB port, stylus, and / or mouse. One or more buttons (e.g., 208 of FIG. 2) optionally include up / down buttons for volume adjustment of the speaker 111 and / or the microphone 113. One or more buttons optionally include push buttons (e.g., 206 of FIG. 2).
[0131] The touch sensing display system 112 provides an input interface and an output interface between the device and the user. The display controller 156 receives and / or transmits electrical signals to / from the touch sensing display system 112. The touch sensing display system 112 displays visual output to the user. The visual output optionally includes graphics, text, icons, video, and any combination thereof (collectively referred to as "graphics"). In some embodiments, some or all of the visual output corresponds to user interface objects. As used herein, the term "affordance" refers to a user-interactive graphical user interface object (e.g., a graphical user interface object configured to respond to input directed thereto). Examples of user-interactive graphical user interface objects include, but are not limited to, buttons, sliders, icons, selectable menu items, switches, or other user interface controls.
[0132] The touch sensing display system 112 has a touch sensing surface, sensor, or set of sensors that receives input from the user based on tactile and / or haptic contact. The touch sensing display system 112 and the display controller 156 (any associated modules and / or instruction sets within the memory 102) detect contact (and any movement or interruption of contact) on the touch sensing display system 112 and convert the detected contact into an interaction with a user interface object (e.g., one or more soft keys, icons, web pages, or images) displayed on the touch sensing display system 112. In one exemplary embodiment, the point of contact between the touch sensing display system 112 and the user corresponds to the user's finger or stylus.
[0133] The touch sensing display system 112 optionally uses LCD (liquid crystal display) technology, LPD (light emitting polymer display) technology, or LED (light emitting diode) technology, although in other embodiments other display technologies are used. The touch sensing display system 112 and the display controller 156 use capacitive technology, resistive technology, infrared technology, and surface acoustic wave technology, as well as other proximity sensors or other elements for determining one or more points of contact with the touch sensing display system 112, including but not limited to, any of a plurality of touch sensing technologies now known or later developed, to optionally detect contact and any movement or interruption thereof. In one exemplary embodiment, projected mutual capacitance sensing technology, such as that found in the iPhone (registered trademark), iPod Touch (registered trademark), and iPad (registered trademark) from Apple Inc. of Cupertino, California, is used.
[0134] The touch sensing display system 112 optionally has a video resolution greater than 100 dpi. In some embodiments, the video resolution of the touch screen is greater than 400 dpi (e.g., 500 dpi, 800 dpi, or more). The user optionally contacts the touch sensing display system 112 using any suitable object or accessory, such as a stylus, finger, etc. In some embodiments, the user interface is designed to function with finger-based contact and gestures, and may be less accurate than stylus-based input due to the large contact area of the finger on the touch screen. In some embodiments, the device converts rough finger-based input into a precise pointer / cursor position or a command to perform the user's desired action.
[0135] In some embodiments, in addition to the touch screen, device 100 optionally includes a touch pad (not shown) for activating or deactivating certain functions. In some embodiments, the touch pad, unlike the touch screen, is a touch-sensitive area of the device that does not display visual output. The touch pad is optionally a touch-sensitive surface separate from the touch-sensitive display system 112, or an extension of the touch-sensitive surface formed by the touch screen.
[0136] Device 100 also includes a power system 162 for supplying power to various components. The power system 162 optionally includes a power management system, one or more power sources (e.g., battery, alternating current (AC)), a recharge system, a power failure detection circuit, a power converter or inverter, a power status indicator (e.g., light-emitting diode (LED)), and any other components associated with the generation, management, and distribution of power within a portable device.
[0137] Device 100 also optionally includes one or more optical sensors 164. FIG. 1A shows an optical sensor coupled to an optical sensor controller 158 within I / O subsystem 106. The optical sensor(s) 164 optionally includes a charge coupled device (CCD) or a complementary metal oxide semiconductor (CMOS) phototransistor. The optical sensor(s) 164 receives light from the environment projected through one or more lenses and converts the light into data representing an image. In combination with imaging module 143 (also referred to as a camera module), the optical sensor(s) 164 optionally captures still images and / or video. In some embodiments, an optical sensor is disposed on the back of device 100, opposite touch-sensitive display system 112 on the front of the device, so that the touch screen can be used as a viewfinder for obtaining still images and / or video. In some embodiments, another optical sensor is disposed on the front of the device so that an image of the user can be obtained (e.g., for self-portraits, while the user conducts a video conference while viewing other video conference participants on the touch screen, etc.).
[0138] Device 100 also optionally includes one or more contact intensity sensors 165. FIG. 1A shows a contact intensity sensor coupled to an intensity sensor controller 159 within I / O subsystem 106. The contact intensity sensor(s) 165 optionally includes one or more piezoresistive strain gauges, capacitive force sensors, electro-mechanical sensors, piezoelectric force sensors, optical force sensors, capacitive touch sensing surfaces, or other intensity sensors (e.g., sensors used to measure the force (or pressure) of contact on a touch sensing surface). The contact intensity sensor(s) 165 receives contact intensity information (e.g., pressure information or a proxy for pressure information) from the environment. In some embodiments, at least one contact intensity sensor is collocated with or proximate to a touch sensing surface (e.g., touch sensing display system 112). In some embodiments, at least one contact intensity sensor is disposed on the back of device 100, which is opposite the touch screen display system 112 disposed on the front of device 100.
[0139] Device 100 also optionally includes one or more proximity sensors 166. FIG. 1A shows a proximity sensor 166 coupled to a peripheral device interface 118. Alternatively, the proximity sensor 166 is coupled to an input controller 160 within I / O subsystem 106. In some embodiments, when a multifunctional device is placed near a user's ear (e.g., when the user is on a phone call), the proximity sensor turns off and the touch sensing display system 112 is disabled.
[0140] Device 100 also optionally includes one or more haptic output generators 167. FIG. 1A shows a haptic output generator coupled to a haptic feedback controller 161 within I / O subsystem 106. The haptic output generator(s) 167 optionally includes one or more electroacoustic devices, such as a speaker or other audio component, and / or an electromechanical device that converts energy into linear motion, such as a motor, solenoid, electroactive polymer, piezoelectric actuator, electrostatic actuator, or other haptic output component (e.g., a component that converts an electrical signal into a haptic output on the device). The haptic output generator(s) 167 receives haptic feedback generation instructions from the haptic feedback module 133 and generates haptic output on device 100 that can be sensed by a user of device 100. In some embodiments, at least one haptic output generator is juxtaposed with or proximate to a touch sensing surface (e.g., touch sensing display system 112) and optionally generates haptic output by moving the touch sensing surface in a vertical direction (e.g., in / out of the surface of device 100) or a lateral direction (e.g., back and forth in the same plane as the surface of device 100). In some embodiments, at least one haptic output generator sensor is disposed on the back of device 100, which is opposite to the touch sensing display system 112 disposed on the front of device 100.
[0141] Device 100 also optionally includes one or more accelerometers 168. FIG. 1A shows an accelerometer 168 coupled to the peripheral device interface 118. Alternatively, the accelerometer 168 is optionally coupled to an input controller 160 within the I / O subsystem 106. In some embodiments, information is displayed in portrait or landscape view on the touch screen display based on an analysis of data received from one or more accelerometers. Device 100 optionally includes, in addition to the accelerometer(s) 168 as needed, a magnetometer (not shown) and a GPS (or GLONASS or other global navigation system) receiver (not shown) for obtaining information regarding the location and orientation of device 100 (e.g., portrait or landscape).
[0142] In some embodiments, the software components stored in the memory 102 include an operating system 126, a communication module (or instruction set) 128, a touch / motion module (or instruction set) 130, a graphics module (or instruction set) 132, a tactile feedback module (or instruction set) 133, a text input module (or instruction set) 134, a global positioning system (GPS) module (or instruction set) 135, and an application (or instruction set) 136. Further, in some embodiments, the memory 102 stores a device / global internal state 157 as shown in FIGS. 1A and 3. The device / global internal state 157 includes one or more of an active application state indicating which application, if any, is active, a display state indicating which application, view, or other information occupies various regions of the touch-sensitive display system 112, a sensor state including information obtained from various sensors of the device and other input or control devices 116, and location and / or position information regarding the location and / or orientation of the device.
[0143] The operating system 126 (e.g., an embedded operating system such as iOS (registered trademark), Darwin (registered trademark), RTXC (registered trademark), LINUX (registered trademark), UNIX (registered trademark), OS X (registered trademark), WINDOWS (registered trademark), or VxWorks (registered trademark)) includes various software components and / or drivers for controlling and managing general system tasks (e.g., memory management, storage device control, power management, etc.), and facilitates communication between various hardware and software components.
[0144] The communication module 128 includes various software components for facilitating communication with other devices via one or more external ports 124 and processing data received by the RF circuit 108 and / or the external port 124. The external port 124 (e.g., Universal Serial Bus (USB), FIREWIRE (registered trademark), etc.) is adapted to be connected directly or indirectly via a network (e.g., the Internet, a wireless LAN, etc.) to other devices. In some embodiments, the external port is a multi-pin (e.g., 30-pin) connector that is the same as, similar to, and / or compatible with the 30-pin connector used in some iPhone (registered trademark), iPod Touch (registered trademark), and iPad (registered trademark) devices of Apple Inc. located in Cupertino, California. In some embodiments, the external port is a Lightning (registered trademark) connector that is the same as, similar to, and / or compatible with the Lightning connector used in some iPhone (registered trademark), iPod Touch (registered trademark), and iPad (registered trademark) devices of Apple Inc. located in Cupertino, California.
[0145] The contact / motion module 130 optionally detects contact with the touch sensing display system 112 (in conjunction with the display controller 156) and contact with other touch sensing devices (such as a touch pad or a physical click wheel). The contact / motion module 130 performs various operations related to the detection of contact (such as by a finger or a stylus), including determining whether contact has occurred (e.g., detecting an event of a finger being lowered), determining the intensity of the contact (e.g., the force or pressure of the contact, or an alternative to the force or pressure of the contact), determining whether there is movement of the contact, tracking movement across the touch sensing surface (e.g., detecting an event of dragging one or more fingers), and determining whether the contact has stopped (e.g., detecting an event of a finger being raised or an interruption of the contact). The contact / motion module 130 includes various software components for performing these operations. The contact / motion module 130 receives contact data from the touch sensing surface. Determining the movement of the contact point represented by a series of contact data optionally includes determining the speed (magnitude), velocity (magnitude and direction), and / or acceleration (change in magnitude and / or direction) of the contact point. These operations are optionally applied to a single contact (e.g., a single finger contact or stylus contact) or multiple simultaneous contacts (e.g., "multi-touch" / multiple finger contacts). In some embodiments, the contact / motion module 130 and the display controller 156 detect contact on the touch pad.
[0146] The contact / movement module 130 optionally detects gesture inputs by a user. Different gestures on the touch sensing surface have different contact patterns (e.g., different movements, timings, and / or intensities of detected contacts). Thus, a gesture is optionally detected by detecting a specific contact pattern. For example, detecting a finger tap gesture includes detecting an event of the finger touching down and subsequently detecting an event of the finger lifting off (lifting up) at the same position (or substantially the same position) as the event of the finger touching down (e.g., at the position of an icon). As another example, detecting a finger swipe gesture on the touch sensing surface includes detecting a finger down event, subsequently detecting one or more finger drag events, and then detecting a finger up (lift off) event. Similarly, a stylus tap, swipe, drag, and other gestures are optionally detected by detecting a specific contact pattern of the stylus.
[0147] The graphic module 132 includes various known software components for rendering and displaying graphics on the touch sensing display system 112 or other displays, including components for changing visual effects (e.g., brightness, transparency, chroma, contrast, or other visual characteristics) of the displayed graphics. As used herein, the term "graphic" includes any object that can be displayed to a user, and examples of such objects include, but are not limited to, text, web pages, icons (such as user interface objects including soft keys), digital images, videos, animations, etc.
[0148] In some embodiments, the graphic module 132 stores data representing the graphics to be used. Each graphic is optionally assigned a corresponding code. The graphic module 132 receives, as needed from an application or the like, one or more codes specifying the graphic to be displayed, along with coordinate data and other graphic property data, and generates screen image data for output to the display controller 156.
[0149] The haptic feedback module 133 includes various software components for generating instructions to be used by the haptic output generator(s) 167 to generate haptic output at one or more locations on the device 100 in response to user interaction with the device 100.
[0150] The text input module 134 is optionally a component of the graphic module 132 and provides a soft keyboard for entering text in various applications (e.g., contacts 137, email 140, IM 141, browser 147, and any other application that requires text input).
[0151] The GPS module 135 determines the location of the device and provides this information for use in various applications (e.g., to the phone 138 for use in location-based dialing, to the camera 143 as metadata for pictures / videos, and to applications that provide location-based services such as weather widgets, local yellow page widgets, and map / navigation widgets).
[0152] The application 136 optionally includes the following modules (or sets of instructions), or subsets or supersets thereof. ● The contacts module 137 (which may also be referred to as an address book or contacts list), ● The phone module 138, ● The video conferencing module 139, ● Email client module 140, ● Instant messaging (IM) module 141, ● Training support module 142, ● Camera module 143 for still images and / or video images, ● Image management module 144, ● Browser module 147, ● Calendar module 148, ● Widget module 149 that optionally includes one or more of weather widget 149-1, stock price widget 149-2, calculator widget 149-3, alarm clock widget 149-4, dictionary widget 149-5, and other widgets obtained by the user, as well as user-created widget 149-6, ● Widget creation module 150 for creating user-created widget 149-6, ● Search module 151, ● Optionally, video and music playback module 152 composed of a video playback module and a music playback module, ● Note module 153, ● Map module 154, and / or ● Online video module 155.
[0153] Examples of other applications 136 optionally stored in memory 102 include other word processing applications, other image editing applications, drawing applications, presentation applications, JAVA (registered trademark)-compatible applications, encryption, digital rights management, speech recognition, and speech replication.
[0154] In conjunction with touch sensing display system 112, display controller 156, contact module 130, graphics module 132, and text input module 134, contact module 137 includes executable instructions for managing an address book or contact list (stored, for example, in the application internal state 192 of contact module 137 in memory 102 or memory 370), and managing the address book or contact list includes adding name(s) to the address book, deleting name(s) from the address book, associating phone number(s), email address(es), address(es), or other information with a name, associating an image with a name, sorting and categorizing names, providing a phone number and / or email address to initiate and / or facilitate communication by phone 138, video conference 139, email 140, or IM 141, and the like.
[0155] Phone module 138 includes executable instructions for entering a sequence of characters corresponding to a phone number, accessing one or more phone numbers in address book 137, modifying the entered phone number, dialing each phone number, conducting a conversation, and disconnecting or hanging up the phone when the conversation is complete, in conjunction with RF circuit 108, audio circuit 110, speaker 111, microphone 113, touch sensing display system 112, display controller 156, contact module 130, graphics module 132, and text input module 134. As described above, wireless communication optionally uses any of a plurality of communication standards, protocols, and technologies.
[0156] The video conferencing module 139, in conjunction with the RF circuit 108, audio circuit 110, speaker 111, microphone 113, touch sensing display system 112, display controller 156, light sensor(s) 164, light sensor controller 158, contact module 130, graphics module 132, text input module 134, contact list 137, and phone module 138, includes executable instructions for starting, conducting, and ending a video conference between the user and one or more other participants according to the user's instructions.
[0157] The email client module 140, in conjunction with the RF circuit 108, touch sensing display system 112, display controller 156, contact module 130, graphics module 132, and text input module 134, includes executable instructions for creating, sending, receiving, and managing emails according to the user's instructions. In conjunction with the image management module 144, the email client module 140 makes it very easy to create a still image or video captured by the camera module 143 and send an email.
[0158] The instant messaging module 141, in conjunction with the RF circuit 108, touch sensing display system 112, display controller 156, contact module 130, graphics module 132, and text input module 134, includes executable instructions for entering a series of characters corresponding to an instant message, modifying the entered characters, transmitting the corresponding instant message (e.g., using the Short Message Service (SMS) or Multimedia Messaging Service (MMS) protocol for phone-based instant messages, or using XMPP, SIMPLE, Apple Push Notification Service (APN), or IMPS for Internet-based instant messages), receiving an instant message, and displaying the received instant message. In some embodiments, the instant messages transmitted and / or received optionally include graphics, photos, audio files, video files, and / or other attachments, as supported by MMS and / or Enhanced Messaging Service (EMS). As used herein, "instant messaging" refers to both phone-based messages (e.g., messages transmitted using SMS or MMS) and Internet-based messages (e.g., messages transmitted using XMPP, SIMPLE, APN, or IMPS).
[0159] The training support module 142, in conjunction with the RF circuit 108, touch sensing display system 112, display controller 156, contact module 130, graphics module 132, text input module 134, GPS module 135, map module 154, and music playback module 146, creates training (e.g., having time, distance, and / or calorie consumption goals), communicates with training sensors (within the sports device and smartwatch), receives training sensor data, measures sensors used to monitor the training, selects and plays music for the training, and includes executable instructions for displaying, storing, and transmitting training data.
[0160] The camera module 143, in conjunction with the touch sensing display system 112, display controller 156, light sensor(s) 164, light sensor controller 158, contact module 130, graphics module 132, and image management module 144, captures still images or videos (including video streams), stores them in the memory 102, modifies the characteristics of the still images or videos, and / or deletes the still images or videos from the memory 102, and includes executable instructions therefor.
[0161] The image management module 144, in conjunction with the touch sensing display system 112, display controller 156, contact module 130, graphics module 132, text input module 134, and camera module 143, arranges, modifies (e.g., edits), or otherwise operates on still images and / or video images, labels, deletes, presents (e.g., within a digital slide show or album), and stores them, and includes executable instructions therefor.
[0162] The browser module 147 includes executable instructions for browsing the Internet according to user instructions, including searching, linking, receiving, and displaying web pages or portions thereof, as well as attached and other files linked to the web pages. The browser module 147 is combined with the RF circuit 108, the touch sensing display system 112, the display system controller 156, the contact module 130, the graphics module 132, and the text input module 134.
[0163] The calendar module 148 includes executable instructions for creating, displaying, modifying, and storing a calendar and data associated with the calendar (e.g., calendar items, ToDo lists, etc.) according to user instructions. The calendar module 148 is combined with the RF circuit 108, the touch sensing display system 112, the display system controller 156, the contact module 130, the graphics module 132, the text input module 134, the email client module 140, and the browser module 147.
[0164] The widget module 149 is a mini-application (e.g., weather widget 149-1, stock price widget 149-2, calculator widget 149-3, alarm clock widget 149-4, and dictionary widget 149-5) optionally downloaded and used by the user, or a mini-application created by the user (e.g., user-created widget 149-6). The widget module 149 is combined with the RF circuit 108, the touch sensing display system 112, the display system controller 156, the contact module 130, the graphics module 132, the text input module 134, and the browser module 147. In some embodiments, the widget includes HTML (HyperText Markup Language) files, CSS (Cascading Style Sheets) files, and JavaScript files. In some embodiments, the widget includes XML (Extensible Markup Language) files and JavaScript (registered trademark) files (e.g., Yahoo! (registered trademark) widgets).
[0165] The widget creation module 150 includes executable instructions for creating widgets (e.g., changing a user-specified portion of a web page into a widget) in conjunction with the RF circuit 108, the touch sensing display system 112, the display system controller 156, the contact module 130, the graphics module 132, the text input module 134, and the browser module 147.
[0166] The search module 151 includes executable instructions for searching for text, music, sounds, images, videos, and / or other files in the memory 102 that match one or more search criteria (e.g., one or more user-specified search terms) according to a user's instruction in conjunction with the touch sensing display system 112, the display system controller 156, the contact module 130, the graphics module 132, and the text input module 134.
[0167] The video and music playback module 152 includes executable instructions for enabling a user to download and play recorded music and other sound files stored in one or more file formats such as MP3 or AAC files, and for displaying, presenting, or otherwise playing videos (e.g., on the touch sensing display system 112 or on an external display connected via a wireless or external port 124) in conjunction with the touch sensing display system 112, the display system controller 156, the contact module 130, the graphics module 132, the audio circuit 110, the speaker 111, the RF circuit 108, and the browser module 147. In some embodiments, the device 100 optionally includes the functionality of an MP3 player such as an iPod (registered trademark of Apple Inc.).
[0168] The memo module 153, in conjunction with the touch sensing display system 112, the display controller 156, the contact module 130, the graphics module 132, and the text input module 134, includes executable instructions for creating and managing memos, ToDo lists, etc. according to user instructions.
[0169] The map module 154, in conjunction with the RF circuit 108, the touch sensing display system 112, the display system controller 156, the contact module 130, the graphics module 132, the text input module 134, the GPS module 135, and the browser module 147, includes executable instructions for receiving, displaying, modifying, and storing maps and data associated with the maps (e.g., driving directions, data about stores and other target locations near a particular location, and other location-based data).
[0170] The online video module 155, in conjunction with the touch sensing display system 112, the display system controller 156, the contact module 130, the graphics module 132, the audio circuit 110, the speaker 111, the RF circuit 108, the text input module 134, the email client module 140, and the browser module 147, includes executable instructions for enabling a user to access, view, receive (e.g., by streaming and / or downloading), play (e.g., on the touch screen 112, wirelessly, or on an external display connected via the external port 124), send an email having a link to the particular online video, and manage online videos in one or more file formats such as H.264 in other ways. In some embodiments, instead of the email client module 140, the instant message module 141 is used to send a link to a particular online video.
[0171] Each of the modules and applications identified above corresponds to a set of executable instructions for performing one or more of the above functions and to the methods described in this application (e.g., methods executed by a computer and other information processing methods described herein). These modules (i.e., sets of instructions) need not be implemented as separate software programs, procedures, or modules, and thus, various subsets of these modules may be optionally combined or rearranged in various embodiments. In some embodiments, memory 102 optionally stores a subset of the identified modules and data structures described above. Further, memory 102 optionally stores additional modules and data structures not described above.
[0172] In some embodiments, device 100 is a device in which the operation of a default set of functions on the device is performed exclusively via a touch screen and / or a touch pad. By using the touch screen and / or the touch pad as the primary input control device for the operation of device 100, the number of physical input control devices (such as push buttons, dials, and the like) on device 100 can be optionally reduced.
[0173] The default set of functions that are performed exclusively via the touch screen and / or the touch pad optionally includes navigation between user interfaces. In some embodiments, when touched by a user, the touch pad navigates device 100 from any user interface displayed on device 100 to the main menu, home menu, or root menu. In such embodiments, the "menu button" is implemented using the touch pad. In some other embodiments, the menu button is a physical push button or other physical input control device instead of the touch pad.
[0174] FIG. 1B is a block diagram showing exemplary components for event processing according to some embodiments. In some embodiments, memory 102 (in FIG. 1A) or 370 (in FIG. 3) includes event sorter 170 (e.g., within operating system 126) and respective applications 136-1 (e.g., any of the applications 136, 137-155, 380-390 described above).
[0175] Event sorter 170 receives event information and determines application 136-1 that distributes the event information and application view 191 of application 136-1. Event sorter 170 includes event monitor 171 and event dispatcher module 174. In some embodiments, application 136-1 includes application internal state 192 that indicates the current application view(s) displayed on touch-sensitive display system 112 when the application is active or running. In some embodiments, device / global internal state 157 is used by event sorter 170 to determine which application is currently active, and application internal state 192 is used by event sorter 170 to determine application view 191 to which the event information is to be delivered.
[0176] In some embodiments, application internal state 192 includes additional information such as resume information used when application 136-1 resumes execution, user interface state information indicating whether information is being displayed or is ready to be displayed by application 136-1, a state queue for allowing the user to return to a previous state or view of application 136-1, and one or more of a redo / undo queue of previous actions performed by the user.
[0177] The event monitor 171 receives event information from the peripheral device interface 118. The event information includes information about sub-events (e.g., a user's touch on the touch-sensitive display system 112 as part of a multi-touch gesture). The peripheral device interface 118 transmits information received from sensors such as the I / O subsystem 106 or the proximity sensor 166, the accelerometer(s) 168, and / or the microphone 113 (via the audio circuitry 110). The information that the peripheral device interface 118 receives from the I / O subsystem 106 includes information from the touch-sensitive display system 112 or the touch-sensitive surface.
[0178] In some embodiments, the event monitor 171 sends requests to the peripheral device interface 118 at predetermined intervals. In response, the peripheral device interface 118 sends out event information. In other embodiments, the peripheral device interface 118 sends out event information only when there is an important event (e.g., receiving an input that exceeds a predetermined noise threshold and / or is longer than a predetermined time).
[0179] In some embodiments, the event sorter 170 also includes a hit view determination module 172 and / or an active event recognition unit determination module 173.
[0180] The hit view determination module 172 provides a software procedure for determining where in one or more views a sub-event has occurred when the touch-sensitive display system 112 displays more than one view. A view is composed of a control unit and other elements that a user can view on the display.
[0181] Another aspect of the user interface associated with an application is, in this specification, a set of views, sometimes referred to as an application view or a user interface window, within which information is displayed and touch-based gestures are performed. The application view (for each respective application) where a touch is detected optionally corresponds to a program level within the program hierarchy or view hierarchy of the application. For example, the lowest level view where a touch is detected is optionally referred to as the hit view, and the set of events recognized as appropriate input is optionally determined based at least in part on the hit view of the first touch that initiates a touch-based gesture.
[0182] The hit view determination module 172 receives information associated with sub-events of a touch-based gesture. When the application has a plurality of views organized as a hierarchy, the hit view determination module 172 identifies the hit view as the lowest level view within the hierarchy in which the sub-event is to be processed. In most situations, the hit view is the lowest level view at which the first sub-event (i.e., the first sub-event in a sequence of sub-events that form an event or potential event) occurs. Once the hit view is identified by the hit view determination module, the hit view typically receives all sub-events associated with the same touch or input source for which it was identified as the hit view.
[0183] The active event recognizer determination module 173 determines which view(s) within the view hierarchy should receive a particular sequence of sub-events. In some embodiments, the active event recognition unit determination module 173 determines that only the hit view should receive a particular sequence of sub-events. In other embodiments, the active event recognition unit determination module 173 determines that all views including the physical location of the sub-event are views that are actively involved, and thus, all views that are actively involved should receive a particular sequence of sub-events. In other embodiments, even if a touch sub-event is completely limited to an area associated with a particular view, the upper-level views in the hierarchy will remain views that are actively involved.
[0184] The event dispatcher module 174 sends event information to the event recognition unit (e.g., event recognition unit 180). In embodiments including the active event identification unit determination module 173, the event dispatcher module 174 distributes the event information to the event recognition unit determined by the active event recognition unit determination module 173. In some embodiments, the event dispatcher module 174 stores the event information obtained by each event receiving unit module 182 in the event queue.
[0185] In some embodiments, the operating system 126 includes the event sorter 170. Alternatively, the application 136-1 includes the event sorter 170. In still other embodiments, the event sorter 170 is a stand-alone module or part of other modules stored in the memory 102 such as the contact / movement module 130.
[0186] In some embodiments, Application 136-1 includes a plurality of event handlers 190 and one or more application views 191, each including instructions for processing touch events that occur within respective views of the application's user interface. Each application view 191 of Application 136-1 includes one or more of the event recognition units 180. Typically, each application view 191 includes a plurality of event recognition units 180. In other embodiments, one or more of the event recognition units 180 are part of a separate module, such as a user interface kit (not shown) or a higher-level object from which Application 136-1 inherits methods and other properties. In some embodiments, each event handler 190 includes one or more of data update data 176, object update data 177, GUI update data 178, and / or event data 179 received from event sorter 170. The event handler 190 optionally utilizes or invokes data update data 176, object update data 177, or GUI update data 178 to update the application internal state 192. Alternatively, one or more of the application views 191 include one or more respective event handlers 190. Also, in some embodiments, one or more of data update data 176, object update data 177, and GUI update data 178 are included within respective application views 191.
[0187] Each event recognition unit 180 receives event information (e.g., event data 179) from the event sorter 170 and identifies an event from the event information. The event recognition unit 180 includes an event receiving unit 182 and an event comparing unit 184. In some embodiments, the event recognition unit 180 further includes at least a subset of metadata 183 and event distribution instructions 188 (optionally including sub-event distribution instructions).
[0188] The event receiver 182 receives event information from the event sorter 170. The event information includes information on sub-events such as, for example, a touch or a movement of a touch. Depending on the sub-event, the event information may also include additional information such as the location of the sub-event. When the sub-event relates to the movement of a touch, the event information optionally further includes the speed and direction of the sub-event. In some embodiments, the event includes a rotation of the device from one direction to another (e.g., from a portrait orientation to a landscape orientation, or vice versa), and the event information includes corresponding information about the current orientation of the device (also referred to as the pose of the device).
[0189] The event comparison unit 184 compares event information with the definition of a predetermined event or sub - event, and based on this comparison, determines an event or sub - event, or determines or updates the state of an event or sub - event. In some embodiments, the event comparison unit 184 includes an event definition 186. The event definition 186 includes, for example, definitions of events such as event 1 (187 - 1), event 2 (187 - 2), etc. (e.g., a predetermined sequence of sub - events). In some embodiments, the sub - events within an event 187 include, for example, touch start, touch end, touch movement, touch cancellation, and multiple touches. In one example, the definition of event 1 (187 - 1) is a double - tap on a displayed object. The double - tap includes, for example, a first touch (touch start) at a predetermined stage on the displayed object, a first lift - off (touch end) at a predetermined stage, a second touch (touch start) at a predetermined stage on the displayed object, and a second lift - off (touch end) at a predetermined stage. In another embodiment, the definition of event 2 (187 - 2) is a drag on a displayed object. Dragging includes, for example, a touch (or contact) at a predetermined stage on the displayed object, movement of the touch across the touch - sensitive display system 112, and lift - off of the touch (touch end). In some embodiments, an event also includes information about one or more associated event handlers 190.
[0190] In some embodiments, event definition 187 includes the definition of events for each user interface object. In some embodiments, event comparison unit 184 performs a hit test to determine the user interface object associated with the sub - event. For example, in an application view where three user interface objects are displayed on touch - sensitive display system 112, when a touch is detected on touch - sensitive display system 112, event comparison unit 184 performs a hit test to determine which of the three user interface objects is associated with the touch (sub - event). If each of the displayed objects is associated with a respective event handler 190, the event comparison unit uses the result of the hit test to determine the event handler 190 that needs to be activated. For example, event comparison unit 184 selects the event handler associated with the sub - event and the object that triggers the hit test.
[0191] In some embodiments, the definition for each event 187 also includes a delaying action that delays the sending of event information until it is determined whether the sequence of sub - events corresponds to the event type of the event recognition unit.
[0192] If each event recognition unit 180 determines that a series of sub - events does not match any of the events in event definition 186, each event recognition unit 180 enters a state of event - impossible, event - failed, or event - ended, and then ignores the next sub - event of the touch - based gesture. In this situation, if any, other event recognition units that remain active for the hit view continue to track and process the sub - events of the ongoing touch - based gesture.
[0193] In some embodiments, each event recognition unit 180 includes metadata 183 having configurable properties, flags, and / or a list indicating how the event distribution system executes sub-event distribution to the event recognition units actively involved. In some embodiments, the metadata 183 includes configurable properties, flags, and / or a list indicating how the event recognition units can interact with each other. In some embodiments, the metadata 183 includes configurable properties, flags, and / or a list indicating whether sub-events are distributed at various levels within the view hierarchy or program hierarchy.
[0194] In some embodiments, each event recognition unit 180 activates an event handler 190 associated with the event when one or more specific sub-events of the event are recognized. In some embodiments, each event recognition unit 180 distributes event information associated with the event to the event handler 190. Activating the event handler 190 is distinguished from sending (and deferring sending) sub-events to each hit view. In some embodiments, the event recognition unit 180 throws a flag associated with the recognized event, and the event handler 190 associated with the flag catches the flag and executes default processing.
[0195] In some embodiments, the event distribution command 188 includes a sub-event distribution command that distributes event information regarding sub-events without activating an event handler. Instead, the sub-event distribution command distributes event information to an event handler associated with a series of sub-events or to a view actively involved. The event handler associated with a series of sub-events or a view actively involved receives the event information and executes predetermined processing.
[0196] In some embodiments, data update data 176 creates and updates data used in application 136-1. For example, data update data 176 updates a phone number used in contact module 137 or stores a video file used in video player module 145. In some embodiments, object update data 177 creates and updates objects used in application 136-1. For example, object update data 177 creates a new user interface object or updates the position of a user interface object. GUI update data 178 updates the GUI. For example, GUI update data 178 prepares display information and sends the display information to graphic module 132 for display on a touch-sensitive display.
[0197] In some embodiments, event handler 190 includes or has access to data update data 176, object update data 177, and GUI update data 178. In some embodiments, data update data 176, object update data 177, and GUI update data 178 are included in one module of respective application 136-1 or application view 191. In other embodiments, they are included in two or more software modules.
[0198] The foregoing discussion regarding event handling of a user's touch on a touch-sensitive display also applies to other forms of user input for operating the multifunctional device 100 using an input device, although it should be understood that not all of them are initiated on the touch screen. For example, movement of a mouse and pressing of a mouse button optionally in conjunction with pressing or holding of a single or multiple keyboards, contact movements such as taps, drags, scrolls, etc. on a touch pad, pen stylus input, movement of the device, voice commands, detected eye movements, biometric input, and / or any combination thereof are optionally utilized as input corresponding to sub-events that define the events to be recognized.
[0199] FIG. 2 shows a portable multifunctional device 100 having a touch screen (e.g., the touch-sensitive display system 112 of FIG. 1A) according to some embodiments. The touch screen optionally displays one or more graphics within a user interface (UI) 200. In the embodiments described hereinafter as well as in the present embodiment, a user can select one or more of the graphics by performing gestures on the graphics using, for example, one or more fingers 202 (not drawn at an exact scale in the figure) or one or more styli 203 (not drawn at an exact scale in the figure). In some embodiments, selection of one or more graphics occurs when the user breaks contact with the one or more graphics. In some embodiments, the gestures optionally include one or more taps, one or more swipes (from left to right, from right to left, upward, and / or downward), and / or rolling of a finger in contact with the device 100 (from right to left, from left to right, upward, and / or downward). In some implementations or situations, an accidental contact with a graphic does not select the graphic. For example, if the gesture corresponding to selection is a tap, a swipe gesture that swipes over an application icon does not optionally select the corresponding application.
[0200] Device 100 also optionally includes one or more physical buttons, such as a "home" or menu button 204. As described above, menu button 204 is optionally used to navigate to any application 136 within a set of applications that are optionally executed on device 100. Alternatively, in some embodiments, the menu button is implemented as a soft key in a GUI displayed on the touch screen display.
[0201] In some embodiments, device 100 includes a touch screen display, menu button 204, a push button 206 for turning the device on / off and locking the device, volume adjustment button(s) 208, a subscriber identity module (SIM) card slot 210, a headset jack 212, and a docking / charging external port 124. Push button 206 is used to turn the power on / off on the device by pressing the button and holding it in the pressed state for a predetermined time interval, and to lock, unlock, and / or initiate an unlock process of the device by pressing the button and releasing it before the predetermined time interval has elapsed. In some embodiments, device 100 also accepts verbal input to activate or deactivate some functions through microphone 113. Device 100 also optionally includes one or more contact intensity sensors 165 for detecting the intensity of contact on touch sensing display system 112 and / or one or more haptic output generators 167 for generating haptic output for a user of device 100.
[0202] FIG. 3 is a block diagram of an exemplary multifunctional device that includes a display and a touch sensing surface, according to some embodiments. Device 300 need not be portable. In some embodiments, device 300 is a laptop computer, desktop computer, tablet computer, multimedia player device, navigation device, educational device (such as a child's learning toy), game system, or a control device (e.g., a home or industrial controller). Device 300 typically includes one or more processing units (CPUs) 310, one or more networks or other communication interfaces 360, memory 370, and one or more communication buses 320 for interconnecting these components. Communication bus 320 optionally includes circuitry (sometimes called a chipset) that interconnects and controls communications between system components. Device 300 includes an input / output (I / O) peripheral interface 330 that includes a display 340, which is generally a touch screen display. I / O interface 330 also optionally includes a keyboard and / or mouse (or other pointing device) 350, a touch pad 355, a haptic output generator 357 (such as haptic output generator 167 described above with reference to FIG. 1A) for generating haptic outputs on device 300, and sensors 359 (e.g., light sensors, acceleration sensors, proximity sensors, touch sensing sensors, and / or haptic intensity sensors similar to haptic intensity sensor 165 described above with reference to FIG. 1A). Memory 370 includes high-speed random access memory, such as DRAM, SRAM, DDR RAM, or other random access semiconductor memory devices, and also optionally includes non-volatile memory, such as one or more magnetic disk storage devices, optical disk storage devices, flash memory devices, or other non-volatile semiconductor storage devices. Memory 370 optionally includes one or more storage devices located remotely from the CPU(s) 310.In some embodiments, memory 370 stores a program, module, and data structure, a program, module, and data structure, or a subset thereof, stored in memory 102 of the portable multifunctional device 100 (FIG. 1A). Further, memory 370 may store additional programs, modules, and data structures that do not exist within memory 102 of the portable multifunctional device 100. For example, memory 370 of device 300 optionally stores a drawing module 380, a presentation module 382, a document creation module 384, a website creation module 386, a disk authoring module 388, and / or a spreadsheet module 390, while memory 102 of the portable multifunctional device 100 (FIG. 1) does not optionally store these modules.
[0203] Each of the elements of FIG. 3 identified above is optionally stored in one or more of the aforementioned memory devices. Each of the modules identified above corresponds to a set of instructions for performing the functions described above. The identified modules or programs (i.e., sets of instructions) described above need not be implemented as separate software programs, procedures, or modules, and thus, in various embodiments, various subsets of these modules are optionally combined or otherwise rearranged. In some embodiments, memory 370 optionally stores a subset of the identified modules and data structures described above. Further, memory 370 optionally stores additional modules and data structures not described above.
[0204] Attention is now directed to embodiments of a user interface (the "UI") optionally implemented on the portable multifunctional device 100.
[0205] Figure 4A shows an exemplary user interface related to the menu of an application on the portable multifunctional device 100, according to some embodiments. A similar user interface may optionally be implemented on the device 300. In some embodiments, the user interface 400 includes the following elements, or a subset or superset thereof. ● Signal strength indicator(s) 402 for wireless communication(s) such as cellular and Wi-Fi signals, ● Time 404, ● Bluetooth indicator 405, ● Battery status indicator 406, ● Tray 408 including icons of frequently used applications ○ Icon 416 of the phone module 138, labeled "Phone", optionally including an indicator 414 of the number of missed calls or voicemail messages, ○ Icon 418 of the email client module 140, labeled "Mail", optionally including an indicator 410 of the number of unread emails, ○ Icon 420 of the browser module 147, labeled "Browser", and ○ Icon 422 of the video and music playback module 152, also referred to as the iPod (registered trademark of Apple Inc.) module 152, labeled "iPod", and ● Icons of the following other applications ○ Icon 424 of the IM module 141, labeled "Message", ○ Icon 426 of the calendar module 148, labeled "Calendar", ○ Icon 428 of the image management module 144, labeled "Photos", ○ Icon 430 of the camera module 143, labeled "Camera", ○ Icon 432 of the online video module 155, labeled "Online Video", ○ The icon 434 of the stock widget 149-2 labeled with "Stock". ○ The icon 436 of the map module 154 labeled with "Map". ○ The icon 438 of the weather widget 149-1 labeled with "Weather". ○ The icon 440 of the alarm clock widget 149-4 labeled with "Clock". ○ The icon 442 of the training support module 142 labeled with "Training Support". ○ The icon 444 of the memo module 153 labeled with "Memo", and ○ The icon 446 of the settings application or module that provides access to the settings related to the device 100 and its various applications 136.
[0206] It should be understood that the labels of the icons shown in FIG. 4A are merely exemplary. For example, in some embodiments, the icon 422 of the video and music playback module 152 is labeled with "Music" or "Music Player". Other labels are optionally used for the various application icons. In some embodiments, the label for each application icon includes the name of the application corresponding to the respective application icon. In some embodiments, the label of a particular application icon is different from the name of the application corresponding to the particular application icon.
[0207] FIG. 4B shows an exemplary user interface on a device (e.g., device 300 of FIG. 3) having a touch-sensing surface 451 (e.g., the tablet or touchpad 355 of FIG. 3) separate from the display 450. The device 300 also includes one or more contact intensity sensors (e.g., one or more of the sensors 357) for detecting the intensity of contact on the touch-sensing surface 451, and / or one or more haptic output generators 359 for generating haptic output to the user of the device 300.
[0208] FIG. 4B shows an exemplary user interface on a device (e.g., device 300 of FIG. 3) having a touch sensing surface 451 (e.g., the tablet or touch pad 355 of FIG. 3) that is separate from the display 450. Many of the following examples are described with reference to input on the touch screen display 112 (when the touch sensing surface and the display are combined), but in some embodiments, the device detects input on a touch sensing surface that is separate from the display, as shown in FIG. 4B. In some embodiments, the touch sensing surface (e.g., 451 of FIG. 4B) has a major axis (e.g., 452 of FIG. 4B) that corresponds to a major axis (e.g., 453 of FIG. 4B) on the display (e.g., 450). In these embodiments, the device detects contact (e.g., 460 and 462 of FIG. 4B) with the touch sensing surface 451 at locations (e.g., in FIG. 4B, 460 corresponds to 468 and 462 corresponds to 470) that correspond to respective locations on the display. Thus, when the touch sensing surface is separate from the display, user input (e.g., contacts 460 and 462, and their movement) detected by the device on the touch sensing surface (e.g., 451 of FIG. 4B) is used by the device to operate the user interface on the display (e.g., 450 of FIG. 4B) of the multifunctional device. It should be understood that a similar method is optionally used for other user interfaces described herein.
[0209] In addition, while the following examples are mainly shown with reference to finger inputs (e.g., finger contact, finger tap gesture, finger swipe gesture, etc.), in some embodiments, one or more of these finger inputs may be replaced with inputs derived from another input device (e.g., mouse-based input, or stylus input). For example, a swipe gesture may optionally be replaced with a mouse click (e.g., instead of a contact), and then the cursor is moved along the path of the swipe (e.g., instead of the movement of the contact). As another example, a tap gesture may optionally be replaced with a mouse click while the cursor is placed over the location of the tap gesture (e.g., instead of stopping the detection of the contact following the detection of the contact). Similarly, it will be understood that when multiple user inputs are detected simultaneously, multiple computer mice may be used simultaneously, optionally, or a mouse and a finger contact may be used simultaneously.
[0210] As used herein, the term "focus selector" refers to an input element that indicates the current part of the user interface with which the user is interacting. In implementations that include a cursor or other location marker, the cursor functions as a "focus selector" when an input (e.g., a press input) is detected on the touch-sensitive surface (e.g., the touchpad 355 of FIG. 3, or the touch-sensitive surface 451 of FIG. 4B), and a particular user interface element (e.g., a button, window, slider, or other user interface element) is over the cursor, and the particular user interface element is adjusted according to the detected input. In some implementations that include a touch screen display (e.g., the touch-sensitive display system 112 of FIG. 1A, or the touch screen of FIG. 4A) that enables direct interaction with user interface elements on the touch screen display, a contact detected on the touch screen serves as a "focus selector", and when an input (e.g., a press input by the contact) is detected at the location of a particular user interface element (e.g., a button, window, slider, or other user interface element) on the touch screen display, the particular user interface element is adjusted according to the detected input. In some implementations, the focus is moved from one region of the user interface to another region of the user interface without a corresponding cursor movement or contact movement on the touch screen display (e.g., by using a tab key or arrow keys to move the focus from one button to another). In these implementations, the focus selector moves in accordance with the movement of the focus between different regions of the user interface. Regardless of the particular form the focus selector takes, the focus selector is generally a user interface element (or a contact on the touch screen display) that is controlled by the user to convey the user's intended (e.g., by indicating to the device the user interface element with which the user wishes to interact) interaction with the user interface.For example, when a press input is detected on a touch sensing surface (e.g., a touch pad or a touch screen), the location of a focus selector (e.g., a cursor, a contact, or a selection box) over each button indicates that the user is attempting to activate each button (unlike other user interface elements displayed on the device's display).
[0211] As used in this specification and the claims, the term "intensity" of a contact on a touch sensing surface refers to the force or pressure (force per unit area) of a contact (e.g., finger contact or stylus contact) on the touch sensing surface, or an alternative (substitute) for the force or pressure of the contact on the touch sensing surface. The intensity of the contact has a range of numerical values that includes at least four different numerical values, and more typically includes hundreds or more different numerical values (e.g., at least 256). The intensity of the contact is optionally determined (or, measured) using a variety of methods and a variety of sensors, or combinations of sensors. For example, one or more sensors disposed under or adjacent to the touch sensing surface are optionally used to measure the force at various points on the touch sensing surface. In some implementations, the force measurements of multiple force sensors are combined (e.g., weighted average or sum) to determine an estimated force of the contact. Similarly, a pressure-sensitive tip of a stylus is optionally used to determine the pressure of the stylus on the touch sensing surface. As another method, the size and / or change thereof of the contact area detected on the touch sensing surface, the capacitance and / or change thereof of the touch sensing surface in proximity to the contact, and / or the resistance and / or change thereof of the touch sensing surface in proximity to the contact are optionally used as a substitute for the force or pressure of the contact on the touch sensing surface. In some implementations, the alternative measurement of the force or pressure of the contact is used directly to determine whether it exceeds an intensity threshold (e.g., the intensity threshold is described in units corresponding to the alternative measurement). In some implementations, the alternative measurement of the force or pressure of the contact is converted to an estimated force or pressure, and this estimated force or pressure is used to determine whether it exceeds an intensity threshold (e.g., the intensity threshold is a pressure threshold measured in units of pressure). By using the intensity of the contact as an attribute of user input, user access to additional device functions that may otherwise be inaccessible to the user becomes possible in a device of limited size for displaying affordances (e.g., on a touch sensing display) and / or receiving user input (e.g., via a touch sensing display, a touch sensing surface, or a physical / mechanical control such as a knob or button).
[0212] In some embodiments, the contact / movement module 130 uses a set of one or more intensity thresholds to determine whether an action has been performed by the user (e.g., to determine whether the user has "clicked" on an icon). In some embodiments, at least a subset of the intensity thresholds is determined according to software parameters (e.g., the intensity threshold is not determined by the activation threshold of a particular physical actuator and can be adjusted without changing the physical hardware of the device 100). For example, the mouse "click" threshold of a trackpad or touchscreen display can be set to any of a wide range of default thresholds without changing the trackpad or touchscreen display hardware. Additionally, in some implementations, the user of the device is provided with software settings for adjusting one or more of the set of intensity thresholds (e.g., by adjusting individual intensity thresholds and / or by adjusting multiple intensity thresholds immediately after a system-level click of the "intensity" parameter).
[0213] As used in the specification and claims, the term "characteristic strength" of a contact refers to a characteristic of the contact based on one or more strengths of the contact. In some embodiments, the characteristic strength is based on a plurality of strength samples. The characteristic strength is optionally based on a set of strength samples collected within a predetermined time period (e.g., 0.05, 0.1, 0.2, 0.5, 1, 2, 5, 10 seconds) for a predetermined number of strength samples, or a predetermined event (e.g., after detecting the contact, before detecting the lift-off of the contact, before or after detecting the start of movement of the contact, before detecting the end of the contact, before or after detecting an increase in the strength of the contact, and / or before or after detecting a decrease in the strength of the contact). The characteristic strength of the contact is optionally based on one or more of the maximum value of the strength of the contact, the mean value of the strength of the contact, the average value of the strength of the contact, the top 10 percentile value of the strength of the contact, a value that is half of the maximum value of the strength of the contact, a value that is 90 percent of the maximum value of the strength of the contact, etc. In some embodiments, the duration of the contact is used to determine the characteristic strength (e.g., when the characteristic strength is the average of the strength of the contact over time). In some embodiments, the characteristic strength is compared to a set of one or more strength thresholds to determine whether an operation has been performed by a user. For example, the set of one or more strength thresholds may include a first strength threshold and a second strength threshold. In this example, a first operation is performed as a result of a contact having a characteristic strength that does not exceed the first threshold, a second operation is performed as a result of a contact having a characteristic strength that exceeds the first threshold and does not exceed the second threshold, and a third operation is performed as a result of a contact having a characteristic strength that exceeds the second threshold. In some embodiments, the comparison between the characteristic strength and one or more strength thresholds is not used for the purpose of determining which of the first or second operations to perform, but rather for the purpose of determining whether to perform one or more operations (e.g., whether to perform each option or to omit the performance of each operation).
[0214] In some embodiments, a portion of a gesture is identified for the purpose of determining characteristic intensity. For example, a touch sensing surface may receive a continuous swipe contact (e.g., a drag gesture) that transitions from a starting location and reaches an ending location that is a point where the intensity of the contact increases. In this example, the characteristic intensity of the contact at the ending location may be based only on a portion of the swipe contact (e.g., only the portion of the swipe contact at the ending location) and not the entire continuous swipe contact. In some embodiments, a smoothing algorithm may be applied to the intensity of the swipe contact before determining the characteristic intensity of the contact. For example, the smoothing algorithm may optionally include one or more of a non - weighted moving average smoothing algorithm, a triangular smoothing algorithm, a median filter smoothing algorithm, and / or an exponential smoothing algorithm. In some situations, these smoothing algorithms exclude minor increases or decreases in the intensity of the swipe contact for the purpose of determining the characteristic intensity.
[0215] The user interface diagrams described herein include one or more intensity thresholds (e.g., a contact detection intensity threshold IT 0 , a light press intensity threshold IT L , (e.g., at least initially higher than I L ) a deep press intensity threshold IT D , and / or one or more other intensity thresholds (e.g., an intensity threshold I L lower than I HOptionally includes various intensity charts showing the current intensity of contact on the touch-sensing surface with respect to (). These intensity charts are typically not part of the displayed user interface but are provided to aid in the interpretation of those figures. In some embodiments, the light press intensity threshold corresponds to the intensity at which the device will perform an operation typically associated with pressing a button on a physical mouse or clicking a trackpad. In some embodiments, the deep press intensity threshold corresponds to the intensity at which the device will perform an operation different from the operation typically associated with pressing a button on a physical mouse or clicking a trackpad. In some embodiments, when a contact with a characteristic intensity below the light press intensity threshold (e.g., and below a slight contact detection intensity threshold IT where contact is no longer detected when below it) 0 is detected above), the device moves the focus selector in accordance with the movement of the contact on the touch-sensing surface without performing the operation associated with the light press intensity threshold or the deep press intensity threshold. Generally, unless otherwise specified, these intensity thresholds are consistent across different sets of user interface figures.
[0216] In some embodiments, the device's response to an input detected by the device depends on a criterion based on the contact intensity during the input. For example, in the case of some "light press" inputs, a contact intensity exceeding a first intensity threshold during the input triggers a first response. In some embodiments, the device's response to an input detected by the device depends on a criterion that includes both the contact intensity during the input and a time-based criterion. For example, for some "deep press" inputs, a contact intensity that exceeds a second intensity threshold during the input and is higher than the first intensity threshold for a light press triggers a second response only if a delay time has elapsed between satisfying the first intensity threshold and satisfying the second intensity threshold. This delay time is typically less than 200 milliseconds (e.g., 40, 100, or 120 milliseconds depending on the magnitude of the second intensity threshold, and this delay time increases with an increase in the second intensity threshold). This delay time helps to avoid accidental deep press inputs. As another example, for some "deep press" inputs, there is a sensitivity reduction period that occurs after the time when the first intensity threshold is satisfied. During this sensitivity reduction period, the second intensity threshold increases. This temporary increase in the second intensity threshold also helps to avoid accidental deep press inputs. For other deep press inputs, the response to the detection of a deep press input does not depend on a time-based criterion.
[0217] In some embodiments, one or more of the input intensity threshold and / or the corresponding output vary based on one or more factors such as user settings, movement of the contact, timing of the input, execution status of the application, acceleration of the intensity imprint, number of simultaneous inputs, user history, environmental factors (e.g., ambient noise), position of the focus selector, etc. Exemplary factors are described in U.S. Patent Application Nos. 14 / 399,606 and 14 / 624,296, which are hereby incorporated by reference in their entirety.
[0218] For example, FIG. 4C shows a dynamic intensity threshold 480 that varies over time, based in part on the intensity of touch input 476. The dynamic intensity threshold 480 is the sum of two components: a first component 474 that decays over time after a predetermined delay time p1 from when the touch input 476 is first detected, and a second component 478 that follows the intensity of the touch input 476 over time. The intensity threshold of the first component 474, which has a high initial value, reduces spurious triggering of a "deep press" response while still allowing an immediate "deep press" response when the touch input 476 provides sufficient intensity. The second component 478 reduces triggering of an unintended "deep press" response as the intensity of the touch input gradually varies. In some embodiments, when the touch input 476 (e.g., at point 481 in FIG. 4C) meets the dynamic intensity threshold 480, a "deep press" response is triggered.
[0219] FIG. 4D shows another dynamic intensity threshold 486 (e.g., intensity threshold I D ). FIG. 4D also shows two other intensity thresholds, a first intensity threshold I H and a second intensity threshold I L . In FIG. 4D, the touch input 484 meets the first intensity threshold I H and the second intensity threshold I L before time p2, but no response is provided until the delay time p2 has elapsed at time 482. FIG. 4D also shows that the dynamic intensity threshold 486 decays over time. This decay starts at time 488 after a predetermined delay time p1 has elapsed from time 482 (when the response associated with the second intensity threshold I L is triggered). This type of dynamic intensity threshold reduces spurious triggering of a response associated with the dynamic intensity threshold I H or the second intensity threshold I L immediately after or simultaneously with triggering a response associated with a lower intensity threshold such as the first intensity threshold I D .
[0220] FIG. 4E shows yet another dynamic intensity threshold 492 (e.g., intensity threshold I D) is shown. In FIG. 4E, after a delay time p2 has elapsed since the touch input 490 was first detected, the response associated with the intensity threshold I L is triggered. At the same time, after a predetermined delay time p1 has elapsed since the touch input 490 was first detected, the dynamic intensity threshold 492 decays. Therefore, after the response associated with the intensity threshold I L is triggered and the intensity of the touch input 490 decreases, and then if the intensity of the touch input 490 increases without releasing the touch input 490, the intensity of the touch input 490, for example, even if it is below another intensity threshold such as the intensity threshold I L , the response associated with the intensity threshold I D can be triggered (for example, at time 494).
[0221] From an intensity below the light press intensity threshold IT L to an intensity between the light press intensity threshold IT L and the deep press intensity threshold IT D , an increase in the characteristic intensity of the contact may be referred to as a "light press" input. From an intensity below the deep press intensity threshold IT to an intensity above the deep press intensity threshold IT D , an increase in the characteristic intensity of the contact may be referred to as a "deep press" input. From an intensity below the contact detection intensity threshold IT 0 to an intensity between the contact detection intensity threshold IT 0 and the light press intensity threshold IT L , an increase in the characteristic intensity of the contact may be referred to as the detection of contact on the touch surface. From an intensity above the contact detection intensity threshold IT 0 to an intensity below the contact detection intensity threshold IT 0 , a decrease in the characteristic intensity of the contact may be referred to as the detection of lift-off of the contact from the touch surface. In some embodiments, IT 0 is zero. In some embodiments, IT 0 is greater than zero. In some figures, shaded circles or ellipses are used to represent the intensity of the contact on the touch sensing surface. In some figures, unshaded circles or ellipses are used to represent each contact on the touch sensing surface without specifying the intensity of each contact.
[0222] In some embodiments described herein, in response to detecting a gesture that includes each pressing input, or in response to detecting each pressing input that is performed with each contact (or contacts), one or more operations are performed, and each of those pressing inputs is detected based at least in part on detecting an increase in the intensity of a contact (or contacts) that exceeds a pressing input threshold intensity. In some embodiments, each operation is performed in response to detecting an increase in the intensity of each contact to an intensity that exceeds a pressing input threshold intensity (e.g., each operation is performed by a “downstroke” of each pressing input). In some embodiments, a pressing input includes an increase in the intensity of each contact to an intensity that exceeds a pressing input threshold intensity and a subsequent decrease in the intensity of the contact that is below the pressing input threshold intensity, and each operation is performed in response to detecting the subsequent decrease in the intensity of each contact that is below the pressing input threshold (e.g., each operation is performed by an “upstroke” of each pressing input).
[0223] In some embodiments, the device employs intensity hysteresis to avoid spurious inputs sometimes referred to as "jitter", and the device defines or selects a hysteresis intensity threshold having a predefined relationship to the press input threshold intensity (e.g., the hysteresis intensity threshold is X intensity units lower than the press input threshold intensity, or is 75%, 90%, or some reasonable ratio of the press input threshold intensity). Thus, in some embodiments, a press input includes an increase in the intensity of each contact to an intensity above the press input threshold intensity and a subsequent decrease in the intensity of each contact below the respective hysteresis intensity threshold to the press input threshold intensity, and each operation is performed in response to detecting the subsequent decrease in the intensity of each contact to an intensity below the hysteresis intensity threshold (e.g., each operation is performed by the "upstroke" of the corresponding press input). Similarly, in some embodiments, a press input is detected only if the device detects an increase in the intensity of contact from an intensity below the hysteresis intensity threshold to an intensity above the press input intensity threshold and optionally a subsequent decrease in the intensity of contact to an intensity below the hysteresis intensity, and each operation is performed in response to the detection of that press input (e.g., an increase in the intensity of contact or a decrease in the intensity of contact, depending on the situation).
[0224] For ease of explanation, the description of an operation performed in response to a pressing input associated with a pressing input threshold intensity, or in response to the pressing input gesture, is based on an increase in the intensity of contact above the pressing input threshold intensity, from an intensity below the hysteresis intensity threshold to an intensity above the pressing input threshold intensity, a decrease in the intensity of contact below the pressing input threshold intensity, or a decrease in the intensity of contact below the hysteresis intensity threshold corresponding to the pressing input threshold intensity, and is optionally triggered in response to detecting such. Additionally, in an embodiment described as an operation being performed in response to detecting a decrease in the intensity of contact below a pressing input intensity threshold, the operation is optionally performed in response to detecting a decrease in the intensity of contact below a hysteresis intensity threshold that corresponds to and is lower than the pressing input intensity threshold. As described above, in some embodiments, the triggering of these responses also depends on a time-based criterion being met (e.g., a delay time has elapsed between a first intensity threshold being met and a second intensity threshold being met). User Interface and Related Processes
[0225] Attention is now directed to embodiments of a user interface "UI" and related processes that may be implemented on an electronic device, such as the portable multifunctional device 100 or device 300, comprising a display, a touch sensing surface, and one or more sensors for detecting the intensity of contact with the touch sensing surface.
[0226] In some embodiments, the device is an electronic device having a separate display (e.g., display 450) and a separate touch sensing surface (e.g., touch sensing surface 451). In some embodiments, the device is the portable multifunctional device 100, the display is the touch sensing display system 112, and the touch sensing surface includes a haptic output generator 167 on the display (FIG. 1A). For convenience of explanation, the described embodiments will be discussed with reference to operations performed on a device having the touch sensing display system 112. In such embodiments, the focus selector is optionally each finger or stylus contact, a representative point corresponding to the finger or stylus contact (e.g., the center of gravity of each contact or a point associated with each contact), or the center of gravity of two or more contacts detected on the touch sensing display system 112. However, similar operations are optionally performed on a device having the display 450 and the separate touch sensing surface 451 in response to detecting a contact on the touch sensing surface 451 while the user interface shown in these figures is being displayed on the display 450 with the focus selector.
[0227] Figs. 5A-5AW illustrate exemplary user interfaces for quickly invoking one of several actions associated with each application without first activating each application. In some embodiments, this is accomplished by detecting user input that is distinguishable from conventional user input used to launch an application (e.g., based on the magnitude of the force applied by the user) and providing the user with a menu (e.g., a "quick action menu") that includes quick action items for each application. In some embodiments, the user interface provides feedback (e.g., visual, auditory, and / or haptic feedback) when the user is about to invoke the quick action menu (e.g., when the user input approaches an intensity threshold). This allows the user to correct their input and avoid inadvertently activating the quick action menu. This also helps the user determine the magnitude of the force required to invoke the quick action menu. An exemplary quick action function is described in Appendix A.
[0228] The user interfaces in these figures are used for the purpose of illustrating the following process. Some of the following examples are presented with reference to input on a touch screen display (when a touch sensing surface and a display are combined), but in some embodiments, the device detects input on a touch sensing surface 451 that is separate from the display 450, as shown in Fig. 4B.
[0229] Figures 5A-5G, 5I-5W, 5Y-5AA, 5AC-5AJ, and 5AL-5AW illustrate exemplary user interfaces of a home screen for displaying a plurality of application launch icons (e.g., icons 480, 426, 428, 482, 432, 434, 436, 438, 440, 442, 444, 446, 484, 430, 486, 488, 416, 418, 420, and 424). Each of these launch icons is associated with an application that is activated (e.g., “launched”) on the electronic device 100 when an application launch input (e.g., a tap gesture having a maximum intensity below a threshold for invoking a quick action menu) is detected. Some of the launch icons are also associated with a corresponding quick action menu that is activated on the electronic device when a quick action display input (e.g., a force press gesture having a maximum intensity equal to or above a threshold for invoking a quick action menu) is detected.
[0230] Figures 5A-5H illustrate one embodiment of a user invoking a quick action display menu from the home screen of the electronic device 100 and invoking an action to reply to a recent message. Figure 5A shows a home screen user interface 500 that displays application launch icons for several applications, including a message icon 424 for activating a messaging application. The device detects a contact 502 on the message icon 424 having an intensity below a strength threshold (e.g., IT L ) required to invoke a quick action menu. In Figure 5C, the intensity of the contact 502 increases to a “hint” threshold (e.g., IT H) is greater than, but still below, the intensity threshold required to invoke the quick action menu. The device blurs other launch icons and begins to move them deeper into the virtual z-space (e.g., away from the screen), and provides a hint graphic 503 that emerges from below the message icon 424 to notify the user that they are approaching the intensity required to invoke the quick action menu. As shown in FIG. 5D, the icon blurring, icon movement in the z-space, and hint graphic respond dynamically to an increase in the intensity of the contact 502 that is below the quick action menu threshold (e.g., IT L ) The hint graphic 503 continues to increase and begins to move away from below the message icon 424.
[0231] In FIG. 5E, the intensity of the contact 502 increases and exceeds the threshold (e.g., IT L ) required to invoke the message quick action menu 504. In response, the hint graphic 503 changes to the quick action menu 504 and displays the icons and text for each of the available selections 506, 508, 510, and 512 for the user. The device also provides haptic feedback 513 to inform the user that the quick action menu has become functional. The user lifts off the contact 502 in FIG. 5F, but the quick action menu 504 remains displayed on the touch screen 112 since it is a selection menu. As shown in FIG. 5G, the user selects to respond to the mother's message by tapping (via contact 514) on option 508 within the quick action menu 504. In response, the device activates the messaging application and displays a user interface 501 that includes a text prompt for replying to the mother's message, rather than opening the application to the default user interface (e.g., view of the last received message).
[0232] FIG. 5I shows an alternative hint state according to some embodiments, where the size of the messaging icon 424 increases in response to a contact 516 having an intensity that exceeds the "hint" threshold but is below the "quick action menu" intensity threshold (e.g., simulating the icon emerging from the screen and coming towards the user).
[0233] FIGS. 5J - 5N show one embodiment where the user initiates a call for the quick action menu but does not reach the required intensity threshold. In FIG. 5J, the device 100 detects a contact 518 on the message icon 424 having an intensity below the intensity threshold required to call the quick action menu (e.g., IT L ) that is displayed within the home screen user interface 500. In FIGS. 5K and 5L, the intensity of the contact 518 increases and exceeds the "hint" threshold (e.g., IT H ) but still remains below the intensity threshold required to call the quick action menu. The device blurs other launch icons dynamically and pushes other icons in the virtual z - space back dynamically (e.g., shrinking them relative to the message icon 424), and provides a hint graphic 503 that appears from below the message icon 424 and emerges dynamically to notify the user that they are approaching the intensity required to call the quick action menu. However, FIG. 5M shows the user reducing the intensity of the contact 518 before reaching the intensity threshold (e.g., IT L ) required to call the quick action menu. In response, the device dynamically reverses the blurring and shrinking of the icons and begins to shrink the hint graphic 503 that had notified the user that they were approaching the quick action intensity threshold. In FIG. 5N, the user lifts off the contact 518. Since the intensity of the contact 518 did not reach the intensity threshold (e.g., IT L ) required to call the quick action menu, the device returns the display of the user interface 500 to the same state as before the contact 518 was detected.
[0234] Figures 5O to 5R show an embodiment in which a user executes a gesture that satisfies the quick action display input criteria for a launch icon that does not have an associated quick action menu. In Figure 5O, the device 100 detects a contact 520 on the set launch icon 446 that has an intensity below the intensity threshold (e.g., IT L ) required to invoke the quick action menu and is displayed within the home screen user interface 500. In Figure 5P, the intensity of the contact 520 increases and exceeds the "hint" threshold (e.g., IT H ), but still remains below the intensity threshold required to invoke the quick action menu. The device blurs (e.g., dynamically) other launch icons to notify the user that they are approaching the intensity required to invoke the quick action menu. However, since the set launch icon 446 is not associated with the quick action menu, the device does not provide a hint graphic (such as the hint graphic 503 in Figure 5C). In Figure 5Q, the intensity of the contact 520 increases and exceeds the threshold (e.g., IT L ) required to invoke the quick action menu. However, since the set launch icon 446 is not associated, the device does not display the quick action menu. Instead, the device provides a negative haptic feedback 522 distinguishable from the positive haptic feedback 513 shown in Figure 5E to explicitly inform the user that there is no quick action menu for the available set launch icon 446. Thereafter, the device returns the display of the user interface 500 to the same state as before the contact 520 was detected in Figure 5R, regardless of whether the user lifted off the contact 520.
[0235] Figures 5S to 5U show an embodiment in which a user invokes a quick action menu for a launch icon located in the upper left section of the touch screen 112. In Figure 5J, the device 100 detects a contact 520 on the launch icon displayed in the upper left section of the home screen user interface 500 that has an intensity below the intensity threshold (e.g., IT L) Detect a contact 524 having an intensity below. In FIG. 5T, the intensity of the contact 524 increases and exceeds the "hint" threshold (e.g., IT H ) but still remains below the intensity threshold required to invoke the quick action menu. The device notifies the user that they are approaching the intensity required to invoke the quick action menu by dynamically blurring other launch icons and providing a hint graphic 503 that appears from below the message icon 424 and dynamically emerges.
[0236] In FIG. 5U, the intensity of the contact 524 increases and exceeds the threshold required to invoke the quick action menu (e.g., IT L) exceeds. Accordingly, the hint graphic 503 changes to the quick action menu 528, and displays the icons and text of each of the selectable options 506, 508, 510, and 512 that have become available to the user. However, since the launch icon is displayed on the left side of the screen 112, the quick action menu 528 aligns at the left end of the message launch icon 424, rather than at the right end as shown in FIG. 5E (for example, when the message launch icon 424 is displayed on the right side of the touch screen 112). Similarly, the icons associated with the options 506, 508, 510, and 512 align on the left side of the quick action menu 528, rather than on the right side as shown in FIG. 5E. Also, since the launch icon is displayed in the upper half of the touch screen 112, the quick action menu 528 is displayed below the message launch icon 424, rather than above as shown in FIG. 5E (for example, when the message launch icon 424 is displayed in the lower half of the touch screen 112). Similarly, since the vertical order of the options 506, 508, 510, and 512 is reversed from the quick action menu 504 of FIG. 5E, the relative distance of each option with respect to the message launch icon 424 within the message quick action menus 504 and 528 is the same (for example, the option to compose a new message 512 to reply to the most recently received message is prioritized over the options 506, 508, and 510, so the option 512 is displayed closest to the message launch icon 424 in both quick action menus).
[0237] FIGS. 5V - 5AF show alternative user inputs for performing various actions after invoking a quick action menu, according to some embodiments.
[0238] In FIG. 5V, after the user invokes the message quick action menu 528 on the home screen user interface 500 via contact 524, as shown in FIG. 5W, the user slides contact 524 over option 508 to reply to the message from the mother. As shown in FIG. 5W, the user does not need to maintain the intensity of contact 524 above the quick action menu intensity threshold (e.g., IT L ). The user then lifts off contact 524 while it is over option 508, and as shown in FIG. 5X, the device activates the messaging application and displays a user interface 501 that includes a text prompt for replying to the mother's message.
[0239] In FIG. 5Y, after the user invokes the message quick action menu 528 on the home screen user interface 500 via contact 532, as shown in FIG. 5Z, the user lifts off contact 532. The user then taps the message launch icon 424 via contact 534, as shown in FIG. 5AA. In response, the device activates the associated messaging application in the default state by displaying a user interface 535 that includes a display of the latest received message, as shown in FIG. 5AB.
[0240] In FIG. 5AC, after the user invokes the message quick action menu 528 on the home screen user interface 500 via contact 536, as shown in FIG. 5AD, the user lifts off contact 536. The user then taps on a location of the touch screen 112 other than the location where the message launch icon 424 and the quick action menu 528 are displayed via contact 538, as shown in FIG. 5AE. In response, the device clears the quick action menu 528 and returns the display of the user interface 500 to the same state as before contact 524 was detected, as shown in FIG. 5AF.
[0241] Figures 5AG - 5AK show an embodiment in which a user performs a suitable action through activation of a quick action menu by pressing. In Figure 5AG, device 100 detects a contact 540 having an intensity below the intensity threshold (e.g., IT L ) required to invoke the quick action menu on the message icon 424, which is displayed within the home screen user interface 500. In Figures 5AH and 5AI, the intensity of the contact 540 increases and exceeds the "hint" threshold (e.g., IT H ), but still remains below the intensity threshold required to invoke the quick action menu. The device notifies the user that they are approaching the intensity required to invoke the quick action menu by dynamically blurring other launch icons and dynamically pushing back other icons within the virtual z - space (e.g., shrinking them relative to the message icon 424), and providing a dynamically emerging hint graphic 503 that appears from below the message icon 424.
[0242] In Figure 5AJ, the intensity of the contact 540 increases and exceeds the threshold (e.g., IT L ) required to invoke the message quick action menu 504. Accordingly, the hint graphic 503 changes to the quick action menu 504, and displays the icon and text of each available selection for the user, such as selection 512 for the suitable action of creating a new message. The device also provides haptic feedback 513 to inform the user that the quick action menu has become functional. After invoking the quick action menu 504, the intensity of the contact 540 continues to increase and exceeds a third intensity threshold (e.g., IT D ). Accordingly, as shown in Figure 5AK, the device activates the associated messaging application in a suitable state (e.g., corresponding to option 512) by displaying a user interface 541 for composing a new message.
[0243] Figures 5AL to 5AN show one embodiment in which a user invokes a quick action menu on the launch icon of a folder containing the launch icons of a plurality of applications having associated notifications. In Figure 5AL, the device 100 detects a contact 542 having an intensity below the intensity threshold (e.g., IT L ) required to invoke the quick action menu on the networking launch icon 488. The networking launch icon 488 is associated with a folder that opens when activated and reveals the launch icons of a plurality of applications (e.g., launch icons "F", "T", and "L") represented on the networking launch icon 488. As shown in Figure 5AL, the applications associated with the launch icons stored in the networking folder have seven composite user notifications.
[0244] In Figure 5AM, the intensity of the contact 542 increases and exceeds the "hint" threshold (e.g., IT H ) but still remains below the intensity threshold required to invoke the quick action menu. The device notifies the user that they are approaching the intensity required to invoke the quick action menu by dynamically blurring other launch icons and providing a hint graphic 543 that appears from below the networking launch icon 488 and moves out dynamically. In Figure 5AN, the intensity of the contact 542 increases and exceeds the threshold (e.g., IT L ) required to invoke the quick action menu. In response, the hint graphic 543 changes to the quick action menu 544, displaying the icons and text of each of the selectable options 546, 548, 550, and 552 that are now available to the user. The icon displayed for each selection is a graphical representation of the launch icon of an application associated with one or more of these seven notifications. The text displayed for each selection is the title of the notification associated with each application.
[0245] Figures 5AO to 5AQ show an embodiment in which a user invokes a quick action menu on a launch icon of a third - party application. In Figure 5AO, the device 100 detects a contact 554 having an intensity below the intensity threshold (e.g., IT L ) required to invoke the quick action menu on the training launch icon 442. In Figure 5AP, the intensity of the contact 554 increases and exceeds the "hint" threshold (e.g., IT H ), but still remains below the intensity threshold required to invoke the quick action menu. The device notifies the user that they are approaching the intensity required to invoke the quick action menu by dynamically blurring other launch icons and providing a hint graphic 556 that appears from below the training launch icon 442 and dynamically emerges. In Figure 5AQ, the intensity of the contact 554 increases and exceeds the threshold (e.g., IT L ) required to invoke the quick action menu. Accordingly, the hint graphic 556 changes to the quick action menu 558, and displays the icons and text of each of the selectable items 560, 562, 564, 566, and 568 that are now available to the user. By selection 568, the user can share the third - party application with a friend (e.g., by sending a link to download the third - party application from the application store to a friend).
[0246] Figures 5AR to 5AT show an embodiment in which a user invokes a quick action menu on a launch icon in the upper - right section of the touch screen 112. In Figure 5AR, the device 100 detects a contact 574 having an intensity below the intensity threshold (e.g., IT L ) required to invoke the quick action menu on the message icon 424, which is displayed in the upper - left section of the home screen user interface 500. In Figure 5AS, the intensity of the contact 570 increases and exceeds the "hint" threshold (e.g., IT H) is exceeded, but still below the intensity threshold required to invoke the quick action menu. The device notifies the user that they are approaching the intensity required to invoke the quick action menu by dynamically blurring other launch icons and providing a hint graphic 569 that appears from below the message icon 424 and dynamically emerges.
[0247] In FIG. 5AT, the intensity of the contact 570 increases and exceeds the threshold (e.g., IT L ) required to invoke the quick action menu. In response, the hint graphic 569 changes to the quick action menu 571, which displays the icons and text for each of the selectable options 506, 508, 510, and 512 that are now available to the user. Since the launch icon is displayed on the right side of the screen 112, the quick action menu 571 aligns at the right end of the message launch icon 424. Similarly, the icons associated with the options 506, 508, 510, and 512 also align on the right side of the quick action menu 571. Since the launch icon is displayed in the upper half of the touch screen 112, the quick action menu 571 is displayed below the message launch icon 424. Similarly, the vertical order of the options 506, 508, 510, and 512 is reversed from the quick action menu 504 in FIG. 5E.
[0248] FIGS. 5AU - 5AW illustrate one embodiment in which the user invokes the quick action menu at a launch icon in the lower left hand region of the touch screen 112. In FIG. 5AU, the device 100 detects a contact 572 having an intensity below the intensity threshold (e.g., IT L ) required to invoke the quick action menu on the message icon 424, which is displayed in the lower left hand region of the home screen user interface 500. In FIG. 5AV, the intensity of the contact 572 increases and exceeds the "hint" threshold (e.g., IT H) is above, but still below the intensity threshold required to invoke the quick action menu. The device notifies the user that they are approaching the intensity required to invoke the quick action menu by dynamically blurring other launch icons and providing a hint graphic 573 that appears from below the message icon 424 and animates out.
[0249] In FIG. 5AW, the intensity of the contact 572 increases and exceeds the threshold (e.g., IT L ) required to invoke the quick action menu. In response, the hint graphic 573 changes to the quick action menu 574 and displays the icons and text for each of the selectable options 506, 508, 510, and 512 that are now available to the user. Since the launch icon is displayed on the left side of the screen 112, the quick action menu 574 aligns at the left end of the message launch icon 424. Similarly, the icons associated with the options 506, 508, 510, and 512 are also aligned on the left side of the quick action menu 574. Since the launch icon is displayed in the lower half of the touch screen 112, the quick action menu 574 is displayed above the message launch icon 424. Similarly, the vertical order of the options 506, 508, 510, and 512 is the same as the quick action menu 504 in FIG. 5E.
[0250] Figures 6A through 6AS illustrate exemplary embodiments of a user interface that enables a user to efficiently navigate between a first user interface and a second user interface. In some embodiments, this is accomplished by providing the user with the ability to preview the content of the second user interface without leaving the first user interface when a user input that can be distinguished from conventional user inputs used to navigate between user interfaces (e.g., based on the magnitude of a force applied by the user) is detected. In some embodiments, the user interface provides the user with the ability to perform actions associated with the second user interface while previewing. Although some of the following examples are presented with reference to an email messaging application, these methods may be implemented within any number of different applications as described herein.
[0251] The user interfaces in these figures are used for the purpose of illustrating the following processes. Although some of the following examples are presented with reference to input on a touch screen display (where a touch sensing surface and a display are combined), in some embodiments, the device detects input on a touch sensing surface 451 that is separate from the display 450, as shown in FIG. 4B.
[0252] Figures 6A-6E, 6H-6AL, and 6AN-6AS illustrate an exemplary user interface 600 for managing electronic mail messages in an inbox. The user interface displays a plurality of partial views of electronic mail messages (e.g., partial views of electronic mail messages 602, 604, 606, 608, and 636). Each partial view of an electronic mail message is associated with a complete electronic mail message that contains more content than is displayed in user interface 600 (e.g., as shown in FIG. 6F, user interface 614 displays additional content associated with the partial view of electronic mail message 602 within user interface 600).
[0253] Figures 6A-6G illustrate one embodiment in which a user previews the content of an electronic mail from an electronic mail inbox and then navigates to that electronic mail with a single gesture. FIG. 6A shows an electronic mail inbox displaying a partial view of an electronic mail message that includes a partial view of electronic mail message 602. Device 100 detects, in FIG. 6B, a contact 610 having an intensity below the intensity threshold (e.g., IT L ) required to invoke a preview of the electronic mail on the partial view of electronic mail message 602. In FIG. 6C, the intensity of contact 610 increases and exceeds a "hint" threshold (e.g., IT), but is still below the intensity threshold (e.g., IT L ) required to invoke the preview area of the electronic mail. The device notifies the user that they are approaching the intensity required to invoke the preview area by blurring other partial views of the electronic mail (e.g., moving away from the screen) and beginning to move it deeper into the virtual z-space. As shown in FIG. 6D, the blurring and the movement deeper into the virtual z-space dynamically react to an increase in the intensity of contact 610 that is below the preview area invocation threshold (e.g., IT L ).
[0254] In FIG. 6E, the intensity of contact 610 increases to the threshold (e.g., IT) required to invoke the preview area 612 of the electronic mail messageL ) exceeds. In response, the device displays a preview area 612 over a portion of the partial view of the email message within the user interface 600. This preview displays a view of the email that includes more content than is provided in the partial view of the email message 602. The device also provides haptic feedback 611 to inform the user that the preview area has been activated. The user continues to increase the intensity of the contact 610 between FIGS. 6E and 6F to exceed a third threshold (e.g., IT D ). In response, the device navigates to a user interface 614, as shown in FIG. 6F, and displays the full-text email associated with the partial view 602 and the preview area 612. The device also provides haptic feedback 615 distinguishable from the haptic feedback 611 to inform the user that navigation to the full-text email has occurred. As shown in FIG. 6G, the device maintains the display of the user interface 614 even after the user has ended the input (e.g., contact 610).
[0255] FIGS. 6H-6K illustrate an embodiment where the user begins to call up a preview of the full-text email associated with the partial view 602 but does not reach the required intensity threshold. In FIG. 6H, the device 100 detects a contact 616 on a partial view of an email message 602 that has an intensity below the intensity threshold (e.g., IT L ) required to call up a preview of the email, as displayed within the email inbox user interface 600. In FIG. 6I, the intensity of the contact 616 increases and exceeds a "hint" threshold (e.g., IT H ) but is below the intensity threshold (e.g., IT L) is still below. The device blurs other partial views of the email (e.g., away from the screen) and begins to move them deeper into the virtual z-space, notifying the user that it is approaching the intensity required to call up the preview area. However, FIG. 6J shows the state where the user has decreased the intensity of contact 616 before reaching the intensity threshold required to call up the preview area (e.g., IT L ). In response, the device dynamically reverses the blurring of the other partial views and moves them forward in the virtual z-space. In FIG. 6K, the user lifts off contact 616. Since the intensity of contact 616 did not reach the intensity threshold (e.g., IT D ) required to navigate to the full-text version of the email, the device returns the display of the user interface 600 to the same state as before contact 616 was detected.
[0256] FIGS. 6L - 6O show an embodiment in which the user activates a menu of selectable actions associated with the entire email message while viewing a preview of the message (e.g., without leaving the email inbox). In FIG. 6L, the device 100 detects a contact 618 with an intensity below the intensity threshold (e.g., IT L ) required to call up a preview of the email, on a partial view of the email message 602, which is displayed within the email inbox user interface 600. In FIG. 6M, the device detects that the intensity of contact 618 has increased to the preview area call-up threshold (e.g., IT LIn response to detecting that it has exceeded [[ID=]], the preview area 612 is displayed. The device also displays the caret 619 and notifies the user that selectable actions can be indicated by swiping up on the touch screen 112. As shown in FIG. 6N, the user moves the contact 620 upward on the touch screen 112. In FIG. 6O, in response to detecting the movement of the contact from the position 618-a to the position 618-b, the preview area 612 moves upward on the display, and selectable action options 624, 626, and 628 appear below the preview area. The device also provides haptic feedback 6123 distinguishable from the haptic feedback 611 and 615 to inform the user that more actions are available. As shown in FIG. 6P, the device maintains the display of the preview area 612 even after the user lifts off the contact 618 because the selectable action options 624, 626, and 628 have appeared.
[0257] FIGS. 6Q-6W illustrate an embodiment in which a user previews the content of an email and then deletes the email with a single gesture. In FIG. 6R, the device 100 detects a contact 630 on a partial view of the email message 602 that has an intensity below the intensity threshold (e.g., IT L ) required to invoke a preview of the email, which is displayed within the email inbox user interface 600. In FIG. 6R, the device detects that the intensity of the contact 630 increases to the preview area invocation threshold (e.g., IT LIn response to detecting that it has exceeded [[ID=]], the preview area 612 is displayed. In FIG. 6S, the user begins to move the contact 630 to the left on the touch screen 112 (via the movement 632). In response thereto, in FIGS. 6T to 6U, the preview area 612 moves due to the contact, and gradually reveals the action icon 634 from below the preview area. When the user continues to move the preview area 612 to the left, as shown in FIG. 6V, the color of the action icon 634 changes, and when the contact ends, the user is notified that the associated action (for example, deleting an email from the inbox) is active for execution. As shown in FIG. 6W, if the user lifts the contact 630 from the touch screen 112 while the action associated with the action icon 634 is active, the device ends the display of the preview area 612 and deletes the associated email. The device also updates the display of the email inbox by deleting the partial display of the associated email and moving the partial views of other emails upward within the user interface 600, and reveals the next partial view of the email 636.
[0258] FIGS. 6X to 6AC show an embodiment in which the user starts to delete an email while in the preview mode, but does not reach the position threshold required to activate the delete action. In FIG. 6X, the device 100 detects a contact 638 having an intensity below the intensity threshold (for example, IT L ) required to call up a preview of the email on the partial view of the email message 602, which is displayed within the email inbox user interface 600. In FIG. 6Y, the device increases the intensity of the contact 638 to the preview area call threshold (for example, IT LIn response to detecting that it has exceeded D ), the user attempts to navigate to the full - text displayed email by exceeding the navigation threshold (e.g., IT
[0259] However, since the user has partially revealed the associated action (e.g., action icon 634), the device locks out the navigation command. (As shown by the action icon 634 not changing color in FIG. 6AB, ) Since the user did not swipe the preview area 612 far enough to the left, the device then, in FIG. 6AC, restores the display of the email inbox user interface 600 to the state before the detection of contact 634 as if it were lifted off. L ), a contact 642 having an intensity below the intensity threshold (e.g., IT L ) required to call up a preview of the email is detected on a partial view of the email message 602 within the email inbox user interface 600. In FIG. 6AE, the device displays the preview area 612 in response to detecting that the intensity of the contact 642 has increased and exceeded the preview area call - up threshold (e.g., IT D) shows how the user reduces the intensity of contact 642 before reaching it. In response, the device dynamically resets the size of the preview area 612. In FIG. 6AH, the user lifts off contact 642. Since the intensity of contact 642 did not reach the intensity threshold (e.g., IT D ) required to navigate to the full-text version of the email, the device returns the display of the user interface 600 to the same state as before contact 642 was detected.
[0260] FIGS. 6AI to 6AM showing the preview area display threshold where the user previews the full-text email and then navigates to the full-text email twice. In FIG. 6AI, the device 100 detects a contact 644 having an intensity below the intensity threshold (e.g., IT L ) required to call up a preview of the email displayed within the email inbox user interface 600 on a partial view of the email message 602. In FIG. 6AJ, the intensity of contact 644 increases and exceeds the "hint" threshold (e.g., IT H ), but still remains below the intensity threshold (e.g., IT L ) required to call up the preview area of the email. The device blurs other partial views of the email and begins to move deeper within the virtual z-space to notify the user that they are approaching the intensity required to call up the preview area. In FIG. 6AE, the device displays the preview area 612 in response to detecting that the intensity of contact 644 has increased and exceeded the preview area display threshold (e.g., IT L ). In FIG. 6AL, as shown by the dynamic reversal of the blurring of the partial view of the email message displayed behind the preview area 612, the user reduces the intensity of contact 644 below the preview area display threshold. However, since the user has not ended contact 644, the device maintains the display of the preview area 612. The user then increases the intensity of contact 644 between FIGS. 6AL and 6AM to the preview area display threshold (e.g., IT Lexceeds it again. In response, the device navigates to the user interface 614 and displays the full - text electronic mail associated with the partial view 602 and the preview area 612, as shown in FIG. 6AM.
[0261] FIGS. 6AN - 6AS show an embodiment in which the user flags an electronic mail with a single gesture by sliding the preview area in the opposite direction instead of deleting the electronic mail. In FIG. 6AN, the device 100 detects a contact 646 having an intensity below the intensity threshold (e.g., IT L ) required to invoke a preview of the electronic mail, on the partial view of the electronic mail message 602. In FIG. 6AO, in response to detecting that the intensity of the contact 646 has increased and exceeded the preview area invocation threshold (e.g., IT L ), the device displays the preview area 612. In FIG. 6AP, the user begins to move the contact 646 to the right (via movement 648) on the touch screen 112. In response, in FIGS. 6AQ - 6AR, the preview area 612 moves with the contact, gradually revealing the action icon 650 from below the preview area. In FIG. 6AR, the color of the action icon 650 changes to notify that the associated action (e.g., flagging the electronic mail) is active for execution when the contact ends. Compared to the quick deletion of the action shown in FIGS. 6Q - 6W, in FIG. 6AR, the user does not need to move the preview area 612 far to invoke the flagging of the action. As shown in FIG. 6AS, when the user lifts the contact 646 from the touch screen 112 while the action associated with the action icon 650 is active, the device ends the display of the preview area 612 and flags the partial view of the electronic mail message 602 through a change in the appearance of the indicator icon 652.
[0262] Figures 7A - 7AQ illustrate exemplary embodiments of a user interface that enables a user to quickly invoke one of several actions associated with a second application while navigating within a first application, without the need to first activate the second application. According to some embodiments, the exemplary user interfaces shown in Figures 7A - 7AQ also enable a user to efficiently navigate between a first and a second user interface. In some embodiments, the exemplary user interface detects user input that is distinguishable from conventional user input used for switching between applications (e.g., based on the magnitude of force applied by the user), and provides the user with a menu that includes quick action items (e.g., a "quick action menu") associated with another user interface (e.g., another application). Similarly, in some embodiments, the exemplary user interface detects user input that is distinguishable from conventional user input used for navigating between user interfaces (e.g., based on the magnitude of force applied by the user), and enables the user to preview the content of a second user interface without leaving the first user interface. In some embodiments, these exemplary user interfaces provide feedback (e.g., visual, auditory, and / or tactile feedback) when the user is about to invoke the quick action menu (e.g., when the user input approaches an intensity threshold). Although some of the following examples are presented with reference to an email messaging application, in some embodiments, these methods are implemented within any number of different applications, as described herein.
[0263] The user interfaces in these figures are used for the purpose of illustrating the following process. Some of the following examples are presented with reference to input on a touch screen display (when the touch sensing surface and the display are combined), but in some embodiments, the device detects input on a touch sensing surface 451 that is separate from the display 450, as shown in FIG. 4B.
[0264] FIGS. 7A-7R and FIGS. 7U-7AP illustrate an exemplary user interface 700 for referencing an email message that includes user interface objects associated with a second application. For example, the contact icon 702 is associated with contact information within a contact management application that is activated (e.g., launched) on the electronic device 100 when an application launch input (e.g., a tap gesture having a maximum intensity below a threshold for calling a quick action menu) is detected. The contact icon 702 is also associated with a quick action menu that includes options for performing actions associated with the contact management program when a quick action display input (e.g., a force press gesture having a maximum intensity above a threshold for calling a quick action menu) is detected. Similarly, the date and time 704 is associated with a calendar application that is activated (e.g., launched) on the electronic device 100 when an application launch input (e.g., a tap gesture having a maximum intensity below a threshold for calling a preview of content associated with the calendar application) is detected. The date and time 704 is also associated with potential new events within the calendar application that include additional content that becomes available when a preview area display input (e.g., a force press gesture having a maximum intensity above a threshold for calling a preview area) is detected.
[0265] Figures 7A - 7O illustrate an embodiment in which a user invokes a preview of a calendar event associated with a date in an email and then, based on a detected touch within the email, invokes a quick action menu of actions associated with a contact management application. Figure 7A shows an email message viewing user interface 700 displaying a contact icon 702 and a date and time 704. In Figure 7B, the device detects a touch 706 having an intensity below a strength threshold (e.g., IT L ) required to invoke a preview area of an associated event within the calendar application on the date and time 704. In Figure 7C, the intensity of the touch 706 increases and exceeds a "hint" threshold (e.g., IT H ) but still remains below a strength threshold (e.g., IT L ) required to invoke the preview area of the event. The device begins to blur other objects within the user interface 700, including the contact icon 702, and increases the size of the date and time 704 (e.g., providing the appearance to the user that the date and time are moving forward relative to other user interface objects in virtual z - space) to notify the user that the intensity is approaching the strength required to invoke the preview area. As shown in Figure 7D, the blurring and forward movement in virtual z - space dynamically react to an increase in the intensity of the touch 706 that is below a preview area invocation threshold (e.g., IT L ).
[0266] In Figure 7E, the intensity of the touch 706 increases and exceeds a threshold (e.g., IT L) exceeds. In response, the device displays a preview area 707 over a portion of the email message within the user interface 700. The preview area displays a view of a calendar user interface for creating a new event based on date and time information within the email. The device also provides haptic feedback 705 to inform the user that the preview area has been activated. In FIG. 7F, the device maintains the display of the preview area 707 even if the user decreases the intensity of the contact 706 before reaching the intensity threshold (e.g., IT D ) required to navigate to the calendar user interface for creating a new event. In FIG. 7G, the user lifts the contact 706 from the touch screen 112 without reaching the intensity threshold (e.g., IT D ) required to navigate to the calendar user interface. Since the preview area did not include one or more selectable action options, the device stops displaying the preview area 707 and returns the display of the user interface 700 to the same state as before the contact 706 was detected.
[0267] In FIG. 7H, the device detects a contact 708 having an intensity below the intensity threshold (e.g., IT L ) required to invoke the quick action menu on the contact icon 702. In FIG. 7I, the intensity of the contact 708 increases and exceeds a "hint" threshold (e.g., IT H ) but still remains below the intensity threshold required to invoke the quick action menu. The device begins to blur other objects within the user interface 700, including the date and time 704, and increases the size of the contact icon 702 (e.g., provides the user with the appearance that the contact icon is moving forward relative to other user interface objects in virtual z-space) to notify the user that the intensity required to invoke the quick action menu is being approached. As shown in FIG. 7J, the blurring and the forward movement in virtual z-space are the quick action menu threshold (e.g., ITL dynamically reacts to an increase in the intensity of contact 708 below
[0268] In FIG. 7K, the intensity of contact 708 increases and exceeds the threshold value (e.g., IT L ) required to call the quick action menu. Accordingly, the contact icon 702 changes to a quick action menu 710 that displays options for navigating to the contact information of Harold Geoffrey within the contact management application 712, calls Harold using the phone information associated with the contact management application 714, sends a message to Harold using the contact information associated with the contact management application 716, and sends an email message to Harold using the email address information associated with the contact management application. The device also provides haptic feedback 711 distinguishable from the haptic feedback 705 to inform the user that the quick action menu has become functional. Since the quick action menu 710 includes selectable options for performing actions, the device maintains the display of the menu even if the user reduces the intensity of contact 708 in FIG. 7L and then lifts the contact off the touch screen 112 in FIG. 7M. The user can then clear the quick action menu by tapping (via contact 720) at a location on the touch screen other than where the quick action menu 710 is displayed.
[0269] FIGS. 7P - 7T illustrate one embodiment in which a user previews the content of a new event and then navigates in a single gesture to the associated user interface within the calendar application. The device 100 detects a contact 722 having an intensity below the intensity threshold value (e.g., IT L ) required to call a preview of the new event on the date and time 704 within the email viewing user interface 700. In FIG. 7Q, the intensity of contact 722 increases and exceeds the "hint" threshold value (e.g., IT H) is exceeded, but still below the intensity threshold (e.g., IT L ) required to call up the email preview area. The device begins to blur other objects within the user interface 700, including the contact icon 702, and increases the size of the date and time 704 to notify the user that they are approaching the intensity required to call up the preview area. In FIG. 7R, in response to detecting that the intensity of contact 722 has increased and exceeded the preview area call threshold (e.g., IT L ), the device displays the preview area 704. The user continues to increase the intensity of contact 722 between FIGS. 7R and 7S to exceed a third threshold (e.g., IT D ). In response, the device navigates to the user interface 724 within the calendar application as shown in FIG. 7S and displays a form for creating an event based on the content of the email being viewed within the user interface 700. Since the device navigates out of the messaging application, when the contact 722 is lifted off as shown in FIG. 7T, the display of the new event user interface 724 within the calendar application is maintained.
[0270] In contrast, FIGS. 7U - 7Y show an embodiment where the same input that was navigated to the calendar application in FIGS. 7P - 7T is executed on the contact icon (e.g., a user interface object associated with the quick action menu) without leaving the email message application. In FIG. 7U, the device 100 detects a contact 726 on the contact icon 702 having an intensity below the intensity threshold (e.g., IT L ) required to call up the quick action menu. In FIG. 7V, the intensity of contact 708 increases to the "hint" threshold (e.g., IT H) is above, but still below the intensity threshold required to invoke the quick action menu. The device begins to blur other objects within the user interface 700, including the date and time 704, and increases the size of the contact icon 702 to notify the user that they are approaching the intensity required to invoke the quick action menu. In FIG. 7W, the device detects that the intensity of the contact 726 has increased and exceeded the quick action menu threshold (e.g., IT L ) and in response, displays the quick action menu 710. The user continues to increase the intensity of the contact 726 between FIGS. 7W and 7X to exceed a third threshold (e.g., IT D ). However, unlike the date and time 704, the image icon 702 is not associated with a navigation operation even when the intensity exceeding the third threshold is detected. Therefore, the device 100 only maintains the display of the quick action menu 710 after detecting the increased intensity of the contact 726 in FIG. 7X and the lift-off in FIG. 7Y.
[0271] FIGS. 7Z - 7AE illustrate an embodiment in which a user previews a potential new event within a calendar event and then creates the calendar event with a single gesture without leaving the email messaging application. In FIG. 7Z, the device 100 detects a contact 728 having an intensity below the intensity threshold (e.g., IT L ) required to invoke a preview of the potential new event on the date and time 704. In FIG. 7AA, the device detects that the intensity of the contact 728 has increased and exceeded the preview area invocation threshold (e.g., IT LIn response to detecting that it has exceeded , the preview area 707 is displayed. The device also displays the caret 729 and notifies that one or more actions associated with the preview area can be specified by swiping right on the touch screen 112. In FIG. 7AB, the user begins to move the contact 728 to the right (via movement 730) on the touch screen 112. In response, in FIGS. 7AC-7AD, the preview area 707 moves with the contact, gradually revealing the action icon 732 from below the preview area. As shown in FIG. 7AC, navigation to the calendar application by further increasing the intensity of the contact 728 (e.g., as shown in FIGS. 7R-7S) is disabled by the movement of the contact. If the user continues to move the preview area 707 to the right, as shown in FIG. 7AD, the color of the action icon 732 changes and, when the contact ends, notifies the user that the associated action (e.g., creating a calendar event based on information provided in an email displayed in the user interface 700) is active for execution. As shown in FIG. 7AE, if the user lifts the contact 732 from the touch screen 112 while the action associated with the action icon 732 is active, the device ends the display of the preview area 707 and creates a new event (not shown).
[0272] In contrast, FIGS. 7AF-7AJ show an embodiment in which the same swipe input that created a calendar event in FIGS. 7Z-7AE is non-active even when executed on a contact icon (e.g., a user interface object associated with a quick action menu). In FIG. 7AF, the device 100 detects a contact 732 having an intensity below the intensity threshold (e.g., IT L ) required to call the quick action menu on the contact icon 702. In FIG....
Claims
1. In an electronic device having a touch sensing surface and a display, the device includes one or more sensors for detecting the intensity of contact with the touch sensing surface, displaying a plurality of user interface objects within a first user interface on the display, detecting contact at a position on the touch sensing surface while a focus selector is at a position of a first user interface object among the plurality of user interface objects on the display, while the focus selector is at the position of the first user interface object on the display, detecting an increase in the characteristic intensity of the contact that reaches a first intensity threshold, in response to detecting the increase in the characteristic intensity of the contact that reaches the first intensity threshold, visually obscuring the plurality of user interface objects other than the first user interface object within the first user interface while maintaining the display of the first user interface object without visually obscuring the first user interface object, detecting that the characteristic intensity of the contact continues to increase above the first intensity threshold, in response to detecting that the characteristic intensity of the contact continues to increase above the first intensity threshold, dynamically increasing the amount of visual obscuration of the plurality of user interface objects other than the first user interface object within the first user interface while maintaining the display of the first user interface object without visually obscuring the first user interface object, A method comprising.
2. The method according to claim 1, comprising reducing the size of the plurality of user interface objects other than the first user interface object within the first user interface in response to detecting the increase in the characteristic intensity of the contact that reaches the first intensity threshold.
3. In response to detecting that the characteristic strength of the contact continues to increase above the first strength threshold, dynamically reducing the size of the plurality of user interface objects other than the first user interface object within the first user interface, the method according to claim 1 or 2.
4. Increasing the size of the first user interface object within the first user interface when the characteristic strength of the contact matches and / or exceeds the first strength threshold, the method according to any one of claims 1 to 3.
5. After dynamically increasing the amount of visual obfuscation of the plurality of user interface objects other than the first user interface object within the first user interface while maintaining the display of the first user interface object without visually obscuring the first user interface object, and before detecting an increase reaching a second strength threshold of the characteristic strength of the contact, detecting a decrease in the characteristic strength of the contact; In response to detecting the decrease in the characteristic strength of the contact, dynamically decreasing the amount of visual obfuscation of the plurality of user interface objects other than the first user interface object within the first user interface while maintaining the display of the first user interface object without visually obscuring the first user interface object; The method according to any one of claims 1 to 4, comprising:
6. In response to detecting an increase in the characteristic strength of the contact reaching a second strength threshold greater than the first strength threshold, displaying a preview area superimposed on at least some of the plurality of user interface objects within the first user interface, the method according to any one of claims 1 to 5.
7. The method according to claim 6, wherein the preview area displays a preview of the user interface, which is displayed in response to detecting a tap gesture on the first user interface object.
8. While displaying a preview area over at least some of the plurality of user interface objects within the first user interface, detecting a decrease in the characteristic strength of the contact; In response to detecting the decrease in the characteristic strength of the contact, maintaining the display of the preview area over at least some of the plurality of user interface objects within the first user interface until lift-off of the contact is detected; Detecting lift-off of the contact; In response to detecting lift-off of the contact, stopping the display of the preview area and stopping the visual obscuring of the plurality of user interface objects; The method according to claim 6 or 7, comprising:
9. In response to detecting an increase in the characteristic strength of the contact that reaches a third strength threshold greater than the second strength threshold, replacing the display of the first user interface and the overlaid preview area with the display of a second user interface separate from the first user interface. The method according to any one of claims 6 to 8, comprising:
10. In response to detecting an increase in the characteristic strength of the contact that reaches a second strength threshold greater than the first strength threshold, displaying a menu over at least some of the plurality of user interface objects within the first user interface, the menu including activatable menu items associated with the first user interface objects. The method according to any one of claims 1 to 5, comprising:
11. Visually obscuring the plurality of user interface objects includes blurring the plurality of user interface objects by a blurring effect having a blur radius; Dynamically increasing the amount of visual obscuring of the plurality of user interface objects includes increasing the blur radius of the blurring effect according to a change in the characteristic strength of the contact. The method according to any one of claims 1 to 10, comprising:
12. An electronic device, comprising: A display; A touch sensing surface; One or more sensors for detecting the strength of contact with the touch sensing surface; One or more processors; A memory; Comprising one or more programs, the one or more programs being stored in the memory and configured to be executed by the one or more processors, the one or more programs being Display a plurality of user interface objects within a first user interface on the display, While a focus selector is at a position of a first user interface object among the plurality of user interface objects on the display, detect a contact at a position on the touch sensing surface, While the focus selector is at the position of the first user interface object on the display, Detect an increase in the characteristic strength of the contact that reaches a first intensity threshold, In response to detecting the increase in the characteristic strength of the contact that reaches the first intensity threshold, visually obscure the plurality of user interface objects other than the first user interface object within the first user interface while maintaining the display of the first user interface object without visually obscuring the first user interface object, Detect that the characteristic strength of the contact continues to increase beyond the first intensity threshold, In response to detecting that the characteristic strength of the contact continues to increase beyond the first intensity threshold, dynamically increase the amount of visual obscuration of the plurality of user interface objects other than the first user interface object within the first user interface while maintaining the display of the first user interface object without visually obscuring the first user interface object, An electronic device including instructions for.
13. A computer-readable storage medium storing one or more programs, the one or more programs, when executed by an electronic device comprising a display, a touch sensing surface, and one or more sensors for detecting the intensity of contact with the touch sensing surface, cause the device to Display a plurality of user interface objects within a first user interface on the display, While the focus selector is at the position of the first user interface object among the plurality of user interface objects on the display, detect contact at a position on the touch sensing surface, While the focus selector is at the position of the first user interface object on the display, Detect an increase in the characteristic intensity of the contact that reaches a first intensity threshold, In response to detecting the increase in the characteristic intensity of the contact that reaches the first intensity threshold, while maintaining the display of the first user interface object without visually obscuring the first user interface object, visually obscure the plurality of user interface objects other than the first user interface object within the first user interface, Detect that the characteristic intensity of the contact continues to increase above the first intensity threshold, In response to detecting that the characteristic intensity of the contact continues to increase above the first intensity threshold, while maintaining the display of the first user interface object without visually obscuring the first user interface object, dynamically increase the amount of visual obscuration of the plurality of user interface objects other than the first user interface object within the first user interface, A computer-readable storage medium including instructions.
14. An electronic device, A display, A touch sensing surface, One or more sensors for detecting the intensity of contact with the touch sensing surface, Means for displaying a plurality of user interface objects within a first user interface on the display, Means for detecting contact at a position on the touch sensing surface while the focus selector is at the position of the first user interface object among the plurality of user interface objects on the display, While the focus selector is at the position of the first user interface object on the display, Means for detecting an increase in the characteristic intensity of the contact that reaches a first intensity threshold, Means for visually obscuring a plurality of user interface objects other than the first user interface object within the first user interface while maintaining the display of the first user interface object without visually obscuring the first user interface object, in response to detecting an increase in the characteristic strength of the contact before reaching the first strength threshold; Means for detecting that the characteristic strength of the contact continues to increase above the first strength threshold; Means for dynamically increasing the amount of visual obscurity of a plurality of user interface objects other than the first user interface object within the first user interface while maintaining the display of the first user interface object without visually obscuring the first user interface object, in response to detecting that the characteristic strength of the contact continues to increase above the first strength threshold; An electronic device comprising the above.
15. An electronic device, A display, A touch sensing surface, One or more sensors for detecting the intensity of contact with the touch sensing surface, One or more processors, A memory, One or more programs, and the one or more programs are stored in the memory and configured to be executed by the one or more processors, and the one or more programs include instructions for executing any of the methods according to claims 1 to 11. An electronic device.
16. A computer-readable storage medium storing one or more programs, wherein when the one or more programs are executed by an electronic device comprising a display, a touch sensing surface, and one or more sensors for detecting the intensity of contact with the touch sensing surface, the device is caused to execute any of the methods according to claims 1 to 11. A computer-readable storage medium containing instructions.
17. A graphical user interface on an electronic device comprising a display, a touch sensing surface, one or more sensors for detecting the intensity of contact with the touch sensing surface, a memory, and one or more processors for executing one or more programs stored in the memory, the graphical user interface comprising a user interface displayed according to any of the methods recited in claims 1 to 11.
18. An electronic device, comprising a display, a touch sensing surface, one or more sensors for detecting the intensity of contact with the touch sensing surface, and means for executing any of the methods recited in claims 1 to 11.
19. An electronic device, comprising a display unit configured to display a user interface object, a touch sensing surface unit configured to receive contact, one or more sensor units configured to detect the intensity of contact with the touch sensing surface unit, and a processing unit coupled to the display unit, the touch sensing surface unit, and the one or more sensor units, the processing unit enabling the display of a plurality of user interface objects within a first user interface on the display unit, detecting contact at a position on the touch sensing surface unit while a focus selector is at a position of a first user interface object within the plurality of user interface objects on the display unit, while the focus selector is at the position of the first user interface object on the display unit, detecting an increase in the characteristic intensity of the contact that reaches a first intensity threshold, in response to detecting the increase in the characteristic intensity of the contact that reaches the first intensity threshold, visually obscuring the plurality of user interface objects other than the first user interface object within the first user interface while maintaining the display of the first user interface object without visually obscuring the first user interface object, detecting that the characteristic intensity of the contact continues to increase above the first intensity threshold, In response to detecting that the characteristic intensity of the contact continues to increase above the first intensity threshold, while maintaining the display of the first user interface object without visually obscuring the first user interface object, the amount of visual obscuring of the plurality of user interface objects other than the first user interface object within the first user interface is dynamically increased. An electronic device configured as described above. **Claim 20** The processing unit is configured to reduce the size of the plurality of user interface objects other than the first user interface object within the first user interface in response to detecting the increase in the characteristic intensity of the contact reaching the first intensity threshold, the electronic device according to claim 19. **Claim 21** The processing unit is configured to dynamically reduce the size of the plurality of user interface objects other than the first user interface object within the first user interface in response to detecting that the characteristic intensity of the contact continues to increase above the first intensity threshold, the electronic device according to claim 19 or 20. **Claim 22** The processing unit is configured to increase the size of the first user interface object within the first user interface when the characteristic intensity of the contact is equal to and / or greater than the first intensity threshold, the electronic device according to any one of claims 19 to 21. **Claim 23** The processing unit is after dynamically increasing the amount of visual obscuring of the plurality of user interface objects other than the first user interface object within the first user interface while maintaining the display of the first user interface object without visually obscuring the first user interface object, and before detecting an increase in the characteristic intensity of the contact reaching a second intensity threshold, detecting a decrease in the characteristic intensity of the contact. In response to detecting the decrease in the characteristic intensity of the contact, while maintaining the display of the first user interface object without visually obscuring the first user interface object, dynamically reducing the amount of visual obscuring of the plurality of user interface objects other than the first user interface object within the first user interface. An electronic device according to any one of claims 19 to 22, configured as such. **Claim 24** The processing unit is An electronic device according to any one of claims 19 to 23, configured to enable the display of a preview area superimposed on at least some of the plurality of user interface objects within the first user interface in response to detecting an increase in the characteristic intensity of the contact that reaches a second intensity threshold greater than the first intensity threshold. **Claim 25** The electronic device according to claim 24, wherein the preview area displays a preview of the user interface, which is displayed in response to detecting a tap gesture on the first user interface object. **Claim 26** The processing unit is During the display of a preview area superimposed on at least some of the plurality of user interface objects within the first user interface, detecting a decrease in the characteristic intensity of the contact, In response to detecting the decrease in the characteristic intensity of the contact, maintaining the display of the preview area superimposed on at least some of the plurality of user interface objects within the first user interface until the lift-off of the contact is detected, Detecting the lift-off of the contact, In response to detecting the lift-off of the contact, stopping the display of the preview area and stopping the visual obscuring of the plurality of user interface objects. An electronic device according to any one of claims 19 to 25, configured as such. **Claim 27** The processing unit is In response to detecting an increase in the characteristic strength of the contact that reaches a third strength threshold greater than the second strength threshold, the display of the first user interface and the superimposed preview area is configured to be replaced with the display of a second user interface that is separate from the first user interface. The electronic device according to any one of claims 24 to 26.
28. The processing unit In response to detecting an increase in the characteristic strength of the contact that reaches a second strength threshold greater than the first strength threshold, it is configured to enable the display of a menu superimposed on at least some of the plurality of user interface objects within the first user interface. The menu includes activatable menu items associated with the first user interface objects. The electronic device according to any one of claims 19 to 23.
29. Visually obscuring the plurality of user interface objects includes blurring the plurality of user interface objects by a blurring effect having a blurring radius, Dynamically increasing the amount of visual obscuring of the plurality of user interface objects includes increasing the blurring radius of the blurring effect according to a change in the characteristic strength of the contact. The electronic device according to any one of claims 19 to 28.
30. In an electronic device comprising a touch sensing surface and a display, the device includes one or more sensors for detecting the strength of contact with the touch sensing surface, Displaying a plurality of user interface objects within a first user interface on the display, The focus selector detecting an input by contact while on a first user interface object among the plurality of user interface objects on the display, In response to detecting the input, according to a determination that the input meets a selection criterion, displaying a second user interface separate from the first user interface In accordance with the determination that the first portion of the input meets a preview criterion, in response to detecting the first portion of the input, a preview area including a reduced representation of the second user interface is displayed over at least some of the plurality of user interface objects within the first user interface; In accordance with the determination that a second portion of the input by the contact, detected after the first portion of the input, meets a user interface replacement criterion, the display of the first user interface and the overlaid preview area is replaced with the display of the second user interface; In accordance with the determination that the second portion of the input by the contact meets a preview area disappearance criterion, after the input ends, the display of the preview area is stopped and the first user interface is displayed; A method comprising the above.
31. The method according to claim 30, wherein the determination that the first portion of the input meets a preview criterion includes detecting an increase in the characteristic strength of the contact reaching a second intensity threshold while the focus selector is on the first user interface object within the plurality of user interface objects on the display.
32. The method according to claim 30 or 31, comprising maintaining the display of the preview area overlaid on at least some of the plurality of user interface objects within the first user interface after the input ends, in accordance with the determination that the second portion of the input by the contact meets a preview area maintenance criterion.
33. The method according to any one of claims 30 to 32, comprising visually obscuring the plurality of user interface objects other than the first user interface object within the first user interface, in accordance with the determination that the first portion of the input meets a hint criterion before meeting the preview criterion.
34. In response to detecting the first portion of the input, displaying the preview area over at least some of the plurality of user interface objects within the first user interface, including displaying an animation in which the plurality of user interface objects other than the first user interface object within the first user interface are further obscured, the method according to claim 33.
35. Determining that the first portion of the input meets the hint criterion includes detecting an increase that reaches a first intensity threshold of the characteristic intensity of the contact while the focus selector is on the first user interface object among the plurality of user interface objects on the display, the method according to claim 33 or 34.
36. Between detecting the first portion of the input and displaying the preview area, detecting the characteristic intensity of the contact that changes over time; dynamically changing the size of the preview area according to the change in the characteristic intensity of the contact in response to detecting the characteristic intensity of the contact that changes over time; The method according to any one of claims 30 to 34, including.
37. The user interface replacement criterion includes the requirement that the characteristic intensity of the contact increases to a third intensity threshold greater than the second intensity threshold during the second portion of the input, the method according to any one of claims 30 to 36.
38. The user interface replacement criterion includes the requirement that the characteristic intensity of the contact decreases below the second intensity threshold and then increases again to at least the second intensity threshold during the second portion of the input, the method according to any one of claims 30 to 37.
39. The user interface replacement criterion includes the requirement that the characteristic intensity of the contact increases at a predetermined speed or a speed higher than that during the second portion of the input, the method according to any one of claims 30 to 38.
40. The user interface replacement criterion includes the requirement that the increase in the characteristic intensity of the contact during the second portion of the input is not accompanied by movement of the contact, the method according to any one of claims 30 to 39.
41. The method according to claim 32, wherein the preview area maintenance criterion includes the requirement that the second portion of the input includes movement of the contact across the touch sensing surface that moves the focus selector in a predetermined direction on the display.
42. The method according to claim 32, wherein the preview area maintenance criterion includes the requirement that an action icon is displayed within the preview area between the second portions of the input.
43. The method according to any one of claims 30 to 42, wherein the preview area disappearance criterion includes the requirement that an action icon is not displayed within the preview area between the second portions of the input.
44. The method according to any one of claims 30 to 43, wherein the preview area disappearance criterion includes the requirement that the user interface replacement criterion is not satisfied and the preview area maintenance criterion is not satisfied.
45. The method according to any one of claims 30 to 44, comprising moving the preview area according to the movement of the contact according to a determination that the second portion of the input by the contact includes movement of the contact across the touch sensing surface.
46. According to a determination that the second portion of the input by the contact includes movement of the contact across the touch sensing surface, moving the focus selector according to the movement of the contact, displaying one or more action items associated with the first user interface object, The method according to any one of claims 30 to 45, comprising.
47. The method according to any one of claims 30 to 46, comprising providing a haptic output indicating display of one or more action items in addition to displaying the preview area according to a determination that the first portion of the input satisfies a preview criterion.
48. Including providing a haptic output indicating the display of the one or more action items, wherein the haptic output indicating the display of the one or more action items is different from the first haptic output indicating the display of the preview area, and the haptic output indicating the display of the one or more action items is provided in conjunction with displaying the one or more action items associated with the first user interface object. The method according to claim 46.
49. Including providing a haptic output indicating replacement of the first user interface according to a determination that the second portion of the input by the contact, detected after the first portion of the input, meets a user interface replacement criterion, the haptic output being provided in conjunction with replacing the display of the first user interface and the superimposed preview area with the display of the second user interface. The method according to any one of claims 30 to 46.
50. While the preview area is displayed on the display and the one or more action items are not displayed, Including displaying an indicator indicating that the one or more action items associated with the first user interface object are hidden. The method according to any one of claims 46 to 48.
51. The method according to claim 50, wherein the indicator is configured to represent a direction of movement of a focus selector that triggers the display of the one or more action items associated with the first user interface object.
52. The movement of the contact across the touch-sensitive surface causes the movement of the focus selector on the display in a first direction, Displaying the one or more action items associated with the first user interface object, Shifting the preview area in the first direction on the display, Showing the one or more action items as the preview area is shifted in the first direction, The method according to any one of claims 46 to 51, including.
53. After showing the one or more action items, The method according to claim 52, comprising continuing to shift the preview area in the first direction on the display in accordance with the movement of the contact before the contact.
54. Displaying the one or more action items associated with the first user interface object includes displaying a first action item associated with the first user interface object, and the method During the display of the first action item associated with the first user interface object, detecting that the movement of the contact causes the focus selector to move on the display by at least a first threshold amount before detecting a lift-off of the contact; Changing a visual appearance of the first action item in response to detecting that the movement of the contact causes the focus selector to move on the display by at least the first threshold amount; After the change in the visual appearance of the first action item, detecting a lift-off of the contact; In response to detecting the lift-off of the contact, Stopping the display of the first action item, Performing a first action represented by the first action item; The method according to claim 52 or 53, comprising.
55. Performing an operation associated with the movement in each direction in response to detecting the end of the input according to a determination that the second portion of the input by the contact includes movement of the contact across the touch-sensitive surface that moves the focus selector in each direction and satisfies each movement threshold; Ceasing to perform the operation associated with the movement in each direction in response to detecting the end of the input according to a determination that the second portion of the input by the contact includes movement of the contact across the touch-sensitive surface that moves the focus selector in each direction and does not satisfy each movement threshold; The method according to any one of claims 30 to 54, comprising.
56. The method according to claim 55, wherein movement of the focus selector in a first direction is associated with a first action and movement of the focus selector in a second direction is associated with a second action.
57. The method according to claim 56, wherein the movement of the focus selector in the first direction is associated with a first threshold, and the movement of the focus selector in the second direction is associated with a second threshold higher than the first threshold.
58. An electronic device, comprising: a display; a touch sensing surface; one or more sensors for detecting the intensity of contact with the touch sensing surface; one or more processors; a memory; one or more programs, wherein the one or more programs are stored in the memory and configured to be executed by the one or more processors, and the one or more programs are to display a plurality of user interface objects in a first user interface on the display; while a focus selector is on a first user interface object among the plurality of user interface objects on the display, to detect an input by contact; in accordance with a determination that the input meets a selection criterion, in response to detecting the input, to display a second user interface separate from the first user interface; in accordance with a determination that a first portion of the input meets a preview criterion, in response to detecting the first portion of the input, to display a preview area including a reduced representation of the second user interface over at least some of the plurality of user interface objects in the first user interface; in accordance with a determination that a second portion of the input by contact, detected after the first portion of the input, meets a user interface replacement criterion, to replace the display of the first user interface and the superimposed preview area with the display of the second user interface; in accordance with a determination that the second portion of the input by contact meets a preview area disappearance criterion, after the input ends, to stop displaying the preview area and display the first user interface. An electronic device comprising instructions for the above.
59. A computer-readable storage medium storing one or more programs, wherein when the one or more programs are executed by an electronic device comprising a display, a touch sensing surface, and one or more sensors for detecting the intensity of contact with the touch sensing surface, the device is caused to Cause a plurality of user interface objects within a first user interface to be displayed on the display. Cause an input by contact to be detected while a focus selector is on a first user interface object among the plurality of user interface objects on the display. Cause a second user interface separate from the first user interface to be displayed in response to detecting the input, according to a determination that the input meets a selection criterion. Cause a preview area including a reduced representation of the second user interface to be displayed over at least some of the plurality of user interface objects within the first user interface in response to detecting a first portion of the input, according to a determination that the first portion of the input meets a preview criterion. Cause the display of the first user interface and the overlaid preview area to be replaced with the display of the second user interface, according to a determination that a second portion of the input by contact, detected after the first portion of the input, meets a user interface replacement criterion. Cause the display of the preview area to be stopped and the first user interface to be displayed after the input ends, according to a determination that the second portion of the input by contact meets a preview area disappearance criterion. A computer-readable storage medium including instructions. [
60. ] An electronic device, comprising: A display; A touch-sensing surface; One or more sensors for detecting the intensity of contact with the touch-sensing surface; Means for causing a plurality of user interface objects within a first user interface to be displayed on the display; Means for causing an input by contact to be detected while a focus selector is on a first user interface object among the plurality of user interface objects on the display; Means for causing a second user interface separate from the first user interface to be displayed in response to detecting the input, according to a determination that the input meets a selection criterion. Means for displaying a preview area including a reduced representation of the second user interface by superimposing it on at least some of the plurality of user interface objects within the first user interface in response to detecting the first part of the input, according to a determination that the first part of the input meets a preview criterion. Means for replacing the display of the first user interface and the superimposed preview area with the display of the second user interface according to a determination that the second part of the input by the contact, detected after the first part of the input, meets a user interface replacement criterion. Means for stopping the display of the preview area and displaying the first user interface after the input ends, according to a determination that the second part of the input by the contact meets a preview area disappearance criterion. An electronic device comprising the above.
61. An electronic device, A display, A touch sensing surface, One or more sensors for detecting the intensity of contact with the touch sensing surface, One or more processors, A memory, One or more programs, and the one or more programs are stored in the memory and configured to be executed by the one or more processors, and the one or more programs include instructions for executing any of the methods according to claims 30 to 57. An electronic device.
62. A computer-readable storage medium storing one or more programs, wherein when the one or more programs are executed by an electronic device comprising a display, a touch sensing surface, and one or more sensors for detecting the intensity of contact with the touch sensing surface, the device is caused to execute any of the methods according to claims 30 to 57. A computer-readable storage medium including instructions.
63. A graphical user interface on an electronic device comprising a display, a touch sensing surface, one or more sensors for detecting the intensity of contact with the touch sensing surface, a memory, and one or more processors for executing one or more programs stored in the memory, the graphical user interface comprising a user interface displayed according to any of the methods according to claims 30 to 57.
64. An electronic device, a display, a touch sensing surface, one or more sensors for detecting the intensity of contact with the touch sensing surface, means for executing any of the methods according to claims 30 to 57, an electronic device comprising.
65. An electronic device, a display unit configured to display a user interface object, a touch sensing surface unit configured to receive contact, one or more sensor units configured to detect the intensity of contact with the touch sensing surface unit, a processing unit coupled to the display unit, the touch sensing surface unit and the one or more sensor units, the processing unit enabling the display of a plurality of user interface objects within a first user interface on the display unit, detecting an input by contact while a focus selector is on a first user interface object among the plurality of user interface objects on the display unit, enabling the display of a second user interface separate from the first user interface in response to detecting the input according to a determination that the input meets a selection criterion, enabling the display of a preview area including a reduced representation of the second user interface over at least some of the plurality of user interface objects within the first user interface in response to detecting the first portion of the input according to a determination that the first portion of the input meets a preview criterion, replacing the display of the first user interface and the superimposed preview area with the display of the second user interface according to a determination that a second portion of the input by contact detected after the first portion of the input meets a user interface replacement criterion, stopping the display of the preview area and enabling the display of the first user interface after the input ends according to a determination that the second portion of the input by contact meets a preview area disappearance criterion, an electronic device configured as such.
66. The determination that the first portion of the input meets a preview criterion includes detecting an increase in the characteristic intensity of the contact that reaches a second intensity threshold while the focus selector is on the first user interface object within the plurality of user interface objects on the display unit, for the electronic device according to claim 65.
67. The processing unit is configured to maintain the display of the preview area superimposed on at least some of the plurality of user interface objects within the first user interface after the input has ended, in accordance with the determination that the second portion of the input by the contact meets a preview area maintenance criterion, for the electronic device according to claim 65 or 66.
68. The processing unit is configured to visually obscure the plurality of user interface objects other than the first user interface object within the first user interface, in accordance with the determination that the first portion of the input meets a hint criterion before it meets the preview criterion, for the electronic device according to any one of claims 65 to 67.
69. Displaying the preview area superimposed on at least some of the plurality of user interface objects within the first user interface in response to detecting the first portion of the input includes displaying an animation in which the plurality of user interface objects other than the first user interface object within the first user interface are further obscured, for the electronic device according to claim 68.
70. The determination that the first portion of the input meets a hint criterion includes detecting an increase in the characteristic intensity of the contact that reaches a first intensity threshold while the focus selector is on the first user interface object within the plurality of user interface objects on the display unit, for the electronic device according to claim 68 or 69.
71. The processing unit is configured to detect the characteristic intensity of the contact that changes over time while detecting the first portion of the input and displaying the preview area. In response to detecting the characteristic intensity of the contact that changes over time, dynamically changing the size of the preview area according to the change in the characteristic intensity of the contact An electronic device according to any one of claims 65 to 69, configured as such.
72. The electronic device according to any one of claims 65 to 71, wherein the user interface replacement criterion includes a requirement that the characteristic intensity of the contact increases between the second part of the input to a third intensity threshold greater than the second intensity threshold.
73. The electronic device according to any one of claims 65 to 72, wherein the user interface replacement criterion includes a requirement that the characteristic intensity of the contact decreases below the second intensity threshold and then increases again to at least the second intensity threshold between the second parts of the input.
74. The electronic device according to any one of claims 65 to 73, wherein the user interface replacement criterion includes a requirement that the characteristic intensity of the contact increases at a predetermined speed or a speed higher than that between the second parts of the input.
75. The electronic device according to any one of claims 65 to 74, wherein the user interface replacement criterion includes a requirement that the increase in the characteristic intensity of the contact between the second parts of the input is not accompanied by movement of the contact.
76. The electronic device according to claim 67, wherein the preview area maintenance criterion includes a requirement that the second part of the input includes movement of the contact across the touch sensing surface unit that moves the focus selector in a predetermined direction on the display unit.
77. The electronic device according to claim 67, wherein the preview area maintenance criterion includes a requirement that an action icon is displayed within the preview area between the second parts of the input.
78. The electronic device according to any one of claims 65 to 77, wherein the preview area disappearance criterion includes a requirement that an action icon is not displayed within the preview area between the second parts of the input.
79. The electronic device according to any one of claims 65 to 78, wherein the preview area disappearance criterion includes a requirement that the user interface replacement criterion is not satisfied and a requirement that the preview area maintenance criterion is not satisfied.
80. The processing unit, configured to move the preview area according to the movement of the contact, in accordance with a determination that the second portion of the input by the contact includes the movement of the contact across the touch sensing surface unit, the electronic device according to any one of claims 65 to 79.
81. The processing unit, in accordance with a determination that the second portion of the input by the contact includes the movement of the contact across the touch sensing surface unit, move the focus selector according to the movement of the contact, and enable the display of one or more action items associated with the first user interface object, the electronic device according to any one of claims 65 to 80, configured as such.
82. The processing unit, configured to provide a haptic output indicating the display of one or more action items in conjunction with the display of the preview area, in accordance with a determination that the first portion of the input meets a preview criterion, the electronic device according to any one of claims 65 to 81.
83. The processing unit, configured to provide a haptic output indicating the display of the one or more action items, the haptic output indicating the display of the one or more action items is different from the first haptic output indicating the display of the preview area, and the haptic output indicating the display of the one or more action items is provided in conjunction with the display of the one or more action items associated with the first user interface object, the electronic device according to claim 81.
84. The processing unit, configured to provide a haptic output indicating the replacement of the first user interface, in accordance with a determination that the second portion of the input by the contact, detected after the first portion of the input, meets a user interface replacement criterion, and the haptic output is provided in conjunction with replacing the display of the first user interface and the superimposed preview area with the display of the second user interface, the electronic device according to any one of claims 65 to 81.
85. The processing unit, while the preview area is displayed on the display unit and the one or more action items are not displayed, An electronic device according to any one of claims 81 to 83, configured to enable display of an indicator indicating that the one or more action items associated with the first user interface object are hidden.
86. The electronic device according to claim 85, wherein the indicator is configured to represent a direction of movement of a focus selector that triggers display of the one or more action items associated with the first user interface object.
87. The movement of the contact across the touch sensing surface unit causes movement of the focus selector on the display unit in a first direction, displaying the one or more action items associated with the first user interface object, shifting the preview area in the first direction on the display unit, and showing the one or more action items as the preview area is shifted in the first direction. An electronic device according to any one of claims 81 to 86, comprising:
88. The processing unit, after showing the one or more action items, is configured to continue shifting the preview area in the first direction on the display unit according to the movement of the contact, as claimed in claim 87.
89. Displaying the one or more action items associated with the first user interface object includes displaying a first action item associated with the first user interface object, and the processing unit, while displaying the first action item associated with the first user interface object, detecting that the movement of the contact causes the focus selector to move at least a first threshold amount on the display unit before detecting a lift-off of the contact, changing a visual appearance of the first action item in response to detecting that the movement of the contact causes the focus selector to move at least the first threshold amount on the display unit, after changing the visual appearance of the first action item, detecting a lift-off of the contact, in response to detecting the lift-off of the contact, Stop displaying the first action item, Execute a first action represented by the first action item, An electronic device according to claim 87 or 88, configured as such.
90. When the processing unit In accordance with the determination that the second part of the input by the contact includes movement of the contact across the touch sensing surface unit that moves the focus selector in respective directions and meets respective movement thresholds, execute an operation associated with the movement in each direction in response to detecting the end of the input, In accordance with the determination that the second part of the input by the contact includes movement of the contact across the touch sensing surface unit that moves the focus selector in the respective directions and does not meet the respective movement thresholds, stop executing the operation associated with the movement in each direction in response to detecting the end of the input, An electronic device according to any one of claims 65 to 89, configured as such.
91. The electronic device according to claim 90, wherein movement of the focus selector in a first direction is associated with a first action, and movement of the focus selector in a second direction is associated with a second action.
92. The electronic device according to claim 91, wherein movement of the focus selector in the first direction is associated with a first threshold, and movement of the focus selector in the second direction is associated with a second threshold higher than the first threshold.
93. In an electronic device comprising a display, a touch sensing surface, and one or more sensors for detecting the intensity of a contact on the touch sensing surface, Display a first user interface including a plurality of selectable user interface objects including one or more user interface objects of a first type and one or more user interface objects of a second type separate from the first type on the display, Detecting a first portion of a first input, including detecting an increase in the characteristic intensity of a first contact on the touch-sensing surface that exceeds a first intensity threshold while the focus selector is on each of the plurality of selectable user interface objects during display of the first user interface on the display; In response to detecting the first portion of the first input, displaying supplementary information associated with each of the user interface objects; During display of the supplementary information associated with each of the user interface objects, detecting an end of the first input; In response to detecting the end of the first input, Stopping display of the supplementary information associated with each of the user interface objects according to a determination that each of the user interface objects is a first type of user interface object; Maintaining display of the supplementary information associated with each of the user interface objects after detecting the end of the first input according to a determination that each of the user interface objects is a second type of user interface object; A method comprising.
94. The method according to claim 93, wherein when each of the user interface objects is a first type of user interface object, the supplementary information includes a preview of a second user interface that is separate from the first user interface and is displayed when each of the user interface objects within the first user interface is selected.
95. The method according to claim 93 or 94, wherein when each of the user interface objects is a second type of user interface object, the supplementary information includes a first menu of actions associated with each of the user interface objects.
96. Detecting a second portion of the first input after the first portion of the first input and before the end of the first input, wherein detecting the second portion of the first input includes detecting a decrease below the first intensity threshold of the characteristic intensity of the first contact without detecting a lift-off of the contact from the touch sensing surface; Maintaining the display of the supplementary information associated with each respective user interface object in response to detecting the second portion of the first input; The method according to any one of claims 93 to 95, comprising:
97. After detecting the end of the first input and stopping the display of the supplementary information associated with each respective user interface object, While the first user interface is displayed on the display and while the focus selector is on each respective user interface object, detecting an increase above the first intensity threshold of the characteristic intensity of a second contact on the touch sensing surface, thereby detecting a first portion of a second input; Redisplaying the supplementary information associated with each respective user interface object in response to detecting the first portion of the second input; Detecting a second portion of the second input, including detecting an increase above a second intensity threshold of the characteristic intensity of the second contact on the touch sensing surface; In response to detecting the second portion of the second input, Replacing the display of the first user interface and the supplementary information with a second user interface according to a determination that each respective user interface object is a first type of user interface object; Maintaining the display of the supplementary information associated with each respective user interface object according to a determination that each respective user interface object is a second type of user interface object; The method according to any one of claims 93 to 96, comprising:
98. After detecting the end of the first input and stopping the display of the supplementary information associated with each respective user interface object, While displaying the first user interface on the display, detecting an increase in the characteristic intensity of a second contact on the touch sensing surface that exceeds the first intensity threshold while the focus selector is on each of the user interface objects, including detecting a first part of a second input, In response to detecting the first part of the second input, redisplaying the supplementary information associated with each of the user interface objects, Detecting a second part of the second input, including detecting an increase in the characteristic intensity of the second contact on the touch sensing surface that exceeds a second intensity threshold, In response to detecting the second part of the second input, According to the determination that each of the user interface objects is a first type of user interface object, replacing the display of the first user interface and the supplementary information with a second user interface, the second user interface also being displayed when each of the user interface objects within the first user interface is selected, According to the determination that each of the user interface objects is a second type of user interface object, replacing the display of the first user interface and the supplementary information with a third user interface, Including, the third user interface being different from each of the user interfaces displayed when each of the user interface objects within the first user interface is selected, the method according to any one of claims 93 to 96.
99. Including invalidating replacing the first user interface and the supplementary information with the second user interface according to the determination that the increase in the characteristic intensity of the second contact is accompanied by movement of the second contact, the method according to claim 97 or 98.
100. Detecting a second part of the first input, including movement of the first contact on the touch sensing surface, while the supplementary information is being displayed on the display and before detecting the end of the first input, In response to detecting the second part of the first part of the input including the movement of the first contact, In accordance with the determination that each of the user interface objects is a user interface object of the first type, move the supplementary information according to the movement of the first contact, In accordance with the determination that each of the user interface objects is a user interface object of the second type, maintain the position of the supplementary information and highlight selectable objects within the supplementary information according to the movement of the first contact, The method according to any one of claims 93 to 96, comprising:
101. After detecting the end of the first input and stopping the display of the supplementary information associated with each of the user interface objects, While the first user interface is being displayed on the display, while the focus selector is on each of the plurality of user interface objects, detect an increase in the characteristic intensity of a second contact on the touch sensing surface that exceeds the first intensity threshold, including detecting a first portion of a second input, In response to detecting the first portion of the second input, redisplay the supplementary information associated with each of the user interface objects, Detecting a second portion of the second input, including detecting a movement of the second contact on the touch sensing surface corresponding to a movement of the focus selector on the display, In response to detecting the second portion of the second input, In accordance with the determination that each of the user interface objects is a user interface object of the first type, display one or more action items associated with each of the user interface objects within the first user interface, In accordance with the determination that each of the user interface objects is a user interface object of the second type, Maintain the redisplay of the supplementary information associated with each of the user interface objects, Highlighting each portion of the redisplayed supplementary information, The method according to any one of claims 93 to 96, comprising:
102. In response to detecting the first portion of the first input, In accordance with the determination that each of the user interface objects is a user interface object of the first type, when displaying the supplementary information associated with each of the user interface objects, provide a first haptic output, In accordance with the determination that each of the user interface objects is a user interface object of the second type, when displaying the supplementary information associated with each of the user interface objects, provide a second haptic output different from the first haptic output, The method according to claim 101, comprising: **Claim 103** In accordance with the determination that each of the user interface objects is a user interface object of the first type, when displaying the one or more action items associated with each of the user interface objects, provide a third haptic output different from the second haptic output, The method according to claim 102, comprising: **Claim 104** Each of the user interfaces is an object of the first type, and the method includes: While the supplementary information associated with each of the user interface objects is displayed on the display and the one or more action items are not displayed, In accordance with the determination that each of the user interface objects is a user interface object of the first type, display an indicator indicating that the one or more action items associated with each of the user interface objects are hidden. The method according to any one of claims 101 to 103, comprising: **Claim 105** The method according to claim 104, wherein the indicator is configured to represent a direction of movement of a contact that triggers display of the one or more action items associated with each of the user interface objects. **Claim 106** Each of the user interface objects is an object of the first type, The movement of the second contact on the touch sensing surface corresponds to the movement of the focus selector on the display in each direction, Displaying the one or more action items associated with each user interface object within the first user interface, shifting the supplementary information in the first direction on the display, revealing the one or more action items as the supplementary information is shifted in the first direction, The method according to any one of claims 101 to 105, comprising: **Claim 107** After showing the one or more action items, continuing to shift the supplementary information in the first direction on the display according to the movement of the second contact, the method according to claim 106, comprising: **Claim 108** Displaying the one or more action items associated with each user interface object includes displaying a first action item associated with each user interface object, and the method includes: After displaying the first action item associated with each user interface object, detecting that the movement of the second contact corresponds to a movement of the focus selector of at least a first threshold amount on the display before detecting a lift-off of the second contact; changing a visual appearance of the first action item in response to detecting that the movement of the second contact corresponds to a movement of the focus selector of at least the first threshold amount on the display; after changing the visual appearance of the first action item, detecting a lift-off of the second contact; in response to detecting the lift-off of the second contact, stopping displaying the first action item, executing a first action represented by the first action item, The method according to claim 106 or 107, comprising: **Claim 109** wherein each user interface is an object of the first type, and the method includes: detecting a second portion of the first input including movement in each direction; in response to detecting an end of the first input, performing an operation associated with the movement in each direction according to a determination that the movement in each direction meets a respective movement threshold. Ceasing execution of the operations associated with the movement in each direction according to a determination that the movement in each direction does not meet the respective movement threshold; The method according to claim 93, comprising: **Claim 110** The method according to claim 109, wherein movement of the focus selector in a first direction is associated with a first action, and movement of the focus selector in a second direction is associated with a second action. **Claim 111** The method according to claim 110, wherein movement of the focus selector in the first direction is associated with a first threshold, and movement of the focus selector in the second direction is associated with a second threshold higher than the first threshold. **Claim 112** After stopping the display of the supplementary information associated with each of the user interface objects, While the first user interface is being displayed on the display, while the focus selector is on each of the plurality of user interface objects, detecting a third contact having a characteristic intensity below the first intensity threshold on the touch sensing surface and a lift-off of the third contact, including detecting a third input; Replacing the first user interface with a second user interface associated with each of the user interface elements in response to detecting the third input; The method according to any one of claims 93 to 111, comprising: **Claim 113** The method according to any one of claims 93 to 112, wherein the first type of user interface object includes a link to a web page or a document. **Claim 114** The method according to any one of claims 93 to 113, wherein the second type of user interface object includes a representation of a touchable entity. **Claim 115** An electronic device, comprising: A display; A touch sensing surface; One or more sensors for detecting the intensity of contact with the touch sensing surface; One or more processors; A memory; One or more programs, which are stored in the memory and configured to be executed by the one or more processors, and the one or more programs are On the display, a first user interface including a plurality of selectable user interface objects including one or more user interface objects of a first type and one or more user interface objects of a second type different from the first type is displayed. While the first user interface is being displayed on the display, a first part of a first input is detected, including detecting an increase in the characteristic intensity of a first contact on the touch-sensing surface that exceeds a first intensity threshold while a focus selector is on each of the plurality of selectable user interface objects. In response to detecting the first part of the first input, supplementary information associated with each of the user interface objects is displayed. While the supplementary information associated with each of the user interface objects is being displayed, an end of the first input is detected. In response to detecting the end of the first input, According to a determination that each of the user interface objects is a user interface object of the first type, the display of the supplementary information associated with each of the user interface objects is stopped. According to a determination that each of the user interface objects is a user interface object of the second type, after detecting the end of the first input, the display of the supplementary information associated with each of the user interface objects is maintained. An electronic device including instructions for this.
116. A computer-readable storage medium storing one or more programs, wherein when the one or more programs are executed by an electronic device having a display, a touch-sensing surface, and one or more sensors for detecting the intensity of contact with the touch-sensing surface, the device is caused to On the display, a first user interface including a plurality of selectable user interface objects including one or more user interface objects of a first type and one or more user interface objects of a second type different from the first type is displayed. While displaying the first user interface on the display, while the focus selector is on each of the plurality of selectable user interface objects, detecting an increase in the characteristic intensity of a first contact on the touch sensing surface that exceeds a first intensity threshold, including detecting a first portion of a first input, In response to detecting the first portion of the first input, causing supplementary information associated with each of the user interface objects to be displayed, While displaying the supplementary information associated with each of the user interface objects, causing the end of the first input to be detected, In response to detecting the end of the first input, According to a determination that each of the user interface objects is a user interface object of the first type, stopping the display of the supplementary information associated with each of the user interface objects, According to a determination that each of the user interface objects is a user interface object of the second type, after detecting the end of the first input, maintaining the display of the supplementary information associated with each of the user interface objects, A computer-readable storage medium including instructions.
117. An electronic device, A display, A touch sensing surface, One or more sensors for detecting the intensity of contact with the touch sensing surface, Means for displaying a first user interface including a plurality of selectable user interface objects, including one or more user interface objects of a first type and one or more user interface objects of a second type different from the first type, on the display, While displaying the first user interface on the display, while the focus selector is on each of the plurality of selectable user interface objects, means for detecting a first portion of a first input, including detecting an increase in the characteristic intensity of a first contact on the touch sensing surface that exceeds a first intensity threshold, means for being enabled in response to detecting the first portion of the first input and for displaying supplementary information associated with each of the user interface objects; means for detecting the end of the first input while the supplementary information associated with each of the user interface objects is being displayed; means that is enabled in response to detecting the end of the first input, for stopping the display of the supplementary information associated with each of the user interface objects according to a determination that each of the user interface objects is a user interface object of the first type; means for maintaining the display of the supplementary information associated with each of the user interface objects after detecting the end of the first input according to a determination that each of the user interface objects is a user interface object of the second type; An electronic device comprising the above.
118. An information processing apparatus for use in an electronic device comprising a display, a touch-sensitive surface, and one or more sensors for detecting the intensity of contact with the touch-sensitive surface, means for displaying a first user interface including a plurality of selectable user interface objects including one or more user interface objects of a first type and one or more user interface objects of a second type different from the first type on the display; means for detecting a first portion of a first input including detecting an increase in the characteristic intensity of a first contact on the touch-sensitive surface that exceeds a first intensity threshold while a focus selector is on each of the plurality of selectable user interface objects while the first user interface is being displayed on the display; means for being enabled in response to detecting the first portion of the first input and for displaying supplementary information associated with each of the user interface objects; means for detecting the end of the first input while the supplementary information associated with each of the user interface objects is being displayed; means that is enabled in response to detecting the end of the first input, In accordance with the determination that each of the user interface objects is the first type of user interface object, stop displaying the supplementary information associated with each of the user interface objects, In accordance with the determination that each of the user interface objects is the second type of user interface object, after detecting the end of the first input, means for maintaining the display of the supplementary information associated with each of the user interface objects, An information processing apparatus comprising the same.
119. An electronic device, A display, A touch sensing surface, One or more sensors for detecting the intensity of contact with the touch sensing surface, One or more processors, A memory, One or more programs, and the one or more programs are stored in the memory and configured to be executed by the one or more processors, and the one or more programs include instructions for executing any of the methods according to claims 93 to 114. An electronic device.
120. A computer-readable storage medium storing one or more programs, wherein when the one or more programs are executed by an electronic device comprising a display, a touch sensing surface, and one or more sensors for detecting the intensity of contact with the touch sensing surface, the device is caused to execute any of the methods according to claims 93 to 114. A computer-readable storage medium containing instructions.
121. A graphical user interface on an electronic device comprising a display, a touch sensing surface, one or more sensors for detecting the intensity of contact with the touch sensing surface, a memory, and one or more processors for executing one or more programs stored in the memory, the graphical user interface comprising a user interface displayed according to any of the methods according to claims 93 to 114.
122. An electronic device, A display, A touch sensing surface, One or more sensors for detecting the intensity of contact with the touch sensing surface, Means for executing any of the methods according to claims 93 to 114. An electronic device comprising the same.
123. An information processing apparatus for use in an electronic device including a display, a touch sensing surface, and one or more sensors for detecting the intensity of contact with the touch sensing surface, An information processing apparatus comprising means for executing any of the methods according to claims 93 to 114.
124. An electronic device, A display unit configured to display content items, A touch sensing surface unit configured to receive user input, One or more sensor units configured to detect the intensity of contact with the touch sensing surface unit, A processing unit coupled to the display unit, the touch sensing surface unit, and the one or more sensor units, the processing unit being Enabling the display of a first user interface including a plurality of selectable user interface objects including one or more user interface objects of a first type and one or more user interface objects of a second type distinct from the first type on the display unit, Detecting a first portion of a first input including detecting an increase above a first intensity threshold of a characteristic intensity of a first contact on the touch sensing surface while a focus selector is on each of the plurality of selectable user interface objects while the first user interface is being displayed on the display unit, Enabling the display of supplementary information associated with each of the user interface objects in response to detecting the first portion of the first input, Detecting the end of the first input while the supplementary information associated with each of the user interface objects is being displayed, In response to detecting the end of the first input, Stopping enabling the display of the supplementary information associated with each of the user interface objects according to a determination that each of the user interface objects is a user interface object of the first type. After detecting the end of the first input in accordance with the determination that each of the user interface objects is the second type of user interface object, maintaining the display of the supplementary information associated with each of the user interface objects. An electronic device configured as described above.
125. The electronic device according to claim 124, wherein when each of the user interface objects is the first type of user interface object, the supplementary information includes a preview of a second user interface that is separate from the first user interface and is displayed when each of the user interface objects within the first user interface is selected.
126. The electronic device according to claim 124 or 125, wherein when each of the user interface objects is the second type of user interface object, the supplementary information includes a first menu of actions associated with each of the user interface objects.
127. The processing unit detects a second portion of the first input after the first portion of the first input and before the end of the first input, and detecting the second portion of the first input includes detecting a decrease in the characteristic intensity of the first contact below the first intensity threshold without detecting a lift-off of the contact from the touch-sensitive surface. maintains the display of the supplementary information associated with each of the user interface objects in response to detecting the second portion of the first input. An electronic device according to any one of claims 124 to 126, configured as described above.
128. The processing unit after detecting the end of the first input and after stopping the display of the supplementary information associated with each of the user interface objects, detects a first portion of a second input, including detecting an increase in the characteristic intensity of a second contact on the touch-sensitive surface above the first intensity threshold while the focus selector is on each of the user interface objects while enabling the display of the first user interface on the display unit. In response to detecting the first portion of the second input, enabling redisplay of the supplementary information associated with each of the user interface objects, detecting an increase in the characteristic intensity of the second contact on the touch-sensing surface that exceeds a second intensity threshold, including detecting a second portion of the second input, in response to detecting the second portion of the second input, in accordance with a determination that each of the user interface objects is a user interface object of the first type, replacing the display of the first user interface and the supplementary information with a second user interface, in accordance with a determination that each of the user interface objects is a user interface object of the second type, maintaining the display of the supplementary information associated with each of the user interface objects, An electronic device according to any one of claims 124 to 127, configured as described above. **Claim 129** The processing unit, after detecting the end of the first input and stopping enabling the display of the supplementary information associated with each of the user interface objects, while the first user interface is being displayed on the display and while the focus selector is on each of the user interface objects, detecting an increase in the characteristic intensity of a second contact on the touch-sensing surface that exceeds the first intensity threshold, including detecting a first portion of a second input, in response to detecting the first portion of the second input, enabling redisplay of the supplementary information associated with each of the user interface objects, detecting an increase in the characteristic intensity of the second contact on the touch-sensing surface that exceeds a second intensity threshold, including detecting a second portion of the second input, in response to detecting the second portion of the second input, in accordance with a determination that each of the user interface objects is a user interface object of the first type, replacing the display of the first user interface and the supplementary information with a second user interface, the second user interface also being displayed upon selection of each of the user interface objects within the first user interface. In accordance with the determination that each of the user interface objects is the second type of user interface object, replace the display of the first user interface and the supplementary information with a third user interface. Configured as such, the third user interface is different from each of the user interfaces displayed when each of the user interface objects within the first user interface is selected. The electronic device according to any one of claims 124 to 127.
130. The processing unit is Configured to invalidate replacing the first user interface and the supplementary information with the second user interface in accordance with the determination that the increase in the characteristic intensity of the second contact is accompanied by movement of the second contact. The electronic device according to claim 128 or 129.
131. The processing unit is Detect a second portion of the first input, including movement of the first contact on the touch sensing surface, while the supplementary information is displayed on the display and before detecting the end of the first input. In response to detecting the second portion of the first portion of the input, including the movement of the first contact, In accordance with the determination that each of the user interface objects is the first type of user interface object, move the supplementary information in accordance with the movement of the first contact. In accordance with the determination that each of the user interface objects is the second type of user interface object, maintain the position of the supplementary information in accordance with the movement of the first contact and highlight selectable objects within the supplementary information. Configured as such. The electronic device according to any one of claims 124 to 127.
132. The processing unit is After detecting the end of the first input and stopping enabling the display of the supplementary information associated with each of the user interface objects. While displaying the first user interface on the display, detecting an increase in the characteristic intensity of a second contact on the touch-sensing surface that exceeds the first intensity threshold while the focus selector is on each of the plurality of user interface objects, including detecting a first portion of a second input, In response to detecting the first portion of the second input, enabling redisplay of the supplementary information associated with each of the user interface objects, Detecting a second portion of the second input, including detecting movement of the second contact on the touch-sensing surface corresponding to movement of the focus selector on the display, In response to detecting the second portion of the second input, According to a determination that each of the user interface objects is a user interface object of the first type, enabling display of one or more action items associated with each of the user interface objects within the first user interface, According to a determination that each of the user interface objects is a user interface object of the second type, Maintaining redisplay of the supplementary information associated with each of the user interface objects, Highlighting each portion of the redisplayed supplementary information, An electronic device according to any one of claims 124 to 127, configured as described above.
133. The processing unit, In response to detecting the first portion of the first input, According to a determination that each of the user interface objects is a user interface object of the first type, providing a first haptic output when displaying the supplementary information associated with each of the user interface objects, According to a determination that each of the user interface objects is a user interface object of the second type, providing a second haptic output different from the first haptic output when displaying the supplementary information associated with each of the user interface objects, An electronic device according to claim 132, configured as described above.
134. The processing unit, The electronic device according to claim 133, configured to provide a third haptic output different from the second haptic output when displaying the one or more action items associated with each of the user interface objects according to the determination that each of the user interface objects is the first type of user interface object.
135. each of the user interface objects is the first type of object, and the processing unit while the supplementary information associated with each of the user interface objects is displayed on the display and the one or more action items are not displayed enable the display of an indicator indicating that the one or more action items associated with each of the user interface objects are hidden according to the determination that each of the user interface objects is the first type of user interface object The electronic device according to any one of claims 132 to 134, configured as such.
136. The electronic device according to claim 135, wherein the indicator is configured to represent the direction of movement of contact that triggers the display of the one or more action items associated with each of the user interface objects.
137. each of the user interface objects is the first type of object, the movement of the second contact on the touch sensing surface corresponds to the movement of the focus selector on the display in each direction, enabling the display of the one or more action items associated with each of the user interface objects within the first user interface includes shifting the supplementary information in the first direction on the display, and showing the one or more action items as the supplementary information is shifted in the first direction The electronic device according to any one of claims 132 to 136, including the above.
138. the processing unit after showing the one or more action items, continue to shift the supplementary information in the first direction on the display according to the movement of the second contact The electronic device according to claim 137, configured as described above.
139. Enabling the display of the one or more action items associated with each of the user interface objects includes enabling the display of a first action item associated with each of the user interface objects, and the processing unit After the first action item associated with each of the user interface objects is displayed, detecting that the movement of the second contact corresponds to a movement of the focus selector on the display of at least a first threshold amount before detecting the lift-off of the second contact; In response to detecting that the movement of the second contact corresponds to a movement of the focus selector on the display of at least the first threshold amount, changing the visual appearance of the first action item; After changing the visual appearance of the first action item, detecting the lift-off of the second contact; In response to detecting the lift-off of the second contact; Stopping enabling the display of the first action item; Executing a first action represented by the first action item; The electronic device according to claim 137 or 138, configured as described above.
140. Each of the user interface objects is an object of the first type, and the processing unit Detecting a second portion of the first input including movement in each direction; In response to detecting the end of the first input; Performing an operation associated with the movement in each direction according to a determination that the movement in each direction satisfies a respective movement threshold; Ceasing to perform the operation associated with the movement in each direction according to a determination that the movement in each direction does not satisfy the respective movement threshold; The electronic device according to claim 124, configured as described above.
141. The electronic device according to claim 140, wherein a movement of the focus selector in a first direction is associated with a first action, and a movement of the focus selector in a second direction is associated with a second action.
142. The movement of the focus selector in the first direction is associated with a first threshold, and the movement of the focus selector in the second direction is associated with a second threshold higher than the first threshold. The electronic device according to claim 141.
143. The processing unit, After stopping enabling the display of the supplementary information associated with each of the user interface objects, While the first user interface is being displayed on the display, while the focus selector is on each of the plurality of user interface objects, detecting a third contact having a characteristic intensity below the first intensity threshold on the touch sensing surface and a lift-off of the third contact, including detecting a third input, In response to detecting the third input, replacing the first user interface with a second user interface associated with each of the user interface elements on the display. An electronic device according to any one of claims 124 to 142, configured as described above.
144. The electronic device according to any one of claims 124 to 143, wherein the first type of user interface object includes a link to a web page or a document.
145. The electronic device according to any one of claims 124 to 144, wherein the second type of user interface object includes a representation of a touchable entity.
146. In an electronic device comprising a touch sensing surface, a display, and one or more sensors for detecting the intensity of contact with the touch sensing surface, A first user interface, A background having a first appearance, Displaying, on the display, a first user interface including one or more foreground objects; While the first user interface is being displayed on the display, detecting a first input by a first contact on the touch sensing surface while a first focus selector is at a position within the first user interface corresponding to the background of the first user interface. In response to detecting the first input by the first contact, in accordance with a determination that the first contact has a characteristic intensity exceeding a first intensity threshold, without changing the appearance of the one or more foreground objects within the first user interface, dynamically change the appearance of the background of the first user interface based at least in part on the characteristic intensity of at least a portion of the first contact. During dynamically changing the appearance of the background of the first user interface, detect the end of the first input by the first contact. In response to detecting the end of the first input by the first contact, return the background of the first user interface to the first appearance of the background. A method comprising the above.
147. The method according to claim 146, wherein the dynamic change of the appearance of the background of the first user interface is based at least in part on the position of the first focus selector on the display.
148. The method according to claim 146 or 147, wherein when the first input is detected, the electronic device is in a lock mode in which access to a plurality of different operations accessible when the device is in an unlocked state is blocked.
149. The background is used for both the locked state and the unlocked state of the device. During the locked state, the appearance of the background is changed from a first appearance to a second appearance according to the characteristic intensity of the first contact. The method includes Receiving a request to enter the unlocked state while the background has the second appearance. In response to receiving the request to enter the unlocked state, entering the unlocked state. After entering the unlocked state, displaying the transition of the appearance of the background from the second state to the first state. The method according to claim 148, comprising the above.
150. The method according to any one of claims 146 to 149, wherein the first intensity threshold is associated with an operating system of the electronic device, and each operation of each application on the electronic device is activated in response to detecting each input that satisfies the first intensity threshold.
151. The operation of each application on the electronic device is activated in response to detecting each input that meets a second intensity threshold. The appearance of the background changes in a first manner when the characteristic intensity of the contact is between the first intensity threshold and the second intensity threshold. The method according to claim 150, wherein the appearance of the background changes in a second manner different from the first manner when the characteristic intensity of the contact exceeds the second intensity threshold.
152. The method according to any one of claims 148 to 151, wherein each foreground object of the one or more foreground objects responds to an input by a contact having a characteristic intensity below the first intensity threshold.
153. Detecting a second input by a second contact that meets a criterion for exiting the lock mode of the electronic device; In response to detecting the second input by the second contact, replacing the display of the first user interface with the display of a second user interface separate from the first user interface on the display; The method according to any one of claims 148 to 152, comprising a second user interface including a background of the second user interface having a first appearance and one or more foreground objects.
154. While the second user interface is being displayed on the display, detecting a third input by a third contact on the touch-sensing surface having a characteristic intensity exceeding the first intensity threshold while the focus selector is at a position within the second user interface corresponding to the background of the second user interface; Maintaining the first appearance of the background of the second user interface in response to detecting the third input by the third contact; The method according to claim 153, comprising.
155. While the second user interface is being displayed on the display, detecting a fourth input by a fourth contact on the touch-sensing surface while the focus selector is at a position within the second user interface corresponding to the background of the second user interface; In response to detecting the fourth input by the fourth contact, in accordance with the determination that the fourth contact has a characteristic strength exceeding the first intensity threshold, without changing the appearance of the one or more foreground objects within the first user interface, dynamically changing the appearance of the background of the second user interface; The method according to claim 153, comprising: the dynamic change of the appearance of the background of the second user interface being based at least in part on the characteristic strength of at least a portion of the fourth contact. **Claim 156** During the dynamic change of the appearance of the background of the second user interface, detecting the end of the fourth input by the fourth contact; In response to detecting the end of the fourth input by the fourth contact, returning the background of the second user interface to the first appearance of the background of the second user interface; The method according to claim 155, comprising. **Claim 157** The change in the appearance of the background of the first user interface is changing the spacing between background objects, changing the radial position of a background object with respect to the position of the first contact, changing the opacity of a background object, changing the color of a background object, changing the simulated depth or focus of a background object, changing the contrast of a background object, and / or changing the brightness of a background object, and the method according to any one of claims 146 to 156. **Claim 158** The method according to any one of claims 146 to 157, wherein the background of the first user interface includes a geometric or abstract pattern. **Claim 159** The background of the first user interface includes representative images within a continuous image, and dynamically changing the appearance of the background of the first user interface includes displaying in sequence at least some of the at least several continuous images, at least in part based on the characteristic strength of the first contact. The method according to any one of claims 146 to 158. **Claim 160** The change in the appearance of the background of the first user interface includes a ripple effect applied to a background object emitted from the focus selector. The method according to any one of claims 146 to 158. **Claim 161** Returning the background of the first user interface to the first appearance of the background can be including returning the display of the object in the background of the first user interface to the first appearance of the object in the background of the first user interface with simulated inertia based on the rate of decrease of the characteristic intensity of the first contact detected immediately before detecting the end of the input by the first contact, according to any one of claims 146 to 158. **Claim 162** After determining that the first contact has a characteristic intensity exceeding the first intensity threshold while detecting the first input by the first contact, detecting a decrease in the characteristic intensity of the first contact, in response to detecting the decrease in the characteristic intensity of the first contact, dynamically reversing the change in the appearance of the background of the first user interface based on the rate of change of the characteristic intensity of the first contact, according to the determination that the rate of change of the characteristic intensity of the first contact during the detected decrease in the characteristic intensity of the first contact does not exceed a first rate-of-change threshold; animating the reversal of the change in the appearance of the background of the first user interface independent of the rate of change of the characteristic intensity of the first contact, according to the determination that the rate of change of the characteristic intensity of the first contact during the detected decrease in the characteristic intensity of the first contact exceeds a first rate-of-change threshold; The method according to any one of claims 146 to 158, including. **Claim 163** The method according to any one of claims 146 to 162, wherein the dynamic change in the appearance of the background of the first user interface is partially based on a positive rate of change of the characteristic intensity of the first contact. **Claim 164** The method according to any one of claims 146 to 163, wherein the magnitude of the dynamic change in the appearance of the background of the first user interface decays according to the detection of the impact force by the first contact. **Claim 165** After determining that the first contact has a characteristic intensity exceeding the first intensity threshold while detecting the first input by the first contact, detecting a decrease in the characteristic intensity of the first contact below the first intensity threshold, Continuing to dynamically change at least part of the appearance of the background of the first user interface based on the characteristic intensity of the first contact in response to detecting the decrease below the first intensity threshold of the characteristic intensity of the first contact. The method according to any one of claims 146 to 164, including this.
166. The method according to any one of claims 146 to 165, wherein restoring the background of the first user interface to the first appearance of the background is based on the rate of change of the decrease in the characteristic intensity of the first contact before the end of the first input.
167. While continuing to detect the first input by the first contact, after determining that the first contact has a characteristic intensity exceeding the first intensity threshold, Detecting the movement of the first contact on the touch-sensing surface, In response to detecting the movement of the first contact, dynamically updating the change in the appearance of the background of the first user interface based on the movement of the first contact on the touch-sensing surface. The method according to any one of claims 146 to 166, including this.
168. After determining that the first contact has a characteristic intensity exceeding the first intensity threshold, before detecting the movement of the first contact on the touch-sensing surface, The method according to claim 167, including detecting a decrease in the characteristic intensity of the contact below the first intensity threshold.
169. In response to detecting the input by the first contact, in accordance with the determination that the first contact has a characteristic intensity exceeding the first intensity threshold, changing the aspect of the appearance of the background of the first user interface without changing the appearance of each foreground object of the one or more foreground objects within the first user interface, and the change in the aspect of the appearance of the background of the first user interface is independent of the position of the focus selector within the background. The method according to any one of claims 146 to 168.
170. While detecting the first input due to the first contact on the touch sensing surface, while a second focus selector is at a position within the first user interface corresponding to the background of the user interface, detecting a second input due to a second contact on the touch sensing surface; in response to detecting the second input due to the second contact; in accordance with a determination that the second contact does not have a characteristic strength exceeding the first strength threshold, without changing the appearance of each foreground object of the one or more foreground objects within the first user interface, dynamically changing the appearance of the background of the first user interface based on at least a portion of the characteristic strength of the first contact; in accordance with a determination that the second contact has a characteristic strength exceeding the first strength threshold, without changing the appearance of each foreground object of the one or more foreground objects within the first user interface, at least a portion of; the characteristic strength of the first contact; the characteristic strength of the second contact; and the positions of the first and second focus selectors on the display based on, dynamically changing the appearance of the background of the first user interface; while dynamically changing the appearance of the background of the first user interface, detecting the end of the first input due to the first contact and the end of the second input due to the second contact; in response to detecting the end of the first input due to the first contact and the end of the second input due to the second contact, returning the background of the first user interface to the first appearance of the background; A method according to any one of claims 146 to 169, comprising:
171. A method according to any one of claims 146 to 170, comprising maintaining the first appearance of the background of the first user interface in accordance with a determination that the first input does not have a characteristic strength exceeding the first strength threshold in response to detecting the first input due to the first contact on the touch sensing surface.
172. An electronic device, comprising: a display; a touch sensing surface; one or more sensors for detecting the strength of contact with the touch sensing surface; one or more processors; a memory; One or more programs, wherein the one or more programs are stored in the memory and configured to be executed by the one or more processors, and the one or more programs are A first user interface, A background having a first appearance, Display a first user interface including one or more foreground objects on the display, While the first user interface is being displayed on the display, detect a first input by a first contact on the touch sensing surface while a first focus selector is at a position within the first user interface corresponding to the background of the first user interface, In response to detecting the first input by the first contact, in accordance with a determination that the first contact has a characteristic strength exceeding a first strength threshold, without changing the appearance of the one or more foreground objects within the first user interface, dynamically change the appearance of the background of the first user interface based on at least a portion of the characteristic strength of the first contact, While dynamically changing the appearance of the background of the first user interface, detect an end of the first input by the first contact, In response to detecting the end of the first input by the first contact, return the background of the first user interface to the first appearance of the background, An electronic device including instructions for.
173. A computer-readable storage medium storing one or more programs, wherein when the one or more programs are executed by an electronic device including a display, a touch sensing surface, and one or more sensors for detecting the intensity of contact with the touch sensing surface, cause the device to A first user interface, A background having a first appearance, Cause a first user interface including one or more foreground objects to be displayed on the display, While the first user interface is being displayed on the display, cause a first input by a first contact on the touch sensing surface to be detected while a first focus selector is at a position within the first user interface corresponding to the background of the first user interface, In response to detecting the first input by the first contact, according to a determination that the first contact has a characteristic strength exceeding a first strength threshold, without changing the appearance of the one or more foreground objects within the first user interface, based on at least a portion of the characteristic strength of the first contact, dynamically change the appearance of the background of the first user interface. While dynamically changing the appearance of the background of the first user interface, detect the end of the first input by the first contact. In response to detecting the end of the first input by the first contact, return the background of the first user interface to the first appearance of the background. A computer-readable storage medium including instructions.
174. An electronic device, A display, A touch sensing surface, One or more sensors for detecting the strength of contact with the touch sensing surface, A first user interface, A background having a first appearance, Means for displaying, on the display, a first user interface including one or more foreground objects. While the first user interface is displayed on the display, means for detecting a first input by a first contact on the touch sensing surface while a first focus selector is at a position within the first user interface corresponding to the background of the first user interface. In response to detecting the first input by the first contact, according to a determination that the first contact has a characteristic strength exceeding a first strength threshold, without changing the appearance of the one or more foreground objects within the first user interface, based on at least a portion of the characteristic strength of the first contact, means for dynamically changing the appearance of the background of the first user interface. While dynamically changing the appearance of the background of the first user interface, means for detecting the end of the first input by the first contact. In response to detecting the end of the first input by the first contact, means for returning the background of the first user interface to the first appearance of the background. An electronic device comprising the above.
175. An electronic device, A display, A touch sensing surface, One or more sensors for detecting the intensity of contact with the touch sensing surface One or more processors Memory One or more programs, wherein the one or more programs are stored in the memory and configured to be executed by the one or more processors, and the one or more programs include instructions for executing any of the methods according to claims 146 to 171, an electronic device **Claim 176** A computer-readable storage medium storing one or more programs, wherein when the one or more programs are executed by an electronic device comprising a display, a touch sensing surface, and one or more sensors for detecting the intensity of contact with the touch sensing surface, the device is caused to execute instructions for executing any of the methods according to claims 146 to 171, a computer-readable storage medium **Claim 177** A graphical user interface on an electronic device comprising a display, a touch sensing surface, one or more sensors for detecting the intensity of contact with the touch sensing surface, memory, and one or more processors for executing one or more programs stored in the memory, the graphical user interface comprising a user interface displayed according to any of the methods according to claims 146 to 171 **Claim 178** An electronic device, comprising A display A touch sensing surface One or more sensors for detecting the intensity of contact with the touch sensing surface Means for executing any of the methods according to claims 146 to 171, an electronic device **Claim 179** An electronic device, comprising A display unit configured to display a user interface, a background, and foreground objects A touch sensing surface unit configured to receive an input One or more sensor units configured to detect the intensity of contact with the touch sensing surface unit A processing unit coupled to the display unit, the touch sensing surface unit, and the one or more sensor units, wherein the processing unit Enables the display on the display of a first user interface, comprising A background having a first appearance One or more foreground objects While the first user interface is being displayed on the display, while a first focus selector is at a position within the first user interface corresponding to the background of the first user interface, a first input by a first contact on the touch sensing surface unit is detected, In response to detecting the first input by the first contact, in accordance with a determination that the first contact has a characteristic intensity exceeding a first intensity threshold, without changing the appearance of the one or more foreground objects within the first user interface, based at least in part on the characteristic intensity of the first contact, the appearance of the background of the first user interface is dynamically changed, While the appearance of the background of the first user interface is being dynamically changed, an end of the first input by the first contact is detected, In response to detecting the end of the first input by the first contact, the background of the first user interface is returned to the first appearance of the background, An electronic device configured as described above.
180. The electronic device according to claim 179, wherein the dynamic change in the appearance of the background of the first user interface is based at least in part on the position of the first focus selector on the display.
181. The electronic device according to claim 179 or 180, wherein when the first input is detected, the electronic device is in a lock mode in which access to a plurality of different operations that are accessible when the device is in an unlocked state is blocked.
182. The background is used for both the locked state and the unlocked state of the device, During the locked state, the appearance of the background is changed from a first appearance to a second appearance in accordance with the characteristic intensity of the first contact, The processing unit, While the background has the second appearance, receives a request to enter the unlocked state, In response to receiving the request to enter the unlocked state, enters the unlocked state, After entering the unlocked state, enables displaying a transition in the appearance of the background from the second state to the first state, The electronic device according to claim 181, configured as described above.
183. The first intensity threshold is associated with an operating system of the electronic device, and operations of respective applications on the electronic device are activated in response to detecting respective inputs that satisfy the first intensity threshold. The electronic device according to any one of claims 179 to 182.
184. Operations of respective applications on the electronic device are activated in response to detecting respective inputs that satisfy a second intensity threshold. The appearance of the background changes in a first manner when the characteristic intensity of the contact is between the first intensity threshold and the second intensity threshold. The electronic device according to claim 183, wherein the appearance of the background changes in a second manner different from the first manner when the characteristic intensity of the contact exceeds the second intensity threshold.
185. Each foreground object of the one or more foreground objects responds to an input by a contact having a characteristic intensity below the first intensity threshold. The electronic device according to any one of claims 148 to 184.
186. The processing unit detects a second input by a second contact that satisfies a criterion for exiting the lock mode of the electronic device. In response to detecting the second input by the second contact, replaces a display of the first user interface with a display of a second user interface separate from the first user interface on the display. The electronic device according to any one of claims 148 to 185, wherein the second user interface includes a background of the second user interface having a first appearance and one or more foreground objects.
187. The processing unit while the second user interface is displayed on the display, when a focus selector is at a position within the second user interface corresponding to the background of the second user interface, detects a third input by a third contact on the touch-sensing surface unit having a characteristic intensity exceeding the first intensity threshold. In response to detecting the third input by the third contact, maintains the first appearance of the background of the second user interface. The electronic device according to claim 186, configured as such.
188. while the processing unit is detecting a fourth input by a fourth contact on the touch sensing surface unit while a focus selector is at a position within the second user interface corresponding to the background of the second user interface while the second user interface is being displayed on the display, dynamically changing the appearance of the background of the second user interface without changing the appearance of the one or more foreground objects within the first user interface according to a determination that the fourth contact has a characteristic strength exceeding a first strength threshold, The electronic device according to claim 186, wherein the dynamic change in the appearance of the background of the second user interface is based at least in part on the characteristic strength of the fourth contact. **Claim 189** while the processing unit is detecting an end of the fourth input by the fourth contact while dynamically changing the appearance of the background of the second user interface, returning the background of the second user interface to the first appearance of the background of the second user interface in response to detecting the end of the fourth input by the fourth contact. The electronic device according to claim 188, configured as such. **Claim 190** The change in the appearance of the background of the first user interface is a change in the spacing between background objects, a change in the radial position of a background object with respect to the position of the first contact, a change in the opacity of a background object, a change in the color of a background object, a change in the simulated depth or focus of a background object, a change in the contrast of a background object, and / or a change in the brightness of a background object, The electronic device according to any one of claims 179 to 189. **Claim 191** The electronic device according to any one of claims 179 to 190, wherein the background of the first user interface includes a geometric or abstract pattern. **Claim 192** The background of the first user interface includes representative images in a continuous image, and dynamically changing the appearance of the background of the first user interface includes sequentially displaying at least some of the continuous images based on the characteristic intensity of at least a part of the first contact. The electronic device according to any one of claims 179 to 191.
193. The change in the appearance of the background of the first user interface includes a ripple effect applied to a background object emitted from the focus selector. The electronic device according to any one of claims 179 to 191.
194. Returning the background of the first user interface to the first appearance of the background is displaying the object of the background of the first user interface with simulated inertia based on the rate of decrease of the characteristic intensity of the first contact detected immediately before detecting the end of the input by the first contact, and returning to the first appearance of the object in the background of the first user interface. The electronic device according to any one of claims 179 to 191.
195. The processing unit after determining that the first contact has a characteristic intensity exceeding the first intensity threshold while detecting the first input by the first contact, detects a decrease in the characteristic intensity of the first contact, in response to detecting the decrease in the characteristic intensity of the first contact, dynamically reverses the change in the appearance of the background of the first user interface based on the rate of change of the characteristic intensity of the first contact according to the determination that the rate of change of the characteristic intensity of the first contact during the detected decrease does not exceed a first rate-of-change threshold, animates the reversal of the change in the appearance of the background of the first user interface independently of the rate of change of the characteristic intensity of the first contact according to the determination that the rate of change of the characteristic intensity of the first contact during the detected decrease exceeds a first rate-of-change threshold, The electronic device according to any one of claims 179 to 191, configured as
196. The electronic device according to any one of claims 179 to 195, wherein the dynamic change in the appearance of the background of the first user interface is partially based on a positive rate of change in the characteristic strength of the first contact.
197. The electronic device according to any one of claims 179 to 196, wherein the magnitude of the dynamic change in the appearance of the background of the first user interface decays in accordance with the detection of the impact force by the first contact.
198. The processing unit, while detecting the first input by the first contact, after determining that the first contact has a characteristic strength exceeding the first strength threshold, detects a decrease in the characteristic strength of the first contact below the first strength threshold, and continues to dynamically change the appearance of the background of the first user interface based at least in part on the characteristic strength of the first contact in response to detecting the decrease in the characteristic strength of the first contact below the first strength threshold. The electronic device according to any one of claims 179 to 197, configured as such.
199. The electronic device according to any one of claims 179 to 198, wherein returning the background of the first user interface to the first appearance of the background is based on the rate of change of the decrease in the characteristic strength of the first contact before the end of the first input.
200. The processing unit, while continuing to detect the first input by the first contact, after determining that the first contact has a characteristic strength exceeding the first strength threshold, detects the movement of the first contact on the touch sensing surface unit, and dynamically updates the change in the appearance of the background of the first user interface based on the movement of the first contact on the touch sensing surface unit in response to detecting the movement of the first contact. The electronic device according to any one of claims 179 to 199, configured as such.
201. The processing unit, after determining that the first contact has a characteristic strength exceeding the first strength threshold and before detecting the movement of the first contact on the touch sensing surface unit, The electronic device according to claim 200, configured to detect a decrease in the characteristic strength of the contact below the first strength threshold.
202. The processing unit, In response to detecting the input due to the first contact, according to a determination that the first contact has a characteristic intensity exceeding the first intensity threshold, without changing the appearance of each of the one or more foreground objects in the first user interface, the aspect of the appearance of the background of the first user interface is configured to be changed, and the change in the aspect of the appearance of the background of the first user interface is independent of the position of the focus selector in the background. The electronic device according to any one of claims 179 to 201.
203. The processing unit, while detecting the first input due to the first contact on the touch sensing surface unit, while a second focus selector is at a position in the first user interface corresponding to the background of the user interface, detects a second input due to a second contact on the touch sensing surface unit, in response to detecting the second input due to the second contact, according to a determination that the second contact does not have a characteristic intensity exceeding the first intensity threshold, without changing the appearance of each of the one or more foreground objects in the first user interface, dynamically changes the appearance of the background of the first user interface based on at least a portion of the characteristic intensity of the first contact, according to a determination that the second contact has a characteristic intensity exceeding the first intensity threshold, without changing the appearance of each of the one or more foreground objects in the first user interface, at least in part, the characteristic intensity of the first contact, the characteristic intensity of the second contact, and the positions of the first and second focus selectors on the display based on which, dynamically changes the appearance of the background of the first user interface, while dynamically changing the appearance of the background of the first user interface, detects the end of the first input due to the first contact and the end of the second input due to the second contact, in response to detecting the end of the first input due to the first contact and the end of the second input due to the second contact, returns the background of the first user interface to the first appearance of the background. An electronic device according to any one of claims 179 to 202, configured as such.
204. Wherein the processing unit An electronic device according to any one of claims 179 to 203, configured to maintain the first appearance of the background of the first user interface according to a determination that the first input does not have a characteristic intensity exceeding the first intensity threshold in response to detecting the first input by the first contact on the touch sensing surface unit.
205. In an electronic device comprising a touch sensing surface, a display, and one or more sensors for detecting the intensity of contact with the touch sensing surface, A first user interface, A background having a first appearance, Displaying, on the display, a first user interface including one or more foreground objects; Detecting, during displaying of the first user interface on the display, an input by a first contact having a characteristic intensity exceeding a first intensity threshold on the touch sensing surface; In response to detecting the input by the first contact, Dynamically changing the appearance of the background of the first user interface based at least in part on the characteristic intensity of the first contact without changing the appearance of the one or more foreground objects in the first user interface according to a determination that the focus selector is at a position within the first user interface corresponding to the background of the user interface during the input; Maintaining the first appearance of the background of the first user interface according to a determination that the focus selector is at a position within the first user interface corresponding to each foreground object of the one or more foreground objects in the first user interface; A method comprising.
206. The method according to claim 205, wherein when the input is detected, the electronic device is in a lock mode in which access to a plurality of different operations that are accessible when the device is in an unlocked state is blocked.
207. Detecting an end of the input by the first contact while dynamically changing the appearance of the background of the first user interface; In response to detecting the end of the input by the first contact, restoring the background of the first user interface to the first appearance of the background, the method according to claim 205 or 206.
208. The input by the first contact includes a first portion of the input, and detecting the input by the first contact on the touch-sensing surface includes detecting the first portion of the first input, and the method includes: In response to detecting the first portion of the input, During the first portion of the input, the focus selector is at a position within the first user interface corresponding to a first foreground object among the one or more foreground objects; According to a determination that the first portion of the input meets a preview criterion, Displaying a preview area superimposed on at least some of the background of the first user interface; The method according to any one of claims 205 to 207.
209. After detecting the first portion of the first input, detecting a second portion of the input by the first contact; In response to detecting the second portion of the input by the first contact, According to a determination that the second portion of the input by the first contact meets a user interface replacement criterion, replacing the display of the first user interface and the superimposed preview area with the display of a second user interface associated with the first foreground object; According to a determination that the second portion of the input by the contact meets a preview area disappearance criterion, after the input ends, stopping the display of the preview area and displaying the first user interface; The method according to claim 208.
210. In response to detecting the input by the first contact, According to a determination that the focus selector is at a position within the first user interface corresponding to a second foreground object among the one or more foreground objects, displaying additional information associated with the second foreground object; During the display of the additional information associated with each second foreground object, detecting the end of the input by the first contact; In response to detecting the end of the input by the first contact, stopping the display of the additional information associated with the second foreground object; The method according to any one of claims 205 to 209, including. **Claim 211** The method according to claim 210, wherein the second foreground object is a notification, and expanding the second foreground object includes displaying additional content associated with the notification. **Claim 212** The method according to claim 210, wherein the second foreground object is a representation of a date and / or time, and expanding the second foreground object includes displaying information regarding the expected activity of the user of the device corresponding to the date and / or time. **Claim 213** In response to detecting the input by the first contact, According to the determination that the focus selector is at a position within the first user interface corresponding to a third foreground object of the one or more foreground objects, displaying a menu area over at least some of the background of the first user interface, the menu area displaying a plurality of selectable actions executed by a first application corresponding to the third foreground object. The method according to any one of claims 205 to 212. **Claim 214** The method according to claim 213, wherein the third foreground object is a representation of a suggested application, and the menu area includes a representation of an additional suggested application. **Claim 215** The method according to claim 213, wherein the third foreground object is a representation of a suggested application, and the menu area includes a representation of an action associated with the suggested application. **Claim 216** The method according to claim 213, wherein the third foreground object is a representation of a media capture application, and the menu area includes a representation of an additional operation mode for the media capture application. **Claim 217** An electronic device, A display, A touch sensing surface, One or more sensors for detecting the intensity of contact with the touch sensing surface, One or more processors, A memory, One or more programs, wherein the one or more programs are stored in the memory and configured to be executed by the one or more processors, and the one or more programs are a first user interface, a background having a first appearance, and one or more foreground objects, and display the first user interface on the display, while the first user interface is being displayed on the display, detect an input by a first contact having a characteristic intensity on the touch-sensing surface that exceeds a first intensity threshold, in response to detecting the input by the first contact, in accordance with a determination that a focus selector is at a position within the first user interface corresponding to the background of the user interface during the input, without changing the appearance of the one or more foreground objects within the first user interface, dynamically change the appearance of the background of the first user interface based at least in part on the characteristic intensity of the first contact, maintain the first appearance of the background of the first user interface in accordance with a determination that the focus selector is at a position within the first user interface corresponding to each of the one or more foreground objects within the first user interface, for an electronic device including instructions.
218. A computer-readable storage medium storing one or more programs, wherein when the one or more programs are executed by an electronic device including a display, a touch-sensing surface, and one or more sensors for detecting the intensity of contact with the touch-sensing surface, the device is caused to a first user interface, a background having a first appearance, and one or more foreground objects, and display the first user interface on the display, while the first user interface is being displayed on the display, detect an input by a first contact having a characteristic intensity on the touch-sensing surface that exceeds a first intensity threshold, in response to detecting the input by the first contact, In accordance with the determination that the focus selector is at a position within the first user interface corresponding to the background of the user interface during the input, without changing the appearance of the one or more foreground objects within the first user interface, dynamically change the appearance of the background of the first user interface based on at least a portion of the characteristic intensity of the first contact. In accordance with the determination that the focus selector is at a position within the first user interface corresponding to each of the one or more foreground objects within the first user interface, maintain the first appearance of the background of the first user interface. A computer-readable storage medium including instructions.
219. An electronic device, A display, A touch-sensitive surface, One or more sensors for detecting the intensity of contact with the touch-sensitive surface, A first user interface, A background having a first appearance, Means for displaying on the display a first user interface including one or more foreground objects, Means for detecting, during the display of the first user interface on the display, an input by a first contact having a characteristic intensity exceeding a first intensity threshold on the touch-sensitive surface, In response to detecting the input by the first contact, In accordance with the determination that the focus selector is at a position within the first user interface corresponding to the background of the user interface during the input, without changing the appearance of the one or more foreground objects within the first user interface, dynamically change the appearance of the background of the first user interface based on at least a portion of the characteristic intensity of the first contact, In accordance with the determination that the focus selector is at a position within the first user interface corresponding to each of the one or more foreground objects within the first user interface, maintain the first appearance of the background of the first user interface, An electronic device comprising.
220. An electronic device, A display, A touch-sensitive surface, One or more sensors for detecting the intensity of contact with the touch-sensitive surface, One or more processors, A memory, An electronic device comprising: one or more programs, wherein the one or more programs are stored in the memory and configured to be executed by the one or more processors, and the one or more programs include instructions for executing any of the methods according to claims 205 to 216.
221. A computer-readable storage medium storing one or more programs, wherein when the one or more programs are executed by an electronic device comprising a display, a touch sensing surface, and one or more sensors for detecting the intensity of contact with the touch sensing surface, the device is caused to execute any of the methods according to claims 205 to 216.
222. A graphical user interface on an electronic device comprising a display, a touch sensing surface, one or more sensors for detecting the intensity of contact with the touch sensing surface, a memory, and one or more processors for executing one or more programs stored in the memory, the graphical user interface comprising a user interface displayed according to any of the methods according to claims 205 to 216.
223. An electronic device, comprising: a display; a touch sensing surface; one or more sensors for detecting the intensity of contact with the touch sensing surface; and means for executing any of the methods according to claims 205 to 216.
224. An electronic device, comprising: a display unit configured to display a user interface, a background, and foreground objects; a touch sensing surface unit configured to receive an input; one or more sensor units configured to detect the intensity of contact with the touch sensing surface unit; and a processing unit coupled to the display unit, the touch sensing surface unit, and the one or more sensor units, wherein the processing unit enables the display on the display unit of a first user interface, the first user interface including a background having a first appearance, and one or more foreground objects. While displaying the first user interface on the display unit, detect an input by a first contact having a characteristic intensity exceeding a first intensity threshold on the touch sensing surface unit. In response to detecting the input by the first contact, According to a determination that the focus selector is at a position within the first user interface corresponding to the background of the user interface during the input, without changing the appearance of the one or more foreground objects within the first user interface, dynamically change the appearance of the background of the first user interface based on at least a part of the characteristic intensity of the first contact. According to a determination that the focus selector is at a position within the first user interface corresponding to each of the one or more foreground objects within the first user interface, maintain the first appearance of the background of the first user interface. An electronic device configured as described above.
225. The electronic device according to claim 224, wherein when the input is detected, the electronic device is in a lock mode in which access to a plurality of different operations accessible when the device is in an unlocked state is blocked.
226. The processing unit is While dynamically changing the appearance of the background of the first user interface, detect the end of the input by the first contact. In response to detecting the end of the input by the first contact, return the background of the first user interface to the first appearance of the background. The electronic device according to any one of claims 205 to 225, configured as described above.
227. The input by the first contact includes a first part of the input, and detecting the input by the first contact on the touch sensing surface unit includes detecting the first part of the first input. The processing unit is In response to detecting the first part of the input, During the first part of the input, the focus selector is at a position within the first user interface corresponding to a first foreground object of the one or more foreground objects, and According to a determination that the first part of the input meets a preview criterion. Enable the display of a preview area superimposed on at least some of the background of the first user interface. An electronic device according to any one of claims 205 to 226, configured as such. **Claim 228** The processing unit After detecting the first part of the first input, detect the second part of the input by the first contact. In response to detecting the second part of the input by the first contact, According to the determination that the second part of the input by the first contact meets the user interface replacement criteria, replace the display of the first user interface and the superimposed preview area with the display of a second user interface associated with the first foreground object. According to the determination that the second part of the input by the contact meets the preview area disappearance criteria, after the input ends, stop the display of the preview area and enable the display of the first user interface. An electronic device according to claim 227, configured as such. **Claim 229** The processing unit In response to detecting the input by the first contact, According to the determination that the focus selector is at a position within the first user interface corresponding to a second foreground object among the one or more foreground objects, enable the display of additional information associated with the second foreground object. While displaying the additional information associated with each second foreground object, detect the end of the input by the first contact. In response to detecting the end of the input by the first contact, stop the display of the additional information associated with the second foreground object. An electronic device according to any one of claims 205 to 228, configured as such. **Claim 230** The electronic device according to claim 229, wherein the second foreground object is a notification, and expanding the second foreground object includes displaying additional content associated with the notification. **Claim 231** The electronic device according to claim 229, wherein the second foreground object is a representation of a date and / or time, and expanding the second foreground object includes displaying information regarding an expected activity of a user of the device corresponding to the date and / or time.
232. The processing unit is in response to detecting the input by the first contact, enabling display of a menu area superimposed on at least some of the background of the first user interface according to a determination that the focus selector is at a position within the first user interface corresponding to a third foreground object of the one or more foreground objects. The electronic device according to any one of claims 205 to 231, wherein the menu area is configured to display a plurality of selectable actions performed by a first application corresponding to the third foreground object.
233. The electronic device according to claim 232, wherein the third foreground object is a representation of a suggested application, and the menu area includes a representation of an additional suggested application.
234. The electronic device according to claim 232, wherein the third foreground object is a representation of a suggested application, and the menu area includes a representation of an action associated with the suggested application.
235. The electronic device according to claim 232, wherein the third foreground object is a representation of a media capture application, and the menu area includes a representation of an additional operation mode for the media capture application.
236. In an electronic device comprising one or more processors, a memory, a touch-sensitive surface, a display, and one or more sensors for detecting the intensity of contact with the touch-sensitive surface, a first user interface, including a background, including a foreground area overlapping a portion of the background, displaying on the display a first user interface, wherein the foreground area includes a plurality of user interface objects. While the first focus selector is on the first user interface object among the plurality of user interface objects in the foreground area, detecting an input by contact on the touch-sensitive surface; In response to detecting the input by the contact; According to a determination that the input by the contact satisfies one or more first pressing criteria including a criterion satisfied when the characteristic intensity of the contact is below a first intensity threshold during the input, performing a first predetermined action corresponding to the first user interface object in the foreground area; According to a determination that the input by the contact satisfies one or more second pressing criteria including a criterion satisfied when the characteristic intensity of the contact increases above the first intensity threshold during the input, performing a second action corresponding to the first user interface object in the foreground area, which is separate from the first predetermined action; A method comprising:
237. The method according to claim 236, wherein when the input is detected, the electronic device is in a lock mode in which access to a plurality of different operations that are accessible when the device is unlocked is blocked.
238. The method according to claim 236 or 237, wherein the first predetermined action is to change a setting corresponding to the first user interface object in the foreground area.
239. The method according to claim 236 or 237, wherein the first predetermined action is to open an application corresponding to the first user interface object.
240. The method according to any one of claims 236 to 239, wherein the second predetermined action is to display a menu area superimposed on a part of the foreground, and the menu area displays one or more selectable actions executed by an application corresponding to the first user interface object.
241. In response to detecting the input by the contact; In accordance with a determination that one or more third pressing criteria are satisfied, including a criterion satisfied when the input due to the contact increases beyond a second intensity threshold greater than the first intensity threshold of the contact characteristics during the input, performing a third predetermined action corresponding to the first user interface object in the foreground area, separate from the first predetermined action and the second predetermined action. The method according to any one of claims 236 to 240.
242. Before displaying the foreground area, a first user interface, Having a first appearance as a background, One or more foreground objects, Including, displaying the first user interface, which is a lock screen user interface, on the display; While displaying the lock screen user interface on the display, detecting an input due to a second contact on the touch sensing surface while the focus selector is at a position within the lock screen user interface corresponding to the background of the lock screen user interface; In response to detecting the input due to the second contact, dynamically changing the appearance of the background of the lock screen user interface without changing the appearance of the one or more foreground objects within the lock screen user interface, in accordance with a determination that the second contact has a characteristic intensity exceeding the first intensity threshold; Including, the dynamic change of the appearance of the background of the lock screen user interface is at least partially based on the characteristic intensity of the second contact. The method according to any one of claims 236 to 241.
243. The method according to any one of claims 236 to 242, wherein the foreground area is displayed superimposed on the portion of the background in response to detecting a gesture starting from an edge of the touch sensing surface.
244. The method according to any one of claims 236 to 243, wherein the first predetermined action includes toggling a wireless connection, and the second predetermined action includes displaying a user interface for selecting a wireless network to connect to.
245. The method according to any one of claims 236 to 243, wherein the first predetermined action includes toggling a limited notification operation mode, and the second predetermined action includes displaying a user interface for setting a timer associated with the limited notification operation mode.
246. The method according to any one of claims 236 to 243, wherein the first predetermined action includes toggling a flashlight function, and the second predetermined action includes displaying a user interface for selecting an operation mode for the flashlight function.
247. The method according to any one of claims 236 to 243, wherein the first predetermined action includes starting a timer application, and the second predetermined action includes displaying a user interface for performing a timer management operation without starting the timer application.
248. The method according to any one of claims 236 to 243, wherein the first predetermined action includes starting an alarm application, and the second predetermined action includes displaying a user interface for performing an alarm management operation without starting the alarm application.
249. The method according to any one of claims 236 to 243, wherein the first predetermined action includes starting a corresponding application, and the second predetermined action includes displaying a user interface for performing an operation associated with the corresponding application without starting the corresponding application.
250. An electronic device, a display, a touch sensing surface, one or more sensors for detecting the intensity of contact with the touch sensing surface, one or more processors, a memory, one or more programs, wherein the one or more programs are stored in the memory and configured to be executed by the one or more processors, and the one or more programs a first user interface, including a background, including a foreground area overlapping a portion of the background, display the first user interface, which includes a plurality of user interface objects, on the display While the first focus selector is on a first user interface object among the plurality of user interface objects within the foreground area, detect an input by contact on the touch sensing surface, In response to detecting the input by the contact, According to a determination that the input by the contact satisfies one or more first pressing criteria including a criterion that is satisfied when the characteristic intensity of the contact is below a first intensity threshold during the input, execute a first predetermined action corresponding to the first user interface object within the foreground area, According to a determination that the input by the contact satisfies one or more second pressing criteria including a criterion that is satisfied when the characteristic intensity of the contact increases above the first intensity threshold during the input, execute a second action corresponding to the first user interface object within the foreground area, which is separate from the first predetermined action, An electronic device including instructions for.
251. A computer-readable storage medium storing one or more programs, wherein when the one or more programs are executed by an electronic device including a display, a touch sensing surface, and one or more sensors for detecting the intensity of contact with the touch sensing surface, cause the device to, A first user interface, Including a background, Including a foreground area overlapping a portion of the background, Display a first user interface on the display, the foreground area including a plurality of user interface objects, Cause the first focus selector to detect an input by contact on the touch sensing surface while the first focus selector is on a first user interface object among the plurality of user interface objects within the foreground area, In response to detecting the input by the contact, According to a determination that the input by the contact satisfies one or more first pressing criteria including a criterion that is satisfied when the characteristic intensity of the contact is below a first intensity threshold during the input, cause a first predetermined action corresponding to the first user interface object within the foreground area to be executed, According to a determination that the input by the contact satisfies one or more second pressing criteria including a criterion satisfied when the characteristic strength of the contact increases above the first strength threshold during the input, a second action corresponding to the first user interface object in the foreground area is executed, separate from the first predetermined action. A computer-readable storage medium including an instruction. **Claim 252** An electronic device, a display, a touch sensing surface, one or more sensors for detecting the strength of contact with the touch sensing surface, a first user interface, including a background, including a foreground area overlapping a portion of the background, wherein the foreground area includes a plurality of user interface objects, means for displaying the first user interface on the display, means for detecting an input by contact on the touch sensing surface while a first focus selector is on a first user interface object among the plurality of user interface objects in the foreground area, in response to detecting the input by the contact, means for executing a first predetermined action corresponding to the first user interface object in the foreground area according to a determination that the input by the contact satisfies one or more first pressing criteria including a criterion satisfied when the characteristic strength of the contact is below the first strength threshold during the input, means for executing a second action corresponding to the first user interface object in the foreground area, separate from the first predetermined action, according to a determination that the input by the contact satisfies one or more second pressing criteria including a criterion satisfied when the characteristic strength of the contact increases above the first strength threshold during the input, An electronic device comprising the above. **Claim 253** An electronic device, a display, a touch sensing surface, one or more sensors for detecting the strength of contact with the touch sensing surface, one or more processors, a memory, An electronic device comprising: one or more programs, wherein the one or more programs are stored in the memory and configured to be executed by the one or more processors, and the one or more programs include instructions for executing any of the methods according to claims 236 to 249.
254. A computer-readable storage medium storing one or more programs, wherein when the one or more programs are executed by an electronic device comprising a display, a touch-sensitive surface, and one or more sensors for detecting the intensity of contact with the touch-sensitive surface, the device is caused to execute any of the methods according to claims 236 to 249.
255. A graphical user interface on an electronic device comprising a display, a touch-sensitive surface, one or more sensors for detecting the intensity of contact with the touch-sensitive surface, a memory, and one or more processors for executing one or more programs stored in the memory, the graphical user interface comprising a user interface displayed according to any of the methods according to claims 236 to 249.
256. An electronic device, comprising a display, a touch-sensitive surface, one or more sensors for detecting the intensity of contact with the touch-sensitive surface, and means for executing any of the methods according to claims 236 to 249.
257. An electronic device, comprising a user interface and a display unit configured to display user interface objects, a touch-sensitive surface unit configured to receive an input, one or more sensor units configured to detect the intensity of contact with the touch-sensitive surface unit, and a processing unit coupled to the display unit, the touch-sensitive surface unit, and the one or more sensor units, the processing unit enabling the display on the display unit of a first user interface, the first user interface including a background, a foreground area overlapping a portion of the background, and the foreground area including a plurality of user interface objects. While the first focus selector is on the first user interface object among the plurality of user interface objects in the foreground area, it detects an input by contact on the touch sensing surface unit, In response to detecting the input by the contact, According to a determination that the input by the contact satisfies one or more first pressing criteria including a criterion satisfied when the characteristic intensity of the contact is below a first intensity threshold during the input, it executes a first predetermined action corresponding to the first user interface object in the foreground area, According to a determination that the input by the contact satisfies one or more second pressing criteria including a criterion satisfied when the characteristic intensity of the contact increases above the first intensity threshold during the input, it executes a second action corresponding to the first user interface object in the foreground area, which is separate from the first predetermined action, An electronic device configured as described above.
258. The electronic device according to claim 224, wherein when the input is detected, the electronic device is in a lock mode in which access to a plurality of different operations that can be accessed when the device is in an unlocked state is blocked.
259. The electronic device according to any one of claims 224 to 258, wherein the first predetermined action changes a setting corresponding to the first user interface object in the foreground area.
260. The electronic device according to any one of claims 224 to 258, wherein the first predetermined action opens an application corresponding to the first user interface object.
261. The electronic device according to any one of claims 224 to 260, wherein the second predetermined action displays a menu area superimposed on a part of the foreground, and the menu area displays one or more selectable actions executed by an application corresponding to the first user interface object.
262. The processing unit, In response to detecting the input by the contact, In accordance with a determination that one or more third pressing criteria are satisfied, including a criterion that is satisfied when the input due to the contact increases beyond a second intensity threshold greater than the first intensity threshold of the contact characteristic strength during the input, a third predetermined action corresponding to the first user interface object in the foreground area, separate from the first predetermined action and the second predetermined action, is configured to be executed. The electronic device according to any one of claims 224 to 261.
263. The processing unit Before displaying the foreground area A background having a first appearance, One or more foreground objects, and enables the display of the first user interface, which is a lock screen user interface, on the display unit. While the lock screen user interface is displayed on the display unit, when the focus selector is at a position within the lock screen user interface corresponding to the background of the lock screen user interface, an input due to a second contact on the touch sensing surface unit is detected. In response to detecting the input due to the second contact, in accordance with a determination that the second contact has a characteristic strength exceeding the first intensity threshold, the appearance of the background of the lock screen user interface is dynamically changed without changing the appearance of the one or more foreground objects within the lock screen user interface. Configured as such, the dynamic change of the appearance of the background of the lock screen user interface is based at least in part on the characteristic strength of the second contact. The electronic device according to any one of claims 224 to 262.
264. The electronic device according to any one of claims 224 to 263, wherein the foreground area is displayed superimposed on the portion of the background in response to detecting a gesture starting from an edge of the touch sensing surface unit.
265. The first predetermined action includes toggling a wireless connection, and the second predetermined action includes displaying a user interface for selecting a wireless network to connect to. The electronic device according to any one of claims 224 to 264.
266. The electronic device according to any one of claims 224 to 264, wherein the first predetermined action includes toggling a limited notification operation mode, and the second predetermined action includes displaying a user interface for setting a timer associated with the limited notification operation mode.
267. The electronic device according to any one of claims 224 to 264, wherein the first predetermined action includes toggling a flashlight function, and the second predetermined action includes displaying a user interface for selecting an operation mode for the flashlight function.
268. The electronic device according to any one of claims 224 to 264, wherein the first predetermined action includes starting a timer application, and the second predetermined action includes displaying a user interface for performing a timer management operation without starting the timer application.
269. The electronic device according to any one of claims 224 to 264, wherein the first predetermined action includes starting an alarm application, and the second predetermined action includes displaying a user interface for performing an alarm management operation without starting the alarm application.
270. The electronic device according to any one of claims 224 to 264, wherein the first predetermined action includes starting a corresponding application, and the second predetermined action includes displaying a user interface for performing an operation associated with the corresponding application without starting the corresponding application.
271. In an electronic device comprising a display, a touch sensing surface, and one or more sensors for detecting the intensity of contact on the touch sensing surface, displaying an application launch user interface including a plurality of application icons for launching corresponding applications on the display; Detecting a first touch input including detecting a first contact at a position on the touch-sensing surface corresponding to a first application icon, which is an icon for launching a first application associated with one or more corresponding quick actions among the plurality of application icons, while displaying the application launch user interface; In response to detecting the first touch input; Launching the first application according to a determination that the first touch input meets one or more application launch criteria; Displaying one or more quick action objects associated with the first application simultaneously with the first application icon without launching the first application according to a determination that the first touch input meets one or more quick action display criteria, the criteria including a criterion that is met when the characteristic intensity of the first contact increases above respective intensity thresholds; A method comprising the above steps.
272. The method according to claim 271, wherein the application launch criteria are criteria configured to be met when the characteristic intensity of the contact does not increase above the respective intensity thresholds.
273. The method according to claim 271 or 272, further comprising, in response to detecting the first touch input and according to a determination that the first touch input meets the quick action display criteria, de-emphasizing a plurality of the application icons relative to the first application icon in conjunction with the display of the one or more quick action objects.
274. The method according to claim 273, further comprising, during the first touch input, detecting a change in the characteristic intensity of the first contact before meeting the quick action display criteria, and dynamically adjusting the appearance of other application icons other than the first application icon to gradually de-emphasize them as the characteristic intensity of the first contact increases based on the characteristic intensity of the first contact.
275. In accordance with a determination that one or more interface navigation criteria are met, including criteria that are satisfied when, in response to detecting the first touch input, the first touch input is a movement that exceeds a threshold amount of the first contact before the characteristic intensity of the first contact increases beyond the respective intensity thresholds, at least a portion of the application launch user interface is stopped from being displayed, and at least a portion of a different user interface is displayed over a portion of the display that was previously occupied by the plurality of application icons within the application launch user interface immediately before the first touch input was detected. The method according to any one of claims 271 to 274.
276. The method according to claim 275, including moving a plurality of application icons in accordance with the movement of the first contact in response to detecting the movement of the first contact before the characteristic intensity of the first contact increases beyond the respective intensity thresholds.
277. In accordance with a determination that an icon reorganization criterion is met, including criteria that are satisfied when, in response to detecting the first touch input, the first touch input is a situation where the first contact is detected for a time longer than a reorganization time threshold on the touch sensing surface before the characteristic intensity of the first contact increases beyond the respective intensity thresholds, one or more application icons can be reorganized within the application launch interface, including entering an icon reorganization mode. The method according to any one of claims 271 to 276.
278. Detecting a second touch input including detecting a second contact at a position on the touch sensing surface corresponding to the first application icon and satisfying the application launch criteria while the one or more quick action objects are being displayed simultaneously with the application icon; Launching the first application in response to detecting the second touch input; The method according to any one of claims 271 to 277.
279. Detecting a third contact at a position on the touch-sensing surface corresponding to the first application icon while displaying the one or more quick action objects simultaneously with the application icon, including a criterion that is satisfied when the third contact is detected on the touch-sensing surface for a time longer than a reorganization time threshold before the characteristic intensity of the third contact increases beyond the respective intensity thresholds, and detecting a third touch input that satisfies an icon reorganization criterion; Entering an icon reorganization mode in which the application icon can be reorganized within the application launch interface in response to detecting the third touch input; The method according to any one of claims 271 to 278, including.
280. The method according to claim 279, wherein entering the icon reorganization mode in response to detecting the third touch input includes stopping the display of the one or more quick action objects.
281. Detecting a fourth touch input, including detecting a fourth contact at a position on the touch-sensing surface away from the quick action object and the first application icon while the quick action object is being displayed simultaneously with the first application icon; Stopping the display of the one or more quick action objects in response to detecting the fourth touch input; The method according to any one of claims 271 to 280, including.
282. The method according to any one of claims 271 to 281, including generating a first haptic output indicating that the quick action display criterion has been satisfied in response to a determination that the quick action display criterion has been satisfied.
283. Detecting a fifth touch input, including detecting a fifth contact at a position on the touch-sensing surface corresponding to a second application icon of the plurality of application icons, which is an icon for launching a second application not associated with any corresponding quick action, while the application launch user interface is being displayed; In response to detecting the fifth touch input, In accordance with the determination that the fifth touch input meets the application startup criterion, start the second application, In accordance with the determination that the fifth touch input meets the quick action display criterion, generate visual and / or haptic output indicating that the fifth touch input meets the quick action display criterion but the second application is not associated with any quick actions, The method according to any one of claims 271 to 282, including.
284. When the first contact approaches the respective intensity thresholds, display each change in the appearance of the plurality of application icons on the display, The method according to claim 283, including: when the fifth contact approaches the respective intensity thresholds, display each change in the appearance of the plurality of application icons on the display.
285. When the fifth contact approaches the respective intensity thresholds, display changes in the appearance of the plurality of application icons other than the second application icon on the display, In response to detecting that the fifth touch input meets the quick action display criterion, invert the change in the appearance of the plurality of application icons to redisplay the application startup interface as it was displayed immediately before detecting the fifth touch input, The method according to claim 283 or 284, including.
286. Detecting a sixth touch input, including detecting a sixth contact that meets the quick action display criterion at a position on the touch-sensitive surface corresponding to each application icon while the application startup user interface is being displayed, In response to detecting the sixth touch input, In accordance with the determination that each application icon is associated with one or more quick actions, Display a quick action object for each application icon, Generate a first haptic output indicating that the sixth touch input meets the quick action display criterion and that each application icon is associated with a quick action, In accordance with the determination that none of the respective application icons are associated with any quick action, although the sixth touch input meets the quick action display criteria, generate a second haptic output indicating that none of the respective application icons are associated with any quick action, and do not display a quick action object for any of the respective application icons, The method according to any one of claims 271 to 285, including, wherein the first haptic output is different from the second haptic output.
287. The method according to any one of claims 271 to 286, wherein displaying the one or more quick action objects simultaneously with the first application icon includes displaying the one or more quick action objects within a menu including a plurality of quick action objects.
288. The method according to claim 287, including, before displaying the menu, displaying a layer under the application icon, and expanding the layer to be the background of the menu in response to detecting that the first input meets the quick action display criteria.
289. The method according to claim 288, including dynamically changing the size of the layer such that the intensity of the first contact changes when the second contact approaches the respective intensity threshold.
290. The method according to any one of claims 287 to 289, wherein the quick action objects in the menu are ordered in the menu based on the position of the icon in the application launch user interface.
291. While displaying the one or more quick action objects, detect a movement of the first contact to each respective position on the touch sensing surface corresponding to each quick action object of the one or more quick action objects, and detect a lift-off of the first contact from the touch sensing surface while the first contact is at each respective position on the touch sensing surface; and execute each respective quick action in response to detecting the lift-off of the first contact. The method according to any one of claims 271 to 290, including.
292. While displaying the one or more quick action objects, detecting a movement of the first contact to respective positions on the touch-sensitive surface corresponding to respective ones of the one or more quick action objects, and detecting an increase in the characteristic intensity of the contact that satisfies an action selection criterion while the first contact is at the respective positions on the touch-sensitive surface; In response to detecting that the first contact satisfies the action selection criterion, performing the respective quick actions; The method according to any one of claims 271 to 290, comprising:
293. After displaying the one or more quick action objects, detecting a lift-off of the contact from the touch-sensitive surface, and detecting a next touch input on the touch-sensitive surface at a position corresponding to each of the one or more quick action objects; In response to detecting the next touch input on the touch-sensitive surface at the position corresponding to each of the one or more quick action objects, performing the respective quick actions; The method according to any one of claims 271 to 290, comprising:
294. The method according to any one of claims 271 to 293, wherein the application icon includes a display of several notifications, and the one or more quick action objects include quick action objects associated with one or more of the notifications.
295. Activating the first application in response to detecting the first touch input includes displaying a default view of the application, The one or more quick action objects include respective quick action objects associated with a non-default view of the application, The method includes: Detecting a selection of each of the respective quick action objects; In response to detecting the selection of each of the respective quick action objects, displaying the non-default view of the application; The method according to any one of claims 271 to 293, comprising:
296. The one or more quick action objects include quick action objects associated with the functions of the first application, The method is detecting a selection of each of the quick action objects, executing the function in response to detecting the selection of each of the quick action objects, The method according to any one of claims 271 to 295, comprising.
297. The one or more quick action objects include quick action objects associated with functions of an application other than the first application, The method is detecting a selection of each of the quick action objects, executing the function in response to detecting the selection of each of the quick action objects, The method according to any one of claims 271 to 296, comprising.
298. The first application is a content generation application, The one or more quick action objects include respective quick action objects associated with generation of new content, The method is detecting a selection of each of the quick action objects, generating a new blank content object in response to detecting the selection of each of the quick action objects, and displaying the new blank content object on the display in an editing operation mode, The method according to any one of claims 271 to 297, comprising.
299. The first application is a content generation application, The one or more quick action objects include respective quick action objects associated with opening previously generated content, The method is detecting a selection of each of the quick action objects, opening the application in response to detecting the selection of each of the quick action objects, and displaying the previously generated content within the application, The method according to any one of claims 271 to 298, comprising.
300. The method according to any one of claims 271 to 299, each quick action object including a quick action object selected based on a recent activity within the first application.
301. The method according to any one of claims 271 to 300, each quick action object including a quick action object dynamically determined based on the current position of the device.
302. An electronic device, a display, a touch sensing surface, one or more sensors for detecting the intensity of contact with the touch sensing surface, one or more processors, a memory, and one or more programs, the one or more programs being stored in the memory and configured to be executed by the one or more processors, the one or more programs display an application launch user interface on the display including a plurality of application icons for launching corresponding applications, while displaying the application launch user interface, detect a first touch input including detecting a first contact at a position on the touch sensing surface corresponding to a first application icon that is an icon for launching a first application associated with one or more corresponding quick actions of the plurality of application icons, in response to detecting the first touch input, launch the first application according to a determination that the first touch input meets one or more application launch criteria, without launching the first application, simultaneously display one or more quick action objects associated with the first application together with the first application icon according to a determination that the first touch input meets one or more quick action display criteria including a criterion that is met when the characteristic intensity of the first contact increases above respective intensity thresholds. An electronic device comprising instructions for.
303. A computer-readable storage medium storing one or more programs, wherein when the one or more programs are executed by an electronic device including a display, a touch sensing surface, and one or more sensors for detecting the intensity of contact with the touch sensing surface, the device is caused to display, on the display, an application launch user interface including a plurality of application icons for launching corresponding applications, while displaying the application launch user interface, detect a first touch input including detecting a first contact at a position on the touch sensing surface corresponding to a first application icon, which is an icon for launching a first application associated with one or more corresponding quick actions of the plurality of application icons, in response to detecting the first touch input, launch the first application according to a determination that the first touch input meets one or more application launch criteria, in accordance with a determination that the first touch input meets one or more quick action display criteria, including a criterion that is met when the characteristic intensity of the first contact increases above respective intensity thresholds, display, simultaneously with the first application icon, one or more quick action objects associated with the first application without launching the first application, A computer-readable storage medium containing instructions.
304. An electronic device, comprising a display, a touch sensing surface, one or more sensors for detecting the intensity of contact with the touch sensing surface, means for displaying, on the display, an application launch user interface including a plurality of application icons for launching corresponding applications, means for detecting a first touch input including detecting a first contact at a position on the touch sensing surface corresponding to a first application icon, which is an icon for launching a first application associated with one or more corresponding quick actions of the plurality of application icons, while displaying the application launch user interface, in response to detecting the first touch input, Means for starting the first application according to a determination that the first touch input meets one or more application startup criteria; Means for simultaneously displaying one or more quick action objects associated with the first application together with the first application icon without starting the first application, according to a determination that the first touch input meets one or more quick action display criteria, including a criterion that is satisfied when the characteristic intensity of the first contact increases beyond respective intensity thresholds; An electronic device comprising the above.
305. An electronic device, comprising: A display; A touch sensing surface; One or more sensors for detecting the intensity of contact with the touch sensing surface; One or more processors; A memory; One or more programs, which are stored in the memory and configured to be executed by the one or more processors, and the one or more programs include instructions for executing any of the methods described in Claims 271 to 301.
306. A computer-readable storage medium storing one or more programs, wherein when the one or more programs are executed by an electronic device comprising a display, a touch sensing surface, and one or more sensors for detecting the intensity of contact with the touch sensing surface, the device is caused to execute any of the methods described in Claims 271 to 301.
307. A graphical user interface on an electronic device comprising a display, a touch sensing surface, one or more sensors for detecting the intensity of contact with the touch sensing surface, a memory, and one or more processors for executing one or more programs stored in the memory, the graphical user interface comprising a user interface displayed according to any of the methods described in Claims 271 to 301.
308. An electronic device, comprising: A display; A touch sensing surface; One or more sensors for detecting the intensity of contact with the touch sensing surface; Means for executing any of the methods described in Claims 271 to 301.
309. An electronic device, comprising: A display unit configured to display a user interface object, A touch sensing surface unit configured to receive contact, One or more sensor units configured to detect the intensity of contact with the touch sensing surface unit, A processing unit coupled to the display unit, the touch sensing surface unit, and the one or more sensor units, wherein the processing unit Enables the display of an application launch user interface including a plurality of application icons for launching corresponding applications on the display unit, While displaying the application launch user interface, detects a first touch input including detecting a first contact at a position on the touch sensing surface unit corresponding to a first application icon that is an icon for launching a first application associated with one or more corresponding quick actions of the plurality of application icons, In response to detecting the first touch input, Launches the first application according to a determination that the first touch input meets one or more application launch criteria, In response to a determination that the first touch input meets one or more quick action display criteria including a criterion that is met when the characteristic intensity of the first contact increases above respective intensity thresholds, enables simultaneous display of one or more quick action objects associated with the first application together with the first application icon without launching the first application, An electronic device configured as such.
310. The electronic device according to claim 309, wherein the application launch criteria are configured to be met when the characteristic intensity of the contact does not increase above the respective intensity thresholds.
311. The electronic device according to claim 309 or 310, wherein the processing unit, in response to detecting the first touch input, is configured to de-emphasize a plurality of the application icons relative to the first application icon in conjunction with the display of the one or more quick action objects according to a determination that the first touch input meets the quick action display criteria.
312. The electronic device according to claim 311, wherein the processing unit is configured to detect a change in the characteristic intensity of the first contact before satisfying the quick action display criterion during the first touch input, and based on the characteristic intensity of the first contact, as the characteristic intensity of the first contact increases, the appearance of other application icons is dynamically adjusted so as to gradually de-emphasize the plurality of application icons other than the first application icon.
313. The electronic device according to any one of claims 309 to 312, wherein in response to detecting the first touch input, the processing unit determines that at least a portion of the application launch user interface is stopped according to a determination that one or more interface navigation criteria are satisfied, including a criterion that the first touch input satisfies when a movement exceeding a threshold amount of the first contact is detected before the characteristic intensity of the first contact exceeds the respective intensity threshold and increases, and at least a portion of a different user interface is enabled to be displayed on a portion of the display unit that has been occupied by the plurality of application icons in the application launch user interface immediately before detecting the first touch input.
314. The electronic device according to claim 313, wherein the processing unit is configured to move a plurality of application icons according to the movement of the first contact in response to detecting the movement of the first contact before the characteristic intensity of the first contact exceeds the respective intensity threshold and increases.
315. The electronic device according to any one of claims 309 to 314, wherein in response to detecting the first touch input, the processing unit enters an icon rearrangement mode in which one or more application icons can be rearranged within the application launch interface according to a determination that an icon rearrangement criterion is satisfied, including a criterion that the first touch input satisfies when the first contact is detected for a time longer than a reconstruction time threshold on the touch sensing surface unit before the characteristic intensity of the first contact exceeds the respective intensity threshold and increases.
316. while the processing unit displays the one or more quick action objects simultaneously with the application icon, detecting a second contact at a position on the touch sensing surface unit corresponding to the first application icon and satisfying the application activation criterion, detecting a second touch input, while the processing unit displays the one or more quick action objects simultaneously with the application icon, detecting a second contact at a position on the touch sensing surface unit corresponding to the first application icon and satisfying the application activation criterion, detecting a second touch input, activating the first application in response to detecting the second touch input; An electronic device according to any one of claims 309 to 315, configured as described above. **Claim 317** while the processing unit displays the one or more quick action objects simultaneously with the application icon, detecting a third contact at a position on the touch sensing surface unit corresponding to the first application icon, including a criterion satisfied when the third contact is detected on the touch sensing surface unit for a time longer than a reorganization time threshold before the characteristic intensity of the third contact increases beyond the respective intensity thresholds, detecting a third touch input that satisfies the icon reorganization criterion; while the processing unit displays the one or more quick action objects simultaneously with the application icon, detecting a third contact at a position on the touch sensing surface unit corresponding to the first application icon, including a criterion satisfied when the third contact is detected on the touch sensing surface unit for a time longer than a reorganization time threshold before the characteristic intensity of the third contact increases beyond the respective intensity thresholds, detecting a third touch input that satisfies the icon reorganization criterion; entering an icon reorganization mode in which the application icon can be reorganized within the application activation interface in response to detecting the third touch input. An electronic device according to any one of claims 309 to 316, configured as described above. **Claim 318** The electronic device according to claim 317, wherein entering the icon reorganization mode in response to detecting the third touch input includes stopping the display of the one or more quick action objects. **Claim 319** while the processing unit displays the quick action object simultaneously with the first application icon, detecting a fourth contact at a position on the touch sensing surface unit away from the quick action object and the first application icon, detecting a fourth touch input, while the processing unit displays the quick action object simultaneously with the first application icon, detecting a fourth contact at a position on the touch sensing surface unit away from the quick action object and the first application icon, detecting a fourth touch input, stopping the display of the one or more quick action objects in response to detecting the fourth touch input; An electronic device according to any one of claims 309 to 318, configured as described above. **Claim 320** The electronic device according to any one of claims 309 to 319, wherein the processing unit is configured to generate a first haptic output indicating that the quick action display criteria are satisfied in response to a determination that the quick action display criteria are satisfied.
321. The processing unit is configured to detect a fifth touch at a position on the touch-sensing surface unit corresponding to a second application icon of the plurality of application icons, the second application icon being an icon for launching a second application that is not associated with any corresponding quick action while the application launch user interface is being displayed, in response to detecting the fifth touch input, launch the second application according to a determination that the fifth touch input satisfies an application launch criterion, generate a visual and / or haptic output indicating that the fifth touch input satisfies the quick action display criterion but that the second application is not associated with any quick action, according to a determination that the fifth touch input satisfies the quick action display criterion. The electronic device according to any one of claims 309 to 320, configured as described above.
322. The processing unit is configured to enable display of respective changes in the appearance of the plurality of application icons on the display unit when the first touch approaches the respective intensity thresholds, enable display of the respective changes in the appearance of the plurality of application icons on the display unit when the fifth touch approaches the respective intensity thresholds. The electronic device according to claim 321, configured as described above.
323. The processing unit is configured to enable display of changes in the appearance of the plurality of application icons other than the second application icon on the display unit when the fifth touch approaches the respective intensity thresholds. In response to detecting that the fifth touch input meets the quick action display criteria, in order to redisplay the application launch interface as it was displayed immediately before the fifth touch input was detected, the change in the appearance of the plurality of application icons is reversed. An electronic device according to claim 321 or 322, configured as such.
324. The processing unit While displaying the application launch user interface, detecting a sixth touch input including detecting a sixth contact at a position on the touch-sensitive surface unit corresponding to each application icon that meets the quick action display criteria. In response to detecting the sixth touch input According to the determination that each of the application icons is associated with one or more quick actions Enabling the display of quick action objects for each of the application icons Generating a first haptic output indicating that the sixth touch input meets the quick action display criteria and that each of the application icons is associated with a quick action. According to the determination that none of the application icons are associated with any quick actions Generating a second haptic output indicating that the sixth touch input meets the quick action display criteria and that none of the application icons are associated with any quick actions. Not enabling the display of quick action objects for each of the application icons An electronic device according to any one of claims 309 to 323, configured as such, wherein the first haptic output is different from the second haptic output.
325. An electronic device according to any one of claims 309 to 324, wherein displaying the one or more quick action objects simultaneously with the first application icon includes displaying the one or more quick action objects within a menu including a plurality of quick action objects.
326. The electronic device according to claim 325, wherein the processing unit is configured to enable display of a layer under the application icon before displaying the menu, and expand the layer to be the background of the menu in response to detecting that the first input meets the quick action display criteria.
327. The electronic device according to claim 326, wherein the processing unit is configured to dynamically change the size of the layer as the intensity of the first contact changes when the second contact approaches the respective intensity threshold.
328. The electronic device according to any one of claims 325 to 327, wherein the quick action objects in the menu are ordered in the menu based on the position of the icon in the application launch user interface.
329. The processing unit is while displaying the one or more quick action objects, detecting movement of the first contact to respective positions on the touch sensing surface unit corresponding to the respective quick action objects of the one or more quick action objects, and detecting lift-off of the first contact from the touch sensing surface unit while the first contact is at the respective positions on the touch sensing surface unit, executing the respective quick actions in response to detecting lift-off of the first contact. The electronic device according to any one of claims 309 to 328, configured as such.
330. The processing unit is while displaying the one or more quick action objects, detecting movement of the first contact to respective positions on the touch sensing surface unit corresponding to the respective quick action objects of the one or more quick action objects, and detecting an increase in the characteristic intensity of the contact that meets the action selection criteria while the first contact is at the respective positions on the touch sensing surface unit, executing the respective quick actions in response to detecting that the first contact meets the action selection criteria. The electronic device according to any one of claims 309 to 328, configured as such.
331. The processing unit is After displaying the one or more quick action objects, detecting a lift-off of the contact from the touch sensing surface unit, and detecting a next touch input on the touch sensing surface at a position corresponding to each of the one or more quick action objects, executing each of the respective quick actions in response to detecting the next touch input on the touch sensing surface at a position corresponding to each of the respective quick action objects; An electronic device according to any one of claims 309 to 328, configured as described above.
332. The electronic device according to any one of claims 309 to 331, wherein the application icon includes a display of several notifications, and the one or more quick action objects include quick action objects associated with one or more of the notifications.
333. Activating the first application in response to detecting the first touch input includes displaying a default view of the application, wherein the one or more quick action objects include respective quick action objects associated with a non-default view of the application, The processing unit, detecting a selection of each of the respective quick action objects, enabling display of the non-default view of the application in response to detecting a selection of each of the respective quick action objects; An electronic device according to any one of claims 309 to 332, configured as described above.
334. The one or more quick action objects include quick action objects associated with functions of the first application, The processing unit, detecting a selection of each of the respective quick action objects, executing the function in response to detecting a selection of each of the respective quick action objects; An electronic device according to any one of claims 309 to 333, configured as described above.
335. The one or more quick action objects include quick action objects associated with functions of applications other than the first application, The processing unit, Detect the selection of each of the quick action objects, Execute the function in response to detecting the selection of each of the quick action objects, An electronic device according to any one of claims 309 to 334, configured as such.
336. The first application is a content generation application, The one or more quick action objects include respective quick action objects associated with the generation of new content, The processing unit, Detect the selection of each of the quick action objects, In response to detecting the selection of each of the quick action objects, generate a new blank content object and enable the display of the new blank content object in an editing operation mode on the display unit. An electronic device according to any one of claims 309 to 335, configured as such.
337. The first application is a content generation application, The one or more quick action objects include respective quick action objects associated with opening previously generated content, The processing unit, Detect the selection of each of the quick action objects, In response to detecting the selection of each of the quick action objects, open the application and enable the display of the previously generated content within the application. An electronic device according to any one of claims 309 to 336, configured as such.
338. An electronic device according to any one of claims 309 to 337, wherein the one or more quick action objects include respective quick action objects corresponding to quick actions selected based on recent activities within the first application.
339. An electronic device according to any one of claims 309 to 338, wherein the one or more quick action objects include respective quick action objects dynamically determined based on the current position of the device.
340. In an electronic device comprising a display and one or more input devices, Displaying a first user interface on the display, the first user interface including a plurality of user interface objects, each user interface object being associated with a set of menu options corresponding thereto; Detecting a first input corresponding to a request to display menu options for a first user interface object of the plurality of user interface objects by the one or more input devices; In response to detecting the first input, displaying menu items within a menu corresponding to the first user interface object, wherein displaying the menu comprises: Displaying the menu items within the menu corresponding to the first user interface object in a first order according to a determination that the first user interface object is at a first position within the first user interface; Displaying the menu items within the menu corresponding to the first user interface object in a second order different from the first order according to a determination that the first user interface object is at a second position within the first user interface, the second position being different from the first position; A method comprising the above.
341. The method according to claim 340, wherein the second order is opposite to the first order.
342. According to a determination that the first user interface object is at the first position within the first user interface, extending the menu corresponding to the first user interface object in a first direction away from the first user interface object; According to a determination that the first user interface object is at the second position, extending the menu corresponding to the first user interface object in a second direction different from the first direction away from the first user interface object; The method according to claim 340 or 341, comprising the above.
343. The menu items within the menu corresponding to the first user interface object have associated priorities relative to each other. The method according to any one of claims 340 to 342, wherein the menu item with the highest priority in the menu is displayed closest to the first user interface object.
344. A plurality of menu items in the menu corresponding to the first user interface object each include their respective graphic and their respective text, The method according to any one of claims 340 to 343, wherein the displayed arrangement of the respective graphics and the respective texts of the plurality of menu items in the menu is determined based on the position of the first user interface object in the first user interface.
345. The method according to claim 344, wherein according to the determination that the first user interface object is in the first position, the respective texts of the menu items are arranged to the right of the respective graphics of the menu items in the menu corresponding to the first user interface object.
346. The method according to claim 344 or 345, wherein according to the determination that the first user interface object is in the second position, the respective texts of the menu items are arranged to the left of the respective graphics of the menu items in the menu corresponding to the first user interface object.
347. The method according to any one of claims 344 to 346, wherein according to the determination that the first user interface object is in the third position, the respective texts of the menu items are arranged to the left of the respective graphics of the menu items in the menu corresponding to the first user interface object, and the menu items in the menu are arranged in the first order.
348. The method according to any one of claims 344 to 347, wherein according to the determination that the first user interface object is in the fourth position, the respective texts of the menu items are arranged to the right of the respective graphics of the menu items in the menu corresponding to the first user interface object, and the menu items in the menu are arranged in the second order.
349. The first user interface object includes respective icon graphics, The method according to any one of claims 344 to 348, wherein the respective icon graphics of the first user interface object are aligned with the respective graphics of the menu items in the menu corresponding to the first user interface object.
350. The plurality of user interface objects are arranged within a grid in the first user interface, The first user interface object is located at a first position within the grid, The method according to any one of claims 340 to 349, wherein the menu extends vertically in respective directions and horizontally in respective directions with respect to the first user interface object so as to cover a part of the first user interface without covering the first user interface object at the first position.
351. The method according to any one of claims 340 to 350, including visually emphasizing the first user interface object with respect to other user interface objects within the plurality of user interface objects in the first user interface while displaying the menu corresponding to the first user interface object.
352. The first user interface object is an application launch icon, The method according to any one of claims 340 to 351, wherein the menu for the first user interface object includes menu items that, when activated, initiate a process of sending acquisition information for the application corresponding to the application launch icon to a second electronic device.
353. Receiving, by an operating system of the electronic device, menu generation data including the menu items to be included in the menu for the first user interface object and priority information associated with the menu items to be included in the menu for the first user interface object from an application associated with the first user interface object. The operating system generates the menu for the first user interface object for display on the first user interface based on the menu generation data received from the application associated with the first user interface object. The method according to any one of claims 340 to 352, including the above.
354. Moving the first user interface object on the first user interface from the first position to a new position within the first user interface different from the first position. After moving the first user interface object to the new position within the first user interface. Detecting a second input corresponding to a second request to display menu options for the first user interface object by the one or more input devices. In response to detecting the second input, displaying the menu items in the menu corresponding to the first user interface object in a new order different from the first order according to the new position of the first user interface object. The method according to any one of claims 340 to 353, including the above.
355. The method according to any one of claims 340 to 354, wherein the first user interface object is an application icon corresponding to a first application program.
356. While displaying the menu items in the menu corresponding to the first user interface object. Detecting a second input corresponding to a request to select the first user interface object. In response to detecting the second input corresponding to the request to select the first user interface object. Starting the first application program. Stopping the display of the first user interface and the menu corresponding to the first user interface object. The method according to claim 355, including the above.
357. While displaying the first user interface without displaying the menu corresponding to the first user interface object, each input corresponding to a request to select the first user interface starts the first application program, the method according to claim 356.
358. While displaying the menu items in the menu corresponding to the first user interface object, detecting a first portion of a third input corresponding to a request to enter a user interface reconfiguration mode; in response to detecting the first portion of the third input corresponding to the request to enter the user interface reconfiguration mode, entering the user interface reconfiguration mode, stopping the display of the menu corresponding to the first user interface object, The method according to any one of claims 340 to 357, comprising:
359. During the user interface reconfiguration mode, detecting a second portion of the third input corresponding to a request to move the first user interface object from a first position within the first user interface to a second position within the first user interface, reconfiguring the first user interface in response to detecting the second portion of the third input corresponding to the request to move the first user interface object from the first position within the first user interface to the second position within the first user interface, The method according to claim 358, comprising:
360. While displaying the first user interface without displaying the menu corresponding to the first user interface object, each input corresponding to a request to enter the user interface reconfiguration mode causes the electronic device to enter the reconfiguration mode, the method according to claim 359.
361. While displaying the menu items in the menu corresponding to the first user interface object, adding a visual effect that obscures one or more user interface objects of the plurality of user interface objects other than the first user interface object, the method according to any one of claims 340 to 360.
362. An electronic device, a display, a touch sensing surface, one or more sensors for detecting the intensity of contact with the touch sensing surface, one or more processors, a memory, and one or more programs, wherein the one or more programs are stored in the memory and configured to be executed by the one or more processors, and the one or more programs cause the device to display a first user interface including a plurality of user interface objects on the display, each user interface object being associated with a set of menu options corresponding thereto, detect a first input corresponding to a request to display menu options for a first user interface object of the plurality of user interface objects by the one or more input devices, and in response to detecting the first input, display menu items within a menu corresponding to the first user interface object, wherein displaying the menu includes displaying the menu items within the menu corresponding to the first user interface object in a first order according to a determination that the first user interface object is at a first position within the first user interface, and displaying the menu items within the menu corresponding to the first user interface object in a second order different from the first order according to a determination that the first user interface object is at a second position within the first user interface different from the first position. An electronic device comprising the above.
363. A computer-readable storage medium storing one or more programs, wherein when the one or more programs are executed by an electronic device comprising a display, a touch sensing surface, and one or more sensors for detecting the intensity of contact with the touch sensing surface, the device is caused to display a first user interface including a plurality of user interface objects on the display, each user interface object being associated with a set of menu options corresponding thereto. Cause the one or more input devices to detect a first input corresponding to a request to display menu options for a first user interface object of the plurality of user interface objects. In response to detecting the first input, cause menu items within a menu corresponding to the first user interface object to be displayed. Include instructions, and displaying the menu comprises: In accordance with a determination that the first user interface object is at a first position within the first user interface, display the menu items within the menu corresponding to the first user interface object in a first order. In accordance with a determination that the first user interface object is at a second position within the first user interface, different from the first position, display the menu items within the menu corresponding to the first user interface object in a second order different from the first order. A computer-readable storage medium comprising the above.
364. An electronic device, comprising: A display; A touch-sensitive surface; One or more sensors for detecting the intensity of contact with the touch-sensitive surface; Means for displaying a first user interface including a plurality of user interface objects, each user interface object being associated with a set of menu options corresponding thereto, on the display; Means for detecting, by the one or more input devices, a first input corresponding to a request to display menu options for a first user interface object of the plurality of user interface objects; Means for displaying menu items within a menu corresponding to the first user interface object in response to detecting the first input; Wherein displaying the menu comprises: In accordance with a determination that the first user interface object is at a first position within the first user interface, display the menu items within the menu corresponding to the first user interface object in a first order. In accordance with a determination that the first user interface object is at a second position within the first user interface that is different from the first position, displaying the menu item within the menu corresponding to the first user interface object in a second order that is different from the first order; An electronic device comprising the above.
365. An electronic device, comprising: A display; A touch sensing surface; One or more sensors for detecting the intensity of contact with the touch sensing surface; One or more processors; A memory; One or more programs, wherein the one or more programs are stored in the memory and configured to be executed by the one or more processors, and the one or more programs include instructions for executing any of the methods according to Claims 340 to 361. An electronic device.
366. A computer-readable storage medium storing one or more programs, wherein when the one or more programs are executed by an electronic device comprising a display, a touch sensing surface, and one or more sensors for detecting the intensity of contact with the touch sensing surface, the device is caused to execute any of the methods according to Claims 340 to 361. A computer-readable storage medium.
367. A graphical user interface on an electronic device comprising a display, a touch sensing surface, one or more sensors for detecting the intensity of contact with the touch sensing surface, a memory, and one or more processors for executing one or more programs stored in the memory, the graphical user interface comprising a user interface displayed according to any of the methods according to Claims 340 to 361.
368. An electronic device, comprising: A display; A touch sensing surface; One or more sensors for detecting the intensity of contact with the touch sensing surface; Means for executing any of the methods according to Claims 340 to 361. An electronic device.
369. An electronic device, comprising: A user interface and a display unit configured to display user interface objects; A touch sensing surface unit configured to receive input; One or more sensor units configured to detect the intensity of contact with the touch sensing surface unit; A display unit, a touch sensing surface unit, and a processing unit coupled to the one or more sensor units, the processing unit Enabling display of a first user interface including a plurality of user interface objects on the display unit, each user interface object being associated with a set of menu options corresponding thereto; Detecting a first input corresponding to a request to display menu options for a first user interface object of the plurality of user interface objects by the one or more input devices; Enabling display of menu items within a menu corresponding to the first user interface object in response to detecting the first input; Configured such that displaying the menu Includes displaying the menu items within the menu corresponding to the first user interface object in a first order according to a determination that the first user interface object is at a first position within the first user interface; Displaying the menu items within the menu corresponding to the first user interface object in a second order different from the first order according to a determination that the first user interface object is at a second position within the first user interface different from the first position; An electronic device including.
370. The electronic device according to claim 369, wherein the second order is opposite to the first order.
371. The processing unit According to a determination that the first user interface object is at the first position within the first user interface, extending the menu corresponding to the first user interface object in a first direction away from the first user interface object; In accordance with the determination that the first user interface object is at the second position, the menu corresponding to the first user interface object is extended in a second direction different from the first direction so as to be separated from the first user interface object. An electronic device according to claim 369 or 370, configured as described above.
372. The menu items in the menu corresponding to the first user interface object have associated priorities with respect to each other. An electronic device according to any one of claims 369 to 371, wherein the menu item with the highest priority in the menu is displayed closest to the first user interface object.
373. A plurality of menu items in the menu corresponding to the first user interface object each include their respective graphic and their respective text. An electronic device according to any one of claims 369 to 372, wherein the displayed arrangement of the respective graphics and the respective texts of the plurality of menu items in the menu is determined based on the position of the first user interface object in the first user interface.
374. In accordance with the determination that the first user interface object is at the first position, the respective texts of the menu items are arranged to the right of the respective graphics of the menu items in the menu corresponding to the first user interface object. An electronic device according to claim 373.
375. In accordance with the determination that the first user interface object is at the second position, the respective texts of the menu items are arranged to the left of the respective graphics of the menu items in the menu corresponding to the first user interface object. An electronic device according to claim 373 or 374.
376. According to the determination that the first user interface object is in the third position, each of the texts of the menu items is arranged to the left of the respective graphic of the menu items in the menu corresponding to the first user interface object, and the menu items in the menu are arranged in the first order. The electronic device according to any one of claims 373 to 375.
377. According to the determination that the first user interface object is in the fourth position, each of the texts of the menu items is arranged to the right of the respective graphic of the menu items in the menu corresponding to the first user interface object, and the menu items in the menu are arranged in the second order. The electronic device according to any one of claims 373 to 376.
378. The first user interface object includes respective icon graphics, Each of the icon graphics of the first user interface object is aligned with the respective graphic of the menu items in the menu corresponding to the first user interface object. The electronic device according to any one of claims 373 to 377.
379. The plurality of user interface objects are arranged within a grid in the first user interface, The first user interface object is located at a first position within the grid, The menu extends vertically in each direction and horizontally in each direction with respect to the first user interface object so as to cover a part of the first user interface without covering the first user interface object at the first position. The electronic device according to any one of claims 369 to 378.
380. The processing unit is While displaying the menu corresponding to the first user interface object, the first user interface object is configured to be visually emphasized with respect to other user interface objects within the plurality of user interface objects in the first user interface. The electronic device according to any one of claims 369 to 379.
381. The first user interface object is an application launch icon, When the menu for the first user interface object is activated, the menu item includes a process of sending acquisition information for the application corresponding to the application launch icon to a second electronic device. The electronic device according to any one of claims 369 to 380.
382. The processing unit, Receives menu generation data including the menu items to be included in the menu for the first user interface object and priority information associated with the menu items to be included in the menu for the first user interface object from the application associated with the first user interface object by the operating system of the electronic device, Generates the menu for the first user interface object for display on the first user interface based on the menu generation data received from the application associated with the first user interface object by the operating system. The electronic device according to any one of claims 369 to 381, configured as follows.
383. The processing unit, Moves the first user interface object on the first user interface from the first position to a new position within the first user interface that is different from the first position, After moving the first user interface object to the new position within the first user interface, Detects a second input corresponding to a second request to display menu options for the first user interface object by the one or more input devices. In response to detecting the second input, enable display of the menu items in the menu corresponding to the first user interface object in a new order different from the first order according to the new position of the first user interface object. An electronic device according to any one of claims 369 to 382, configured as described above. **Claim 384** The electronic device according to any one of claims 369 to 383, wherein the first user interface object is an application icon corresponding to a first application program. **Claim 385** The processing unit, while displaying the menu items in the menu corresponding to the first user interface object, detect a second input corresponding to a request to select the first user interface object, in response to detecting the second input corresponding to the request to select the first user interface object, launch the first application program, and stop displaying the first user interface and the menu corresponding to the first user interface object. An electronic device according to claim 384, configured as described above. **Claim 386** While displaying the first user interface without displaying the menu corresponding to the first user interface object, each input corresponding to a request to select the first user interface object launches the first application program. The electronic device according to claim 385. **Claim 387** The processing unit, while displaying the menu items in the menu corresponding to the first user interface object, detect a first part of a third input corresponding to a request to enter a user interface reconfiguration mode, in response to detecting the first part of the third input corresponding to the request to enter the user interface reconfiguration mode, enter the user interface reconfiguration mode, and stop displaying the first user interface and the menu corresponding to the first user interface object. An electronic device according to any one of claims 384 to 386, configured as described above. **Claim 388** The processing unit, During the user interface reconfiguration mode, detecting a second portion of the third input corresponding to a request to move the first user interface object from a first position on the first user interface to a second position on the user interface, reconfiguring the first user interface in response to detecting the second portion of the third input corresponding to a request to move the first user interface object from the first position on the first user interface to the second position on the first user interface, The electronic device according to claim 387, configured as described above.
389. While displaying the first user interface without displaying the menu corresponding to the first user interface object, each input corresponding to a request to enter the user interface reconfiguration mode causes the electronic device to enter the reconfiguration mode. The electronic device according to claim 388.
390. The processing unit is configured to apply a visual effect that obscures one or more user interface objects of the plurality of user interface objects other than the first user interface object while displaying the menu items in the menu corresponding to the first user interface object. The electronic device according to any one of claims 369 to 389.
391. In an electronic device comprising a display, a touch sensing surface, and one or more sensors for detecting the intensity of contact on the touch sensing surface, displaying on the display a user interface including selectable user interface objects associated with a plurality of actions including a direct selection action and one or more other actions for interacting with the user interface; detecting an input including detecting a contact on the touch sensing surface while a focus selector is on the selectable user interface object while displaying the user interface including the selectable user interface objects; in response to detecting the input including detecting the contact, In accordance with the determination that the input meets the selection criteria, display a menu on the display that includes a graphical representation of the plurality of actions including the direct selection action and the one or more other actions. Execute the direct selection action in accordance with the determination that the input meets the direct selection criteria, the direct selection criteria including criteria that are met when the characteristic intensity of the contact increases above respective intensity thresholds. A method comprising the above.
392. The method according to claim 391, wherein each of the direct selection action and the one or more other actions is individually selectable within the menu displayed on the user interface.
393. The method according to claim 391 or 392, wherein the menu is displayed after lift-off of the contact is detected.
394. The method according to claim 391 or 392, wherein the menu is displayed when the characteristic intensity of the contact reaches a first intensity value that is lower than the respective intensity thresholds used for the direct selection criteria.
395. Displaying the menu including the graphical representation of the plurality of actions including the direct selection action and the one or more other actions includes applying a visual effect that visually distinguishes the direct selection action from the one or more other actions within the menu. The method according to any one of claims 391 to 394.
396. Displaying the menu including the graphical representation of the plurality of actions including the direct selection action and the one or more other actions includes gradually presenting the menu in accordance with an increase in the intensity of the contact. The method according to any one of claims 391 to 395.
397. In accordance with the determination that the input meets the direct selection criteria, applying a second visual effect to the direct selection action that visually distinguishes the direct selection action from the one or more other actions within the menu. The method according to any one of claims 391 to 396.
398. In accordance with the determination that the input meets the direct selection criteria, gradually fading out the other actions so as to visually emphasize the direct selection action within the menu. The method according to any one of claims 391 to 397.
399. The method according to any one of claims 391 to 398, comprising gradually reducing the menu so as to hide the other actions in the menu while the direct selection action is displayed in the menu according to the determination that the input meets the direct selection criteria.
400. The method according to any one of claims 391 to 399, comprising moving the direct selection action closer to the focus selector according to the determination that the input meets the direct selection criteria.
401. According to the determination that the input meets the selection criteria, while displaying the menu, detecting the end of the input, detecting a second input, including detecting a second contact on the touch-sensitive surface while the focus selector is outside the displayed menu, stopping the display of the menu in response to detecting the second input, The method according to any one of claims 391 to 400, comprising.
402. The method according to any one of claims 391 to 401, wherein the menu is displayed superimposed on a part of the user interface and adjacent to the selectable user interface object.
403. According to the determination that the input meets the selection criteria, while displaying the menu, detecting the movement of the contact corresponding to the movement of the focus selector onto the first action of the one or more other actions, performing the first action in response to detecting the movement of the contact, The method according to any one of claims 391 to 402, comprising.
404. The method according to any one of claims 391 to 403, wherein performing the direct selection action includes updating the user interface.
405. The method according to any one of claims 391 to 404, wherein the selectable user interface object corresponds to a message interface, and the menu includes a reply action as the direct selection action and a reply-to-all action and a forward action as the other actions.
406. The method according to any one of claims 391 to 404, wherein the selectable user interface object corresponds to a camera icon, and the menu includes a still camera mode as the direct selection action and a video camera mode and a panorama mode as the other actions.
407. An electronic device, A display, A touch sensing surface, One or more sensors for detecting the intensity of contact with the touch sensing surface, One or more processors, A memory, One or more programs, which are stored in the memory and configured to be executed by the one or more processors, and the one or more programs are To display on the display a user interface including selectable user interface objects associated with a plurality of actions including a direct selection action and one or more other actions for interacting with the user interface, While displaying the user interface including the selectable user interface object, detect an input including detecting contact on the touch sensing surface while a focus selector is on the selectable user interface object, In response to detecting the input including detecting the contact, According to a determination that the input meets a selection criterion, display on the display a menu including a graphical representation of the plurality of actions including the direct selection action and the one or more other actions, Execute the direct selection action according to a determination that the input meets a direct selection criterion including a criterion that is met when the characteristic intensity of the contact increases above respective intensity thresholds. An electronic device including instructions for
408. A computer-readable storage medium storing one or more programs, wherein when the one or more programs are executed by an electronic device including a display, a touch sensing surface, and one or more sensors for detecting the intensity of contact with the touch sensing surface, the device is caused to Display a user interface on the display, the user interface including selectable user interface objects associated with a plurality of actions, including a direct selection action and one or more other actions, for interacting with the user interface. While displaying the user interface including the selectable user interface objects, detect an input including detecting contact on the touch sensing surface while a focus selector is on the selectable user interface object. In response to detecting the input including detecting the contact. According to a determination that the input meets a selection criterion, display a menu on the display, the menu including a graphical representation of the plurality of actions including the direct selection action and the one or more other actions. Execute the direct selection action according to a determination that the input meets a direct selection criterion, the direct selection criterion including a criterion that is met when the characteristic intensity of the contact increases above respective intensity thresholds. A computer-readable storage medium including instructions.
409. An electronic device, A display, A touch sensing surface, One or more sensors for detecting the intensity of contact with the touch sensing surface, Means for displaying on the display a user interface including selectable user interface objects associated with a plurality of actions, including a direct selection action and one or more other actions, for interacting with the user interface. Means for detecting an input including detecting contact on the touch sensing surface while a focus selector is on the selectable user interface object while displaying the user interface including the selectable user interface objects. In response to detecting the input including detecting the contact. According to a determination that the input meets a selection criterion, means for displaying on the display a menu including a graphical representation of the plurality of actions including the direct selection action and the one or more other actions. Means for executing the direct selection action according to a determination that the input meets a direct selection criterion, the direct selection criterion including a criterion that is met when the characteristic intensity of the contact increases above respective intensity thresholds. An electronic device comprising...
410. An electronic device, a display, a touch sensing surface, one or more sensors for detecting the intensity of contact with the touch sensing surface, one or more processors, a memory, one or more programs, and is configured such that the one or more programs are stored in the memory and executed by the one or more processors, and the one or more programs include instructions for executing any of the methods according to Claims 391 to 406. An electronic device.
411. A computer-readable storage medium storing one or more programs, wherein when the one or more programs are executed by an electronic device comprising a display, a touch sensing surface, and one or more sensors for detecting the intensity of contact with the touch sensing surface, the device includes instructions for causing the device to execute any of the methods according to Claims 391 to 406. A computer-readable storage medium.
412. A graphical user interface on an electronic device comprising a display, a touch sensing surface, one or more sensors for detecting the intensity of contact with the touch sensing surface, a memory, and one or more processors for executing one or more programs stored in the memory, the graphical user interface comprising a user interface displayed according to any of the methods according to Claims 391 to 406. A graphical user interface.
413. An electronic device, a display, a touch sensing surface, one or more sensors for detecting the intensity of contact with the touch sensing surface, means for executing any of the methods according to Claims 391 to 406. An electronic device.
414. An electronic device, a user interface and a display unit configured to display user interface objects, a touch sensing surface unit configured to receive an input, one or more sensor units configured to detect the intensity of contact with the touch sensing surface unit, a processing unit coupled to the display unit, the touch sensing surface unit, and the one or more sensor units, and the processing unit... Enable the display of a user interface including selectable user interface objects associated with a plurality of actions, including a direct selection action and one or more other actions, for interacting with the user interface on the display unit. While displaying the user interface including the selectable user interface objects, detect an input including detecting a contact on the touch sensing surface unit while a focus selector is on the selectable user interface object. In response to detecting the input including detecting the contact. According to the determination that the input meets the selection criteria, enable the display of a menu including a graphical representation of the plurality of actions including the direct selection action and the one or more other actions on the display unit. Execute the direct selection action according to the determination that the input meets the direct selection criteria including a criteria that is met when the characteristic strength of the contact increases above respective strength thresholds. An electronic device configured as described above.
415. The electronic device according to claim 414, wherein each of the direct selection action and the one or more other actions is individually selectable within the menu displayed on the user interface.
416. The electronic device according to claim 414 or 415, wherein the menu is displayed after a lift-off of the contact is detected.
417. The electronic device according to claim 414 or 415, wherein the menu is displayed when the characteristic strength of the contact reaches a first strength value lower than the respective strength thresholds used for the direct selection criteria.
418. The electronic device according to any one of claims 414 to 417, wherein displaying the menu including the graphical representation of the plurality of actions including the direct selection action and the one or more other actions includes applying a visual effect that visually distinguishes the direct selection action from the one or more other actions within the menu.
419. Displaying the menu, including a graphical representation of the plurality of actions including the direct selection action and the one or more other actions, includes gradually presenting the menu in accordance with an increase in the intensity of the contact. The electronic device according to any one of claims 414 to 418.
420. The processing unit is configured to apply a second visual effect to the direct selection action to visually distinguish the direct selection action from the one or more other actions in the menu according to a determination that the input meets the direct selection criteria. The electronic device according to any one of claims 414 to 419.
421. The processing unit is configured to gradually fade out the other actions so as to visually emphasize the direct selection action in the menu according to a determination that the input meets the direct selection criteria. The electronic device according to any one of claims 414 to 420.
422. The processing unit is configured to gradually shrink the menu so as to hide the other actions in the menu while the direct selection action is being displayed in the menu according to a determination that the input meets the direct selection criteria. The electronic device according to any one of claims 414 to 421.
423. The processing unit is configured to move the direct selection action closer to the focus selector according to a determination that the input meets the direct selection criteria. The electronic device according to any one of claims 414 to 422.
424. The processing unit is configured, according to a determination that the input meets the selection criteria, while displaying the menu, to detect the end of the input, to detect a second input including detecting a second contact on the touch sensing surface unit while the focus selector is outside the displayed menu, and to stop the display of the menu in response to detecting the second input. The electronic device according to any one of claims 414 to 423.
425. The electronic device according to any one of claims 414 to 424, wherein the menu is displayed superimposed on a part of the user interface and adjacent to the selectable user interface object.
426. wherein the processing unit, while displaying the menu in accordance with a determination that the input meets a selection criterion, detects movement of the contact corresponding to movement of the focus selector onto a first action of the one or more other actions, and executes the first action in response to detecting the movement of the contact; An electronic device according to any one of claims 414 to 425, configured as such.
427. An electronic device according to any one of claims 414 to 426, wherein executing the direct selection action includes updating the user interface.
428. An electronic device according to any one of claims 414 to 427, wherein the selectable user interface object corresponds to a message interface, and the menu includes a reply action as the direct selection action and a reply-to-all action and a forward action as the other actions.
429. An electronic device according to any one of claims 414 to 427, wherein the selectable user interface object corresponds to a camera icon, and the menu includes a still camera mode as the direct selection action and a video camera mode and a panorama mode as the other actions.
430. In an electronic device comprising a display, a touch-sensitive surface, and one or more sensors for detecting the intensity of a contact on the touch-sensitive surface, displaying a user interface including a plurality of user interface objects associated with respective object-specific actions triggered by a change in contact intensity on the display, the plurality of user interface objects including a first object displayed at a first position within the user interface and a second object displayed at a second position within the user interface; detecting a first input including detecting a first contact on the touch-sensitive surface and detecting an increase in a characteristic intensity of the first contact that exceeds a first intensity threshold while displaying the user interface including the plurality of user interface objects; in response to detecting the first input, Performing a first operation associated with the first object, including displaying additional information associated with the first object on the display according to a determination that the focus selector is at the first position within the user interface where the first object is displayed. Performing a second operation associated with the second object, separate from the first operation associated with the first object, including displaying additional information associated with the second object on the display according to a determination that the focus selector is at the second position within the user interface where the second object is displayed. Performing a third operation, including updating the user interface on the display to visually distinguish the first and second objects within the user interface simultaneously according to a determination that the focus selector is at a position within the user interface away from any object associated with an object-specific operation triggered by a change in contact intensity. A method, comprising the above.
431. The method according to claim 430, wherein the first operation associated with the first object includes emphasizing the first object relative to the second object.
432. The method according to claim 430 or 431, wherein the second operation associated with the second object includes emphasizing the second object relative to the first object.
433. The method according to any one of claims 430 to 432, wherein the third operation includes emphasizing the first object and the second object.
434. The method according to claim 433, wherein emphasizing in the third operation includes emphasizing the first object in the same way as the first operation emphasizes the first object, and emphasizing the second object in the same way as the second operation emphasizes the second object.
435. The method according to any one of claims 431 to 434, wherein the amount of visual effect added to emphasize the first object with respect to the second object is dynamically changed according to the current change in the characteristic strength of the contact.
436. The method according to any one of claims 430 to 435, wherein the first object is associated with a first type of intensity trigger operation.
437. The method according to claim 436, wherein the second object is associated with a second type of intensity trigger operation, which is separate from the first type of intensity trigger operation.
438. The method according to any one of claims 430 to 435, wherein the first object is associated with a first type of intensity trigger operation for showing first content associated with the first object.
439. The method according to claim 438, wherein the second object is associated with a first type of intensity trigger operation for showing second content associated with the second object.
440. The method according to any one of claims 430 to 439, wherein the first object is associated with a first type of action API associated with a change in contact intensity.
441. Performing the first operation associated with the first object includes presenting first information corresponding to the first object when the characteristic strength of the contact increases above the first intensity threshold; and presenting second information, which is separate from the first information, corresponding to the first object when the characteristic strength of the contact increases above a second intensity threshold that is greater than the first intensity threshold. The method according to any one of claims 430 to 440.
442. The method according to claim 441, wherein the first information corresponding to the first object is a preview associated with the first object, and the second information corresponding to the first object is a second user interface associated with the first object.
443. Performing the second operation associated with the second object includes presenting first information corresponding to the second object when the characteristic intensity of the contact increases beyond the first intensity threshold; executing an action represented within the first information corresponding to the second object when the characteristic intensity of the contact increases beyond a second intensity threshold greater than the first intensity threshold; The method according to any one of claims 430 to 442, comprising: **Claim 444** The method according to claim 443, wherein the first information corresponding to the second object is an action menu associated with the second object, and the action represented within the first information corresponding to the second object is a direct selection action represented within the action menu associated with the second object. **Claim 445** detecting a second contact on the touch-sensing surface while the user interface is displayed on the display, and subsequently detecting a lift-off of the second contact without detecting an increase in the characteristic intensity of the second contact beyond the first intensity threshold, thereby detecting a second input; in response to detecting the second input, executing a second action associated with the first object, distinct from the first action associated with the first object, according to a determination that the focus selector is at the first position within the user interface where the first object is displayed; executing a fourth action corresponding to a user interface element within the remainder of the user interface according to a determination that the focus selector is at a position within the user interface away from any object, associated with an object-specific action triggered by a change in contact intensity; The method according to any one of claims 430 to 444, comprising: **Claim 446** An electronic device, comprising: a display; a touch-sensing surface; one or more sensors for detecting the intensity of contact with the touch-sensing surface; one or more processors; a memory; one or more programs, stored in the memory and configured to be executed by the one or more processors, the one or more programs comprising Display a user interface including a plurality of user interface objects associated with respective object-specific operations triggered by changes in contact intensity on the display, wherein the plurality of user interface objects include a first object displayed at a first position within the user interface and a second object displayed at a second position within the user interface, While displaying the user interface including the plurality of user interface objects, detect a first input including detecting a first contact on the touch-sensitive surface and detecting an increase in the characteristic intensity of the first contact that exceeds a first intensity threshold, In response to detecting the first input, Execute a first operation associated with the first object, including displaying additional information associated with the first object on the display according to a determination that the focus selector is at the first position within the user interface where the first object is displayed, Execute a second operation associated with the second object, separate from the first operation associated with the first object, including displaying additional information associated with the second object on the display according to a determination that the focus selector is at the second position within the user interface where the second object is displayed, Execute a third operation including updating the user interface on the display so as to visually distinguish the first and second objects within the user interface simultaneously according to a determination that the focus selector is at a position within the user interface away from any object associated with an object-specific operation triggered by a change in contact intensity, An electronic device comprising instructions for.
447. A computer-readable storage medium storing one or more programs, which, when executed by an electronic device provided with a display, a touch-sensitive surface, and one or more sensors for detecting the intensity of contact with the touch-sensitive surface, cause the device to, Display a user interface that includes a plurality of user interface objects associated with respective object-specific operations triggered by changes in contact intensity on the display, wherein the plurality of user interface objects include a first object displayed at a first position within the user interface and a second object displayed at a second position within the user interface. While displaying the user interface that includes the plurality of user interface objects, detect a first input that includes detecting a first contact on the touch-sensing surface and detecting an increase in the characteristic intensity of the first contact that exceeds a first intensity threshold. In response to detecting the first input, Cause a first operation associated with the first object to be executed, including displaying additional information associated with the first object on the display according to a determination that the focus selector is at the first position within the user interface where the first object is displayed. Cause a second operation associated with the second object, separate from the first operation associated with the first object, to be executed, including displaying additional information associated with the second object on the display according to a determination that the focus selector is at the second position within the user interface where the second object is displayed. Cause a third operation to be executed, including updating the user interface on the display so as to visually distinguish the first and second objects within the user interface simultaneously according to a determination that the focus selector is at a position within the user interface away from any of the objects associated with object-specific operations triggered by changes in contact intensity. A computer-readable storage medium containing instructions.
448. An electronic device, A display, A touch-sensing surface, One or more sensors for detecting the intensity of contact with the touch-sensing surface Means for displaying a user interface on the display, the user interface including a plurality of user interface objects associated with respective object-specific operations triggered by a change in contact intensity, the plurality of user interface objects including a first object displayed at a first position within the user interface and a second object displayed at a second position within the user interface. Means for detecting a first input, including detecting a first contact on the touch sensing surface and detecting an increase in the characteristic intensity of the first contact that exceeds a first intensity threshold while the user interface including the plurality of user interface objects is being displayed. Means that is enabled in response to detecting the first input. Performing a first operation associated with the first object, including the focus selector displaying additional information associated with the first object on the display according to a determination that the first object is at the first position within the user interface where the first object is displayed. Performing a second operation associated with the second object, separate from the first operation associated with the first object, including the focus selector displaying additional information associated with the second object on the display according to a determination that the second object is at the second position within the user interface where the second object is displayed. Means for performing a third operation, including the focus selector updating the user interface on the display so as to visually distinguish the first and second objects within the user interface simultaneously according to a determination that the focus selector is at a position within the user interface that is away from any of the objects associated with object-specific operations triggered by a change in contact intensity. An electronic device comprising the above.
449. An electronic device, comprising: A display; A touch sensing surface; One or more sensors for detecting the intensity of contact with the touch sensing surface; One or more processors; A memory; An electronic device comprising: one or more programs, wherein the one or more programs are stored in the memory and configured to be executed by the one or more processors, and the one or more programs include instructions for executing any of the methods according to claims 430 to 445.
450. A computer-readable storage medium storing one or more programs, wherein when the one or more programs are executed by an electronic device comprising a display, a touch-sensitive surface, and one or more sensors for detecting the intensity of contact with the touch-sensitive surface, the device is caused to execute any of the methods according to claims 430 to 445.
451. A graphical user interface on an electronic device comprising a display, a touch-sensitive surface, one or more sensors for detecting the intensity of contact with the touch-sensitive surface, a memory, and one or more processors for executing one or more programs stored in the memory, the graphical user interface comprising a user interface displayed according to any of the methods according to claims 430 to 445.
452. An electronic device, comprising a display, a touch-sensitive surface, one or more sensors for detecting the intensity of contact with the touch-sensitive surface, and means for executing any of the methods according to claims 430 to 445.
453. An electronic device, comprising a user interface and a display unit configured to display user interface objects, a touch-sensitive surface unit configured to receive an input, one or more sensor units configured to detect the intensity of contact with the touch-sensitive surface unit, and a processing unit coupled to the display unit, the touch-sensitive surface unit, and the one or more sensor units, wherein the processing unit Enable the display of a user interface including a plurality of user interface objects associated with respective object-specific operations triggered by changes in contact intensity on the display unit, the plurality of user interface objects including a first object displayed at a first position within the user interface and a second object displayed at a second position within the user interface, Detect a first input including detecting a first contact on the touch sensing surface unit and detecting an increase in the characteristic intensity of the first contact that exceeds a first intensity threshold while enabling the display of the user interface including the plurality of user interface objects, In response to detecting the first input, Execute a first operation associated with the first object, including displaying additional information associated with the first object on the display unit according to a determination that the focus selector is at the first position within the user interface where the first object is displayed, Execute a second operation associated with the second object, separate from the first operation associated with the first object, including displaying additional information associated with the second object on the display unit according to a determination that the focus selector is at the second position within the user interface where the second object is displayed, Execute a third operation including updating the user interface on the display unit to visually distinguish the first and second objects within the user interface simultaneously according to a determination that the focus selector is at a position within the user interface away from any of the objects associated with object-specific operations triggered by changes in contact intensity, An electronic device configured as such.
454. The electronic device according to claim 453, wherein the first operation associated with the first object includes emphasizing the first object with respect to the second object.
455. The electronic device according to claim 453 or 454, wherein the second operation associated with the second object includes emphasizing the second object with respect to the first object.
456. The electronic device according to any one of claims 453 to 455, wherein the third operation includes emphasizing the first object and the second object.
457. The electronic device according to claim 456, wherein emphasizing in the third operation includes emphasizing the first object in the same way as the first operation emphasizes the first object, and emphasizing the second object in the same way as the second operation emphasizes the second object.
458. The electronic device according to any one of claims 454 to 457, wherein the amount of the visual effect added to emphasize the first object with respect to the second object is dynamically changed according to the current change in the characteristic intensity of the contact.
459. The electronic device according to any one of claims 453 to 458, wherein the first object is associated with a first type of intensity trigger operation.
460. The electronic device according to claim 459, wherein the second object is associated with a second type of intensity trigger operation, which is separate from the first type of intensity trigger operation.
461. The electronic device according to any one of claims 453 to 458, wherein the first object is associated with a first type of intensity trigger operation for presenting first content associated with the first object.
462. The electronic device according to claim 461, wherein the second object is associated with a first type of intensity trigger operation for presenting second content associated with the second object.
463. The electronic device according to any one of claims 453 to 462, wherein the first object is associated with a first type of action API associated with a change in contact intensity.
464. Executing the first operation associated with the first object is presenting first information corresponding to the first object when the characteristic intensity of the contact increases above the first intensity threshold; When the characteristic strength of the contact increases beyond a second strength threshold that is greater than the first strength threshold, presenting second information, separate from the first information, corresponding to the first object; An electronic device according to any one of claims 453 to 463, including this.
465. The electronic device according to claim 464, wherein the first information corresponding to the first object is a preview associated with the first object, and the second information corresponding to the first object is a second user interface associated with the first object.
466. Executing the second operation associated with the second object, When the characteristic strength of the contact increases beyond the first strength threshold, presenting first information corresponding to the second object; When the characteristic strength of the contact increases beyond a second strength threshold that is greater than the first strength threshold, executing an action represented within the first information corresponding to the second object; An electronic device according to any one of claims 453 to 465, including this.
467. The electronic device according to claim 466, wherein the first information corresponding to the second object is an action menu associated with the second object, and the action represented within the first information corresponding to the second object is a direct selection action represented within the action menu associated with the second object.
468. The processing unit, While enabling the display on the display unit of the user interface, detecting a second contact on the touch sensing surface unit, and subsequently detecting a lift-off of the second contact without detecting an increase in the characteristic strength of the second contact beyond the first strength threshold, including detecting a second input; In response to detecting the second input, According to the determination that the focus selector is at the first position within the user interface where the first object is displayed, executing a second operation associated with the first object, separate from the first operation associated with the first object; In accordance with the determination that the focus selector is at the position within the user interface that is away from any object associated with an object-specific operation triggered by a change in contact intensity, perform a fourth operation corresponding to a user interface element within the remainder of the user interface. An electronic device according to any one of claims 453 to 467, configured as such. [
469. ] A method, In an electronic device comprising a display, a touch sensing surface, and one or more sensors for detecting the intensity of contact on the touch sensing surface, Displaying a user interface on the display, The user interface includes a set of first user interface elements, For each user interface element within the set of first user interface elements, the device is configured to respond by performing a plurality of operations corresponding to the respective user interface element in response to a user input of a first input type at a position corresponding to the respective user interface element. For the remainder of the user interface, the device is not configured to respond by performing a plurality of operations corresponding to the user interface elements within the remainder of the user interface in response to a user input of the first input type at a position corresponding to the user interface elements within the remainder of the user interface. Detecting a first user input of the first input type while the focus selector is at a first position within the user interface. In response to detecting the first user input of the first input type while the focus selector is at the first position within the user interface, Performing a plurality of operations corresponding to the first user interface element in accordance with the determination that the first position corresponds to a first user interface element within the set of first user interface elements. Adding a visual effect for distinguishing the set of first user interface elements from the remainder of the user interface on the display in accordance with the determination that the first position does not correspond to any user interface element within the set of first user interface elements. A method comprising
470. Determining whether the first position corresponds to the first user interface element within the set of the first user interface elements, including determining whether the first position corresponds to a user interface element having a first type of action API associated with the first input type, the method according to claim 469.
471. The first input type is a pressing input by contact on the touch-sensing surface, The device is configured to respond by performing a first action corresponding to each of the user interface elements when the intensity of the contact exceeds a first intensity threshold with respect to the pressing input by the contact at the position corresponding to each of the user interface elements, The device is configured to respond by performing a second action, distinct from the first action, corresponding to each of the user interface elements when the intensity of the contact exceeds a second intensity threshold greater than the first intensity threshold with respect to the pressing input by the contact at the position corresponding to each of the user interface elements, the method according to claim 469 or 470.
472. The first action is to display a preview associated with each of the user interface elements, The second action is to display a second user interface associated with each of the user interface elements, the method according to claim 471.
473. The first action is to display an action menu associated with each of the user interface elements, The second action is to execute an action represented within the action menu associated with each of the user interfaces, the method according to claim 471.
474. Adding the visual effect to distinguish the set of the first user interface elements from the remainder of the user interface on the display, Including enhancing the appearance of the set of the first user interface elements while maintaining the appearance of the user interface elements within the remainder of the user interface on the display, the method according to any one of claims 469 to 473.
475. Adding the visual effect to distinguish the set of the first user interface elements from the remainder of the user interface on the display, The method according to any one of claims 469 to 473, including obfuscating user interface elements within the remainder of the user interface on the display while maintaining the appearance of the set of the first user interface elements on the display.
476. Adding the visual effect to distinguish the set of the first user interface elements from other user interface elements on the display, Enhancing the appearance of the set of the first user interface elements, Obfuscating user interface elements within the remainder of the user interface on the display, The method according to any one of claims 469 to 473, including.
477. During displaying the user interface on the display, while a focus selector is at the first position within the user interface, detecting a second user input of a second input type, different from the first input type, While the focus selector is at the first position within the user interface, in response to detecting the second user input of the second input type, According to a determination that the first position corresponds to the first user interface element within the set of the first user interface elements, performing an operation corresponding to the first user interface element, According to a determination that the first position corresponds to a user interface element within the remainder of the user interface, performing an operation corresponding to the user interface element within the remainder of the user interface, The method according to any one of claims 469 to 476, including.
478. An electronic device, comprising: A display, A touch sensing surface, One or more sensors for detecting the intensity of contact with the touch sensing surface, One or more processors, A memory, One or more programs, Wherein the one or more programs are stored in the memory and configured to be executed by the one or more processors, and the one or more programs are Display a user interface on the display, wherein the user interface includes a set of first user interface elements, for each user interface element in the set of first user interface elements, the device is configured to respond by performing a plurality of operations corresponding to the respective user interface element to a user input of a first input type at a position corresponding to the respective user interface element, for the remainder of the user interface, the device is not configured to respond by performing a plurality of operations corresponding to the user interface elements in the remainder of the user interface to a user input of the first input type at a position corresponding to the user interface elements in the remainder of the user interface, detect a first user input of the first input type while a focus selector is at a first position within the user interface, in response to detecting the first user input of the first input type while the focus selector is at the first position within the user interface, perform a plurality of operations corresponding to the first user interface element according to a determination that the first position corresponds to a first user interface element within the set of first user interface elements, add a visual effect for distinguishing the set of first user interface elements from the remainder of the user interface on the display according to a determination that the first position does not correspond to any user interface element within the set of first user interface elements, an electronic device comprising instructions for.
479. A computer-readable storage medium storing one or more programs, wherein when the one or more programs are executed by an electronic device comprising a display, a touch-sensitive surface, and one or more sensors for detecting the intensity of contact with the touch-sensitive surface, the device is caused to display a user interface on the display, wherein the user interface includes a set of first user interface elements, For each user interface element within the set of the first user interface elements, the device is configured to respond to a user input of a first input type at a position corresponding to the respective user interface element by performing a plurality of operations corresponding to the respective user interface element. For the remainder of the user interface, the device is not configured to respond to a user input of the first input type at a position corresponding to a user interface element within the remainder of the user interface by performing a plurality of operations corresponding to the user interface element within the remainder of the user interface. While a focus selector is at a first position within the user interface, cause a first user input of the first input type to be detected. In response to detecting the first user input of the first input type while the focus selector is at the first position within the user interface. In accordance with a determination that the first position corresponds to a first user interface element within the set of the first user interface elements, cause a plurality of operations corresponding to the first user interface element to be performed. In accordance with a determination that the first position does not correspond to any user interface element within the set of the first user interface elements, cause a visual effect for distinguishing the set of the first user interface elements from the remainder of the user interface on the display to be added. A computer-readable storage medium including instructions.
480. An electronic device, comprising: A display; A touch-sensitive surface; One or more sensors for detecting an intensity of contact with the touch-sensitive surface; Means for displaying a user interface on the display, wherein The user interface includes a set of first user interface elements, and For each user interface element within the set of the first user interface elements, the device is configured to respond to a user input of a first input type at a position corresponding to the respective user interface element by performing a plurality of operations corresponding to the respective user interface element. means that the device is not configured to respond to user input of the first input type at positions corresponding to user interface elements within the remainder of the user interface by performing a plurality of operations corresponding to the user interface elements within the remainder of the user interface; means for detecting a first user input of the first input type while a focus selector is at a first position within the user interface; means that is enabled in response to detecting the first user input of the first input type while the focus selector is at the first position within the user interface, performing a plurality of operations corresponding to the first user interface element according to a determination that the first position corresponds to a first user interface element within a set of the first user interface elements; means for applying a visual effect for distinguishing the set of the first user interface elements from the remainder of the user interface on the display according to a determination that the first position does not correspond to any user interface element within the set of the first user interface elements; An electronic device comprising the above.
481. An electronic device, a display, a touch sensing surface, one or more sensors for detecting an intensity of contact with the touch sensing surface, one or more processors, a memory, and one or more programs, wherein the one or more programs are stored in the memory and configured to be executed by the one or more processors, and the one or more programs include instructions for causing the device to perform any of the methods according to Claims 469 to 477.
482. A computer-readable storage medium storing one or more programs, wherein the one or more programs, when executed by an electronic device comprising a display, a touch sensing surface, and one or more sensors for detecting an intensity of contact with the touch sensing surface, include instructions for causing the device to perform any of the methods according to Claims 469 to 477.
483. A graphical user interface on an electronic device comprising a display, a touch sensing surface, one or more sensors for detecting the intensity of contact with the touch sensing surface, a memory, and one or more processors for executing one or more programs stored in the memory, the graphical user interface comprising a user interface displayed according to any of the methods recited in claims 469 to 477.
484. An electronic device, comprising a display, a touch sensing surface, one or more sensors for detecting the intensity of contact with the touch sensing surface, and means for executing any of the methods recited in claims 469 to 477.
485. An electronic device, comprising a user interface and a display unit configured to display user interface elements, a touch sensing surface unit configured to receive input, one or more sensor units configured to detect the intensity of contact with the touch sensing surface unit, and a processing unit coupled to the display unit, the touch sensing surface unit, and the one or more sensor units, wherein the processing unit enables the display of a user interface on the display unit, wherein the user interface includes a first set of user interface elements, for each user interface element in the first set of user interface elements, the device is configured to respond to a user input of a first type of input at a position corresponding to the respective user interface element by performing a plurality of operations corresponding to the respective user interface element, for the remainder of the user interface, the device is not configured to respond to a user input of the first type of input at a position corresponding to a user interface element in the remainder of the user interface by performing a plurality of operations corresponding to the user interface element in the remainder of the user interface, a focus selector detects a first user input of the first type of input while at a first position within the user interface While the focus selector is at the first position within the user interface, in response to detecting the first user input of the first input type, In accordance with the determination that the first position corresponds to a first user interface element within the set of first user interface elements, execute a plurality of operations corresponding to the first user interface element, In accordance with the determination that the first position does not correspond to any user interface element within the set of first user interface elements, apply a visual effect for distinguishing the set of first user interface elements from the remainder of the user interface on the display unit, An electronic device configured as described above.
486. Determining whether the first position corresponds to the first user interface element within the set of first user interface elements includes determining whether the first position corresponds to a user interface element having a first type of action API associated with the first input type. The electronic device according to claim 485.
487. The first input type is a pressing input by contact on the touch sensing surface unit, The device is configured to respond by executing a first operation corresponding to each user interface element when the intensity of the contact exceeds a first intensity threshold with respect to the pressing input by the contact at the position corresponding to each user interface element, The device is configured to respond by executing a second operation, distinct from the first operation, corresponding to each user interface element when the intensity of the contact exceeds a second intensity threshold greater than the first intensity threshold with respect to the pressing input by the contact at the position corresponding to each user interface element. The electronic device according to claim 485 or 486.
488. The first operation is to display a preview associated with each user interface element, The second operation is to display a second user interface associated with each user interface element. The electronic device according to claim 487.
489. The first operation displays an action menu associated with each of the user interface elements, The electronic device according to claim 487, wherein the second operation executes an action represented within the action menu associated with each of the user interfaces.
490. Adding the visual effect to distinguish the set of the first user interface elements from the rest of the user interface on the display unit, The electronic device according to any one of claims 485 to 489, including enhancing the appearance of the set of the first user interface elements while maintaining the appearance of the user interface elements within the rest of the user interface on the display unit.
491. Adding the visual effect to distinguish the set of the first user interface elements from the rest of the user interface on the display unit, The electronic device according to any one of claims 485 to 489, including obscuring the user interface elements within the rest of the user interface on the display unit while maintaining the appearance of the set of the first user interface elements on the display unit.
492. Adding the visual effect to distinguish the set of the first user interface elements from other user interface elements on the display unit, Enhancing the appearance of the set of the first user interface elements, Obscuring the user interface elements within the rest of the user interface on the display unit, The electronic device according to any one of claims 485 to 489, including.
493. The processing unit, While the user interface is being displayed on the display unit, while the focus selector is at the first position within the user interface, detecting a second user input of a second input type that is separate from the first input type, In response to detecting the second user input of the second input type while the focus selector is at the first position within the user interface, In accordance with the determination that the first position corresponds to the first user interface element within the set of the first user interface elements, execute an operation corresponding to the first user interface element, In accordance with the determination that the first position corresponds to a user interface element within the remainder of the user interface, execute an operation corresponding to the user interface element within the remainder of the user interface, An electronic device according to any one of claims 485 to 492, configured as described above.
494. In an electronic device comprising a display, a touch sensing surface, and one or more sensors for detecting the intensity of contact on the touch sensing surface, Display a user interface including a first media object representing a first set of one or more media items and a second media object representing a second set of one or more media items on the display, wherein the first set of media items is different from the second set of media items, and the user interface includes a plurality of media objects, Detect an input including movement of contact on the touch sensing surface while a focus selector is on the first media object, In response to detecting the input including the movement of the contact on the touch sensing surface, Output a preview of a media item from the first set of media items in accordance with a determination that the input meets a media preview criterion including a criterion that is satisfied when the input includes an increase in the characteristic intensity of the contact that exceeds a media preview intensity threshold while the focus selector is on the first media object, stop outputting the preview of the media item from the first set of media items in response to detecting the movement of the contact, and output a preview of a media item from the second set of media items, Move the first media object and the second media object on the display in accordance with the movement of the contact on the touch sensing surface in accordance with a determination that the input does not meet the media preview criterion, A method comprising the above.
495. In response to detecting the input including the movement of the contact on the touch sensing surface, The method according to claim 494, comprising maintaining positions of the first media object and the second media object on the display during the movement of the contact on the touch sensing surface in accordance with a determination that the input meets the media preview criteria.
496. The method according to claim 494 or 495, wherein the media preview criteria includes a criterion that is satisfied when an increase in the characteristic intensity of the contact exceeding the media preview intensity threshold occurs before the focus selector is moved beyond a threshold distance.
497. The method according to any one of claims 494 to 496, comprising tilting the first media object from a first orientation of the first media object to a second orientation of the first media object in accordance with the movement of the contact.
498. The method according to any one of claims 494 to 497, comprising outputting the preview of the media item from the set of the first media items and visually differentiating the first media object from one or more media objects other than the first media object among the plurality of media objects.
499. In response to detecting the movement of the contact, stopping outputting the preview of the media item from the set of the first media items and stopping visually differentiating the first media object from one or more media objects other than the first media object among the plurality of media objects, outputting the preview of the media item from the set of the second media items and visually differentiating the second media object from one or more media objects other than the second media object among the plurality of media objects, The method according to claim 498, comprising.
500. The method according to any one of claims 494 to 499, comprising stopping outputting the preview of the media item from the set of the second media items after a predetermined duration after the output of the preview of the media item from the set of the second media items is started.
501. While outputting the preview of the media item from one of the set of the first media items or the set of the second media items, detecting a decrease in the characteristic intensity of the contact below a preview end intensity threshold, stopping the output of the preview of the media item from the one of the set of the first media items or the set of the second media items in response to detecting the decrease in the characteristic intensity of the contact below the preview end intensity threshold, The method according to any one of claims 494 to 500, comprising.
502. The method according to claim 501, wherein the preview end intensity threshold is an intensity threshold lower than the media preview intensity threshold.
503. The movement of the contact on the touch sensing surface causes the movement of the focus selector to a predetermined area of the user interface including the plurality of media objects, and the method includes moving the first media object and the second media object on the display while the focus selector is within the predetermined area of the user interface. The method according to any one of claims 494 to 502.
504. Moving the first media object and the second media object on the display while the focus selector is within the predetermined area of the user interface includes moving the first media object and the second media object while the focus selector is substantially stationary within the predetermined area of the user interface. The method according to claim 503.
505. Moving the first media object and the second media object on the display while the focus selector is within the predetermined area of the user interface includes moving the first media object and the second media object at a speed according to the current position of the focus selector within the predetermined area of the user inte...
Citation Information
Patent Citations
DEVICE, METHOD, AND GRAPHICAL USER INTERFACE FOR MANIPULATING USER INTERFACE OBJECTS WITH VISUAL AND / OR HAPTAL FEEDBACK
JP6505292B2
Device, Method, and Graphical User Interface for Providing Feedback for Changing Activation States of a User Interface Object
US20150067495A1