User interface for receiving user input

Abstract

This disclosure relates to user interfaces for receiving user input. In some examples, a device determines which user input technique a user has most recently accessed the most and displays a corresponding user interface. In some examples, a device scrolls a set of information on a display. When a threshold criterion is met, the device displays an index object that fully or partially obscures the set of information. In some examples, a device displays a sketch graphical object that is visually manipulated based on user input. The sketch graphical object is transmitted to a recipient. In some examples, a device displays a flip page affordance that is magnified and allows a user to select a particular page of a user interface. In some examples, a device displays a user interface for various input methods, including a plurality of sketch graphical objects. In some examples, a keyboard is displayed for receiving user input.

Description

[0001] Cross-reference to related applications

[0002] This application is a divisional application of Chinese invention patent application filed on September 2, 2015, with national application number 201510557356.X and invention title "User Interface for Receiving User Input".

[0003] This application claims priority to U.S. Provisional Application Serial No. 62 / 129,903, filed March 8, 2015; U.S. Provisional Application Serial No. 62 / 127,800, filed March 3, 2015; and U.S. Provisional Application Serial No. 62 / 044,923, filed September 2, 2014, the contents of which are incorporated herein by reference in their entirety.

[0004] This application also relates to the following applications: International Patent Application Serial No. PCT / US2013 / 040087, filed May 8, 2013, entitled “Device, Method, and Graphical User Interface for Moving a User Interface Object Based on an Intensity of a Press Input”; International Patent Application Serial No. PCT / US2013 / 040072, filed May 8, 2013, entitled “Device, Method, and Graphical User Interface for Providing Feedback for Changing Activation States of a User Interface Object”; International Patent Application Serial No. PCT / US2013 / 040070, filed May 8, 2013, entitled “Device, Method, and Graphical User Interface for Providing Tactile Feedback for Operations Performed in a User Interface”; and International Patent Application Serial No. PCT / US2013 / 040070, filed May 8, 2013, entitled “Device, Method, and Graphical User Interface for Facilitating User…”. International patent application serial number PCT / US2013 / 040067 entitled "Interaction with Controls in a User Interface"; International patent application serial number PCT / US2013 / 040061 entitled "Device, Method, and Graphical User Interface for Displaying User Interface Objects Corresponding to an Application" filed on May 8, 2013; International patent application serial number PCT / US2013 / 040058 entitled "Device, Method, and Graphical User Interface for Displaying Additional Information in Response to a User Contact" filed on May 8, 2013;International patent application serial number PCT / US2013 / 040056, filed May 8, 2013, entitled “Device, Method, and Graphical User Interface for Scrolling Nested Regions”; international patent application serial number PCT / US2013 / 040054, filed May 8, 2013, entitled “Device, Method, and Graphical User Interface for Manipulating Framed Graphical Objects”; international patent application serial number PCT / US2013 / 069489, filed November 11, 2013, entitled “Device, Method, and Graphical User Interface for Switching Between User Interfaces”; international patent application serial number PCT / US2013 / 069489, filed November 11, 2013, entitled “Device, Method, and Graphical User Interface for Determining Whether to Scroll or Select”. The international patent application serial number for “Content” is PCT / US2013 / 069486; the international patent application serial number for “Device, Method, and Graphical User Interface for Moving a Cursor According to a Change in an Appearance of a Control Icon with Simulated Three-Dimensional Characteristics” filed on November 11, 2013 is PCT / US2013 / 069484; the international patent application serial number for “Device, Method, and Graphical User Interface for Transitioning Between Touch Input to Display Output Relationships” filed on November 11, 2013 is PCT / US2013 / 069483.International patent application serial number PCT / US2013 / 069479, filed November 11, 2013, entitled "Device, Method, and Graphical User Interface for Forgoing Generation of Tactile Output for a Multi-Contact Gesture"; International patent application serial number PCT / US2013 / 069472, filed November 11, 2013, entitled "Device, Method, and Graphical User Interface for Navigating UserInterface Hierarchies"; International patent application serial number PCT / US2013 / 040108, filed May 8, 2013, entitled "Device, Method, and Graphical User Interface for Moving and Dropping a User Interface Object"; International patent application serial number PCT / US2013 / 040108, filed May 8, 2013, entitled "Device, Method, and Graphical User Interface for Selecting UserInterface". International patent application serial number PCT / US2013 / 040101 for “Objects”; international patent application serial number PCT / US2013 / 040098 for “Device, Method, and Graphical User Interface for Displaying Content Associated with a Corresponding Affordance” filed on May 8, 2013; international patent application serial number PCT / US2013 / 040093 for “Device, Method, and Graphical User Interface for Transitioning Between Display States in Response to a Gesture” filed on May 8, 2013; international patent application serial number PCT / US2013 / 040053 for “Device, Method, and Graphical User Interface for Selecting Object within a Group of Objects” filed on May 8, 2013.U.S. Patent Application Serial No. 61 / 778,211, filed March 12, 2013, entitled "Device, Method, and Graphical User Interface for Facilitating User Interaction with Controls in a User Interface"; U.S. Patent Application Serial No. 61 / 778,191, filed March 12, 2013, entitled "Device, Method, and Graphical User Interface for Displaying User Interface Objects Corresponding to an Application"; U.S. Patent Application Serial No. 61 / 778,171, filed March 12, 2013, entitled "Device, Method, and Graphical User Interface for Displaying Additional Information in Response to a User Contact"; and U.S. Patent Application Serial No. 61 / 778,171, filed March 12, 2013, entitled "Device, Method, and Graphical User Interface for Scrolling Nested...". U.S. Patent Application Serial No. 61 / 778,179, entitled “Regions”; U.S. Patent Application Serial No. 61 / 778,156, entitled “Device, Method, and Graphical User Interface for Manipulating Framed Graphical Objects”, filed March 12, 2013; U.S. Patent Application Serial No. 61 / 778,125, entitled “Device, Method, and Graphical User Interface for Navigating User Interface Hierarchies”, filed March 12, 2013; and U.S. Patent Application Serial No. 61 / 778,092, entitled “Device, Method, and Graphical User Interface for Selecting ObjectWithin a Group of Objects”, filed March 12, 2013.U.S. Patent Application Serial No. 61 / 778,418, filed March 13, 2013, entitled "Device, Method, and Graphical User Interface for Switching Between User Interfaces"; U.S. Patent Application Serial No. 61 / 778,416, filed March 13, 2013, entitled "Device, Method, and Graphical User Interface for Determining Whether to Scroll or Select Content"; U.S. Patent Application Serial No. 61 / 747,278, filed December 29, 2012, entitled "Device, Method, and Graphical User Interface for Manipulating User Interface Objects with Visual and / or Haptic Feedback"; and U.S. Patent Application Serial No. 61 / 747,278, filed March 13, 2013, entitled "Device, Method, and Graphical User Interface for Moving and Dropping a User Interface". U.S. Patent Application Serial No. 61 / 778,414, entitled “Device, Method, and Graphical User Interface for Selecting User Interface Objects”, filed March 13, 2013; U.S. Patent Application Serial No. 61 / 778,412, entitled “Device, Method, and Graphical User Interface for Displaying Content Associated with a Corresponding Affordance”, filed March 13, 2013; and U.S. Patent Application Serial No. 61 / 778,373, entitled “Device, Method, and Graphical User Interface for Managing Activation of a Control Based on Contact Intensity”, filed March 12, 2013.U.S. Patent Application Serial No. 61 / 778,265, filed March 12, 2013, entitled "Device, Method, and Graphical User Interface for Transitioning Between Display States in Response to a Gesture"; U.S. Patent Application Serial No. 61 / 778,367, filed March 12, 2013, entitled "Device, Method, and Graphical User Interface for Moving a User Interface Object Based on an Intensity of a Press Input"; U.S. Patent Application Serial No. 61 / 778,363, filed March 12, 2013, entitled "Device, Method, and Graphical User Interface for Transitioning Between Touch Input to Display Output Relationships"; and U.S. Patent Application Serial No. 61 / 778,363, filed March 12, 2013, entitled "Device, Method, and Graphical User Interface for Providing Feedback for Changing Activation States of a User Interface". U.S. Patent Application Serial No. 61 / 778,287 entitled “InterfaceObject”; U.S. Patent Application Serial No. 61 / 778,284 entitled “Device, Method, and Graphical User Interface for Providing Tactile Feedback for Operations Performed in a User Interface” filed on March 12, 2013; and U.S. Patent Application Serial No. 61 / 778,239 entitled “Device, Method, and Graphical User Interface for Forgoing Generation of Tactile Output for a Multi-Contact Gesture” filed on March 12, 2013.The following U.S. patent applications are incorporated herein by reference in their entirety: U.S. Patent Application Serial No. 61 / 688,227, filed May 9, 2012, entitled “Device, Method, and Graphical User Interface for Manipulating User Interface Objects with Visual and / or Haptic Feedback”; U.S. Provisional Patent Application Serial No. 61 / 645,033, filed May 9, 2012, entitled “Adaptive Haptic Feedback for Electronic Devices”; U.S. Provisional Patent Application Serial No. 61 / 665,603, filed June 28, 2012, entitled “Adaptive Haptic Feedback for Electronic Devices”; and U.S. Provisional Patent Application Serial No. 61 / 681,098, filed August 8, 2012, entitled “Adaptive Haptic Feedback for Electronic Devices”. Technical Field

[0005] This disclosure relates generally to computer user interfaces, and more particularly to techniques for receiving user input. Background Technology

[0006] The use of electronic devices has increased significantly in recent years (e.g., accessing music and sending / receiving messages). Devices receive input from users, such as selecting songs for playback, choosing message recipients from the phone book, text input for the message body, and selecting specific pages of documents. As a result of this increased device use, the frequency of user input on such devices has also increased significantly. Summary of the Invention

[0007] However, some technologies used to receive user input on electronic devices are often cumbersome and inefficient. For example, editing or preparing a reply to a message requires manipulating a complex and time-consuming user interface, which may include multiple keys or keystrokes. Existing technologies require unnecessarily more time, wasting user time and device energy. This latter consideration is particularly important in battery-powered devices.

[0008] Therefore, there is a need for electronic devices with faster and more efficient methods and interfaces for receiving user input. Such methods and interfaces can optionally supplement or replace conventional methods for receiving user input. These methods and interfaces reduce the cognitive burden on users and result in more efficient human-machine interfaces. For battery-powered computing devices, such methods and interfaces save power and increase the time between battery charging cycles.

[0009] The aforementioned deficiencies and other problems associated with the user interface of a computing device used to receive user input are mitigated or eliminated by the disclosed device. In some embodiments, the device is a desktop computer. In some embodiments, the device is portable (e.g., a laptop computer, tablet computer, or handheld device). In some embodiments, the device has a touchpad. In some embodiments, the device is wearable by the user. In some embodiments, the device has a touch-sensitive display (also referred to as a "touchscreen" or "touchscreen display"). In some embodiments, the device has a display and a touch-sensitive surface. In some embodiments, the device has a short-range communication radio. In some embodiments, the device has a graphical user interface (GUI), one or more processors, memory, and one or more modules, programs, or instruction sets stored in the memory for performing multiple functions. In some embodiments, the user interacts with the GUI primarily through finger contact and gestures on the touch-sensitive surface. Executable instructions for performing these functions may optionally be included in a computer-readable storage medium or other computer program product configured for execution by one or more processors.

[0010] In some embodiments, a method is performed at an electronic device having a display. The method includes: receiving user input; in response to receiving user input: identifying the most recently accessed user input technique from a set of user input techniques; identifying the least recently accessed user input technique from the set of user input techniques; displaying a user input interface for the most recently accessed user input technique on the display; and displaying a first available element associated with the user input interface for the least recently accessed user input technique on the display.

[0011] In some embodiments, a non-transient computer-readable storage medium stores one or more programs, the programs including instructions that, when executed by one or more processors of an electronic device having a display, cause the device to: receive user input; in response to receiving user input, identify the most recently accessed user input technique from a set of user input techniques; identify the least recently accessed user input technique from the set of user input techniques; display a user input interface for the most recently accessed user input technique on the display; and display a first available element associated with the user input interface for the least recently accessed user input technique on the display.

[0012] In some embodiments, a transient computer-readable storage medium stores one or more programs, the programs including instructions that, when executed by one or more processors of an electronic device having a display, cause the device to: receive user input; in response to receiving user input, identify the most recently accessed user input technique from a set of user input techniques; identify the least recently accessed user input technique from the set of user input techniques; display a user input interface for the most recently accessed user input technique on the display; and display a first available element associated with the user input interface for the least recently accessed user input technique on the display.

[0013] In some embodiments, an electronic device includes: a display; one or more processors; a memory; and one or more programs, wherein the programs are stored in the memory and configured to be executed by the one or more processors, the programs including instructions for: receiving user input; in response to receiving user input: identifying the most recently accessed user input technique from a set of user input techniques; identifying the least recently accessed user input technique from the set of user input techniques; displaying a user input interface of the most recently accessed user input technique on the display; and displaying a first available element associated with the user input interface of the least recently accessed user input technique on the display.

[0014] In some embodiments, an electronic device includes: a display; means for receiving user input; in response to receiving user input: means for identifying the most recently accessed user input technology in a set of user input technologies; means for identifying the least recently accessed user input technology in the set of user input technologies; means for displaying a user input interface of the most recently accessed user input technology on the display; and means for displaying a first available element associated with the user input interface of the least recently accessed user input technology on the display.

[0015] In some embodiments, an apparatus includes: a display unit; a receiving unit configured to receive user input; and a processing unit coupled to the display unit and the receiving unit, the processing unit being configured to: in response to receiving user input, identify the most recently accessed user input technique in a set of user input techniques; identify the least recently accessed user input technique in the set of user input techniques; display a user input interface of the most recently accessed user input technique on the display unit; and display a first available element associated with the user input interface of the least recently accessed user input technique on the display unit.

[0016] In some embodiments, a method is performed at an electronic device having a display. The method includes: displaying a portion of a set of information; receiving user input associated with the set of information; scrolling the set of information on the display in response to receiving the user input associated with the set of information; determining whether a scrolling attribute satisfies a threshold criterion; and displaying an index object based on the determination that the scrolling attribute satisfies the threshold criterion.

[0017] In some embodiments, a non-transient computer-readable storage medium stores one or more programs, the programs including instructions that, when executed by one or more processors of an electronic device having a display, cause the device to: display a portion of a set of information; receive user input associated with the set of information; scroll the set of information on the display in response to receiving the user input associated with the set of information; determine whether a scrolling attribute satisfies a threshold criterion; and display an index object based on the determination that the scrolling attribute satisfies the threshold criterion.

[0018] In some embodiments, a transient computer-readable storage medium stores one or more programs, the programs including instructions that, when executed by one or more processors of an electronic device having a display, cause the device to: display a portion of a set of information; receive user input associated with the set of information; scroll the set of information on the display in response to receiving the user input associated with the set of information; determine whether a scrolling attribute satisfies a threshold criterion; and display an index object based on the determination that the scrolling attribute satisfies the threshold criterion.

[0019] In some embodiments, an electronic device includes: a display; one or more processors; a memory; and one or more programs, wherein the programs are stored in the memory and configured to be executed by the one or more processors, the programs including instructions for: displaying a portion of a set of information; receiving user input associated with the set of information; scrolling the set of information on the display in response to receiving the user input associated with the set of information; determining whether a scrolling attribute satisfies a threshold criterion; and displaying an index object based on the determination that the scrolling attribute satisfies the threshold criterion.

[0020] In some embodiments, an electronic device includes: a display; means for receiving user input; means for displaying a portion of a set of information in response to receiving user input; means for receiving user input associated with the set of information; means for scrolling the set of information on the display in response to receiving user input associated with the set of information; means for determining whether a scrolling attribute satisfies a threshold criterion; and means for displaying an index object based on the determination that the scrolling attribute satisfies the threshold criterion.

[0021] In some embodiments, a device includes: a display unit; a processing unit coupled to the display unit, the processing unit being configured to display a portion of a set of information on the display unit; receiving user input associated with the set of information; scrolling the set of information on the display unit in response to receiving the user input associated with the set of information; determining whether a scrolling attribute satisfies a threshold criterion; and displaying an index object based on the determination that the scrolling attribute satisfies the threshold criterion.

[0022] In some embodiments, a method is performed at an electronic device having a display. The method includes: receiving user input associated with a messaging input interface; displaying a Graphic Object in response to receiving the user input associated with the messaging input interface; receiving first user input associated with the Graphic Object; changing a first visual aspect of the Graphic Object in response to receiving the first user input associated with the Graphic Object, wherein the change in the first visual aspect is based on the first user input; receiving recipient information; and transmitting the Graphic Object including the changed first visual aspect to a recipient associated with the received recipient information.

[0023] In some embodiments, a non-transient computer-readable storage medium stores one or more programs, the programs including instructions that, when executed by one or more processors of an electronic device having a display, cause the device to: receive user input associated with a message transceiver input interface; display a Graphic Object in response to receiving the user input associated with the message transceiver input interface; receive first user input associated with the Graphic Object; change a first visual aspect of the Graphic Object in response to receiving the first user input associated with the Graphic Object, wherein the change of the first visual aspect is based on the first user input; receive recipient information; and transmit the Graphic Object including the changed first visual aspect to a recipient associated with the received recipient information.

[0024] In some embodiments, a transient computer-readable storage medium stores one or more programs, the programs including instructions that, when executed by one or more processors of an electronic device having a display, cause the device to: receive user input associated with a message transceiver input interface; display a Graphic Object in response to receiving the user input associated with the message transceiver input interface; receive first user input associated with the Graphic Object; change a first visual aspect of the Graphic Object in response to receiving the first user input associated with the Graphic Object, wherein the change of the first visual aspect is based on the first user input; receive recipient information; and transmit the Graphic Object including the changed first visual aspect to a recipient associated with the received recipient information.

[0025] In some embodiments, an electronic device includes: a display; one or more processors; a memory; and one or more programs, wherein the programs are stored in the memory and configured to be executed by the one or more processors, the programs including instructions for: receiving user input associated with a messaging input interface; displaying a Graphic Object in response to receiving the user input associated with the messaging input interface; receiving first user input associated with the Graphic Object; changing a first visual aspect of the Graphic Object in response to receiving the first user input associated with the Graphic Object, wherein the change in the first visual aspect is based on the first user input; receiving recipient information; and transmitting the Graphic Object including the changed first visual aspect to a recipient associated with the received recipient information.

[0026] In some embodiments, an electronic device includes: a display; means for receiving user input associated with a messaging input interface; displaying a Graphic Object in response to receiving the user input associated with the messaging input interface; means for receiving first user input associated with the Graphic Object; means for changing a first visual aspect of the Graphic Object in response to receiving the first user input associated with the Graphic Object, wherein the change in the first visual aspect is based on the first user input; means for receiving recipient information; and means for transmitting the Graphic Object including the changed first visual aspect to a recipient associated with the received recipient information.

[0027] In some embodiments, an apparatus includes: a display unit; and a processing unit coupled to the display unit, the processing unit being configured to: receive user input associated with a message transceiver input interface; display a Graphic Object on the display unit in response to receiving the user input associated with the message transceiver input interface; receive first user input associated with the Graphic Object; change a first visual aspect of the Graphic Object in response to receiving the first user input associated with the Graphic Object, wherein the change of the first visual aspect is based on the first user input; receive recipient information; and transmit the Graphic Object including the changed first visual aspect to a recipient associated with the received recipient information.

[0028] In some embodiments, a method is performed at an electronic device having a display. The method includes: displaying a first page of a user interface and a first set of page-turning options, wherein the first set of page-turning options includes a first page-turning option, the first page-turning option including a focus selector, and wherein the first page-turning option corresponds to the first page of the user interface; receiving a user touch at a first location on a touch-sensitive surface, wherein the first location is associated with the first set of page-turning options; in response to receiving a user touch at the first location, replacing the display of the first set of page-turning options with the display of a second set of page-turning options, wherein the second set of page-turning options includes a second page-turning option corresponding to a second page of the user interface; while continuing to receive user touches, detecting movement of a user touch from the first location to a second location on the touch-sensitive surface without interruption in contact with the touch on the touch-sensitive surface, wherein the second location is associated with a second page-turning option; and in response to detecting a user touch at the second location, displaying the second page of the user interface.

[0029] In some embodiments, a non-transient computer-readable storage medium stores one or more programs, the programs including instructions that, when executed by one or more processors of an electronic device having a display and a touch-sensitive surface, cause the device to: display a first page of a user interface and a first set of page-turning options, wherein the first set of page-turning options includes a first page-turning option, the first page-turning option including a focus selector, and wherein the first page-turning option corresponds to the first page of the user interface; receive a user touch at a first location on the touch-sensitive surface, wherein the first location is associated with the first set of page-turning options; in response to receiving a user touch at the first location, replace the display of the first set of page-turning options with the display of a second set of page-turning options, wherein the second set of page-turning options includes a second page-turning option corresponding to a second page of the user interface; while continuing to receive user touches, detect movement of a user touch from the first location to a second location on the touch-sensitive surface without interruption in contact with the touch on the touch-sensitive surface, wherein the second location is associated with a second page-turning option; and in response to detecting a user touch at the second location, display the second page of the user interface.

[0030] In some embodiments, a transient computer-readable storage medium stores one or more programs, the programs including instructions that, when executed by one or more processors of an electronic device having a display and a touch-sensitive surface, cause the device to: display a first page of a user interface and a first set of page-turning options, wherein the first set of page-turning options includes a first page-turning option, the first page-turning option including a focus selector, and wherein the first page-turning option corresponds to the first page of the user interface; receive a user touch at a first location on the touch-sensitive surface, wherein the first location is associated with the first set of page-turning options; in response to receiving a user touch at the first location, replace the display of the first set of page-turning options with the display of a second set of page-turning options, wherein the second set of page-turning options includes a second page-turning option corresponding to a second page of the user interface; while continuing to receive user touches, detect movement of a user touch from the first location to a second location on the touch-sensitive surface without interruption in contact with the touch on the touch-sensitive surface, wherein the second location is associated with a second page-turning option; and in response to detecting a user touch at the second location, display the second page of the user interface.

[0031] In some embodiments, an electronic device includes: a display; a touch-sensitive surface; one or more processors; a memory; and one or more programs, wherein the programs are stored in the memory and configured to be executed by the one or more processors, the programs including instructions for: displaying a first page of a user interface and a first set of page-turning options, wherein the first set of page-turning options includes a first page-turning option, the first page-turning option including a focus selector, and wherein the first page-turning option corresponds to the first page of the user interface; receiving a user touch at a first location on the touch-sensitive surface, wherein the first location is associated with the first set of page-turning options; in response to receiving a user touch at the first location, replacing the display of the first set of page-turning options with the display of a second set of page-turning options, wherein the second set of page-turning options includes a second page-turning option corresponding to a second page of the user interface; while continuing to receive user touches, detecting movement of a user touch from the first location to a second location on the touch-sensitive surface without interruption in contact with the touch on the touch-sensitive surface, wherein the second location is associated with a second page-turning option; and in response to detecting a user touch at the second location, displaying the second page of the user interface.

[0032] In some embodiments, an electronic device includes: a display; a touch-sensitive surface; means for displaying a first page of a user interface and a first set of page-turning options, wherein the first set of page-turning options includes a first page-turning option, the first page-turning option including a focus selector, and wherein the first page-turning option corresponds to the first page of the user interface; means for receiving a user touch at a first location on the touch-sensitive surface, wherein the first location is associated with the first set of page-turning options; means for replacing the display of the first set of page-turning options with the display of a second set of page-turning options in response to receiving a user touch at the first location, wherein the second set of page-turning options includes a second page-turning option corresponding to a second page of the user interface; means for detecting, while continuing to receive user touches, movement of a user touch from the first location to a second location on the touch-sensitive surface without interruption in contact with the user touch on the touch-sensitive surface, wherein the second location is associated with a second page-turning option; and means for displaying a second page of the user interface in response to detecting a user touch at the second location.

[0033] In some embodiments, an apparatus includes: a display unit; a touch-sensitive surface unit; and a processing unit coupled to the display unit and the touch-sensitive surface unit, the processing unit being configured to: display a first page of a user interface and a first set of page-turning options on the display unit, wherein the first set of page-turning options includes a first page-turning option, the first page-turning option including a focus selector, and wherein the first page-turning option corresponds to the first page of the user interface; receive a user touch at a first location on the touch-sensitive surface unit, wherein the first location is associated with the first set of page-turning options; in response to receiving a user touch at the first location, replace the display of the first set of page-turning options with the display of a second set of page-turning options, wherein the second set of page-turning options includes a second page-turning option corresponding to a second page of the user interface; while continuing to receive user touches, detect movement of a user touch from the first location to a second location on the touch-sensitive surface unit in the absence of interruption in contact with the user touch on the touch-sensitive surface unit, wherein the second location is associated with a second page-turning option; and in response to detecting a user touch at the second location, display the second page of the user interface.

[0034] In some embodiments, a method is performed at an electronic device having a display and a touch-sensitive surface. The method includes: displaying a first page of a user interface among a plurality of pages and a first set of page-turning options, wherein the first set of page-turning options includes a first page-turning option, the first page-turning option including a focus selector, and wherein the first page-turning option corresponds to the first page of the user interface; receiving a user touch at a first location on the touch-sensitive surface, the first location corresponding to the first set of page-turning options; and, in response to receiving the user touch at the first location, replacing the display of the first set of page-turning options with the display of a second set of page-turning options, wherein the second set of page-turning options includes the first page-turning option, the first page-turning option including… The method includes a focus selector, wherein a first page-turning device corresponds to a first page of the user interface; while receiving a user touch, detecting a movement of the user touch from a first position to a second position on the touch-sensitive surface without interruption of contact with the touch-sensitive surface, wherein the second position is associated with a second page-turning device; and in response to detecting a user touch at the second position: replacing the display of the first page with the second page from a plurality of pages; and updating a second set of page-turning devices, wherein the update includes removing the focus selector from the first page-turning devices in the set and displaying the second page-turning device with the focus selector in the set of page-turning devices.

[0035] In some embodiments, a non-transient computer-readable storage medium stores one or more programs, the programs including instructions that, when executed by one or more processors of an electronic device having a display and a touch-sensitive surface, cause the device to: display a first page of a user interface and a first set of page-turning options, wherein the first set of page-turning options includes a first page-turning option, the first page-turning option including a focus selector, and wherein the first page-turning option corresponds to the first page of the user interface; receive a user touch at a first location on the touch-sensitive surface, the first location corresponding to the first set of page-turning options; and, in response to receiving the user touch at the first location, replace the display of the page-turning options with the display of a second set of page-turning options. The display of a first set of page turners, wherein a second set of page turners includes a first page turner, the first page turner including a focus selector, and wherein the first page turner corresponds to a first page of the user interface; while receiving a user touch, detecting a movement of the user touch from a first position to a second position on the touch-sensitive surface without interruption of contact with the touch-sensitive surface, wherein the second position is associated with a second page turner; and in response to detecting a user touch at the second position: replacing the display of the first page with the second page from a plurality of pages; and updating the second set of page turners, wherein the update includes removing the focus selector from the first page turner in the set and displaying the second page turner with the focus selector in the set of page turners.

[0036] In some embodiments, a transient computer-readable storage medium stores one or more programs, the programs including instructions that, when executed by one or more processors of an electronic device having a display and a touch-sensitive surface, cause the device to: display a first page of a user interface and a first set of page-turning options among a plurality of pages, wherein the first set of page-turning options includes a first page-turning option, the first page-turning option including a focus selector, and wherein the first page-turning option corresponds to the first page of the user interface; receive a user touch at a first location on the touch-sensitive surface, the first location corresponding to the first set of page-turning options; and, in response to receiving a user touch at the first location, replace the display of the page-turning options with the display of a second set of page-turning options. The display of a first set of page turners, wherein a second set of page turners includes a first page turner, the first page turner including a focus selector, and wherein the first page turner corresponds to a first page of the user interface; while receiving a user touch, detecting a movement of the user touch from a first position to a second position on the touch-sensitive surface without interruption of contact with the touch-sensitive surface, wherein the second position is associated with a second page turner; and in response to detecting a user touch at the second position: replacing the display of the first page with the second page from a plurality of pages; and updating the second set of page turners, wherein the update includes removing the focus selector from the first page turner in the set and displaying the second page turner with the focus selector in the set of page turners.

[0037] In some embodiments, an electronic device includes: a display; a touch-sensitive surface; one or more processors; a memory; and one or more programs, wherein the one or more programs are stored in the memory and configured to be executed by the one or more processors, the one or more programs including instructions for: displaying a first page of a user interface and a first set of page-turning options in a plurality of pages, wherein the first set of page-turning options includes a first page-turning option, the first page-turning option including a focus selector, and wherein the first page-turning option corresponds to the first page of the user interface; receiving a user touch at a first location on the touch-sensitive surface, the first location corresponding to the first set of page-turning options; and responding to receiving the user touch at the first location, using a second set of page-turning options. The display replaces the display of a first set of page turners, wherein a second set of page turners includes a first page turner, the first page turner including a focus selector, and wherein the first page turner corresponds to a first page of the user interface; while receiving a user touch, detecting a movement of the user touch from a first position to a second position on the touch-sensitive surface without interruption of contact with the touch-sensitive surface, wherein the second position is associated with a second page turner; and in response to detecting a user touch at the second position: replacing the display of the first page with the second page from a plurality of pages; and updating the second set of page turners, wherein the update includes removing the focus selector from the first page turner in the set and displaying the second page turner with the focus selector in the set of page turners.

[0038] In some embodiments, an electronic device includes: a display; a touch-sensitive surface; means for displaying a first page of a user interface among a plurality of pages and a first set of page-turning options, wherein the first set of page-turning options includes a first page-turning option, the first page-turning option including a focus selector, and wherein the first page-turning option corresponds to the first page of the user interface; means for receiving a user touch at a first location on the touch-sensitive surface, the first location corresponding to the first set of page-turning options; and means for replacing the display of the first set of page-turning options with the display of a second set of page-turning options in response to receiving the user touch at the first location, wherein the second set of page-turning options includes the first page-turning option. The first page-turning device includes a focus selector, and wherein the first page-turning device corresponds to a first page of the user interface; means for detecting, while receiving a user touch, movement of a user touch from a first position to a second position on a touch-sensitive surface without interruption of contact with the touch-sensitive surface, wherein the second position is associated with a second page-turning device; and in response to detecting a user touch at the second position: means for replacing the display of the first page with the second page of a plurality of pages; and means for updating a second set of page-turning devices, wherein updating includes removing the focus selector from the first page-turning devices in the set and displaying the second page-turning device with the focus selector in the set of page-turning devices.

[0039] In some embodiments, a device includes: a display unit; a touch-sensitive surface unit; and a processing unit coupled to the display unit and the touch-sensitive unit, the processing unit being configured to: display on the display unit a first page of a user interface and a first set of page-turning options, wherein the first set of page-turning options includes a first page-turning option, the first page-turning option including a focus selector, and wherein the first page-turning option corresponds to the first page of the user interface; receive a user touch at a first location on the touch-sensitive surface unit, the first location corresponding to the first set of page-turning options; and, in response to receiving a user touch at the first location, replace the display of the first set of page-turning options with the display of a second set of page-turning options, wherein page-turning... The second set of available items includes a first page-turning item, the first page-turning item including a focus selector, and wherein the first page-turning item corresponds to a first page of the user interface; while receiving a user touch, detecting a movement of the user touch from a first position to a second position on the touch-sensitive surface unit without interruption of contact with the touch-sensitive surface, wherein the second position is associated with a second page-turning item; and in response to detecting a user touch at the second position: replacing the display of the first page with the second page from a plurality of pages; and updating the second set of page-turning items, wherein the update includes removing the focus selector from the first page-turning item in the set and displaying the second page-turning item with the focus selector in the set of page-turning items.

[0040] In some embodiments, a method is performed at an electronic device having a display. The method includes: receiving first user input; displaying a spoken user interface on the display in response to receiving the first user input; receiving second user input; replacing the display of the spoken user interface with the display of a first Epic graphic object in response to receiving the second user input; receiving a first user swipe gesture input at a location associated with the first Epic graphic object on a touch-sensitive surface; replacing the display of the first Epic graphic object with the display of a second Epic graphic object in response to receiving the first user swipe gesture input; receiving a second user swipe gesture input at a touch-sensitive surface; and displaying a set of recently accessed Epic graphic objects in response to receiving the second user swipe gesture input.

[0041] In some embodiments, a non-transient computer-readable storage medium stores one or more programs, the programs including instructions that, when executed by one or more processors of an electronic device having a display and a touch-sensitive surface, cause the device to: receive first user input; display a spoken user interface on the display in response to receiving the first user input; receive second user input; replace the display of the spoken user interface with the display of a first Etymotic graphic object in response to receiving the second user input; receive a first user swipe gesture input at a location on the touch-sensitive surface associated with the first Etymotic graphic object; replace the display of the first Etymotic graphic object with the display of a second Etymotic graphic object in response to receiving the first user swipe gesture input; receive a second user swipe gesture input at the touch-sensitive surface; and display a set of recently accessed Etymotic graphic objects in response to receiving the second user swipe gesture input.

[0042] In some embodiments, a transient computer-readable storage medium stores one or more programs, the programs including instructions that, when executed by one or more processors of an electronic device having a display and a touch-sensitive surface, cause the device to: receive first user input; display a spoken user interface on the display in response to receiving the first user input; receive second user input; replace the display of the spoken user interface with the display of a first Epic graphic object in response to receiving the second user input; receive a first user swipe gesture input at a location on the touch-sensitive surface associated with the first Epic graphic object; replace the display of the first Epic graphic object with the display of a second Epic graphic object in response to receiving the first user swipe gesture input; receive a second user swipe gesture input at the touch-sensitive surface; and display a set of recently accessed Epic graphic objects in response to receiving the second user swipe gesture input.

[0043] In some embodiments, an electronic device includes: a display; a touch-sensitive surface; one or more processors; a memory; and one or more programs, wherein the programs are stored in the memory and configured to be executed by the one or more processors, the programs including instructions for: receiving first user input; displaying a spoken user interface on the display in response to receiving the first user input; receiving second user input; replacing the display of the spoken user interface with the display of a first Epic graphic object in response to receiving the second user input; receiving a first user swipe gesture input at a location on the touch-sensitive surface associated with the first Epic graphic object; replacing the display of the first Epic graphic object with the display of a second Epic graphic object in response to receiving the first user swipe gesture input; receiving a second user swipe gesture input at the touch-sensitive surface; and displaying a set of recently accessed Epic graphic objects in response to receiving the second user swipe gesture input.

[0044] In some embodiments, an electronic device includes: a display; a touch-sensitive surface; means for receiving first user input; means for displaying a spoken user interface on the display in response to receiving the first user input; means for receiving second user input; means for replacing the display of the spoken user interface with the display of a first Emoji graphic object in response to receiving the second user input; means for receiving a first user swipe gesture input at a location on the touch-sensitive surface associated with the first Emoji graphic object; means for replacing the display of the first Emoji graphic object with the display of a second Emoji graphic object in response to receiving the first user swipe gesture input; means for receiving a second user swipe gesture input at the touch-sensitive surface; and means for displaying a set of recently accessed Emoji graphic objects in response to receiving the second user swipe gesture input.

[0045] In some embodiments, a device includes: a display unit; a touch-sensitive surface unit; and a processing unit coupled to the display unit and the touch-sensitive surface unit, the processing unit being configured to: receive a first user input; display a spoken user interface on the display unit in response to receiving the first user input; receive a second user input; replace the display of the spoken user interface with the display of a first Epic graphic object in response to receiving the second user input; receive a first user swipe gesture input at a location on the touch-sensitive surface unit associated with the first Epic graphic object; replace the display of the first Epic graphic object with the display of a second Epic graphic object in response to receiving the first user swipe gesture input; receive a second user swipe gesture input at the touch-sensitive surface unit; and display a set of recently accessed Epic graphic objects in response to receiving the second user swipe gesture input.

[0046] In some embodiments, a method is performed on an electronic device having a touch-sensitive display. The method includes: displaying a keyboard and a text input interface, the text input interface including a character insertion point; detecting touch user input having a first characteristic intensity at a first location on the touch-sensitive display, the first location being associated with the keyboard and corresponding to a first character; determining the first characteristic intensity of the touch user input at the first location; displaying a preview of the first character on the touch-sensitive display based on a determination that the first characteristic intensity of the touch user input does not exceed an intensity threshold; and displaying the first character at the character insertion point on the touch-sensitive display based on a determination that the first characteristic intensity of the touch user input at the first location exceeds an intensity threshold.

[0047] In some embodiments, a non-transient computer-readable storage medium stores one or more programs, the programs including instructions that, when executed by one or more processors of an electronic device having a touch-sensitive display, cause the device to: display a keyboard and a text input interface, the text input interface including a character insertion point; detect a touch user input having a first characteristic intensity at a first location on the touch-sensitive display, the first location being associated with the keyboard and corresponding to a first character; determine the first characteristic intensity of the touch user input at the first location; display a preview of the first character on the touch-sensitive display based on the determination that the first characteristic intensity of the touch user input does not exceed an intensity threshold; and display the first character at the character insertion point on the touch-sensitive display based on the determination that the first characteristic intensity of the touch user input at the first location exceeds an intensity threshold.

[0048] In some embodiments, a transient computer-readable storage medium stores one or more programs, the programs including instructions that, when executed by one or more processors of an electronic device having a touch-sensitive display, cause the device to: display a keyboard and a text input interface, the text input interface including a character insertion point; detect a touch user input having a first characteristic intensity at a first location on the touch-sensitive display, the first location being associated with the keyboard and corresponding to a first character; determine the first characteristic intensity of the touch user input at the first location; display a preview of the first character on the touch-sensitive display based on the determination that the first characteristic intensity of the touch user input does not exceed an intensity threshold; and display the first character at the character insertion point on the touch-sensitive display based on the determination that the first characteristic intensity of the touch user input at the first location exceeds an intensity threshold.

[0049] In some embodiments, an electronic device includes: a touch-sensitive display; one or more processors; a memory; and one or more programs, wherein the programs are stored in the memory and configured to be executed by the one or more processors, the programs including instructions for: displaying a keyboard and a text input interface, the text input interface including a character insertion point; detecting a touch user input having a first characteristic intensity at a first location on the touch-sensitive display, the first location being associated with the keyboard and corresponding to a first character; determining the first characteristic intensity of the touch user input at the first location; displaying a preview of the first character on the touch-sensitive display based on the determination that the first characteristic intensity of the touch user input does not exceed an intensity threshold; and displaying the first character at the character insertion point on the touch-sensitive display based on the determination that the first characteristic intensity of the touch user input at the first location exceeds an intensity threshold.

[0050] In some embodiments, an electronic device includes: a touch-sensitive display; means for displaying a keyboard and a text input interface, the text input interface including a character insertion point; means for detecting touch user input having a first characteristic intensity at a first location on the touch-sensitive display, the first location being associated with the keyboard and corresponding to a first character; means for determining the first characteristic intensity of the touch user input at the first location; means for displaying a preview of the first character on the touch-sensitive display based on a determination that the first characteristic intensity of the touch user input does not exceed an intensity threshold; and means for displaying the first character at the character insertion point on the touch-sensitive display based on a determination that the first characteristic intensity of the touch user input at the first location exceeds an intensity threshold.

[0051] In some embodiments, an electronic device includes: a touch-sensitive display unit; and a processing unit coupled to the touch-sensitive display, the processing unit being configured to: display a keyboard and a text input interface, the text input interface including a character insertion point; detect a touch user input having a first characteristic intensity at a first position on the touch-sensitive display, the first position being associated with the keyboard and corresponding to a first character; determine the first characteristic intensity of the touch user input at the first position; display a preview of the first character on the touch-sensitive display based on the determination that the first characteristic intensity of the touch user input does not exceed an intensity threshold; and display the first character at the character insertion point on the touch-sensitive display based on the determination that the first characteristic intensity of the touch user input at the first position exceeds an intensity threshold.

[0052] In some embodiments, a method is performed at an electronic device having a display and a touch-sensitive surface. The method includes: displaying a user interface comprising a set of one or more available elements; receiving user input on the touch-sensitive surface while the user interface is displayed; determining the intensity of a characteristic of the user input; and, based on a determination that the intensity of the user input exceeds an intensity threshold: determining whether a context available element is available for the user interface; displaying the context available element based on the determination that the context available element is available; and displaying a visual indication that the context available element is unavailable for the user interface based on the determination that the context available element is unavailable.

[0053] In some embodiments, a non-transient computer-readable storage medium stores one or more programs, the programs including instructions that, when executed by one or more processors of an electronic device having a display and a touch-sensitive surface, cause the device to: display a user interface including a set of one or more available elements; receive user input on the touch-sensitive surface while displaying the user interface; determine the intensity of the characteristic of the user input; and, based on the determination that the intensity of the characteristic of the user input exceeds an intensity threshold: determine whether the available elements are available for the user interface; display the available elements based on the determination that the available elements are available; and display a visual indication that the available elements are unavailable for the user interface based on the determination that the available elements are unavailable.

[0054] In some embodiments, a transient computer-readable storage medium stores one or more programs, the programs including instructions that, when executed by one or more processors of an electronic device having a display and a touch-sensitive surface, cause the device to: display a user interface comprising a set of one or more available elements; receive user input on the touch-sensitive surface while displaying the user interface; determine the intensity of the characteristic of the user input; and, based on the determination that the intensity of the characteristic of the user input exceeds an intensity threshold: determine whether the available elements are available for the user interface; display the available elements based on the determination that the available elements are available; and display a visual indication that the available elements are unavailable for the user interface based on the determination that the available elements are unavailable.

[0055] In some embodiments, an electronic device includes: a display; a touch-sensitive surface; one or more processors; a memory; and one or more programs, wherein the programs are stored in the memory and configured to be executed by the one or more processors, the programs including instructions for: displaying a user interface comprising a set of one or more available elements; receiving user input on the touch-sensitive surface when the user interface is displayed; determining the intensity of the user input; and, based on the determination that the intensity of the user input exceeds an intensity threshold: determining whether the available elements are available for the user interface; displaying the available elements based on the determination that the available elements are available; and displaying a visual indication that the available elements are unavailable for the user interface based on the determination that the available elements are unavailable.

[0056] In some embodiments, an electronic device includes: a display; a touch-sensitive surface; means for displaying a user interface including a set of one or more available elements; means for receiving user input on the touch-sensitive surface when the user interface is displayed; means for determining the intensity of the user input; and means for performing the following actions based on the determination that the intensity of the user input exceeds an intensity threshold: determining whether a context available element is available for the user interface; displaying the context available element based on the determination that the context available element is available; and displaying a visual indication that the context available element is unavailable for the user interface based on the determination that the context available element is unavailable.

[0057] In some embodiments, an electronic device includes: a display unit configured to display an image user interface; a touch-sensitive surface unit configured to detect the intensity of a contact; and a processing unit coupled to the display and the touch-sensitive surface, the processing unit being configured to: enable the display of a user interface comprising a set of one or more available elements; receive user input on the touch-sensitive surface when the user interface is enabled to be displayed; determine the characteristic intensity of the user input; and, based on the determination that the characteristic intensity of the user input exceeds an intensity threshold: determine whether a context available element is available for the user interface; enable the display of a context available element based on the determination that a context available element is available; and enable the display of a visual indication that a context available element is unavailable for the user interface based on the determination that a context available element is unavailable.

[0058] In some embodiments, a system includes: a display; means for receiving user input; and, in response to receiving user input, means for: identifying the most recently accessed user input technique in a set of user input techniques; identifying the least recently accessed user input technique in the set of user input techniques; displaying a user input interface of the most recently accessed user input technique on the display; and means for displaying a first available element associated with the user input interface of the least recently accessed user input technique on the display.

[0059] In some embodiments, a system includes: a display; means for displaying a portion of a set of information; means for receiving user input associated with the set of information; means for scrolling the set of information on the display in response to receiving the user input associated with the set of information; means for determining whether a scrolling attribute satisfies a threshold criterion; and means for displaying an index object based on the determination that the scrolling attribute satisfies the threshold criterion.

[0060] In some embodiments, a system includes: a display; means for receiving user input associated with a messaging input interface; means for displaying a Graphic Object in response to receiving the user input associated with the messaging input interface; means for receiving first user input associated with the Graphic Object; means for changing a first visual aspect of the Graphic Object in response to receiving the first user input associated with the Graphic Object, wherein the change in the first visual aspect is based on the first user input; receiving recipient information; and means for transmitting the Graphic Object including the changed first visual aspect to a recipient associated with the received recipient information.

[0061] In some embodiments, a system includes: a display; a touch-sensitive surface; means for displaying a first page of a user interface and a first set of page-turning options, wherein the first set of page-turning options includes a first page-turning option, the first page-turning option including a focus selector, and wherein the first page-turning option corresponds to the first page of the user interface; receiving a user touch at a first location on the touch-sensitive surface, wherein the first location is associated with the first set of page-turning options; means for replacing the display of the first set of page-turning options with the display of a second set of page-turning options in response to receiving a user touch at the first location, wherein the second set of page-turning options includes a second page-turning option corresponding to a second page of the user interface; means for detecting, while continuing to receive user touches, movement of a user touch from the first location to a second location on the touch-sensitive surface in the absence of interruptions in contact with the user touch on the touch-sensitive surface, wherein the second location is associated with a second page-turning option; and displaying a second page of the user interface in response to detecting a user touch at the second location.

[0062] In some embodiments, a system includes: a display; a touch-sensitive surface; means for displaying a first page of a user interface among a plurality of pages and a first set of page-turning options, wherein the first set of page-turning options includes a first page-turning option, the first page-turning option including a focus selector, and wherein the first page-turning option corresponds to the first page of the user interface; means for receiving a user touch at a first location on the touch-sensitive surface, the first location corresponding to the first set of page-turning options; and means for replacing the display of the first set of page-turning options with the display of a second set of page-turning options in response to receiving the user touch at the first location, wherein the second set of page-turning options includes the first page of the user interface; means for receiving a user touch at the first location; and means for replacing the display of the first set of page-turning options with the display of a second set of page-turning options, wherein the second set of page-turning options includes the first page of the user interface; means for receiving a user touch at a first location on the touch-sensitive surface and a first set of page-turning options; means for receiving a user touch at the first location on the touch-sensitive surface and a first set of page-turning options. The device includes a first page-turning device comprising a focus selector, and wherein the first page-turning device corresponds to a first page of a user interface; means for detecting, while receiving a user touch, movement of a user touch from a first position to a second position on a touch-sensitive surface without interruption of contact with the touch-sensitive surface, wherein the second position is associated with a second page-turning device; and means for, in response to detecting a user touch at the second position, to: replace the display of the first page with the second page of a plurality of pages; and means for updating a second set of page-turning devices, wherein updating includes removing the focus selector from the first page-turning devices in the set and displaying the second page-turning device with the focus selector in the set of page-turning devices.

[0063] In some embodiments, a system includes: a display; a touch-sensitive surface; means for receiving first user input; means for displaying a spoken user interface on the display in response to receiving the first user input; means for receiving second user input; means for replacing the display of the spoken user interface with the display of a first Emoji graphic object in response to receiving the second user input; means for receiving a first user swipe gesture input at a location on the touch-sensitive surface associated with the first Emoji graphic object; means for replacing the display of the first Emoji graphic object with the display of a second Emoji graphic object in response to receiving the first user swipe gesture input; means for receiving a second user swipe gesture input at the touch-sensitive surface; and means for displaying a set of recently accessed Emoji graphic objects in response to receiving the second user swipe gesture input.

[0064] Executable instructions for performing these functions may optionally be included in a non-transient computer-readable storage medium or other computer program product configured for execution by one or more processors.

[0065] Therefore, devices with faster and more efficient methods and interfaces for receiving user input are provided, thereby increasing effectiveness, efficiency, and user satisfaction with such devices. Such methods and interfaces can complement or replace other methods for receiving user input. Attached Figure Description

[0066] To better understand the various described embodiments, reference should be made to the following description of the embodiments in conjunction with the accompanying drawings, in which the same reference numerals refer to corresponding parts throughout the drawings.

[0067] Figure 1A This is a block diagram illustrating a portable multi-functional device with a touch-sensitive display according to some embodiments.

[0068] Figure 1B This is a block diagram illustrating exemplary components for event handling according to some embodiments.

[0069] Figure 2 The illustration shows a portable multi-functional device with a touchscreen according to some embodiments.

[0070] Figure 3 This is a block diagram illustrating an exemplary multifunctional device having a display and a touch-sensitive surface according to some embodiments.

[0071] Figure 4A An exemplary user interface for an application menu on a portable multi-functional device, according to some embodiments, is illustrated.

[0072] Figure 4B An exemplary user interface for a multifunctional device having a touch-sensitive surface separate from the display is illustrated according to some embodiments.

[0073] Figure 5A The illustration shows a personal electronic device according to some embodiments.

[0074] Figure 5B This is a block diagram illustrating a personal electronic device according to some embodiments.

[0075] Figures 5C to 5D The illustration shows exemplary components of a personal electronic device having a touch-sensitive display and an intensity sensor according to some embodiments.

[0076] Figures 5E to 5H Exemplary components and user interfaces of a personal electronic device according to some embodiments are illustrated.

[0077] Figures 6A to 6D An exemplary user interface for receiving user input is illustrated according to some embodiments.

[0078] Figure 7This is a flowchart illustrating an exemplary process for receiving user input according to some embodiments.

[0079] Figure 8 The illustration shows an exemplary user interface for user input associated with a scrollable list according to some embodiments.

[0080] Figure 9 This is a flowchart illustrating an exemplary process for receiving user input associated with a scrollable list, according to some embodiments.

[0081] Figure 10 This is a flowchart illustrating an exemplary process for receiving user input associated with a scrollable list, according to some embodiments.

[0082] Figure 11 An exemplary user interface for manipulating emoji graphic objects is illustrated according to some embodiments.

[0083] Figure 12 This is a flowchart illustrating an exemplary process for manipulating emoticon graphic objects according to some embodiments.

[0084] Figure 13 An exemplary user interface for switching between various pages is illustrated according to some embodiments.

[0085] Figures 14A to 14B This is a flowchart illustrating an exemplary process for transitioning between various pages according to some embodiments.

[0086] Figures 15A to 15B An exemplary user interface for receiving user input is illustrated according to some embodiments.

[0087] Figure 16 This is a flowchart illustrating an exemplary process for receiving user input according to some embodiments.

[0088] Figures 17A to 17D An exemplary user interface for receiving user input is illustrated according to some embodiments.

[0089] Figures 18 to 23 The illustration shows a functional block diagram according to some embodiments.

[0090] Figure 24 This is a flowchart illustrating an exemplary process for receiving user input according to some embodiments.

[0091] Figure 25 The illustration shows a functional block diagram according to some embodiments.

[0092] Figures 26A to 26N An exemplary user interface for receiving user input is illustrated according to some embodiments.

[0093] Figure 27 This is a flowchart illustrating an exemplary process for receiving user input according to some embodiments.

[0094] Figure 28 The illustration shows a functional block diagram according to some embodiments. Detailed Implementation

[0095] The following description illustrates exemplary methods, parameters, etc. However, it should be understood that such description is not intended to limit the scope of this disclosure, but rather is provided as a description of exemplary embodiments.

[0096] There is a need for electronic devices that provide efficient interfaces for receiving user input. For example, easy-to-use interfaces for selecting items from lists, entering text input, and selecting specific pages of documents enhance user access and input efficiency. Such technologies can reduce the cognitive load on users using messaging, music, and other applications, thereby increasing productivity. Furthermore, such technologies can reduce processor and battery power that would otherwise be wasted on redundant user input.

[0097] under, Figures 1A to 1B , Figure 2 , Figure 3 and Figures 4A to 4B as well as Figures 5A to 5B A description is provided for implementing an exemplary device for receiving user input. Figures 6A to 6D , Figure 8 , Figure 11 , Figure 13 , Figures 15A to 15B and Figures 17A to 17D The illustration depicts an exemplary user interface for receiving user input. The user interface in the figure also illustrates the processes described below, including... Figure 7 , Figure 9 , Figure 10 , Figure 12 , Figures 14A to 14B and Figure 16 The process in.

[0098] Although the following description uses the terms "first," "second," etc., to describe various elements, these elements should not be limited by the terms. These terms are used only to distinguish one element from another. For example, a first touch may be referred to as a second touch, and similarly, a second touch may be referred to as a first touch, without departing from the scope of the various described embodiments. Both a first touch and a second touch are touches, but they are not the same touch.

[0099] The terminology used in the description of the various embodiments described herein is for the purpose of describing particular embodiments only and is not intended to be limiting. The singular forms “a,” “an,” and “described” as used in the description of the various embodiments and in the appended claims are intended to include the plural forms as well, unless the context clearly indicates otherwise. It should also be understood that the term “and / or” as used herein refers to and covers any item in one or more entries of the associated listed items and all possible combinations thereof. Furthermore, it should be understood that the terms “comprising,” “having,” “including,” and / or “containing,” as used in this specification, specify the presence of features, integrals, steps, operations, elements, and / or portions, but do not preclude the presence or addition of one or more other features, integrals, steps, operations, elements, components, and / or combinations thereof.

[0100] The term "if" may be interpreted, depending on the context, as meaning "when," "once," "in response to determination," or "in response to detection." Similarly, the phrases "if determination" or "if [a certain condition or event] is detected" may be interpreted, depending on the context, as meaning "once determination, then," "in response to determination," "once [a certain condition or event] is detected," or "in response to the detection of [a certain condition or event]."

[0101] Embodiments of electronic devices, user interfaces for such devices, and associated processes for using such devices are described. In some embodiments, the device is a portable communication device (such as a mobile phone) that also includes other functions such as PDA and / or music player functionality. Exemplary embodiments of portable multi-functional devices include, but are not limited to, those from Apple Inc., Cupertino, California. iPod and Devices. Other portable electronic devices, such as laptops or tablets with touch-sensitive surfaces (e.g., touchscreen displays and / or touchpads), may also be used. It should also be understood that in some embodiments, the device is not a portable communication device, but a desktop computer with touch-sensitive surfaces (e.g., touchscreen displays and / or touchpads).

[0102] In the following discussion, an electronic device comprising a display and a touch-sensitive surface is described. However, it should be understood that the computing device may include one or more other physical user interface devices, such as a physical keyboard, mouse, and / or joystick.

[0103] The device typically supports a variety of applications, such as one or more of the following: drawing applications, presentation applications, word processing applications, website creation applications, disk writing applications, spreadsheet applications, game applications, telephone applications, video conferencing applications, email applications, instant messaging applications, training support applications, photo management applications, digital camera applications, digital video recorder applications, web browsing applications, digital music player applications, and / or digital video player applications.

[0104] Various applications running on the device may optionally use at least one common physical user interface device, such as a touch-sensitive surface. One or more functions of the touch-sensitive surface, and the corresponding information displayed on the device, may be optionally adjusted and / or changed from one application to the next and / or within each application. In this way, the device's common physical architecture (such as the touch-sensitive surface) may optionally support various applications through a user interface that is intuitive and transparent to the user.

[0105] We will now focus on embodiments that turn to portable devices with touch-sensitive displays. Figure 1A This is a block diagram illustrating a portable multi-functional device 100 with a touch-sensitive display system 112 according to some embodiments. The touch-sensitive display 112 is sometimes referred to as a “touchscreen” and is sometimes considered or referred to as a touch-sensitive display system. Device 100 includes a memory 102 (which optionally includes one or more computer-readable storage media), a memory controller 122, one or more processing units (CPUs) 120, a peripheral interface 118, RF circuitry 108, audio circuitry 110, a speaker 111, a microphone 113, an input / output (I / O) subsystem 106, other input or control devices 116, and an external port 124. Device 100 optionally includes one or more optical sensors 164. Device 100 optionally includes one or more contact strength sensors 165 for detecting the contact strength on device 100 (e.g., a touch-sensitive surface, such as the touch-sensitive display system 112 of device 100). Device 100 may optionally include one or more tactile output generators 167 for generating tactile output on device 100 (e.g., generating tactile output on a touch-sensitive surface such as the touch-sensitive display system 112 of device 100 or the touchpad 335 of device 300). These components may optionally communicate via one or more communication buses or signal lines 103.

[0106] As used in the specification and claims, the term "intensity" for contact on a tactile surface refers to the force or pressure (force per unit area) of contact (e.g., finger contact) on the tactile surface, or to a substitute (proxy) for the force or pressure used for contact on the tactile surface. Contact intensity has a numerical range including at least four different values ​​and more typically including hundreds of different values ​​(e.g., at least 256). Optionally, various methods and various sensors or combinations of sensors are used to determine (or measure) contact intensity. For example, one or more force sensors, located below or adjacent to the tactile surface, may be used to measure force at various points on the tactile surface. In some embodiments, force measurements from multiple force sensors are combined (e.g., weighted average) to determine an estimated force of contact. Similarly, the pressure-sensitive tip of a stylus may be used to determine the pressure of the stylus on the tactile surface. Alternatively, the size and / or changes thereto of the contact area detected on the touch-sensitive surface, the capacitance and / or changes thereto of the touch-sensitive surface adjacent to the contact, and the resistance and / or changes thereto of the touch-sensitive surface adjacent to the contact can optionally be used as alternatives to the force or pressure of contact on the touch-sensitive surface. In some embodiments, alternative measurements for contact force or contact pressure are used directly to determine whether an intensity threshold has been exceeded (e.g., the intensity threshold is described in units corresponding to the alternative measurement). In some embodiments, alternative measurements for contact force or contact pressure are converted into an estimated force or estimated pressure, and this estimated force or estimated pressure is used to determine whether an intensity threshold has been exceeded (e.g., the intensity threshold is a pressure threshold measured in units of pressure). Using contact intensity as a user input attribute allows user access to additional device functionality that would otherwise be inaccessible to the user on a device with a reduced size (e.g., via a touch-sensitive display) having a limited effective area for displaying affordances and / or receiving user input (e.g., via a touch-sensitive display, a touch-sensitive surface, or physical / mechanical controls such as knobs or buttons).

[0107] As used in the specification and claims, the term "haptic output" refers to a physical displacement of the device relative to a previous position of the device, a physical displacement of a component of the device (e.g., a touch-sensitive surface) relative to another component of the device (e.g., the housing), or a displacement of a component relative to the center of gravity of the device, which will be detected by the user using the user's tactile sense. For example, when the device or a component of the device comes into contact with a touch-sensitive user surface (e.g., a finger, palm, or other part of the user's hand), the haptic output resulting from the physical displacement will be interpreted by the user as a tactile sensation corresponding to a change in the perceived physical characteristics of the device or a component of the device. For example, movement of a touch-sensitive surface (e.g., a touch-sensitive display or touchpad) may optionally be interpreted by the user as a "press-click" or "release-click" of a physical actuator button. In some cases, the user will feel a tactile sensation such as a "press-click" or "release-click" even when there is no movement of a physical actuator button associated with a touch-sensitive surface physically pressed (e.g., displaced) by the user's movement. As another example, even when the smoothness of the touch-sensitive surface does not change, the movement of the touch-sensitive surface may optionally be interpreted or felt by the user as the "roughness" of the touch-sensitive surface. While this interpretation of touch by a user will be influenced by the user's personalized sensory perception, there are sensory perceptions of touch at many points common to most users. Therefore, when tactile output is described as corresponding to a user's specific sensory perception (e.g., "lift-to-click", "press-to-click", "roughness"), the resulting tactile output will correspond to the physical displacement of the device or its components, which will produce the sensory perception described for a typical (or average) user, unless explicitly indicated otherwise.

[0108] It should be understood that device 100 is merely an example of a portable multifunctional device, and device 100 may optionally have more or fewer components than those shown, may optionally combine two or more components, or may optionally have different component configurations or arrangements. Figure 1A The various components shown can be implemented in hardware, software, or a combination of both, including one or more signal processing and / or application-specific integrated circuits.

[0109] Memory 102 may optionally include one or more computer-readable storage media. The computer-readable storage media may optionally be tangible and non-transient. The computer-readable storage media may optionally be transient. Memory 102 may optionally include high-speed random access memory, and may optionally also include non-volatile memory, such as one or more disk storage devices, flash memory devices, or other non-volatile solid-state memory devices. Memory controller 122 may optionally control access to memory 102 via other components of device 100.

[0110] Peripheral interface 118 can be used to peripherally couple the device's inputs and outputs to CPU 120 and memory 102. One or more processors 120 run or execute various software programs and / or instruction sets stored in memory 102 to perform various functions for device 100 and to process data. In some embodiments, peripheral interface 118, CPU 120, and memory controller 122 may optionally be implemented on a single chip (such as chip 104). In some other embodiments, they may optionally be implemented on separate chips.

[0111] RF (Radio Frequency) circuitry 108 receives and transmits RF signals, also known as electromagnetic signals. RF circuitry 108 converts electrical signals into electromagnetic signals and vice versa, and communicates with communication networks and other communication devices via electromagnetic signals. RF circuitry 108 may optionally include known circuitry for performing these functions, including but not limited to: antenna systems, RF transceivers, one or more amplifiers, tuners, one or more oscillators, digital signal processors, CODEC chipsets, customer identity module (SIM) cards, memory, etc. RF circuitry 108 may optionally communicate wirelessly with the Internet, also known as the World Wide Web (WWW), intranets, and / or wireless networks such as cellular telephone networks, wireless local area networks (LANs), and / or metropolitan area networks (MANs), and other devices. RF circuitry 108 may optionally include known circuitry for detecting near-field communication (NFC) fields, such as via short-range communication radio. Wireless communication may optionally use any of a variety of communication standards, protocols, and technologies, including but not limited to: Global System for Mobile Communications (GSM), Enhanced Data GSM Environment (EDGE), High-Speed ​​Downlink Packet Access (HSDPA), High-Speed ​​Uplink Packet Access (HSUPA), Evolved Data Only (EV-DO), HSPA, HSPA+, Dual-Cell HSPA (DC-HSPDA), Long Term Evolution (LTE), Near Field Communication (NFC), Wideband Code Division Multiple Access (W-CDMA), Code Division Multiple Access (CDMA), Time Division Multiple Access (TDMA), Bluetooth, Bluetooth Low Energy (BTLE), and Wireless High Fidelity (Wi-Fi) (e.g., IEEE 802.11a, IEEE 802.11b, IEEE 802.11g, IEEE 802.11n and / or IEEE...). 802.11ac), Voice over Internet Protocol (VoIP), Wi-MAX, protocols for email (e.g., Internet Messaging Access Protocol (IMAP) and / or Post Office Protocol (POP)), instant messaging (e.g., Extensible Messaging and Field Protocol (XMPP), Session Initiation Protocol for Instant Messaging and Field Balanced Extensions (SIMPLE), Instant Messaging and Field Services (IMPS)) and / or Short Message Service (SMS), or any other suitable communication protocol, including communication protocols that have not been developed as of the date of this document submission.

[0112] Audio circuitry 110, speaker 111, and microphone 113 provide an audio interface between the user and device 100. Audio circuitry 110 receives audio data from peripheral interface 118, converts the audio data into an electrical signal, and transmits the electrical signal to speaker 111. Speaker 111 converts the electrical signal into sound waves that are audible to humans. Audio circuitry 110 also receives electrical signals converted from sound waves by microphone 113. Audio circuitry 110 converts the electrical signals into audio data and transmits the audio data to peripheral interface 118 for processing. Audio data may optionally be acquired from and / or transmitted to memory 102 and / or RF circuitry 108 via peripheral interface 118. In some embodiments, audio circuitry 110 also includes a headphone jack (e.g., ...). Figure 2 (212 in the text). The headphone jack provides an interface between the audio circuitry 110 and a removable audio input / output peripheral device (such as a receiver with only output or a headset that can output (e.g., a receiver with one or both ears) and input (e.g., a microphone)).

[0113] I / O subsystem 106 couples input / output peripherals (such as touchscreen 112 and other input control devices 116) on device 100 to peripheral interface 118. I / O subsystem 106 optionally includes display controller 156, optical sensor controller 158, intensity sensor controller 159, haptic feedback controller 161, and one or more input controllers 160 for other input or control devices. The one or more input controllers 160 receive / send electrical signals to / from other input or control devices 116. Other input or control devices 116 optionally include physical buttons (e.g., push-buttons, joysticks, etc.), dials, slide switches, joysticks, click dials, etc. In some alternative embodiments, the input controllers 160 may optionally be coupled to any (or none of) of the following: keyboard, infrared port, USB port, and pointing device such as a mouse. One or more buttons (e.g., Figure 2 Optionally, 208) may include an up / down button for volume control of speaker 111 and / or microphone 113. The one or more buttons may optionally include a push-down button (e.g., Figure 2 (206 in the middle).

[0114] A rapid press of the push button may optionally disengage the touchscreen 112 from a lock or optionally initiate a process of using gestures on the touchscreen to unlock the device, as described in U.S. Patent Application No. 11 / 322,549 and U.S. Patent No. 7,657,849, filed December 23, 2005, entitled "Unlocking a Device by Performing Gestures on an Unlock Image," which are incorporated herein by reference in their entirety. A prolonged press of the push button (e.g., 206) may optionally power on or off the device 100. The function of one or more buttons may optionally be user-customizable. The touchscreen 112 is used to implement virtual buttons or soft buttons and one or more soft keyboards.

[0115] The touch-sensitive display 112 provides input and output interfaces between the device and the user. The display controller 156 receives electrical signals from and / or sends electrical signals to the touchscreen 112. The touchscreen 112 displays visual output to the user. This visual output may optionally include graphics, text, icons, video, and any combination thereof (collectively, "graphics"). In some embodiments, some or all of the visual output may optionally correspond to user interface objects.

[0116] Touchscreen 112 has a touch-sensitive surface, sensor, or set of sensors that accept input from a user based on haptic and / or tactile contact. Touchscreen 112 and display controller 156 (along with any associated modules and / or instruction set in memory 102) detect contact on touchscreen 112 (and any movement or interruption of contact) and translate the detected contact into interaction with user interface objects (e.g., one or more soft keys, icons, web pages, or images) displayed on touchscreen 112. In one exemplary embodiment, the contact point between touchscreen 112 and the user corresponds to the user's finger.

[0117] While other display technologies are used in other embodiments, the touchscreen 112 may optionally use LCD (Liquid Crystal Display) technology, LPD (Light Emitting Polymer Display) technology, or LED (Light Emitting Diode) technology. The touchscreen 112 and display controller 156 may optionally use any of a variety of touch sensing technologies now known or developed hereafter to detect contact and any movement or interruption of contact. These touch sensing technologies include, but are not limited to, capacitive, resistive, infrared, and surface acoustic wave technologies, as well as other proximity sensor arrays or other elements for determining one or more points of contact with the touchscreen 112. In one exemplary embodiment, projected mutual capacitance sensing technology, such as that available at Apple Inc. in Cupertino, California, is used. and iPod The technology found there.

[0118] In some embodiments of the touchscreen 112, the touch-sensitive display may optionally be similar to a multi-touch sensitive touchpad described in the following U.S. patents: 6,323,846 (Westerman et al.), 6,570,557 (Westerman et al.), and / or 6,677,932 (Westerman), and / or U.S. Patent Publication 2002 / 0015024A1, each of which is incorporated herein by reference in its entirety. However, the touchscreen 112 displays visual output from the device 100, while the touch-sensitive touchpad does not provide visual output.

[0119] Touchscreen 112 has touch-sensitive displays in some embodiments as described in the following applications: (1) U.S. Patent Application No. 11 / 381,313, filed May 2, 2006, entitled “Multipoint Touch Surface Controller”; (2) U.S. Patent Application No. 10 / 840,862, filed May 6, 2004, entitled “Multipoint Touchscreen”; (3) U.S. Patent Application No. 10 / 903,964, filed July 30, 2004, entitled “Gestures For Touch Sensitive Input Devices”; (4) U.S. Patent Application No. 11 / 048,264, filed January 31, 2005, entitled “Gestures For Touch Sensitive Input Devices”; and (5) U.S. Patent Application No. 18, 2005, entitled “Mode-Based Graphical User Interfaces For Touch Sensitive”. U.S. Patent Application No. 11 / 038,590, entitled “Input Devices”; (6) U.S. Patent Application No. 11 / 228,758, entitled “Virtual Input Device Placement On A Touch Screen User Interface”, filed September 16, 2005; (7) U.S. Patent Application No. 11 / 228,700, entitled “Operation Of A Computer With A Touch Screen Interface”, filed September 16, 2005; (8) U.S. Patent Application No. 11 / 228,737, entitled “Activating Virtual Keys Of A Touch-Screen Virtual Keyboard”, filed September 16, 2005; and (9) U.S. Patent Application No. 11 / 367,749, entitled “Multi-Functional Hand-Held Device”, filed March 3, 2006. All of these applications are incorporated herein by reference in their entirety.

[0120] The touchscreen 112 optionally has a video resolution exceeding 100 dpi. In some embodiments, the touchscreen has a video resolution of approximately 160 dpi. Users may optionally interact with the touchscreen 112 using any suitable object or accessory, such as a stylus, finger, etc. In some embodiments, the user interface is designed to function primarily through finger-based touch and gestures, which may be less precise than stylus-based input due to the larger contact area of ​​the finger on the touchscreen. In some embodiments, the device translates coarse finger-based input into precise pointer / cursor positions or commands to perform the user-desired actions.

[0121] In some embodiments, in addition to the touchscreen, device 100 may optionally include a touchpad (not shown) for activating or deactivating specific functions. In some embodiments, the touchpad is a touch-sensitive area of ​​the device that differs from the touchscreen and does not display visual output. The touchpad may optionally be a touch-sensitive surface separate from the touchscreen 112 or an extension of the touch-sensitive surface formed by the touchscreen.

[0122] The device 100 also includes a power system 162 for supplying power to various components. The power system 162 may optionally include a power management system, one or more power sources (e.g., a battery, alternating current (AC)), a charging system, a power failure detection circuit, a power converter or inverter, a power status indicator (e.g., a light-emitting diode (LED)), and any other components related to the generation, management, and distribution of power in the portable device.

[0123] The device 100 may optionally also include one or more optical sensors 164. Figure 1AAn optical sensor 164 coupled to a controller 158 of an optical sensor in I / O subsystem 106 is shown. The optical sensor 164 optionally includes a charge-coupled device (CCD) or a complementary metal-oxide-semiconductor (CMOS) phototransistor. The optical sensor 164 receives light from the environment projected through one or more lenses and converts the light into data representing an image. In conjunction with an imaging module 143 (also referred to as a camera module), the optical sensor 164 optionally captures still images or video. In some embodiments, the optical sensor is located on the back of device 100, opposite a touchscreen display 112 on the front of the device, enabling the touchscreen display to be used as a viewfinder for still and / or video image acquisition. In some embodiments, the optical sensor is located on the front of the device, optionally capturing user images for a video conference while the user views other video conference participants on the touchscreen display. In some embodiments, the position of the optical sensor 164 can be changed by the user (e.g., by rotating lenses and sensors within the device housing), allowing a single optical sensor 164 to be used in conjunction with the touchscreen display for both video conferencing and still and / or video image acquisition.

[0124] The device 100 may optionally also include one or more contact strength sensors 165. Figure 1A A contact strength sensor is shown coupled to a strength sensor controller 159 in I / O subsystem 106. The contact strength sensor 165 optionally includes one or more piezoresistive strain gauges, capacitive force sensors, electrostatic force sensors, piezoelectric force sensors, optical force sensors, capacitive touch-sensitive surfaces, or other strength sensors (e.g., sensors for measuring the force (or pressure) of contact on a touch-sensitive surface). The contact strength sensor 165 receives contact strength information (e.g., pressure information or alternatives for pressure information) from the environment. In some embodiments, at least one contact strength sensor is juxtaposed with or near a touch-sensitive surface (e.g., touch-sensitive display system 112). In some embodiments, at least one contact strength sensor is located on the back of device 100, opposite a touchscreen display 112 located on the front of device 100.

[0125] The device 100 may optionally also include one or more proximity sensors 166. Figure 1AA proximity sensor 166 coupled to a peripheral interface 118 is shown. Alternatively, the proximity sensor 166 may be coupled to an input controller 160 in an I / O subsystem 106. The proximity sensor 166 may perform as described in U.S. Patent Application No. 11 / 241,839 entitled "Proximity Detector In Handheld Device", U.S. Patent Application No. 11 / 240,788 entitled "Proximity Detector In Handheld Device", U.S. Patent Application No. 11 / 620,702 entitled "Using Ambient Light Sensor To Augment ProximitySensor Output", U.S. Patent Application No. 11 / 586,862 entitled "Automated Response To And Sensing Of User Activity In Portable Devices", and U.S. Patent Application No. 11 / 638,251 entitled "Methods And Systems For Automatic Configuration Of Peripherals", all of which are incorporated herein by reference in their entirety. In some embodiments, when the multifunction device is near the user's ear (e.g., when the user is making a phone call), the proximity sensor is turned off and the touchscreen 112 is disabled.

[0126] The device 100 may optionally also include one or more tactile output generators 167. Figure 1AA haptic output generator coupled to a haptic feedback controller 161 in I / O subsystem 106 is shown. The haptic output generator 167 optionally includes one or more electroacoustic devices (such as speakers or other audio components) and / or electromechanical devices that convert electrical energy into linear motion (such as motors, solenoids, electroactive polymers, piezoelectric actuators, electrostatic actuators, or other haptic output generating components (e.g., components that convert electrical signals into haptic outputs on the device)). A contact intensity sensor 165 receives haptic feedback generation instructions from a haptic feedback module 133 and generates a haptic output on device 100 that can be felt by a user of device 100. In some embodiments, at least one haptic output generator is juxtaposed with or near a haptic surface (e.g., a haptic display system 112) and optionally generates the haptic output by moving the haptic surface vertically (e.g., in / outside the surface of device 100) or laterally (reciprocating in the same plane as the surface of device 100). In some embodiments, at least one haptic output generator sensor is located on the back of the device 100, opposite to the touch screen display 112 located on the front of the device 100.

[0127] The device 100 may optionally also include one or more accelerometers 168. Figure 1A An accelerometer 168 coupled to a peripheral interface 118 is shown. Alternatively, the accelerometer 168 may be coupled to an input controller 160 in an I / O subsystem 106. The accelerometer 168 may be performed as described in U.S. Patent Publication No. 20050190059 entitled “Acceleration-based Theft Detection System for Portable Electronic Devices” and U.S. Patent Publication No. 20060017692 entitled “Methods and Apparatuses For Operating A Portable Device Based On An Accelerometer,” both of which are incorporated herein by reference in their entirety. In some embodiments, information is displayed on a touchscreen display in either a portrait or landscape view based on analysis of data received from one or more accelerometers. In addition to the accelerometer(s)168, the device 100 may also optionally include a magnetometer (not shown) and a GPS (or GLONASS or other global navigation system) receiver (not shown) for obtaining information relating to the position and orientation (e.g., portrait or landscape) of the device 100.

[0128] In some embodiments, the software components stored in memory 102 include an operating system 126, a communication module (or instruction set) 128, a contact / motion module (or instruction set) 130, a graphics module (or instruction set) 132, a text input module (or instruction set) 134, a Global Positioning System (GPS) module (or instruction set) 135, and an application (or instruction set) 136. Furthermore, as... Figure 1A and Figure 3 As shown, in some embodiments, memory 102 ( Figure 1A ) or memory 370 ( Figure 3 Storage device / global internal state 157. Device / global internal state 157 includes one or more of the following: active application state, indicating which applications (if any) are currently active; display state, indicating what applications, views and other information occupy various areas of the touch screen display 112; sensor state, including information obtained from the device's various sensors and input control devices 116; and position information related to the device's position and / or orientation.

[0129] The operating system 126 (e.g., Darwin, RTXC, LINUX, UNIX, OS X, iOS, WINDOWS, or an embedded operating system such as VxWorks) includes various software components and / or drivers for controlling and managing general system tasks (e.g., memory management, storage device control, power management, etc.) and facilitates communication between various hardware and software components.

[0130] The communication module 128 facilitates communication with other devices on one or more external ports 124 and includes various software components for processing data received by the RF circuitry device 108 and / or the external ports 124. The external ports 124 (e.g., Universal Serial Bus (USB), FireWire, etc.) are adapted to be directly coupled to other devices or indirectly coupled to other devices via a network (e.g., the Internet, Wireless LAN, etc.). In some embodiments, the external port is used in conjunction with... (A trademark of Apple Inc.) The same, similar and / or compatible multi-pin (e.g., 30-pin) connectors on the device.

[0131] The contact / motion module 130 optionally detects contact with the touchscreen 112 (in conjunction with the display controller 156) and other touch-sensitive devices (e.g., a touchpad or physical click wheel). The contact / motion module 130 includes various software components for performing various operations related to contact detection, such as determining whether a contact has occurred (e.g., detecting a finger press event), determining the contact intensity (e.g., the force or pressure of the contact, or an alternative to the force or pressure used for the contact), determining whether there is movement of the contact and tracking movement across the touch-sensitive surface (e.g., detecting one or more finger drag events), and determining whether the contact has stopped (e.g., detecting a finger lift event or a contact interruption). The contact / motion module 130 receives contact data from the touch-sensitive surface. Determining the movement of the touch point (represented by a series of contact data) optionally includes determining the rate (magnitude), velocity (magnitude and direction), and / or acceleration (change in magnitude and / or direction) of the touch point. These operations can optionally be applied to a single contact (e.g., a single finger contact) or multiple simultaneous contacts (e.g., "multi-touch" / multiple finger contact). In some embodiments, the contact / motion module 130 and the display controller 156 detect contact on the touchpad.

[0132] In some embodiments, the contact / motion module 130 uses a set of one or more intensity thresholds to determine whether an operation has been performed by the user (e.g., determining whether the user has “clicked” an icon). In some embodiments, at least a subset of the intensity thresholds is determined based on software parameters (e.g., the intensity thresholds are not determined by the activation threshold of a specific physical actuator and are adjusted without changing the physical hardware of the device 100). For example, the mouse “click” threshold of a touchpad or touchscreen display can be set to any wide range of a predetermined threshold range without changing the touchpad or touchscreen display hardware. Furthermore, in some embodiments, the user of the device is provided with software settings for adjusting one or more intensity thresholds in the set of intensity thresholds (e.g., adjusting a single and / or multiple intensity thresholds at once via a system-level click “intensity” parameter).

[0133] The touch / motion module 130 optionally detects gestures input by the user. Different gestures on a touch-sensitive surface have different contact patterns (e.g., different movements, timings, and / or detected contact intensities). Therefore, gestures can be detected optionally by detecting specific contact patterns. For example, detecting a finger tapping gesture includes: detecting a finger press event, followed by detecting a finger lift (e.g., raise) event at the same location (e.g., at the icon location) as the finger press event (e.g., at the icon location). As another example, detecting a finger dragging gesture on a touch surface includes: detecting a finger press event, followed by detecting one or more finger dragging events, and then detecting a finger lift (raise) event.

[0134] The graphics module 132 includes various known software components for rendering and displaying graphics on the touchscreen 112 or other displays, including components for altering the visual effects of the displayed graphics (e.g., brightness, transparency, saturation, contrast, or other visual attributes). As used herein, the term "graphics" includes any object that can be displayed to a user, including but not limited to: text, web pages, icons (such as user interface objects including soft keys), digital images, videos, animations, etc.

[0135] In some embodiments, the graphics module 132 stores data representing graphics to be used. Each graphic is optionally assigned a corresponding code. The graphics module 132 receives one or more codes specifying the graphics to be displayed from applications, etc., along with coordinate data and other graphic attribute data (if necessary), and then generates screen image data for output to the display controller 156.

[0136] The haptic feedback module 133 includes various software components that, in response to user interaction with the device 100, generate instructions for use by the haptic output generator(s) 167 to produce haptic output at one or more locations on the device.

[0137] The text input module 134 (which may optionally be a component of the graphics module 132) provides a soft keyboard for entering text into various applications (e.g., contacts 137, email 140, IM 141, browser 147, and any other application that requires text input).

[0138] GPS module 135 determines the location of the device and provides this information for use by various applications (e.g., to telephone 138 for use in location-based dialing; to camera 143 as image / video metadata; and to applications for location-based services such as weather widgets, local yellow pages widgets, and map / navigation widgets).

[0139] Application 136 may optionally include the following modules (or instruction sets), or subsets or supersets thereof:

[0140] • Contacts module 137 (sometimes called address book or contact list);

[0141] • Telephone module 138;

[0142] • Video conferencing module 139;

[0143] • Email client module 140

[0144] • Instant Messaging (IM) module 141;

[0145] • Training support module 142;

[0146] • Camera module 143 for still and / or video images;

[0147] • Image management module 144;

[0148] • Video player module;

[0149] Music player module;

[0150] • Browser module 147;

[0151] • Calendar module 148;

[0152] • Widget module 149, which may optionally include one or more of the following: weather widget 149-1, stock widget 149-2, calculator widget 149-3, alarm clock widget 149-4, dictionary widget 149-5 and other widgets obtained by the user, and user-created widget 149-6;

[0153] • Widget Creator Module 150, used to create user-created widgets 149-6;

[0154] • Search module 151;

[0155] • Video and music player module 152, which combines a video player module and a music player module;

[0156] • Memo module 153;

[0157] • Map module 154; and / or

[0158] • Online video module 155.

[0159] Examples of other applications 136 that may be optionally stored in memory 102 include other word processing applications, other image editing applications, drawing applications, presentation applications, applications that support JAVA features, encryption, digital access control, speech recognition, and speech duplication.

[0160] In conjunction with the touchscreen 112, display controller 156, touch / motion module 130, graphics module 132, and text input module 134, the contact module 137 is optionally used to manage an address book or contact list (e.g., in the application internal state 192 of the contact module 137 stored in memory 102 or memory 370), including: adding one or more names to the address book; deleting one or more names from the address book; associating one or more phone numbers, one or more email addresses, one or more physical addresses, or other information with a name; associating an image with a name; categorizing and sorting names; providing a phone number or email address to initiate and / or facilitate communication via telephone 138, video conferencing module 139, email 140, or instant messaging 141, etc.

[0161] In conjunction with RF circuitry 108, audio circuitry 110, speaker 111, microphone 113, touchscreen 112, display controller 156, contact / motion module 130, graphics module 132, and text input module 134, telephone module 138 is optionally used to input character sequences corresponding to telephone numbers, access one or more telephone numbers in contact module 137, modify input telephone numbers, dial corresponding telephone numbers, initiate conversations, and disconnect or hang up when a conversation is complete. As described above, wireless communication may optionally use any of a variety of communication standards, protocols, and technologies.

[0162] Combining RF circuitry 108, audio circuitry 110, speaker 111, microphone 113, touchscreen 112, display controller 156, optical sensor 164, optical sensor controller 158, contact / motion module 130, graphics module 132, text input module 134, contact module 137, and telephone module 138, the video conferencing module 139 includes executable instructions for initiating, conducting, and terminating video conferences between the user and one or more other participants, based on user instructions.

[0163] Incorporating RF circuitry 108, touchscreen 112, display controller 156, touch / motion module 130, graphics module 132, and text input module 134, email client module 140 includes executable instructions for creating, sending, receiving, and managing emails in response to user commands. Combined with image management module 144, email client module 140 makes it very easy to create and send emails containing still images or video images captured by camera module 143.

[0164] In conjunction with RF circuitry 108, touchscreen 112, display controller 156, touch / motion module 130, graphics module 132, and text input module 134, instant messaging module 141 includes executable instructions for inputting character sequences corresponding to instant messages, modifying previously input characters, transmitting corresponding instant messages (e.g., using Short Message Service (SMS) or Multimedia Messaging Service (MMS) protocols for telephone-based instant messaging, or using XMPP, SIMPLE, or IMPS for internet-based instant messaging), receiving instant messages, and viewing received instant messages. In some embodiments, transmitted and / or received instant messages may optionally include graphics, photographs, audio files, video files, and / or other attachments supported in MMS and / or Enhanced Messaging Service (EMS). As used herein, “instant message” refers to telephone-based messages (e.g., messages sent using SMS or MMS) and internet-based messages (e.g., messages using XMPP, SIMPLE, or IMPS).

[0165] Incorporating the RF circuitry 108, touchscreen 112, display controller 156, contact / motion module 130, graphics module 132, text input module 134, GPS module 135, map module 154, and music player module, the training support module 142 includes executable instructions for creating training (e.g., with time, distance, and / or calorie burning goals); communicating with training sensors (sports equipment); receiving training sensor data; calibrating sensors used for monitoring training; selecting and playing music for training; and displaying, storing, and transmitting training data.

[0166] Incorporating a touchscreen 112, a display controller 156, one or more optical sensors 164, an optical sensor controller 158, a contact / motion module 130, a graphics module 132, and an image management module 144, the camera module 143 includes executable instructions for capturing still images or videos (including video streams) and storing them in memory 102, modifying the characteristics of still images or videos, or deleting still images or videos from memory 102.

[0167] Incorporating touchscreen 112, display controller 156, touch / motion module 130, graphics module 132, text input module 134, and camera module 143, image management module 144 includes executable instructions for arranging, modifying (e.g., editing), manipulating, annotating, deleting, presenting (e.g., in a digital slideshow presentation or photo album), and storing still and / or video images.

[0168] Combining the RF circuitry 108, touchscreen 112, display controller 156, contact / motion module 130, graphics module 132, and text input module 134, the browser module 147 includes executable instructions for browsing the Internet (including searching, linking, receiving, and displaying web pages or multiple parts of web pages, as well as attachments and other files linked to the web pages) according to user instructions.

[0169] Incorporating RF circuitry 108, touchscreen 112, display controller 156, touch / motion module 130, graphics module 132, text input module 134, email client module 140, and browser module 147, calendar module 148 includes executable instructions for creating, displaying, modifying, and storing calendars and calendar-related data (e.g., calendar entries, to-do lists, etc.) according to user instructions.

[0170] In conjunction with RF circuitry 108, touchscreen 112, display controller 156, touch / motion module 130, graphics module 132, text input module 134, and browser module 147, widget module 149 may be a small application (e.g., weather widget 149-1, stock widget 149-2, calculator widget 149-3, alarm clock widget 149-4, and dictionary widget 149-5) downloaded and used by the user, or a small application (e.g., user-created widget 149-6). In some embodiments, the widget includes HTML (Hypertext Markup Language) files, CSS (Cascading Style Sheets) files, and JavaScript files. In some embodiments, the widget includes XML (Extensible Markup Language) files and JavaScript files (e.g., Yahoo! widgets).

[0171] In conjunction with RF circuitry 108, touchscreen 112, display controller 156, touch / motion module 130, graphics module 132, text input module 134, and browser module 147, widget creator module 150 can optionally be used by the user to create widgets (e.g., converting user-specified portions of a webpage into widgets).

[0172] In conjunction with the touchscreen 112, display controller 156, touch / motion module 130, graphics module 132, and text input module 134, the search module 151 includes executable instructions for searching the memory 102 for text, music, sound, images, videos, and / or other files that match one or more search criteria (e.g., one or more user-specified search terms) according to user instructions.

[0173] Incorporating touchscreen 112, display controller 156, touch / motion module 130, graphics module 132, audio circuitry 110, speaker 111, RF circuitry 108, and browser module 147, video and music player module 152 includes executable instructions allowing users to download and play back recorded music and other sound files (such as MP3 or AAC files) stored in one or more file formats, and includes executable instructions for displaying, presenting, or additionally playing back video (e.g., on touchscreen 112 or on a display externally connected via external port 124). In some embodiments, device 100 may optionally include the functionality of an MP3 player such as an iPod (a trademark of Apple Inc.).

[0174] Combining the touchscreen 112, display controller 156, touch / motion module 130, graphics module 132, and text input module 134, the memo module 153 includes executable instructions for creating and managing memos, to-do lists, etc., according to user instructions.

[0175] In conjunction with RF circuitry 108, touchscreen 112, display controller 156, touch / motion module 130, graphics module 132, text input module 134, GPS module 135, and browser module 147, map module 154 may optionally be used to receive, display, modify, and store maps and map-related data (e.g., driving directions; data about shops and other points of interest in or near a specific location; and other location-based data) according to user instructions.

[0176] In conjunction with touchscreen 112, display controller 156, touch / motion module 130, graphics module 132, audio circuitry 110, speaker 111, RF circuitry 108, text input module 134, email client module 140, and browser module 147, online video module 155 includes instructions allowing users to access, browse, receive (e.g., via streaming and / or downloading), (e.g., on a touchscreen or on a display externally connected via external port 124) play back specific online videos, send emails with links to specific online videos, and manage online videos in one or more file formats such as H.264. In some embodiments, instant messaging module 141, instead of email client module 140, is used to send links to specific online videos. Additional descriptions of the online video application may be found in U.S. Provisional Patent Application No. 60 / 936,562, filed June 20, 2007, entitled “Portable Multifunction Device, Method, and Graphical User Interface for Playing Online Videos,” and U.S. Patent Application No. 11 / 968,067, filed December 31, 2007, entitled “Portable Multifunction Device, Method, and Graphical User Interface for Playing Online Videos,” the entire contents of which are incorporated herein by reference.

[0177] Each of the modules and applications identified above corresponds to a set of instructions for performing one or more functions described above and the methods described in this application (e.g., computer implementations of the methods described herein and other information processing methods). These modules (e.g., instruction sets) do not need to be implemented as separate software programs, processes, or modules; therefore, various subsets of these modules may be optionally combined or rearranged in different embodiments. For example, a video player module may be optionally combined with a music player module into a single module (e.g., Figure 1A (Video and music player module 152). In some embodiments, memory 102 may optionally store a subset of the above-described modules and data structures. Additionally, memory 102 may optionally store other modules and data structures not described above.

[0178] In some embodiments, device 100 is a device specifically designed to perform operations of a predetermined set of functions on the device via a touchscreen and / or touchpad. By using the touchscreen and / or touchpad as the primary input control device for operating device 100, the number of physical input control devices (such as push-buttons, dial pads, etc.) on device 100 can be optionally reduced.

[0179] The predetermined set of functions, specifically performed via a touchscreen and / or touchpad, may optionally include navigation between user interfaces. In some embodiments, when a user touches the touchpad, the device 100 is navigated from any user interface on the device 100 display to the home screen, main picture, or root menu. In such embodiments, a touchpad is used to implement a "menu button." In some other embodiments, the menu button is a physical push button or other physical input control device instead of a touchpad.

[0180] Figure 1B This is a block diagram illustrating exemplary components for event processing according to some embodiments. In some embodiments, memory 102 (in...) Figure 1A ) or memory 370 ( Figure 3 This includes an event classifier 170 (e.g., in operating system 126) and corresponding applications 136-1 (e.g., any of the aforementioned applications 137-151, 155, 380-390).

[0181] Event classifier 170 receives event information and determines the application 136-1 to which the event information should be delivered and the application view 191 of application 136-1. Event classifier 170 includes event monitor 171 and event dispatcher module 174. In some embodiments, application 136-1 includes an application internal state 192 that indicates one or more current application views displayed on touch-sensitive display 112 when the application is active or running. In some embodiments, device / global content state 157 is used by event classifier 170 to determine which application(s) are currently active, and application internal state 192 is used by event classifier 170 to determine the application view 191 to which the event information should be delivered.

[0182] In some embodiments, the application internal state 192 includes additional information such as one or more of the following: recovery information to be used when the application 136-1 resumes execution, user interface state information indicating the information being displayed or ready to be displayed by the application 136-1, a state queue that allows the user to return to the previous state or view of the application 136-1, and a redo / undo queue of previous actions taken by the user.

[0183] Event monitor 171 receives event information from peripheral interface 118. The event information includes information about sub-events (e.g., user touches on touch-sensitive display 112 as part of a multi-touch gesture). Peripheral interface 118 transmits information it receives from I / O subsystem 106 or sensors, such as proximity sensor 166, one or more accelerometers 168, and / or microphone 113 (via audio circuitry 110). The information received by peripheral interface 118 from I / O subsystem 106 includes information from touch-sensitive display 112 or touch-sensitive surfaces.

[0184] In some embodiments, the event monitor 171 sends requests to the peripheral interface 118 at predetermined intervals. In response, the peripheral interface 118 sends event information. In other embodiments, the peripheral interface 118 sends event information only when a significant event occurs (e.g., receiving input exceeding a predetermined noise threshold and / or for a predetermined duration).

[0185] In some embodiments, the event classifier 170 further includes a hit view determination module 172 and / or an active event recognizer determination module 173.

[0186] The hit view determination module 172 provides a software program for determining where a sub-event has occurred in one or more views when the touch-sensitive display 112 displays more than one view. A view consists of controls and other elements that the user can see on the display.

[0187] Another aspect of the user interface associated with an application is a set of views, sometimes referred to herein as application views or user interface windows, in which information is displayed and touch-based gestures occur. The application view (of the corresponding application) in which a touch is detected may optionally correspond to a program level in the application's program or view hierarchy. For example, the lowest-level view in which a touch is detected may optionally be referred to as the hit view, and the set of events recognized as correct input may optionally be determined based at least in part on the hit view of the initial touch that initiates the touch-based gesture.

[0188] The hit view determination module 172 receives information related to sub-events of touch-based gestures. When an application has multiple views organized in a hierarchical structure, the hit view determination module 172 identifies the lowest-level view in that hierarchy that should handle the sub-event as the hit view. In most cases, the hit view is the lowest-level view where the initiating sub-event (e.g., the first sub-event in a sequence of sub-events that forms an event or potential event) occurred. Once the hit view is identified by the hit view determination module 172, it typically receives all sub-events related to the same touch or input source that led to its identification as a hit view.

[0189] The active event recognizer determination module 173 determines which view(s) in the view hierarchy should receive a specific sub-event sequence. In some embodiments, the active event recognizer determination module 173 determines that only the hit view should receive the specific sub-event sequence. In other embodiments, the active event recognizer determination module 173 determines that all views, including the physical location of the sub-event, are actively participating views, and therefore determines that all actively participating views should receive the specific sub-event sequence. In other embodiments, even if the touch sub-event is completely confined to the area associated with a particular view, higher-level views in the hierarchy will still remain as actively participating views.

[0190] Event dispatcher module 174 dispatches event information to event identifiers (e.g., event identifier 180). In embodiments that include an active event identifier determination module 173, event dispatcher module 174 delivers event information to an event identifier determined by active event identifier determination module 173. In some embodiments, event dispatcher module 174 stores event information in an event queue for retrieval by a corresponding event receiver 182.

[0191] In some embodiments, operating system 126 includes event classifier 170. Alternatively, application 136-1 includes event classifier 170. In other embodiments, event classifier 170 is a separate module or part of another module (such as contact / motion module 130) stored in memory 102.

[0192] In some embodiments, application 136-1 includes a plurality of event handlers 190 and one or more application views 191, each including instructions for processing touch events occurring within a corresponding view of the application's user interface. Each application view 191 of application 136-1 includes one or more event recognizers 180. Typically, a corresponding application view 191 includes a plurality of event recognizers 180. In other embodiments, one or more event recognizers 180 are part of a separate module (such as a user interface suite (not shown)) or a higher-level object from which application 136-1 inherits methods and other properties. In some embodiments, a corresponding event handler 190 includes one or more of the following: a data updater 176, an object updater 177, a GUI updater 178, and / or event data 179 received from an event classifier 170. Event handlers 190 may optionally utilize or invoke the data updater 176, the object updater 177, or the GUI updater 178 to update the application's internal state 192. Alternatively, one or more of the application views 191 include one or more corresponding event handlers 190. Similarly, in some embodiments, one or more of the data updater 176, object updater 177, and GUI updater 178 are included in the corresponding application view 191.

[0193] The corresponding event identifier 180 receives event information (e.g., event data 179) from the event classifier 170 and identifies the event based on the event information. The event identifier 180 includes an event receiver 182 and an event comparator 184. In some embodiments, the event identifier 180 also includes at least a subset of the following: metadata 183 and event delivery instructions 188 (which optionally includes sub-event delivery instructions).

[0194] Event receiver 182 receives event information from event classifier 170. This event information includes information about sub-events (e.g., touch or touch movement). Depending on the sub-event, the event information also includes additional information, such as the location of the sub-event. When the sub-event involves touch movement, the event information may optionally also include the rate and direction of the sub-event. In some embodiments, the event includes a rotation of the device from one orientation to another (e.g., rotation from portrait to landscape and vice versa), and the event information includes corresponding information about the device's current orientation (also referred to as device pose).

[0195] Event comparator 184 compares event information with predefined event or sub-event definitions and determines the event or sub-event based on the comparison, or determines or updates the state of the event or sub-event. In some embodiments, event comparator 184 includes event definition 186. Event definition 186 contains definitions of events (e.g., a predetermined sequence of sub-events), such as event 1 (187-1), event 2 (187-2), etc. In some embodiments, sub-events in event 187 include, for example, touch start, touch end, touch movement, touch cancellation, and multi-touch. In one example, event 1 (187-1) is defined as a double-click on a displayed object. This double-click includes, for example, a first touch (touch start) of a predetermined phase on the displayed object, a first lift of a predetermined phase (touch end), a second touch (touch start) of a predetermined phase on the displayed object, and a second lift of a predetermined phase (touch end). In another example, event 2 (187-2) is defined as a drag on a displayed object. This drag includes, for example, a touch (or contact) of a predetermined phase on the displayed object, movement of the touch on the touch-sensitive display 112, and a lift of the touch (touch end). In some embodiments, the event may also include information for one or more associated event handlers 190.

[0196] In some embodiments, event definition 187 includes definitions of events for corresponding user interface objects. In some embodiments, event comparator 184 performs a hit test to determine the user interface object associated with the sub-event. For example, in an application view where three user interface objects are displayed on a touch-sensitive display 112, when a touch is detected on the touch-sensitive display 112, event comparator 184 performs a hit test to determine which of the three user interface objects is associated with the touch (sub-event). If each displayed object is associated with a corresponding event handler 190, the event comparator uses the result of the hit test to determine which event handler 190 should be activated. For example, event comparator 184 selects the event handler associated with the sub-event and object that triggered the hit test.

[0197] In some embodiments, the definition of the corresponding event (187) also includes a delay action that delays the delivery of event information until it has been determined whether the sequence of sub-events corresponds to the event type of the event recognizer.

[0198] When the corresponding event recognizer 180 determines that the sub-event sequence does not match any event in event definition 186, the corresponding event recognizer 180 enters an event impossible, event failed, or event ended state, after which the corresponding event recognizer 180 ignores subsequent sub-events based on the touch gesture. In this case, other event recognizers (if any) that remain active in the hit view continue to track and process the ongoing sub-events based on the touch gesture.

[0199] In some embodiments, the corresponding event identifier 180 includes metadata 183 with configurable attributes, flags, and / or lists indicating how the event delivery system should perform sub-event delivery to actively participating event identifiers. In some embodiments, the metadata 183 includes configurable attributes, flags, and / or lists indicating how event identifiers interact with each other or are able to interact with each other. In some embodiments, the metadata 183 includes configurable attributes, flags, and / or lists indicating whether sub-events are delivered to different levels in a view or program hierarchy.

[0200] In some embodiments, the corresponding event recognizer 180 activates the event handler 190 associated with the event when one or more specific sub-events of the event are recognized. In some embodiments, the corresponding event recognizer 180 delivers event information associated with the event to the event handler 190. Activating the event handler 190 is different from sending (or delaying) the sub-event to the corresponding hit view. In some embodiments, the event recognizer 180 throws a flag associated with the recognized event, and the event handler 190 associated with the flag catches the flag and performs a predetermined procedure.

[0201] In some embodiments, event delivery instruction 188 includes a sub-event delivery instruction that delivers event information about a sub-event without activating an event handler. Instead, the sub-event delivery instruction delivers event information to an event handler associated with a series of sub-events or an actively participating view. The event handler associated with the series of sub-events or the actively participating view receives the event information and executes a predetermined procedure.

[0202] In some embodiments, data updater 176 creates and updates data used in application 136-1. For example, data updater 176 updates phone numbers used in contact module 137 or stores video files used in video player module 145. In some embodiments, object updater 177 creates and updates data used in application 136-1. For example, object updater 177 creates new user interface objects or updates the location of user interface objects. GUI updater 178 updates the GUI. For example, GUI updater 178 prepares display information and sends it to graphics module 132 for display on a touch-sensitive display.

[0203] In some embodiments, one or more event handlers 190 include or have access to a data updater 176, an object updater 177, and a GUI updater 178. In some embodiments, the data updater 176, object updater 177, and GUI updater 178 are included in a single module of a corresponding application 136-1 or application view 191. In other embodiments, the data updater 176, object updater 177, and GUI updater 178 are included in two or more software modules.

[0204] It should be understood that the foregoing discussion of event handling for user touch on a touch-sensitive display also applies to other forms of user input for operating the multifunction device 100 with input devices, where not all user input is initiated on the touchscreen. Examples include mouse movement and mouse button presses that optionally correspond to pressing or holding one or more keyboard keys; touch movements on the touchpad (such as tapping, dragging, scrolling, etc.); stylus input; device movement; voice commands; detected eye movements; biometric input; and / or any combination of the foregoing, which may optionally be used as input corresponding to a sub-event that defines the event to be identified.

[0205] Figure 2 A portable multi-functional device 100 with a touchscreen 112 is illustrated according to some embodiments. The touchscreen optionally displays one or more graphics within a user interface (UI) 200. In this embodiment and other embodiments described below, a user can select one or more graphics by gesturing over them (e.g., with one or more fingers 202 (not shown to scale) or one or more styluses (not shown to scale)). In some embodiments, selection of one or more graphics occurs when the user interrupts contact with one or more graphics. In some embodiments, gestures may optionally include one or more taps, one or more swipes (from left to right, from right to left, up and / or down), and / or rotation of a finger that has been in contact with the device 100 (from right to left, from left to right, up and / or down). In some implementations or situations, unintentional contact with a graphic will not select the graphic. For example, a swipe gesture over an application icon may not select the corresponding application when the gesture corresponding to selection is a tap.

[0206] Device 100 may optionally also include one or more physical buttons, such as a "home screen" or menu button 204. As previously described, menu button 204 may optionally be used to navigate to any application 136 in the application set that may be executed on device 100. Alternatively, in some embodiments, the menu button is implemented as a soft key in a GUI displayed on touchscreen 112.

[0207] In some embodiments, device 100 includes a touchscreen 112, a menu button 204, a push-button 206 for turning the device on / off and locking the device, and one or more volume control buttons 208, a SIM card slot 210, a headphone jack 212, and a docking / charging external port 124. The push-button 206 is optionally used to turn the device on / off by pressing the button and holding it in the pressed state for a predetermined time interval; to lock the device by pressing the button and releasing it before the predetermined time interval has elapsed; and / or to unlock the device or initiate an unlocking process. In an alternative embodiment, device 100 also accepts voice input via microphone 113 for activating or deactivating certain functions. Device 100 may optionally also include one or more contact strength sensors 165 for detecting contact strength on the touchscreen 112 and / or one or more haptic output generators 167 for generating haptic outputs to a user of device 100.

[0208] Figure 3 This is a block diagram of an exemplary multi-functional device having a display and a touch-sensitive surface according to some embodiments. Device 300 need not be portable. In some embodiments, device 300 is a laptop computer, desktop computer, tablet computer, multimedia player device, navigation device, educational device (such as a children's learning toy), gaming system, or control device (e.g., a home or industrial controller). Device 300 typically includes one or more processing units (CPUs) 310, one or more network or other communication interfaces 360, memory 370, and one or more communication buses 320 for interconnecting these components. The communication bus 320 may optionally include circuitry (sometimes referred to as a chipset) that interconnects and controls communication between system components. Device 300 includes an input / output (I / O) interface 330, which includes a display 340, typically a touchscreen display. The input / output interface 330 may also optionally include a keyboard and / or mouse (or other pointing device) 350 and a touchpad 355, and a haptic output generator 357 for generating haptic output on device 300 (e.g., similar to the one mentioned above). Figure 1A The described (multiple) tactile output generators 167 and sensors 359 (e.g., similar to those in the above reference appendix) Figure 1AThe described contact strength sensors 165 are optical, acceleration, proximity, touch-sensitive, and / or contact strength sensors. Memory 370 includes high-speed random access memory, such as DRAM, SRAM, DDR RAM, or other random access solid-state memory devices; and optionally includes non-volatile memory, such as one or more disk storage devices, optical disk storage devices, flash memory devices, or other non-volatile solid-state memory devices. Memory 370 may optionally include one or more storage devices located remotely from CPU(one or more) 310. In some embodiments, memory 370 stores programs, modules, and data structures similar to those stored in memory 102 of portable multifunction device 100 (FIG. 1), or subsets thereof. Furthermore, memory 370 may optionally store additional programs, modules, and data structures not present in memory 102 of portable multifunction device 100. For example, the memory 370 of device 300 may optionally store a drawing module 380, a presentation module 382, ​​a word processing module 384, a website creation module 386, a disk writing module 388, and / or a spreadsheet module 390, while the portable multifunction device 100 ( Figure 1A The memory 102 may optionally not store these modules.

[0209] Figure 3 Each of the aforementioned elements may optionally be stored in one or more of the aforementioned memory devices. Each of the aforementioned modules corresponds to an instruction set for performing the functions described above. The aforementioned modules or programs (e.g., instruction sets) do not need to be implemented as separate software programs, processes, or modules; therefore, in various embodiments, various subsets of these modules may optionally be combined or otherwise rearranged. In some embodiments, memory 370 may optionally store a subset of the aforementioned modules and data structures. Furthermore, memory 370 may optionally store additional modules and data structures not described above.

[0210] Our attention will now turn to embodiments of the user interface that may be optionally implemented on, for example, a portable multifunction device 100.

[0211] Figure 4A An exemplary user interface for an application menu on a portable multifunction device 100, according to some embodiments, is illustrated. A similar user interface may optionally be implemented on device 300. In some embodiments, user interface 400 includes the following elements or a subset or superset thereof:

[0212] • Signal strength indicator 402 is used for (various) wireless communications, such as cellular signals and Wi-Fi signals;

[0213] • Time 404;

[0214] Bluetooth indicator 405;

[0215] • Battery status indicator 406;

[0216] • Tray tray 408, featuring icons for frequently used applications, such as:

[0217] o An icon 416 for the telephone module 138, labeled “telephone”, optionally includes an indicator 414 for the number of missed calls or voice messages;

[0218] o An icon 418 for the email client module 140, labeled “Mail”, which optionally includes an indicator 410 for the number of unread emails;

[0219] o Icon 420 for browser module 147, labeled "Browser"; and

[0220] o The icon 422 used for the video and music player module 152, also known as the iPod (Apple Inc. trademark) module 152, is labeled "iPod"; and

[0221] • Icons used in other applications, such as:

[0222] o Icon 424 used for IM module 141 is labeled "Message";

[0223] o Icon 426 for the calendar module 148 is labeled "Calendar";

[0224] o Icon 42 for the image management module 144 is labeled "Photo";

[0225] o The icon 430 used for camera module 143 is labeled "camera";

[0226] o Icon 432 for the online video module 155 is labeled "Online Video";

[0227] o Icon 434 for the stock widget 149-2, labeled "Stock";

[0228] o Icon 436 for map module 154, labeled "map";

[0229] o Icon 438 for the weather widget 149-1, labeled "Weather";

[0230] o Icon 440 for alarm clock widget 149-4, labeled "Clock";

[0231] o Icon 442 used for training support module 142, labeled "training support";

[0232] o The icon 444 used for the memo module 153 is labeled "Memo";

[0233] o is the icon 446 used to set applications or modules, labeled "Settings", which provides access to the settings of device 100 and its various applications 136.

[0234] It should be understood Figure 4A The icon labels shown are merely exemplary. For example, icon 422 for video and music player module 152 is labeled "Music" or "Music Player". Other labels may optionally be used for individual application icons. In some embodiments, the label for a given application icon includes the name of the application corresponding to that application icon. In some embodiments, the label for a particular application icon is different from the name of the application corresponding to that particular application icon.

[0235] Figure 4B The illustration shows a touch-sensitive surface 451 (e.g., separate from the display 450 (e.g., touchscreen display 112)). Figure 3 Devices (e.g., tablets or touchpads 355) Figure 3 An exemplary user interface on the device 300. The device 300 may also optionally include one or more contact intensity sensors (e.g., one or more sensors 359) for detecting contact intensity on the touch-sensitive surface 451 and / or one or more tactile output generators 357 for generating tactile outputs to a user of the device 300.

[0236] While some examples are given with reference to input on a touchscreen display 112 (where a touch-sensitive surface is combined with the display), in some embodiments, such as Figure 4B As shown, the device detects input on a touch-sensitive surface separate from the display. In some embodiments, the touch-sensitive surface (e.g., Figure 4B 451) has a corresponding principal coordinate axis (e.g., on the display (e.g., 450)). Figure 4B The principal coordinate axis of 453 in the middle (e.g., Figure 4B (452 in the example). According to these embodiments, the device detects a position corresponding to a specific location on the display (e.g., in...). Figure 4B In the middle, 460 corresponds to 468 and 462 corresponds to 470) the contact with the touch-sensitive surface 451 (e.g., Figure 4B (460 and 462 in the text). In this way, when the touch-sensitive surface is in contact with the display of a multi-functional device (e.g., ... Figure 4B When separated from the 450), the device is used on the touch-sensitive surface (e.g., Figure 4B User input detected on (e.g., touches 460 and 462 and their movement) is used by the device to manipulate the user interface on the display. It should be understood that similar methods may be used alternatively for other user interfaces described herein.

[0237] Furthermore, while the following examples are primarily given with reference to finger input (e.g., finger touch, finger tapping gesture, finger swipe gesture), it should be understood that in some embodiments, one or more finger inputs are replaced by input from another input device (e.g., mouse-based input or stylus input). For example, a swipe gesture may optionally be replaced by a mouse click (e.g., instead of touch) followed by movement of the cursor along the swipe path (e.g., instead of touch movement). As another example, a tapping gesture may optionally be replaced by a mouse click when the cursor is at the location of the tapping gesture (e.g., instead of detecting touch, followed by stopping the detection of that touch). Similarly, when multiple user inputs are detected simultaneously, it should be understood that multiple computer mice may optionally be used simultaneously, or mouse and finger touch may optionally be used simultaneously.

[0238] Figure 5A The illustration shows an exemplary personal electronic device 500. Device 500 includes a body 502. In some embodiments, device 500 may optionally include a reference device 100 and a device 300 (e.g., Figures 1A to 4B Some or all of the features described herein. In some embodiments, device 500 has a touch-sensitive display screen 504, hereinafter referred to as touchscreen 504. Alternatively, or in addition to touchscreen 504, device 500 has a display and a touch-sensitive surface. Like devices 100 and 300, in some embodiments, touchscreen 504 (or touch-sensitive surface) may have one or more intensity sensors for detecting the intensity of an applied contact (e.g., a touch). The one or more intensity sensors of the touchscreen 504 (or touch-sensitive surface) may provide output data representing the intensity of the touch. The user interface of device 500 may respond to touches based on their intensity, meaning that touches of different intensities may invoke different user interface operations on device 500.

[0239] Exemplary techniques for detecting and processing touch intensity can be found, for example, in the following related applications: International Patent Application Serial No. PCT / US2013 / 040061, filed May 8, 2013, entitled “Device, Method, and Graphical User Interface for Displaying User Interface Objects Corresponding to an Application”, and International Patent Application Serial No. PCT / US2013 / 069483, filed November 11, 2013, entitled “Device, Method, and Graphical User Interface for Transitioning Between Touch Input to Display Output Relationships”, which are incorporated herein by reference in their entirety.

[0240] In some embodiments, device 500 has one or more input mechanisms 506 and 508. If included, input mechanisms 506 and 508 may be physical. Examples of physical input mechanisms include push-buttons and rotatable mechanisms. In some embodiments, device 500 has one or more attachment mechanisms. If included, these attachment mechanisms may allow device 500 to be attached to, for example, hats, glasses, earrings, necklaces, shirts, jackets, bracelets, watch straps, watch chains, trousers, belts, shoes, handbags, backpacks, etc. These attachment mechanisms allow device 500 to be worn by a user.

[0241] Figure 5B An exemplary personal electronic device 500 is depicted. In some embodiments, device 500 may include references Figure 1A , Figure 1B and Figure 3 Some or all of the components described. Device 500 has a bus 512 that operatively couples I / O component 514 to one or more computer processors 516 and memory 518. I / O component 514 may be connected to display 504, which may have touch-sensitive component 522 and optionally intensity sensor 524 (e.g., contact intensity sensor). Furthermore, I / O component 514 may be connected to communication unit 530 using Wi-Fi, Bluetooth, near field communication (NFC), cellular and / or other wireless communication technologies for receiving application and operating system data. Device 500 may include input mechanisms 506 and / or 508. Input mechanism 506 may optionally be, for example, a rotatable input device or a pressable and rotatable input device. In some examples, input mechanism 508 may optionally be a button.

[0242] In some examples, the input mechanism 508 may optionally be a microphone. The personal electronic device 500 may optionally include various sensors, such as a GPS sensor 532, an accelerometer 534, an orientation sensor 540 (e.g., a compass), a gyroscope 536, a motion sensor 538, and / or combinations thereof, all of which may be operatively connected to the I / O component 514.

[0243] The memory 518 of the personal electronic device 500 may be a non-volatile computer-readable storage medium for storing computer-executable instructions, which, when executed by one or more computer processors 516, may cause the computer processors to perform, for example, the techniques described above, including process 700. Figure 7 ), 900 Figure 9 ), 1000 Figure 10 ), 1200 Figure 12 ), 1400 Figure 14A ), 1420 Figure 14B ) and 1600 ( Figure 16 Computer-executable instructions may also be stored and / or transmitted in any non-volatile computer-readable storage medium for use by, or in conjunction with, an instruction execution system, apparatus, or device, such as a computer-based system, a processor-containing system, or other system that can retrieve and execute instructions from and from the instruction execution system, apparatus, or device. For the purposes of this document, a “non-volatile computer-readable storage medium” can be any medium that tangibly contains or stores computer-executable instructions that can be used by or in conjunction with an instruction execution system, apparatus, or device. Non-volatile computer-readable storage media may include, but are not limited to, magnetic, optical, and / or semiconductor storage devices. Examples of such storage devices include magnetic disks, optical discs based on CD, DVD, or Blu-ray technology, and persistent solid-state storage (such as flash memory, solid-state drives, etc.). Personal electronic devices 500 are not limited to Figure 5B The components and configurations may include other or additional components in various configurations.

[0244] As used herein, the term "available component" refers to components optionally available in device 100, device 300, and / or device 500 (Figure 1, ...). Figure 3 The user-interactive graphical user interface objects displayed on the screen (as shown in Figure 5). For example, images (e.g., icons), buttons, and text (e.g., hyperlinks) may optionally each constitute an available element.

[0245] As used herein, the term "focus selector" refers to an input element of a user interface that is currently being interacted with by the user. In some implementations, a cursor or other position marker is included, which serves as the "focus selector" so that when the user is on a touch-sensitive surface (e.g., ...), the input element is selected. Figure 3 The touchpad 355 or Figure 4B When input (e.g., a press) is detected on the touch-sensitive surface 451 and the cursor is over a specific user interface element (e.g., a button, window, slider, or other user interface element), that specific user interface element is adjusted according to the detected input. In some embodiments, a touchscreen display (e.g., [missing information]) is included, enabling direct interaction with user interface elements on the touchscreen display. Figure 1A The touch-sensitive display system 112 or Figure 4A The touchscreen 112 in the interface acts as a "focus selector" to adjust a particular user interface element (e.g., a touch input) based on the detected input when input is detected on the touchscreen display at the location of that element (e.g., a touch press). In some implementations, focus is moved from one area of ​​the user interface to another without corresponding cursor movement or touch movement on the touchscreen display (e.g., moving focus from one button to another using tab keys or arrow keys); in these implementations, the focus selector moves according to the movement of focus between different areas of the user interface. Regardless of the specific form the focus selector takes, it is typically a user interface element (or a touch on the touchscreen display) that is controlled by the user (e.g., by indicating to the device the user interface element with which the user intends to interact) to communicate the user's intended interaction with the user interface. For example, when a press input is detected on a touch-sensitive surface (e.g., a touchpad or touchscreen), the position of a focus selector (e.g., a cursor, touch, or selection box) on the corresponding button will indicate that the user intends to activate the corresponding button (relative to other user interface elements displayed on the device's display).

[0246] As used in the specification and claims, the term "characteristic strength" of contact refers to a characteristic of contact based on one or more strengths of the contact. In some embodiments, characteristic strength is based on a plurality of strength samples. Characteristic strength may optionally be based on a predetermined number of strength samples or a set of strength samples collected over a predetermined time period (e.g., 0.05 seconds, 0.1 seconds, 0.2 seconds, 0.5 seconds, 1 second, 2 seconds, 5 seconds, 10 seconds) relative to predetermined events (e.g., after contact is detected, before contact lift is detected, before or after contact begins to move is detected, before contact ends is detected, before or after contact strength increases is detected, and / or before or after contact strength decreases is detected). The characteristic strength of contact may optionally be based on one or more of the following: the maximum value of contact strength, the median value of contact strength, the average value of contact strength, the highest 10% value of contact strength, the half-maximum value of contact strength, the 90% maximum value of contact strength, etc. In some embodiments, the duration of contact is used to determine characteristic strength (e.g., when characteristic strength is the average value of contact strength over time). In some embodiments, the characteristic intensity is compared to a set of one or more intensity thresholds to determine whether an action has been performed by the user. For example, the set of one or more intensity thresholds may optionally include a first intensity threshold and a second intensity threshold. In this example, contact with a characteristic intensity not exceeding the first threshold results in a first action, contact with a characteristic intensity exceeding the first intensity threshold but not exceeding the second intensity threshold results in a second action, and contact with a characteristic intensity exceeding the second threshold results in a third action. In some embodiments, the comparison between the characteristic intensity and one or more thresholds is used to determine whether one or more actions are performed (e.g., whether to perform the corresponding action or abandon the performance of the corresponding action) and not to determine whether the first action or the second action is performed.

[0247] Figure 5C The illustration shows the detection of multiple contacts 552A-552E on a touch-sensitive display screen 504 having multiple intensity sensors 524A-524D. Figure 5C The illustration also shows an intensity graph illustrating the current intensity measurements of intensity sensors 524A-524D relative to intensity units. In this example, the intensity measurements of intensity sensors 524A and 524D are both 9 intensity units, and the intensity measurements of intensity sensors 524B and 524C are both 7 intensity units. In some embodiments, the polymerization intensity is the sum of the intensity measurements of the multiple intensity sensors 524A-524D, which is 32 intensity units in this example. In some embodiments, each contact is assigned a corresponding intensity as part of the polymerization intensity. Figure 5DThe illustration shows the assignment of polymerization intensity to contacts 552A-552E based on their distance from the center of force 554. In this example, each of contacts 552A, 552B, and 552E is assigned a contact intensity of 8 intensity units of polymerization intensity, and each of contacts 552C and 552D is assigned a contact intensity of 4 intensity units of polymerization intensity. More generally, in some implementations, each contact j is assigned a corresponding intensity Ij as a part of the polymerization intensity A according to a predefined mathematical function, Ij = A·(Dj / ΣDi), where Dj is the distance of the corresponding contact j from the center of force, and ΣDi is the sum of the distances of all corresponding contacts (e.g., i-1 to the last) from the center of force. Reference Figures 5C to 5D The described operations can be performed using electronic equipment similar to or the same as device 100, 300, or 500. In some embodiments, the characteristic strength of the contact is based on one or more strengths of the contact. In some embodiments, an intensity sensor is used to determine the individual characteristic strength (e.g., the individual characteristic strength of a single contact). It should be noted that the intensity graph is not part of the displayed user interface but is included in... Figures 5C to 5D To help readers.

[0248] In some embodiments, a portion of the gesture is recognized for the purpose of determining the characteristic strength. For example, the touch-sensitive surface may optionally receive a series of swipes transitioning from a start position to an end position, where the contact strength increases. In this example, the characteristic strength of the contact at the end position may optionally be based on only a portion of the series of swipes, rather than the entire swipe (e.g., only a portion of the swipe at the end position). In some embodiments, a smoothing algorithm may optionally be applied to the swipe contact strength before determining the characteristic strength of the contact. For example, the smoothing algorithm may optionally include one or more of the following: unweighted moving average smoothing, triangular smoothing, median filtering smoothing, and / or exponential smoothing. In some cases, these smoothing algorithms may eliminate narrow spikes or dips in the swipe contact strength for the purpose of determining the characteristic strength.

[0249] The contact intensity on a touch-sensitive surface may optionally be characterized relative to one or more intensity thresholds, such as a contact detection intensity threshold, a light pressure intensity threshold, a deep pressure intensity threshold, and / or one or more other intensity thresholds. In some embodiments, the light pressure intensity threshold corresponds to the intensity at which the device would perform an operation typically associated with clicking a button on a physical mouse or touchpad. In some embodiments, the deep pressure intensity threshold corresponds to the intensity at which the device would perform an operation different from the operation typically associated with clicking a button on a physical mouse or touchpad. In some embodiments, when a contact is detected with a characteristic intensity below the light pressure intensity threshold (e.g., and when a contact is detected with an intensity above the nominal contact detection intensity threshold, where the contact is no longer detected below the nominal contact detection intensity threshold), the device will move the focus selector according to the movement of the contact on the touch-sensitive surface without performing the operation associated with the light pressure intensity threshold or the deep pressure intensity threshold. Generally, unless otherwise stated, these intensity thresholds are consistent across different sets of user interface graphics.

[0250] The intensity of a contact increasing from below a light pressure threshold to between a light pressure threshold and a deep pressure threshold is sometimes referred to as a "light pressure" input. The intensity of a contact increasing from below a deep pressure threshold to above a deep pressure threshold is sometimes referred to as a "deep pressure" input. The intensity of a contact increasing from below a contact detection intensity threshold to between a contact detection intensity threshold and a light pressure threshold is sometimes referred to as detecting contact on a touch surface. The intensity of a contact decreasing from above a contact detection intensity threshold to below a contact detection intensity threshold is sometimes referred to as detecting contact lifting off the contact surface. In some embodiments, the contact detection intensity threshold is zero. In some embodiments, the contact detection intensity threshold is greater than zero.

[0251] In some embodiments described herein, one or more operations are performed in response to detecting a gesture including a corresponding press input, or in response to detecting a corresponding press input performed by a corresponding contact (or multiple contacts), wherein the corresponding press input is detected at least in part based on detecting that the contact (or multiple contacts) intensity increases to above a press input intensity threshold. In some embodiments, the corresponding operation is performed in response to detecting that the corresponding contact intensity increases to above a press input intensity threshold (e.g., a "press-to-slap" of the corresponding press input). In some embodiments, the press input includes a corresponding contact intensity increasing to above a press input intensity threshold, and the contact intensity subsequently decreasing to below a press input intensity threshold, and the corresponding operation is performed in response to detecting that the corresponding contact intensity subsequently decreases to below a press input threshold (e.g., a "lift-to-slap" of the corresponding press input).

[0252] Figures 5E to 5H The diagram illustrates the strength corresponding to contact 562 from... Figure 5E Below the light press intensity threshold (e.g., "IT") L The intensity of ”) Figure 5H The pressure intensity is higher than the deep press strength threshold (e.g., "IT"). D The intensity of the press input gesture is detected by the sensor. The gesture performed by contact 562 is detected on the touch-sensitive surface 560, while cursor 576 is displayed above the application icon 572B corresponding to APP2 on the displayed user interface 570, which includes application icons 572A-572D displayed in the predefined area 574. The intensity sensor detects the intensity of the contact on the touch-sensitive surface 560. The device determines that the peak intensity of contact 562 exceeds the deep press intensity threshold (e.g., "IT"). D Contact 562 is maintained on touch-sensitive surface 560 in response to gesture detection, and based on the presence of a deep press intensity threshold (e.g., "IT") during the gesture. D The intensity of the contact 562 of App2 is reduced to a smaller scale representation of the recently opened documents (e.g., thumbnails), as shown in Figure 578A-578C. Figures 5F to 5H As shown. In some embodiments, the intensity compared to one or more intensity thresholds is a characteristic intensity of the intensity. It should be noted that the intensity map of contact 562 is not part of the displayed user interface, but is included in... Figures 5E to 5H This is to help readers.

[0253] In some embodiments, the display of 578A-578C includes animation. For example, 578A is shown when it initially approaches the application icon 572B, as... Figure 5F As shown, as the animation progresses, it indicates that 578A moves upwards, and that 578B approaches and is displayed when it gets close to the application icon 572B, as shown. Figure 5G As shown. Next, it indicates that 578A moves upwards, 578B moves towards the direction indicated by 578A moving upwards, and 578C is displayed when it approaches the application icon 572B, as shown. Figure 5H As shown. This indicates that 578A-578C form the array on icon 572B. In some embodiments, the animation advances according to the intensity of contact 562, as... Figures 5F to 5G As shown, as the intensity of contact 562 moves towards the deep press intensity threshold (e.g., "IT"), D An increase of ") indicates that 578A-578C have appeared and moved upwards. In some embodiments, the threshold upon which the animation's progression is based is the intensity of the contact characteristic. Reference Figures 5E to 5H The described operations can be performed using an electronic device similar to or the same as device 100, device 300 or device 500.

[0254] In some embodiments, the device employs intensity hysteresis to avoid unintended inputs sometimes referred to as "jitter," wherein the device defines or selects a hysteresis intensity threshold that has a predetermined relationship with a press input intensity threshold (e.g., the hysteresis intensity threshold is X intensity units lower than the press input intensity threshold, or the hysteresis intensity threshold is 75%, 90%, or some reasonable proportion of the press input intensity threshold). Therefore, in some embodiments, a press input includes a corresponding increase in contact intensity above the press input intensity threshold and a subsequent decrease in contact intensity below the hysteresis intensity threshold corresponding to the press input intensity threshold, and a corresponding operation is performed in response to detecting that the corresponding contact intensity subsequently decreases below the hysteresis intensity threshold (e.g., a "lift-kick" of the corresponding press input). Similarly, in some embodiments, a press input is detected only when the device detects that the contact intensity increases from an intensity at or below the hysteresis intensity threshold to an intensity at or above the press input intensity threshold, and optionally the contact intensity subsequently decreases to an intensity at or below the hysteresis intensity, and a corresponding operation is performed in response to detecting a press input (e.g., depending on various conditions, an increase or decrease in contact intensity).

[0255] For ease of illustration, the description of an operation optionally triggered in response to a press input associated with a press input strength threshold or in response to a gesture including a press input is provided, in response to detecting any of the following: the contact strength increases to above the press input strength threshold, the contact strength increases from below a hysteresis strength threshold to above the press input strength threshold, the contact strength decreases to below the press input strength threshold, and / or the contact strength decreases to below a hysteresis strength threshold corresponding to the press input strength threshold. Additionally, in the example, an operation is described in response to detecting a decrease in contact strength to below the press input strength threshold, which may optionally be executed in response to detecting a decrease in contact strength to below a hysteresis strength threshold corresponding to the press input strength threshold, or a decrease to a hysteresis strength threshold less than the press input strength threshold.

[0256] Attention now turns to embodiments of the user interface (“UI”) and associated processes implemented, for example, on electronic devices such as multifunction devices 100, 300, and / or 500, to improve the user experience when providing user input. The illustrated user interface screen optionally includes an illustrated finger with optional arrows illustrating finger movement. The illustrated finger and corresponding arrows are generally not part of the displayed user interface but are provided to aid in the interpretation of the diagram.

[0257] Figures 6A to 6DThe illustration shows an exemplary user interface for receiving user input using an electronic device, according to some embodiments. In some embodiments, the electronic device is device 500. In some embodiments, the electronic device has a display (e.g., 112, 340, 504), a touch-sensitive surface (e.g., 112, 355, 504), and a rotatable input mechanism (e.g., 506).

[0258] exist Figure 6A In the middle, the user interface screen 602 displays add contact option 602A and create message option 602B. The user interface screen 602 can, for example, display when a user requests to create a new contact. When an SMS message, email, or similar message is displayed, the electronic device receives user input (e.g., the user taps to add a contact, device 602A). In response to receiving user input, the device identifies the most recently accessed user input technology from a set of user input technologies (e.g., the last input technology used by the user when adding a new contact, which could be a user preference, such as a recent contacts list). In some examples, "most recently accessed" means the most recently used to add a contact address to a message. In other examples, "most recently accessed" means the most recently displayed on the display. By determining which of the various accessible user input technologies the user has most recently accessed, the device can be trained to determine which user input technology the user might want to use again—the most recently accessed user input technology.

[0259] At user interface screen 606, the device displays a user input interface for the most recently accessed user input technology (e.g., a user interface for selecting contacts). In this example, the most recently accessed user input technology is the recent contacts function with available components 606C-606E. User interface screen 606 displays the recent contacts 606C-606E with whom the user has recently communicated (e.g., sent or received messages). Therefore, because the user used the recent contacts function (e.g., the most recently accessed user input technology) when last adding a contact, the device displays a user interface corresponding to that function.

[0260] The device also identifies the least recently accessed user input technology (e.g., a technology that the user has not used for a period of time) from the set of user input technologies. In this example, the least recently accessed user input technology is a verbal function. For example, this is a user input technology that the user dislikes and therefore rarely uses. The device displays a first availability element (e.g., availability element 606B, which, when activated, causes the display of the user interface for the least recently accessed user input technology) on the display. Thus, in this example, the availability element in the lower right corner of the display provides the user with access to the least recently accessed user input technology.

[0261] According to some embodiments, the device identifies the second most recently accessed user input technique from a set of user input techniques (e.g., a technique used before the most recently displayed technique). The device displays a second availability associated with the user input interface of the second most recently accessed user input technique (e.g., availability 606A, which, when activated, causes the display of a user interface for the most recently displayed user input technique before the most recently displayed user input technique). In user interface screen 606, availability 606A, displayed in the lower left corner of the display, provides the user with access to the second most recently accessed user input technique, which is the full contact functionality.

[0262] According to some embodiments, the user input interface for the most recently accessed user input technology includes selection options associated with the most recently accessed user input technology (e.g., options 606C, 606D, 606E for selecting content from multiple options, or options for starting and / or ending audio recording). At the user interface screen 606, activating one of options 606C-606E causes the device to add contact information corresponding to the activated option as the recipient to new messages. As will be understood, by providing options for communicating with recent contacts, the device saves users the keystrokes otherwise required to enter names or navigate a contact list. Furthermore, by providing a more efficient interface, the device can save energy, for example, by activating the display for less time.

[0263] According to some embodiments, the most recently accessed user input technique, the least recently accessed user input technique, and the second most recently accessed user input technique are different techniques within a set of user input techniques. According to some embodiments, the most recently accessed user input technique, the least recently accessed user input technique, and the second most recently accessed user input technique are selected from a group including recent contacts functionality, all contacts functionality, and dictation functionality (e.g., the most recently accessed user input technique is the recent contacts functionality, the least recently accessed user input technique is the dictation functionality, and the second most recently accessed user input technique is the all contacts functionality, as shown on user interface screen 606).

[0264] According to some embodiments, the most recently accessed user input technology, the least recently accessed user input technology, and the second most recently accessed user input technology are selected from a group including suggested reply function, emoji function, and dictation function (e.g., the most recently accessed user input technology is suggested reply mode, the least recently accessed user input technology is emoji mode, and the second most recently accessed user input technology is dictation mode).

[0265] According to some embodiments, the set of user input technologies is a predetermined closed set of input technologies. According to some embodiments, the number of user input technologies in the set of user input technologies is predetermined. According to some embodiments, a first available component provides an indication of the least recently accessed user input technology (e.g., in user interface screen 606, available component 606B includes a label for "Speak"). According to some embodiments, a second available component provides an indication of the second most recently accessed user input technology (e.g., in user interface screen 606, available component 606A includes a label for "Contacts").

[0266] According to some embodiments, a first available element (e.g., 606B), a second available element (e.g., 606B), and a user input interface for the most recently accessed user input technology (e.g., 606C-606E) are displayed simultaneously. This allows the user to provide input using the most recently accessed user input technology, or quickly switch to the second most recently accessed user input technology, or even switch to the least recently accessed user input technology.

[0267] According to some embodiments, the device receives user input associated with a first available element (e.g., 606A), which is associated with a user input interface for a least recently accessed user input technique (e.g., the user taps on the first available element (or otherwise activates the first available element)). In response to receiving user input associated with the first available element, the device replaces the display of the user input interface for the most recently accessed user input technique with the display of the user input interface for the least recently accessed user input technique, as illustrated in user input screen 610. Thus, at user interface screen 606, user interface screen 610 is displayed when available element 606A is activated. Note that at user interface 610, the recent contacts function is now the second most recently accessed technique, as illustrated by the recent contacts available element 610A in the lower left corner of the display. Similarly, all contacts functions are now the least recently accessed techniques, and therefore the corresponding available element (e.g., 610B) for all contacts functions is displayed in the lower right corner of user interface screen 610. Speech functionality has become one of the most frequently accessed technologies recently, and user interfaces for speech functionality have therefore been developed (e.g., 610C and 610D).

[0268] Returning to user interface screen 606, according to some embodiments, the device receives user input associated with a first available element, which is associated with the user input interface of the least recently accessed user input technology (e.g., the user taps on the first available element (or otherwise activates the first available element)). In response to receiving user input associated with the first available element, the device replaces the display of the user input interface of the most recently accessed user input technology with the display of the user input interface of the least recently accessed user input technology, and replaces the display of the first available element associated with the user input interface of the least recently accessed user input technology with the display of a third available element associated with the user input interface of the most recently accessed user input technology, and replaces the display of the second available element associated with the user input interface of the second most recently accessed user input technology with the display of a fourth available element associated with the user input interface of the most recently accessed user input technology. Therefore, the user interface transitions to dictation functionality, and available element 610 corresponds to the recent contacts function, while available element 610B corresponds to the all contacts function.

[0269] Returning to user interface screen 606, if the user activates the option 606A corresponding to all contact functions, the device displays user interface screen 608. On user interface screen 608, a user interface for the most recently accessed user input technology is displayed (e.g., 608C for all contact functions). Option 608A corresponds to the second most recently accessed user input technology (e.g., recent contacts function), and option 608B corresponds to the least recently accessed user input technology (e.g., speech function).

[0270] At user interface screen 608, if the user activates the available component 608C corresponding to the Adam Smith contact, the device displays... Figure 6B The user interface screen 616 includes contact information associated with the Adam Smith contact. For example, the user interface screen 616 includes an option 616A for a mobile phone number, an option 616B for an email address, and an option 616C for microblogging processing. Activating any of options 616A-616C causes the device to add the corresponding contact information as recipient information in an electronic message. Returning to activation of option 614D causes the device to replace the display of the user interface screen 616 with the user interface screen 608.

[0271] Returning to the user interface screen 608, if the user activates the option 608B corresponding to the speech function, the device displays the user interface screen 614. On the user interface screen 614, a user interface for the most recently accessed user input technology (e.g., 614C, 614D for the speech function) is displayed. Option 614A corresponds to the second most recently accessed user input technology (e.g., the all contacts function), and option 614B corresponds to the least recently accessed user input technology (e.g., the recent contacts function).

[0272] At the user interface screen 614, the device receives audio input. If the user activates the available component 614C, the device displays... Figure 6B The user interface screen 620. The device transcribes the received audio input and displays all or part of the transcribed audio as an offer 620A. In this example, the transcribed audio input is "555-5555". The user interface screen 620 includes an offer 620B corresponding to the transcribed audio for Adam Smith's contact information, and an offer 620C also corresponding to the transcribed audio for Emily Wong's contact information. Activating any of the offers 620A-620C causes the device to add the corresponding contact information as recipient information in an electronic message. Returning to activation of offer 620D causes the device to replace the display of user interface screen 616 with user interface screen 614.

[0273] Returning to user interface screen 610, if the user has activated the option 610A corresponding to the recent contacts function, the device displays user interface screen 612. On user interface screen 612, a user interface for the most recently accessed user input technology (e.g., 614C for the recent contacts function) is displayed. Option 612A corresponds to the second most recently accessed user input technology (e.g., the dictation function), and option 612B corresponds to the least recently accessed user input technology (e.g., the all contacts function). Note that user interface screen 612 differs from user interface screen 606 due to the path required to access user interface screen 612.

[0274] After (or before) a user adds contact information as a recipient to an electronic message (e.g., by activating the enablement 602A of user interface screen 602), the user can create the body of the electronic message (e.g., by activating the create message enablement 602B). The user interface screen 622, corresponding to user interface screen 602, includes the create message enablement 622A. At user interface screen 622, if the user activates enablement 622A, the device displays... Figure 6C The user interface screen 626.

[0275] At user interface screen 626, a user interface for the most recently accessed user input technology (e.g., 626C-626E for suggested response function) is displayed. Availability 626A corresponds to the second most recently accessed user input technology (e.g., emoji function), and availability 626B corresponds to the least recently accessed user input technology (e.g., speech function).

[0276] Different techniques can be used to generate suggested responses (also known as "suggested replies"). In one example, the device determines whether a received message contains a question. This determination could be based on including the phrase "Are you...?" at the beginning of the received message and a question mark at the end of the received message. Based on the determination that the received message contains a question, one or more suggested replies could include "yes," "no," and "maybe."

[0277] In another example, the received message might state "beef or chicken." As mentioned earlier, the device can determine that the message contains a question (at least based on the use of a question mark in the message). Additionally, the device can identify a question that includes alternatives based on the presence of the word "or" in the message. In this case, the device can parse the words directly before and after the word "or." Therefore, one or more suggested responses could include "beef" and "chicken."

[0278] The techniques used to determine suggested responses can be found, for example, in the relevant U.S. Provisional Patent Application Serial No. 62 / 005,958 entitled “CannedAnswers in Messages”, filed May 30, 2014, the entire disclosure of which is incorporated herein by reference.

[0279] At the user interface screen 626, the device receives user activation for one of the available components 626C-626E. Based on the received user activation, the device adds a corresponding suggested reply to the body of the electronic message (e.g., the content of an SMS message or the body of an email message). As will be understood, by providing a component for adding suggested replies, the device saves users the keystrokes otherwise required to enter names or navigate a contact list. Furthermore, by providing a more efficient interface, the device can save energy, for example, by activating the display for less time.

[0280] Returning to user interface screen 626, if the user activates the option 626A corresponding to the emoji function, the device displays user interface screen 628. User interface screen 628 displays a user interface for the most recently accessed user input technology (e.g., 628C, 628D, 628E for the emoji function). Option 628A corresponds to the second most recently accessed user input technology (e.g., suggested reply function), and option 628B corresponds to the least recently accessed user input technology (e.g., speech function).

[0281] At user interface screen 628, if the user activates the option 628B corresponding to the speech function, the device displays user interface screen 634. User interface screen 634 displays a user interface for the most recently accessed user input technology (e.g., 634C, 634D for the speech function). Option 634A corresponds to the second most recently accessed user input technology (e.g., emoji function), and option 634B corresponds to the least recently accessed user input technology (e.g., suggested reply function).

[0282] At user interface screen 634, the user receives audio input. If the user activates the available component 634C, the device displays... Figure 6D The user interface screen 636. The device transcribes the received audio input. The device displays a text availability 636A and an audio availability 636B. When activated, the text availability 636A causes the device to add transcribed audio input (e.g., as an audio file) to the body of the electronic message. The device receives scroll input, and the display of user interface 636 scrolls, as shown on user interface screen 638. At user interface screen 638, the device displays the transcribed audio input 636A and an availability 638B for playing back the recording of the received audio input. This allows the user to see the transcribed text precisely and determine whether the transcribed text or the audio recording should be sent to the recipient of the electronic message.

[0283] Returning to user interface screen 626, if the user activates the option 626B corresponding to the speech function, the device displays user interface screen 632. User interface screen 632 displays the user interface for the most recently accessed user input technology (e.g., 632C, 632D for the speech function). Option 632A corresponds to the second most recently accessed user input technology (e.g., suggested response function), and option 632B corresponds to the least recently accessed user input technology (e.g., emoji function). Note that user interface screen 632 differs from user interface screen 634 due to the paths required to access the two user interfaces.

[0284] At user interface screen 632, if the user activates the option 632A corresponding to the suggested response function, the device displays user interface screen 630. User interface screen 630 displays a user interface for the most recently accessed user input technology (e.g., options 630C-630E for the suggested response function). Option 630A corresponds to the second most recently accessed user input technology (e.g., speech function), and option 630B corresponds to the least recently accessed user input technology (e.g., emoji function). Note that user interface screen 630 differs from user interface screen 626 due to the path required to access user interface screen 630.

[0285] The transcription of received audio input (e.g., speech) can be accomplished in several ways, including: (1) locally via an electronic device; (2) remotely, where the electronic device transmits (e.g., via WiFi or Bluetooth) user input representing speech to an external device (e.g., a cellular phone or a laptop computer), the external device transcribes the user input locally, and the electronic device receives the transcribed speech from the external device; (3) remotely, where the electronic device transmits (e.g., via WiFi or Bluetooth) user input representing speech to a server (e.g., a server connected via the Internet), the server transcribes the user input, and the electronic device receives the transcribed speech from the server (e.g., via WiFi or Bluetooth); or (4) remotely, where the electronic device transmits (e.g., via WiFi or Bluetooth) user input representing speech to an external device (e.g., a cellular phone or a laptop computer), the external device transmits the user input to the server, the server transcribes the user input, the external device receives the transcribed speech from the server, and the electronic device receives the transcribed speech from the external device. The device adds the transcribed speech as response information for electronic dialogue. For example, transcription can be performed using speech-to-text and / or automatic speech recognition using a virtual assistant. At the user interface screen 646, conversation 646A has been updated to reflect the addition of "Of course! I'll send it right away." in domain 646B. Thus, the user can provide audio input to enter a response message for the electronic conversation. When send availability 646C is enabled and activated, the response message (e.g., transcribed speech) is transmitted to the recipient of the conversation. Once a reply is sent, a notification 648 indicating that a reply has been sent is displayed.

[0286] An example description of a virtual assistant is given in the applicant’s U.S. Utility Model Application Serial No. 12 / 987,982, filed January 11, 2011, for “Intelligent Automated Assistant,” the entire disclosure of which is incorporated herein by reference.

[0287] Figure 7 This is a flowchart illustrating a method 700 for receiving user input according to some embodiments. In some embodiments, method 700 can be performed on an electronic device having a display (e.g., 112, 340, 504), a touch-sensitive surface (e.g., 112, 355, 504), and a rotatable input mechanism (e.g., 506). Some operations in method 700 can be combined, the order of some operations can be changed, and some operations can be omitted.

[0288] In some embodiments, the touch-sensitive surface (e.g., 112, 355, 504) is capable of detecting the intensity of a touch contact. In some embodiments, method 700 can be performed at an electronic device having a display and a touch-sensitive surface (e.g., 112, 355, 504) capable of determining an alternative (proxy) force or pressure for contact on the touch-sensitive surface. Exemplary devices that can perform method 700 include devices 100, 300, and 500. Figure 1A , Figure 3 and Figure 5A ).

[0289] Method 700 provides an intuitive way to receive user input. This method reduces the cognitive burden on users when inputting information using a device, thereby creating a more efficient human-computer interface. For battery-powered computing devices, it enables users to input information faster and more efficiently, saving power and reducing time between battery charging cycles.

[0290] At box 702, user input is received. At box 704, in response to receiving user input, boxes 706-712 are executed. At box 706, the most recently accessed user input technology in the set of user input technologies is identified. At box 708, the least recently accessed user input technology in the set of user input technologies is identified. At box 710, the user input interface of the most recently accessed user input technology is displayed on the screen. At box 712, a first available element associated with the user input interface of the least recently accessed user input technology is displayed on the screen.

[0291] According to some embodiments, the user input interface of the most recently accessed user input technology includes selection options associated with the most recently accessed user input technology (e.g., 606C, 626C).

[0292] According to some embodiments, in response to receiving user input, the most recently accessed second most accessed user input technique in the set of user input techniques is identified, and a second available element associated with the user input interface of the most recently accessed second most accessed user input technique is displayed on the display.

[0293] According to some embodiments, the most recently accessed user input technique, the least recently accessed user input technique, and the second most recently accessed user input technique are different techniques in a set of user input techniques.

[0294] According to some embodiments, the most recently accessed user input technology, the least recently accessed user input technology, and the second most recently accessed user input technology are selected from a group that includes the recent contacts function, the all contacts function, and the dictation function.

[0295] According to some embodiments, the most recently accessed user input technology, the least recently accessed user input technology, and the second most recently accessed user input technology are selected from a group including suggested reply function, emoji function, and dictation function.

[0296] According to some embodiments, the set of user input techniques is a predetermined closed set of input techniques. According to some embodiments, the number of user input techniques in the set of user input techniques is predetermined. According to some embodiments, a first available element provides an indication of the least recently accessed user input technique. According to some embodiments, a second available element provides an indication of the second most recently accessed user input technique. According to some embodiments, the user input interface of the first available element, the second available element, and the most recently accessed user input technique is displayed simultaneously.

[0297] According to some embodiments, user input associated with a first available element is received, the first available element being associated with a user input interface of a least recently accessed user input technique. In response to receiving user input associated with the first available element, the display of a user input interface of a most recently accessed user input technique is replaced with the display of a user input interface of a least recently accessed user input technique.

[0298] According to some embodiments, user input associated with a first available element is received, the first available element being associated with a user input interface of a least recently accessed user input technology. In response to receiving user input associated with the first available element: the display of the user input interface of the most recently accessed user input technology is replaced by the display of the user input interface of the least recently accessed user input technology; the display of the first available element associated with the user input interface of the least recently accessed user input technology is replaced by the display of a third available element associated with the user input interface of the most recently accessed user input technology; and the display of a second available element associated with the user input interface of the second most recently accessed user input technology is replaced by the display of a fourth available element associated with the user input interface of the most recently accessed user input technology.

[0299] Note that the above reference method 700 ( Figure 7 The details of the process described in ) also apply in a similar manner to the methods described below. For example, method 900 ( Figure 9 Method 1000 Figure 10 Method 1200 Figure 12 Method 1400 Figure 14A Method 1420 Figure 14B ) and Method 1600 ( Figure 16 This may include one or more of the features of the various methods described in reference method 700 above. For the sake of brevity, these details will not be repeated below.

[0300] It should be understood that the description Figure 7 The specific order of operations described herein is exemplary and not intended to indicate that the described order is the only possible order in which operations can be performed. Those skilled in the art will recognize the various ways in which the operations described herein can be reordered, and certain operations can be excluded. For the sake of brevity, these details are not repeated here. Additionally, it should be noted that method 700 ( Figure 7 Method 900 Figure 9 Method 1000 Figure 10 Method 1200 Figure 12 Method 1400 Figure 14A Method 1420 Figure 14B ) and Method 1600 ( Figure 16 The aspects of ) can be merged with each other. Therefore, the technology described in reference method 700 can be combined with method 900 ( Figure 9 Method 1000 Figure 10 Method 1200 Figure 12 Method 1400 Figure 14A Method 1420 Figure 14B Method 1600 Figure 16(Related to)

[0301] Figure 8 The illustration depicts an exemplary user interface for receiving user input associated with a scrollable list, according to some embodiments. In some embodiments, the electronic device is device 500. The electronic device has a display (e.g., 112, 340, 504) and a rotatable input mechanism (e.g., 506). In some cases, it may be difficult for a user to quickly and efficiently determine the progress of scrolling as they scroll through a list of items on the display. Therefore, displaying an index object can be helpful, providing an indication of the scrolling progress.

[0302] At user interface 802, a portion of a collection of information (e.g., a portion of a contact list; 802A and other names) is displayed. In this example, the elements of the collection of information (e.g., contacts in the contact list) are arranged alphabetically, with "Adam Smith" 802A displayed at the top of the collection of information. The device receives user input associated with the collection of information (e.g., the user swipes their finger across the displayed collection of information, the user rotates a rotatable input mechanism, or the user swipes up or down along the index bar 802B). In response to receiving user input associated with the collection of information, the device scrolls the collection of information on the display. The device determines whether scrolling attributes (e.g., scrolling rate, acceleration, duration; user input rate, acceleration, duration) satisfy threshold criteria (e.g., scrolling above a threshold scrolling rate, acceleration above a threshold acceleration, scrolling duration longer than a threshold scrolling duration; user input above a threshold rate or threshold acceleration, user input duration longer than a threshold duration). Based on the determination that the scrolling attributes satisfy the threshold criteria (e.g., scrolling above a threshold scrolling rate, user input above a threshold rate), the device displays index object 804A, as illustrated in user interface screen 804.

[0303] According to some embodiments, index object 804A completely or partially obscures at least a portion of the set of information, as illustrated in user interface screen 804. By obscuring a portion of the set of information, the user does not need to shift their attention to different locations on the display to see index object 804A. Therefore, when it is displayed as obscured, a user viewing the set of information scrolling on the display can easily see index object 804A.

[0304] According to some embodiments, scrolling attributes are attributes of the scrolling of a collection of information (e.g., scrolling rate, acceleration, duration). Thus, for example, when the collection of information exceeds a certain scrolling rate, index object 804A is displayed. According to some embodiments, scrolling attributes are attributes of user input (e.g., scrolling rate, acceleration, and duration). Thus, for example, when user input exceeds a certain rate, such as an upward swipe exceeding a certain rate or a rotation of a rotatable input mechanism exceeding a certain rotation rate, index object 804A is displayed. Similarly, in some embodiments, threshold criteria are based on one or more of exceeding a threshold rate, exceeding a threshold speed, and exceeding a threshold duration.

[0305] According to some embodiments, the electronic device includes a touch-sensitive surface, and user input is a swipe touch on the touch-sensitive surface (e.g., a vertical swipe or flick on a collection of information to scroll the collection of information). According to some embodiments, the electronic device includes a rotatable input mechanism, and user input is rotation of the rotatable input mechanism (e.g., a user rotating the rotatable input mechanism to scroll a list of information).

[0306] In some embodiments, based on the determination that the scrolling attribute does not meet a threshold criterion, the device does not display (or stops displaying) an index object (e.g., 804A, 806A) that completely or partially obscures the set of information. Therefore, when a user provides input for scrolling the set of information, the index object may not appear if, for example, the scrolling rate does not exceed a threshold scrolling rate. Similarly, when an index object is displayed, the device may stop displaying the index object when the scrolling rate no longer exceeds a threshold scrolling rate. For example, in user interface 806, as the scrolling rate of the set of information decreases, the device may stop displaying all objects 806A, as illustrated in user interface screen 810. In some examples, although index object 806A is no longer displayed when the scrolling attribute no longer meets the threshold criterion, the set of information may continue to scroll. In some examples, the threshold criterion for displaying the index object (e.g., a first threshold scrolling rate) may be different from the threshold criterion for stopping the display of the index object (e.g., a second threshold scrolling rate).

[0307] According to some embodiments, index objects 804A, 806A include indexes (e.g., single letter characters or single numeric characters; "H" in 804A, "J" in 806A) based on one or more currently displayed pieces of information in the information set (e.g., based on character positions used for alphabetical sorting of the information set; the first letter of a name in user interface screen 804, "H"). Therefore, the index indicates to the user which parts of the information set are currently being displayed.

[0308] According to some embodiments, the device determines whether the index update attribute of the set of information satisfies a masking update criterion (e.g., the set of information has an item that has reached a threshold position on the display). For example, the device may determine whether a first name with a first letter different from the letter currently displayed in the index exceeds a threshold (masking update criterion). In user interface 804, the index update attribute is the vertical position of the topmost "H" name 804C. Because name 804C has reached the threshold position (displayed only for explanatory purposes, not as part of the user interface), the device determines that the masking update criterion is satisfied (e.g., the position of the list has changed sufficiently to make an update in the index necessary). Based on the determination that the index update attribute of the set of information satisfies the index update criterion, the device updates the visual display of the index objects (e.g., updates the index objects to reflect the letters corresponding to the portion of the list being displayed). Therefore, as the set of information scrolls, the device updates the displayed letters / characters of the index objects (e.g., 804A "H" updated to 806A "J") to reflect the position of the set of information (e.g., from the "H" name in 804 to the "J" name in 806).

[0309] According to some embodiments, the collection of information is organized (e.g., all names with "A" together, all names with "B" together, etc.). According to some embodiments, the collection of information is displayed in alphabetical order (or reverse alphabetical order, or numerical order).

[0310] According to some embodiments, user input associated with the set of information includes a first direction (e.g., swiping up or down on a touch-sensitive display, clockwise or counterclockwise rotation of a rotatable input mechanism), and scrolling at least a portion of the set of information on the display includes scrolling at least a portion of the set of information on the display in a second direction. The second direction is based on the first direction. Therefore, the set of information scrolls in the direction requested by the user.

[0311] These techniques for displaying indexed objects can be used in various software applications and for collections of various types of information. According to some embodiments, the collection of information includes multiple contacts (e.g., names, email addresses, and / or phone numbers). According to some embodiments, the collection of information includes a list of contacts (e.g., names, email addresses, and / or phone numbers). According to some embodiments, the collection of information includes multiple media attributes (or a list of media attributes) (e.g., song titles, audio recordings, videos, books, newspaper articles, websites, and / or email subjects; song artists, audio recordings, and / or videos; book authors, newspaper articles, websites, and / or emails).

[0312] Figure 9This is a flowchart illustrating a method 900 for receiving user input associated with a scrollable list according to some embodiments. In some embodiments, method 900 may be performed at an electronic device having a display (e.g., 112, 340, 504). The electronic device may also include a touch-sensitive surface (e.g., 112, 355, 504) and a rotatable input mechanism (e.g., 506). In some embodiments, the touch-sensitive surface (e.g., 112, 355, 504) is capable of detecting the intensity of a touch contact. In some embodiments, method 900 may be performed at an electronic device having a display and a touch-sensitive surface (e.g., 112, 355, 504) capable of determining an alternative (proxy) force or pressure for contact on the touch-sensitive surface. Exemplary devices that can perform method 900 include devices 100, 300, and 500. Figure 1A , Figure 3 and Figure 5A Some operations in method 900 can be combined, the order of some operations can be changed, and some operations can be omitted.

[0313] In some situations, users may find it difficult to quickly and effectively determine the progress of scrolling through a list of items on a display. Therefore, displaying an index object can be helpful, providing an indication of the scrolling progress. Method 900 provides an intuitive approach to scrolling through a list based on user input. This method reduces the cognitive burden on users when scrolling through a list on a device, thereby creating a more efficient human-computer interface. For battery-powered computing devices, enabling users to scroll through information faster and more efficiently saves power and increases the time between battery recharges.

[0314] At box 902, a portion of the information set is displayed (e.g., 802A and other names of the user interface 802).

[0315] At box 904, user input associated with a set of information is received (e.g., the user swipes on the displayed set, or the user rotates a rotatable input mechanism).

[0316] At box 906, in response to receiving user input associated with a set of information, the set of information is scrolled on the display.

[0317] At box 908, determine whether scrolling attributes (e.g., scrolling rate, acceleration, duration; user input rate, acceleration, duration) meet threshold criteria (e.g., scrolling rate is higher than threshold, acceleration is higher than threshold, scrolling duration is longer than threshold; user input is higher than threshold rate or threshold acceleration, user input duration is longer than threshold duration).

[0318] At box 910, based on the determination that the scrolling attributes meet the threshold criteria (e.g., scrolling is fast, user input is fast), the index object (e.g., 804A, 806A) is displayed.

[0319] According to some embodiments, the index object (e.g., 804A, 806A) completely or partially obscures at least a portion of the set of information. According to some embodiments, scrolling attributes are scrolling attributes of the set of information (e.g., scrolling rate, acceleration, duration). According to some embodiments, scrolling attributes are user-input attributes (e.g., scrolling rate, acceleration, and duration). According to some embodiments, the threshold criterion is based on one or more of exceeding a threshold rate, exceeding a threshold speed, and exceeding a threshold duration.

[0320] According to some embodiments, in an electronic device having a touch-sensitive surface, user input is a swipe touch on the touch-sensitive surface (e.g., a vertical swipe on a collection of information to scroll through the collection of information). According to some embodiments, in an electronic device having a rotatable input mechanism, user input is rotation of the rotatable input mechanism (e.g., the user rotates the rotatable input mechanism to scroll through a list of information).

[0321] According to some embodiments, at block 914, based on the determination that the scrolling attribute does not meet the threshold criterion, the device does not display (or stops displaying; for example, as illustrated in 810) an index object of a set of information that is fully or partially covered (e.g., 804A, 806A).

[0322] According to some embodiments, the index object (e.g., 804A, 806A) includes an index (e.g., a single letter character or a single numeric character) based on one or more currently displayed pieces of information in the set of information (e.g., based on the character position used to alphabetically sort the set of information).

[0323] According to some embodiments, it is determined whether the index update attribute of the set of information (e.g., the position of 804C) satisfies the occlusion update criterion (e.g., an item in the set of information that reaches a threshold position 804B on the display). Based on the determination that the index update attribute of the set of information satisfies the index update criterion, the visual display of the index objects is updated (e.g., index objects 804A / 806A are updated to reflect the letters corresponding to the portion of the list being displayed).

[0324] According to some embodiments, the collection of information is organized. According to some embodiments, the collection of information is displayed in alphabetical order.

[0325] According to some embodiments, user input associated with a set of information includes a first direction (e.g., sliding up or down on a touch-sensitive surface, clockwise or counterclockwise rotation of a rotatable input mechanism), and scrolling at least a portion of the set of information on the display includes scrolling at least a portion of the set of information on the display in a second direction, wherein the second direction is based on the first direction.

[0326] According to some embodiments, the collection of information includes multiple contacts (e.g., names, email addresses, and / or phone numbers). According to some embodiments, the collection of information includes a list of contacts (e.g., names, email addresses, and / or phone numbers). According to some embodiments, the collection of information includes multiple media attributes (or a list of media attributes) (e.g., song titles, audio recordings, videos, books, newspaper articles, websites, and / or email subjects; the artist of a song, audio recordings, and / or videos; the author of a book, newspaper articles, websites, and / or emails).

[0327] Note that the above reference method 900 ( Figure 9 The details of the process described in ) also apply in a similar manner to the methods described below. For example, method 700 ( Figure 7 Method 1000 Figure 10 Method 1200 Figure 12 Method 1400 Figure 14A Method 1420 Figure 14B ) and Method 1600 ( Figure 16 This may include one or more of the features of the various methods described in reference method 900 above. For the sake of brevity, these details will not be repeated below.

[0328] It should be understood that the description Figure 9 The specific order of operations described herein is exemplary and not intended to indicate that the described order is the only possible order in which operations can be performed. Those skilled in the art will recognize the various ways in which the operations described herein can be reordered, and certain operations can be excluded. For the sake of brevity, these details are not repeated here. Additionally, it should be noted that method 700 ( Figure 7 Method 900 Figure 9 Method 1000 Figure 10 Method 1200 Figure 12 Method 1400 Figure 14A Method 1420 Figure 14B ) and Method 1600 ( Figure 16 The aspects of ) can be merged with each other. Therefore, the technology described in reference method 900 can be combined with method 700 ( Figure 7 Method 1000 Figure 10 Method 1200 Figure 12 Method 1400 Figure 14A Method 1420 Figure 14B Method 1600 Figure 16 (Related to)

[0329] Figure 10 This is a flowchart illustrating a method 1000 for receiving user input associated with a scrollable list according to some embodiments. In some embodiments, method 1000 may be performed at an electronic device having a display (e.g., 112, 340, 504). The electronic device may also include a touch-sensitive surface (e.g., 112, 355, 504) and a rotatable input mechanism (e.g., 506). In some embodiments, the touch-sensitive surface (e.g., 112, 355, 504) is capable of detecting the intensity of a touch contact. In some embodiments, method 1000 may be performed at an electronic device having a display and a touch-sensitive surface (e.g., 112, 355, 504) capable of determining an alternative (proxy) force or pressure for contact on the touch-sensitive surface. Exemplary devices that can perform method 1000 include device 100, device 300, and device 500. Figure 1A , Figure 3 and Figure 5A Some operations in method 1000 can be combined, the order of some operations can be changed, and some operations can be omitted.

[0330] In some situations, users may find it difficult to quickly and effectively determine the progress of scrolling through a list of items on a display. Therefore, displaying an index object can be helpful, providing an indication of the scrolling progress. Method 1000 provides an intuitive approach to scrolling through a list based on user input. This method reduces the cognitive burden on users when scrolling through a list on a device, thereby creating a more efficient human-computer interface. For battery-powered computing devices, enabling users to scroll through information faster and more efficiently saves power and increases the time between battery recharges.

[0331] In box 1002, a portion of the set of information is displayed (e.g., 802A and other names for user interface 802).

[0332] At box 1004, user input associated with a set of information is received (e.g., the user swipes on the displayed set, or the user rotates a rotatable input mechanism).

[0333] At box 1006, in response to receiving user input associated with a set of information, the set of information is scrolled on the display.

[0334] At box 1008, determine whether scrolling attributes (e.g., scrolling rate, acceleration, duration; user input rate, acceleration, duration) meet threshold criteria (e.g., scrolling rate is higher than threshold, acceleration is higher than threshold, scrolling duration is longer than threshold; user input is higher than threshold rate or threshold acceleration, user input duration is longer than threshold duration).

[0335] At box 1010, based on the determination that the scrolling attributes meet the threshold criteria (e.g., scrolling is fast, user input is fast), the index object (e.g., 804A, 806A) is displayed.

[0336] Optionally, at box 1012, the index object is not displayed (e.g., not displayed or stopped displayed) based on the determination that the scrolling attribute does not meet the threshold criterion (e.g., scrolling is slow, user input is slow).

[0337] You can then repeat the confirmation at box 1008.

[0338] Note that the above reference method 1000 ( Figure 10 The details of the process described in ) also apply in a similar manner to the methods described below. For example, method 700 ( Figure 7 Method 900 Figure 9 Method 1200 Figure 12 Method 1400 Figure 14A Method 1420 Figure 14B ) and Method 1600 ( Figure 16 This may include one or more of the characteristics of the various methods described in reference method 1000 above. For the sake of brevity, these details will not be repeated below.

[0339] It should be understood that the description Figure 10 The specific order of operations described herein is exemplary and not intended to indicate that the described order is the only possible order in which operations can be performed. Those skilled in the art will recognize the various ways in which the operations described herein can be reordered, and certain operations can be excluded. For the sake of brevity, these details are not repeated here. Additionally, it should be noted that method 700 ( Figure 7 Method 900 Figure 9 Method 1000 Figure 10 Method 1200 Figure 12 Method 1400 Figure 14A Method 1420 Figure 14B ) and Method 1600 ( Figure 16 The aspects of ) can be merged with each other. Therefore, the technology described in reference method 1000 can be combined with method 700 ( Figure 7 Method 900 Figure 9 Method 1200 Figure 12 Method 1400 Figure 14A Method 1420 Figure 14B Method 1600 Figure 16 (Related to)

[0340] Figure 11 The illustration depicts an exemplary user interface for manipulating emojis before sending them to a recipient, according to some embodiments. In some embodiments, the electronic device is device 500. The electronic device has a display (e.g., 112, 340, 504). The electronic device may also include a touch-sensitive surface (e.g., 112, 355, 504) and a rotatable input mechanism (e.g., 506). A user may wish to express emotions or provide simple messages to a recipient (e.g., I am happy or unhappy, yes or no). It may be difficult for a user to quickly and effectively provide textual information to express emotions or provide messages. Therefore, displaying interactive emojis that a user can manipulate to express emotions or messages can be helpful. The manipulated emojis can then be sent to the recipient.

[0341] The device receives user input. User input can be associated with a message sending / receiving input interface. In response to receiving user input, the device displays a pictogram object (e.g., 1100A), as illustrated in the user interface screen 1100. The pictogram object 1100A includes several visual objects, such as eyebrows, a right eye, a left eye 1100B, and a mouth 1100C.

[0342] At user interface 1100, the device receives a first user input associated with a Font Graphic object. For example, the device receives a swipe on a touch-sensitive surface or a rotation of a rotatable input mechanism. In the example of user interface 1100, the device receives a downward swipe gesture on the left eye 1100B. In response to receiving the first user input associated with the Font Graphic object (e.g., a downward swipe gesture on the left eye 1100B), the device changes a first visual aspect of the Font Graphic object. The change in the first visual aspect is based on the first user input (the downward swipe gesture on the left eye 1100B causes the left eye to close or enter a blinking state, as illustrated in user interface screen 1102). Therefore, the user input on the left eye 1100B causes the left eye of the Font Graphic object 1102A to either close or blink 1102B, as illustrated in user interface screen 1102.

[0343] In some embodiments, touch gestures on the display can be used to change specific visual aspects of a graffiti object. For example, when the device receives a smiley face touch gesture (e.g., a “U”-shaped touch gesture) at the user interface screen 1100, the device changes the mouth 1100C of the graffiti object to indicate a smile. When the device receives a frowning touch gesture (e.g., an inverted “U”-shaped touch gesture), the device changes the mouth 1100C of the graffiti object to indicate a frown. The smiley face touch gesture and the frowning touch gesture do not require the finger to be at the position of the mouth 1100C. This allows the user to quickly modify the visual aspect of the graffiti object without requiring high precision in the position of the touch gesture. As will be understood, other gestures such as tapping can be used to change the graffiti element. For example, repeatedly tapping the same element can pass it through various states.

[0344] The device receives recipient information (e.g., the user enters an email address or...). (Recipient). Once the user has manipulated the Emoji graphic object to their liking and has provided the recipient information, the user can request that the Emoji graphic object be sent to them. The device transmits the Emoji graphic object, including the changed first visual aspect, to the recipient associated with the received recipient information (e.g., sending the changed Emoji as a message).

[0345] According to some embodiments, the device receives a second user input associated with a graffiti object (e.g., a swipe / drag on a touch-sensitive surface or rotation of a rotatable input mechanism). In response to receiving the second user input associated with the graffiti object, the device alters (e.g., by animing the change) a second visual aspect of the graffiti object. The alteration of the second visual aspect is based on the second user input (e.g., swiping upwards at the corner of a smiley face makes the smiley face appear happier). According to some embodiments, the first and second visual aspects are different.

[0346] For example, at user interface screen 1104, an upward swipe on the mouth 1140B (or the corner of the mouth) of a smiley face can make the smiley face 1104A appear happier, as illustrated by the mouth 1106C at user interface screen 1106. Note that the closed / blinking 1106B of the smiley face 1106A persists, meaning multiple visual aspects can be altered. Similarly, a downward swipe on the mouth can make the smiley face appear sadder. In some examples, different procedures of upward or downward swipes give the emoji graphic object mouths corresponding to different degrees of happiness or sadness. Therefore, users can manipulate different visual aspects of emoji graphic objects by providing user input before sending them to a recipient.

[0347] According to some embodiments, the electronic device includes a touch-sensitive surface, and a first user input associated with a pictogram object includes a touch gesture (e.g., the user drags, swipes, or taps on the eyes of the pictogram) at a location on the touch-sensitive surface associated with a first visual aspect of the pictogram object.

[0348] According to some embodiments, the electronic device includes a touch-sensitive surface configured to detect touch intensity. A first user input associated with a pictogram object includes a touch gesture with characteristic intensity (e.g., a user tap with intensity: hard press, light press, or still contact). In response to receiving the first user input and determining that the characteristic intensity exceeds an intensity threshold (e.g., the touch gesture is a hard press), the device alters a first visual aspect of the pictogram object, including changing a first feature of the pictogram visual object (e.g., changing the size or color of the pictogram).

[0349] According to some embodiments, in response to receiving a first user input and determining that the characteristic intensity does not exceed an intensity threshold (e.g., the touch gesture is not a hard press), changing a first visual aspect of a pictogram object includes changing a second characteristic of the pictogram object that is different from the first characteristic (e.g., changing the expression or orientation of the pictogram). Therefore, a touch gesture can change different characteristics of a pictogram object based on the characteristic intensity of the touch.

[0350] According to some embodiments, the electronic device includes a rotatable input mechanism. A first user input associated with a pictographic graphic object includes rotation of the rotatable input structure (e.g., rotating the rotatable input mechanism to change the shape of the eye).

[0351] According to some embodiments, the electronic device includes a touch-sensitive surface and a rotatable input mechanism. First user input associated with a pictographic object includes a touch gesture on the touch-sensitive surface at a location associated with a first visual aspect of the pictographic object and rotation of the rotatable input mechanism (e.g., the user taps or taps and holds the pictographic object over its eye to identify a feature to be changed and rotates the rotatable input mechanism to cause a change in the identified feature).

[0352] According to some embodiments, transmitting an Emoji graphic object includes transmitting the Emoji graphic object in response to receiving third user input associated with a selected availability (e.g., when activated, the third user input causes Emoji to be sent).

[0353] According to some embodiments, before transmitting the emoji graphic object, the device, in response to receiving a fourth user input, adds the emoji graphic object to the message body (e.g., the fourth user input is associated with the selection option 1104D, which, when activated, causes the emoji to be added to the body of a text message or an email message).

[0354] According to some embodiments, the emoji graphic object is an animated emoji graphic object (e.g., an emoji blinking and / or an emoji's tongue flapping). According to some embodiments, altering a first visual aspect of the emoji graphic object includes animating changes to the first visual aspect of the emoji graphic object (e.g., an upward swipe at the corner of a smiley face makes the mouth appear larger / happier). In some embodiments, the transmitted emoji may include additional information, such as changing the order of elements, so that the emoji can be animated in the same style at the recipient's device.

[0355] Figure 12 This is a flowchart illustrating a method 1200 for manipulating emojis before sending them to a recipient, according to some embodiments. In some embodiments, method 1200 may be performed at an electronic device having a display (e.g., 112, 340, 504). The electronic device may also include a touch-sensitive surface (e.g., 112, 355, 504) and a rotatable input mechanism (e.g., 506). In some embodiments, the touch-sensitive surface (e.g., 112, 355, 504) is capable of detecting the intensity of a touch contact. In some embodiments, method 1200 may be performed at an electronic device having a display and a touch-sensitive surface (e.g., 112, 355, 504) capable of determining an alternative (proxy) force or pressure for contact on the touch-sensitive surface. Exemplary devices that can perform method 1200 include devices 100, 300, and 500. Figure 1A , Figure 3 and Figure 5A Some operations in method 1200 can be combined, the order of some operations can be changed, and some operations can be omitted.

[0356] Users may want to express emotions or provide simple messages (e.g., I'm happy or unhappy, yes or no) to recipients. Users may find it difficult to quickly and effectively provide textual information to express emotions or provide messages. Therefore, displaying interactive emojis can be helpful; users can manipulate them to express emotions or messages. The manipulated emojis can then be sent to the recipient. Method 1200 provides an intuitive way to manipulate emojis based on user input. This method reduces the cognitive burden on users preparing messages using their devices, thereby creating a more efficient human-computer interface. For battery-powered computing devices, it enables users to prepare messages faster and more efficiently, saving power and increasing the time between battery charging.

[0357] At box 1202, user input is received. At box 1204, in response to receiving user input, a Graphic Object (e.g., 1100A) is displayed. At box 1206, first user input associated with the Graphic Object is received.

[0358] At box 1208, in response to receiving a first user input associated with a Font Graphics object (e.g., 1100A), a first visual aspect of the Font Graphics object (e.g., 1102B) is changed. The change in the first visual aspect (e.g., 1102B) is based on the first user input.

[0359] At box 1210, recipient information is received. At box 1212, a pictogram object including a modified first visual aspect (e.g., 1102B) is transmitted to the recipient associated with the received recipient information.

[0360] According to some embodiments, a second user input (e.g., a swipe / drag on a touch-sensitive surface or rotation of a rotatable input mechanism) associated with a pictogram object (e.g., 1104A) is received. In response to receiving the second user input associated with the pictogram object (e.g., 1104A), a second visual aspect (1106C) of the pictogram object (e.g., 1104B) is changed. The change in the second visual aspect (e.g., 1106C) is based on the second user input (e.g., swiping upwards at the corner of a smiley face makes the smiley face appear happier). According to some embodiments, the first visual aspect (e.g., 1100B, 1102B, 1106B) and the second visual aspect (e.g., 1100C, 1104B, 1106C) are different.

[0361] According to some embodiments, at an electronic device having a touch-sensitive surface, the first user input associated with a pictogram object (e.g., 1100A) includes a touch gesture (e.g., the user dragging, swiping, or tapping on the eyes of the pictogram) at a location on the touch-sensitive surface associated with a first visual aspect (e.g., 1100B) of the pictogram object.

[0362] According to some embodiments, at an electronic device having a touch-sensitive surface configured to detect touch intensity, a first user input associated with a pictogram object includes a touch gesture with characteristic intensity (e.g., a user tap with intensity: hard press, light press, or still contact). In response to receiving the first user input and based on a determination that the characteristic intensity exceeds an intensity threshold (e.g., the touch gesture is a hard press), altering a first visual aspect of the pictogram object includes changing a first feature of the pictogram visual object (e.g., changing the size or color of the pictogram, such as changing a smiley face from yellow to red to indicate anger or unease).

[0363] According to some embodiments, in response to receiving a first user input and determining that the characteristic intensity does not exceed an intensity threshold (e.g., the touch gesture is not a hard press), changing a first visual aspect of a pictogram object includes changing a second feature of the pictogram object that is different from the first feature (e.g., changing the expression or orientation of the pictogram).

[0364] According to some embodiments, in an electronic device having a rotatable input mechanism, the first user input associated with a pictographic graphic object includes rotation of the rotatable input structure (e.g., the user rotates the rotatable input mechanism to change the shape of the eye).

[0365] According to some embodiments, in an electronic device having a touch-sensitive surface and a rotatable input mechanism, a first user input associated with a pictographic graphic object includes a touch gesture at a location on the touch-sensitive surface associated with a first visual aspect of the pictographic graphic object and rotation of the rotatable input mechanism (e.g., the user taps or taps and holds the pictographic object over its eye to identify a feature to be changed and rotates the rotatable input mechanism to cause a change in the identified feature). In some embodiments, the touch gesture and rotation are received fully or at least partially simultaneously.

[0366] According to some embodiments, transmitting a pictogram graphic object (e.g., 1106A) includes transmitting the pictogram graphic object (e.g., 1106A) in response to receiving a third user input associated with a selectable element (e.g., the third user input is a sendable element).

[0367] According to some embodiments, before transmitting the emoji graphic object (e.g., 1106A), in response to receiving a fourth user input, the emoji graphic object is added to the message body (e.g., 1104D; the fourth user input is associated with the selection option 1104D; the emoji is added to the body of a text message or email message).

[0368] According to some embodiments, the emoji graphic objects (e.g., 1100A, 1102A, 1104A, 1106A) are animated emoji graphic objects (e.g., an emoji blinking, an emoji flicking its tongue). According to some embodiments, altering a first visual aspect of an emoji graphic object includes altering the first visual aspect of the animated emoji graphic object (e.g., 1100B, 1102B, 1104B, 1106C) (e.g., an upward swipe at the corner of a smiley face makes the mouth animated as larger / happier).

[0369] Note that the above reference method 1200 ( Figure 12 The details of the process described in ) also apply in a similar manner to the methods described below. For example, method 700 ( Figure 7Method 900 Figure 9 Method 1000 Figure 10 Method 1400 Figure 14A Method 1420 Figure 14B ) and Method 1600 ( Figure 16 This may include one or more of the features of the various methods described in reference method 1200 above. For the sake of brevity, these details will not be repeated below.

[0370] It should be understood that the description Figure 12 The specific order of operations described herein is exemplary and not intended to indicate that the described order is the only possible order in which operations can be performed. Those skilled in the art will recognize the various ways in which the operations described herein can be reordered, and certain operations can be excluded. For the sake of brevity, these details are not repeated here. Additionally, it should be noted that method 700 ( Figure 7 Method 900 Figure 9 Method 1000 Figure 10 Method 1200 Figure 12 Method 1400 Figure 14A Method 1420 Figure 14B ) and Method 1600 ( Figure 16 The aspects of ) can be merged with each other. Therefore, the technology described in reference method 1200 can be combined with method 700 ( Figure 7 Method 900 Figure 9 Method 1000 Figure 10 Method 1400 Figure 14A Method 1420 Figure 14B ) and Method 1600 ( Figure 16 (Related to)

[0371] Figure 13 The illustration depicts an exemplary user interface for switching between pages according to some embodiments. In some embodiments, the electronic device is device 500. The electronic device has a display (e.g., 112, 340, 504) and a touch-sensitive surface (e.g., 112, 355, 504). The electronic device may also include a rotatable input mechanism (e.g., 506). Users may wish to quickly switch between non-contiguous pages of the device's user interface. However, switching between pages may require manipulating complex menu structures or entering the desired page number. This is time-consuming and inefficient. Therefore, providing techniques that allow users to manipulate precisely, quickly, and efficiently between pages of the user interface can be helpful. Precise, fast, and efficient techniques are now described.

[0372] At user interface 1302, the device displays a first page of the user interface (e.g., a smiley face page depicted on user interface screen 1302) and a first set of page-turning options (e.g., page-turning options 1302A and 1302B). The first set of page-turning options (e.g., 1302A-1302B) includes a first page-turning option (e.g., 1302A), which includes a focus selector (e.g., a fill page-turning point 1302A). The first page-turning option (e.g., 1302) corresponds to the first page of the user interface (e.g., page-turning point 1302 corresponds to the currently displayed smiley face page on user interface screen 1302). In this example, the user interface has four pages, as illustrated by the four page-turning points.

[0373] The device receives a user touch at a first location on a touch-sensitive surface, as illustrated in user interface screen 1302. The first location is associated with a first set of page-turning options (e.g., the touch is on top of the first set of page-turning options 1302A-1302B). In some examples, the touch exceeds a threshold duration.

[0374] In response to receiving a user touch at a first location, the device replaces the display of the first set of page turn options (e.g., 1302A-1302B) with the display of a second set of page turn options (e.g., 1304A-1304B), as illustrated in user interface screen 1304. For example, the device displays a larger set of page turn points or an enlarged version of the existing set of page turn points. The second set of page turn options (e.g., 1304A-1304B) includes a second page turn option (e.g., 1304B) corresponding to a second page of the user interface (e.g., the second page turn option 1304B does not correspond to the currently displayed smiley face page illustrated in user interface screens 1302 and 1304, but rather to a different page). In this example, page turn point 1304A is an enlarged version of page turn point 1302A, both corresponding to the first page of the user interface (e.g., the smiley face page). At user interface screen 1304, the second page turn option 1304B does not include a focus selector (e.g., no filled page turn point).

[0375] While continuing to receive user touches, the device detects movement of the user touch from a first position to a second position on the touch-sensitive surface without interruption of contact (e.g., the user moves their finger without lifting it off the touch surface), as illustrated in user interface screen 1306. The second position is associated with a second page-turning amenity (e.g., the finger is now at page-turning points 1304B, 1306B). For example, the user slides their finger over the second page-turning amenity (e.g., 1304B, 1306B), or the user slides their finger over the second page-turning amenity and lifts it off.

[0376] In response to detecting a user touch at a second location (e.g., at page-turning point 1306B), the device displays a second page of the user interface (e.g., a thumb-up page including a thumb-up emoji object 1306C). Thus, when the user places their finger on a page-turning device, the page-turning device enlarges and / or moves to a new position to allow the user to see the page-turning device more easily and to ensure that the enlarged page-turning device is not obscured by the user's touch. When the user selects a page-turning device by moving their finger to it, the page corresponding to the selected page-turning device is displayed.

[0377] According to some embodiments, the device detects a user touch at the second location being lifted from the touch-sensitive surface (e.g., the user intermittently contacts the touch-sensitive surface) (e.g., the user lifts their finger after sliding it over the second page-turning element). In response to detecting a user touch lift at the second location, the device maintains the display of the second page of the user interface. Thus, once the desired page of the user interface is displayed, the user can remove their finger from the touch-sensitive surface to continue accessing the desired page.

[0378] According to some embodiments, while receiving user touches, the characteristic intensity (e.g., maximum intensity) of the user touch at a second location on the touch-sensitive surface is detected, and a subsequent lifting of the user touch from the touch-sensitive surface is detected (e.g., the user slides their finger over the second page-turning device, or the user slides their finger over the second page-turning device and lifts their finger). Based on the determination that the characteristic intensity exceeds an intensity threshold (e.g., the user performs a hard press at the second location), the display of the second page of the user interface is maintained (e.g., if the user has submitted the page using a hard press after the user touch is lifted, the display of the second page is maintained). Therefore, the user has performed a hard press to submit a specific page.

[0379] According to some embodiments, based on a determination that the characteristic intensity does not exceed an intensity threshold (e.g., it is not a hard press), the device replaces the display of a second page of the user interface (e.g., a smiley face page) with the display of a first page of the user interface (e.g., a thumbs-up page). In this example, the device determines that the finger movement is for a preview request. Because the user did not submit the page by performing a hard press, the device replaces the second page with the originally displayed first page after the user lifts their finger from the touch-sensitive surface.

[0380] According to some embodiments, in response to detecting a user touch at a second location, the device updates the second page turn offer 1306B to include a focus selector (e.g., fill the second page turn point 1306B), as illustrated in the user interface screen 1306.

[0381] According to some embodiments, displaying a second page of the user interface includes replacing the display of the first page of the user interface with the display of the second page. Therefore, the smiley face pages of user interface screens 1302 and 1304 are replaced by thumb-up pages of user interface screens 1306 and 1308. According to some embodiments, the first page and the second page of the user interface are different.

[0382] According to some embodiments, the second set of display page-turning options includes an enlarged version of the first set of display page-turning options.

[0383] According to some embodiments, displaying a second set of page-turning options includes an animated rendering of a magnified first set of page-turning options (e.g., the display of the second set of page-turning options originates from the first set of page-turning options becoming larger). In other examples, the display of the second set of page-turning options originates from a translation of the first set of page-turning options (e.g., the first set of page-turning points moves to different positions on the display).

[0384] According to some embodiments, each page-turning option in the second set of page-turning options is associated with a corresponding page of the user interface.

[0385] In another embodiment, at user interface 1302, the device displays a first page of the user interface (e.g., the smiley face page depicted in user interface screen 1302) and a first set of page-turning options (e.g., 1302A-1302B). The first set of page-turning options includes a first page-turning option (e.g., 1302A), which includes a focus selector (e.g., filled). The first page-turning option (e.g., 1302A) corresponds to the first page of the user interface (e.g., the smiley face page illustrated in user interface screens 1302 and 1304).

[0386] The device receives a user touch at a first location on a touch-sensitive surface, the first location corresponding to a first set of page turners (e.g., the user touches and holds page turners 1302A-1302B, as illustrated in user interface screen 1302). In response to receiving a user touch at the first location, the device replaces the display of the first set of page turners (e.g., 1302A-1302B) with the display of a second set of page turners (e.g., 1304A-1304B), wherein the second set of page turners (e.g., 1304A-1304B) includes a first page turner (1304A), the first page turner includes a focus selector (e.g., filled), and the first page turner (e.g., 1304A) corresponds to a first page of the user interface (e.g., the smiley face page illustrated in user interface screens 1302 and 1304).

[0387] While continuing to receive user touches, the device detects a movement of the user touch from a first position to a second position on the touch-sensitive surface without interruption of contact with the touch-sensitive surface, wherein the second position is associated with a second page-turning option. In response to detecting a user touch at the second position, the device replaces the display of the first page (e.g., the smiley face page) with the second page (e.g., the thumb-up page) from a set of pages, and updates the second set of page-turning options (e.g., updating options 1304A-1304B to options 1306A-1306B), wherein the update includes removing the focus selector from the first page-turning options in the set (e.g., removing the filled portion of 1304A) and displaying the second page-turning option with the focus selector in the set of page-turning options (e.g., 1306B is filled).

[0388] According to some embodiments, the device detects a user touch at a second location being lifted from the touch-sensitive surface (e.g., the user intermittently contacts the touch-sensitive surface) (e.g., the user lifts their finger after swiping it over the second page-turning element). In response to detecting a user touch lift at the second location, the device maintains the display of the second page of the user interface. Thus, once the desired page of the user interface is displayed, the user can remove their finger from the touch-sensitive surface to continue accessing the desired page. This technology does not provide a preview mode.

[0389] According to some embodiments, while receiving user touches, the characteristic intensity (e.g., maximum intensity) of the user touch at a second location on the touch-sensitive surface is detected, and a subsequent lifting of the user touch from the touch-sensitive surface is detected (e.g., the user slides their finger over the second page-turning device, or the user slides their finger over the second page-turning device and lifts their finger). Based on the determination that the characteristic intensity exceeds an intensity threshold (e.g., the user performs a hard press at the second location), the display of the second page of the user interface is maintained (e.g., if the user has submitted the page using a hard press after the user touch is lifted, the display of the second page is maintained). Therefore, the user has performed a hard press to submit a specific page.

[0390] According to some embodiments, the first page and the second page of the user interface are different. According to some embodiments, the second set of page-turning options displayed includes an enlarged version of the first set of page-turning options displayed.

[0391] According to some embodiments, displaying a second set of page-turning options includes an animated rendering of a magnified first set of page-turning options (e.g., the display of the second set of page-turning options originates from the first set of page-turning options becoming larger). In other examples, the display of the second set of page-turning options originates from a translation of the first set of page-turning options (e.g., the first set of page-turning points moves to different positions on the display).

[0392] According to some embodiments, each page-turning option in the second set of page-turning options is associated with a corresponding page of the user interface.

[0393] Figures 14A to 14B This is a flowchart illustrating methods 1400 and 1420 for switching between pages according to some embodiments. In some embodiments, methods 1400 and 1420 can be performed at an electronic device having a display (e.g., 112, 340, 504) and a touch-sensitive surface (e.g., 112, 355, 504). The electronic device may also include a rotatable input mechanism (e.g., 506). In some embodiments, the touch-sensitive surface (e.g., 112, 355, 504) is capable of detecting the intensity of a touch contact. In some embodiments, methods 1400 and 1420 can be performed at an electronic device having a touch-sensitive surface (e.g., 112, 355, 504) capable of determining an alternative (proximity) force or pressure for contact on the touch-sensitive surface. Exemplary devices that can perform methods 1400 and 1420 include devices 100, 300, and 500. Figure 1A , Figure 3 and Figure 5A In method 1400, some operations can be combined, the order of some operations can be changed, and some operations can be omitted. In method 1420, some operations can be combined, the order of some operations can be changed, and some operations can be omitted.

[0394] Users may want to quickly switch between non-contiguous pages of a device's user interface. However, switching between pages may require manipulating complex menu structures or entering the desired page number. This is time-consuming and inefficient. Therefore, providing technology that allows users to navigate between pages of the user interface precisely, quickly, and efficiently with fewer gestures or keystrokes can be helpful. A precise, fast, and efficient technology will now be described.

[0395] Methods 1400 and 1420 provide intuitive approaches based on transitions between pages in the user interface. These methods reduce the cognitive burden on users when switching between pages on a device, thereby creating a more efficient human-computer interface. For battery-powered computing devices, enabling users to switch between pages faster and more efficiently saves power and increases the time between battery charging cycles.

[0396] Figure 14AThis is a flowchart illustrating a method 1400 for transitioning between various pages according to some embodiments. At block 1402, a first page of the user interface (e.g., the smiley face page of user interface screen 1302) and a first set of page-turning options (e.g., 1302A-1302B) are displayed, wherein the first set of page-turning options includes a first page-turning option (e.g., 1302A), the first page-turning option includes a focus selector, and wherein the first page-turning option (e.g., 1302) corresponds to the first page of the user interface (e.g., the currently displayed smiley face page of user interface screen 1302).

[0397] At frame 1404, a user touch is received at a first location on a touch-sensitive surface, wherein the first location is associated with a first set of page-turning available elements (e.g., as illustrated in user interface screen 1302).

[0398] At frame 1406, in response to receiving a user touch at the first position, the display of the first set of page turn options (e.g., 1302A-1302B) is replaced by the display of a second set of page turn options (e.g., 1304A-1304B; displaying a larger set of page turn points or an enlarged set of existing page turn points). The second set of page turn options (e.g., 1304A-1304B) includes a second page turn option (e.g., 1304B) corresponding to the second page of the user interface (e.g., 1304B corresponds to the thumb-up page).

[0399] At box 1408, while continuing to receive user touch, the movement of user touch from a first position to a second position on the touch-sensitive surface is detected without interruption in the contact of user touch on the touch-sensitive surface (e.g., the user does not lift their finger off the touch surface), wherein the second position is associated with a second page-turning device (e.g., the user slides their finger over the second page-turning device 1306B, or the user slides their finger over the second page-turning device 1306B and lifts their finger).

[0400] At box 1410, in response to detecting a user touch at the second location, a second page of the user interface is displayed (e.g., the thumb-up page illustrated in user interface screens 1306 and 1308).

[0401] According to some embodiments, the lifting of a user touch from the touch-sensitive surface at the second location is detected (e.g., the user intermittently contacts the touch-sensitive surface) (e.g., the user slides their finger over the second page-turning device and lifts their finger). In response to detecting the lifting of a user touch at the second location, the display of the second page of the user interface is maintained (e.g., the display of the second page is maintained after the user touch is lifted).

[0402] According to some embodiments, while receiving user touches, the characteristic intensity of the user touch at a second location on the touch-sensitive surface is detected, and a subsequent lifting of the user touch from the touch-sensitive surface is detected (e.g., the user slides a finger over the second page-turning device, or the user slides a finger over the second page-turning device and lifts the finger). Based on a determination that the characteristic intensity exceeds an intensity threshold (e.g., the user performs a hard press), the display of the second page of the user interface is maintained (e.g., if the user has submitted the page using a hard press after the user touch is lifted, the display of the second page is maintained).

[0403] According to some embodiments, based on the determination that the characteristic intensity does not exceed an intensity threshold (e.g., not a hard press), the device replaces the display of the second page of the user interface with the display of the first page of the user interface (e.g., in the case of a preview request, the second page is replaced with the originally displayed first page).

[0404] According to some embodiments, in response to detecting a user touch at a second location, the second page-turning offer is updated to include a focus selector (e.g., the second page-turning point becomes filled).

[0405] According to some embodiments, displaying a second page of the user interface includes replacing the display of the first page of the user interface with the display of the second page of the user interface.

[0406] According to some embodiments, the second set of display page-turning options includes an enlarged version of the first set of display page-turning options.

[0407] According to some embodiments, the first page of the user interface and the second page of the user interface are different.

[0408] According to some embodiments, displaying a second set of page-turning options includes an animated rendering of a magnified first set of page-turning options (e.g., the display of the second set of page-turning options originates from the first set of page-turning options becoming larger). In other examples, the display of the second set of page-turning options originates from a translation of the first set of page-turning options (e.g., the first set of page-turning points moves to different positions on the display).

[0409] According to some embodiments, each page-turning option in the second set of page-turning options is associated with a corresponding page of the user interface.

[0410] Figure 14BThis is a flowchart illustrating a method 1420 for transitioning between various pages according to some embodiments. At block 1422, a first page of the user interface (e.g., the smiley face page depicted in user interface screen 1302) and a first set of page-turning options (e.g., 1302A-1302B) are shown among a plurality of pages. The first set of page-turning options includes a first page-turning option (e.g., 1302A), which includes a focus selector (e.g., filled). The first page-turning option (e.g., 1302A) corresponds to the first page of the user interface (e.g., the smiley face page illustrated in user interface screens 1302 and 1304).

[0411] At frame 1424, a user touch is received at a first position on the touch-sensitive surface, the first position corresponding to a first set of page turners (e.g., the user touches and holds at page turners 1302A-1302B, as illustrated in user interface screen 1302).

[0412] At frame 1426, in response to receiving a user touch at the first location, the display of the first set of page turners (e.g., 1302A-1302B) is replaced by the display of a second set of page turners (e.g., 1304A-1304B), wherein the second set of page turners (e.g., 1304A-1304B) includes a first page turner (e.g., 1304A), the first page turner includes a focus selector (e.g., filled), and wherein the first page turner (e.g., 1304A) corresponds to the first page of the user interface (e.g., the smiley face page illustrated in user interface screens 1302 and 1304).

[0413] At frame 1428, while continuing to receive user touches, the movement of the user touch from a first position to a second position on the touch-sensitive surface without interruption of contact with the touch-sensitive surface is detected, wherein the second position is associated with a second page-turning device.

[0414] At box 1430, in response to detecting a user touch at the second location, boxes 1432 and 1434 are executed. At box 1432, the display of the first page (e.g., the smiley face page) is replaced with the second page (e.g., the thumbs-up page) from a set of multiple pages. At box 1434, the second set of page-turning options is updated (e.g., options 1304A-1304B to options 1306A-1306B), wherein the update includes removing the focus selector from the first page-turning options in the set (e.g., removing the filled portion of 1304A) and displaying the second page-turning option with the focus selector in the set of page-turning options (e.g., 1306B being filled).

[0415] According to some embodiments, the lifting of a user touch from the touch-sensitive surface at the second location is detected (e.g., the user intermittently contacts the touch-sensitive surface) (e.g., the user slides a finger over the second page-turning device and lifts the finger). In response to detecting the lifting of a user touch at the second location, the display of the second page of the user interface is maintained (e.g., the display of the second page is maintained after the user's touch is lifted).

[0416] According to some embodiments, while receiving user touches, the characteristic intensity of the user touch at a second location on the touch-sensitive surface is detected, and a subsequent lifting of the user touch from the touch-sensitive surface is detected (e.g., the user slides a finger over the second page-turning device, or the user slides a finger over the second page-turning device and lifts the finger). Based on a determination that the characteristic intensity exceeds an intensity threshold (e.g., the user performs a hard press), the display of the second page of the user interface is maintained (e.g., if the user has submitted the page using a hard press after the user touch is lifted, the display of the second page is maintained).

[0417] According to some embodiments, the second set of display page-turning options includes an enlarged version of the first set of display page-turning options.

[0418] According to some embodiments, the first page of the user interface and the second page of the user interface are different.

[0419] According to some embodiments, displaying a second set of page-turning options includes an animated rendering of a magnified first set of page-turning options (e.g., the display of the second set of page-turning options originates from the first set of page-turning options becoming larger). In other examples, the display of the second set of page-turning options originates from a translation of the first set of page-turning options (e.g., the first set of page-turning points moves to different positions on the display).

[0420] According to some embodiments, each page-turning option in the second set of page-turning options is associated with a corresponding page of the user interface.

[0421] Note that the above refers to methods 1400 and 1420 ( Figures 14A to 14B The details of the process described in ) also apply in a similar manner to the methods described below. For example, method 700 ( Figure 7 Method 900 Figure 9 Method 1000 Figure 10 Method 1200 Figure 12 Method 1400 Figure 14A Method 1420 Figure 14B ) and Method 1600 ( Figure 16 This may include one or more of the characteristics of the various methods described in reference methods 1400 and 1420 above. For the sake of brevity, these details will not be repeated below.

[0422] It should be understood that the description Figures 14A to 14B The specific order of operations described herein is exemplary and not intended to indicate that the described order is the only possible order in which operations can be performed. Those skilled in the art will recognize the various ways in which the operations described herein can be reordered, and certain operations can be excluded. For the sake of brevity, these details are not repeated here. Additionally, it should be noted that method 700 ( Figure 7 Method 900 Figure 9 Method 1000 Figure 10 Method 1200 Figure 12 Method 1400 Figure 14A Method 1420 Figure 14B ) and Method 1600 ( Figure 16 The aspects of ) can be merged with each other. Therefore, the techniques described with reference to methods 1400 and 1420 can be combined with method 700 ( Figure 7 Method 900 Figure 9 Method 1000 Figure 10 Method 1200 Figure 12 Method 1400 Figure 14A Method 1420 Figure 14B ) and Method 1600 ( Figure 16 (Related to)

[0423] Figures 15A to 15B The illustration shows an exemplary user interface for receiving user input using an electronic device, according to some embodiments. In some embodiments, the electronic device is device 500. In some embodiments, the electronic device has a display (e.g., 112, 134, 504), a touch-sensitive surface (e.g., 112, 355, 504), and a rotatable input mechanism (e.g., 506).

[0424] Users may want to use input methods such as... Choosing between different user interfaces in the body or reply of an SMS or email message can be time-consuming and inefficient, as switching between various user interfaces can involve manipulating complex menu structures. Therefore, providing technology that allows users to switch precisely, quickly, and efficiently between different user interfaces is helpful. This precise, fast, and efficient technology will now be described.

[0425] According to some embodiments, as illustrated in the user interface screen 1502, the device displays an add contact availability 1502A (e.g., adding a contact to a new message or an existing message) and a create message availability 1502B (e.g., adding a contact to a new message or an existing message).

[0426] The device receives first user input (e.g., (1) the user taps on the Create Message Availability 1502, or (2) the user is already in the Create Message interface and taps on the Spoken Availability). In response to receiving the first user input, the device displays a spoken user interface on the display, as illustrated in the user interface screen 1504. The spoken user interface may include a waveform 1504C (e.g., the waveform 1504 is positioned such that it appears to radiate from a physical button on the device) and an availability 1504D for starting and ending spoken mode. The user interface screen 1504 also includes an Epic Availability 1504A that, when activated, causes the display of an Epic user interface and a Suggested Response Availability 1504B that, when activated, causes the display of a Suggested Response user interface.

[0427] The device receives a second user input (e.g., the user taps on the emoji provide 1504A). In response to receiving the second user input, the device replaces the display of the spoken user interface (e.g., as illustrated in user interface screen 1504) with the display of a first emoji graphic object (e.g., the smiley face 1506A of the emoji user interface illustrated in user interface screen 1506). User interface screen 1506 also includes a suggestion response provide that causes the display of the emoji user interface when activated, and a spoken provide that causes the display of the spoken user interface when activated.

[0428] At user interface screen 1506, the device receives a first user swipe gesture input on a touch-sensitive surface at a location associated with the first emoji graphic object (e.g., a user swipe to the next emoji page; a left swipe gesture). In response to receiving the first user swipe gesture input, the device replaces the display of the first emoji graphic object (e.g., a smiley face 1506A) with the display of a second emoji graphic object (e.g., a heart 1508A), as illustrated in user interface screen 1508.

[0429] In some examples, one or more additional swipes cause additional emoji objects to be displayed before reaching the set of recently accessed emoji objects. In some examples, additional swipes cause reaching the set of recently accessed emoji objects. Specifically, the device receives a second user swipe gesture input at a touch-sensitive surface (e.g., a user swipes to reach the most recent emoji; the swipe can be on a second emoji object (heart) or a third emoji object (thumb up / thumb down)). In response to receiving the second user swipe gesture input, the device displays (e.g., by replacing the display of the second or third emoji object) the sets of recently accessed emoji objects 1512A-1512C (e.g., a list of recently accessed emojis), as illustrated in user interface screen 1512.

[0430] According to some embodiments, the set of recently accessed emoji objects 1512A-1512C includes one or more emoji objects (e.g., 1512A, 1512B, 1512C), wherein one or more emoji objects are selected based on the emoji objects recently accessed by an external electronic device (e.g., a device other than the electronic device displaying the user interface screen described above; the external electronic device may be the user's telephone) (and in some examples, a predetermined number). Therefore, the user's telephone (external electronic device) can be wirelessly linked to the electronic device. The user uses the external electronic device to send, for example... Messages that include emoticons and graphic objects, such as email messages. The electronic device receives information identifying (a predetermined number) of the most recently sent emoticons and graphic objects by an external electronic device (e.g., directly or indirectly from the external electronic device) and displays them in the most recently sent emoticon view, such as illustrated in user interface screen 1512.

[0431] According to some embodiments, the set of recently accessed emoticon graphic objects (e.g., 1512A-1512C) includes one or more visually manipulateable emoticon graphic objects (e.g., emoticons that can be manipulated to change their visual appearance), wherein one or more visually manipulateable emoticon graphic objects are selected based on a predetermined number of visually manipulateable emoticon graphic objects recently accessed by a wirelessly linked external electronic device (e.g., a user's telephone). Thus, the user's telephone (e.g., the external electronic device) can be wirelessly linked to the electronic device. The user uses the external electronic device to send, for example... Messages such as email messages include emoticons that have been visually manipulated. An electronic device (e.g., from an external electronic device) receives information identifying a predetermined number of manipulated emoticons that have been most recently sent by the external electronic device and displays them in a recent emoticon view, such as illustrated in user interface screen 1512.

[0432] According to some embodiments, the device receives third user input (e.g., a user taps on suggested response available piece 1512D). In response to receiving the third user input, the device displays a suggested response user input interface (e.g., a list of suggested responses 1514C, 1514D, and 1514E), such as... Figure 15B The user interface screen 1514 is illustrated in the diagram. The suggested response user input interface includes one or more suggested responses (e.g., 1514C-1514E). The user interface screen 1514 also includes a verbal support 1514A that displays a verbal user interface when activated, and an emoji support 1514B that displays an emoji user interface when activated.

[0433] According to some embodiments, at the user interface screen 1514, the device receives user input indicating a touch associated with a first suggested response (e.g., 1514C) among one or more suggested responses (e.g., 1514C-1514E). In response to receiving user input indicating a touch associated with the first suggested response (e.g., 1514C), the device adds the first suggested response as reply information to the electronic message. For example, after the user has selected the available item 1514C, the device may send a reply to the recipient. The reply information is transmitted to the recipient, for example (1) via direct wireless WiFi communication with a WiFi-enabled router, (2) via direct wireless cellular communication with a cellular base station, or (3) by using a companion device (such as a cellular phone or laptop computer) as an intermediary and requesting the companion device to transmit the reply information. The companion device also includes a user-accessible electronic messaging application and can be configured to access electronic messages from the user of the electronic device.

[0434] According to some embodiments, a fourth user input is received (e.g., a tap by the user on the dictation available 1514A or on user interface screens 1506, 1508, 1510, and 1512). In response to receiving the fourth user input, the dictation user interface is displayed.

[0435] According to some embodiments, the device receives user input representing speech (e.g., at a spoken user interface). In response to receiving user input representing speech, the device transcribes the user input representing speech. Transcription of speech can be accomplished in several ways, including: (1) locally, via an electronic device; (2) remotely, where the electronic device transmits (e.g., via WiFi or Bluetooth) user input representing speech to a companion device (e.g., a cellular phone or a laptop), the companion device transcribes the user input locally, and the electronic device receives the transcribed speech from the companion device; (3) remotely, where the electronic device transmits (e.g., via WiFi or Bluetooth) user input representing speech to a server (e.g., a server connected via the Internet), the server transcribes the user input, and the electronic device receives the transcribed speech from the server (e.g., via WiFi or Bluetooth); or (4) remotely, where the electronic device transmits (e.g., via WiFi or Bluetooth) user input representing speech to a companion device (e.g., a cellular phone or a laptop), the companion device transmits the user input to the server, the server transcribes the user input, the companion device receives the transcribed speech from the server, and the electronic device receives the transcribed speech from the companion device. In response to receiving user input representing speech, the device adds the transcribed speech to an electronic message (or to... (The speech was transcribed and added to the SMS or email message).

[0436] According to some embodiments, the device receives fifth user input (e.g., a user tapping on a "keyboard" available). In response to receiving the fifth user input, the device displays one or more keys on the keyboard (e.g., displays a keyboard that allows the user to input reply information to be added to the electronic message, such as reference keys). Figures 17A to 17D (As described).

[0437] According to some embodiments, at user interface screen 1508, the device receives a sixth user input associated with a second emoji graphic object (e.g., a swipe / drag on a touch-sensitive surface, or rotation of a rotatable input mechanism). In response to receiving the sixth user input associated with the second emoji graphic object (e.g., 1508A), a first visual aspect of the second emoji graphic object is altered, wherein the alteration of the first visual aspect is based on the sixth user input. For example, an upward swipe at the corner of a smiley face's mouth (making the smiley face happier) causes a change different from a downward swipe at the corner of the mouth (making the smiley face happier).

[0438] According to some embodiments, at the user interface screen 1508, the device receives a third user swipe gesture input (e.g., the device receives the third swipe gesture before receiving the second user swipe gesture; the user swipes to the next page). In response to receiving the third user swipe gesture input, the display of the second Epic text graphic object (e.g., heart 1508A) is replaced by the display of the third Epic text graphic object (e.g., thumb up 1510A).

[0439] According to some embodiments, the device transmits electronic messages to the recipient, which include response information (e.g., sending emojis, text, or spoken content as a message once the user has selected / entered a response).

[0440] According to some embodiments, the first Emoji graphic object and the second Emoji graphic object are different; and the first Emoji graphic object and the second Emoji graphic object are selected from a group including smiley faces (e.g., happy faces, sad faces, angry faces), hearts (e.g., heart, sad heart, animated beating heart) and thumbs-up signals (e.g., thumbs up or thumbs down; the user can manipulate the thumbs-up signal to switch between the two).

[0441] Figure 16 This is a flowchart illustrating a method 1600 for receiving user input using an electronic device according to some embodiments. In some embodiments, method 1600 can be performed at an electronic device having a display (e.g., 112, 340, 504) and a touch-sensitive surface (e.g., 112, 355, 504). The electronic device may also include a rotatable input mechanism (e.g., 506). In some embodiments, the touch-sensitive surface (e.g., 112, 355, 504) is capable of detecting the intensity of a touch contact. In some embodiments, method 1600 can be performed at an electronic device having a touch-sensitive surface (e.g., 112, 355, 504) capable of determining an alternative (proximity) of force or pressure for contact on the touch-sensitive surface. Exemplary devices that can perform method 1600 include devices 100, 300, and 500. Figure 1A , Figure 3 and Figure 5A Some operations in method 1600 can be combined, the order of some operations can be changed, and some operations can be omitted.

[0442] Users may want to use input methods such as... Choosing between different user interfaces in the body or reply of an SMS or email message can be time-consuming and inefficient, as switching between various user interfaces can involve manipulating complex menu structures. Therefore, providing a method that allows users to switch precisely, quickly, and efficiently between different user interfaces is helpful. A precise, fast, and efficient technology will now be described.

[0443] Method 1600 provides an intuitive way to switch between various user interfaces. This method reduces the cognitive burden on users switching between different user interfaces, thereby creating a more efficient human-computer interface. For battery-powered computing devices, it enables users to switch between user interfaces faster and more efficiently, saving power and increasing the time between battery charging sessions.

[0444] At box 1602, a first user input is received. At box 1604, in response to receiving the first user input, a spoken user interface is displayed. At box 1606, a second user input is received. At box 1608, in response to receiving the second user input, the display of the spoken user interface is replaced by the display of a first Etymotic graphic object. At box 1610, a first user swipe gesture input is received at a location on the touch-sensitive surface associated with the first Etymotic graphic object. At box 1612, in response to receiving the first user swipe gesture input, the display of the first Etymotic graphic object is replaced by the display of a second Etymotic graphic object. At box 1614, a second user swipe gesture input is received at the touch-sensitive surface. At box 1616, in response to receiving the second user swipe gesture input, a set of recently accessed Etymotic graphic objects is displayed.

[0445] According to some embodiments, the set of recently accessed emoji graphics objects includes one or more emoji graphics objects, wherein one or more emoji graphics objects are selected based on emoji graphics objects recently accessed by an external electronic device.

[0446] According to some embodiments, the set of recently accessed emoticon objects includes one or more visually manipulated emoticon objects, wherein one or more visually manipulated emoticon objects are selected based on visually manipulated emoticon objects recently accessed by a wirelessly linked external electronic device.

[0447] According to some embodiments, the device receives input from a third user. In response to receiving the third user input, the device displays a suggested response interface. The suggested response interface includes one or more suggested answers.

[0448] According to some embodiments, the device receives user input indicating a touch associated with a first suggested response in one or more suggested responses. In response to receiving user input indicating a touch associated with the first suggested response, the device adds the first suggested response as reply information to the electronic message.

[0449] According to some embodiments, the device receives a fourth user input. In response to receiving the fourth user input, the device displays a spoken user interface.

[0450] According to some embodiments, the device receives user input representing a speech. In response to receiving user input representing a speech: the device transcribes the user input representing a speech and adds the transcribed speech to the electronic message.

[0451] According to some embodiments, the device receives input from a fifth user. In response to receiving the fifth user input, the device displays one or more keys on the keyboard (such as reference keys). Figures 17A to 17D (The keyboard described).

[0452] According to some embodiments, the device receives a sixth user input associated with a second Graphic Object. In response to receiving the sixth user input associated with the second Graphic Object, the device alters a first visual aspect of the second Graphic Object, wherein the alteration of the first visual aspect is based on the sixth user input.

[0453] According to some embodiments, the device receives a swipe gesture input from a third user. In response to receiving the swipe gesture input from the third user, the device replaces the display of the second Epic text object with the display of a third Epic text object.

[0454] According to some embodiments, the device transmits electronic messages to the recipient, including reply information.

[0455] According to some embodiments, the first emoji graphic object and the second emoji graphic object are different, and the first emoji graphic object and the second emoji graphic object are selected from a group including smiley face, heart and thumbs-up signals.

[0456] Note that the above reference method 1600 ( Figure 16 The details of the process described in ) also apply in a similar manner to the methods described below. For example, method 700 ( Figure 7 Method 900 Figure 9 Method 1000 Figure 10 Method 1200 Figure 12 Method 1400 Figure 14A ) and Method 1420 ( Figure 14B This may include one or more of the features of the various methods described in reference method 1600 above. For the sake of brevity, these details will not be repeated below.

[0457] It should be understood that the description Figure 16 The specific order of operations described herein is exemplary and not intended to indicate that the described order is the only possible order in which operations can be performed. Those skilled in the art will recognize the various ways in which the operations described herein can be reordered, and certain operations can be excluded. For the sake of brevity, these details are not repeated here. Additionally, it should be noted that method 700 ( Figure 7 Method 900 Figure 9 Method 1000 Figure 10 Method 1200 Figure 12 Method 1400 Figure 14A Method 1420 Figure 14B ) and Method 1600 ( Figure 16 The aspects of ) can be merged with each other. Therefore, the technology described in reference method 1600 can be combined with method 700 ( Figure 7 Method 900 Figure 9 Method 1000 Figure 10 Method 1200 Figure 12 Method 1400 Figure 14A ) and Method 1420 ( Figure 14B (Related to)

[0458] Figures 17A to 17D The illustration shows an exemplary user interface for receiving user input using an electronic device, according to some embodiments. In some embodiments, the electronic device is device 500. In some embodiments, the electronic device has a display (e.g., 112, 340, 504), a touch-sensitive surface (e.g., 112, 355, 504), and a rotatable input mechanism (e.g., 506).

[0459] Users may want to use it for purposes such as... In SMS or email messages, text is entered using a virtual keyboard for the message body or reply. However, electronic devices with small displays do not provide sufficient area for an effective virtual QWERTY keyboard. Therefore, providing a method that allows users to input characters accurately, quickly, and efficiently using a touch-based keyboard can be helpful.

[0460] exist Figure 17A At this location, user interface screen 1702 includes an option for adding a recipient to a message and an option 1702A for adding a message body. When the user activates option 1702, user interface screen 1704 is presented to the user. User interface screen 1704 includes recently accessed user interfaces (e.g., "Yes," "No," "Maybe" options for suggesting responses to user interfaces), such as those shown in Figures 6 to 702. Figure 7 As described.

[0461] At user interface screen 1704, the keyboard access device, when activated, causes the keyboard user interface to be displayed, such as that illustrated in user interface screen 1706.

[0462] At user interface screen 1706, the keyboard user interface includes a keyboard track 1706A. Keyboard track 1706A can be, for example, a character line, as illustrated in keyboard track 1706. Character line 1706A can be letters arranged alphabetically. Option 1706B, when activated, inserts a space into the text being typed. Option 1706C, when activated, causes a second keyboard track to be displayed, replacing keyboard track 1706A. The second keyboard track can be a second character line including non-alphabetic characters, such as one or more of ".", ",", "!", "?", "@", "&", "%", "$", "#", "{", "}", and "~". The second keyboard track uses a similar user input character technique to keyboard track 1706A, as described below. Option 1706D, when activated, deletes typed characters (e.g., a backspace or delete function such as on a conventional hardware keyboard). Option 1706E, when activated, indicates to the user that they have finished typing and, for example, causes keyboard track 1706A to no longer be displayed. In some examples, the user interface includes a text insertion area 1706F with a cursor 1706G. The cursor can indicate, for example, where the entered text will be inserted.

[0463] At the user interface screen 1708, the user has placed a touch (e.g., a finger touch) on the touch-sensitive surface at the position corresponding to keyboard track 1708A. In response to the detected touch, the device displays one or more preview characters 1708B. In this example, the one or more preview characters are "LMN". The preview characters are determined based on the position of the touch on keyboard track 1708A. The preview characters can be larger than the characters on the keyboard track. This allows the keyboard track to be small, but still allows the user to read which character is being previewed through the preview characters. The position of the preview character 1708B is different from the position of the corresponding character in keyboard track 1708A. This allows the preview character 1708C to be visible when the user places a finger or other touch at the position on keyboard track 1708A.

[0464] Preview character 1708B includes the characters "L", "M", and "N". In this example, the "M" (or the middle character) is larger than the other characters, indicating that it is the focus character. The focus character indicates to the user which character will be inserted if the selection is confirmed. In this example, the "M" character is the focus character and will be added at the insertion point (e.g., at the cursor). The "L" and "N" characters are not focus characters, but they provide context to the user. The "L" and "N" characters indicate to the user which character will become the focus character if the user moves along the keyboard track without interrupting contact with the touch-sensitive surface (e.g., finger contact). Different characters can be previewed and different characters can become focus characters by wiping along the keyboard track (e.g., sliding the user's finger). When the focus character is the character the user wants to insert, the user can initiate a hard press on the touch-sensitive screen while continuing to contact the touch-sensitive surface. For example, the device displays "M" as the focus character. The device detects that the intensity of the touch exceeds an intensity threshold. In response to detecting that the intensity of a touch exceeds an intensity threshold, the device inserts a focused character at the insertion point (e.g., at the cursor position), as illustrated in user interface screen 1710.

[0465] At the user interface screen 1710, the character “M” 1710B has been inserted as a result of a hard press (e.g., exceeding the intensity threshold) performed by the user when a finger touch is detected on the character track 1710A and the character “M” is the focused character.

[0466] While maintaining continuous contact with the touch-sensitive surface, the user slides their finger to the right along keyboard track 1712A, as shown on user interface screen 1712. As the user slides (e.g., swipes) along keyboard track 1712A, preview characters 1712A are updated to reflect the position of the user's touch on keyboard track 1712A. In preview characters 1712B, the focus character is the "O" character, as indicated by the "N" or "P" characters larger than 1712B. Additionally, while maintaining continuous contact with the touch-sensitive surface, the user makes a hard press. The device detects that the touch intensity at a location on keyboard track 1712A exceeds an intensity threshold. In response to detecting that the touch intensity exceeds the intensity threshold, the device inserts the focus character at the insertion point (e.g., at the cursor position), as illustrated in user interface screen 1714.

[0467] At user interface screen 1714, the user has now entered “MO”, all without lifting their finger from the touch-sensitive surface (e.g., without interruption of contact with the touch-sensitive surface).

[0468] According to some embodiments, a user can input a space by lifting their finger. According to some embodiments, a user can input a space by lifting their finger and placing it back on the keyboard track. Thus, for example, if a user wants to input a space after “MO” displayed on the user interface screen 1714, the user intermittently contacts the touch-sensitive surface. In some embodiments, a space is inserted at the insertion point (e.g., cursor 1714) based on a determination that no longer a touch is detected (e.g., the user no longer touches the touch-sensitive surface). In some embodiments, a space is inserted at the insertion point (e.g., cursor 1714) based on a determination that no longer a contact (e.g., the contact used to insert “MO”) is detected and a second touch is detected. According to some embodiments, a space is inserted at the insertion point (e.g., cursor 1714) based on a determination that no longer a contact (e.g., the contact used to insert “MO”) is detected and a second touch is detected within a predetermined time period (e.g., the user lifts their finger and then places their finger back on the touch-sensitive display within a time period less than the predetermined time period).

[0469] User input interfaces 1716 and 1718 illustrate the insertion of spaces using the techniques described above. At user interface screen 1716, the user has not yet lifted their finger from the touch-sensitive surface. At user interface screen 1718, the device detects that the touch on the touch-sensitive surface has been interrupted. In response to detecting that the touch on the touch-sensitive surface has been interrupted, the device inserts a space character, such as the character “MO” 1720A in user interface screen 1720 (i.e., “MO”). <whitespace>As illustrated in the diagram, the space character typically does not correspond to a visual marker on the monitor. However, the cursor 1720B can be moved (such as to the right) to indicate that a space has been inserted at the insertion point.

[0470] In some examples, users can perform an upward swipe to submit the character instead of a hard press. In some examples, such as in... Figure 17D As illustrated in the user interface screen 1724, the keyboard track does not include all the characters of...

Claims

1. A method comprising: In electronic devices with displays and touch-sensitive surfaces: Displays a user interface that includes a set of one or more available components; When the user interface is displayed, user input at a location on the touch-sensitive surface is received; Determine the strength of the characteristic input by the user; Determined based on the user input indicating that the characteristic intensity exceeds an intensity threshold: Without considering the location of the user input on the touch-sensitive surface, determine whether the scenario availability is available; Based on the determination that the scenario availability is available, at least a portion of the display of the user interface is replaced with the scenario availability; and Based on the aforementioned scenario, the following can be determined: Maintain the display of the user interface without replacing the display of at least a portion of the user interface; The scenario can be abandoned; and Displaying a visual indication that the scenario is unavailable for the user interface, wherein displaying the visual indication includes: Reduce the size of the first available element in the set of one or more available elements of the user interface on the display; as well as After reducing the size of the first available component in the set of one or more available components, the size of the first available component in the set of one or more available components on the display is increased; and Determined based on the user input that the characteristic intensity does not exceed the intensity threshold: Perform an action based on the location of the user input on the touch-sensitive surface.

2. The method of claim 1, wherein displaying the visual indication comprises: The display of the set of one or more available components of the user interface is moved once or multiple times on the display.

3. The method according to any one of claims 1 to 2, wherein displaying the visual indication comprises: The display of the set of one or more available components of the user interface on the display is moved one or more times in the left-right direction.

4. The method according to any one of claims 1 to 2, wherein displaying the visual indication comprises: The first available element in the set of one or more available elements of the user interface is oscillated on the display.

5. The method according to any one of claims 1 to 2, further comprising: Determined based on the user input that the characteristic intensity does not exceed the intensity threshold: Determine whether the location of the user input corresponds to the location of an available item in the set of one or more available items; wherein, based on the determination that the user input corresponds to the location of the available item in the set of one or more available items, the action is associated with the available item in the set of one or more available items.

6. The method of claim 5, wherein performing the action associated with one or more available components in the set of available components includes launching an application associated with the available component.

7. The method of claim 5, wherein performing the action associated with one or more available elements in the set of available elements includes displaying one or more characters in a text field.

8. The method of claim 5, wherein performing the action associated with one of the available items in the set of one or more available items includes activating an action associated with a notification.

9. The method of claim 5, wherein performing the action associated with one or more available elements in the set of available elements includes displaying one or more emojis in the text domain.

10. The method of claim 5, wherein performing the action associated with one or more of the available components in the set of available components includes activating a speech input function for transcription into a text domain.

11. The method of claim 5, wherein performing the action associated with one or more available elements in the set of available elements includes activating a user interface for adding emoji to a text field.

12. The method of claim 5, wherein performing the action associated with one or more of the available components in the set of available components includes activating a user interface for transcribing speech input.

13. The method according to any one of claims 1 to 2, further comprising: When the scene is available, a second user input is received on the touch-sensitive surface; Determine the strength of the characteristic input from the second user; as well as Based on the determination that the characteristic intensity input by the second user exceeds the second intensity threshold: Stop displaying the available elements for the scenario and display a set of one or more available elements.

14. The method according to any one of claims 1 to 2, further comprising: When the scene is available, a second user input is received on the touch-sensitive surface; Determine the strength of the characteristic input from the second user; as well as Based on the determination that the characteristic intensity input by the second user does not exceed the second intensity threshold: Perform a second action based on the position of the second user input on the touch-sensitive surface.

15. The method according to any one of claims 1 to 2, further comprising: When the scene is available, a second user input is received on the touch-sensitive surface; Based on the determination that the characteristic intensity input by the second user does not exceed the second intensity threshold: Determine whether the location of the second user input corresponds to the location of the available element in the scenario; and Based on the determination of the location of the scenario available element corresponding to the second user input, a second action associated with the scenario available element is performed.

16. The method of any one of claims 1 to 2, wherein displaying the visual indication comprises animate a horizontal rocking motion of the set of one or more available elements.

17. The method according to any one of claims 1 to 2, wherein displaying the visual indication includes animate presentation of a vertical sway of the set of one or more available elements.

18. The method of claim 15, wherein the intensity threshold is the same as the second intensity threshold.

19. A computer-readable storage medium storing one or more programs, said programs comprising instructions that, when executed by one or more processors of an electronic device having a display and a touch-sensitive surface, cause the device to: Displays a user interface that includes a set of one or more available components; When the user interface is displayed, user input at a location on the touch-sensitive surface is received; Determine the strength of the characteristic input by the user; Determined based on the user input indicating that the characteristic intensity exceeds an intensity threshold: Without considering the location of the user input on the touch-sensitive surface, determine whether the scenario availability is available; Based on the determination that the scenario availability is available, at least a portion of the display of the user interface is replaced with the scenario availability; and Based on the aforementioned scenario, the following can be determined: Maintain the display of the user interface without replacing the display of at least a portion of the user interface; The scenario can be abandoned; and Displaying a visual indication that the scenario is unavailable for the user interface, wherein displaying the visual indication includes: Reduce the size of the first available element in the set of one or more available elements of the user interface on the display; as well as After reducing the size of the first available component in the set of one or more available components, the size of the first available component in the set of one or more available components on the display is increased; and Determined based on the user input that the characteristic intensity does not exceed the intensity threshold: Perform an action based on the location of the user input on the touch-sensitive surface.

20. The computer-readable storage medium of claim 19, wherein displaying the visual indication comprises: The display of the set of one or more available components of the user interface is moved once or multiple times on the display.

21. The computer-readable storage medium of claim 19 or 20, wherein displaying the visual indication comprises: The display of the set of one or more available components of the user interface on the display is moved one or more times in the left-right direction.

22. The computer-readable storage medium of claim 19 or 20, wherein displaying the visual indication comprises: The first available element in the set of one or more available elements of the user interface is oscillated on the display.

23. The computer-readable storage medium according to claim 19 or 20, further comprising: Determined based on the user input that the characteristic intensity does not exceed the intensity threshold: Determine whether the location of the user input corresponds to the location of an available item in the set of one or more available items; wherein, based on the determination that the user input corresponds to the location of the available item in the set of one or more available items, the action is associated with the available item in the set of one or more available items.

24. The computer-readable storage medium of claim 23, wherein performing the action associated with one of the plurality of available devices includes launching an application associated with the available device.

25. The computer-readable storage medium of claim 23, wherein performing the action associated with one or more of the available elements in the set of available elements comprises displaying one or more characters in a text field.

26. The computer-readable storage medium of claim 23, wherein performing the action associated with one of the available elements in the set of one or more available elements includes activating an action associated with a notification.

27. The computer-readable storage medium of claim 23, wherein performing the action associated with one or more of the available elements in the set of available elements includes displaying one or more emojis in the text domain.

28. The computer-readable storage medium of claim 24, wherein performing the action associated with one of the available elements in the set of one or more available elements includes activating a speech input function for transcription into a text domain.

29. The computer-readable storage medium of claim 23, wherein performing the action associated with one of the available elements in the set of one or more available elements includes activating a user interface for adding emoji to a text field.

30. The computer-readable storage medium of claim 23, wherein performing the action associated with one of the available elements in the set of one or more available elements includes activating a user interface for transcribing speech input.

31. The computer-readable storage medium according to claim 19 or 20, further comprising: When the scene is available, a second user input is received on the touch-sensitive surface; Determine the strength of the characteristic input from the second user; as well as Based on the determination that the characteristic intensity input by the second user exceeds the second intensity threshold: Stop displaying the available elements for the scenario and display a set of one or more available elements.

32. The computer-readable storage medium according to claim 19 or 20, further comprising: When the scene is available, a second user input is received on the touch-sensitive surface; Determine the strength of the characteristic input from the second user; as well as Based on the determination that the characteristic intensity input by the second user does not exceed the second intensity threshold: Perform a second action based on the position of the second user input on the touch-sensitive surface.

33. The computer-readable storage medium according to claim 19 or 20, further comprising: When the scene is available, a second user input is received on the touch-sensitive surface; Based on the determination that the characteristic intensity input by the second user does not exceed the second intensity threshold: Determine whether the location of the second user input corresponds to the location of the available element in the scenario; and Based on the determination of the location of the scenario available element corresponding to the second user input, a second action associated with the scenario available element is performed.

34. The computer-readable storage medium of claim 19 or 20, wherein displaying the visual indication includes an animated presentation of a horizontal rocking motion of the set of one or more available elements.

35. The computer-readable storage medium of claim 19 or 20, wherein displaying the visual indication includes an animated presentation of the vertical swaying of the set of one or more available elements.

36. The computer-readable storage medium of claim 33, wherein the strength threshold is the same as the second strength threshold.

37. An electronic device comprising: monitor; Touch-sensitive surface; One or more processors; Memory; as well as One or more programs, wherein the one or more programs are stored in the memory and configured to be executed by the one or more processors, the one or more programs including instructions for: Displays a user interface that includes a set of one or more available components; When the user interface is displayed, user input at a location on the touch-sensitive surface is received; Determine the strength of the characteristic input by the user; Determined based on the user input indicating that the characteristic intensity exceeds an intensity threshold: Without considering the location of the user input on the touch-sensitive surface, determine whether the scenario availability is available; Based on the determination that the scenario availability is available, at least a portion of the display of the user interface is replaced with the scenario availability; and Based on the aforementioned scenario, the following can be determined: Maintain the display of the user interface without replacing the display of at least a portion of the user interface; The scenario can be abandoned; and Displaying a visual indication that the scenario is unavailable for the user interface, wherein displaying the visual indication includes: Reduce the size of the first available element in the set of one or more available elements of the user interface on the display; as well as After reducing the size of the first available component in the set of one or more available components, the size of the first available component in the set of one or more available components on the display is increased; and Determined based on the user input that the characteristic intensity does not exceed the intensity threshold: Perform an action based on the location of the user input on the touch-sensitive surface.

38. The electronic device of claim 37, wherein displaying the visual indication comprises: The display of the set of one or more available components of the user interface is moved once or multiple times on the display.

39. The electronic device of claim 37 or 38, wherein displaying the visual indication comprises: The display of the set of one or more available components of the user interface on the display is moved one or more times in the left-right direction.

40. The electronic device of claim 37 or 38, wherein displaying the visual indication comprises: The first available element in the set of one or more available elements of the user interface is oscillated on the display.

41. The electronic device according to claim 37 or 38, further comprising: Determined based on the user input that the characteristic intensity does not exceed the intensity threshold: Determine whether the location of the user input corresponds to the location of an available item in the set of one or more available items; wherein, based on the determination that the user input corresponds to the location of the available item in the set of one or more available items, the action is associated with the available item in the set of one or more available items.

42. The electronic device of claim 41, wherein performing the action associated with one of the available devices in the set of one or more available devices includes launching an application associated with the available device.

43. The electronic device of claim 41, wherein performing the action associated with one of the available components in the set of one or more available components includes displaying one or more characters in a text field.

44. The electronic device of claim 41, wherein performing the action associated with one of the available devices in the set of one or more available devices includes activating an action associated with a notification.

45. The electronic device of claim 41, wherein performing the action associated with one or more of the available elements in the set of available elements includes displaying one or more emojis in the text domain.

46. ​​The electronic device of claim 41, wherein performing the action associated with one of the available devices in the set of one or more available devices includes activating a voice input function for transcription into a text domain.

47. The electronic device of claim 41, wherein performing the action associated with one of the available components in the set of one or more available components includes activating a user interface for adding emoji to a text field.

48. The electronic device of claim 41, wherein performing the action associated with one of the available devices in the set of one or more available devices includes activating a user interface for transcribing speech input.

49. The electronic device according to claim 37 or 38, further comprising: When the scene is available, a second user input is received on the touch-sensitive surface; Determine the strength of the characteristic input from the second user; as well as Based on the determination that the characteristic intensity input by the second user exceeds the second intensity threshold: Stop displaying the available elements for the scenario and display a set of one or more available elements.

50. The electronic device according to claim 37 or 38, further comprising: When the scene is available, a second user input is received on the touch-sensitive surface; Determine the strength of the characteristic input from the second user; as well as Based on the determination that the characteristic intensity input by the second user does not exceed the second intensity threshold: Perform a second action based on the position of the second user input on the touch-sensitive surface.

51. The electronic device according to claim 37 or 38, further comprising: When the scene is available, a second user input is received on the touch-sensitive surface; Based on the determination that the characteristic intensity input by the second user does not exceed the second intensity threshold: Determine whether the location of the second user input corresponds to the location of the available element in the scenario; and Based on the determination of the location of the scenario available element corresponding to the second user input, a second action associated with the scenario available element is performed.

52. The electronic device of claim 37 or 38, wherein displaying the visual indication includes an animated presentation of a horizontal rocking motion of the set of one or more available components.

53. The electronic device of claim 37 or 38, wherein displaying the visual indication comprises an animated presentation of a vertical sway of the set of one or more available components.

54. The electronic device of claim 51, wherein the intensity threshold is the same as the second intensity threshold.

Images