User interface for message
The enhanced messaging user interface in electronic devices highlights important messages, creates rich links, and indicates message replies, addressing inefficiencies in existing systems by improving user experience and data security.
Patent Information
- Application Number
- JP2025079814
- Authority / Receiving Office
- JP · JP
- Patent Type
- Applications
- Current Assignee / Owner
- Priority Date
- 2020-06-21
- Filing Date
- 2025-05-12
- Publication Date
- 2025-08-26
AI Technical Summary
Existing electronic devices struggle to efficiently present messaging conversations in a way that highlights important messages and reduces user interaction time, particularly for battery-operated devices, while ensuring compliance with privacy policies and minimizing unauthorized access to personally identifiable information.
The implementation of methods to present a messaging user interface that highlights important messages prominently, creates and presents links (rich links) to tag people, and indicates message replies, thereby enhancing user interaction and reducing redundant input, while managing personally identifiable information in compliance with privacy regulations.
This approach improves user experience by reducing interaction time and cognitive burden, conserving processor and battery power, and ensuring secure handling of personal data.
Smart Images

Figure 2025124672000001_ABST
Abstract
Description
CROSS-REFERENCE TO RELATED APPLICATIONS
[0001] This application claims priority to U.S. Provisional Patent Application No. 63 / 036,927, filed June 9, 2020, and U.S. Provisional Patent Application No. 63 / 041,994, filed June 21, 2020, the contents of which are incorporated herein by reference in their entirety for all purposes. [Technical Field]
[0002] TECHNICAL FIELD This specification relates generally to electronic devices that present messaging user interfaces and user interaction with such devices. [Background technology]
[0003] In recent years, user interaction with electronic devices has increased significantly. These devices may be devices such as computers, tablet computers, televisions, multimedia devices, mobile devices, etc. In some situations, users desire to use electronic devices to send and receive messages. Electronic devices may present messaging user interfaces to facilitate such. Summary of the Invention
[0004] Some embodiments described in this disclosure are directed to methods for presenting a representation of a messaging conversation. Some embodiments described in this disclosure are directed to methods for indicating which messages are important to a user and providing these messages in a prominent, easily accessible location within a user interface. Some embodiments described in this disclosure are directed to methods for creating and presenting links (e.g., rich links) that tag people in messaging conversations. Some embodiments described in this disclosure are directed to presenting instructions for messages that reply to other messages. Enhancing messaging interactions improves the user experience with the device and reduces user interaction time, which is especially important when the input device is battery-operated.
[0005] It is understood that use of personally identifiable information should comply with generally recognized privacy policies and practices that meet or exceed industry or government requirements for maintaining user privacy. In particular, personally identifiable information data should be managed and handled in a manner that minimizes the risk of unintended or unauthorized access or use, and the nature of permitted uses should be clearly indicated to users. [Brief explanation of the drawings]
[0006] For a better understanding of the various embodiments described, please refer to the following detailed description in conjunction with the following drawings, in which like reference numerals refer to corresponding parts throughout:
[0007] [Figure 1A] FIG. 1 is a block diagram illustrating a portable multifunction device with a touch-sensitive display according to some embodiments.
[0008] [Figure 1B] FIG. 2 is a block diagram illustrating example components for event processing, according to some embodiments.
[0009] [Figure 2] FIG. 1 illustrates a portable multifunction device with a touch screen according to some embodiments.
[0010] [Figure 3] FIG. 1 is a block diagram of an exemplary multifunction device with a display and a touch-sensitive surface in accordance with some embodiments.
[0011] [Figure 4A] 1 illustrates an exemplary user interface for a menu of applications on a portable multifunction device according to some embodiments.
[0012] [Figure 4B] 1 illustrates an exemplary user interface for a multifunction device with a touch-sensitive surface that is separate from the display, according to some embodiments.
[0013] [Figure 5A] FIG. 1 illustrates a personal electronic device according to some embodiments.
[0014] [Figure 5B] FIG. 1 is a block diagram illustrating a personal electronic device according to some embodiments.
[0015] [Figure 5C] FIG. 1 illustrates exemplary components of a personal electronic device having a touch-sensitive display and intensity sensor, according to some embodiments. [Figure 5D] FIG. 1 illustrates exemplary components of a personal electronic device having a touch-sensitive display and intensity sensor, according to some embodiments.
[0016] [Figure 5E] 1 illustrates example components and a user interface of a personal electronic device according to some embodiments. [Figure 5F] 1 illustrates example components and a user interface of a personal electronic device according to some embodiments. [Figure 5G] 1 illustrates example components and a user interface of a personal electronic device according to some embodiments. [Figure 5H] 1 illustrates example components and a user interface of a personal electronic device according to some embodiments.
[0017] [Figure 6A] 1 illustrates an example method for an electronic device to present a representation of a messaging conversation, according to some embodiments of the present disclosure. [Figure 6B] 1 illustrates an example method for an electronic device to present a representation of a messaging conversation, according to some embodiments of the present disclosure. [Figure 6C] 1 illustrates an example method for an electronic device to present a representation of a messaging conversation, according to some embodiments of the present disclosure. [Figure 6D] 1 illustrates an example method for an electronic device to present a representation of a messaging conversation, according to some embodiments of the present disclosure. [Figure 6E] 1 illustrates an example method for an electronic device to present a representation of a messaging conversation, according to some embodiments of the present disclosure. [Figure 6F] 1 illustrates an example method for an electronic device to present a representation of a messaging conversation, according to some embodiments of the present disclosure. [Figure 6G] 1 illustrates an example method for an electronic device to present a representation of a messaging conversation, according to some embodiments of the present disclosure. [Figure 6H] 1 illustrates an example method for an electronic device to present a representation of a messaging conversation, according to some embodiments of the present disclosure. [Figure 6I] 1 illustrates an example method for an electronic device to present a representation of a messaging conversation, according to some embodiments of the present disclosure. [Figure 6J]1 illustrates an example method for an electronic device to present a representation of a messaging conversation, according to some embodiments of the present disclosure. [Figure 6K] 1 illustrates an example method for an electronic device to present a representation of a messaging conversation, according to some embodiments of the present disclosure. [Figure 6L] 1 illustrates an example method for an electronic device to present a representation of a messaging conversation, according to some embodiments of the present disclosure. [Figure 6M] 1 illustrates an example method for an electronic device to present a representation of a messaging conversation, according to some embodiments of the present disclosure. [Figure 6N] 1 illustrates an example method for an electronic device to present a representation of a messaging conversation, according to some embodiments of the present disclosure. [Figure 6O] 1 illustrates an example method for an electronic device to present a representation of a messaging conversation, according to some embodiments of the present disclosure. [Figure 6P] 1 illustrates an example method for an electronic device to present a representation of a messaging conversation, according to some embodiments of the present disclosure. [Figure 6Q] 1 illustrates an example method for an electronic device to present a representation of a messaging conversation, according to some embodiments of the present disclosure. [Figure 6R] 1 illustrates an example method for an electronic device to present a representation of a messaging conversation, according to some embodiments of the present disclosure. [Figure 6S] 1 illustrates an example method for an electronic device to present a representation of a messaging conversation, according to some embodiments of the present disclosure. [Figure 6T] 1 illustrates an example method for an electronic device to present a representation of a messaging conversation, according to some embodiments of the present disclosure. [Figure 6U] 1 illustrates an example method for an electronic device to present a representation of a messaging conversation, according to some embodiments of the present disclosure. [Figure 6V] 1 illustrates an example method for an electronic device to present a representation of a messaging conversation, according to some embodiments of the present disclosure. [Figure 6W] 1 illustrates an example method for an electronic device to present a representation of a messaging conversation, according to some embodiments of the present disclosure. [Figure 6X] 1 illustrates an example method for an electronic device to present a representation of a messaging conversation, according to some embodiments of the present disclosure. [Figure 6Y] 1 illustrates an example method for an electronic device to present a representation of a messaging conversation, according to some embodiments of the present disclosure. [Figure 6Z] 1 illustrates an example method for an electronic device to present a representation of a messaging conversation, according to some embodiments of the present disclosure. [Figure 6AA] 1 illustrates an example method for an electronic device to present a representation of a messaging conversation, according to some embodiments of the present disclosure. [Figure 6BB] 1 illustrates an example method for an electronic device to present a representation of a messaging conversation, according to some embodiments of the present disclosure. [Figure 6CC] 1 illustrates an example method for an electronic device to present a representation of a messaging conversation, according to some embodiments of the present disclosure. [Figure 6DD] 1 illustrates an example method for an electronic device to present a representation of a messaging conversation, according to some embodiments of the present disclosure. [Figure 6EE] 1 illustrates an example method for an electronic device to present a representation of a messaging conversation, according to some embodiments of the present disclosure. [Figure 6FF] 1 illustrates an example method for an electronic device to present a representation of a messaging conversation, according to some embodiments of the present disclosure. [Figure 6GG] 1 illustrates an example method for an electronic device to present a representation of a messaging conversation, according to some embodiments of the present disclosure. [Figure 6HH] 1 illustrates an example method for an electronic device to present a representation of a messaging conversation, according to some embodiments of the present disclosure. [Figure 6II] 1 illustrates an example method for an electronic device to present a representation of a messaging conversation, according to some embodiments of the present disclosure. [Figure 6JJ] 1 illustrates an example method for an electronic device to present a representation of a messaging conversation, according to some embodiments of the present disclosure. [Figure 6KK] 1 illustrates an example method for an electronic device to present a representation of a messaging conversation, according to some embodiments of the present disclosure. [Figure 6LL] 1 illustrates an example method for an electronic device to present a representation of a messaging conversation, according to some embodiments of the present disclosure. [Figure 6MM] 1 illustrates an example method for an electronic device to present a representation of a messaging conversation, according to some embodiments of the present disclosure. [Figure 6NN] 1 illustrates an example method for an electronic device to present a representation of a messaging conversation, according to some embodiments of the present disclosure. [Figure 6OO] 1 illustrates an example method for an electronic device to present a representation of a messaging conversation, according to some embodiments of the present disclosure. [Figure 6PP] 1 illustrates an example method for an electronic device to present a representation of a messaging conversation, according to some embodiments of the present disclosure. [Figure 6QQ] 1 illustrates an example method for an electronic device to present a representation of a messaging conversation, according to some embodiments of the present disclosure. [Figure 6RR] 1 illustrates an example method for an electronic device to present a representation of a messaging conversation, according to some embodiments of the present disclosure. [Figure 6SS] 1 illustrates an example method for an electronic device to present a representation of a messaging conversation, according to some embodiments of the present disclosure.
[0018] [Figure 7] FIG. 1 is a flow diagram illustrating a method for presenting a representation of a messaging conversation according to an embodiment of the present disclosure.
[0019] [Figure 8A]1 illustrates an example method by which an electronic device indicates which messages are replies to other messages in a messaging conversation, according to some embodiments. [Figure 8B] 1 illustrates an example method by which an electronic device indicates which messages are replies to other messages in a messaging conversation, according to some embodiments. [Figure 8C] 1 illustrates an example method by which an electronic device indicates which messages are replies to other messages in a messaging conversation, according to some embodiments. [Figure 8D] 1 illustrates an example method by which an electronic device indicates which messages are replies to other messages in a messaging conversation, according to some embodiments. [Figure 8E] 1 illustrates an example method by which an electronic device indicates which messages are replies to other messages in a messaging conversation, according to some embodiments. [Figure 8F] 1 illustrates an example method by which an electronic device indicates which messages are replies to other messages in a messaging conversation, according to some embodiments. [Figure 8G] 1 illustrates an example method by which an electronic device indicates which messages are replies to other messages in a messaging conversation, according to some embodiments. [Figure 8H] 1 illustrates an example method by which an electronic device indicates which messages are replies to other messages in a messaging conversation, according to some embodiments. [Figure 8I] 1 illustrates an example method by which an electronic device indicates which messages are replies to other messages in a messaging conversation, according to some embodiments. [Figure 8J] 1 illustrates an example method by which an electronic device indicates which messages are replies to other messages in a messaging conversation, according to some embodiments. [Figure 8K] 1 illustrates an example method by which an electronic device indicates which messages are replies to other messages in a messaging conversation, according to some embodiments. [Figure 8L] 1 illustrates an example method by which an electronic device indicates which messages are replies to other messages in a messaging conversation, according to some embodiments. [Figure 8M] 1 illustrates an example method by which an electronic device indicates which messages are replies to other messages in a messaging conversation, according to some embodiments. [Figure 8N] 1 illustrates an example method by which an electronic device indicates which messages are replies to other messages in a messaging conversation, according to some embodiments. [Figure 8O] 1 illustrates an example method by which an electronic device indicates which messages are replies to other messages in a messaging conversation, according to some embodiments. [Figure 8P] 1 illustrates an example method by which an electronic device indicates which messages are replies to other messages in a messaging conversation, according to some embodiments. [Figure 8Q] 1 illustrates an example method by which an electronic device indicates which messages are replies to other messages in a messaging conversation, according to some embodiments. [Figure 8R] 1 illustrates an example method by which an electronic device indicates which messages are replies to other messages in a messaging conversation, according to some embodiments. [Figure 8S] 1 illustrates an example method by which an electronic device indicates which messages are replies to other messages in a messaging conversation, according to some embodiments. [Figure 8T] 1 illustrates an example method by which an electronic device indicates which messages are replies to other messages in a messaging conversation, according to some embodiments. [Figure 8U] 1 illustrates an example method by which an electronic device indicates which messages are replies to other messages in a messaging conversation, according to some embodiments. [Figure 8V]1 illustrates an example method by which an electronic device indicates which messages are replies to other messages in a messaging conversation, according to some embodiments. [Figure 8W] 1 illustrates an example method by which an electronic device indicates which messages are replies to other messages in a messaging conversation, according to some embodiments. [Figure 8X] 1 illustrates an example method by which an electronic device indicates which messages are replies to other messages in a messaging conversation, according to some embodiments. [Figure 8Y] 1 illustrates an example method by which an electronic device indicates which messages are replies to other messages in a messaging conversation, according to some embodiments. [Figure 8Z] 1 illustrates an example method by which an electronic device indicates which messages are replies to other messages in a messaging conversation, according to some embodiments. [Figure 8AA] 1 illustrates an example method by which an electronic device indicates which messages are replies to other messages in a messaging conversation, according to some embodiments.
[0020] [Figure 9] FIG. 1 is a flow diagram illustrating a method for indicating that a message replies to another message in a messaging conversation, according to some embodiments.
[0021] [Figure 10A] 1A-1C illustrate various ways in which an electronic device can create and present links (e.g., rich links) to contacts in messaging conversations (e.g., "mentions"), according to some embodiments. [Figure 10B] 1A-1C illustrate various ways in which an electronic device can create and present links (e.g., rich links) to contacts in messaging conversations (e.g., "mentions"), according to some embodiments. [Figure 10C]1A-1C illustrate various ways in which an electronic device can create and present links (e.g., rich links) to contacts in messaging conversations (e.g., "mentions"), according to some embodiments. [Figure 10D] 1A-1C illustrate various ways in which an electronic device can create and present links (e.g., rich links) to contacts in messaging conversations (e.g., "mentions"), according to some embodiments. [Figure 10E] 1A-1C illustrate various ways in which an electronic device can create and present links (e.g., rich links) to contacts in messaging conversations (e.g., "mentions"), according to some embodiments. [Figure 10F] 1A-1C illustrate various ways in which an electronic device can create and present links (e.g., rich links) to contacts in messaging conversations (e.g., "mentions"), according to some embodiments. [Figure 10G] 1A-1C illustrate various ways in which an electronic device can create and present links (e.g., rich links) to contacts in messaging conversations (e.g., "mentions"), according to some embodiments. [Figure 10H] 1A-1C illustrate various ways in which an electronic device can create and present links (e.g., rich links) to contacts in messaging conversations (e.g., "mentions"), according to some embodiments. [Figure 10I] 1A-1C illustrate various ways in which an electronic device can create and present links (e.g., rich links) to contacts in messaging conversations (e.g., "mentions"), according to some embodiments. [Figure 10J] 1A-1C illustrate various ways in which an electronic device can create and present links (e.g., rich links) to contacts in messaging conversations (e.g., "mentions"), according to some embodiments. [Figure 10K] 1A-1C illustrate various ways in which an electronic device can create and present links (e.g., rich links) to contacts in messaging conversations (e.g., "mentions"), according to some embodiments. [Figure 10L]1A-1C illustrate various ways in which an electronic device can create and present links (e.g., rich links) to contacts in messaging conversations (e.g., "mentions"), according to some embodiments. [Figure 10M] 1A-1C illustrate various ways in which an electronic device can create and present links (e.g., rich links) to contacts in messaging conversations (e.g., "mentions"), according to some embodiments. [Figure 10N] 1A-1C illustrate various ways in which an electronic device can create and present links (e.g., rich links) to contacts in messaging conversations (e.g., "mentions"), according to some embodiments. [Figure 10O] 1A-1C illustrate various ways in which an electronic device can create and present links (e.g., rich links) to contacts in messaging conversations (e.g., "mentions"), according to some embodiments. [Figure 10P] 1A-1C illustrate various ways in which an electronic device can create and present links (e.g., rich links) to contacts in messaging conversations (e.g., "mentions"), according to some embodiments. [Figure 10Q] 1A-1C illustrate various ways in which an electronic device can create and present links (e.g., rich links) to contacts in messaging conversations (e.g., "mentions"), according to some embodiments. [Figure 10R] 1A-1C illustrate various ways in which an electronic device can create and present links (e.g., rich links) to contacts in messaging conversations (e.g., "mentions"), according to some embodiments. [Figure 10S] 1A-1C illustrate various ways in which an electronic device can create and present links (e.g., rich links) to contacts in messaging conversations (e.g., "mentions"), according to some embodiments. [Figure 10T] 1A-1C illustrate various ways in which an electronic device can create and present links (e.g., rich links) to contacts in messaging conversations (e.g., "mentions"), according to some embodiments. [Figure 10U]1A-1C illustrate various ways in which an electronic device can create and present links (e.g., rich links) to contacts in messaging conversations (e.g., "mentions"), according to some embodiments. [Figure 10V] 1A-1C illustrate various ways in which an electronic device can create and present links (e.g., rich links) to contacts in messaging conversations (e.g., "mentions"), according to some embodiments. [Figure 10W] 1A-1C illustrate various ways in which an electronic device can create and present links (e.g., rich links) to contacts in messaging conversations (e.g., "mentions"), according to some embodiments. [Figure 10X] 1A-1C illustrate various ways in which an electronic device can create and present links (e.g., rich links) to contacts in messaging conversations (e.g., "mentions"), according to some embodiments. [Figure 10Y] 1A-1C illustrate various ways in which an electronic device can create and present links (e.g., rich links) to contacts in messaging conversations (e.g., "mentions"), according to some embodiments. [Figure 10Z] 1A-1C illustrate various ways in which an electronic device can create and present links (e.g., rich links) to contacts in messaging conversations (e.g., "mentions"), according to some embodiments. [Figure 10AA] 1A-1C illustrate various ways in which an electronic device can create and present links (e.g., rich links) to contacts in messaging conversations (e.g., "mentions"), according to some embodiments. [Figure 10BB] 1A-1C illustrate various ways in which an electronic device can create and present links (e.g., rich links) to contacts in messaging conversations (e.g., "mentions"), according to some embodiments. [Figure 10CC] 1A-1C illustrate various ways in which an electronic device can create and present links (e.g., rich links) to contacts in messaging conversations (e.g., "mentions"), according to some embodiments. [Figure 10DD]1A-1C illustrate various ways in which an electronic device can create and present links (e.g., rich links) to contacts in messaging conversations (e.g., "mentions"), according to some embodiments. [Figure 10EE] 1A-1C illustrate various ways in which an electronic device can create and present links (e.g., rich links) to contacts in messaging conversations (e.g., "mentions"), according to some embodiments. [Figure 10FF] 1A-1C illustrate various ways in which an electronic device can create and present links (e.g., rich links) to contacts in messaging conversations (e.g., "mentions"), according to some embodiments. [Figure 10GG] 1A-1C illustrate various ways in which an electronic device can create and present links (e.g., rich links) to contacts in messaging conversations (e.g., "mentions"), according to some embodiments. [Figure 10HH] 1A-1C illustrate various ways in which an electronic device can create and present links (e.g., rich links) to contacts in messaging conversations (e.g., "mentions"), according to some embodiments. [Figure 10II] 1A-1C illustrate various ways in which an electronic device can create and present links (e.g., rich links) to contacts in messaging conversations (e.g., "mentions"), according to some embodiments. [Figure 10JJ] 1A-1C illustrate various ways in which an electronic device can create and present links (e.g., rich links) to contacts in messaging conversations (e.g., "mentions"), according to some embodiments. [Figure 10KK] 1A-1C illustrate various ways in which an electronic device can create and present links (e.g., rich links) to contacts in messaging conversations (e.g., "mentions"), according to some embodiments. [Figure 10LL] 1A-1C illustrate various ways in which an electronic device can create and present links (e.g., rich links) to contacts in messaging conversations (e.g., "mentions"), according to some embodiments. [Figure 10MM]1A-1C illustrate various ways in which an electronic device can create and present links (e.g., rich links) to contacts in messaging conversations (e.g., "mentions"), according to some embodiments. [Figure 10NN] 1A-1C illustrate various ways in which an electronic device can create and present links (e.g., rich links) to contacts in messaging conversations (e.g., "mentions"), according to some embodiments. [Figure 10OO] 1A-1C illustrate various ways in which an electronic device can create and present links (e.g., rich links) to contacts in messaging conversations (e.g., "mentions"), according to some embodiments. [Figure 10PP] 1A-1C illustrate various ways in which an electronic device can create and present links (e.g., rich links) to contacts in messaging conversations (e.g., "mentions"), according to some embodiments. [Figure 10QQ] 1A-1C illustrate various ways in which an electronic device can create and present links (e.g., rich links) to contacts in messaging conversations (e.g., "mentions"), according to some embodiments. [Figure 10RR] 1A-1C illustrate various ways in which an electronic device can create and present links (e.g., rich links) to contacts in messaging conversations (e.g., "mentions"), according to some embodiments. [Figure 10SS] 1A-1C illustrate various ways in which an electronic device can create and present links (e.g., rich links) to contacts in messaging conversations (e.g., "mentions"), according to some embodiments. [Figure 10TT] 1A-1C illustrate various ways in which an electronic device can create and present links (e.g., rich links) to contacts in messaging conversations (e.g., "mentions"), according to some embodiments. [Figure 10UU] 1A-1C illustrate various ways in which an electronic device can create and present links (e.g., rich links) to contacts in messaging conversations (e.g., "mentions"), according to some embodiments. [Figure 10VV]1A-1C illustrate various ways in which an electronic device can create and present links (e.g., rich links) to contacts in messaging conversations (e.g., "mentions"), according to some embodiments. [Figure 10WW] 1A-1C illustrate various ways in which an electronic device can create and present links (e.g., rich links) to contacts in messaging conversations (e.g., "mentions"), according to some embodiments. [Figure 10XX] 1A-1C illustrate various ways in which an electronic device can create and present links (e.g., rich links) to contacts in messaging conversations (e.g., "mentions"), according to some embodiments. [Figure 10YY] 1A-1C illustrate various ways in which an electronic device can create and present links (e.g., rich links) to contacts in messaging conversations (e.g., "mentions"), according to some embodiments. [Figure 10ZZ] 1A-1C illustrate various ways in which an electronic device can create and present links (e.g., rich links) to contacts in messaging conversations (e.g., "mentions"), according to some embodiments. [Figure 10AAA] 1A-1C illustrate various ways in which an electronic device can create and present links (e.g., rich links) to contacts in messaging conversations (e.g., "mentions"), according to some embodiments. [Figure 10BBB] 1A-1C illustrate various ways in which an electronic device can create and present links (e.g., rich links) to contacts in messaging conversations (e.g., "mentions"), according to some embodiments. [Figure 10CCC] 1A-1C illustrate various ways in which an electronic device can create and present links (e.g., rich links) to contacts in messaging conversations (e.g., "mentions"), according to some embodiments. [Figure 10DDD] 1A-1C illustrate various ways in which an electronic device can create and present links (e.g., rich links) to contacts in messaging conversations (e.g., "mentions"), according to some embodiments. [Figure 10EEE]1A-1C illustrate various ways in which an electronic device can create and present links (e.g., rich links) to contacts in messaging conversations (e.g., "mentions"), according to some embodiments. [Figure 10FFF] 1A-1C illustrate various ways in which an electronic device can create and present links (e.g., rich links) to contacts in messaging conversations (e.g., "mentions"), according to some embodiments. [Figure 10GGG] 1A-1C illustrate various ways in which an electronic device can create and present links (e.g., rich links) to contacts in messaging conversations (e.g., "mentions"), according to some embodiments. [Figure 10HHH] 1A-1C illustrate various ways in which an electronic device can create and present links (e.g., rich links) to contacts in messaging conversations (e.g., "mentions"), according to some embodiments. [Figure 10III] 1A-1C illustrate various ways in which an electronic device can create and present links (e.g., rich links) to contacts in messaging conversations (e.g., "mentions"), according to some embodiments. [Figure 10JJJ] 1A-1C illustrate various ways in which an electronic device can create and present links (e.g., rich links) to contacts in messaging conversations (e.g., "mentions"), according to some embodiments. [Figure 10KKK] 1A-1C illustrate various ways in which an electronic device can create and present links (e.g., rich links) to contacts in messaging conversations (e.g., "mentions"), according to some embodiments. [Figure 10LLL] 1A-1C illustrate various ways in which an electronic device can create and present links (e.g., rich links) to contacts in messaging conversations (e.g., "mentions"), according to some embodiments. [Figure 10MMM] 1A-1C illustrate various ways in which an electronic device can create and present links (e.g., rich links) to contacts in messaging conversations (e.g., "mentions"), according to some embodiments. [Figure 10NNN]1A-1C illustrate various ways in which an electronic device can create and present links (e.g., rich links) to contacts in messaging conversations (e.g., "mentions"), according to some embodiments. [Figure 10OOO] 1A-1C illustrate various ways in which an electronic device can create and present links (e.g., rich links) to contacts in messaging conversations (e.g., "mentions"), according to some embodiments. [Figure 10PPP] 1A-1C illustrate various ways in which an electronic device can create and present links (e.g., rich links) to contacts in messaging conversations (e.g., "mentions"), according to some embodiments. [Figure 10QQQ] 1A-1C illustrate various ways in which an electronic device can create and present links (e.g., rich links) to contacts in messaging conversations (e.g., "mentions"), according to some embodiments. [Figure 10RRR] 1A-1C illustrate various ways in which an electronic device can create and present links (e.g., rich links) to contacts in messaging conversations (e.g., "mentions"), according to some embodiments. [Figure 10SSS] 1A-1C illustrate various ways in which an electronic device can create and present links (e.g., rich links) to contacts in messaging conversations (e.g., "mentions"), according to some embodiments. [Figure 10TTT] 1A-1C illustrate various ways in which an electronic device can create and present links (e.g., rich links) to contacts in messaging conversations (e.g., "mentions"), according to some embodiments.
[0022] [Figure 11A] 1 is a flow diagram illustrating a method for creating and presenting links (e.g., rich links) to contacts within a messaging conversation (e.g., a "mention"), according to some embodiments. [Figure 11B] 1 is a flow diagram illustrating a method for creating and presenting links (e.g., rich links) to contacts within a messaging conversation (e.g., a "mention"), according to some embodiments.
[0023] [Figure 12A] 10A-10C illustrate various ways in which an electronic device may present an indication of a message replying to another message, according to some embodiments. [Figure 12B] 10A-10C illustrate various ways in which an electronic device may present an indication of a message replying to another message, according to some embodiments. [Figure 12C] 10A-10C illustrate various ways in which an electronic device may present an indication of a message replying to another message, according to some embodiments. [Figure 12D] 10A-10C illustrate various ways in which an electronic device may present an indication of a message replying to another message, according to some embodiments. [Figure 12E] 10A-10C illustrate various ways in which an electronic device may present an indication of a message replying to another message, according to some embodiments. [Figure 12F] 10A-10C illustrate various ways in which an electronic device may present an indication of a message replying to another message, according to some embodiments. [Figure 12G] 10A-10C illustrate various ways in which an electronic device may present an indication of a message replying to another message, according to some embodiments. [Figure 12H] 10A-10C illustrate various ways in which an electronic device may present an indication of a message replying to another message, according to some embodiments. [Figure 12I] 10A-10C illustrate various ways in which an electronic device may present an indication of a message replying to another message, according to some embodiments. [Figure 12J] 10A-10C illustrate various ways in which an electronic device may present an indication of a message replying to another message, according to some embodiments. [Figure 12K] 10A-10C illustrate various ways in which an electronic device may present an indication of a message replying to another message, according to some embodiments. [Figure 12L]10A-10C illustrate various ways in which an electronic device may present an indication of a message replying to another message, according to some embodiments. [Figure 12M] 10A-10C illustrate various ways in which an electronic device may present an indication of a message replying to another message, according to some embodiments. [Figure 12N] 10A-10C illustrate various ways in which an electronic device may present an indication of a message replying to another message, according to some embodiments. [Figure 12O] 10A-10C illustrate various ways in which an electronic device may present an indication of a message replying to another message, according to some embodiments. [Figure 12P] 10A-10C illustrate various ways in which an electronic device may present an indication of a message replying to another message, according to some embodiments. [Figure 12Q] 10A-10C illustrate various ways in which an electronic device may present an indication of a message replying to another message, according to some embodiments. [Figure 12R] 10A-10C illustrate various ways in which an electronic device may present an indication of a message replying to another message, according to some embodiments. [Figure 12S] 10A-10C illustrate various ways in which an electronic device may present an indication of a message replying to another message, according to some embodiments. [Figure 12T] 10A-10C illustrate various ways in which an electronic device may present an indication of a message replying to another message, according to some embodiments. [Figure 12U] 10A-10C illustrate various ways in which an electronic device may present an indication of a message replying to another message, according to some embodiments. [Figure 12V] 10A-10C illustrate various ways in which an electronic device may present an indication of a message replying to another message, according to some embodiments. [Figure 12W] 10A-10C illustrate various ways in which an electronic device may present an indication of a message replying to another message, according to some embodiments. [Figure 12X]10A-10C illustrate various ways in which an electronic device may present an indication of a message replying to another message, according to some embodiments. [Figure 12Y] 10A-10C illustrate various ways in which an electronic device may present an indication of a message replying to another message, according to some embodiments.
[0024] [Figure 13] FIG. 1 is a flow diagram illustrating a method for presenting instructions for a message replying to another message, according to some embodiments.
[0025] [Figure 14A] 1 illustrates various ways in which an electronic device may present options for creating links (e.g., "rich links") to contacts in a messaging conversation (e.g., "mentions") using suggested input user interface elements, according to some embodiments. [Figure 14B] 1 illustrates various ways in which an electronic device may present options for creating links (e.g., "rich links") to contacts in a messaging conversation (e.g., "mentions") using suggested input user interface elements, according to some embodiments. [Figure 14C] 1 illustrates various ways in which an electronic device may present options for creating links (e.g., "rich links") to contacts in a messaging conversation (e.g., "mentions") using suggested input user interface elements, according to some embodiments. [Figure 14D] 1 illustrates various ways in which an electronic device may present options for creating links (e.g., "rich links") to contacts in a messaging conversation (e.g., "mentions") using suggested input user interface elements, according to some embodiments. [Figure 14E]1 illustrates various ways in which an electronic device may present options for creating links (e.g., "rich links") to contacts in a messaging conversation (e.g., "mentions") using suggested input user interface elements, according to some embodiments. [Figure 14F] 1 illustrates various ways in which an electronic device may present options for creating links (e.g., "rich links") to contacts in a messaging conversation (e.g., "mentions") using suggested input user interface elements, according to some embodiments. [Figure 14G] 1 illustrates various ways in which an electronic device may present options for creating links (e.g., "rich links") to contacts in a messaging conversation (e.g., "mentions") using suggested input user interface elements, according to some embodiments. [Figure 14H] 1 illustrates various ways in which an electronic device may present options for creating links (e.g., "rich links") to contacts in a messaging conversation (e.g., "mentions") using suggested input user interface elements, according to some embodiments. [Figure 14I] 1 illustrates various ways in which an electronic device may present options for creating links (e.g., "rich links") to contacts in a messaging conversation (e.g., "mentions") using suggested input user interface elements, according to some embodiments. [Figure 14J] 1 illustrates various ways in which an electronic device may present options for creating links (e.g., "rich links") to contacts in a messaging conversation (e.g., "mentions") using suggested input user interface elements, according to some embodiments. [Figure 14K] 1 illustrates various ways in which an electronic device may present options for creating links (e.g., "rich links") to contacts in a messaging conversation (e.g., "mentions") using suggested input user interface elements, according to some embodiments.
[0026] [Figure 15] 10 is a flow diagram illustrating a method for presenting an option to create a link (e.g., a rich link) to a contact in a messaging conversation (e.g., a "mention") using a suggested input user interface element. DETAILED DESCRIPTION OF THE INVENTION
[0027] Description of the embodiment The following description describes example methods, parameters, etc. However, it should be recognized that such description is not intended as a limitation on the scope of the present disclosure, but is instead provided as a description of example embodiments.
[0028] In some implementations, the exemplary electronic device presents a messaging user interface. In some implementations, the messaging user interface allows a user to organize representations of messaging conversations in a customized way. In some implementations, the messaging user interface allows a user an easy way to view replies to messages in a messaging conversation. In some implementations, the messaging user interface allows a user to create and view links (e.g., rich links) that tag people in a conversation. Such techniques can reduce the cognitive burden on a user using the exemplary electronic device. Furthermore, these techniques can reduce processor and battery power that would otherwise be wasted on redundant user input.
[0029] In the following description, terms such as "first" and "second" are used to describe various elements, but these elements should not be limited by these terms. These terms are used only to distinguish one element from another. For example, a first touch can be referred to as a second touch, and similarly, a second touch can be referred to as a first touch, without departing from the scope of the various embodiments described. Although a first touch and a second touch are both touches, they are not the same touch.
[0030] The terminology used in the description of the various embodiments set forth herein is for the purpose of describing particular embodiments only and is not intended to be limiting. In the description of the various embodiments set forth and in the appended claims, the singular forms "a," "an," and "the" are intended to include the plural forms as well, unless the context clearly dictates otherwise. Also, as used herein, the term "and / or" should be understood to refer to and include any and all possible combinations of one or more of the associated listed items. It will be further understood that the terms "includes," "including," "comprises," and / or "comprising," as used herein, specify the presence of stated features, integers, steps, operations, elements, and / or components, but do not exclude the presence or addition of one or more other features, integers, steps, operations, elements, components, and / or groups thereof.
[0031] The term "if" is interpreted, optionally, depending on the context, to mean "when" or "upon," or "in response to determining" or "in response to detecting." Similarly, the phrases "if it is determined" or "if [a stated condition or event] is detected" are interpreted, optionally, depending on the context, to mean "upon determining" or "in response to determining," or "upon detecting [the stated condition or event]" or "in response to detecting [the stated condition or event]."
[0032] Embodiments of electronic devices, user interfaces for such devices, and associated processes for using such devices are described. In some embodiments, the device is a portable communication device, such as a mobile phone, that also includes other functions, such as PDA and / or music player functions. Exemplary embodiments of portable multifunction devices include, but are not limited to, the iPhone®, iPod Touch®, and iPad® devices from Apple Inc. of Cupertino, California. Optionally, other portable electronic devices, such as a laptop or tablet computer having a touch-sensitive surface (e.g., a touchscreen display and / or a touchpad), are also used. It should also be understood that in some embodiments, the device is not a portable communication device, but rather a desktop computer having a touch-sensitive surface (e.g., a touchscreen display and / or a touchpad). In some embodiments, the electronic device is a computer system that communicates (e.g., via wireless communication, via wired communication) with a display generation component. The display generation component is configured to provide a visual output, such as a display via a CRT display, a display via an LED display, or a display via image projection. In some embodiments, the display generation component is integrated with the computer system. In some embodiments, the display generation component is separate from the computer system. As used herein, "displaying" content includes displaying content (e.g., video data rendered or decoded by display controller 156) by transmitting data (e.g., image data or video data) via a wired or wireless connection to an integrated or external display generation component to visually generate the content.
[0033] In the following discussion, electronic devices are described that include a display and a touch-sensitive surface. However, it should be understood that the electronic device optionally includes one or more other physical user-interface devices, such as a physical keyboard, a mouse, and / or a joystick.
[0034] The device typically supports a variety of applications such as one or more of a drawing application, a presentation application, a word processing application, a website creation application, a disc authoring application, a spreadsheet application, a gaming application, a telephone application, a video conferencing application, an email application, an instant messaging application, a training support application, a photo management application, a digital camera application, a digital video camera application, a web browsing application, a digital music player application, and / or a digital video player application.
[0035] Various applications running on the device optionally use at least one common physical user-interface device, such as a touch-sensitive surface. One or more features of the touch-sensitive surface and corresponding information displayed on the device are optionally adjusted and / or changed for each application and / or within each application. In this way, the common physical architecture of the device (such as the touch-sensitive surface) optionally supports various applications with user interfaces that are intuitive and transparent to the user.
[0036] Attention now turns to embodiments of portable devices with touch-sensitive displays. FIG. 1A is a block diagram illustrating portable multifunction device 100 having touch-sensitive display system 112 according to some embodiments. Touch-sensitive display 112 may conveniently be referred to as a "touch screen" and may also be known or referred to as a "touch-sensitive display system." Device 100 includes memory 102 (optionally including one or more computer-readable storage media), memory controller 122, one or more processing units (CPUs) 120, peripherals interface 118, RF circuitry 108, audio circuitry 110, speaker 111, microphone 113, input / output (I / O) subsystem 106, other input control devices 116, and external port 124. Device 100 optionally includes one or more optical sensors 164. Device 100 optionally includes one or more contact intensity sensors 165 that detect the intensity of a contact on device 100 (e.g., a touch-sensitive surface such as touch-sensitive display system 112 of device 100). Device 100 optionally includes one or more tactile output generators 167 that generate tactile output on device 100 (e.g., generate tactile output on a touch-sensitive surface such as touch-sensitive display system 112 of device 100 or touchpad 355 of device 300). These components optionally communicate via one or more communication buses or signal lines 103.
[0037] As used herein and in the claims, the term “intensity” of a contact on a touch-sensitive surface refers to the force or pressure (force per unit area) of a contact (e.g., a finger contact) on the touch-sensitive surface, or a proxy for the force or pressure of a contact on the touch-sensitive surface. The intensity of a contact has a range of values that includes at least four distinct values and more typically includes hundreds (e.g., at least 256) distinct values. The intensity of a contact is optionally determined (or measured) using various techniques and various sensors or combinations of sensors. For example, one or more force sensors under or adjacent to the touch-sensitive surface are optionally used to measure force at various points on the touch-sensitive surface. In some implementations, force measurements from multiple force sensors are combined (e.g., weighted average) to determine an estimated force of the contact. Similarly, a pressure-sensitive tip of a stylus is optionally used to determine the pressure of the stylus on the touch-sensitive surface. Alternatively, the size and / or change in the contact area detected on the touch-sensitive surface, the capacitance and / or change in the capacitance of the touch-sensitive surface proximate the contact, and / or the resistance and / or change in the capacitance of the touch-sensitive surface proximate the contact are optionally used as a surrogate for the force or pressure of the contact on the touch-sensitive surface. In some implementations, the surrogate measurement for the force or pressure of the contact is used directly to determine whether an intensity threshold has been exceeded (e.g., the intensity threshold is stated in units corresponding to the surrogate measurement). In some implementations, the surrogate measurement for the contact force or pressure is converted to an estimated force or pressure, and the estimated force or pressure is used to determine whether an intensity threshold has been exceeded (e.g., the intensity threshold is a pressure threshold measured in units of pressure). Using contact intensity as an attribute of user input allows a user to access additional device functionality that may not otherwise be accessible by a user on devices of reduced size that have limited area for displaying affordances (e.g., on a touch-sensitive display) and / or receiving user input (e.g., via a touch-sensitive display, touch-sensitive surface, or physical / mechanical controls such as knobs or buttons).
[0038] As used herein and in the claims, the term “tactile output” refers to a physical displacement of a device relative to its previous position, a physical displacement of a component of the device (e.g., a touch-sensitive surface) relative to another component of the device (e.g., a housing), or a displacement of a component relative to the center of mass of the device, that will be detected by a user with the user's sense of touch. For example, in a situation where a device or a component of a device is in contact with a touch-sensitive surface of a user (e.g., the fingers, palm, or other part of the user's hand), the tactile output produced by the physical displacement will be interpreted by the user as a tactile sensation corresponding to a perceived change in a physical property of the device or a component of the device. For example, movement of a touch-sensitive surface (e.g., a touch-sensitive display or trackpad) is optionally interpreted by the user as a “downclick” or “upclick” of a physical actuator button. In some cases, a user feels a tactile sensation such as a “downclick” or “upclick” even when there is no movement of a physical actuator button associated with the touch-sensitive surface that is physically pressed (e.g., displaced) by the user's action. As another example, movement of a touch-sensitive surface is optionally interpreted or perceived by a user as "roughness" of the touch-sensitive surface, even when there is no change in the smoothness of the touch-sensitive surface. While such user interpretation of touch depends on the user's personal sensory perception, there are many sensory perceptions of touch that are common to the majority of users. Thus, when a tactile output is described as corresponding to a particular sensory perception of a user (e.g., "upclick," "downclick," "roughness"), unless otherwise specified, the generated tactile output corresponds to a physical displacement of the device, or a component of the device, that produces the described sensory perception for a typical (or average) user.
[0039] It should be understood that device 100 is only one example of a portable multifunction device, and that device 100 optionally has more or fewer components than those shown, optionally combines two or more components, or optionally has a different configuration or arrangement of its components. The various components shown in Figure 1A are implemented in hardware, software, or a combination of both hardware and software, including one or more signal processing circuits and / or application specific integrated circuits.
[0040] Memory 102 optionally includes high-speed random access memory, and optionally includes non-volatile memory, such as one or more magnetic disk storage devices, flash memory devices, or other non-volatile solid-state memory devices. Memory controller 122 optionally controls access to memory 102 by other components of device 100.
[0041] Peripheral interface 118 may be used to couple input and output peripherals of the device to CPU 120 and memory 102. One or more processors 120 operate or execute various software programs and / or instruction sets stored in memory 102 to perform various functions and process data for device 100. In some embodiments, peripheral interface 118, CPU 120, and memory controller 122 are optionally implemented on a single chip, such as chip 104. In some other embodiments, they are optionally implemented on separate chips.
[0042] RF (radio frequency) circuitry 108 transmits and receives RF signals, also called electromagnetic signals. RF circuitry 108 converts electrical signals to or from electromagnetic signals and communicates with communication networks and other communication devices via electromagnetic signals. RF circuitry 108 optionally includes well-known circuitry for performing these functions, including, but not limited to, an antenna system, an RF transceiver, one or more amplifiers, a tuner, one or more oscillators, a digital signal processor, a CODEC chipset, a subscriber identity module (SIM) card, memory, etc. RF circuitry 108 optionally communicates wirelessly with networks, such as the Internet, also known as the World Wide Web (WWW), an intranet, and / or wireless networks, such as cellular telephone networks, wireless local area networks (LANs) and / or metropolitan area networks (MANs), and with other devices. RF circuitry 108 optionally includes well-known circuitry for detecting near field communication (NFC) fields, such as by short-range radios. Wireless communication optionally includes, but is not limited to, Global System for Mobile Communications (GSM), Enhanced Data GSM Environment (EDGE), high-speed downlink packet access (HSDPA), high-speed uplink packet access (HSUPA), Evolution, Data-Only (EV-DO), HSPA, HSPA+, Dual-Cell HSPA (DC-HSPA), Long Term Evolution (LTE), and other technologies.Wireless technology includes, but is not limited to, technology such as: LTE evolution (LTE), near field communications (NFC), wideband code division multiple access (W-CDMA), code division multiple access (CDMA), time division multiple access (TDMA), Bluetooth®, Bluetooth Low Energy (BTLE®), Wireless Fidelity (Wi-Fi®) (e.g., IEEE 802.11a, IEEE 802.11b, IEEE 802.11g, IEEE 802.11n, and / or IEEE 802.11ac), voice over Internet Protocol (VoIP), Wi-MAX®, protocols for email (e.g., Internet message access protocol (IMAP) and / or post office protocol (POP)), instant messaging (e.g., extensible messaging and presence protocol), and the like. The present invention may use any of a number of communication standards, protocols, and technologies, including the Session Initiation Protocol for Instant Messaging and Presence Leveraging Extensions (XMPP), the Session Initiation Protocol for Instant Messaging and Presence Leveraging Extensions (SIMPLE), the Instant Messaging and Presence Service (IMPS), and / or the Short Message Service (SMS), or any other suitable communication protocol, including communication protocols not yet developed as of the filing date of this application.
[0043] Audio circuit 110, speaker 111, and microphone 113 provide an audio interface between a user and device 100. Audio circuit 110 receives audio data from peripherals interface 118, converts the audio data into electrical signals, and transmits the electrical signals to speaker 111. Speaker 111 converts the electrical signals into sound waves audible to humans. Audio circuit 110 also receives electrical signals converted from sound waves by microphone 113. Audio circuit 110 converts the electrical signals into audio data and transmits the audio data to peripherals interface 118 for processing. The audio data is optionally retrieved from and / or transmitted to memory 102 and / or RF circuit 108 by peripherals interface 118. In some embodiments, audio circuit 110 also includes a headset jack (e.g., 212 in FIG. 2 ). The headset jack provides an interface between audio circuitry 110 and a detachable audio input / output peripheral, such as an output-only headphone or a headset with both an output (e.g., mono or binaural headphones) and an input (e.g., a microphone).
[0044] I / O subsystem 106 couples input / output peripherals on device 100, such as touchscreen 112 and other input control devices 116, to peripheral interface 118. I / O subsystem 106 optionally includes display controller 156, light sensor controller 158, intensity sensor controller 159, haptic feedback controller 161, and one or more input controllers 160 for other input or control devices. One or more input controllers 160 receive / send electrical signals from / to other input control devices 116. Other input control devices 116 optionally include physical buttons (e.g., push buttons, rocker buttons, etc.), dials, slider switches, joysticks, click wheels, etc. In some embodiments, input controller(s) 160 are optionally coupled to any (or none) of a keyboard, an infrared port, a USB port, and a pointer device such as a mouse. The one or more buttons (e.g., 208 in FIG. 2 ) optionally include up and down buttons for volume control of speaker 111 and / or microphone 113. The one or more buttons optionally include a push button (e.g., 206 in FIG. 2 ). In some embodiments, the electronic device is a computer system in communication (e.g., via wireless communication, via wired communication) with one or more input devices. In some embodiments, the one or more input devices include a touch-sensitive surface (e.g., a trackpad as part of a touch-sensitive display). In some embodiments, the one or more input devices include one or more camera sensors (e.g., one or more optical sensors 164 and / or one or more depth camera sensors 175), such as for tracking user gestures (e.g., hand gestures) as input. In some embodiments, the one or more input devices are integrated with the computer system. In some embodiments, the one or more input devices are separate from the computer system.
[0045] As described in U.S. Patent Application No. 11 / 322,549, filed December 23, 2005, "Unlocking a Device by Performing Gestures on an Unlock Image," U.S. Patent No. 7,657,849, which is incorporated herein by reference in its entirety, a quick press of the push button optionally disengages a lock on the touchscreen 112 or, optionally, initiates a process to unlock the device using a gesture on the touchscreen. A longer press of a push button (e.g., 206) optionally turns power on or off to the device 100. The functionality of one or more of the buttons is optionally customizable by the user. The touchscreen 112 is used to implement virtual or soft buttons and one or more soft keyboards.
[0046] Touch-sensitive display 112 provides an input and output interface between the device and a user. Display controller 156 receives and / or sends electrical signals to touchscreen 112. Touchscreen 112 displays visual output to the user. This visual output optionally includes graphics, text, icons, video, and any combination thereof (collectively "graphics"). In some embodiments, some or all of the visual output optionally corresponds to user-interface objects.
[0047] Touchscreen 112 has a touch-sensitive surface, sensor, or set of sensors that accepts input from a user based on haptic and / or tactile contact. Touchscreen 112 and display controller 156 (along with any associated modules and / or instruction sets in memory 102) detects contacts (and any movement or cessation of contact) on touchscreen 112 and translates the detected contacts into interactions with user interface objects (e.g., one or more softkeys, icons, web pages, or images) displayed on touchscreen 112. In an exemplary embodiment, the point of contact between touchscreen 112 and the user corresponds to the user's finger.
[0048] Touchscreen 112 optionally uses LCD (liquid crystal display), LPD (light emitting polymer display), or LED (light emitting diode) technology, although other display technologies are used in other embodiments. Touchscreen 112 and display controller 156 optionally detect contact and any movement or disruption thereof using any of a number of now known or later developed touch sensing technologies, including, but not limited to, capacitive, resistive, infrared, and surface acoustic wave technologies, as well as other proximity sensor arrays or other elements that determine one or more points of contact with touchscreen 112. In an exemplary embodiment, projected mutual capacitance sensing technology is used, such as that found in the iPhone® and iPod Touch® from Apple Inc. of Cupertino, California.
[0049] The touch-sensitive display in some embodiments of touchscreen 112 is optionally similar to the multi-touch-sensing touchpad described in U.S. Patent Nos. 6,323,846 (Westerman et al.), 6,570,557 (Westerman et al.), and / or 6,677,932 (Westerman), and / or U.S. Patent Publication No. 2002 / 0015024 (A1), each of which is incorporated by reference herein in its entirety. However, touchscreen 112 displays visual output from device 100, whereas touch-sensitive touchpads do not provide visual output.
[0050] The touch-sensitive display in some embodiments of touch screen 112 may be any of the touch-sensitive displays described in U.S. patent application Ser. No. 11 / 381,313, filed May 2, 2006, entitled "Multipoint Touch Surface Controller," (2) U.S. patent application Ser. No. 10 / 840,862, filed May 6, 2004, entitled "Multipoint Touchscreen," (3) U.S. patent application Ser. No. 10 / 903,964, filed July 30, 2004, entitled "Gestures For Touch Sensitive Input Devices," (4) U.S. patent application Ser. No. 11 / 048,264, filed January 31, 2005, entitled "Gestures For Touch Sensitive Input Devices," and (5) U.S. patent application Ser. No. 11 / 038,590, filed January 18, 2005, entitled "Mode-Based Graphical User Interfaces For Touch Sensitive Input Devices." No. 11 / 228,758, filed September 16, 2005, entitled "Virtual Input Device Placement On A Touch Screen User Interface," (7) U.S. Patent Application No. 11 / 228,700, filed September 16, 2005, entitled "Operation Of A Computer With A Touch Screen Interface," (8) U.S. Patent Application No. 11 / 228,737, filed September 16, 2005, entitled "Activating Virtual Keys Of A Touch-Screen Virtual Keyboard," and (9) U.S. Patent Application No. 11 / 367,749, filed March 3, 2006, entitled "Multi-Functional Hand-Held Device," all of which are incorporated herein by reference in their entirety.
[0051] Touchscreen 112 optionally has a video resolution greater than 100 dpi. In some embodiments, the touchscreen has a video resolution of approximately 160 dpi. A user optionally contacts touchscreen 112 using any suitable object or accessory, such as a stylus, a finger, or the like. In some embodiments, the user interface is designed to primarily handle finger contacts and gestures, which may not be as precise as stylus-based input due to the larger contact area of a finger on the touchscreen. In some embodiments, the device translates the coarse finger input into precise pointer / cursor positions or commands to perform the action desired by the user.
[0052] In some embodiments, in addition to the touchscreen, device 100 optionally includes a touchpad (not shown) for activating or deactivating certain functions. In some embodiments, the touchpad is a touch-sensitive area of the device that, unlike the touchscreen, does not display visual output. The touchpad is optionally a touch-sensitive surface that is separate from touchscreen 112 or an extension of the touch-sensitive surface formed by the touchscreen.
[0053] Device 100 also includes a power system 162 that provides power to the various components. Power system 162 optionally includes a power management system, one or more power sources (e.g., battery, alternating current (AC)), a recharging system, power failure detection circuitry, power converters or inverters, power status indicators (e.g., light emitting diodes (LEDs)), and any other components associated with the generation, management, and distribution of electrical power within a portable device.
[0054] Device 100 also optionally includes one or more light sensors 164. FIG. 1A shows a light sensor coupled to light sensor controller 158 in I / O subsystem 106. Light sensor 164 optionally includes a charge-coupled device (CCD) or a complementary metal-oxide semiconductor (CMOS) phototransistor. Light sensor 164 receives light from the environment projected through one or more lenses and converts the light into data representing an image. Light sensor 164 optionally works in conjunction with imaging module 143 (also called a camera module) to capture still images or video. In some embodiments, the light sensor is located on the back of device 100, as opposed to touchscreen display 112, which is on the front of the device, so that the touchscreen display is effectively used as a viewfinder for capturing still and / or video images. In some embodiments, the light sensor is located on the front of the device, so that an image of the user is obtained, optionally for video conferencing, and the user sees other video conference participants on the touchscreen display. In some embodiments, the position of the light sensor 164 can be changed by the user (e.g., by rotating the lens and sensor within the device housing), so that a single light sensor 164 is used for both video conferencing and capturing still and / or video images, along with the touchscreen display.
[0055] Device 100 also optionally includes one or more contact intensity sensors 165. FIG. 1A shows a contact intensity sensor coupled to intensity sensor controller 159 in I / O subsystem 106. Contact intensity sensor 165 optionally includes one or more piezoresistive strain gauges, capacitive force sensors, electric force sensors, piezoelectric force sensors, optical force sensors, capacitive touch-sensitive surfaces, or other intensity sensors (e.g., sensors used to measure the force (or pressure) of a contact on a touch-sensitive surface). Contact intensity sensor 165 receives contact intensity information (e.g., pressure information, or a proxy for pressure information) from the environment. In some embodiments, at least one contact intensity sensor is juxtaposed with or proximate to the touch-sensitive surface (e.g., touch-sensitive display system 112). In some embodiments, at least one contact intensity sensor is located on the back of device 100, opposite touchscreen display 112, which is located on the front of device 100.
[0056] Device 100 also optionally includes one or more proximity sensors 166. Figure 1A shows proximity sensor 166 coupled to peripherals interface 118. Alternatively, proximity sensor 166 is optionally coupled to input controller 160 within I / O subsystem 106. Proximity sensor 166 optionally functions as described in U.S. patent application Ser. Nos. 11 / 241,839, "Proximity Detector In Handheld Device," 11 / 240,788, "Proximity Detector In Handheld Device," 11 / 620,702, "Using Ambient Light Sensor To Augment Proximity Sensor Output," 11 / 586,862, "Automated Response To And Sensing Of User Activity In Portable Devices," and 11 / 638,251, "Methods And Systems For Automatic Configuration Of Peripherals," which are incorporated herein by reference in their entireties. In some embodiments, the proximity sensor turns off and disables touchscreen 112 when the multifunction device is placed near the user's ear (e.g., when the user is on a phone call).
[0057] Device 100 also optionally includes one or more tactile output generators 167. FIG. 1A shows tactile output generators coupled to haptic feedback controller 161 in I / O subsystem 106. Tactile output generator 167 optionally includes one or more electroacoustic devices, such as speakers or other audio components, and / or electromechanical devices that convert energy into linear motion, such as motors, solenoids, electroactive polymers, piezoelectric actuators, electrostatic actuators, or other tactile output generating components (e.g., components that convert electrical signals into tactile output on the device). Contact intensity sensor 165 receives tactile feedback generation instructions from haptic feedback module 133 and generates a tactile output on device 100 that can be sensed by a user of device 100. In some embodiments, at least one tactile output generator is juxtaposed with or proximate to a touch-sensitive surface (e.g., touch-sensitive display system 112) and generates a tactile output, optionally by moving the touch-sensitive surface vertically (e.g., in / out of the surface of device 100) or horizontally (e.g., back and forth in the same plane as the surface of device 100). In some embodiments, at least one tactile output generator sensor is located on the back of device 100, opposite touchscreen display 112, which is located on the front of device 100.
[0058] Device 100 also optionally includes one or more accelerometers 168. FIG. 1A shows accelerometer 168 coupled to peripherals interface 118. Alternatively, accelerometer 168 is optionally coupled to input controller 160 within I / O subsystem 106. Accelerometer 168 optionally functions as described in U.S. Patent Publication No. 20050190059, "Acceleration-based Theft Detection System for Portable Electronic Devices," and U.S. Patent Publication No. 20060017692, "Methods And Apparatuses For Operating A Portable Device Based On An Accelerometer," both of which are incorporated herein by reference in their entireties. In some embodiments, information is displayed on the touchscreen display in portrait or landscape view based on analysis of data received from the one or more accelerometers. Device 100 optionally includes, in addition to accelerometer(s) 168, a magnetometer (not shown), and a GPS (or GLONASS or other global navigation system) receiver (not shown) for obtaining information regarding the location and orientation (e.g., portrait or landscape) of device 100.
[0059] In some embodiments, software components stored in memory 102 include operating system 126, communications module (or instruction set) 128, touch / motion module (or instruction set) 130, graphics module (or instruction set) 132, text input module (or instruction set) 134, Global Positioning System (GPS) module (or instruction set) 135, and applications (or instruction set) 136. Additionally, in some embodiments, memory 102 (FIG. 1A) or 370 (FIG. 3) stores device / global internal state 157, as shown in FIGS. 1A and 3. Device / global internal state 157 includes one or more of: active application state indicating which applications, if any, are currently active; display state indicating which applications, views, or other information occupy various regions of touchscreen display 112; sensor state including information obtained from the device's various sensors and input control devices 116; and location information regarding the device's position and / or orientation.
[0060] Operating system 126 (e.g., Darwin®, RTXC®, LINUX®, UNIX®, OS X®, iOS®, WINDOWS®, or an embedded operating system such as VxWorks®) includes various software components and / or drivers that control and manage common system tasks (e.g., memory management, storage device control, power management, etc.) and facilitate communication between various hardware and software components.
[0061] Communications module 128 facilitates communication with other devices via one or more external ports 124 and also includes various software components for processing data received by RF circuitry 108 and / or external port 124. External port 124 (e.g., Universal Serial Bus (USB), FIREWIRE®, etc.) is adapted to couple to other devices directly or indirectly via a network (e.g., the Internet, wireless LAN, etc.). In some embodiments, the external port is a multi-pin (e.g., 30-pin) connector that is the same as, similar to, and / or compatible with the 30-pin connector used on iPod® (trademark of Apple Inc.) devices.
[0062] Contact / motion module 130, optionally in conjunction with display controller 156, detects contact with touch screen 112 and other touch-sensing devices (e.g., a touchpad or physical click wheel). Contact / motion module 130 includes various software components for performing various operations related to contact detection, such as determining whether contact occurs (e.g., detecting a finger-down event), determining the intensity of the contact (e.g., the force or pressure of the contact, or a surrogate for the force or pressure of the contact), determining whether there is contact movement and tracking the movement across the touch-sensitive surface (e.g., detecting one or more finger-drag events), and determining whether the contact has stopped (e.g., detecting a finger-up event or an interruption of the contact). Contact / motion module 130 receives contact data from the touch-sensitive surface. Determining the movement of the contact, as represented by the series of contact data, optionally includes determining the speed (magnitude), velocity (magnitude and direction), and / or acceleration (change in magnitude and / or direction) of the contact. These actions are optionally applied to a single contact (e.g., a single finger contact) or multiple simultaneous contacts (e.g., "multi-touch" / multiple finger contacts). In some embodiments, contact / motion module 130 and display controller 156 detect contacts on the touchpad.
[0063] In some embodiments, contact / motion module 130 uses a set of one or more intensity thresholds for determining whether an action has been performed by a user (e.g., for determining whether a user has “clicked” on an icon). In some embodiments, at least a subset of the intensity thresholds are determined according to software parameters (e.g., the intensity thresholds are not determined by the activation threshold of a particular physical actuator, but can be adjusted without changing the physical hardware of device 100). For example, the mouse “click” threshold of a trackpad or touchscreen display can be set to any of a wide range of pre-defined thresholds without changing the trackpad or touchscreen display hardware. Additionally, in some implementations, a device user is provided with software settings to adjust one or more of the set of intensity thresholds (e.g., by adjusting individual intensity thresholds and / or multiple intensity thresholds at once via a system-level click “intensity” parameter).
[0064] Contact / motion module 130 optionally detects gesture input by a user. Different gestures on the touch-sensitive surface have different contact patterns (e.g., different movements, timing, and / or intensities of detected contacts). Thus, gestures are optionally detected by detecting particular contact patterns. For example, detecting a finger tap gesture includes detecting a finger down event, followed by detecting a finger up (lift off) event at the same location (or substantially the same location) as the finger down event (e.g., the location of an icon). As another example, detecting a finger swipe gesture on the touch-sensitive surface includes detecting a finger down event, followed by one or more finger drag events, followed by detecting a finger up (lift off) event.
[0065] Graphics module 132 includes various known software components that render and display graphics on touchscreen 112 or other display, including components that vary the visual impact (e.g., brightness, transparency, saturation, contrast, or other visual characteristics) of the displayed graphics. As used herein, the term "graphic" includes any object that can be displayed to a user, including, but not limited to, characters, web pages, icons (such as user interface objects including soft keys), digital images, videos, animations, etc.
[0066] In some embodiments, graphics module 132 stores data representing graphics to be used. Each graphic is optionally assigned a corresponding code. Graphics module 132 receives one or more codes specifying the graphics to be displayed, including coordinate data and other graphic characteristic data, as needed, from an application or the like, and then generates screen image data to output to display controller 156.
[0067] The tactile feedback module 133 includes various software components for generating instructions used by the tactile output generator(s) 167 to generate tactile outputs at one or more locations on the device 100 in response to user interaction with the device 100.
[0068] Text input module 134 is optionally a component of graphics module 132 and provides a soft keyboard for entering text in various applications (e.g., contacts 137, email 140, IM 141, browser 147, and any other application requiring text input).
[0069] The GPS module 135 determines the location of the device and provides this information for use in various applications (e.g., to the phone 138 for use in location-based dialing, to the camera 143 as photo / video metadata, and to applications that provide location-based services such as weather widgets, local yellow pages widgets, and map / navigation widgets).
[0070] Application 136 optionally includes the following modules (or instruction sets), or a subset or superset thereof: • a contacts module 137 (sometimes called an address book or contact list); ●Telephone module 138, ●Videoconferencing module 139, ● an email client module 140; ● Instant messaging (IM) module 141, ●Training support module 142, a camera module 143 for still and / or video images, ● Image management module 144; ●Video player module, ●Music player module, ● Browser module 147, ● Calendar module 148, • A widget module 149 optionally including one or more of a weather widget 149-1, a stocks widget 149-2, a calculator widget 149-3, an alarm clock widget 149-4, a dictionary widget 149-5, and other widgets obtained by the user, and a user-created widget 149-6; a widget creation module 150 for creating user-created widgets 149-6; ● Search module 151, A video and music player module 152 that integrates a video player module and a music player module; ● Memo module 153, Map module 154, and / or ●Online video module 155.
[0071] Examples of other applications 136 optionally stored in memory 102 include other word processing applications, other image editing applications, drawing applications, presentation applications, JAVA-enabled applications, encryption, digital rights management, voice recognition, and voice duplication.
[0072] In conjunction with touch screen 112, display controller 156, contact / motion module 130, graphics module 132, and text input module 134, contacts module 137 is used to manage an address book or contact list (e.g., stored in memory 102 or in the application internal state 192 of contacts module 137 in memory 370), optionally including adding name(s) to the address book, deleting name(s) from the address book, associating phone number(s), email address(es), physical address(es), or other information with names, associating images with names, categorizing and sorting names, providing phone numbers or email addresses to initiate and / or facilitate communication by phone 138, videoconferencing module 139, email 140, or IM 141, etc.
[0073] Telephone module 138, in conjunction with RF circuitry 108, audio circuitry 110, speaker 111, microphone 113, touchscreen 112, display controller 156, contact / motion module 130, graphics module 132, and text input module 134, is optionally used to enter character sequences corresponding to telephone numbers, access one or more telephone numbers in contacts module 137, modify entered telephone numbers, dial respective telephone numbers, conduct conversations, and terminate or hang up when the conversation is completed. As previously mentioned, wireless communication optionally uses any of a number of communication standards, protocols, and technologies.
[0074] In conjunction with RF circuitry 108, audio circuitry 110, speaker 111, microphone 113, touch screen 112, display controller 156, light sensor 164, light sensor controller 158, touch / motion module 130, graphics module 132, text input module 134, contacts module 137, and telephone module 138, videoconferencing module 139 includes executable instructions for initiating, conducting, and terminating a videoconference between a user and one or more other participants in accordance with user commands.
[0075] In cooperation with RF circuitry 108, touch screen 112, display controller 156, contact / motion module 130, graphics module 132, and text input module 134, email client module 140 contains executable instructions for composing, sending, receiving, and managing emails in response to user commands. In cooperation with image management module 144, email client module 140 greatly facilitates the creation and sending of emails with still or video images captured by camera module 143.
[0076] In cooperation with RF circuitry 108, touchscreen 112, display controller 156, contact / motion module 130, graphics module 132, and text input module 134, instant messaging module 141 includes executable instructions for entering character sequences corresponding to instant messages, modifying previously entered characters, sending respective instant messages (e.g., using Short Message Service (SMS) or Multimedia Message Service (MMS) protocols for telephony-based instant messaging, or XMPP, SIMPLE, or IMPS for Internet-based instant messaging), receiving instant messages, and viewing received instant messages. In some embodiments, sent and / or received instant messages optionally include graphics, photos, audio files, video files, and / or other attachments supported by MMS and / or Enhanced Messaging Service (EMS). As used herein, "instant messaging" refers to both telephony-based messages (e.g., messages sent using SMS or MMS) and Internet-based messages (e.g., messages sent using XMPP, SIMPLE, or IMPS).
[0077] In conjunction with the RF circuitry 108, touchscreen 112, display controller 156, contact / motion module 130, graphics module 132, text input module 134, GPS module 135, map module 154, and music player module, the training support module 142 includes executable instructions for creating workouts (e.g., with time, distance, and / or calorie burn goals), communicating with training sensors (sports devices), receiving training sensor data, calibrating sensors used to monitor workouts, selecting and playing music for workouts, and displaying, storing, and transmitting workout data.
[0078] In conjunction with touch screen 112, display controller 156, light sensor(s) 164, light sensor controller 158, contact / motion module 130, graphics module 132, and image management module 144, camera module 143 contains executable instructions for capturing and storing still images or video (including video streams) in memory 102, modifying characteristics of the still images or video, or deleting the still images or video from memory 102.
[0079] In conjunction with touch screen 112, display controller 156, contact / motion module 130, graphics module 132, text input module 134, and camera module 143, image management module 144 contains executable instructions for arranging, modifying (e.g., editing), or otherwise manipulating, labeling, deleting, presenting (e.g., in a digital slide show or album), and storing still and / or video images.
[0080] In conjunction with RF circuitry 108, touch screen 112, display controller 156, contact / motion module 130, graphics module 132, and text input module 134, browser module 147 contains executable instructions for browsing the Internet according to user commands, including retrieving, linking to, receiving, and displaying web pages or portions thereof, as well as attachments and other files linked to web pages.
[0081] In conjunction with RF circuitry 108, touch screen 112, display controller 156, contact / motion module 130, graphics module 132, text input module 134, email client module 140, and browser module 147, calendar module 148 contains executable instructions for creating, displaying, modifying, and storing calendars and data associated with calendars (e.g., calendar items, to-do lists, etc.) in accordance with user instructions.
[0082] In conjunction with RF circuitry 108, touchscreen 112, display controller 156, touch / motion module 130, graphics module 132, text input module 134, and browser module 147, widget module 149 is optionally a mini-application downloaded and used by a user (e.g., weather widget 149-1, stocks widget 149-2, calculator widget 149-3, alarm clock widget 149-4, and dictionary widget 149-5), or a mini-application created by a user (e.g., user-created widget 149-6). In some embodiments, a widget includes an HTML (Hypertext Markup Language) file, a CSS (Cascading Style Sheets) file, and a JavaScript file. In some embodiments, a widget includes an XML (Extensible Markup Language) file and a JavaScript file (e.g., Yahoo! Widgets).
[0083] In conjunction with RF circuitry 108, touch screen 112, display controller 156, touch / motion module 130, graphics module 132, text input module 134, and browser module 147, widget creator module 150 is optionally used by a user to create a widget (e.g., turn a user-specified portion of a web page into a widget).
[0084] In cooperation with touch screen 112, display controller 156, contact / motion module 130, graphics module 132, and text input module 134, search module 151 includes executable instructions for searching for text, music, sound, images, video, and / or other files in memory 102 that match one or more search criteria (e.g., one or more user-specified search terms) in accordance with user commands.
[0085] In conjunction with touchscreen 112, display controller 156, contact / motion module 130, graphics module 132, audio circuitry 110, speaker 111, RF circuitry 108, and browser module 147, video and music player module 152 contains executable instructions that enable a user to download and play pre-recorded music and other sound files stored in one or more file formats, such as MP3 or AAC files, as well as executable instructions for displaying, presenting, or otherwise playing videos (e.g., on touchscreen 112 or on an external display connected via external port 124). In some embodiments, device 100 optionally includes the functionality of an MP3 player, such as an iPod (a trademark of Apple Inc.).
[0086] In conjunction with the touch screen 112, display controller 156, contact / motion module 130, graphics module 132, and text input module 134, the notes module 153 contains executable instructions for creating and managing notes, to-do lists, and the like according to user commands.
[0087] In conjunction with RF circuitry 108, touchscreen 112, display controller 156, touch / motion module 130, graphics module 132, text input module 134, GPS module 135, and browser module 147, map module 154 is used to receive, display, modify, and store maps and data associated with maps (e.g., driving directions, data regarding businesses and other points of interest at or near a particular location, and other location-based data), optionally in accordance with user instructions.
[0088] In cooperation with touchscreen 112, display controller 156, contact / motion module 130, graphics module 132, audio circuitry 110, speaker 111, RF circuitry 108, text input module 134, email client module 140, and browser module 147, online video module 155 contains instructions that enable a user to access, browse for, receive (e.g., by streaming and / or downloading), and play (e.g., on the touchscreen or on an external display connected via external port 124) particular online videos, send emails with links to particular online videos, and otherwise manage online videos in one or more file formats, such as H.264. In some embodiments, instant messaging module 141 is used to send links to particular online videos, rather than email client module 140. Additional description of online video applications can be found in U.S. Provisional Patent Application No. 60 / 936,562, filed June 20, 2007, entitled "Portable Multifunction Device, Method, and Graphical User Interface for Playing Online Videos," and U.S. Patent Application No. 11 / 968,067, filed December 31, 2007, entitled "Portable Multifunction Device, Method, and Graphical User Interface for Playing Online Videos," the contents of which are incorporated herein by reference in their entireties.
[0089] The above-identified modules and applications each correspond to a set of executable instructions that perform one or more of the functions previously described and methods described herein (e.g., the computer-implemented methods and other information processing methods described herein). These modules (e.g., sets of instructions) need not be implemented as separate software programs, procedures, or modules; thus, in various embodiments, various subsets of these modules are optionally combined or otherwise reconfigured. For example, a video player module is optionally combined with a music player module into a single module (e.g., video and music player module 152 of FIG. 1A). In some embodiments, memory 102 optionally stores a subset of the above-identified modules and data structures. Additionally, memory 102 optionally stores additional modules and data structures not described above.
[0090] In some embodiments, device 100 is a device in which operation of a predetermined set of functions on the device is performed solely via a touchscreen and / or touchpad. Using the touchscreen and / or touchpad as the primary input control device for operation of device 100 optionally reduces the number of physical input control devices (push buttons, dials, etc.) on device 100.
[0091] The set of predefined functions performed only through the touchscreen and / or touchpad optionally includes navigation between user interfaces. In some embodiments, the touchpad, when touched by a user, navigates device 100 to a main menu, home menu, or root menu from any user interface displayed on device 100. In such embodiments, a "menu button" is implemented using the touchpad. In some other embodiments, the menu button is a physical push button or other physical input control device rather than a touchpad.
[0092] 1B is a block diagram illustrating exemplary components for event processing according to some embodiments. In some embodiments, memory 102 (FIG. 1A) or 370 (FIG. 3) includes event sorter 170 (e.g., within operating system 126) and a respective application 136-1 (e.g., any of applications 137-151, 155, 380-390 described above).
[0093] Event sorter 170 receives the event information and determines which application 136-1 to deliver the event information to and application view 191 of application 136-1. Event sorter 170 includes event monitor 171 and event dispatcher module 174. In some embodiments, application 136-1 includes application internal state 192 that indicates the current application view(s) that are displayed on touch-sensitive display 112 when the application is active or running. In some embodiments, device / global internal state 157 is used by event sorter 170 to determine which application(s) are currently active, and application internal state 192 is used by event sorter 170 to determine which application(s) is / are currently active.
[0094] In some embodiments, application internal state 192 includes additional information such as one or more of resume information to be used when application 136-1 resumes execution, user interface state information indicating or ready to display information being displayed by application 136-1, state cues that allow the user to return to a previous state or view of application 136-1, and redo / undo cues of previous actions taken by the user.
[0095] Event monitor 171 receives event information from peripherals interface 118. The event information includes information about a sub-event (e.g., a user touch on touch-sensitive display 112 as part of a multi-touch gesture). Peripherals interface 118 transmits information it receives from I / O subsystem 106 or sensors such as proximity sensor 166, accelerometer(s) 168, and / or microphone 113 (via audio circuitry 110). Information that peripherals interface 118 receives from I / O subsystem 106 includes information from touch-sensitive display 112 or a touch-sensitive surface.
[0096] In some embodiments, event monitor 171 sends requests to peripherals interface 118 at predetermined intervals. In response, peripherals interface 118 transmits event information. In other embodiments, peripherals interface 118 transmits event information only when there is a significant event (e.g., receipt of an input above a predetermined noise threshold and / or for more than a predetermined duration).
[0097] In some embodiments, event sorter 170 also includes a hit view determination module 172 and / or an active event recognizer determination module 173 .
[0098] Hit view determination module 172 provides software procedures that determine where a sub-event occurred within one or more views when touch-sensitive display 112 displays more than one view. A view consists of the controls and other elements that a user can see on the display.
[0099] Another aspect of a user interface associated with an application is the set of views, sometimes referred to herein as application views or user interface windows, in which information is displayed and touch-based gestures occur. The application view (of the respective application) in which the touch is detected optionally corresponds to a programmatic level within the application's programmatic or view hierarchy. For example, the lowest-level view in which the touch is detected is optionally referred to as the hit view, and the set of events that are recognized as suitable inputs is optionally determined based at least in part on the hit view of the initial touch that initiates the touch gesture.
[0100] Hit view determination module 172 receives information related to sub-events of a touch-based gesture. When an application has multiple views organized hierarchically, hit view determination module 172 identifies the hit view as the lowest view in the hierarchy that should process the sub-events. In most situations, the hit view is the lowest-level view in which an initiating sub-event (e.g., the first sub-event in a sequence of sub-events that form an event or potential event) occurs. Once a hit view is identified by hit view determination module 172, the hit view typically receives all sub-events related to the same touch or input source as the hit view.
[0101] Active event recognizer determination module 173 determines which view(s) in the view hierarchy should receive the particular sequence of sub-events. In some embodiments, active event recognizer determination module 173 determines that only the hit view should receive the particular sequence of sub-events. In other embodiments, active event recognizer determination module 173 determines that all views that contain the physical location of the sub-event are actively participating views, and therefore all actively participating views should receive the particular sequence of sub-events. In other embodiments, even if the touch sub-event is completely confined to the area associated with one particular view, views higher in the hierarchy still remain actively participating views.
[0102] Event dispatcher module 174 dispatches event information to event recognizers (e.g., event recognizer 180). In embodiments that include active event recognizer determination module 173, event dispatcher module 174 delivers the event information to the event recognizers determined by active event recognizer determination module 173. In some embodiments, event dispatcher module 174 stores event information obtained by each event receiver 182 in an event queue.
[0103] In some embodiments, operating system 126 includes event sorter 170. Alternatively, application 136-1 includes event sorter 170. In still other embodiments, event sorter 170 is a stand-alone module or is part of another module stored in memory 102, such as contact / motion module 130.
[0104] In some embodiments, application 136-1 includes multiple event handlers 190 and one or more application views 191, each containing instructions for processing touch events that occur within a respective view of the application's user interface. Each application view 191 of application 136-1 includes one or more event recognizers 180. Typically, each application view 191 includes multiple event recognizers 180. In other embodiments, one or more of event recognizers 180 are part of a separate module, such as a user interface kit (not shown) or a higher-level object from which application 136-1 inherits methods and other properties. In some embodiments, each event handler 190 includes one or more of data updater 176, object updater 177, GUI updater 178, and / or event data 179 received from event sorter 170. Event handler 190 optionally utilizes or invokes data updater 176, object updater 177, or GUI updater 178 to update application internal state 192. Alternatively, one or more of the application views 191 include one or more respective event handlers 190. Also, in some embodiments, one or more of the data updater 176, the object updater 177, and the GUI updater 178 are included in each application view 191.
[0105] Each event recognizer 180 receives event information (e.g., event data 179) from event sorter 170 and identifies an event from the event information. Event recognizer 180 includes an event receiver 182 and an event comparator 184. In some embodiments, event recognizer 180 also includes metadata 183 and at least a subset of event delivery instructions 188 (optionally including sub-event delivery instructions).
[0106] Event receiver 182 receives event information from event sorter 170. The event information includes information about a sub-event, e.g., a touch or a movement of a touch. Depending on the sub-event, the event information also includes additional information, such as the position of the sub-event. When the sub-event involves a movement of a touch, the event information also optionally includes the speed and direction of the sub-event. In some embodiments, the event includes a rotation of the device from one orientation to another (e.g., from portrait to landscape or vice versa), and the event information includes corresponding information about the current orientation of the device (also called the device's attitude).
[0107] The event comparator 184 compares the event information with predefined event or sub-event definitions and determines the event or sub-event, or determines or updates the state of the event or sub-event, based on the comparison. In some embodiments, the event comparator 184 includes an event definition 186. The event definition 186 includes definitions of events (e.g., a predefined sequence of sub-events), such as Event 1 (187-1) and Event 2 (187-2). In some embodiments, sub-events within Event 1 (187) include, for example, touch start, touch end, touch movement, touch cancellation, and multiple touches. In one example, the definition for Event 1 (187-1) is a double tap on a displayed object. The double tap includes, for example, a first touch on a displayed object relative to a predetermined stage (touch start), a first lift-off (touch end) relative to the predetermined stage, a second touch on a displayed object relative to the predetermined stage (touch start), and a second lift-off (touch end) relative to the predetermined stage. In another example, a definition of event 2 (187-2) is a drag on a displayed object. Drag includes, for example, a touch (or contact) on the displayed object to a predetermined stage, a movement of the touch across the touch-sensitive display 112, and a lift-off of the touch (touch end). In some embodiments, the event also includes information about one or more associated event handlers 190.
[0108] In some embodiments, event definition 187 includes a definition of the event for each user interface object. In some embodiments, event comparator 184 performs a hit test to determine which user interface object is associated with the sub-event. For example, when a touch is detected on touch-sensitive display 112 in an application view in which three user interface objects are displayed on touch-sensitive display 112, event comparator 184 performs a hit test to determine which of the three user interface objects is associated with the touch (sub-event). If each displayed object is associated with a respective event handler 190, event comparator 184 uses the results of the hit test to determine which event handler 190 to activate. For example, event comparator 184 selects the event handler associated with the sub-event and object that triggers the hit test.
[0109] In some embodiments, each event 187 definition also includes a delay action that delays delivery of the event information until it is determined whether the sequence of sub-events corresponds to the event type of the event recognizer.
[0110] If the respective event recognizer 180 determines that the sequence of sub-events does not match any of the events in the event definition 186, the respective event recognizer 180 enters an event-disabled, event-failed, or event-ended state and thereafter ignores the next sub-event of the touch-based gesture. In this situation, any other event recognizers that remain active for the hit view continue to track and process sub-events of the ongoing touch-based gesture.
[0111] In some embodiments, each event recognizer 180 includes metadata 183 with configurable properties, flags, and / or lists that indicate to actively participating event recognizers how the event delivery system should perform sub-event delivery. In some embodiments, metadata 183 includes configurable properties, flags, and / or lists that indicate how event recognizers interact with each other or how event recognizers are allowed to interact with each other. In some embodiments, metadata 183 includes configurable properties, flags, and / or lists that indicate how sub-events are delivered to various levels in the view or programmatic hierarchy.
[0112] In some embodiments, each event recognizer 180 activates an event handler 190 associated with an event when one or more specific sub-events of the event are recognized. In some embodiments, each event recognizer 180 delivers event information associated with the event to the event handler 190. Activating the event handler 190 is separate from sending (and postponing sending) sub-events to the respective hit view. In some embodiments, the event recognizer 180 pops a flag associated with the recognized event, and the event handler 190 associated with the flag captures the flag and performs a predetermined process.
[0113] In some embodiments, the event delivery instructions 188 include sub-event delivery instructions that deliver event information about a sub-event without activating an event handler. Instead, the sub-event delivery instructions deliver the event information to an event handler associated with a set of sub-events or to an actively participating view. The event handler associated with the set of sub-events or the actively participating view receives the event information and performs predetermined processing.
[0114] In some embodiments, data updater 176 creates and updates data used by application 136-1. For example, data updater 176 updates phone numbers used by contacts module 137 or stores video files used by a video player module. In some embodiments, object updater 177 creates and updates objects used by application 136-1. For example, object updater 177 creates new user interface objects or updates the positions of user interface objects. GUI updater 178 updates the GUI. For example, GUI updater 178 prepares display information and sends the display information to graphics module 132 for display on the touch-sensitive display.
[0115] In some embodiments, event handler(s) 190 include or have access to data updater 176, object updater 177, and GUI updater 178. In some embodiments, data updater 176, object updater 177, and GUI updater 178 are included in a single module of the respective application 136-1 or application view 191. In other embodiments, they are included in two or more software modules.
[0116] It should be understood that the foregoing description of event processing of a user's touch on a touch-sensitive display also applies to other forms of user input for operating multifunction device 100 using input devices, not all of which are initiated on the touchscreen. For example, mouse movements and mouse button presses, contact movements such as tapping, dragging, scrolling on a touchpad, optionally coordinated with single or multiple keyboard presses or holds, pen stylus input, device movement, verbal commands, detected eye movement, biometric input, and / or any combination thereof, optionally utilize as inputs corresponding to sub-events that define the recognized event.
[0117] FIG. 2 illustrates portable multifunction device 100 having touchscreen 112, according to some embodiments. The touchscreen optionally displays one or more graphics within user interface (UI) 200. In this embodiment, as well as other embodiments described below, a user may select one or more of the graphics by performing a gesture on the graphics, for example, using one or more fingers 202 (not drawn to scale) or one or more styluses 203 (not drawn to scale). In some embodiments, selection of one or more graphics is performed when the user breaks contact with the one or more graphics. In some embodiments, the gesture optionally includes one or more taps, one or more swipes (left to right, right to left, upward and / or downward), and / or rolling of a finger in contact with device 100 (right to left, left to right, upward and / or downward). In some implementations or situations, accidental contact with a graphic does not select the graphic, for example, if the gesture corresponding to selection is a tap, a swipe gesture sweeping over an application icon optionally does not select the corresponding application.
[0118] Device 100 also optionally includes one or more physical buttons, such as a "home" button or menu button 204. As previously mentioned, menu button 204 is optionally used to navigate to any application 136, optionally within a set of applications running on device 100. Alternatively, in some embodiments, the menu button is implemented as a soft key within a GUI displayed on touchscreen 112.
[0119] In some embodiments, device 100 includes touchscreen 112, menu button 204, pushbuttons 206 for powering the device on / off and locking the device, volume control buttons 208, subscriber identity module (SIM) card slot 210, headset jack 212, and external docking / charging port 124. Pushbutton 206 is optionally used to power the device on / off by pressing and holding the button down for a predetermined period of time, to lock the device by pressing and releasing the button before the predetermined time has elapsed, and / or to unlock the device or initiate the unlocking process. In alternative embodiments, device 100 also accepts verbal input via microphone 113 for activating or deactivating some functions. Device 100 also optionally includes one or more contact intensity sensors 165 for detecting the intensity of a contact on touchscreen 112 and / or one or more tactile output generators 167 for generating a tactile output for a user of device 100.
[0120] FIG. 3 is a block diagram of an exemplary multifunction device having a display and a touch-sensitive surface, according to some embodiments. Device 300 need not be portable. In some embodiments, device 300 is a laptop computer, a desktop computer, a tablet computer, a multimedia player device, a navigation device, an educational device (such as a child's learning toy), a gaming system, or a control device (e.g., a home or commercial controller). Device 300 typically includes one or more processing units (CPUs) 310, one or more network or other communication interfaces 360, memory 370, and one or more communication buses 320 interconnecting these components. Communication bus 320 optionally includes circuitry (sometimes referred to as a chipset) that interconnects and controls communication between system components. Device 300 includes input / output (I / O) interface 330, including display 340, which is typically a touchscreen display. I / O interface 330 also optionally includes a keyboard and / or mouse (or other pointing device) 350, a touchpad 355, a tactile output generator 357 (e.g., similar to tactile output generator 167 described above with reference to FIG. 1A ) that generates tactile output on device 300, and sensors 359 (e.g., light, acceleration, proximity, touch-sensing, and / or contact intensity sensors similar to contact intensity sensor 165 described above with reference to FIG. 1A ). Memory 370 includes high-speed random-access memory such as DRAM, SRAM, DDR RAM, or other random-access solid-state memory devices, and optionally includes non-volatile memory such as one or more magnetic disk storage devices, optical disk storage devices, flash memory devices, or other non-volatile solid-state storage devices. Memory 370 optionally includes one or more storage devices located remotely from CPU(s) 310.In some embodiments, memory 370 stores programs, modules, and data structures similar to, or a subset of, programs, modules, and data structures stored in memory 102 of portable multifunction device 100 (FIG. 1A). Additionally, memory 370 optionally stores additional programs, modules, and data structures not present in memory 102 of portable multifunction device 100. For example, memory 370 of device 300 optionally stores drawing module 380, presentation module 382, word processing module 384, website creation module 386, disc authoring module 388, and / or spreadsheet module 390, whereas memory 102 of portable multifunction device 100 (FIG. 1A) optionally does not store these modules.
[0121] Each of the above-identified elements of FIG. 3 is optionally stored in one or more of the memory devices mentioned above. Each of the above-identified modules corresponds to an instruction set that performs the function described above. The above-identified modules or programs (e.g., instruction sets) need not be implemented as separate software programs, procedures, or modules; thus, in various embodiments, various subsets of these modules are optionally combined or otherwise reconfigured. In some embodiments, memory 370 optionally stores a subset of the above-identified modules and data structures. Additionally, memory 370 optionally stores additional modules and data structures not described above.
[0122] Attention is now directed to user interface embodiments, optionally implemented on portable multifunction device 100, for example.
[0123] 4A shows an exemplary user interface for a menu of applications on portable multifunction device 100 according to some embodiments. A similar user interface is optionally implemented on device 300. In some embodiments, user interface 400 includes the following elements, or a subset or superset thereof: signal strength indicator(s) 402 for wireless communication(s), such as cellular and Wi-Fi® signals; ●Time 404, ●Bluetooth (registered trademark) indicator 405, ● Battery status indicator 406, A tray 408 with icons of frequently used applications, such as: An icon 416 for the phone module 138, labeled "Phone," optionally including an indicator 414 of the number of missed calls or voicemail messages; icon 418 of the email client module 140, labeled "Mail," optionally including an indicator 410 of the number of unread emails; ○ An icon 420 for the browser module 147, labeled "Browser"; and ○ An icon 422 of the video and music player module 152, also called the iPod (trademark of Apple Inc.) module 152, labeled "iPod"; and ● Icons of other applications, such as: ○ Icon 424 of IM module 141, labeled "Messages"; icon 426 of the calendar module 148, labeled "Calendar"; ○ Icon 428 of the image management module 144, labeled "Photos" ○ An icon 430 of the camera module 143, labeled "camera"; ○ Icon 432 of the online video module 155, labeled "Online Video"; Icon 434 of Stocks widget 149-2, labeled "Stocks" ○ Icon 436 of the map module 154, labeled "Map"; Icon 438 of weather widget 149-1, labeled "Weather" ○ Icon 440 of alarm clock widget 149-4, labeled "Clock" ○ Icon 442 of Training Support Module 142, labeled "Training Support"; ○ An icon 444 of the Notes module 153 labeled "Notes," and A settings application or module icon 446 labeled "Settings" that provides access to settings for the device 100 and its various applications 136.
[0124] 4A are merely exemplary. For example, icon 422 for video and music player module 152 may be labeled "Music" or "Music Player." Other labels are optionally used for the various application icons. In some embodiments, the label for each application icon includes the name of the application corresponding to the respective application icon. In some embodiments, the label for a particular application icon is different from the name of the application corresponding to that particular application icon.
[0125] 4B shows an example user interface on a device (e.g., device 300 of FIG. 3 ) that has touch-sensitive surface 451 (e.g., tablet or touchpad 355 of FIG. 3 ) that is separate from display 450 (e.g., touchscreen display 112). Device 300 also optionally includes one or more contact intensity sensors (e.g., one or more of sensors 359) that detect the intensity of a contact on touch-sensitive surface 451, and / or one or more tactile output generators 357 that generate a tactile output for a user of device 300.
[0126] Although some of the following examples are given with reference to input on touchscreen display 112 (which combines a touch-sensitive surface and a display), in some embodiments, the device detects input on a touch-sensitive surface that is separate from the display shown in FIG. 4B . In some embodiments, the touch-sensitive surface (e.g., 451 in FIG. 4B ) has a primary axis (e.g., 452 in FIG. 4B ) that corresponds to a primary axis (e.g., 453 in FIG. 4B ) on the display (e.g., 450). According to these embodiments, the device detects contact with touch-sensitive surface 451 (e.g., 460 and 462 in FIG. 4B ) at locations that correspond to respective locations on the display (e.g., in FIG. 4B , 460 corresponds to 468 and 462 corresponds to 470). In this way, user input (e.g., contacts 460 and 462 and their movement) detected by the device on the touch-sensitive surface (e.g., 451 in FIG. 4B ) is used by the device to operate a user interface on the display (e.g., 450 in FIG. 4B ) of the multifunction device when the touch-sensitive surface is separate from the display. It should be understood that similar methods are optionally used for the other user interfaces described herein.
[0127] Additionally, while the following examples are given primarily with reference to finger input (e.g., finger contacts, finger tap gestures, finger swipe gestures), it should be understood that in some embodiments, one or more of the finger inputs are replaced with input from another input device (e.g., mouse-based input or stylus input). For example, a swipe gesture is optionally replaced by a mouse click (e.g., instead of a contact) followed by movement of a cursor along the path of the swipe (e.g., instead of movement of the contact). As another example, a tap gesture is optionally replaced with a mouse click while the cursor is positioned over the location of the tap gesture (e.g., instead of detecting a contact and subsequently ceasing contact detection). Similarly, it should be understood that when multiple user inputs are detected simultaneously, multiple computer mice are optionally used simultaneously, or a mouse and finger contacts are optionally used simultaneously.
[0128] FIG. 5A shows an exemplary personal electronic device 500. Device 500 includes a main body 502. In some embodiments, device 500 can include some or all of the features described with respect to devices 100 and 300 (e.g., FIGS. 1A-4B). In some embodiments, device 500 has a touch-sensitive display screen 504, hereafter referred to as touchscreen 504. Alternatively, or in addition to touchscreen 504, device 500 has a display and a touch-sensitive surface. Similar to devices 100 and 300, in some embodiments, touchscreen 504 (or the touch-sensitive surface) optionally includes one or more intensity sensors that detect the intensity of contact (e.g., touch) being applied. The one or more intensity sensors of touchscreen 504 (or the touch-sensitive surface) can provide output data representing the intensity of the touch. A user interface of device 500 can respond to a touch based on the intensity of the touch, meaning that touches of different intensities can invoke different user interface actions on device 500.
[0129] Exemplary techniques for detecting and processing touch intensity can be found, for example, in International Patent Application No. PCT / US2013 / 040061, filed May 8, 2013, entitled "Device, Method, and Graphical User Interface for Displaying User Interface Objects Corresponding to an Application," published as International Patent Application No. WO / 2013 / 169849, and related applications, including International Patent Application No. PCT / US2013 / 069483, filed November 11, 2013, entitled "Device, Method, and Graphical User Interface for Transitioning Between Touch Input to Display Output Relationships," published as International Patent Application No. WO / 2014 / 105276, each of which is incorporated herein by reference in its entirety.
[0130] In some embodiments, device 500 has one or more input mechanisms 506 and 508. Input mechanisms 506 and 508, if included, can be physical mechanisms. Examples of physical input mechanisms include push buttons and rotatable mechanisms. In some embodiments, device 500 has one or more attachment mechanisms. Such attachment mechanisms, if included, can allow device 500 to be attached to, for example, hats, eyewear, earrings, necklaces, shirts, jackets, bracelets, watch bands, chains, pants, belts, shoes, wallets, backpacks, etc. These attachment mechanisms allow a user to wear device 500.
[0131] FIG. 5B illustrates an exemplary personal electronic device 500. In some embodiments, device 500 can include some or all of the components described with respect to FIGS. 1A, 1B, and 3. Device 500 has a bus 512 that operably couples an I / O section 514 to one or more computer processors 516 and a memory 518. I / O section 514 can be connected to a display 504, which can have touch-sensing components 522 and, optionally, an intensity sensor 524 (e.g., a contact intensity sensor). Additionally, I / O section 514 can be connected to a communication unit 530 that receives application and operating system data using Wi-Fi, Bluetooth, near-field communication (NFC), cellular, and / or other wireless communication techniques. Device 500 can include input mechanisms 506 and / or 508. Input mechanism 506 is optionally a rotatable input device or a depressible and rotatable input device, for example. In some examples, input mechanism 508 is optionally a button.
[0132] In some examples, the input mechanism 508 is optionally a microphone. The personal electronic device 500 optionally includes various sensors, such as a GPS sensor 532, an accelerometer 534, an orientation sensor 540 (e.g., a compass), a gyroscope 536, a motion sensor 538, and / or combinations thereof, all of which may be operably connected to the I / O section 514.
[0133] The memory 518 of the personal electronic device 500 may include one or more non-transitory computer-readable storage media for storing computer-executable instructions that, when executed by one or more computer processors 516, may cause the computer processors to perform the techniques described below, including processes 700, 900, 1100, 1300, and 1500 (FIGS. 7, 9, 11, 13, and 15). A computer-readable storage medium may be any medium that can tangibly contain or store computer-executable instructions for use by or in connection with an instruction execution system, apparatus, or device. In some embodiments, the storage medium is a transient computer-readable storage medium. In some embodiments, the storage medium is a non-transitory computer-readable storage medium. Non-transitory computer-readable storage media may include, but are not limited to, magnetic, optical, and / or semiconductor storage devices. Examples of such storage devices include magnetic disks, optical disks based on CD, DVD, or Blu-ray technology, and resident solid-state memory such as flash, solid-state drives, etc. Personal electronic device 500 is not limited to the components and configuration of Figure 5B and may include other or additional components in multiple configurations.
[0134] As used herein, the term "affordance" refers to a user-interactive graphical user interface object that is optionally displayed on the display screen of device 100, 300, and / or 500 (FIGS. 1A, 3, and 5A-5B). For example, images (e.g., icons), buttons, and text (e.g., hyperlinks) each optionally constitute an affordance.
[0135] As used herein, the term “focus selector” refers to an input element that indicates the current portion of the user interface with which the user is interacting. In some implementations involving a cursor or other location marker, the cursor acts as the “focus selector,” such that when input (e.g., a press input) is detected on a touch-sensitive surface (e.g., touchpad 355 of FIG. 3 or touch-sensitive surface 451 of FIG. 4B) while the cursor is positioned over a particular user interface element (e.g., a button, window, slider, or other user interface element), the particular user interface element is adjusted according to the detected input. In some implementations involving a touchscreen display (e.g., touch-sensitive display system 112 of FIG. 1A or touchscreen 112 of FIG. 4A) that enables direct interaction with user interface elements on the touchscreen display, a detected contact on the touchscreen acts as the “focus selector,” such that when input (e.g., a press input by contact) is detected at the location of a particular user interface element (e.g., a button, window, slider, or other user interface element) on the touchscreen display, the particular user interface element is adjusted according to the detected input. In some implementations, focus is moved from one region of the user interface to another region of the user interface without a corresponding cursor movement or contact movement on the touchscreen display (e.g., by using the tab key or arrow keys to move focus from one button to another), and in these implementations the focus selector moves to follow the movement of focus between various regions of the user interface. Regardless of the particular form the focus selector takes, the focus selector is generally a user interface element (or contact on a touchscreen display) that is controlled by the user to communicate the user's intended interaction with the user interface (e.g., by indicating to the device which element of the user interface the user intends to interact with).For example, while a press input is detected on a touch-sensitive surface (e.g., a touchpad or touchscreen), the position of a focus selector (e.g., a cursor, touch, or selection box) over a corresponding button indicates that the user intends to activate that corresponding button (and not other user interface elements shown on the device's display).
[0136] As used herein and in the claims, the term "characteristic intensity" of a contact refers to a characteristic of that contact based on one or more intensities of the contact. In some embodiments, the characteristic intensity is based on a plurality of intensity samples. The characteristic intensity is optionally based on a predetermined number of intensity samples, i.e., a set of intensity samples collected during a predetermined time period (e.g., 0.05, 0.1, 0.2, 0.5, 1, 2, 5, 10 seconds) associated with a predetermined event (e.g., after detecting the contact, before detecting lift-off of the contact, before or after detecting the start of contact movement, before detecting the end of the contact, before or after detecting an increase in the intensity of the contact, and / or before or after detecting a decrease in the intensity of the contact). The characteristic intensity of the contact is optionally based on one or more of the maximum intensity of the contact, the mean intensity of the contact, the average intensity of the contact, the top 10 percentile intensity of the contact, half the maximum intensity of the contact, 90 percent of the maximum intensity of the contact, etc. In some embodiments, the duration of the contact is used in determining the characteristic intensity (e.g., when the characteristic intensity is an average of the intensity of the contact over time). In some embodiments, the characteristic intensity is compared to a set of one or more intensity thresholds to determine whether an action is performed by the user. For example, the set of one or more intensity thresholds optionally includes a first intensity threshold and a second intensity threshold. In this example, a contact having a characteristic intensity that does not exceed the first threshold results in a first action, a contact having a characteristic intensity that exceeds the first intensity threshold but not the second intensity threshold results in a second action, and a contact having a characteristic intensity that exceeds the second threshold results in a third action. In some embodiments, the comparison between the characteristic intensity and the one or more thresholds is not used to determine whether the first action or the second action should be performed, but rather is used to determine whether one or more actions should be performed (e.g., whether to perform the respective action or to refrain from performing the respective action).
[0137] FIG. 5C illustrates detecting multiple contacts 552A-552E on the touch-sensitive display screen 504 by multiple intensity sensors 524A-524D. FIG. 5C additionally includes an intensity diagram illustrating the current intensity measurements of intensity sensors 524A-524D relative to intensity units. In this example, intensity sensors 524A and 524D each measure 9 intensity units, and intensity sensors 524B and 524C each measure 7 intensity units. In some implementations, the aggregate intensity is the sum of the intensity measurements of multiple intensity sensors 524A-524D, which in this example is 32 intensity units. In some embodiments, each contact is assigned a respective intensity that is a fraction of the aggregate intensity. FIG. 5D illustrates assigning aggregate intensities to contacts 552A-552E based on their distance from the center of force 554. In this example, contacts 552A, 552B, and 552E are each assigned a contact intensity of 8 intensity units of aggregate intensity, and contacts 552C and 552D are each assigned a contact intensity of 4 intensity units of aggregate intensity. More generally, in some implementations, each contact j is assigned a respective intensity Ij, which is a fraction of a total intensity A, according to a predetermined mathematical function Ij=A·(Dj / ΣDi), where Dj is the distance from the center of force to the respective contact j, and ΣDi is the sum of the distances from the center of force to all respective contacts (e.g., from i=1 to the end). The operations described with reference to FIGS. 5C-5D can be performed using electronic devices similar to or identical to device 100, 300, or 500. In some embodiments, the characteristic intensity of a contact is based on one or more intensities of the contact. In some embodiments, an intensity sensor is used to determine a single characteristic intensity (e.g., a single characteristic intensity of a single contact). Note that the intensity diagrams are not part of the displayed user interface, but are included in FIGS. 5C-5D as an aid to the reader.
[0138] In some embodiments, a portion of the gesture is identified for purposes of determining the characteristic intensity. For example, the touch-sensitive surface optionally receives successive swipe contacts that transition from a start location to an end location, at which point the intensity of the contacts increases. In this example, the characteristic intensity of the contacts at the end location is optionally based on only a portion of the successive swipe contacts (e.g., only the portion of the swipe contacts at the end location) rather than the entire swipe contact. In some embodiments, a smoothing algorithm is optionally applied to the intensity of the swipe contacts before determining the characteristic intensity of the contacts. For example, the smoothing algorithm optionally includes one or more of an unweighted moving average smoothing algorithm, a triangular smoothing algorithm, a median filter smoothing algorithm, and / or an exponential smoothing algorithm. In some situations, these smoothing algorithms eliminate small increases or decreases in the intensity of the swipe contacts for purposes of determining the characteristic intensity.
[0139] The intensity of the contact on the touch-sensitive surface is optionally characterized with respect to one or more intensity thresholds, such as a contact-detection intensity threshold, a light press intensity threshold, a deep press intensity threshold, and / or one or more other intensity thresholds. In some embodiments, the light press intensity threshold corresponds to an intensity at which the device performs an action typically associated with clicking a physical mouse button or trackpad. In some embodiments, the deep press intensity threshold corresponds to an intensity at which the device performs an action different from an action typically associated with clicking a physical mouse button or trackpad. In some embodiments, when a contact is detected having a characteristic intensity below the light press intensity threshold (e.g., above a nominal contact-detection intensity threshold below which the contact is not detected), the device moves the focus selector according to the movement of the contact on the touch-sensitive surface without performing an action associated with the light press intensity threshold or the deep press intensity threshold. In general, unless otherwise specified, these intensity thresholds are consistent across the various sets of user interface diagrams.
[0140] An increase in the characteristic intensity of a contact from an intensity below the light pressure intensity threshold to an intensity between the light pressure intensity threshold and the deep pressure intensity threshold may be referred to as inputting a "light press." An increase in the characteristic intensity of a contact from an intensity below the deep pressure intensity threshold to an intensity above the deep pressure intensity threshold may be referred to as inputting a "deep press." An increase in the characteristic intensity of a contact from an intensity below the contact-detection intensity threshold to an intensity between the contact-detection intensity threshold and the light pressure intensity threshold may be referred to as detecting a contact on the touch surface. A decrease in the characteristic intensity of a contact from an intensity above the contact-detection intensity threshold to an intensity below the contact-detection intensity threshold may be referred to as detecting a lift-off of the contact from the touch surface. In some embodiments, the contact-detection intensity threshold is zero. In some embodiments, the contact-detection intensity threshold is greater than zero.
[0141] In some embodiments described herein, one or more actions are performed in response to detecting a gesture including the respective pressure input or in response to detecting the respective pressure input performed by the respective contact(s), where the respective pressure inputs are detected based at least in part on detecting an increase in intensity of the contact(s) above a pressure input intensity threshold. In some embodiments, the respective actions are performed in response to detecting an increase in intensity of the respective contact(s) above a pressure input intensity threshold (e.g., a “downstroke” of the respective pressure input). In some embodiments, the pressure input includes an increase in intensity of the respective contact(s) above a pressure input intensity threshold followed by a decrease in intensity of the contact(s) below the pressure input intensity threshold, and the respective actions are performed in response to detecting a subsequent decrease in intensity of the respective contact(s) below the pressure input intensity threshold (e.g., an “upstroke” of the respective pressure input).
[0142] 5E-5H illustrate the detection of a gesture including a press input corresponding to an increase in the intensity of contact 562 from an intensity below a light press intensity threshold (e.g., "ITL") in FIG. 5E to an intensity above a deep press intensity threshold (e.g., "ITD") in FIG. 5H. The gesture performed by contact 562 is detected on touch-sensitive surface 560, and cursor 576 is displayed over application icon 572B corresponding to app2 on display user interface 570, which includes application icons 572A-572D displayed within default region 574. In some embodiments, the gesture is detected on touch-sensitive display 504. An intensity sensor detects the intensity of the contact on touch-sensitive surface 560. The device determines that the intensity of contact 562 peaks above a deep press intensity threshold (e.g., "ITD"). Contact 562 is maintained on touch-sensitive surface 560. In response to detecting the gesture, contact 562 having an intensity above a deep pressure intensity threshold (e.g., "ITD") during the gesture causes reduced-scale representations 578A-578C (e.g., thumbnails) of recently opened documents to app2, as shown in FIGS. 5F-5H. In some embodiments, the intensity compared to one or more intensity thresholds is a characteristic intensity of the contact. Note that the intensity diagrams for contact 562 are not part of the displayed user interface, but are included in FIGS. 5E-5H as an aid to the reader.
[0143] In some embodiments, the display of representations 578A-578C includes animation. For example, as shown in FIG. 5F, representation 578A is first displayed adjacent to application icon 572B. As the animation progresses, representation 578A moves upward and representation 578B is displayed adjacent to application icon 572B, as shown in FIG. 5G. Then, as shown in FIG. 5H, representation 578A moves upward, representation 578B moves upward toward representation 578A, and representation 578C is displayed adjacent to application icon 572B. Representations 578A-578C form an array above icon 572B. In some embodiments, the animation progresses according to the intensity of contact 562, as shown in FIGS. 5F-5G, with representations 578A-578C appearing and moving upward as the intensity of contact 562 increases toward a deep pressure intensity threshold (e.g., "ITD"). In some embodiments, the intensity on which the animation progression is based is a characteristic intensity of the contact. The operations described with reference to FIGS. 5E-5H may be performed using an electronic device similar to or identical to device 100, 300, or 500.
[0144] In some embodiments, the device employs intensity hysteresis to avoid accidental input, sometimes referred to as “jitter,” and the device defines or selects a hysteresis intensity threshold that has a predetermined relationship to the pressure input intensity threshold (e.g., the hysteresis intensity threshold is X intensity units below the pressure input intensity threshold, or the hysteresis intensity threshold is 75%, 90%, or some reasonable percentage of the pressure input intensity threshold). Thus, in some embodiments, the pressure input includes an increase in the intensity of each contact above the pressure input intensity threshold, followed by a decrease in the intensity of the contact below the hysteresis intensity threshold corresponding to the pressure input intensity threshold, and a respective action is performed in response to detecting a subsequent decrease in the intensity of each contact below the hysteresis intensity threshold (e.g., an “upstroke” of each pressure input). Similarly, in some embodiments, a pressure input is detected only when the device detects an increase in the intensity of the contact from an intensity below the hysteresis intensity threshold to an intensity above the pressure input intensity threshold, and optionally a subsequent decrease in the intensity of the contact to an intensity below the hysteresis intensity, and a respective action is performed in response to detecting the pressure input (e.g., an increase in the intensity of the contact or a decrease in the intensity of the contact, depending on the context).
[0145] For ease of explanation, descriptions of operations performed in response to a pressure input associated with a pressure input intensity threshold, or a gesture including a pressure input, are optionally triggered in response to detecting any of: an increase in the intensity of the contact above the pressure input intensity threshold, an increase in the intensity of the contact from an intensity below a hysteresis intensity threshold to an intensity above the pressure input intensity threshold, a decrease in the intensity of the contact below the pressure input intensity threshold, and / or a decrease in the intensity of the contact below a hysteresis intensity threshold corresponding to the pressure input intensity threshold. Further, in examples where an operation is described as being performed in response to detecting a decrease in the intensity of the contact below a pressure input intensity threshold, the operation is optionally performed in response to detecting a decrease in the intensity of the contact below a hysteresis intensity threshold corresponding to and lower than the pressure input intensity threshold.
[0146] As used herein, an "installed application" refers to a software application that has been downloaded onto an electronic device (e.g., device 100, 300, and / or 500) and is ready to run (e.g., opened) on the device. In some embodiments, a downloaded application becomes an installed application by an installation program that extracts program portions from a downloaded package and integrates the extracted portions with the computer system's operating system.
[0147] As used herein, the terms "open application" or "running application" refer to a software application that has retained state information (e.g., as part of device / global internal state 157 and / or application internal state 192). An open or running application is, optionally, any one of the following types of application: ● the active application currently displayed on the display screen of the device on which the application is being used; background applications (or background processes) that are not currently displayed, but for which one or more processes are being processed by one or more processors; and • Suspended or hibernated applications that are not running but have state information stored in memory (volatile and non-volatile respectively) and that can be used to resume execution of the application.
[0148] As used herein, the term "closed application" refers to a software application that does not have retained state information (e.g., state information for a closed application is not stored in the device's memory). Thus, closing an application includes stopping and / or removing the application process for the application and removing state information for the application from the device's memory. Generally, opening a second application during a first application does not close the first application. When a second application is displayed and the first application is no longer displayed, the first application becomes a background application.
[0149] Attention is now directed to embodiments of user interfaces (“UIs”) and associated processes implemented on an electronic device such as portable multifunction device 100, device 300, or device 500. User Interface and Associated Processes User interface for displaying a representation of a messaging conversation
[0150] Users interact with electronic devices in many different ways, including using the electronic device to view messaging interactions. The embodiments described below provide methods for displaying representations of messaging interactions that, when selected, cause the electronic device to display the messaging interaction associated with the selected representation. In some embodiments, the electronic device displays one or more representations of messaging interactions in a "pinned" area of the user interface according to a user-defined order. Displaying representations of messaging interactions in a user-defined order enhances interaction with the device, such as by making it easier for a user to identify a representation of a particular interaction, and thus reduces the time a user needs to perform navigation operations and increases battery life for battery-powered devices by reducing the device's power usage. It is understood that people use devices. When a person uses a device, the person is optionally referred to as the device's user.
[0151] In some embodiments, the electronic device sorts one or more messaging interactions chronologically (e.g., based on the recency of messaging activity for those interactions). A user may desire to configure the electronic device to display one or more representations of messaging interactions at predetermined locations in the user interface independent of the chronology of the messaging activity. FIGS. 6A-6SS illustrate example ways in which an electronic device 500 displays representations of messaging interactions according to some embodiments. The embodiments in these figures are used to illustrate the processes described below, including the process described with reference to FIG. 7. While FIGS. 6A-6SS illustrate various examples of ways in which an electronic device may perform the processes described below with reference to FIG. 7, it should be understood that these examples are not intended to be limiting, and that an electronic device may perform one or more of the processes described below with reference to FIG. 7 in ways not explicitly described with reference to FIGS. 6A-6SS.
[0152] 6A shows electronic device 500 displaying an exemplary user interface 602 for configuring a pinned interaction of a messaging application. In some embodiments, user interface 602 is displayed in response to detecting activation of a pinned interaction (e.g., in response to user input to configure the pinned interaction, in response to installing an updated version of a messaging application on the electronic device that includes the pinned interaction). In some embodiments, pinning a interaction allows a user to place a representation of the interaction in a prominent location in the user interface so that it appears in an easily accessible location for as long as the interaction is pinned. For example, a user may message their best friend every day. The user may want to pin a representation of the messaging interaction at the top of the messaging application's user interface so that when the user enters the messaging application, the user can easily view the pinned interaction. The messaging application is optionally an application installed on electronic device 500 by which the electronic device can send and receive electronic messages and display information related to the messages as described herein. In some embodiments, a pinned interaction feature causes electronic device 500 to display one or more representations of an interaction in a fixed location in a messaging application, while representations of non-pinned interactions are sorted in a list format, e.g., based on how recently new messaging activity has been received for the interaction, with older messages displayed at the bottom of the list. In some embodiments, one or both of pinned and non-pinned messages are sorted according to different criteria. In some embodiments, both pinned and non-pinned messages are sorted according to the same criteria. For example, both types of messages can each be sorted chronologically or in a predetermined order.
[0153] As shown in Figure 6A, in some embodiments, the user selects option 604 to continue to configure the pinned interaction (e.g., with contact 603). In response to the user's selection in Figure 6A, electronic device 500 presents a user interface, such as the user interface shown in Figure 6B, for customizing the pinned interaction.
[0154] 6B illustrates an example messaging application user interface including representations 606a-606c of messaging interactions displayed in a pinned interactions area of the messaging application user interface and representations 610a-610d of interactions displayed in an unpinned messages area of the message user interface. In some embodiments, the messaging application may recommend a different number of interactions to be pinned. In some embodiments, the user may select representations of different interactions (e.g., 610a-d) to be pinned. The messaging interactions represented by representations 606a-c are optionally selected by electronic device 500 based on how frequently and / or recently messages have been received in the interaction and / or whether participants in the interaction are on electronic device 500's favorite contacts list. In some embodiments, electronic device 500 does not suggest which interactions are pinned.
[0155] Representations 606a-606c are optionally displayed with a selectable option 608 that, when selected, causes electronic device 500 to remove the interaction from the pinned interaction area (e.g., move it to the unpinned area as representation 610). Representations 610a-d are optionally displayed with a selectable option 612 that, when selected, causes electronic device 500 to add the respective interaction to the pinned interaction area (e.g., and remove it from the unpinned area as representation 610). In some embodiments, a user can select which representations to display in the pinned interaction area and which representations to display in the unpinned interaction area. In some embodiments, representations 610a-d of unpinned messaging interactions are sorted based on how recent new messaging activity has been received for the interaction. In some embodiments, representation 606a of a pinned interaction is sorted by messaging interaction or other criteria, often based on how recent new messaging activity has been received.
[0156] In some embodiments, the user interface shown in FIG. 6B further includes a selectable option 614a that, when selected, causes the electronic device 500 to avoid adding any interactions to the pinned interaction area of the messaging user interface, and a selectable option 614b that, when selected, causes the electronic device 500 to save the displayed arrangement of pinned and unpinned interactions and display the message user interface.
[0157] As shown in FIG. 6B, in some embodiments, the user selects option 614b (e.g., with contact 603) to save the configuration of pinned and unpinned interactions and display a messaging user interface with the pinned and unpinned interactions displayed according to the configuration, as shown in, for example, FIG. 6C.
[0158] FIG. 6C shows an exemplary messaging user interface including representations 606a-c of pinned interactions and representations 616a-f of unpinned interactions. As in FIG. 6C, the arrangement of representations 606a-c and 616a-f is the same as in FIG. 6B. Thus, in some embodiments, a user can use the user interface shown in FIG. 6B to configure the messaging user interface, for example, by selecting which interactions should be pinned, which interactions should not be pinned, and the arrangement of the pinned interactions in the displayed user interface. Electronic device 500 then displays the messaging user interface according to the configuration, for example, as shown in FIG. 6C. The user interface optionally includes selectable option 622a that, when selected, causes electronic device 500 to display one or more settings related to the messaging user interface, and selectable option 622b that, when selected, causes electronic device 500 to initiate a process for creating a new message. In some embodiments, one or more settings related to the messaging user interface displayed in response to selection of option 622a include options to rearrange and change interactions currently displayed in the pinned interaction area of the user interface.
[0159] Representations 606a-c of pinned messaging interactions optionally include images (e.g., avatars) representing one or more users participating in each messaging interaction. In some implementations, the images of the interaction participants do not include the users of electronic device 500. In some implementations, each representation of a messaging interaction includes text indicating the names of the users of the interaction. In some embodiments, group interactions are given nicknames that are displayed in place of the names of the participants in the interaction. In some embodiments, an image is associated with the group interaction (e.g., other than an image associated with the users of the interaction), and the image is used to represent the group messaging interaction; e.g., an image associated with the users of the interaction is replaced with an image associated with the interaction, as described in more detail below with reference to FIG. 6I.
[0160] In some embodiments, representations 616a-f of an unpinned messaging interaction each include an image 618a representing a user or users included in the interaction other than the user of electronic device 500, an indication 618b of the names of one or more users of the interaction other than the user of electronic device 500, and an indication 618c of the interaction's most recent messaging activity. Representations 616a-b and 616d-f optionally represent interactions that include one other user in addition to the user of electronic device 500, and representation 616c represents an interaction that includes two users in addition to the user of electronic device 500. In some embodiments, if an image is associated with a group interaction other than an image representing a user of the interaction, electronic device 500 displays an image associated with the group in representation 616 (e.g., in representation 616c) instead of an image associated with a user of the interaction.
[0161] In some embodiments, representations 606a-c of pinned interactions do not include notifications of messaging activity in the most recent interactions, e.g., because there is no messaging activity in those interactions that are not read by the user of electronic device 500. In contrast, in some embodiments, representations 616a-f of unpinned interactions include notifications of messaging activity in the most recent interactions, e.g., because messaging activity in those interactions is “read” by the user. In some embodiments, messaging activity includes messages (e.g., text messages, audio messages, messages including images or other media) and tags added to messages (e.g., heart tags, thumbs up tags, thumbs down tags, loud tags, emphasis tags, etc.).
[0162] 6D , electronic device 500 optionally detects an indication 624d of messaging activity received from a contact (e.g., Alice) who is engaged in a messaging interaction with the user of electronic device 500, who has the user pinned to the messaging application user interface. In response to detecting the indication 624 of receipt of Alice's message, electronic device 500 optionally displays a representation 626a of the received unread messaging activity, which is superimposed on representation 606a of the messaging interaction, with the addition of a tag (e.g., a "heart" tag) to one of the messages in the interaction. Electronic device 500 optionally further displays an indication 620a that unread messaging activity exists in the interaction proximate to representation 606a of the messaging interaction.
[0163] In Figure 6E, electronic device 500 receives indication 624e that a user (e.g., Bob) is providing input to create a messaging activity in one of the interactions (e.g., currently typing a message before sending the message). In response to indication 624e, electronic device 500 optionally displays indication of input 626b superimposed on representation 606b of the messaging interaction in which the user is providing input. As shown in Figure 6E, indication 626a of messaging activity in the other (e.g., Alice) interaction optionally remains displayed at the same size and / or location as indication 626a displayed in Figure 6D. In some embodiments, indication 626a is displayed at a smaller size in response to receiving indication 624e.
[0164] 6F , electronic device 500 optionally receives an indication 624f of messaging activity received in one of the interactions (e.g., an interaction with Bob). As shown in FIG. 6F , in response to receiving a new message added to the interaction indication 624f, electronic device 500 displays a representation 626c of a new unread message. The content of representation 626c is optionally the content of the message, and representation 626c is optionally displayed superimposed on representation 606b of the messaging interaction. In some embodiments, if the length of the incoming message exceeds a predetermined threshold, notification of message 626c includes the first portion of the message text, followed by a notification that the message continues (e.g., "..."). Electronic device 500 optionally further displays an indication 620b that unread messaging activity exists in the interaction represented by representation 606b adjacent to representation 606b of the interaction. As shown in FIG. 6F , in some embodiments, in response to receiving a new message indication, e.g., instruction 624f, electronic device 500 changes the size (e.g., reduces the size) and / or location of previously received unread messages for the pinned interaction. For example, as shown in FIG. 6F , when instruction 626c is received for the messaging interaction represented by representation 606b, indication 626a of previously received unread messaging activity for the interaction with Alice is reduced in size. In some embodiments, the location of the unread message notification is displayed in the same relative position for each pinned interaction. For example, as shown in FIG. 6F , indication 626c is the same for representation 606b as the position of instruction 626a for representation 606a. In some embodiments, electronic device 500 ceases displaying notifications for unread messages for other pinned interactions when a new unread message is received for a particular messaging interaction. Instead, only the notification for the most recently received new unread message is displayed. For example, in FIG. 6F, instruction 626b may be the only instruction shown in the pinned interaction area in response to receiving instruction 624f.
[0165] 6G , electronic device 500 optionally receives an indication 624g of a messaging activity for one of the messaging interactions (e.g., an interaction with Alice). In response to indication 624g, electronic device 500 optionally displays an indication 626d of the messaging activity superimposed on representation 606a of the messaging interaction, decreasing the size (while maintaining the same position) and / or changing the position of previously received indication 626c of the messaging activity. In some embodiments, indication 626d of the messaging activity includes at least a portion of the message. If the length of the message exceeds a predetermined threshold, electronic device 500 displays a first portion of the message with a notification that the message continues (e.g., "..."). In some embodiments, indication 626a continues to be displayed in response to indication 624g. In some embodiments, indication 626d is displayed in the same location where indication 626a was displayed. In some embodiments, indication 626d is displayed in a different location than where indication 626a was displayed. The electronic device 500 optionally continues to display the indication 620a of unread messaging activity for the messaging conversation. In some embodiments, the electronic device 500 ceases displaying the representation 626a shown in FIG. 6F of previously received messaging activity for the same messaging conversation.
[0166] In FIG. 6H , electronic device 500 optionally receives an indication 624h of messaging activity in one of the unpinned interactions (e.g., the interaction with Mom). In some embodiments, electronic device 500 updates representation 616f of the interaction to include an indication 618f of the interaction's most recent messaging activity and an indication 620c that there is unread messaging activity for the interaction. As shown in FIG. 6H , indication 620c may be a dot displayed next to image 618d representing the user of the interaction for whom a message was received. In some embodiments, rather than displaying indication 620c, electronic device 500 may update representation 616f of the messaging interaction, such as changing the color, size, translucency of representation 616f, or changing the size and / or text styling of name 618e of the user of the message interaction or text 618f. In some embodiments, electronic device 500 reorders representations 618a-f of the unpinned messaging interactions to display representation 616f, starting with Mom, at the top of the list of representations in the unpinned area. 6H, the size of indications 626c-d of messaging activity received for a pinned interaction optionally does not change in response to indication 624h of messaging activity received for a pinned interaction. However, in some embodiments, indications 626c-d are displayed at a smaller size than they were before responding to indication 624h. In some embodiments, the size of notifications 626c-d decreases over time (e.g., as time passes due to received messaging activity for those notifications 626c-d) regardless of newly received messaging activity in either pinned or unpinned interactions.
[0167] As shown in FIG. 6I , in some embodiments, electronic device 500 receives an indication 624i of new messaging activity received in a pinned group interaction (e.g., from Chris in the Chris, Alex, and Eve interaction). In response to indication 624i, electronic device 500 optionally displays an indication 622e of messaging activity superimposed on representation 606c of the interaction proximate an image associated with Chris, and displays an indication 620d of unread messaging activity proximate representation 606c of the interaction. Electronic device 500 optionally updates representation 606c of the interaction to display an image corresponding to the contact who sent the message on the remaining side (e.g., left side) of representation 606c (e.g., Chris's avatar moves from within representation 606c to an outer portion of representation 606c). As shown in FIG. 6I , in some embodiments, indication 622e is displayed proximate to Chris's avatar. In some embodiments, representations of other users in the group interaction remain inside representation 606c. In some embodiments, if the representation 606c of the group interaction is an image other than an image associated with a user of the interaction, the electronic device 500 optionally updates the representation 606c to include an image (e.g., an avatar) corresponding to the user who sent the received message, as shown in FIG. 6I, but the display is superimposed on an outer portion of the image representing the group, rather than on an outer portion of the container with images representing other users of the interaction (e.g., as shown in FIG. 6I). In some embodiments, the instructions 622e include at least a portion of the content of the message. If the message is less than a threshold length, the instructions 622e optionally include the entire content of the message. If the message is greater than the threshold length, the instructions 622e optionally include a first portion of the message and an indication that the message continues (e.g., "...").
[0168] As also shown in Figure 6I, in some embodiments, instructions 626c-d of other messaging activities of the pinned interaction are reduced in size (e.g., while remaining in the same location) in response to instruction 624i, and the size of instructions 626c-d is smaller than the size of instructions 626c-d in Figure 6H before receiving instruction 624i.
[0169] As shown in Figure 6I, in some embodiments, the user selects a representation 606a of one of the interactions (e.g., with contacts 603). In response to the user's selection in Figure 6I, electronic device 500 optionally displays the messaging interaction corresponding to representation 606a, as shown in Figure 6J.
[0170] As shown in Figure 6J, electronic device 500 optionally displays user interface 626 including a notification of messaging activity for the messaging conversation, including a notification of a tag added to one of the received messages in Figure 6D and a representation of the received message in Figure 6G. As shown in Figure 6J, in some embodiments, the user returns to the user interface shown in Figure 6K (e.g., with contact 603). As shown in Figure 6K, in some embodiments, when electronic device 500 displays the messaging user interface again, electronic device 500 optionally displays representation 606a without indication 626d and 620a because the message associated with representation 626d has been read by the user of electronic device 500 (e.g., the content of the messaging conversation is being displayed by device 500 in Figure 6J) and there are no new unread messages associated with the message conversation with Alice.
[0171] In some embodiments, the electronic device 500 provides a way for a user to rearrange the representation of messaging interactions in the messaging user interface to move unpinned interactions into a group of pinned interactions and vice versa.
[0172] In Figure 6K, for example, a user selects one of the representations 616c of unpinned interactions (e.g., with contact 603). In some embodiments, contact 603 is detected on representation 616c for a period of time that exceeds a predetermined threshold (e.g., 0.25 seconds, or 0.5 seconds, or 1 second) before movement of the contact is detected, thereby dragging the representation of the interaction, as shown in Figure 6L. In some embodiments, if contact 603 is not detected for longer than the predetermined threshold before movement of the contact is detected, the input is optionally interpreted as a scroll input to scroll the unpinned interactions, rather than an input to move the unpinned interactions into a pinned region.
[0173] In some embodiments, after a predetermined threshold (e.g., when the user begins to move contact 603), device 500 optionally ceases displaying representation 616c in the unpinned region and changes the representation of the interaction to representation 606d (e.g., the pinned region representation), as shown in Figure 6L. In Figure 6L, the user continues to optionally drag representation 606d of the interaction, which is optionally now a representation of the pinned interaction, toward other representations 606a-c of the pinned interactions (e.g., with contact 603). In some embodiments, when electronic device 500 begins displaying representation 606d, electronic device 500 moves representations 616a-b and 616d-g downward to create an open row in the pinned region of the user interface (e.g., the row in which representation 606c is displayed in Figure 6M, the area in which message 648 is displayed in Figure 6FF, etc.), toward which the user can drag representation 606d, if the user chooses to do so. In some embodiments, representation 616c remains displayed until it is dragged into a pinned interaction area of the user interface. In some embodiments, once representation 616c is dragged into a pinned interaction area of the user interface, electronic device 500 replaces representation 616c with pinned interaction representation 606d.
[0174] In FIG. 6M, the user places representation 606d in a messaging interaction with other representations 606a-c in the pinned interaction (e.g., representation 606d is optionally placed upon detecting lift-off of contact 603 at the location of contact 603 when lift-off is detected). As shown in FIG. 6M, in some embodiments, the user can select a location within the pinned interaction area to place representation 606d. In FIG. 6M, the user moves representation 606d to a location determined to be representation 606c (e.g., closer to representation 606c than to another representation, e.g., representation 606b), optionally causing representation 606d to be displayed instead of representation 606c, lifts off contact 603, and moves representation 606c down to a second line of display in the pinned area (e.g., automatically created by device 500 upon detecting the addition of representation 606d and the overflow of the first line of pinned representations). In contrast to the ordering of pinned interactions, in some embodiments, representations 616a-616b and 616d-f of unpinned interactions are arranged according to the order in which the interactions' most recent messaging activity was received.
[0175] As also shown in Figure 6M, in some embodiments, a user selects (e.g., with contact 603) another pinned representation of an interaction 606a. In some embodiments, contact 603 is detected on representation 606a for a period of time that exceeds a predetermined threshold (e.g., 0.25 seconds, or 0.5 seconds, or 1 second) before movement of the contact is detected, thereby dragging the representation of the interaction, as shown in Figure 6N.
[0176] In some embodiments, upon detecting movement of representation 606a outside the pinned region and into an unpinned region, device 500 changes representation 606a to unpinned representation 616h (e.g., no longer displays representation 606a), as shown in Figure 6N. In Figure 6N, the user continues to drag representation 616h of the messaging interaction, which is currently displayed as representation 616h of the unpinned interaction, to, for example, an unpinned interaction area of the user interface (e.g., with contact 603). Thus, as shown in Figure 6N, in some embodiments, as soon as the user drags representation 606a from the pinned region of the user interface to the unpinned region of the user interface, the representation of the interaction is displayed as representation 616h of the unpinned interaction. However, in some embodiments, the electronic device 500 displays the pinned interaction representation 606a while the user continues to drag the representation to an unpinned area of the user interface and, in response to detecting lift-off of the contact 603 shown in FIG. 6N, updates the representation to the unpinned interaction representation 616h.
[0177] 6O , when contact 603 lift-off is detected, electronic device 500 displays representation 616h of the messaging interaction among the other representations 616a-b and 616d-f of the unpinned interactions. Rather than displaying representation 616h where contact 603 lift-off was detected, electronic device 500 sorts representations 616 of the unpinned interactions according to how the last messaging activity for each interaction was received. Thus, in some embodiments, in response to detecting contact 603 lift-off, representation 616h is displayed above representation 616a of the unpinned interaction area because, even though contact 603 lift-off was detected while representation 616h was displayed below representation 616a, the last messaging activity for the interaction corresponding to representation 616h was more recent than the last messaging activity for the interaction corresponding to representation 616a.
[0178] 6O, the user can select (e.g., with contacts 603) option 622a that indicates one or more selectable options for performing an action related to a message user interface (e.g., selecting one or more messaging interactions, editing information associated with the electronic device's user account, editing pinned and unpinned interactions). In some embodiments, the user can select an option (not shown) that causes electronic device 500 to display a user interface for editing which interactions are pinned and unpinned.
[0179] FIG. 6P shows an exemplary user interface for editing which interactions are pinned and unpinned. The user interface shown in FIG. 6P is optionally similar to the user interface described above with reference to FIG. 6B. Representations 606b-d of pinned interactions may include a selectable option 608 that, when selected, causes electronic device 500 to remove the associated representation 606 from the pinned interactions (e.g., and move the interaction to the unpinned area). The electronic device may animate representations 606b-d of pinned interactions with a wiggle or other movement to indicate that the positions of representations 606b-d can be changed and which interactions are pinned and unpinned can be changed. Representations 610a-b, 610d, 610f, and 610h of unpinned interactions optionally include a selectable option 612 that, when selected, causes electronic device 500 to add the associated representation 610 to the pinned interactions (e.g., and remove the interaction from the unpinned area). Thus, in some embodiments, electronic device 500 moves the representation between the pinned and unpinned interaction sections of the user interface according to one or more user inputs to do so. As shown in Figure 6P, in some embodiments, the user selects an option (e.g., with contact 603) to save the changes to the pinned interaction and return to the user interface shown in Figure 6Q.
[0180] In Figure 6Q, in some embodiments, the user selects (e.g., with contacts 603) representation 616f of the interaction with unread messages, as indicated by instruction 620c included in representation 616f. In response to the user's selection, electronic device 500 optionally displays the messaging interaction in a manner similar to how Figure 6J illustrates a different messaging interaction. After the user returns from the messaging interaction, electronic device 500 optionally displays representation 616f of the messaging interaction without instruction 620c of unread messages, as shown in Figure 6R, because the messages have been read by the user.
[0181] FIG. 6S shows electronic device 500 displaying an exemplary messaging user interface having representations 606e, 606g, 616i, and 616j of a group interaction including three or more users (including the user of electronic device 500) (e.g., in addition to other representations of the interaction, the details of which are described with reference to FIGS. 6A-6R).
[0182] Representations 606e and 616i optionally include images (e.g., avatars) 630a-630f of other users included in the group interaction. Representations 630a-630f are optionally sized based on how recently each user has sent messaging activity to the group interaction. In the interaction associated with representation 606e, representation 630f is optionally displayed at the largest size among the other representations of the interaction because the user associated with that representation 630f is the most recent user other than the user of electronic device 500 to send messaging activity to the group interaction. The user associated with representation 630d is optionally the least recent user other than the user of electronic device 500 to send messaging activity to the group interaction, and thus representation 630d is optionally the smallest representation of a user included in representation 606e of the group interaction. In some embodiments, representation 616i of an unpinned group interaction similarly includes avatars 630a-c of the users of the group interaction. In some embodiments, pinned and unpinned representations of a group interaction are displayed in a similar manner. In some embodiments, electronic device 500 displays representations of users up to a maximum number of user representations (e.g., 5, 6, 7, 8, or 9 users) in the user interface shown in FIG. 6S. If there are more users in the interaction than the maximum number of user representations displayed, electronic device 500 optionally displays, in the representation of the group interaction, the maximum number of users who most recently added messaging activity to the messaging interaction. In some embodiments, while displaying the messaging interaction of a group interaction (e.g., in a user interface similar to the user interface shown in FIG. 6J), electronic device 500 may display a different maximum number of user representations (e.g., 4, 5, 6, 7, 8, 9, 10, 11, 12, or 13) at the top of the user interface that is either more or less than the maximum number of user representations that can be displayed in the representation of the group interaction in the user interface shown in FIG. 6S.In some implementations, representations of messages that display images associated with others in the group message are based on templates. Each template can vary the size and position of images associated with others in the group message. The size and position of images can be varied based on the recency of the message received by each person in the group. A particular template can be based on the number of people in the group message. For example, a group message that includes three people other than the user of the electronic device may have space for three images representing the other people in the group message. Each group message that includes three people other than the user of the electronic device can use the same template (e.g., vary the size and position in the same way) so that each group message representation shows images in a uniform manner. For example, an image representing the person who sent the most recent message can be shown to the right of the group representation, at the largest size of the group member representations.
[0183] Representations 606g and 616j, for example, include images 628a and 628b associated with the group interactions. Because these group interactions have associated images 628a and 628b set by the respective users of the respective interactions, images 628a and 628b are optionally displayed in place of images (e.g., avatars) associated with the users of the interactions. Thus, in some embodiments, representations of pinned and unpinned group interactions having associated images (e.g., other than the avatars of the users of the group interaction) are displayed in a similar manner.
[0184] 6T, electronic device 500 detects an indication 624t of a message received in a group interaction associated with representation 606e. In response to representation 624t, electronic device 500 optionally displays a representation 630d of the user who sent the message at the periphery (e.g., an outer portion) of representation 606e (e.g., by moving representation 630d to the periphery of representation 606e), a representation 626e of the contents of the message displayed with (e.g., overlaid on a portion of) representation 630d, and an indication 620e that there are unread messages in the interaction.
[0185] In some embodiments, representation 630d is displayed at a larger size in Figure 6T than in Figure 6S. In some embodiments, when a user views the messaging interaction associated with representation 606e and returns to the user interface shown in Figure 6T, electronic device 500 updates representation 606e to include representation 630d within it. In some embodiments, representation 630d should be displayed at a larger size than the other representations 630e and 630f within the representation because the most recent message is from the user associated with representation 630f, and representation 630f should be displayed larger than representation 630e because the user associated with representation 630f has contributed more recent messaging activity to the interaction than the user associated with representation 630e.
[0186] As mentioned above, in some embodiments, if the number of users in the interaction exceeds a predetermined threshold (e.g., 5 or 6 or 7 or 8 or 9, etc.), only the most number of users with recent messaging activity are displayed in the representation of the group interaction. In response to receiving messaging activity from a user whose representation is not included in the representation of the group interaction (e.g., because the user has not recently contributed messaging activity to the interaction), electronic device 500 optionally displays a representation of the user on the edge of the representation of the group interaction, and the least number of users in the representation of the group are no longer displayed.
[0187] In some embodiments, if a message is received in an interaction associated with representation 606g, electronic device 500 displays the representation of the user who sent the message in a manner similar to how electronic device 500 displays representation 630d of the user who sent the message in interaction 606e. For example, electronic device 500 displays (e.g., adds) the representation of the user in the periphery of image 606g with the representation of the received message.
[0188] In some embodiments, if a message is received in either interaction associated with representation 616i and representation 616j (e.g., an unpinned message interaction in an unpinned messaging area of a messaging application user interface), electronic device 500 does not display a representation of the user who sent the message or the circle in which representations 630a-c are displayed in the periphery of image 628b. Instead, electronic device 500 optionally updates the text of representation 616i or 616j to include a notification of the most recent message, as described above. In some embodiments, if one of the users associated with representation 630b or 630c sends a message to the interaction associated with representation 616i, electronic device 500 optionally updates representation 616i of the interaction to display the representation of the user who sent the most recent message in the largest size compared to the representations of the other users. If the number of users in the interaction exceeds the maximum number of user representations that can be displayed simultaneously in the representation of the group interaction and the user who provided the most recent messaging activity is not currently displayed in the representation of the group, the electronic device updates the group representation to remove the smallest representation of the user in the representation, reduce the size of the other user representations, add the representation of the most recently sent user to the representation of the group message, and display that user representation at its largest size.
[0189] 6U, electronic device 500 optionally detects an indication 624u of another incoming message of the interaction associated with representation 606e from a user associated with image 630e (e.g., Alice). In response to detecting indication 624u, electronic device 500 displays image 630e in a periphery (e.g., outer portion) of representation 606e of the interaction and displays an indication 626f of the received message superimposed on image 630e. Electronic device 500 optionally reduces the size of image 630d and indication 626e in response to indication 624u. In some embodiments, electronic device 500 updates the user interface to display image 630d away from the periphery of representation 606e (e.g., entirely within representation 606e) in response to indication 624u.
[0190] While Figure 6U shows that, in some embodiments, electronic device 500 decreases the size of instruction 626e in response to instruction 624u, electronic device 500 ceases displaying instruction 626e in response to instruction 624u as shown in Figure 6V. As shown in Figure 6V, in response to receiving message instruction 624u, electronic device 500 displays representation 630e of the contact who sent the message in the periphery of representation 606e of the group interaction with representation 626f of the message. Representation 630d of the contact who sent the previously received message is optionally displayed at a smaller size than the size at which representation 630d was displayed in Figure 6T. In some embodiments, electronic device 500 displays an incoming message notification in representation 606g similar to the examples described with reference to Figures 6T-6V because representation 606g is a representation of a pinned interaction. In some embodiments, electronic device 500 ceases displaying notifications of received messages in the manner described with reference to Figures 6T-6V for representations 616i and 616j because representations 616i and 616j are representations of unpinned interactions. As shown in Figure 6V, as more messaging activity is received in the group interaction, representations of contacts who sent messages are displayed on alternating sides of the periphery of representation 606e, as described in more detail below with reference to Figures 6II-6LL.
[0191] In some embodiments, as described above, a user may wish to edit which interactions are pinned to the top of the message user interface. In some embodiments, electronic device 500 can initiate an additional process to move representations of interactions from unpinned areas of the user interface to pinned areas of the user interface, as described next.
[0192] As shown in Figure 6W, the user swipes right (e.g., with contact 603) over representation 616h of an unpinned interaction. In some embodiments, in response to a right swipe that satisfies one or more criteria (e.g., speed- or length-based criteria, such as speed above a threshold or length above a threshold), electronic device 500 pins the interaction (e.g., pins it as representation 606a) without additional input, as shown in Figure 6Z. In some embodiments, in response to a right swipe that fails to meet one or more criteria (e.g., speed- or length-based criteria, speed or length below a respective threshold, etc.), electronic device 500 displays an option to pin the interaction, as shown in Figure 6X.
[0193] In Figure 6X, in response to a swipe input that does not meet one or more criteria, such as the swipe input shown in Figure 6W, electronic device 500 displays option 632 adjacent to representation 616h that, when selected, causes electronic device 500 to display option 632 to pin the interaction associated with representation 616h. As shown in Figure 6Y, the user selects option 632 (e.g., with contact 603) to pin the interaction associated with representation 616h.
[0194] Figure 6Z shows the user interface after the interaction associated with representation 616h shown in Figures 6W-6Y has been pinned. Electronic device 500 displays representation 606a of the interaction in the pinned interaction area in response to either a swipe input that meets the criteria, such as the swipe input shown in Figure 6W, or selection of option 632 to pin the interaction, as shown in Figure 6Y. As shown in Figure 6Z, representation 616h optionally disappears from the unpinned interaction area. In some embodiments, representation 606a is added to the end of the pinned interaction.
[0195] In some embodiments, electronic device 500, in response to detecting a selection of a representation of an interaction having a first special characteristic (e.g., a contact that remains in place for a predetermined time, such as a touch-and-hold input), displays a menu associated with the messaging interaction that includes an option to add the interaction to the pinned interactions. For example, FIG. 6Z shows a user selecting interaction representation 616b (e.g., with contact 603). In some embodiments, the selection (e.g., with contact 603) is detected for a time that exceeds a predetermined threshold (e.g., 0.5 seconds, 1 second, 2 seconds).
[0196] In response to the user's selection of Figure 6Z, electronic device 500 optionally displays the user interface shown in Figure 6AA. As shown in Figure 6AA, electronic device 500 optionally displays a representation 642a of a messaging interaction corresponding to representation 616b, as well as a plurality of selectable options 644a-c that, when selected, cause electronic device 500 to send the content and message indicated by the selected option to the messaging interaction, option 644d that, when selected, causes electronic device 500 to send a custom message to the messaging interaction, and option 646a that, when selected, causes electronic device 500 to pin the messaging interaction associated with representation 616b. In Figure 6AA, the user selects option 646a (e.g., with contacts 603) to pin the interaction.
[0197] In some embodiments, in response to the user's selection of Figure 6AA, electronic device 500 updates the user interface to present representation 606h of the messaging interaction in the pinned interaction area of the user interface (e.g., and no longer displays representation 616b in the unpinned interaction area of the user interface), as shown in Figure 6BB. In some embodiments, representation 606h is displayed at the end of the pinned interaction section of the user interface.
[0198] 6BB, the user selects one of the pinned interaction representations 606a (e.g., with contact 603). In some embodiments, electronic device 500 detects contact 603 for a time period that exceeds a predetermined threshold (e.g., 0.5 seconds, 1 second, 2 seconds). In some embodiments, in response to detecting contact 603 shown in FIG. 6BB for a time period that exceeds the threshold, electronic device 500 displays the user interface shown in FIG. 6CC.
[0199] 6CC, electronic device 500 optionally displays a representation 642b of a messaging interaction corresponding to representation 606a, as well as a plurality of selectable options 644e-g that, when selected, cause electronic device 500 to send a message to the messaging interaction indicated by the selected option, an option 644h to send a custom message to the interaction, and an option 646b to unpin the interaction. As shown in FIG. 6CC, the user selects option 646b (e.g., with contacts 603) to unpin the interaction.
[0200] In some embodiments, in response to the user's selection of FIG. 6CC, the electronic device 500 stops displaying the representation 606a shown in FIG. 6BB and instead updates the messaging user interface to display a representation 616h of the interaction in the unpinned interaction area of the user interface, as shown in FIG. 6DD.
[0201] In some embodiments, while electronic device 500 displays representations of messaging interactions in unpinned regions of the user interface without displaying representations of the messaging interactions in pinned regions of the user interface (e.g., because the interactions have not yet been placed in a pinned region by the user), the user may desire to move any one or more of the representations to a pinned region of the user interface. In response to an input to begin dragging a representation of an unpinned messaging interaction, electronic device 500 optionally displays a notification of where to drag and drop the representation of the unpinned interaction to pin the interaction when there are no unpinned interactions in the user interface, as described next with reference to FIGS.
[0202] In some embodiments, as shown in FIG. 6EE, electronic device 500 displays a messaging user interface including representations 616 of messaging interactions. Electronic device 500 optionally displays representations 616 such that representations 616 of interactions with the most recent messaging activity are displayed toward the top of the user interface. For example, the interaction associated with representation 616i has the most recent messaging activity, and the interaction associated with representation 616l has the least recent messaging activity among the interactions for which representation 616 is currently displayed. In some embodiments, a user can scroll down in the messaging user interface to reveal additional representations of unpinned interactions. In FIG. 6EE, the interaction is not yet pinned. As shown in FIG. 6EE, a user selects (e.g., with contact 603) one of the messaging interaction representations 616h, for example. Electronic device 500 optionally detects contact 603 for a time period that exceeds a predetermined threshold (e.g., 0.5 seconds, 1 second, 2 seconds). In some embodiments, in response to the electronic device 500 detecting the contact 603 for a time period exceeding a predetermined threshold, the electronic device 500 displays a notification of where to drag the representation to pin the interaction (e.g., at the top of the messaging user interface, in an area corresponding to where the pinned interaction will be displayed), as shown in FIG.
[0203] As shown in Figure 6FF, electronic device 500 optionally displays representation 606a and an indication 648 of the region of the user interface corresponding to the pinned interactive region of the user interface. In some embodiments, representation 616h shown in Figure 6EE is replaced with representation 606a shown in Figure 6FF in response to detecting contact 603 shown in Figure 6EE for a time that exceeds a predetermined time threshold before the user begins dragging representation 606a of the interaction. In some embodiments, representation 616h shown in Figure 6EE is replaced with representation 606a shown in Figure 6FF in response to the user dragging representation 606a at least a threshold distance. In response to detecting the user dragging representation 606a (e.g., using the contact) into region 648, electronic device 500 optionally displays representation 606a in the pinned interactive region of the user interface, as shown in Figures 6GG-6HH.
[0204] In some embodiments, as shown in Figure 6GG, the user drags representation 606a with contact 603 to indication 648. In response to detecting lift-off of contact 603 at the location shown in Figure 6GG (or at any other location overlaid indication 648), electronic device 500 optionally displays interaction representation 606a of the pinned interaction area of the user interface, as shown in Figure 6HH.
[0205] In some embodiments, as shown in Figure 6HH, in response to a user dragging and dropping representation 606a onto instruction 648b, as shown in Figures 6EE-6GG, electronic device 500 displays representation 606a in a predetermined location (e.g., on the left side, in a first position of the pinned region, etc.) in the pinned interactive region of the user interface. In some embodiments, because representation 606a is optionally the first representation displayed in the pinned region, electronic device 500 displays representation 606a in a predetermined location (e.g., on the left side) in the pinned interactive region regardless of where in the region representation 606a is dropped.
[0206] In some embodiments, rather than displaying representation 606a in a predetermined location (e.g., to the left) of the pinned interactive region as shown in Figure 6HH, electronic device 500 displays representation 606a proximate to where representation 606a was dropped (e.g., in response to detecting lift-off of contact 603). For example, in response to detecting representation 606a being dropped at the location shown in Figure 6GG, electronic device 500 optionally displays representation 606a in the center of the pinned interactive region.
[0207] As mentioned above, in some embodiments, electronic device 500 displays a notification of the last message received in the group interaction, including displaying a representation of the user who sent the last group message peripherally to the representation of the group interaction. Electronic device 500 optionally ceases displaying the message notification when another message is received in the interaction, but optionally continues to display representations of users who recently contributed messaging activity to the messaging interaction. In some embodiments, there is a maximum number of representations of users that are displayed peripherally to the representation of the group interaction, such as two, three, or four. These and other exemplary details are now described.
[0208] Figure 6II shows an example of representation 606e of a group interaction. Representation 606e can be, for example, the same representation having the same interaction history as described above with reference to Figures 6T-6V. In Figure 6II, electronic device 500 optionally displays indicia 630d (e.g., an avatar) in the periphery of representation 606e because a user represented by representation 630d has previously sent messaging activity to the interaction that has not yet been read by the user of electronic device 500. Electronic device 500 optionally displays an indication 626f of the most recent messaging activity sent to the interaction, and optionally displays a representation 630e of the user who sent the message associated with indication 626f in the periphery of representation 606e (e.g., indication 626f is optionally superimposed on a portion of representation 630e). In some embodiments, representation 630e is displayed at a size larger than representation 630d, even though both representations are displayed at the periphery (e.g., outer portion) of representation 606e, because the user associated with representation 630e sent messaging activity to the interaction more recently than the user associated with representation 630d, who sent messaging activity to the interaction.
[0209] 6JJ , electronic device 500 optionally detects indication 624jj that a user associated with representation 630g is currently providing input that constitutes a messaging activity for the messaging conversation (e.g., typing, but not yet sending the messaging activity). In some embodiments, in response to indication 624jj, electronic device 500 displays indication 626h that the user is providing input to the messaging conversation with representation 630g displayed in the periphery of representation 606e (e.g., indication 626h optionally overlays a portion of representation 630f, with representation 630f moving from an inner portion to an outer portion of representation 606e). In some embodiments, representation 630f is displayed on the side of representation 606e opposite the side from which representation 630e is displayed because representation 630e was the most recent user avatar displayed in the periphery. In some embodiments, representation 630f is displayed over representation 630d because the messaging activity associated with representation 630f was received more recently than the messaging activity associated with representation 630d. In some embodiments, in response to displaying representation 630f, electronic device 500 moves representation 630d (e.g., moves representation 630d down to make room for representation 630f). Electronic device 500 optionally displays representation 630f at the same size as representation 630e and ceases displaying representation 626f shown in FIG. 6II. In some embodiments, because a message associated with the input corresponding to instruction 624jj has not yet been sent, electronic device 500 does not reduce the size of representations 630e and 630d of other users who have recently contributed messaging activity to the messaging dialogue in response to instruction 624jj. In some embodiments, electronic device 500 reduces the size of representations 630e and 630d of other users who have recently contributed messaging activity to the messaging dialogue (e.g., while maintaining their relative sizes) in response to instruction 624jj and displays representation 630f at a size larger than representations 630e or 630d.
[0210] In Figure 6KK, the user stops providing input for configuring the messaging activity in the messaging dialogue (e.g., stops typing a message without sending the message). In some embodiments, in response to ceasing to detect user instructions 624jj for configuring the messaging activity shown in Figure 6JJ, electronic device 500 stops displaying instructions 626h, displays user instructions 630g inside representation 606e of the messaging dialogue rather than on the periphery of representation 606e of the messaging dialogue, and re-displays representation 626f of the dialogue's most recent unread message.
[0211] In FIG. 6LL, electronic device 500 detects indication 6241 of a message sent by a user associated with representation 630g. In response to indication 6241, electronic device 500 optionally displays indication 626g of the message (e.g., overlays a portion of representation 630g), displays representation 630g of the user setting the message in the periphery of representation 606e of the messaging interaction, reduces the size of indications 630e and 630d of other users who have recently contributed messaging activity to the interaction, and ceases displaying representation 626f of another message shown in FIG. 6KK. In some embodiments, representation 630f is displayed on the side of representation 606e opposite the side from which representation 630e is displayed because representation 630e was the most recent user avatar displayed in the periphery. In some embodiments, representation 630f is displayed over representation 630d because messaging activity associated with representation 630f was received more recently than messaging activity associated with representation 630d. In some embodiments, in response to displaying representation 630f, electronic device 500 moves representation 630d (eg, moves representation 630d down to make room for representation 630f).
[0212] As described above, in some embodiments, there is a maximum number of representations of users that electronic device 500 will display in the periphery of the representation of the group interaction. While an example is described in which electronic device 500 displays up to three representations of users, it should be understood that the maximum number can be a different number, such as two, four, five, or any other suitable number. In this example, while displaying representations of three users in the periphery of the representation of the group interaction, electronic device 500 receives a display of an additional message received in the interaction from a user whose avatar is not currently displayed in the periphery of the representation of the interaction. In this example, in response to the notification of the new message, electronic device 500 ceases displaying the minimal representation of another user (e.g., representation 630d in FIG. 6LL) displayed in the periphery of representation 606e, reduces the size of the other representations of users displayed in the periphery of representation 606e of the interaction, and displays the representation of the user who sent the most recent message in the periphery of the representation of the group interaction. In some embodiments, the representations of users are displayed alternately on opposite sides of the representation of the group interaction. For example, if a representation of a user who sent a most recent message to a conversation is displayed to the right of the representation of the group message, electronic device 500 optionally displays a representation of the next user to send a message to the left of the representation of the group conversation, etc. In some embodiments, electronic device 500 displays representations of users with more recent messaging conversations in vertical locations above representations of users with less recent messaging activity. For example, in FIG. 6LL, representation 630g is displayed in a vertical location above representation 630d because the user associated with representation 630g sent a message to the conversation more recently than the user associated with representation 630d.
[0213] Returning to Figure 6LL, a user selects a representation 606a of a messaging interaction (e.g., with contact 603). In some embodiments, contact 603 is detected for a time greater than a predetermined threshold (e.g., 0.5 seconds, 1 second, 2 seconds, 3 seconds). In some embodiments, this predetermined threshold is longer than the predetermined thresholds described above with reference to Figures 6Z and 6BB.
[0214] In some embodiments, in response to a user selection of FIG. 6LL in which contact 603 is detected for a time period exceeding a predetermined threshold, electronic device 500 displays a user interface for editing pinned interactions, as shown in FIG. 6MM. In some embodiments, while displaying the user interface for editing pinned interactions, the user can drag representations 616 of unpinned interactions into the pinned interactions area to pin them, drag representations 606 of pinned interactions down onto unpinned interactions to unpin them, and / or rearrange the order of representations 606 of pinned interactions. As shown in FIG. 6MM, the user can select and drag representation 606a of pinned interaction (e.g., with contact 603) to rearrange its position among the other pinned interactions.
[0215] In some embodiments, as shown in Figure 6NN, in response to the input shown in Figure 6MM, electronic device 500 displays representation 606a where representation 606a was dragged by the user. Electronic device 500 optionally moves display 606g to the second column of pinned interactions to accommodate representation 606a in the first row of pinned interactions. As shown in Figure 6NN, the user selects option 612 (e.g., with contact 603) to add the interaction associated with representation 616b to the pinned interactions.
[0216] In some embodiments, as shown in Figure 6OO, in response to the user input shown in Figure 6NN, electronic device 500 displays a representation 606h of the interaction selected by the user upon exiting the pinned interaction area of the user interface and ceases displaying representation 616b of the interaction in the unpinned area of the user interface. In Figure 6OO, the user, for example, selects an option to stop editing the pinned interaction (e.g., with contact 603).
[0217] As shown in FIG. 6PP, in response to the user's selection of FIG. 6OO, electronic device 500 optionally ceases displaying the user interface for editing the pinned interactions and displays a messaging user interface with the pinned interactions arranged according to the changes made by the user of FIGS. 66MM-6OO.
[0218] In some embodiments, the messaging user interface is scrollable, including scrolling pinned interactions. In FIG. 6PP, the user swipes (e.g., with contact 603 detected in an unpinned or pinned area, but rather than remaining fixed for the predetermined time threshold previously described) to, for example, scroll the user interface downward. As shown in FIG. 6QQ, in some embodiments, in response to an input to scroll the user interface, the electronic device 500 scrolls the user interface, including scrolling the representation 606 of the pinned interaction (e.g., off-touchscreen 504). In some embodiments, it is possible to scroll the user interface downward such that the representation 606 of the pinned interaction is no longer displayed (e.g., if the touchscreen 504 is scrolled off completely). However, in some embodiments, the representation 606 of the pinned interaction is fixed in place in the user interface, such that scrolling only scrolls the representation 616 of the unpinned interaction while the representation 606 of the pinned interaction remains displayed.
[0219] 6RR-6SS show another example of electronic device 500 updating representation 606e of a group interaction in response to receiving notifications 624rr and 624ss of incoming messages for the interaction. In some embodiments, electronic device 500 displays an image associated with the user who sent the most recent message in the periphery of representation 606e. In some embodiments, electronic device 500 moves a representation of a user from the periphery of representation 606e to the interior of representation 606e in response to receiving another message in the messaging interaction from a different user, even if the user of electronic device 500 does not read the messaging interaction between receipt of the messages.
[0220] 6RR, in response to receiving an indication 624rr of the message of the interaction associated with representation 606e, electronic device 500 displays a representation 630d of the user who sent the message in the vicinity of representation 606e of the messaging interaction. In some embodiments, electronic device 500 also displays an indication 626e of the content of the message in a manner similar to that described above.
[0221] As shown in FIG. 6SS, in response to receiving an indication 624ss of a subsequent message of the interaction associated with representation 606e, electronic device 500 displays a representation 630f of the user who sent the subsequent message on the periphery of representation 606e of the messaging interaction. In some embodiments, as shown in FIG. 6SS, electronic device 500 also moves a representation 630d of the user who sent the message received in FIG. 6RR inside indication 606e and ceases displaying an indication 626e of the contents of the message received in FIG. 6RR in response to indication 624ss, even if the user has not viewed the messaging interaction between receiving indications 624rr and 624ss. As shown in FIG. 6SS, representation 630f is displayed at a larger size than representation 630d, for example. In some embodiments, electronic device 500 also displays an indication 626h of the contents of the message associated with indication 624ss.
[0222] 7 is a flow diagram illustrating a method 700 for presenting a representation of a messaging interaction according to an embodiment of the present disclosure. Method 700 is optionally performed on an electronic device, such as device 100, device 300, or device 500, as described above with reference to FIGS. 1A-1B, 2-3, 4A-4B, and 5A-5H. Some operations in method 700 are optionally combined and / or the order of some operations is optionally changed.
[0223] As described below, method 700 provides a way for an electronic device to present a representation of a messaging interaction. This method reduces the cognitive burden on a user when interacting with the user interface of a device of the present disclosure, thereby creating a more efficient human-machine interface. For battery-operated electronic devices, improving the efficiency of user interaction with the user interface conserves power and increases the time between battery charges.
[0224] In some embodiments, method 700 is performed by an electronic device in communication with a display generation component and one or more input devices (e.g., a mobile device (e.g., tablet, smartphone, media player), a computer (e.g., desktop computer, laptop computer), or a wearable device (e.g., watch, head-mounted device). In some embodiments, the display generation component is a display integrated with the electronic device (optionally a touchscreen display) and / or an external display such as a monitor, projector, television, etc. In some embodiments, electronic device 500, via the display generation component, displays (702) a user interface including (1) a first visual representation 606a associated with the first messaging interaction and (2) a second visual representation 606b associated with the second messaging interaction, such as in FIG. 6C . In some embodiments, first visual representation 606a is displayed in a first location in a user interface (704), such as in FIG. 6C . In some embodiments, second visual representation 606b is displayed in a second location in a user interface (704), such as in FIG. 6C . Representation 606b is displayed in a second location of the user interface (706), such as in FIG. 6C. In some embodiments, such as in FIG. 6C, the second location is different from the first location (708). In some embodiments, each respective visual representation associated with a respective messaging interaction optionally includes a representation of one or more contacts included in the messaging interaction. For example, each visual representation includes an image associated with a contact card of one or more contacts in the interaction and / or an image associated with the interaction. In some embodiments, the user interface includes multiple representations of "pinned" interactions and multiple representations of "unpinned" interactions in respective regions of the user interface (e.g., the top of the user interface). The representations of pinned interactions optionally have a different design, format, etc. than the representations of unpinned interactions. In some embodiments, the representations of pinned interactions are arranged in a grid, each showing an image representing one or more participants in the interaction and text indicating the names of the contacts in the messaging interaction or the name associated with the group interaction.A representation of an unpinned interaction optionally includes all elements of a representation of a pinned interaction, and optionally further includes a timestamp of the interaction's last messaging activity and a notification of the interaction's last messaging activity, regardless of whether a user of the electronic device has the interaction open since the last activity was received (e.g., whether the last activity was "read" or not). In some embodiments, a representation of a pinned interaction only includes notifications of messaging activity received from a user viewing the messaging interaction (e.g., a representation of a pinned interaction only includes notifications of unread messaging activity). In some embodiments, messaging activity includes sending a message in the interaction and / or adding a tag to an existing message (e.g., a reaction such as "like," "love," "dislike," laugh, highlight, or question mark), and / or a change to a group's members (e.g., adding or removing a contact from the interaction) and / or a change to the interaction's name.
[0225] 6D , while displaying the first visual representation 606c in a first location in the user interface (e.g., without moving the first visual representation) (710), the electronic device 500 receives an indication 624d of a first messaging activity associated with the first messaging interaction (712). In some embodiments, the messaging activity includes sending a message in the interaction and / or adding a tag to an existing message (e.g., a reaction such as "like," "love," "dislike," laugh, highlight, or question mark), and / or making a change to the members of a group (e.g., adding or removing a contact from the interaction) and / or making a change to the name of the interaction.
[0226] 6D , in response to receiving the indication 624d of the first messaging activity, the electronic device 500 updates (714) the first visual representation 606a to include a visual indication 626a of the first messaging activity, where the visual indication 626a of the first messaging activity is displayed in a first visual characteristic. In some embodiments, the first messaging interaction is a pinned interaction, and the visual indication of the first messaging activity is displayed superimposed on the visual representation of the first messaging interaction. The first messaging activity optionally receives a message of the first messaging interaction, and the visual indication of the message includes some or all of the text of the message. In some embodiments, the visual indication of the message is initially displayed in a first size.
[0227] 6F , electronic device 500 receives (716) notification of a second messaging activity associated with the second messaging conversation. In some embodiments, the messaging activity includes sending a message in the conversation and / or adding a tag to an existing message (e.g., a reaction such as "like," "love," "dislike," laugh, highlight, or question mark), and / or making a change to a group's members (e.g., adding or removing a contact from the conversation) and / or making a change to the conversation's name. In some embodiments, the second messaging conversation is a different conversation from the first messaging conversation, and both the first and second messaging conversations are "pinned" to their respective regions of the user interface.
[0228] 6F , in response to receiving the indication 624f of the second messaging activity, the electronic device 500 updates (718) the visual indication 626a of the first messaging activity to be displayed with a second visual characteristic that is different from the first visual characteristic. In some embodiments, changing the visual characteristic of the visual indication of the first messaging activity in the first messaging interaction includes reducing the size of the visual indication, changing the color scheme of the visual indication (e.g., from being displayed in color to being displayed in black and white or grayscale), changing the translucency of the visual indication, etc. In some embodiments, in response to receiving notification of the second messaging activity associated with the second messaging interaction, the electronic device displays, via a display generation component, the visual indication of the second messaging activity relative to the second visual representation associated with the second messaging interaction.
[0229] The above method of updating a display to display a visual indication of the first messaging activity having a visual characteristic having a second value different from the first value in response to receiving a notification of the second messaging activity enables the electronic device to continue to display the notification of the first messaging activity in a manner that efficiently communicates that other messaging activities have been received because the first messaging activity was received, which simplifies the interaction between the user and the electronic device, enhances the operability of the electronic device, makes the user device interface more efficient (e.g., by allowing the user to determine the recency of the first messaging activity without entering input that requests more information about the first messaging activity or the second messaging activity), and which further reduces power usage and improves battery life of the electronic device by enabling the user to use the electronic device more quickly and efficiently.
[0230] In some embodiments, such as in FIG. 6F , after the visual indication 626a is updated to be displayed with the second visual characteristic, the first visual representation 606a remains displayed in the first location. In some embodiments, the locations of the first visual representation associated with the first messaging interaction and the second visual representation associated with the second messaging interaction are displayed in fixed locations in the user interface. Updating the first visual indication displayed with the second visual characteristic optionally includes one of updating a size, color, or translucency of the visual representation of the first messaging interaction without changing the location of the first visual representation. In some embodiments, in response to receiving a notification of a subsequent messaging activity for the first messaging interaction, the electronic device displays a visual notification of the subsequent messaging activity and changes the location of the visual indication of the first messaging activity within the representation of the first messaging interaction, but does not change the location of the visual representation of the first messaging interaction itself. The above method of maintaining the location of the first visual representation upon updating the visual characteristics of the visual indication allows the electronic device to provide an efficient method of displaying the first visual representation, which simplifies the interaction between the user and the electronic device, enhances the operability of the electronic device, makes the user device interface more efficient (e.g., by reducing the time and number of inputs required to position the first visual representation and access the first messaging interaction), and allows the user to use the electronic device more quickly and efficiently, thereby further reducing power usage and improving battery life of the electronic device.
[0231] In some embodiments, the second visual representation continues to be displayed in a second location of the user interface in response to receiving notification of the first messaging activity and in response to receiving notification of the second messaging activity. For example, the user interface location of the second visual representation does not change in response to receiving notification of messaging activity in the second interaction or any other interaction. In some embodiments, the representations of the first messaging interaction and the second messaging interaction are displayed in a "pinned interactions" area of the user interface. Optionally, the location of each respective representation of the pinned interaction does not change when messaging activity is detected. In some embodiments, the messaging user interface further includes representations of additional messaging interactions that are not pinned. Optionally, the representations of the additional messaging interactions are displayed in reverse chronological order of the interactions' most recent messaging activity. For example, when a notification of messaging activity associated with each unpinned interaction is detected, the electronic device updates the location of the representation of the unpinned messaging interaction so that the representation of the respective interaction is displayed with the highest priority in the user interface (e.g., at the top of the column of representations of messaging interactions).
[0232] In some embodiments, such as in FIG. 6H , the user interface further includes a third visual representation 616f associated with the third messaging conversation. In some embodiments, while displaying first, second, and third visual representations 606a-b and 616f in the user interface, electronic device 500 receives an indication 624h of a third messaging activity associated with the third messaging conversation (e.g., a new message (e.g., including text and / or media, such as an image, audio, etc.) is added to the conversation and / or a tag is added to an existing message in the conversation). In some embodiments, such as in FIG. 6H , in response to receiving the indication 624h of the third messaging activity, the electronic device updates the position of third visual representation 616f in the user interface without updating the first location of first visual representation 606a and the second location of second visual representation 606b in accordance with a determination that one or more criteria have been met (e.g., not at the top of a list of messages that are not already pinned). In some embodiments, before receiving notification of the third messaging activity, the most recently received messaging activity among the unpinned interactions is associated with a different messaging interaction. Optionally, before receiving notification of the third messaging activity, a representation of the different messaging interaction is displayed in a highest priority area of unpinned messaging interactions of the user interface. In some embodiments, in response to receiving the indication of the third messaging activity, the electronic device displays a representation of the third messaging interaction in a highest priority area of unpinned messaging interactions and moves the remaining representations of the unpinned messaging interactions down in priority. For example, before receiving notification of the third messaging activity, a representation of the fourth messaging interaction is displayed at the top of the unpinned message area of the user interface, along with representations of the other messaging interactions displayed below.In this example, in response to receiving notification of the third messaging activity, the electronic device displays a representation of the third interaction at the top of the unpinned message area of the user interface and moves representations of the other unpinned interactions downward. In some embodiments, pursuant to a determination that one or more criteria are not met, the electronic device does not update the location of the third visual representation. For example, if the most recently received messaging activity among the unpinned interactions was in the third interaction before receiving the third messaging activity, the electronic device optionally displays the third visual representation at the top of the unpinned interaction area of the user interface and continues to display the third visual representation in that location in response to receiving an indication of the third messaging activity.) In some embodiments, in response to receiving notification of the third messaging activity, the electronic device updates the third visual representation to indicate the third messaging activity without updating the first visual representation and the second visual representation. In some embodiments, updating the third visual representation includes displaying notification of the third messaging activity, such as by updating the visual representation to include a visual representation of the received messaging activity. For example, if the third messaging activity is a text message, the third visual representation is updated to include an indication of the sender of the text message and at least a portion of the text of the message. In some embodiments, in response to receiving a messaging activity associated with a non-pinned interaction, the representation of the pinned interaction is not changed. In some embodiments, the third visual representation is updated regardless of whether one or more criteria are met.The above method of updating the third visual representation to indicate third messaging activity without updating the first visual representation and the second visual representation allows the electronic device to efficiently communicate to the user that no further messaging activity has been received in the first or second messaging interaction, which simplifies the interaction between the user and the electronic device, enhances the operability of the electronic device, makes the user device interface more efficient (e.g., by reducing the time it takes for the user to determine which interaction has received recent messaging activity), and allows the user to use the electronic device more quickly and efficiently, thereby further reducing power usage and improving battery life of the electronic device.
[0233] In some embodiments, such as in Figure 6I, the user interface further includes a third visual representation 606c associated with the third messaging conversation, where the visual indication 626c of the second messaging activity is displayed with a third visual characteristic (e.g., size, color, translucency, etc.). In some embodiments, such as in Figure 6I, while displaying the first, second, and third visual representations 606a-c in the user interface, an indication 624i of the third messaging activity associated with the third messaging conversation is received (e.g., receipt of a new message in the third messaging conversation or a new tag being added to an existing message in the third messaging conversation). In some embodiments, such as in FIG. 6I , in response to receiving the indication of the third messaging activity, pursuant to a determination that one or more criteria are met (e.g., the third messaging interaction is a “pinned” interaction), electronic device 500 updates the visual indication of first messaging activity 626d to display with a fourth visual characteristic that is different from the second visual characteristic, and updates visual indication of second messaging activity 626c to have a fifth visual characteristic that is different from the third visual characteristic. In some embodiments, the respective locations of the first, second, and third representations of each messaging interaction are the same after the notification of the third messaging activity is received as before the notification of the third messaging activity is received as the respective locations of the first, second, and third representations of each messaging interaction. The electronic device optionally displays the visual indication of the most recently received messaging activity in the largest size compared to other visual indications of other messaging activities, and when a new notification of a new messaging activity is received, the electronic device reduces the size of the visual indication of the previously received messaging activity. In some embodiments, the electronic device only displays a visual indication of the messaging activity of the pinned interaction while the messaging activity is not being read by the user.In some embodiments, once the user has completed the respective messaging activity (e.g., by selecting the representation of the messaging interaction in which the messaging activity was received to view the messaging interaction after the messaging activity was received), the electronic device ceases displaying the visual indication of the messaging activity along with the representation of the messaging activity. The above method of updating the visual characteristics of the first and second visual indications of each messaging activity allows the electronic device to efficiently communicate the order in which messaging activities were received across different interactions, which simplifies the interaction between the user and the electronic device, enhances the operability of the electronic device, makes the user device interface more efficient (e.g., by reducing the input required to view all notifications for the messaging activity with a notification of the order in which the messaging activities were received), and allows the user to use the electronic device more quickly and efficiently, further reducing power usage and improving battery life of the electronic device.
[0234] 6I , while displaying first visual representation 606a including a visual indication of the first messaging activity, includes receiving input via one or more input devices (e.g., via contact 603) to display the first messaging activity within the first messaging dialogue. In some embodiments, the electronic device detects a selection of the first visual representation. In some embodiments, displaying the first messaging activity within the first messaging dialogue includes displaying additional messages included in the messaging dialogue. In some embodiments, in response to receiving an input to display a first messaging activity within a first messaging dialogue, such as in FIG. 6I , the electronic device 500 displays, via the display generation component, the first messaging dialogue including the first messaging activity (e.g., representations of other messaging activities in the first messaging dialogue, and a representation of the first messaging activity). In some embodiments, such as in FIG. 6K , after displaying the content of the first messaging dialogue including the first messaging activity, the electronic device displays, via the display generation component, a first visual representation 606 a associated with the first messaging dialogue and a second visual representation 606 b associated with the first messaging dialogue. and a second visual representation 606b associated with the interaction, where the first visual representation 606b does not include the visual indication of the first messaging activity 626b as in FIG. 6I. For example, the visual indication of the first messaging activity is removed from the first visual representation. In some embodiments, the first visual representation is not displayed while the electronic device displays the content of the first messaging interaction. The electronic device optionally displays the first visual representation in response to receiving an input corresponding to a request to navigate within the user interface to a user interface including a representation of the messaging interaction including the first visual representation, without the visual indication of the first messaging activity.In some embodiments, the electronic device displays a visual representation of a pinned interaction that includes a visual indication of messaging activity received since the last time the user viewed the content of the respective pinned interaction. The electronic device optionally stops displaying the visual indication of messaging activity in the visual representation of the pinned interaction in response to detecting that the user has viewed the content of the respective pinned messaging interaction since the messaging activity was received. In some embodiments, the representation of a non-pinned interaction always includes a visual indication of the most recent messaging activity, regardless of whether the user has viewed the content of the messaging interaction since the most recent messaging activity was received. In some embodiments, the electronic device displays a representation of a non-pinned interaction that includes a visual indication of the most recently received messaging activity within the interaction, even if the most recent messaging activity was generated by a user account associated with the electronic device. The electronic device optionally does not display an indication of messaging activity generated by a user account of the electronic device with the visual representation of the pinned interaction. The method of removing the visual indication of the first messaging activity in response to an input to display the contents of the first messaging conversation enables the electronic device to efficiently indicate to the user whether there is unread messaging activity associated with the first messaging conversation, which simplifies the interaction between the user and the electronic device, enhances the operability of the electronic device, makes the user device interface more efficient (e.g., by reducing the time and number of inputs required by the user to determine whether new messaging activity associated with the first messaging conversation has been received), and additionally reduces power usage and improves battery life of the electronic device by allowing the user to use the electronic device more quickly and efficiently.
[0235] In some embodiments, such as in Figure 6C, the user interface further includes a third visual representation 616a associated with the third messaging interaction. In some embodiments, such as in Figure 6C, the first and second locations are in a first region of the user interface (e.g., a pinned interaction region of the user interface). In some embodiments, for example, as in Figure 6C, the third location is in a second region of the user interface (e.g., an unpinned interaction region of the user interface), and the second region is displayed at a lower priority (e.g., below) than the first region in the user interface. In some embodiments, such as FIG. 6C , the first respective visual representations of the first respective messaging interactions, including third visual representation 616a of the third messaging interaction, are displayed in the second area of the user interface in an order based on recency of messaging activity in the first respective messaging interaction (e.g., in response to receiving new messaging activity in one of the respective messaging interactions, the priority at which the respective visual representations of the respective messaging interactions are displayed is updated to display the respective messaging interaction for which new messaging activity was received with the highest priority). The electronic device optionally displays the first respective visual representations of the first respective messaging interactions in the second area in an order based on recency of messaging activity in the first respective messaging interaction (e.g., in response to receiving new messaging activity in one of the respective messaging interactions, the priority at which the respective visual representations of the respective messaging interactions are displayed is updated to display the respective messaging interaction for which new messaging activity was received with the highest priority). and displaying representations of the messaging interactions in a second region having the most recent activity in the first region, and displaying the remaining representations of the messaging interactions displayed in order from most recent to oldest activity. In some embodiments, the second respective visual representations of the second respective messaging interactions, including first visual representation 606c of the first messaging interaction and second visual representation 606b of the second messaging interaction, are displayed in the first region of the user interface in an order that is not based on the recency of messaging activity in the second respective messaging interaction. In some embodiments, the visual representations of the interactions in the first region of the user interface are arranged according to a user-defined order.In some embodiments, the visual representations of the interactions in the second region of the user interface are displayed in an order such that messaging interactions with more recent activity are displayed with higher priority than messaging interactions with older activity (e.g., the representations are arranged in reverse chronological order). The above method of displaying representations of interactions in different regions based on different orders enables an electronic device to provide efficient access to specific interactions, thereby simplifying interaction between a user and the electronic device and enhancing the operability of the electronic device to make the user device interface more efficient (e.g., by reducing the number of inputs required to view the content of a pinned interaction). This additionally reduces power usage and improves battery life of the electronic device by allowing a user to use the electronic device more quickly and efficiently.
[0236] In some embodiments, such as in FIG. 6K , the user interface further includes a third visual representation 616 c associated with the third messaging interaction, where the third visual representation 616 c is displayed in a third location within the user interface. In some embodiments, such as in FIG. 6K , the first and second locations are within a first region of the user interface (e.g., a pinned interaction region of the user interface). In some embodiments, such as in FIG. 6K , the third location is within a second region of the user interface (e.g., an unpinned interaction region of the user interface). In some embodiments, while displaying the third visual representation 616 c of the third messaging interaction in the second region of the user interface, the electronic device 500 receives input (e.g., with contact 603) via one or more input devices corresponding to a request to move the third visual representation from the second region to the first region. In some embodiments, the electronic device detects the selection and movement of the third visual representation from the second region to the first region (e.g., the electronic device detects the user “dragging” the third representation from the second region to the first region). In some embodiments, in response to receiving input corresponding to a request to move the third visual representation 616c from the second region to the first region, the electronic device moves the third representation from the second region to a third position within the first region, as in FIG. 6K, where the third position is different from the first position and the second position, and the third position does not change in response to detecting messaging activity at the electronic device, such as in FIG. 6M. In some embodiments, in response to detecting the movement of the third visual representation to the first region, the electronic device displays the third visual representation at the end of the group of pinned interactions. In some embodiments, in response to detecting the movement of the third visual representation to the first region, the electronic device displays the third visual representation at a position selected by the user (e.g., defined by the position to which the user drags the third representation). While the first, second, and third visual representations are displayed within the first region, the positions of the first, second, and third visual representations remain unchanged in response to detected receipt of new messaging activity.The above method of moving the third representation to the first area in response to an input enables the electronic device to provide an efficient way of adding interactions to pinned interaction areas, simplifying the interaction between the user and the electronic device, enhancing the operability of the electronic device, and making the user device interface more efficient (e.g., by reducing the number of inputs required to add interactions to the pinned interaction area), which additionally reduces power usage and improves battery life of the electronic device by allowing the user to use the electronic device more quickly and efficiently.
[0237] In some embodiments, such as in FIG. 6M , the first and second locations are within a first region of the user interface (e.g., a pinned interactive region of the user interface). In some embodiments, such as in FIG. 6M , the user interface includes a second region of the user interface (e.g., an unpinned interactive region of the user interface). In some embodiments, such as in FIG. 6M , while displaying the first visual representation 606 a within the first region of the user interface, the electronic device 500 receives input via one or more input devices corresponding to a request to move the first visual representation from the first region to the second region. In some embodiments, the electronic device detects a selection of the first visual representation and a movement from the first region to the second region (e.g., the electronic device detects a user “dragging” the first representation from the first region to the second region). In some embodiments, in response to receiving an input corresponding to a request to move the first visual representation 606a from the first region to the second region, as in FIG. 6M, the electronic device 500 moves the first representation from the first region to a third position within the second region, where the third position is based on the recency of messaging activity in the first messaging interaction relative to other messaging interactions having visual representations displayed in the second region of the user interface, as in FIG. 6N. In some embodiments, in response to detecting the movement of the first representation to the second region, the electronic device displays the first visual representation within the representations of the other unpinned interactions according to a reverse chronological order of the order in which messaging activity was received in each unpinned interaction, independent of the location in the user interface where the input moving the first visual representation ends (e.g., the location where the user “drops” the first visual representation in the second region). The electronic device optionally updates the order in which representations of messaging interactions are displayed in response to receiving messaging activity associated with a non-pinned interaction.The above method of moving the third representation to the second area in response to an input enables the electronic device to provide an efficient method of removing interactions from a pinned interaction area, simplifying the interaction between the user and the electronic device, enhancing the operability of the electronic device, and making the user device interface more efficient (e.g., by reducing the number of inputs required to remove interactions from a pinned interaction area), which additionally reduces power usage and improves battery life of the electronic device by allowing the user to use the electronic device more quickly and efficiently.
[0238] In some embodiments, such as in FIG. 6E , the visual indication of the first messaging activity includes a first respective indication 626b that another device associated with the first messaging interaction receives one or more input characters without receiving a request to send the one or more characters to the first messaging interaction. For example, a respective user other than the user of the electronic device involved in the first messaging interaction is currently providing input to the first messaging interaction. In some embodiments, the first respective indication does not indicate the type of input (e.g., voice input, typing, etc.) or messaging activity (e.g., text message vs. tag vs. image, etc.) being provided to the first messaging interaction by the respective user. The electronic device optionally displays the same typing indicator regardless of the type of input or type of message provided by the user. For example, the typing indicator is shown in response to detecting an indication that the user is entering text on a soft keyboard. As another example, the typing indicator is shown in response to detecting an indication that the user is selecting an image to send in a message to the messaging interaction. In some embodiments, in response to detecting that the respective user has stopped entering input into the first messaging dialogue, the electronic device stops displaying the visual indication. For example, in response to detecting an indication that the respective user is typing a message to be sent to the first messaging dialogue, the electronic device displays the visual indication. The above method of displaying a visual indication of a user providing input into the first messaging dialogue allows the electronic device to efficiently indicate that a user is providing input without receiving an input requesting to view the content of the messaging dialogue, thereby simplifying interaction between the user and the electronic device, enhancing the operability of the electronic device, and making the user device interface more efficient (e.g., by reducing the number of inputs required to view the indication).Additionally, it reduces power usage and improves battery life of electronic devices by allowing users to use the devices more quickly and efficiently.
[0239] In some embodiments, as in FIG. 6F , in response to an instruction that another device associated with the first messaging dialogue has received a request to send one or more characters to the first messaging dialogue (e.g., completion of an input to the first messaging dialogue provided by the respective user, such as an input to send a message configured in the messaging dialogue), the first respective instruction 626b as in FIG. 6E is replaced with a second respective instruction 636c as in FIG. 6F to indicate a type of messaging activity (e.g., optional content) provided by the respective user to the first messaging dialogue. In some embodiments, possible types of messaging activity include sending text to the dialogue, sending an image to the dialogue, sending audio to the dialogue, or adding a tag (e.g., a like tag, a dislike tag, etc.) to an existing message in the dialogue. For example, if the messaging content includes adding a tag to an existing message in the dialogue, the second respective instruction is an image corresponding to the tag. As another example, if the messaging content includes a message including text, the second respective instruction includes at least a portion of the text of the message. In some embodiments, if the respective user stops providing input to the messaging dialogue without sending a messaging activity, the first respective indication ceases to be displayed without displaying the second respective indication. The above-described method of replacing the first respective indication with the second respective indication indicating the type of messaging activity enables the electronic device to provide an efficient way to view the type of messaging content added to the dialogue, thereby simplifying the interaction between the user and the electronic device, enhancing the operability of the electronic device, and making the user device interface more efficient (e.g., by reducing the number of inputs required to view the type of messaging activity added to the dialogue). Additionally, by allowing the user to use the electronic device more quickly and efficiently, the electronic device reduces power usage and improves battery life.
[0240] In some embodiments, the visual indication 626c of the first messaging activity includes at least a portion of a most recent unread message in the first messaging dialogue, such as in FIG. 6F. In some embodiments, if the most recent unread message in the messaging dialogue has a length less than a threshold, the entire content of the message is displayed. In some embodiments, if the most recent unread message in the messaging dialogue has a length greater than a threshold, a portion of the message is displayed. The electronic device optionally does not display a visual indication of the messaging activity read in the first messaging dialogue. The above method of including at least a portion of a most recent unread message allows the electronic device to efficiently provide the content of the messaging activity without receiving input to view the content of the messaging dialogue, thereby simplifying interaction between the user and the electronic device, enhancing the operability of the electronic device, and making the user device interface more efficient (e.g., by reducing the number of inputs required to view a portion of the messaging activity). In addition, by allowing a user to use the electronic device more quickly and efficiently, power usage and battery life of the electronic device are reduced.
[0241] In some embodiments, such as in FIG. 6U , while displaying first visual representation 606e including visual indication 626e of the first messaging activity (e.g., before displaying content of the first messaging conversation including the first messaging activity), electronic device 500 receives indication 624u of a third messaging activity associated with the first messaging conversation. In some embodiments, such as in FIG. 6U , in response to receiving indication 624u of the third messaging activity associated with the first messaging conversation, electronic device updates first visual representation 626e to simultaneously include visual indication 626e of the first messaging activity and visual indication 626f of the third messaging activity. In some embodiments, electronic device displays visual indications of two or more unread messaging activities received in a pinned conversation. In some embodiments, there is a limit on the number of indications of unread messaging activities in a single conversation that the electronic device displays. In response to detecting that the user has viewed the content of the first messaging conversation, the electronic device optionally ceases displaying the indications of the first and third messaging activities as part of the visual representation of the first messaging conversation. The above method of simultaneously displaying visual indications of the first and third messaging activities allows the electronic device to display indications of multiple messaging activities added to the first messaging conversation without receiving input presenting the content of the first messaging conversation, thereby simplifying interaction between the user and the electronic device, enhancing the operability of the electronic device, and making the user device interface more efficient (e.g., by reducing the number of inputs required to determine that a conversation has multiple unread messages). Additionally, by allowing the user to use the electronic device more quickly and efficiently, the electronic device reduces power usage and improves battery life.
[0242] In some embodiments, as in FIG. 6U , the size of the visual indication of the first messaging activity is based on the recency of the first messaging activity, and the size of the visual indication of the third messaging activity is based on the recency of the third messaging activity. In some embodiments, the more recent the messaging activity, the larger the indication of the messaging activity. In response to receiving an indication of the third messaging activity while displaying the visual indication of the first messaging activity, the electronic device optionally displays the indication of the first messaging activity at a smaller size than the indication of the third messaging activity. In some embodiments, in response to receiving an indication of a fourth messaging activity associated with the second interaction, the electronic device optionally reduces the size of the visual indications of the first and third messaging activities. In some embodiments, in response to receiving an indication of the fourth messaging activity associated with the second interaction, the electronic device optionally does not update the size of the visual indications of the first and third messaging activities. The above-described method of displaying visual indications with sizes based on the recency of messaging activities allows an electronic device to efficiently communicate the order in which messaging activities were received, thereby simplifying interaction between a user and the electronic device, enhancing the operability of the electronic device, and making the user device interface more efficient (e.g., by reducing the number of inputs required to see the order in which messaging activities were received). Additionally, by allowing a user to use the electronic device more quickly and efficiently, it reduces power usage and improves battery life of the electronic device.
[0243] In some embodiments, such as in FIG. 6T, before receiving the indication of the third messaging activity, visual indication 626e of the first messaging activity has a first size. In some embodiments, such as in FIG. 6U, after receiving indication 624u of the third messaging activity, visual indication 626e of the first messaging activity has a second size smaller than the first size (e.g., visual indication of the third messaging activity has a third size larger than the second size). In some embodiments, in response to detecting receipt of the new messaging activity, the electronic device reduces the size of the indications of other messaging activities associated with the same (or different) interaction and displays the indication of the new messaging activity in a size larger than the size of the representations of the other messaging activities. In some embodiments, rather than reducing the size of the visual indication of the first messaging activity, the electronic device stops displaying the visual indication of the first messaging activity in response to receiving the indication of the third messaging activity. The above method of reducing the size of the visual indication of the first messaging activity in response to receiving an indication of the third messaging activity allows the electronic device to efficiently indicate the order in which the messaging activities were received, thereby simplifying interaction between the user and the electronic device, enhancing the operability of the electronic device, and making the user device interface more efficient (e.g., by reducing the number of inputs required to see the order in which the messaging activities were received). Additionally, by allowing the user to use the electronic device more quickly and efficiently, the electronic device's power usage is reduced and battery life is improved.
[0244] In some embodiments, before receiving the indication of the third messaging activity, the visual indication of the first messaging activity is at a first respective position within the first visual representation. In some embodiments, after receiving the indication of the third messaging activity, the visual indication of the first messaging activity has a second respective position within the first visual representation that is different from the first respective position, and the visual indication of the third messaging activity has a third respective position within the first visual representation that is different from the second respective position. In some embodiments, the positions of the visual representations of the messaging activities in the pinned conversation change as additional messaging activities in the pinned conversation are received. In some embodiments, the positions are predetermined based on the number of indications displayed in a visual representation and the order in which the messaging activities corresponding to the indications are received. In some embodiments, the positions are random. The above method of repositioning the visual indication of the first messaging activity in response to receiving the indication of the third messaging activity allows the electronic device to display the indication of the messaging activity in a non-overlapping position for easy viewing by the user, thereby simplifying interaction between the user and the electronic device, enhancing the operability of the electronic device, and making the user device interface more efficient (e.g., by allowing the user to view the indication, reducing the need for the user to provide input to view the content of the messaging dialogue in order to view the indication of the messaging activity). Additionally, by allowing the user to use the electronic device more quickly and efficiently, power usage of the electronic device is reduced and battery life is improved.
[0245] In some embodiments, the size of the visual indication of the messaging activity is within a range set by a lower size threshold and an upper size threshold. In some embodiments, the electronic device displays a maximum of two lines of text when displaying the visual indication of the text messaging activity in a pinned interaction. The electronic device optionally displays an indication at the beginning of the message, in part of the message, that the message has additional content if the message exceeds the maximum visual indication size.
[0246] In some embodiments, while displaying multiple visual indications of messaging activity in each visual representation of each pinned messaging interaction, the electronic device displays the visual indications of the messaging activity at different vertical positions within the user interface.
[0247] In some embodiments, such as in FIG. 6D , in response to receiving an indication 624d of the first messaging activity, the electronic device 500 updates the user interface to include a visual indication 620a associated with the first visual representation indicating the presence of unseen messaging activity in the first messaging conversation. In some embodiments, in addition to displaying the visual indication of the messaging activity, in response to detecting receipt of new messaging activity in the pinned conversation, the electronic device displays a visual indication that new messaging activity has been added to the conversation since the user viewed the contents of the messaging conversation. The visual indication is optionally the same regardless of the type, content, or number of unread messaging activities associated with the pinned conversation. In some embodiments, the visual indication displayed in association with the first visual representation is displayed in a position that does not overlap with the visual representation of the conversation. In some embodiments, each visual indication of each messaging activity is displayed superimposed on the visual representation of the conversation. The above method of displaying a visual representation indicating the presence of unseen messaging activity enables the electronic device to efficiently indicate that the messaging conversation includes unseen activity. This simplifies the interaction between the user and the electronic device, enhances the operability of the electronic device, and makes the user device interface more efficient (e.g., by reducing the number of inputs required to determine that hidden messaging activity exists, such as by eliminating the need for the user to view the contents of a messaging dialogue to determine if new messaging activity has been added to the dialogue), and additionally reduces power usage and improves battery life of the electronic device by allowing the user to use the electronic device more quickly and efficiently.
[0248] In some embodiments, following a determination that one or more criteria are met (e.g., a determination that the electronic device has not set a pinned interaction feature for the messaging activity), the electronic device optionally configures the pinned interaction feature of the messaging application, which includes automatically selecting one or more “pinned” interactions based on one or more criteria (e.g., the recency of the messaging activity in the interaction, how frequently messaging activity is received within the interaction, how recently the messaging interaction was initiated, whether one or more participants in the messaging interaction are on a favorite contacts list).
[0249] In some embodiments, in a pinned interaction configuration user interface, the electronic device displays representations of multiple pinned interactions each associated with a selectable option that, when selected, removes the respective interaction from the pinned interaction area, and the electronic device displays representations of additional messaging interactions that are not yet pinned with selectable options that, when selected, cause the electronic device to add the respective interaction to the pinned interactions.
[0250] In some embodiments, while displaying an indication of the automatically selected pinned interaction, the electronic device receives an input confirming that the interaction should be pinned. In response to the input, the electronic device optionally displays a messaging user interface with a representation of the automatically selected pinned interaction displayed in a pinned interaction area of the user interface and representations of other messaging interactions in unpinned interaction user interfaces.
[0251] In some embodiments, while displaying an indication of the automatically selected pinned interaction, the electronic device receives an input denying that the interaction should be pinned. In response to the input, the electronic device optionally displays a messaging user interface with a representation of the automatically selected pinned interaction displayed in an unpinned interaction area of the user interface.
[0252] In some embodiments, while displaying a messaging user interface, the electronic device detects an input corresponding to a request to edit a selection of which interactions are pinned interactions. In response to the input, the electronic device displays representations of the pinned interactions in a first region each associated with a selectable option that, when selected, removes the respective interactions from the pinned interaction region and places them in an unpinned interaction region. The electronic device displays representations of additional messaging interactions in the unpinned interaction region with selectable options that, when selected, cause the electronic device to add the respective interactions to the pinned interaction region.
[0253] In some embodiments, e.g., as in FIG. 6I , the first messaging interaction is a group messaging interaction (e.g., including three or more participating electronic devices, including the electronic device), and the first messaging activity is provided to the first messaging interaction by a first respective contact in the first messaging interaction. Updating the first visual representation 606c in response to receiving an indication of the first messaging activity includes updating the first visual representation 606c to include a visual representation of the first respective contact displayed in association with the visual indication 622e of the first messaging activity. In some embodiments, the first visual representation includes representations of multiple contacts participating in the first messaging interaction, and in response to the indication of the first messaging activity, the representation of the first respective contact is displayed in an updated position within the first representation of the first messaging interaction. The electronic device optionally displays a visual indication of the first message at an edge of the representation of the first messaging interaction and the representation of the first respective contact. In some embodiments, the visual representation of the first messaging interaction includes an image associated with the messaging interaction that does not include an image associated with a contact included in the messaging interaction. Optionally, in response to receiving an indication of the first messaging activity, the electronic device updates the first visual representation to include an image associated with each first contact displayed in proximity to the visual indication of the first message. The above method of updating the first visual representation to include a visual representation of each first contact displayed in association with the visual indication of the first messaging activity enables the electronic device to communicate which user in the group interaction sent the first messaging activity, thereby simplifying interaction between the user and the electronic device, enhancing operability of the electronic device, and making the user device interface more efficient (e.g., by reducing the number of inputs required to determine who sent the first messaging activity).Additionally, it reduces power usage and improves battery life of electronic devices by allowing users to use the devices more quickly and efficiently.
[0254] In some embodiments, e.g., as in FIG. 6T , the first messaging interaction is a group messaging interaction (e.g., including three or more participating electronic devices, including the electronic device). In some embodiments, e.g., as in FIG. 6T , a first messaging activity is provided to the first messaging interaction by a first respective contact in the first messaging interaction. In some embodiments, such as in FIG. 6T , the first visual representation 606e includes a first region configured to include one or more representations 630e-f of each contact included in the first messaging interaction that do not have messaging activity visible on the electronic device. In some embodiments, instead of displaying one or more representations of each contact included in the first messaging interaction that do not have messaging activity visible on the electronic device, the first visual representation includes an image associated with the group interaction that is different from the image associated with one or more contacts included in the messaging interaction. The representation of each contact optionally includes an image associated with a contact card for one or more contacts. In some embodiments, the first region of the first visual representation is, optionally, within a visual indication of an outline of the region, such as a circle. In some embodiments, such as in FIG. 6T , the first visual representation 606e includes a second region different from the first region, the second region configured to include one or more representations 630d of each contact included in the first messaging conversation that has messaging activity that is not visible on the electronic device. In some embodiments, in response to receiving new messaging activity at the electronic device and before the user views the messaging activity within the content of the messaging conversation, the electronic device displays a visual representation of one or more contacts that sent the new messaging activity. The second region is optionally on the periphery of a visual outline of the region (e.g., a circle surrounding a visual representation of one or more users that do not have messaging activity that is not visible, or a circle surrounding a visual indication of messaging activity that is different from one or more images associated with the contacts included in the messaging conversation).In some embodiments, such as in FIG. 6T , updating the first visual representation 606e in response to receiving an indication 624t of the first messaging activity includes moving a visual representation 630d of the first respective contact from a first region to a second region within the first visual representation. For example, after a user views the content of a messaging interaction and before receiving a new messaging activity in the first interaction, the electronic device displays multiple representations of the contacts in the messaging interaction within a circle that is part of the representation of the first messaging interaction. In this example, in response to receiving a first messaging activity from a first user of the multiple users, the electronic device updates the visual representation of the first messaging interaction to move the representation of the first user from within the circle to the periphery of the circle. In some embodiments, a representation of the first contact who sent the first messaging activity is displayed in proximity to the visual indication of the first messaging activity. The above method of updating the first visual representation and moving the visual representation of each first contact from the first area to the second area allows the electronic device to efficiently communicate which users were in the conversation before the user sent the first messaging activity and which user provided the first messaging activity after the first messaging activity is received. This simplifies the interaction between the user and the electronic device, enhances the operability of the electronic device, and makes the user device interface more efficient (e.g., by reducing the number of inputs required to view the users in the conversation and the user who sent the first messaging activity). In addition, it reduces the power usage and improves the battery life of the electronic device by allowing the user to use the electronic device more quickly and efficiently.
[0255] In some embodiments, while displaying first visual representation 606e including visual indication 626e of the first messaging activity and visual representation 630d of the first respective contact, as in FIG. 6T, electronic device 500 receives indication 624t of a third messaging activity provided to the first messaging interaction by a second respective contact different from the first respective contact, as in FIG. 6U. In some embodiments, such as FIG. 6U, in response to receiving the third messaging activity, the electronic device displays the first visual representation including reducing the size of visual representation 630d of the first respective contact displayed in the first visual representation (e.g., in some embodiments, the size of the visual indication of the first messaging activity is also reduced in response to receiving the third messaging activity). In some embodiments, rather than reducing the size of the visual indication of the first messaging activity and the visual representation of the first respective contact, the electronic device stops displaying the visual indication of the first messaging activity and / or the visual representation of the first respective contact. In some embodiments, in addition to changing the size of the visual representation of the first respective contact and / or the visual indication of the first messaging activity, the electronic device updates the position of the visual representation of the first respective contact and / or the position of the visual indication of the first messaging activity within the visual representation of the first messaging interaction. In some embodiments, such as in FIG. 6U, electronic device 500 adds visual representation 630e of the second respective contact to the first visual representation (e.g., the visual representation of the second respective contact is displayed at a larger size than the visual representation of the first respective contact). In some embodiments, electronic device 500 displays visual indication 626f of the third messaging activity within the first visual representation in association with visual representation 630e of the second respective contact. In some embodiments, the visual indication of the third messaging activity is displayed in physical proximity to the visual representation of the second respective contact.By reducing the size of the visual representation of the first respective contact in response to receiving the third messaging activity and adding a visual representation of the second respective contact and a visual indication of the third messaging activity, the electronic device frees up space to display additional indications of the incoming messaging activity as the incoming messaging activity is received while continuing to display visual representations of the previously received messaging activity and the user who sent the previously received messaging activity, thereby simplifying interaction between the user and the electronic device, enhancing the operability of the electronic device, and making the user device interface more efficient (e.g., by reducing the number of inputs required to view an indication of the received messaging activity). Additionally, by allowing a user to use the electronic device more quickly and efficiently, power usage of the electronic device is reduced and battery life is improved.
[0256] In some embodiments, such as in FIG. 6S, the first messaging interaction is a group messaging interaction (e.g., includes three or more participating electronic devices, including the electronic device), and the first visual representation 606e includes a plurality of representations 630d-f of each of the plurality of contacts included in the first messaging interaction, where the plurality of representations 630d-f of each of the plurality of contacts are displayed at different sizes based on the recency of each contact's messaging activity in the first messaging interaction. In some embodiments, a representation of a user who most recently sent a messaging activity to the first messaging interaction is displayed at the largest size within the representation of the first messaging interaction, and a user whose representation is displayed who most recently sent a messaging activity to the first messaging interaction is displayed at the smallest size within the representation of the first messaging interaction. In some embodiments, the electronic device displays a maximum predetermined number (e.g., 6, 7, or 8) of representations of contacts included in the first messaging interaction that is the maximum number of recently active users in the interaction. For example, if there are 10 users other than the user of the electronic device involved in the messaging interaction, the representation of the messaging interaction includes an indication of the seven users who most recently submitted messaging activity to the interaction. The indication is sized based on the recency with which the users submitted messaging activity to the interaction, with the largest representation of the user who most recently submitted messaging activity to the messaging interaction and smaller representation sizes of other users who contributed messaging activity to the interaction more recently. In some embodiments, the first visual representation of the group messaging interaction does not include a representation of the user of the current electronic device (e.g., the device on which the first visual representation is displayed) (regardless of the messaging activity of the current electronic device in the group messaging interaction).The above-described method of displaying representations of other contacts sized based on how recently the contacts contributed messaging activity to the interaction enables an electronic device to identify interactions based on users who have recently sent messaging activity to the interaction, thereby simplifying the interaction between the user and the electronic device, enhancing the operability of the electronic device, and making the user device interface more efficient (e.g., by displaying representations of interactions in a manner that is quickly recognizable to the user, thereby reducing the number of inputs required to view a desired messaging interaction), and reducing power usage and improving battery life of the electronic device by allowing the user to use the electronic device more quickly and efficiently.
[0257] It should be understood that the particular order described of the operations in FIG. 7 is merely exemplary, and that the described order is not intended to indicate the only order in which the operations may be performed. Those skilled in the art will recognize various ways to reorder the operations described herein. In addition, it should be noted that other process details described herein with respect to other methods described herein (e.g., methods 900, 1100, 1300, and 1500) are also applicable in a similar manner to method 700 described above with respect to FIG. 7. For example, the method of presenting a representation of a messaging conversation described above with reference to method 700 optionally has one or more of the characteristics described herein with reference to other methods described herein (e.g., methods 900, 1100, 1300, and 1500), such as methods of creating and presenting mentions, methods of presenting indications of messages that are replies to other messages in the conversation, etc. For the sake of brevity, those details will not be repeated here.
[0258] The operations in the information processing method described above are optionally performed by running one or more functional modules in an information processing device, such as a general-purpose processor (e.g., as described above in connection with FIGS. 1A-1B, 3, 5A-5H) or an application-specific chip. Additionally, the operations described above with reference to FIG. 7 are optionally performed by the components shown in FIGS. 1A-1B. For example, displaying operation 702 and receiving operations 712 and 716 are optionally performed by event sorter 170, event recognizer 180, and event handler 190. Event monitor 171 of event sorter 170 detects a contact on touchscreen 504, and event dispatcher module 174 delivers the event information to application 136-1. Each event recognizer 180 of application 136-1 compares the event information to a respective event definition 186 to determine whether a first contact at a first location on the touchscreen corresponds to a predefined event or sub-event, such as selecting an object on a user interface. When a corresponding predefined event or sub-event is detected, event recognizer 180 activates event handler 190 associated with the detection of that event or sub-event. Event handler 190 optionally utilizes or invokes data updater 176 or object updater 177 to update application internal state 192. In some embodiments, event handler 190 accesses a corresponding GUI updater 178 to update what is displayed by the application. Similarly, it will be apparent to one skilled in the art how other processes can be implemented based on the components shown in FIGS. 1A-1B. A user interface that indicates a message that is a reply to another message
[0259] Users interact with electronic devices in many different ways, including using the electronic device to display representations of messages within messaging conversations. The embodiments described below provide ways for an electronic device to present an indication of messages that are replies to other messages. Presenting an indication of messages that are replies to other messages in the manner described herein enhances interaction with the device by reducing the time and input required by the user to view messages in the same reply thread, and thus reduces the power usage of the device and extends the battery life of battery-powered devices by reducing the time required for the user to perform actions. It is understood that people use devices. When a person uses a device, that person is optionally referred to as the user of the device.
[0260] 8A-8AA illustrate exemplary ways in which an electronic device 500 may display representations of messages in a conversation that are replies to respective other messages in the conversation, according to some embodiments. The embodiments in these figures are used to illustrate the processes described below, including the process described with reference to FIG. 9. While FIGS. 8A-8AA illustrate various examples of ways in which an electronic device may perform the processes described below with reference to FIG. 9, it should be understood that these examples are not intended to be limiting, and that an electronic device may perform one or more of the processes described below with reference to FIG. 9 in ways not explicitly described with reference to FIGS. 8A-8AA.
[0261] 8A shows an exemplary user interface including a messaging dialogue 802 between a user of electronic device 500 and two contacts named Alice and Bob. In some embodiments, electronic device 500 displays messaging dialogue 802 in response to detecting a selection of a dialogue representation, such as one of the messaging dialogue representations described above with reference to FIGS. 6A-7 . Messaging dialogue 802 optionally includes a representation 804a of a message from the user of electronic device 500 that is not a reply to any particular message in the dialogue, a representation 808a of a message from another user that is not a reply to any particular message in the dialogue, a representation 806a of a message from the user of electronic device 500 that is a reply to the message associated with representation 808a, and a representation 808b of another message from a user other than the user of electronic device 500 that is not a reply to a particular message in the dialogue. Representation 808a is optionally displayed with an indication 814a indicating that a message (e.g., from the user of electronic device 500) has been received in reply to the message corresponding to representation 808a. In some embodiments, electronic device 500 does not display indication 814a because representation 806a of the reply is displayed in close proximity to representation 808a of the message (e.g., immediately without any other intervening messages). Representation 808a and representation 806a are optionally connected by line 844a, indicating that the message corresponding to representation 806a is a reply to the message corresponding to representation 808a. As shown in FIG. 8A , in some embodiments, line 844a connects representation 806a of contact Alice, e.g., an avatar, displayed in association with representation 808a. The user interface optionally further includes a text entry field 822 in which inputs to compose the message are prompted, and a selectable option 848 that, when selected, causes electronic device 500 to send a draft message to the messaging dialogue. As shown in FIG. 8A , in some embodiments, representations 804a and 806a of messages sent by the user of electronic device 500 are displayed in a different color than representations 808a and 808b of messages received from users other than the user of electronic device 500.In some embodiments, representations 804a and 806a are displayed on a green, blue, or other colored background with white or other colored text, and representations 808a and 808b are displayed on a white, gray, or other colored background with black text, or on a black or other colored background with white text. Further, in some embodiments, representations 804a and 806a of messages from a user of electronic device 500 are displayed on one side (e.g., the right side) of the user interface, and representations 808a and 808b of messages sent by other users are displayed on the other side (e.g., the left side) of the user interface.
[0262] 8B , electronic device 500 optionally detects indication 842b of an incoming message from a user of the conversation other than the user of electronic device 500 (e.g., Bob). In response to indication 842b, electronic device 500 optionally displays representation 812a of the message. In some embodiments, representation 812a of the incoming message includes an indication of the user who sent the message and an indication of the user to whom the message is replied (e.g., "Bob replying to Alice"). Because the message corresponding to representation 812a is a reply to another message in the conversation, electronic device 500 optionally displays indication 810a of the message to which the most recent message is replied. Representation 810a and representation 808a may correspond to the same message. Representation 810a and representation 808a may have one or more differences in visual characteristics. For example, the size of representation 810a may be smaller than the size of representation 808a. As another example, the color and / or opacity of representation 810a may differ from the color and / or opacity of representation 808a. Because a message corresponding to representation 808b, which may not be a reply to the message corresponding to representation 808a, was optionally received before receiving the message corresponding to representation 812a, electronic device 500 optionally displays second representation 810a of the message, in which the most recent message is a reply, to reduce the number of inputs required to view the content of the message associated with representation 808a and the content of the message corresponding to representation 812a. In some embodiments, even if a message corresponding to representation 808b was not received between the message corresponding to representation 808a and the message corresponding to representation 812a, electronic device 500 still displays second representation 810a of the message corresponding to representation 808a.
[0263] Representation 810a of a message whose most recent message is a reply optionally includes an indication 816a of the number of reply messages received between the message corresponding to representation 808a and the message corresponding to representation 812a. For example, the message corresponding to representation 806a is also a reply to the message corresponding to representation 808a. Because there is one other reply (e.g., the message corresponding to representation 806a) other than the message corresponding to representation 812a that is a reply to the message corresponding to representation 810a, indication 816a shows one additional reply. In some embodiments, instead of displaying the number of replies received between the message corresponding to representation 810a and the message corresponding to representation 812a, electronic device 500 displays an indication of the number of messages received after representation 810a. For example, if another message is received after receiving the message corresponding to representation 812a, and the new message is a reply to the message corresponding to representation 810a, the representation is updated to show the two replies received since displaying representation 810a. However, in some embodiments, indication 816a reflects the total number of replies to the message corresponding to representations 808a and 810a (eg, two replies in this example).
[0264] 8B , electronic device 500, in response to instruction 842b, optionally updates indication 814b of the number of replies to the message corresponding to representation 808a. In some embodiments, electronic device 500 does not display indication 814b. In some embodiments, electronic device 500 displays an indication of the number of replies to the message corresponding to representation 808a other than the message corresponding to representation 806a (e.g., one message in this example). In some embodiments, the indication of the number of replies to the message corresponding to representation 808a other than the message corresponding to representation 806a is displayed at the location of instruction 814b or in another location (e.g., below representation 806a).
[0265] As shown in FIG. 8B , in some embodiments, a user selects (e.g., with contacts 803) an indication 814b of the number of replies to the message corresponding to indication 808a. In response to the user's selection in FIG. 8B , electronic device 500 optionally displays a user interface that includes a representation of the message corresponding to representation 808a and representations of messages that are replies to that message, without displaying representations of other messages in the conversation that are not replies to the message corresponding to representation 808a. FIG. 8C shows an exemplary user interface that includes representation 838a of the message represented by representations 808a and 810a in FIG. 8B and representations 840a and 838b of subsequent messages in the conversation that are replies to the message corresponding to representation 838a. The user interface shown in FIG. 8C optionally does not include representations of messages that are not in the same reply thread, such as representation 808b.
[0266] In some embodiments, representations 838a, 838b, and 840a are displayed overlaid on the messaging user interface shown in Figure 8B. However, in some embodiments, representations 838a, 838b, and 840a are not overlaid on the messaging user interface, but instead are displayed on some other background (e.g., a plain background or an image, etc.). Although representations 838a, 840a, and 838b are shown as having the same color scheme as representations 808a, 806a, and 812a shown in Figure 8B, in some embodiments, representations 838a, 840a, and 838b are displayed in different colors than representations 808a, 806a, and 812a. In some embodiments, different visual characteristics (e.g., size, font, outline color, translucency, etc.) are modified between representations 808a, 806a, and 812a and representations 838a, 840a, and 838b. The user interface further includes a text entry field 824 that is updated to indicate that the messaging content entered into the text entry field 824 creates a message that is also a reply to the message corresponding to the representation 838a. In some embodiments, the text entry field 824 is not updated (e.g., includes the text "message" instead of "reply").
[0267] As shown in FIG. 8C , in some embodiments, the reply user interface does not include lines connecting representations 838a, 840a, and 838b of messages in the reply thread because the reply user interface includes only messages that reply to the same thread. Thus, it is clear that the messages corresponding to representations 840a and 838b are replies to the message corresponding to representation 838a without including lines connecting the representations. In some embodiments, as shown in FIG. 8C , intervening messages in the conversation that are not replies to the message associated with representation 838a are not shown in the reply user interface, so only one representation 838a of the message corresponding to representation 838a is present. Thus, in some embodiments, an additional representation of the message corresponding to representation 838a is not needed for a user to easily view the content of the message in the conversation. As shown in FIG. 8C , representations 838a and 838b of messages from users other than the user of electronic device 500 are displayed on one side (e.g., the left side) of the user interface, and representation 840a of the message from the user of electronic device 500 is displayed on the other side (e.g., the right side) of the user interface.
[0268] As shown in Figure 8C, in some embodiments, a user selects (e.g., with contacts 803) text entry field 803. In response to the user's selection of Figure 8C, electronic device 500 optionally displays soft keyboard 846 while remaining within the reply user interface of Figure 8C, as shown in Figure 8D.
[0269] 8D shows an updated user interface that may include a soft keyboard 846 whose input is directed to composing a message that is a reply to the message corresponding to representation 838a. As shown in FIG. 8D, in some embodiments, the user selects (e.g., with contact 803) an area of soft keyboard 846 that corresponds to the letter at which to begin message input.
[0270] 8E, in some embodiments, the user has finished entering text into text entry field 826, which is a reply to the message corresponding to expression 838a. The user optionally selects option 848 (e.g., with contact 803) to send the reply message to the messaging dialogue.
[0271] In some embodiments, in response to the user's selection in FIG. 8E, electronic device 500 sends a message and updates the user interface, as shown in FIG. 8F.
[0272] As shown in FIG. 8F , in some embodiments, electronic device 500 displays representation 840b of a message sent by the user in the user interface along with representations 840a and 838b of messages that are replies to the message corresponding to representation 838a. For example, representation 840b is displayed on the same side of the user interface as representation 840a of another message sent by the user of electronic device 500. Electronic device 500 optionally updates the messaging user interface in the background of the user interface to include another representation of the user's message corresponding to representation 840b connected to the representation of the message corresponding to representation 838a with a curved line. Because a message that is not a reply to the message corresponding to representation 838a was received between the receipt of the message corresponding to representation 838b and the message corresponding to representation 840b, the additional representation of the message corresponding to representation 838a may be displayed. The curve connecting the representation of the message corresponding to representation 838a and the representation of the message corresponding to representation 840b is optionally displayed, as described in more detail below with reference to FIGS. 12A-13 .
[0273] 8G , in some embodiments, electronic device 500 detects an indication 842g of a message received from another user in the conversation while device 500 is displaying the reply user interface. The message is, optionally, a reply to the message corresponding to representation 838a. Thus, because the message was sent by a user other than the user of electronic device 500, electronic device 500 optionally displays representation 838c of the message in the reply user interface on the left side of the user interface. In some embodiments, electronic device 500 also updates the user interface in the background to include the additional representation of the received message.
[0274] As shown in FIG. 8G, the user selects the background of the reply user interface (e.g., with contact 803). In response to the user's selection in FIG. 8G, electronic device 500 optionally displays the user interface shown in FIG. 8H. In some embodiments, electronic device 500 also navigates away from the user interface shown in FIG. 8G in response to detecting a selection of representations 838a-c or 840a-b of messages within the user interface. In some embodiments, electronic device 500 also navigates away from the user interface shown in FIG. 8G in response to detecting an input to stop displaying the messaging application user interface. In some embodiments, electronic device 500 also navigates away from the user interface shown in FIG. 8G in response to detecting an input to close the messaging application.
[0275] FIG. 8H shows an exemplary message user interface with representations of all messages in the dialogue, including messages that are not replies to the message corresponding to representation 838a in FIG. 8G (e.g., the message corresponding to representation 808a in FIG. 8B). The representations may include representation 806b of a message sent by the user in FIG. 8E and representation 812b of a received message in FIG. 8G. In some embodiments, representation 806b is displayed on the right because the message was sent by the user of the electronic device. In some embodiments, representation 812b is displayed on the left side of the user inte...
Claims
1. 1. An electronic device in communication with a display generating component and one or more input devices, comprising: displaying, via the display generation component, a messaging user interface including a first plurality of representations of a first plurality of messages in a messaging dialogue, the first plurality of representations including a first representation of a first message, a first set of one or more representations of one or more second messages that are replies to the first message, and a second set of one or more representations of one or more third messages that are not replies to the first message, the one or more third messages being temporally located between the first message and the one or more second messages; receiving, while displaying the messaging user interface, input via the one or more input devices corresponding to a request to view replies to the first message; In response to receiving the input corresponding to the request to view replies to the first message, displaying, via the display generation component, a reply user interface including a second plurality of representations of a second plurality of messages, the second plurality of messages being a subset of the first plurality of messages, the reply user interface comprising: a second representation of the first message and a second set of one or more representations of the one or more second messages that are replies to the first message; and displaying the one or more third messages without including a representation of the one or more third messages that are not replies to the first message.
2. receiving, while displaying the messaging user interface including the first representation of the first message, an indication that a second respective message that is a reply to the first message has been added to the messaging conversation when the messaging user interface includes a first respective representation of a first respective message that is different from the first message and is a most recent message in the messaging conversation; in response to receiving the indication that the second respective message has been added to the messaging conversation; in response to determining that the first respective message is not a reply to the first message, a representation of the second respective message; and updating the messaging user interface to include a second representation of the first message displayed in association with the representation of the second respective message; 10. The method of claim 1, further comprising: updating the messaging user interface to include a representation of the second respective message without including the second representation of the first message in accordance with a determination that the first respective message is a reply to the first message.
3. 2. The method of claim 1, wherein the input corresponding to the request to view replies to the first message comprises a selection of a selectable option displayed in association with the first representation of the first message in the messaging user interface.
4. The method of claim 3 , wherein the selectable options include a visual indication of the number of replies to the first message in the messaging conversation.
5. displaying the reply user interface includes displaying the reply user interface overlaid on the messaging user interface; prior to receiving the input corresponding to the request to view replies to the first message, the messaging user interface is displayed with a visual characteristic having a first value; 2. The method of claim 1, wherein while displaying the reply user interface overlaid on the messaging user interface, the messaging user interface is displayed with a visual characteristic having a second value different from the first value.
6. in the messaging user interface, the first set of one or more representations are displayed in association with one or more visual indications that the one or more second messages are replies to the first message; 2. The method of claim 1, wherein in the reply user interface, the second set of one or more representations are not displayed in association with the one or more visual indications that the one or more second messages are replies to the first message.
7. receiving an indication that a first respective message has been added to the messaging conversation while displaying the reply user interface overlaid on the messaging user interface; 6. The method of claim 5, further comprising: in response to receiving the indication that the first respective message has been added to the messaging conversation, updating the messaging user interface to include a first respective representation of the first respective message while maintaining a display of the reply user interface overlaid on the messaging user interface.
8. The method of claim 1 , wherein the reply user interface includes a selectable option selectable to initiate a process of replying to the first message in the messaging conversation.
9. receiving, while displaying the reply user interface, an indication that a first respective message has been added to the messaging conversation in reply to the first message; 2. The method of claim 1, further comprising: in response to receiving the indication that the first respective message has been added to the messaging conversation as a reply to the first message, updating the reply user interface to include a first respective representation of the first respective message.
10. the reply user interface is displayed in response to the input corresponding to the request to view the replies to the first message that satisfy one or more first criteria or one or more second criteria; the one or more first criteria are satisfied if the input includes a selection of a selectable option displayed in association with the first representation of the first message in the messaging user interface; The method of claim 1 , wherein the one or more second criteria are satisfied if the input includes a selection of each representation of the first set of one or more representations.
11. the first set of one or more representations includes a respective representation of a first respective message; pursuant to a determination that the first respective message is a direct reply to the first message, the respective representation is displayed in association with a visual indication that the first respective message is a reply to the first message; 2. The method of claim 1, wherein, pursuant to a determination that the first respective message is a reply to a second respective message that is a reply to the first message and is not a direct reply to the first message, the respective representation is displayed in association with the visual indication that the first respective message is a reply to the first message.
12. one or more processors; Memory and and one or more programs stored in the memory and configured to be executed by the one or more processors, the one or more programs comprising: displaying, via a display generation component, a messaging user interface including a first plurality of representations of a first plurality of messages in a messaging dialogue, the first plurality of representations including a first representation of a first message, a first set of one or more representations of one or more second messages that are replies to the first message, and a second set of one or more representations of one or more third messages that are not replies to the first message, the one or more third messages being temporally located between the first message and the one or more second messages; receiving, while displaying the messaging user interface, input via one or more input devices corresponding to a request to view replies to the first message; In response to receiving the input corresponding to the request to view replies to the first message, displaying, via the display generation component, a reply user interface including a second plurality of representations of a second plurality of messages, the second plurality of messages being a subset of the first plurality of messages, the reply user interface comprising: a second representation of the first message and a second set of one or more representations of the one or more second messages that are replies to the first message; and displaying the one or more third messages, the third messages not including a representation of the one or more third messages that are not replies to the first message.
13. A non-transitory computer-readable storage medium storing one or more programs, the one or more programs including instructions that, when executed by one or more processors of an electronic device, cause the electronic device to: displaying, via a display generation component, a messaging user interface including a first plurality of representations of a first plurality of messages in a messaging dialogue, the first plurality of representations including a first representation of a first message, a first set of one or more representations of one or more second messages that are replies to the first message, and a second set of one or more representations of one or more third messages that are not replies to the first message, the one or more third messages being temporally located between the first message and the one or more second messages; receiving, while displaying the messaging user interface, input via one or more input devices corresponding to a request to view replies to the first message; In response to receiving the input corresponding to the request to view replies to the first message, displaying, via the display generation component, a reply user interface including a second plurality of representations of a second plurality of messages, the second plurality of messages being a subset of the first plurality of messages, the reply user interface comprising: a second representation of the first message and a second set of one or more representations of the one or more second messages that are replies to the first message; and displaying the one or more third messages, the third messages not including any representations of the one or more third messages that are not replies to the first message.
Citation Information
Patent Citations
Providing contextual information and enabling group communication for participants in conversation
JP2017123189A
Group message prompt method and apparatus for instant messaging application
JP2018529148A
Multi-participant live communication user interface
JP2020039139A
Use of confirmation response option in graphical message user interface
JP2020077425A