Applying Confirmation Options in a Graphical Messaging User Interface

Abstract

The present disclosure relates to applying confirmation options in a graphical messaging user interface. Electronic devices with improved methods and interfaces for messaging are disclosed herein, including improved ways for: confirming messages; editing previously sent messages; expressing what the user is trying to convey; displaying private messages; synchronizing content viewing among users; and getting handwritten input; quickly locating content in a message transcript; integrating a camera; integrating search and sharing; integrating interactive applications; integrating stickers; making payments; interacting with avatars; providing suggestions; navigating in an interactive application; managing an interactive application; translating foreign language text; combining messages into a group; and flagging messages.

Description

[0001] This application is a divisional application of a patent application for "Applying Confirmation Options in a Graphical Messaging User Interface" with an international filing date of May 18, 2017, a national application number of 201780002856.4 (international application number PCT / US2017 / 033396). Technical Field

[0002] This document generally relates to electronic devices having a touch-sensitive surface, including but not limited to electronic devices having a touch-sensitive surface for sending and receiving messages (e.g., instant messages). Background Art

[0003] The use of touch-sensitive surfaces as input devices for computers and other electronic computing devices has increased significantly in recent years. Exemplary touch-sensitive surfaces include touchpads and touchscreen displays. These devices are commonly used to send messages, such as instant messages, between users using an instant messaging application.

[0004] However, current instant messaging applications have many drawbacks and limitations. For example, these applications are limited in the following aspects: confirming messages; editing previously sent messages; expressing what the user is trying to convey; displaying private messages; synchronizing content viewing between users; and enabling handwritten input; quickly locating content in a message transcript; integrating a camera; integrating search and sharing; integrating interactive applications; integrating stickers; making payments; interacting with avatars; providing suggestions; navigating in an interactive application; managing an interactive application; translating foreign language text; grouping messages together; and flagging messages. Summary of the Invention

[0005] Accordingly, there is a need for electronic devices having improved methods and interfaces for messaging. Such methods and interfaces optionally supplement or replace conventional messaging methods. Such methods and interfaces change the amount, degree, and / or nature of input from the user and result in a more efficient human-machine interface. For battery-powered devices, such methods and interfaces save power and increase the interval between battery charges.

[0006] The above-described deficiencies and other problems associated with the user interface of an electronic device having a touch-sensitive surface can be reduced or eliminated by the disclosed device. In some embodiments, the device is a desktop computer. In some embodiments, the device is portable (e.g., a laptop computer, a tablet computer, or a handheld device). In some embodiments, the device is a personal electronic device (e.g., a wearable electronic device such as a watch). In some embodiments, the device has a touchpad. In some embodiments, the device has a touch-sensitive display (also referred to as a "touch screen" or "touch screen display"). In some embodiments, the device has a graphical user interface (GUI), one or more processors, memory, and one or more modules, programs, or instruction sets stored in the memory for performing multiple functions. In some embodiments, the user interacts with the GUI primarily via a stylus and / or finger contacts and gestures on the touch-sensitive surface. In some embodiments, these functions optionally include image editing, drawing, presentation, word processing, spreadsheet creation, gaming, making phone calls, video conferencing, sending and receiving emails, instant messaging, fitness support, digital photography, digital video recording, web browsing, digital music playback, notepad creation, and / or digital video playback. Executable instructions for performing these functions are optionally included in a non-transitory computer-readable storage medium or other computer program product configured to be executed by one or more processors.

[0007] There is a need for an electronic device having improved methods and interfaces for applying confirmations to message regions in a conversation transcript. Such methods and interfaces can supplement or replace conventional methods for applying confirmations to message regions in a conversation transcript. Such methods and interfaces reduce the amount, degree, and / or nature of input from the user and result in a more efficient human-machine interface.

[0008] According to some embodiments, a method for applying a confirmation to a message area in a conversation transcript displayed on a display of an electronic device includes displaying an instant messaging user interface (e.g., an instant messaging application) on the display, where the instant messaging user interface includes a conversation transcript of an instant messaging session between a user of the electronic device and at least one other user (e.g., a user of another electronic device). The method further includes receiving a first message in the instant messaging session from an electronic device corresponding to another user included in the instant messaging session (e.g., a second electronic device), and in response to receiving the first message, displaying the first message in a first message area of the conversation transcript on the display. The electronic device detects a first input made by a first contact at a position on the touch-sensitive surface corresponding to the position of the first message area in the conversation transcript, and in response to detecting the first input, displays a confirmation selection affordance at a position in the instant messaging interface corresponding to the first message area, where the confirmation selection affordance displays a plurality of confirmation options. Then, the method includes detecting a second input made by a second contact at a position on the touch-sensitive surface corresponding to the position of the first confirmation option in the confirmation selection affordance, and in response to detecting the second input, applying the first confirmation option to the first message area.

[0009] According to some embodiments, an electronic device includes: a display unit configured to display an instant messaging user interface on the display unit, the instant messaging user interface including a conversation transcript of an instant messaging session between a user of the electronic device and at least one other user; a touch-sensitive surface unit configured to detect a contact; and a processing unit coupled to the display unit and the touch-sensitive surface unit. The processing unit is configured to: receive a first message in the instant messaging session from an electronic device corresponding to another user included in the instant messaging session, and in response to receiving the first message, display the first message in a first message area of the conversation transcript on the display unit. The processing unit is further configured to detect a first input made by a first contact at a position on the touch-sensitive surface unit corresponding to the position of the first message area in the conversation transcript, and in response to detecting the first input, display a confirmation selection affordance at a position in the instant messaging interface corresponding to the first message area, where the confirmation selection affordance displays a plurality of confirmation options. The processing unit is further configured to detect a second input made by a second contact at a position on the touch-sensitive surface unit corresponding to the position of the first confirmation option in the confirmation selection affordance, and in response to detecting the second input, apply the first confirmation option to the first message area.

[0010] Accordingly, an electronic device having a display and a touch-sensitive surface has improved methods and interfaces for applying confirmations to message regions in a conversation transcript, thereby enhancing effectiveness, efficiency, and user satisfaction with such devices. Such methods and interfaces may supplement or replace conventional methods for applying confirmations to message regions in a conversation transcript.

[0011] There is a need for an electronic device having improved methods and interfaces for editing sent messages. Such methods and interfaces may supplement or replace conventional methods for editing sent messages. Such methods and interfaces reduce the amount, degree, and / or nature of input from a user and result in a more efficient human-machine interface.

[0012] According to some embodiments, a method of editing a message performed at an electronic device (e.g., a first electronic device) having one or more processors, a memory, a touch-sensitive surface, and a display includes displaying an instant messaging user interface on the display. The instant messaging user interface includes: a conversation transcript of an instant messaging session between a user of the electronic device and at least one other user, and a first message region including a first message sent from the user's electronic device to the at least one other user in the instant messaging session. The method further includes detecting a first input corresponding to a request to edit the first message, and in response to detecting the first input, displaying a message editing interface for the first message, the message editing interface including the first message, a keyboard, and an update affordance, and while the message editing interface for the first message is displayed, detecting one or more inputs that modify the first message, displaying a modified version of the first message; and detecting an input that activates the update affordance.

[0013] The method further includes: in response to detecting an input that activates the update affordance: stopping displaying the message editing interface for the first message; displaying the modified version of the first message in the conversation transcript in place of the first message; displaying at least one indication of the modification of the first message in the conversation transcript; and transmitting the modified version of the first message to one or more electronic devices corresponding to the at least one other user included in the instant messaging session, wherein the one or more electronic devices display the modified version of the first message in place of the first message in the conversation transcript corresponding to the instant messaging session, and at least one indication of the modification of the first message in the conversation transcript.

[0014] According to some embodiments, an electronic device includes: a display unit configured to display an instant messaging user interface on the display unit; a touch-sensitive surface unit configured to detect contacts; and a processing unit coupled to the display unit and the touch-sensitive surface unit. The instant messaging user interface includes: a conversation transcript of an instant messaging session between a user of the electronic device and at least one other user, and a first message area including a first message in the instant messaging session sent from the user's electronic device to the at least one other user in the instant messaging session. The processing unit is configured to: detect a first input corresponding to a request to edit the first message; and in response to detecting the first input, display a message editing interface for the first message, the message editing interface including the first message, a keyboard, and an update affordance. The processing unit is further configured to: when displaying the message editing interface for the first message, detect one or more inputs that modify the first message; display a modified version of the first message; detect an input that activates the update affordance; and in response to detecting the input that activates the update affordance: stop displaying the message editing interface for the first message; display the modified version of the first message in the conversation transcript instead of the first message; display at least one indication of the modification of the first message in the conversation transcript; and transmit the modified version of the first message to one or more electronic devices corresponding to the at least one other user included in the instant messaging session. The one or more electronic devices display the modified version of the first message that replaces the first message in the conversation transcript corresponding to the instant messaging session, and at least one indication of the modification of the first message in the conversation transcript.

[0015] Accordingly, an electronic device having a display and a touch-sensitive surface has improved methods and interfaces for editing sent messages, thereby enhancing effectiveness, efficiency, and user satisfaction using such devices. Such methods and interfaces may supplement or replace conventional methods for editing sent messages in an instant messaging application.

[0016] There is a need for an electronic device having improved methods and interfaces for displaying versions of sent messages. Such methods and interfaces may supplement or replace conventional methods for displaying versions of sent messages. Such methods and interfaces reduce the amount, degree, and / or nature of input from a user and result in a more efficient human-machine interface.

[0017] According to some embodiments, a method performed at an electronic device having one or more processors, a memory, a touch-sensitive surface, and a display includes displaying, on the display, an instant messaging user interface that includes: a conversation transcript of an instant messaging session between a user of the electronic device and at least one other user, and a first message area that includes a current version of a first message in the instant messaging session, wherein the conversation transcript includes an indication that the current version of the first message is a modified version of the first message in the conversation transcript. The method further includes detecting an input corresponding to a request to view a version of the first message; and in response to detecting the input corresponding to the request to view a version of the first message, displaying a version user interface that includes the current version of the first message and one or more previous versions of the first message.

[0018] According to some embodiments, an electronic device includes: a display unit configured to display an instant messaging user interface on a display; a touch-sensitive surface unit configured to detect contacts; and a processing unit coupled to the display unit and the touch-sensitive surface unit. The instant messaging user interface includes: a conversation transcript of an instant messaging session between a user of the electronic device and at least one other user, and a first message area that includes a current version of a first message in the instant messaging session, wherein the conversation transcript includes an indication that the current version of the first message is a modified version of the first message in the conversation transcript. The processing unit is configured to: detect an input corresponding to a request to view a version of the first message; and in response to detecting the input corresponding to the request to view a version of the first message, display a version user interface that includes the current version of the first message and one or more previous versions of the first message.

[0019] Thus, an electronic device having a display and a touch-sensitive surface has improved methods and interfaces for displaying versions of sent messages, thereby enhancing effectiveness, efficiency, and user satisfaction with such devices. Such methods and interfaces may supplement or replace conventional methods for displaying versions of sent messages in an instant messaging application.

[0020] There is a need for an electronic device having improved methods and interfaces for selecting an impact effect for a message. Such methods and interfaces may supplement or replace conventional methods for selecting an impact effect for a message. Such methods and interfaces reduce the amount, degree, and / or nature of input from a user and result in a more efficient human-machine interface.

[0021] According to some embodiments, a method performed at an electronic device having one or more processors, a memory, a touch-sensitive surface, and a display includes displaying, on the display, an instant messaging user interface that includes: a conversation transcript of an instant messaging session between a user of the electronic device and at least one other user, and a message input area that includes a first message input. The method further includes: while displaying the instant messaging user interface, detecting a first input via a first contact at a location on the touch-sensitive surface corresponding to a location in the message input area; in response to detecting the first input via the first contact, displaying an impact selection interface that includes a plurality of impact effect options; while displaying the impact selection interface, detecting a second input via a second contact at a location on the touch-sensitive surface corresponding to a location of a first impact effect option among the plurality of impact effect options; and in response to detecting the second user input via the second contact, displaying a preview of applying the first impact effect option to the first message input.

[0022] According to some embodiments, an electronic device includes: a display unit configured to display an instant messaging user interface on the display unit; a touch-sensitive surface unit configured to detect contacts; and a processing unit coupled to the display unit and the touch-sensitive surface unit. The instant messaging user interface includes: a conversation transcript of an instant messaging session between a user of the electronic device and at least one other user, and a message input area that includes a first message input. The processing unit is configured to: while displaying the instant messaging user interface, detect a first input via a first contact at a location on the touch-sensitive surface unit corresponding to a location in the message input area; and in response to detecting the first input via the first contact, display an impact selection interface that includes a plurality of impact effect options. The processing unit is further configured to: while displaying the impact selection interface, detect a second input via a second contact at a location on the touch-sensitive surface unit corresponding to a location of a first impact effect option among the plurality of impact effect options; and in response to detecting the second user input via the second contact, display a preview of applying the first impact effect option to the first message input.

[0023] Accordingly, an electronic device having a display and a touch-sensitive surface has improved methods and interfaces for selecting an impact effect for a message, thereby enhancing effectiveness, efficiency, and user satisfaction with such devices. Such methods and interfaces may supplement or replace conventional methods for selecting an impact effect in an instant messaging application.

[0024] There is a need for an electronic device having improved methods and interfaces for hiding and showing messages. Such methods and interfaces may supplement or replace conventional methods for hiding and showing messages. Such methods and interfaces reduce the amount, degree, and / or nature of input from the user and result in a more efficient human-machine interface.

[0025] According to some embodiments, a method performed at an electronic device having one or more processors, a memory, a touch-sensitive surface, and a display includes displaying, on the display, an instant messaging user interface that includes: a conversation transcript of an instant messaging session between a user of the electronic device and at least one other user including a first other user, and a message region in the conversation transcript of messages received from the first other user, the message region including one or more screen elements for hiding messages received from the first other user. The method further includes detecting a first input by contact at a location on the touch-sensitive surface corresponding to the message region having a hidden message; and in response to detecting the first input by contact, revealing the hidden message in the message region.

[0026] According to some embodiments, an electronic device includes: a display unit configured to display an instant messaging user interface on the display unit; a touch-sensitive surface unit configured to detect contact; and a processing unit coupled to the display unit and the touch-sensitive surface unit. The instant messaging user interface includes: a conversation transcript of an instant messaging session between a user of the electronic device and at least one other user including a first other user, and a message region in the conversation transcript of messages received from the first other user, the message region including one or more screen elements for hiding messages received from the first other user. The processing unit is further configured to: detect a first input by contact at a location on the touch-sensitive surface unit corresponding to the message region having a hidden message; and in response to detecting the first input by contact, reveal the hidden message in the message region.

[0027] Thus, an electronic device having a display and a touch-sensitive surface has improved methods and interfaces for hiding and revealing messages, thereby enhancing effectiveness, efficiency, and user satisfaction with such devices. Such methods and interfaces may supplement or replace conventional methods for hiding and revealing messages in an instant messaging application.

[0028] There is a need for an electronic device having improved methods and interfaces for displaying enhanced message content in an instant messaging application. Such methods and interfaces may supplement or replace conventional methods for displaying enhanced message content in an instant messaging application. Such methods and interfaces reduce the amount, degree, and / or nature of input from a user and result in a more efficient human-machine interface.

[0029] According to some embodiments, a method performed at an electronic device having one or more processors, a memory, a touch-sensitive surface, and a display includes: displaying, on the display, an instant messaging user interface that includes a conversation transcript of an instant messaging session between a user of the electronic device and at least one other user including a first other user; receiving, from an electronic device corresponding to the first other user included in the instant messaging session, a first message in the instant messaging session; and determining whether the first message includes an enhanced message content trigger. The method further includes: in accordance with determining that the first message includes an enhanced message content trigger, displaying the first message in a first message region of the conversation transcript on the display, and displaying enhanced message content corresponding to the trigger, wherein the enhanced message content includes content that applies an effect to at least one message region other than the first message region in the conversation transcript. The method further includes displaying the first message (e.g., without enhanced message content) in the first message region of the conversation transcript on the display in accordance with determining that the first message does not include an enhanced message content trigger.

[0030] According to some embodiments, an electronic device includes: a display unit configured to display an instant messaging user interface on a display screen; a touch-sensitive surface unit configured to detect contacts; and a processing unit coupled to the display unit and the touch-sensitive surface unit. The instant messaging user interface includes a conversation transcript of an instant messaging session between a user of the electronic device and at least one other user including a first other user. The processing unit is configured to: receive a first message in the instant messaging session from an electronic device corresponding to the first other user included in the instant messaging session, and determine whether the first message includes an enhanced message content trigger. The processing unit is further configured to: in accordance with determining that the first message includes an enhanced message content trigger, display the first message in a first message region of the conversation transcript on the display unit, and display enhanced message content corresponding to the trigger, wherein the enhanced message content includes content that applies an effect to at least one message region other than the first message region in the conversation transcript. Additionally, the processing unit is configured to: display the first message in the first message region of the conversation transcript on the display unit in accordance with determining that the first message does not include an enhanced message content trigger.

[0031] Thus, an electronic device having a display and a touch-sensitive surface has improved methods and interfaces for displaying enhanced message content in an instant messaging application, thereby enhancing effectiveness, efficiency, and user satisfaction with such devices. Such methods and interfaces may supplement or replace conventional methods for displaying enhanced message content in an instant messaging application.

[0032] An electronic device is needed that has improved methods and interfaces for displaying composable content in an instant messaging application. Such methods and interfaces can supplement or replace conventional methods for displaying composable content in an instant messaging application. Such methods and interfaces reduce the amount, degree, and / or nature of input from a user and result in a more efficient human-machine interface.

[0033] According to some embodiments, a method performed at an electronic device having one or more processors, a memory, a touch-sensitive surface, and a display includes displaying, on the display, an instant messaging user interface that includes a conversation transcript of an instant messaging session between a user of the electronic device and at least one other user including a first other user, and a message input area. The method further includes: receiving, from an electronic device corresponding to the first other user included in the instant messaging session, a first message in the instant messaging session, where the first message includes first composable content; in response to receiving the first message, displaying the first message in a first message area of the conversation transcript on the display; receiving an input of a second message in the message input area; and when the second message is displayed in the message input area, detecting an input for sending the second message to the instant messaging session. The method further includes: in response to detecting the input for sending the second message to the instant messaging session: displaying, in the conversation transcript on the display, content corresponding to a predefined combination according to a determination that the second message includes second composable content and that the second composable content and the first composable content are part of the predefined combination; and displaying the second message in a second message area of the conversation transcript on the display (e.g., not displaying content corresponding to the predefined combination in the conversation transcript on the display) according to a determination that the second message does not include second composable content that forms a predefined combination with the first composable content.

[0034] According to some embodiments, an electronic device includes: a display unit configured to display an instant messaging user interface on the display unit; a touch-sensitive surface unit configured to detect contacts; and a processing unit coupled to the display unit and the touch-sensitive surface unit. The instant messaging user interface includes: a conversation transcript of an instant messaging session between a user of the electronic device and at least one other user including a first other user, and a message input area. The processing unit is configured to: receive a first message in the instant messaging session from an electronic device corresponding to the first other user included in the instant messaging session, wherein the first message includes first composable content; in response to receiving the first message, display the first message in a first message area of the conversation transcript on the display unit; receive an input of a second message in the message input area; and when the second message is displayed in the message input area, detect an input for sending the second message to the instant messaging session. The processing unit is further configured to: in response to detecting the input for sending the second message to the instant messaging session: display content corresponding to a predefined combination in the conversation transcript on the display unit based on determining that the second message includes second composable content and the second composable content and the first composable content are part of a predefined combination; and display the second message in a second message area of the conversation transcript on the display unit based on determining that the second message does not include second composable content that forms a predefined combination with the first composable content (e.g., not display content corresponding to the predefined combination in the conversation transcript on the display).

[0035] Accordingly, an electronic device having a display and a touch-sensitive surface has improved methods and interfaces for displaying composable content in an instant messaging application, thereby enhancing effectiveness, efficiency, and user satisfaction with such devices. Such methods and interfaces may supplement or replace conventional methods for displaying composable content in an instant messaging application.

[0036] An electronic device is needed that has improved methods and interfaces for synchronizing media presentations in an instant messaging application. Such methods and interfaces optionally supplement or replace conventional methods for synchronizing media presentations in an instant messaging application. Such methods and interfaces create a more efficient human-machine interface by allowing a user to easily view media content in a synchronized manner directly within the instant messaging application (and without having to be in the same location as another user viewing the media content and without having to use inefficient methods for synchronized viewing). For battery-powered devices, such methods and interfaces increase user satisfaction with the device, save power, and increase the interval between battery charges. Additionally, allowing a user to easily view media content in a synchronized manner directly within the messaging application enhances the device's operability and makes the user device interface (e.g., within the instant messaging application) more efficient (e.g., by allowing for an efficient synchronized viewing of media items), thereby further reducing power usage and extending the device's battery life by enabling the user to use the device more quickly and efficiently.

[0037] According to some embodiments, a method is performed at an electronic device having a display and a touch-sensitive surface. The method includes: displaying an instant messaging user interface on the display, the instant messaging user interface including a transcript of an instant messaging session between a user of a first electronic device and at least one other user. In some embodiments, the transcript includes a representation of a media item displayed at a chronological position within the transcript, and the instant messaging session is configured to allow a user at the first electronic device to synchronously view the media item with at least one other user at a second electronic device different from the first electronic device. The method further includes: receiving a first request for synchronous viewing of the media item within the instant messaging user interface. In response to receiving the first request, the method includes: starting to play content corresponding to the media item when the representation of the media item is displayed at the chronological position. After starting to play the content corresponding to the media item, the method includes: displaying the playback content corresponding to the media item at a fixed position within the instant messaging user interface different from the chronological position. When displaying the playback content corresponding to the media item at the fixed position, the method includes: displaying messages exchanged between the user and at least one other user below the playback content corresponding to the media item; and detecting the end of the content corresponding to the media item. In response to detecting the end of the content corresponding to the media item, the method includes: stopping displaying the content corresponding to the media item at the fixed position.

[0038] According to some embodiments, an electronic device (e.g., Fig. 22The electronic device 2200) includes: a display unit configured to display a user interface; a touch-sensitive surface unit for receiving contacts; one or more sensor units for detecting the intensity of contacts with the touch-sensitive surface unit; and a processing unit coupled to the display unit, the touch-sensitive surface unit, and the one or more sensor units. The processing unit is configured to (or one or more of its components, such as Fig. 22 the unit 2210-2216 shown is configured to) display an instant messaging user interface on the display, the instant messaging user interface including a transcript of an instant messaging session between a user of a first electronic device and at least one other user. In some embodiments, the transcript includes a representation of a media item displayed at a chronological position in the transcript, and the instant messaging session is configured to allow a user at the first electronic device and at least one other user at a second electronic device different from the first electronic device to view the media item synchronously. The processing unit is further configured to: receive a first request for synchronous viewing of a media item in the instant messaging user interface, and in response to receiving the first request, when displaying a representation of the media item at the chronological position in the transcript, start playing the content corresponding to the media item. After starting to play the content corresponding to the media item, the processing unit is configured to: display the playback content corresponding to the media item at a fixed position different from the chronological position in the instant messaging user interface. When displaying the playback content corresponding to the media item at the fixed position, the processing unit is configured to: display the messages exchanged between the user and at least one other user below the playback content corresponding to the media item, and detect the end of the content corresponding to the media item. In response to detecting the end of the content corresponding to the media item, the processing unit is configured to: stop displaying the content corresponding to the media item at the fixed position.

[0039] Accordingly, an electronic device having a display and a touch-sensitive surface has a faster and more efficient method and interface for viewing media content in a synchronous manner in an instant messaging application, thereby enhancing effectiveness, efficiency, operability, and user satisfaction using such a device. Such methods and interfaces may supplement or replace conventional methods for viewing media in an instant messaging application.

[0040] An electronic device is needed that has improved methods and interfaces for using handwritten input in an instant messaging application. Such methods and interfaces optionally supplement or replace conventional methods for entering messages in an instant messaging application. Such methods and interfaces help to increase user satisfaction with their devices and create a more efficient human-machine interface by, for example, allowing the user to simply rotate the device to begin entering handwritten input. Such methods and interfaces also create a more efficient human-machine interface by allowing handwritten input to automatically replace typed input and allowing the user to use handwritten characters as keys to visually form a keyboard, thereby increasing the operability of the device. For battery-powered devices, such methods and interfaces save power and increase the interval between battery charges. Additionally, allowing the user to simply rotate the device to begin entering handwritten input, automatically replace typed input, and use handwritten characters as keys to form a keyboard all contribute to enhancing the operability of the device and making the user device interface (e.g., in an instant messaging application) more efficient (e.g., by allowing the user to easily customize message content using handwritten input), thereby further reducing power usage and extending the battery life of the device by enabling the user to use the device more quickly and efficiently. For example, the user does not need to leave the instant messaging application, open and use a different application to enter or locate handwritten input, and then return to use those inputs in the instant messaging application. Instead, the user can simply provide and / or select customized handwritten input directly in the messaging application.

[0041] According to some embodiments, a method is performed at an electronic device having a display and a touch-sensitive surface. The method includes: when the electronic device is in a portrait orientation, displaying an instant messaging user interface on the display, the instant messaging user interface including a virtual keyboard. The method further includes: detecting an orientation change of the electronic device from the portrait orientation to the landscape orientation; and in response to detecting the orientation change of the electronic device: stopping the display of the virtual keyboard and displaying a handwritten input area on the display that is configured to receive handwritten input from a user of the electronic device.

[0042] According to some embodiments, an electronic device includes: a display unit configured to display a user interface; a touch-sensitive surface unit for receiving contacts; one or more sensor units for detecting the intensity of contacts with the touch-sensitive surface unit; and a processing unit coupled to the display unit, the touch-sensitive surface unit, and the one or more sensor units. The processing unit is configured to: when the electronic device is in a portrait orientation, display an instant messaging user interface on the display, the instant messaging user interface including a virtual keyboard; detect an orientation change of the electronic device from the portrait orientation to the landscape orientation; and in response to detecting the orientation change of the electronic device: stop displaying the virtual keyboard; and display a handwritten input area on the display that is configured to receive handwritten input from a user of the electronic device.

[0043] According to some embodiments, a method is performed at an electronic device having a display and a touch-sensitive surface. The method includes: displaying on the display: an instant messaging user interface that includes a conversation transcript of an instant messaging session between a user of the electronic device and at least one other user, a virtual keyboard, and a message input area. The method further includes: receiving a plurality of typed inputs at the virtual keyboard. When the plurality of typed inputs are received, the method includes: determining whether one or more of the plurality of typed inputs match a character sequence stored in association with a user's stored handwritten input. Based on determining that the one or more typed inputs match the stored string, the method includes: displaying an optional representation of the stored handwritten input at a first position of a first set of characters displayed adjacent to the message input area. In some embodiments, the first set of characters is displayed in the message input area and includes characters corresponding to one or more of the typed inputs that match the stored character sequence. The method further includes: detecting a selection of the optional representation of the stored handwritten input via the touch-sensitive surface; and in response to detecting the selection of the optional representation of the stored handwritten input: ceasing to display the optional representation of the stored handwritten input at the first position; and replacing the display of the first set of characters corresponding to the one or more typed inputs with a display of the representation of the stored handwritten input in the message input area.

[0044] According to some embodiments, an electronic device includes: a display unit configured to display a user interface; a touch-sensitive surface unit for receiving contacts; one or more sensor units for detecting the intensity of contacts with the touch-sensitive surface unit; and a processing unit coupled to the display unit, the touch-sensitive surface unit, and the one or more sensor units. The processing unit is configured to: display on the display: an instant messaging user interface that includes a conversation transcript of an instant messaging session between a user of the electronic device and at least one other user, a virtual keyboard, and a message input area. The processing unit is configured to: receive a plurality of typing inputs at the virtual keyboard; when receiving the plurality of typing inputs, determine whether one or more of the plurality of typing inputs match a character sequence stored in association with a user's stored handwritten input; based on determining that one or more of the plurality of typing inputs match the stored character sequence, display an optional representation of the stored handwritten input at a first position of a first set of characters displayed adjacent to the message input area, the first set of characters being displayed in the message input area and including characters corresponding to one or more of the typing inputs that match the stored character sequence; detect a selection of the optional representation of the stored handwritten input via the touch-sensitive surface; and in response to detecting the selection of the optional representation of the stored handwritten input: stop displaying the optional representation of the stored handwritten input at the first position; and replace the display of the first set of characters corresponding to the one or more typing inputs with a display of the representation of the stored handwritten input in the message input area.

[0045] According to some embodiments, a method is performed at an electronic device having a display and a touch-sensitive surface. The method includes: detecting a first input via the touch-sensitive surface; in response to detecting the first input, presenting a keyboard-ready user interface on the display; while presenting the keyboard-ready user interface, receiving a handwritten input corresponding to a set of predefined training characters via the touch-sensitive surface; after receiving the handwritten input, detecting a second input corresponding to a request to display an instant messaging user interface including a message input area and a virtual keyboard having a plurality of keys, wherein a first key of the plurality of keys is associated with a first handwritten input of the received handwritten input; in response to detecting the second input, displaying the instant messaging user interface including the message input area and the virtual keyboard having the plurality of keys; receiving a selection of the first key via the touch-sensitive surface; and in response to receiving the selection of the first key, outputting a representation of the first handwritten input in the message input area.

[0046] According to some embodiments, an electronic device includes: a display unit configured to display a user interface; a touch-sensitive surface unit for receiving contacts; one or more sensor units for detecting the intensity of contacts with the touch-sensitive surface unit; and a processing unit coupled to the display unit, the touch-sensitive surface unit, and the one or more sensor units. The processing unit is configured to: detect a first input via the touch-sensitive surface; in response to detecting the first input, present a keyboard-ready user interface on the display; while presenting the keyboard-ready user interface, receive a handwritten input corresponding to a set of predefined training characters via the touch-sensitive surface; after receiving the handwritten input, detect a second input corresponding to a request to display an instant messaging user interface including a message input area and a virtual keyboard having a plurality of keys, wherein a first key among the plurality of keys is associated with a first handwritten input in the received handwritten input; in response to detecting the second input, display the instant messaging user interface including the message input area and the virtual keyboard having the plurality of keys; receive a selection of the first key via the touch-sensitive surface; and in response to receiving the selection of the first key, output a representation of the first handwritten input in the message input area.

[0047] Accordingly, an electronic device having a display, a touch-sensitive surface, and optionally one or more sensors for detecting the intensity of contacts with the touch-sensitive surface has faster and more efficient methods and interfaces for handwritten messaging, thereby enhancing effectiveness, efficiency, and user satisfaction with such devices. Such methods and interfaces may supplement or replace conventional methods for composing and submitting messages.

[0048] There is a need for electronic devices having improved methods and interfaces for quickly locating different types of content in an instant messaging application. Such methods and interfaces optionally supplement or replace conventional methods. Such methods and interfaces result in a more efficient human-machine interface by allowing a user to quickly reduce the display size of content in the instant messaging application using only simple gestures, enabling the user to quickly locate desired content (e.g., the user can reduce all plain text content to quickly locate an emoji, photo, video, or other type of content that may have been received long ago). For battery-powered devices, such methods and interfaces save power and increase the interval between battery charges (e.g., by allowing the user to quickly locate desired content). Additionally, allowing the user to quickly locate desired content enhances the operability of the device and makes the user device interface (e.g., in an instant messaging application) more efficient (e.g., by allowing the user to easily locate desired content that may be large and difficult to search for in a conversation transcript), thereby further reducing power usage and extending the battery life of the device by enabling the user to use the device more quickly and efficiently (e.g., the user does not need to scroll page by page through the content in a conversation transcript, but can simply provide an intuitive gesture to easily reduce the content and thus easily locate the desired content).

[0049] According to some embodiments, a method is performed at an electronic device having a display and a touch-sensitive surface. The method includes: displaying, on the display, an instant messaging user interface that includes a plurality of content items. In some embodiments, the plurality of content items includes a content item having a first content type, the plurality of content items includes a content item having a second content type different from the first content type, and corresponding content items among the plurality of content items are displayed in corresponding first sizes. While displaying the instant messaging user interface, the method includes: detecting a first input via the touch-sensitive surface. In response to detecting the first input, the method includes: reducing the display size of at least some of the content items having the first content type while continuing to display the content items having the second content type in their corresponding first sizes.

[0050] According to some embodiments, an electronic device includes: a display unit configured to display a user interface; a touch-sensitive surface unit for receiving contacts; one or more sensor units for detecting a contact intensity with the touch-sensitive surface unit; and a processing unit coupled to the display unit, the touch-sensitive surface unit, and the one or more sensor units. The processing unit is configured to: display, on the display, an instant messaging user interface that includes a plurality of content items. In some embodiments, the plurality of content items includes at least a content item having a first content type, the plurality of content items includes at least a content item having a second content type different from the first content type, and corresponding content items among the plurality of content items are displayed in corresponding first sizes. While displaying the instant messaging user interface, the processing unit is configured to: detect a first input via the touch-sensitive surface and, in response to detecting the first input, reduce the display size of at least some of the content items having the first content type while continuing to display the content items having the second content type in their corresponding first sizes.

[0051] According to some embodiments, a method is performed at an electronic device having a display and a touch-sensitive surface. The method includes: displaying, on the display, an instant messaging user interface including a plurality of content items. In some embodiments, the plurality of content items includes a content item having a first content type, the plurality of content items includes a content item having a second content type different from the first content type, and respective content items in the plurality of content items are displayed in respective first sizes. While displaying the instant messaging user interface, the method includes: detecting a first input via the touch-sensitive surface, and in response to detecting the first input, the method includes: reducing the display size of at least some of the content items having the first content type such that a first content item having the first content type is reduced to a respective second size less than the respective first size by a predefined first display size reduction factor; and reducing the display size of at least some of the content items having the second content type such that a second content item having the second content type is reduced to a respective third size less than the respective first size by a predefined second display size reduction factor. In some embodiments, the predefined second display size reduction factor is less than the predefined first display size reduction factor.

[0052] According to some embodiments, an electronic device includes: a display unit configured to display a user interface; a touch-sensitive surface unit for receiving contacts; one or more sensor units for detecting a contact intensity with the touch-sensitive surface unit; and a processing unit coupled to the display unit, the touch-sensitive surface unit, and the one or more sensor units. The processing unit is configured to: display, on the display, an instant messaging user interface including a plurality of content items. In some embodiments, the plurality of content items includes a content item having a first content type, the plurality of content items includes a content item having a second content type different from the first content type, and respective content items in the plurality of content items are displayed in respective first sizes. While displaying the instant messaging user interface, the processing unit is configured to: detect a first input via the touch-sensitive surface. In response to detecting the first input, the processing unit is configured to: reduce the display size of at least some of the content items having the first content type such that a first content item having the first content type is reduced to a respective second size less than the respective first size by a predefined first display size reduction factor; and reduce the display size of at least some of the content items having the second content type such that a second content item having the second content type is reduced to a respective third size less than the respective first size by a predefined second display size reduction factor. In some embodiments, the predefined second display size reduction factor is less than the predefined first display size reduction factor.

[0053] Accordingly, an electronic device having a display, a touch-sensitive surface, and optionally one or more sensors for detecting the intensity of contact with the touch-sensitive surface has fast and efficient methods and interfaces for quickly locating different types of content in an instant messaging application, thereby enhancing the effectiveness, efficiency, and user satisfaction with such devices.

[0054] There is a need for an electronic device having improved methods and interfaces for sharing images (e.g., photos) in a messaging conversation. Such methods and interfaces may supplement or replace conventional methods for sharing images (e.g., photos) in a messaging conversation. Such methods and interfaces reduce the amount, degree, and / or nature of input from a user and result in a more efficient human-machine interface.

[0055] In accordance with some embodiments, a method is performed at an electronic device having a display, a digital camera, a touch-sensitive surface, and a memory. The method includes displaying an instant messaging user interface on the display, the instant messaging user interface including a conversation transcript of an instant messaging session between a user of the electronic device and at least one other user, a keyboard, a message input area, and a digital image enabling representation. The method further includes, while displaying the instant messaging user interface, detecting an input that activates the digital image enabling representation. The method further includes, in response to detecting the input that activates the digital image enabling representation, replacing the display of the keyboard with a display of a plurality of digital images, the plurality of digital images including one or more digital images stored in the memory and a real-time preview image from the digital camera. The method further includes detecting an input that selects a real-time image displayed among the plurality of digital images. The method further includes, in response to detecting the input that selects the real-time image, capturing a digital image using the digital camera while maintaining the display of the conversation transcript.

[0056] According to some embodiments, an electronic device includes: a display unit configured to display a user interface; a digital camera unit configured to capture images; a touch-sensitive surface unit; a memory unit; and a processing unit coupled to the display unit, the digital camera unit, the touch-sensitive surface unit, and the memory unit. The processing unit is configured to: display an instant messaging user interface on the display unit, the instant messaging user interface including a conversation transcript of an instant messaging session between a user of the electronic device and at least one other user, a keyboard, a message input area, and a digital image enabling representation. The processing unit is further configured to: upon displaying the instant messaging user interface, detect an input that activates the digital image enabling representation. The processing unit is further configured to: in response to detecting the input that activates the digital image enabling representation, replace the display of the keyboard with a display of a plurality of digital images, the plurality of digital images including one or more digital images stored in the memory unit and a live preview image from the digital camera unit. The processing unit is further configured to detect an input that selects a live image displayed among the plurality of digital images. The processing unit is further configured to, in response to detecting the input that selects the live image, use the digital camera unit to capture a digital image while maintaining the display of the conversation transcript.

[0057] Thus, an electronic device having a display and a touch-sensitive surface has improved methods and interfaces for sharing images (e.g., photos) in a message conversation, thereby enhancing effectiveness, efficiency, and user satisfaction with such devices. Such methods and interfaces may supplement or replace conventional methods for sharing images (e.g., photos) in a message conversation.

[0058] There is a need for electronic devices having improved methods and interfaces for searching and sharing content (e.g., content from the Internet and locally stored content) in a message conversation. Such methods and interfaces may supplement or replace conventional methods for searching and sharing content in a message conversation. Such methods and interfaces reduce the amount, degree, and / or nature of input from a user and result in a more efficient human-machine interface.

[0059] According to some embodiments, a method is performed at an electronic device having a display and a touch-sensitive surface. The method includes displaying, on the display, an instant messaging user interface that includes a conversation transcript of an instant messaging session between a user of the electronic device and at least one other user, and a search affordance. The method further includes, while displaying the instant messaging user interface, detecting an input that activates the search affordance. The method further includes: in response to detecting the input that activates the search affordance: stopping the display of the instant messaging user interface, and displaying a search user interface that includes a search field and a plurality of categorized content items, where the plurality of categorized content items includes at least content items stored on the electronic device and content items from the Internet. The method further includes: while displaying the search user interface, detecting an input that selects a first content item from the plurality of categorized content items. The method further includes: after detecting the input that selects the first content item from the plurality of categorized content items: stopping the display of the search user interface, displaying the first content item in the conversation transcript in the instant messaging user interface, and transmitting the first content item to one or more electronic devices corresponding to at least one other user included in the instant messaging session, where the one or more electronic devices display the first content item in the conversation transcript corresponding to the instant messaging session.

[0060] According to some embodiments, an electronic device includes: a display unit configured to display a user interface; a touch-sensitive surface unit; a memory unit; and a processing unit coupled to the display unit, the touch-sensitive surface unit, and the memory unit. The processing unit is configured to: display, on the display unit, an instant messaging user interface that includes a conversation transcript of an instant messaging session between a user of the electronic device and at least one other user, and a search affordance. The processing unit is further configured to: while displaying the instant messaging user interface, detect an input that activates the search affordance. The processing unit is further configured to: in response to detecting the input that activates the search affordance: stop the display of the instant messaging user interface, and display a search user interface that includes a search field and a plurality of categorized content items, where the plurality of categorized content items includes at least content items stored on the electronic device and content items from the Internet. The processing unit is further configured to: while displaying the search user interface, detect an input that selects a first content item from the plurality of categorized content items. The processing unit is further configured to: after detecting the input that selects the first content item from the plurality of categorized content items: stop the display of the search user interface, display the first content item in the conversation transcript in the instant messaging user interface, and transmit the first content item to one or more electronic devices corresponding to at least one other user included in the instant messaging session, where the one or more electronic devices display the first content item in the conversation transcript corresponding to the instant messaging session.

[0061] Accordingly, an electronic device having a display and a touch-sensitive surface has improved methods and interfaces for searching for shared content in a messaging conversation, thereby enhancing the effectiveness, efficiency, and user satisfaction of such devices. Such methods and interfaces may supplement or replace conventional methods for sharing content in a conversation.

[0062] There is a need for an electronic device having improved methods and interfaces for adding an interactive application in an instant messaging application. Such methods and interfaces may supplement or replace conventional methods for adding an interactive application in an instant messaging application. Such methods and interfaces reduce the amount, degree, and / or nature of input from a user and result in a more efficient human-machine interface.

[0063] According to some embodiments, a method is performed at an electronic device having one or more processors, a memory, a touch-sensitive surface, and a display. The method includes: displaying, on the display, an instant messaging user interface of an instant messaging application, the instant messaging user interface including a conversation transcript of an instant messaging session between a user of the electronic device and at least one other user and application enablement representations; while displaying the instant messaging user interface, detecting an input that activates an application enablement representation; in response to detecting the input that activates the application enablement representation, simultaneously displaying a launch icon for an application store and a plurality of launch icons for interactive applications, wherein activating a corresponding launch icon for an interactive application will launch the corresponding application displayed in the instant messaging application; detecting an input that activates the launch icon for the application store; in response to detecting the input that activates the launch icon for the application store: ceasing to display the instant messaging user interface and displaying an application store user interface, including displaying at least one interactive application available for download to the electronic device; while displaying the application store user interface, detecting an input corresponding to a request to download a first interactive application not stored in the memory of the electronic device; and in response to detecting the input corresponding to the request to download the first interactive application: downloading the first interactive application to the memory of the electronic device; replacing the display of the application store user interface with a display of the instant messaging user interface, the instant messaging user interface including the conversation transcript and at least some of the plurality of launch icons for interactive applications; and adding a launch icon corresponding to the first interactive application to the display of the plurality of launch icons for interactive applications.

[0064] According to some embodiments, an electronic device includes: a display unit configured to display a user interface; a touch-sensitive surface unit configured to detect contacts; and a processing unit coupled to the display unit and the touch-sensitive surface unit. The processing unit is configured to: enable, on the display unit, a display of an instant messaging user interface for an instant messaging application, the instant messaging user interface including a conversation transcript of an instant messaging session between a user of the electronic device and at least one other user and application enabling representations; while displaying the instant messaging user interface, detect an input that activates an application enabling representation; in response to detecting the input that activates the application enabling representation, simultaneously enable a display of a launch icon for an application store and a plurality of launch icons for interactive applications, wherein activating a corresponding launch icon of an interactive application will launch a corresponding application displayed in the instant messaging application; detect an input that activates the launch icon for the application store; in response to detecting the input that activates the launch icon for the application store: stop displaying the instant messaging user interface and enable a display of an application store user interface, including displaying at least one interactive application available for download to the electronic device; while displaying the application store user interface, detect an input corresponding to a request to download a first interactive application not stored in a memory of the electronic device; and in response to detecting the input corresponding to the request to download the first interactive application: download the first interactive application to the memory of the electronic device; replace the display of the application store user interface with a display of the instant messaging user interface, the instant messaging user interface including the conversation transcript and at least some of the plurality of launch icons for the interactive applications; and add a launch icon corresponding to the first interactive application to the display of the plurality of launch icons for the interactive applications.

[0065] Thus, an electronic device having a display and a touch-sensitive surface has improved methods and interfaces for adding interactive applications in an instant messaging application, thereby enhancing effectiveness, efficiency, and user satisfaction with such devices. Such methods and interfaces may supplement or replace conventional methods for adding interactive applications in an instant messaging application.

[0066] There is a need for an electronic device having improved methods and interfaces for posting messages. Such methods and interfaces may supplement or replace conventional methods for posting messages. Such methods and interfaces reduce the amount, degree, and / or nature of input from a user and result in a more efficient human-machine interface.

[0067] According to some embodiments, a method is performed at an electronic device having one or more processors, a memory, a touch-sensitive surface, and a display. The method includes: displaying, on the display, an instant messaging user interface of an instant messaging application, the instant messaging user interface including a conversation transcript of an instant messaging session between a user of the electronic device and at least one other user, a first message input area, and a launch icon for an interactive application; while displaying the instant messaging user interface, detecting an input that activates the launch icon for the interactive application; in response to detecting the input that activates the launch icon for the interactive application, displaying a user interface of the interactive application, the interactive application user interface including a second message input area different from the first message input area; while displaying the interactive application user interface, detecting an input of a first message in the second message input area; in response to detecting the input of the first message in the second message input area, displaying the first message in the second message input area; while displaying the first message in the second message input area, detecting an input corresponding to a request to post the content of the second message input area to the instant messaging session; and in response to detecting the input corresponding to the request to post the content of the second message input area to the instant messaging session, transmitting the first message to one or more electronic devices corresponding to at least one other user included in the instant messaging session, wherein the one or more electronic devices display the first message in a session transcript corresponding to the instant messaging session.

[0068] According to some embodiments, an electronic device includes: a display unit configured to display a user interface; a touch-sensitive surface unit configured to detect contacts; and a processing unit coupled to the display unit and the touch-sensitive surface unit. The processing unit is configured to: enable display of an instant messaging user interface for an instant messaging application on the display unit, the instant messaging user interface including a conversation transcript of an instant messaging session between a user of the electronic device and at least one other user, a first message input area, and a launch icon for an interactive application; when displaying the instant messaging user interface, detect an input activating the launch icon of the interactive application; in response to detecting the input activating the launch icon of the interactive application, enable display of a user interface of the interactive application, the interactive application user interface including a second message input area different from the first message input area; when displaying the interactive application user interface, detect an input of a first message in the second message input area; in response to detecting the input of the first message in the second message input area, enable display of the first message in the second message input area; when the first message is displayed in the second message input area, detect an input corresponding to a request to post the content of the second message input area to the instant messaging session; and in response to detecting the input corresponding to the request to post the content of the second message input area to the instant messaging session, transmit the first message to one or more electronic devices corresponding to at least one other user included in the instant messaging session, wherein the one or more electronic devices display the first message in a session transcript corresponding to the instant messaging session.

[0069] Thus, an electronic device having a display and a touch-sensitive surface has improved methods and interfaces for posting messages, thereby enhancing effectiveness, efficiency, and user satisfaction using such devices. Such methods and interfaces may supplement or replace conventional methods for posting messages.

[0070] There is a need for electronic devices having improved methods and interfaces for using interactive applications in an instant messaging application. Such methods and interfaces may supplement or replace conventional methods for using interactive applications in an instant messaging application. Such methods and interfaces reduce the amount, degree, and / or nature of input from the user and result in a more efficient human-machine interface.

[0071] According to some embodiments, a method is performed at an electronic device having one or more processors, a memory, a touch-sensitive surface, and a display. The method includes: displaying, on the display, an instant messaging user interface of an instant messaging application, the instant messaging user interface including a conversation transcript of an instant messaging session between a user of the electronic device and at least one other user, a message input area, and an icon of an interactive application displayed in the conversation transcript; while displaying the instant messaging user interface, detecting an input that activates the icon of the interactive application; in response to detecting the input that activates the icon of the interactive application, displaying the user interface of the interactive application in a first state; while displaying the user interface of the interactive application, detecting a first user input in the user interface of the interactive application; and in response to detecting the first user input in the user interface of the interactive application: changing the display of the user interface of the interactive application from the first state to a second state, and sending information to one or more electronic devices corresponding to at least one other user included in the instant messaging session indicating that the first user input was made in the user interface of the interactive application, wherein the one or more electronic devices display a marker of the first user input.

[0072] According to some embodiments, an electronic device includes: a display unit configured to display a user interface; a touch-sensitive surface unit configured to detect contact; and a processing unit coupled to the display unit and the touch-sensitive surface unit. The processing unit is configured to: enable the display of an instant messaging user interface of an instant messaging application on the display unit, the instant messaging user interface including a conversation transcript of an instant messaging session between a user of the electronic device and at least one other user, a message input area, and an icon of an interactive application displayed in the conversation transcript; while displaying the instant messaging user interface, detect an input that activates the icon of the interactive application; in response to detecting the input that activates the icon of the interactive application, enable the display of the user interface of the interactive application in a first state; while displaying the user interface of the interactive application, detect a first user input in the user interface of the interactive application; and in response to detecting the first user input in the user interface of the interactive application: change the display of the user interface of the interactive application from the first state to a second state, and send information to one or more electronic devices corresponding to at least one other user included in the instant messaging session indicating that the first user input was made in the user interface of the interactive application, wherein the one or more electronic devices display a marker of the first user input.

[0073] Accordingly, an electronic device having a display and a touch-sensitive surface has improved methods and interfaces for using an interactive application in an instant messaging application, thereby enhancing effectiveness, efficiency, and user satisfaction with such devices. Such methods and interfaces may supplement or replace conventional methods for using an interactive application in an instant messaging application.

[0074] There is a need for an electronic device having improved methods and interfaces for using an interactive application in an instant messaging application. Such methods and interfaces may supplement or replace conventional methods for using an interactive application in an instant messaging application. Such methods and interfaces reduce the amount, degree, and / or nature of input from a user and result in a more efficient human-machine interface.

[0075] According to some embodiments, a method is performed at an electronic device having one or more processors, memory, a touch-sensitive surface, and a display. The method includes: displaying, on the display, an instant messaging user interface of an instant messaging application, the instant messaging user interface including a conversation transcript of an instant messaging session between a user of the electronic device and at least one other user and a message input area; while displaying the instant messaging user interface, receiving, from an electronic device corresponding to another user included in the instant messaging session, an instruction to display an icon of an interactive application in the conversation transcript; in response to receiving the instruction, displaying the icon of the interactive application in the conversation transcript; while displaying the icon of the interactive application in the conversation transcript, detecting an input to activate the icon of the interactive application; and in response to detecting the input to activate the icon of the interactive application displayed in the conversation transcript: displaying a user interface of the interactive application based on determining that the interactive application corresponding to the icon of the interactive application is stored in the memory of the electronic device, and based on determining that the interactive application corresponding to the icon of the interactive application is not stored in the memory of the electronic device: downloading the interactive application from a remote server to the memory of the electronic device, and after downloading the interactive application from the remote server, displaying a user interface of the interactive application.

[0076] According to some embodiments, an electronic device includes: a display unit configured to display a user interface; a touch-sensitive surface unit configured to detect contacts; and a processing unit coupled to the display unit and the touch-sensitive surface unit. The processing unit is configured to: enable display of an instant messaging user interface of an instant messaging application on the display unit, the instant messaging user interface including a conversation transcript of an instant messaging session between a user of the electronic device and at least one other user and a message input area; when displaying the instant messaging user interface, receive an instruction from an electronic device corresponding to another user included in the instant messaging session for displaying an icon of an interactive application in the conversation transcript; in response to receiving the instruction, enable display of the icon of the interactive application in the conversation transcript; when displaying the icon of the interactive application in the conversation transcript, detect an input for activating the icon of the interactive application; and in response to detecting the input for activating the icon of the interactive application displayed in the conversation transcript: enable display of a user interface of the interactive application according to a determination that the interactive application corresponding to the icon of the interactive application is stored in a memory of the electronic device, and according to a determination that the interactive application corresponding to the icon of the interactive application is not stored in the memory of the electronic device: download the interactive application from a remote server to the memory of the electronic device, and after downloading the interactive application from the remote server, enable display of the user interface of the interactive application.

[0077] Thus, an electronic device having a display and a touch-sensitive surface has improved methods and interfaces for using interactive applications in an instant messaging application, thereby enhancing effectiveness, efficiency, and user satisfaction with such devices. Such methods and interfaces may supplement or replace conventional methods for using interactive applications in an instant messaging application.

[0078] There is a need for an electronic device having improved methods and interfaces for using interactive applications in an instant messaging application. Such methods and interfaces may supplement or replace conventional methods for using interactive applications in an instant messaging application. Such methods and interfaces reduce the amount, degree, and / or nature of input from a user and result in a more efficient human-machine interface.

[0079] According to some embodiments, a method is performed at an electronic device having a display and a touch-sensitive surface. The method includes: displaying, on the display, an instant messaging user interface of an instant messaging application, the instant messaging user interface including: a conversation transcript of an instant messaging session between a user of the electronic device and at least one other user, displayed in a first region of the display; a first interactive application object corresponding to a first interactive application, displayed in the conversation transcript; a message input region; and an input region of the first interactive application, different from the message input region, displayed in a second region of the display, the input region of the first interactive application including one or more input affordances; and detecting an input that activates a first input affordance in the input region of the interactive application.

[0080] According to some embodiments, an electronic device includes a display unit and a touch-sensitive surface unit, and a processing unit coupled to the display unit and the touch-sensitive surface unit. The processing unit is configured to: enable display, on the display unit, of an instant messaging user interface of an instant messaging application, the instant messaging user interface including: a conversation transcript of an instant messaging session between a user of the electronic device and at least one other user, displayed in a first region of the display; a first interactive application object corresponding to a first interactive application, displayed in the conversation transcript; a message input region; and an input region of the first interactive application, different from the message input region, displayed in a second region of the display, the input region of the first interactive application including one or more input affordances; and detecting an input that activates a first input affordance in the input region of the interactive application.

[0081] Thus, an electronic device having a display and a touch-sensitive surface has improved methods and interfaces for using an interactive application in an instant messaging application, thereby enhancing effectiveness, efficiency, and user satisfaction with such devices. Such methods and interfaces may supplement or replace conventional methods for using an interactive application in an instant messaging application.

[0082] There is a need for an electronic device having improved methods and interfaces for using an interactive application in an instant messaging application. Such methods and interfaces may supplement or replace conventional methods for using an interactive application in an instant messaging application. Such methods and interfaces reduce the amount, degree, and / or nature of input from a user and result in a more efficient human-machine interface.

[0083] According to some embodiments, a method is performed at an electronic device having a display and a touch-sensitive surface. The method includes: displaying, on the display, an instant messaging user interface of an instant messaging application, the instant messaging user interface including: a conversation transcript of an instant messaging session between a user of the electronic device and at least one other user, a first interactive application object corresponding to a first interactive application displayed in the conversation transcript, and a message input area. The method further includes: detecting a first input when a focus selector is at a position on the touch-sensitive surface corresponding to the first interactive application object displayed in the conversation transcript; in response to detecting the first input, displaying an input area of the first interactive application different from the message input area, the input area of the first interactive application including one or more input affordances; while displaying the input area of the first interactive application, detecting one or more inputs on the one or more input affordances; after detecting the one or more inputs on the one or more input affordances: updating the first interactive application; sending information to one or more electronic devices corresponding to at least one other user included in the instant messaging session such that a corresponding user interface of the first interactive application displayed in the corresponding conversation transcript of the instant messaging session is updated; and stopping displaying the input area of the first interactive application.

[0084] According to some embodiments, an electronic device includes a display unit and a touch-sensitive surface unit, and a processing unit coupled to the display unit and the touch-sensitive surface unit. The processing unit is configured to: enable display, on the display unit, of an instant messaging user interface of an instant messaging application, the instant messaging user interface including: a conversation transcript of an instant messaging session between a user of the electronic device and at least one other user, a first interactive application object corresponding to a first interactive application displayed in the conversation transcript, and a message input area. The processing unit is further configured to: detect a first input when a focus selector is at a position on the touch-sensitive surface unit corresponding to the first interactive application object displayed in the conversation transcript; in response to detecting the first input, enable display of an input area of the first interactive application different from the message input area, the input area of the first interactive application including one or more input affordances; while displaying the input area of the first interactive application, detect one or more inputs on the one or more input affordances; after detecting the one or more inputs on the one or more input affordances: update the first interactive application; send information to one or more electronic devices corresponding to at least one other user included in the instant messaging session such that a corresponding user interface of the first interactive application displayed in the corresponding conversation transcript of the instant messaging session is updated; and stop displaying the input area of the first interactive application.

[0085] Accordingly, an electronic device having a display and a touch-sensitive surface has improved methods and interfaces for using interactive applications in an instant messaging application, thereby enhancing effectiveness, efficiency, and user satisfaction using such devices. Such methods and interfaces may supplement or replace conventional methods for using interactive applications in an instant messaging application.

[0086] There is a need for an electronic device having improved methods and interfaces for enabling the use of interactive applications in an instant messaging application. Such methods and interfaces may supplement or replace conventional methods for enabling the use of interactive applications in an instant messaging application. Such methods and interfaces reduce the amount, degree, and / or nature of input from a user and result in a more efficient human-machine interface.

[0087] In accordance with some embodiments, a method is performed at an electronic device having a display and a touch-sensitive surface, wherein an instant messaging application and a plurality of other applications are stored in a memory, and a respective application of the plurality of other applications has a normal mode for normal operation on the electronic device and an embedded mode for operation in the instant messaging application on the electronic device. The method includes: displaying a plurality of toggling affordance representations, wherein a respective toggling affordance representation of the plurality of toggling affordance representations has a corresponding application in the plurality of other applications stored in the memory; the respective toggling affordance representation having a first state that enables the display of a corresponding launch icon in the instant messaging application to operate the corresponding application in the embedded mode in the instant messaging application; the respective toggling affordance representation having a second state that blocks the display of the corresponding launch icon in the instant messaging application to prevent the operation of the corresponding application in the embedded mode in the instant messaging application; the plurality of toggling affordance representations including a first toggling affordance representation of a first application displayed in the first state and a second toggling affordance representation of a second application displayed in the second state. While displaying the plurality of toggling affordance representations, the method further includes: detecting a first user input at a first location corresponding to the first toggling affordance representation; and in response to detecting the first user input at the first location corresponding to the first toggling affordance representation: changing the first toggling affordance representation from the first state to the second state and blocking the display of the corresponding launch icon of the first application in the instant messaging application.

[0088] According to some embodiments, an electronic device includes a display unit and a touch-sensitive surface unit, and a processing unit coupled to the display unit and the touch-sensitive surface unit, wherein an instant messaging application and a plurality of other applications are stored in a memory of the electronic device, and a corresponding application among the plurality of other applications has a normal mode for normal operation on the electronic device and an embedded mode for operation in the instant messaging application on the electronic device. The processing unit is configured to: enable display of a plurality of toggling enable representations, wherein a corresponding toggling enable representation among the plurality of toggling enable representations has a corresponding application among the plurality of other applications stored in the memory; the corresponding toggling enable representation has a first state that enables display of a corresponding launch icon in the instant messaging application to operate the corresponding application in the embedded mode in the instant messaging application; the corresponding toggling enable representation has a second state that blocks display of the corresponding launch icon in the instant messaging application to block operation of the corresponding application in the embedded mode in the instant messaging application; the plurality of toggling enable representations includes a first toggling enable representation of a first application displayed in the first state and a second toggling enable representation of a second application displayed in the second state. The processing unit is further configured to: when displaying the plurality of toggling enable representations, detect a first user input corresponding to the first toggling enable representation at a first location; and in response to detecting the first user input corresponding to the first toggling enable representation at the first location: change the first toggling enable representation from the first state to the second state and block display of the corresponding launch icon of the first application in the instant messaging application.

[0089] Accordingly, an electronic device having a display and a touch-sensitive surface has improved methods and interfaces for enabling use of interactive applications in an instant messaging application, thereby enhancing effectiveness, efficiency, and user satisfaction using such a device. Such methods and interfaces may supplement or replace conventional methods for enabling use of interactive applications in an instant messaging application.

[0090] There is a need for an electronic device having improved methods and interfaces for navigation in an instant messaging application. Such methods and interfaces may supplement or replace conventional methods for navigation in an instant messaging application. Such methods and interfaces reduce the amount, degree, and / or nature of input from a user and result in a more efficient human-machine interface.

[0091] According to some embodiments, a method is performed at an electronic device having a display, a touch-sensitive surface, and a digital camera. The method includes: displaying, on the display, an instant messaging user interface that includes a conversation transcript of an instant messaging session between a user of the electronic device and at least one other user, a message input area, a digital image enabling representation, a digital touch enabling representation, and an application enabling representation; while displaying the instant messaging user interface, detecting a first input on the touch-sensitive surface; in response to detecting the first input: displaying, in the instant messaging user interface, a plurality of digital images based on determining that the first input is made when a focus selector is at a position in the instant messaging user interface corresponding to the digital image enabling representation; displaying, in the instant messaging user interface, a digital drawing canvas based on determining that the first input is made when the focus selector is at a position in the instant messaging user interface corresponding to the digital canvas enabling representation; and displaying, in the instant messaging user interface, one or more launch icons of an application based on determining that the first input is made when the focus selector is at a position in the instant messaging user interface corresponding to the application enabling representation.

[0092] According to some embodiments, an electronic device includes a display unit, a touch-sensitive surface unit, a digital camera unit, and a processing unit coupled to the display unit, the touch-sensitive surface unit, and the digital camera unit. The processing unit is configured to: enable display of an instant messaging user interface on the display unit, the instant messaging user interface including a conversation transcript of an instant messaging session between a user of the electronic device and at least one other user, a message input area, a digital image enabling representation, a digital touch enabling representation, and an application enabling representation. The processing unit is further configured to: while displaying the instant messaging user interface, detect a first input on the touch-sensitive surface; in response to detecting the first input: enable display of a plurality of digital images in the instant messaging user interface based on determining that the first input is made when a focus selector is at a position in the instant messaging user interface corresponding to the digital image enabling representation; enable display of a digital drawing canvas in the instant messaging user interface based on determining that the first input is made when the focus selector is at a position in the instant messaging user interface corresponding to the digital canvas enabling representation; and enable display of one or more launch icons of an application in the instant messaging user interface based on determining that the first input is made when the focus selector is at a position in the instant messaging user interface corresponding to the application enabling representation.

[0093] Thus, an electronic device having a display and a touch-sensitive surface has improved methods and interfaces for navigating in an instant messaging application, thereby enhancing effectiveness, efficiency, and user satisfaction with such devices. Such methods and interfaces may supplement or replace conventional methods for navigating in an instant messaging application.

[0094] An electronic device is needed that has improved methods and interfaces for placing electronic stickers in a conversation transcript. Such methods and interfaces can supplement or replace conventional methods for placing electronic stickers in a conversation transcript. Such methods and interfaces reduce the amount, degree, and / or nature of input from the user and result in a more efficient human-machine interface.

[0095] According to some embodiments, a method is performed at an electronic device having one or more processors, a memory, a touch-sensitive surface, and a display. The device displays, on the display, an instant messaging user interface of an instant messaging application, the instant messaging user interface including a conversation transcript of an instant messaging session between a user of the electronic device and at least one other user, a plurality of electronic stickers, and a message input area. While displaying the instant messaging user interface, the device detects a first drag gesture that begins when a focus selector is at a first position corresponding to a first electronic sticker among the plurality of electronic stickers in the instant messaging user interface, the first drag gesture moving the focus selector in a first direction. The device moves the first electronic sticker in the first direction in accordance with the movement of the first drag gesture. When the focus selector is at a second position in the instant messaging user interface, the device detects the termination of the first drag gesture. In response to detecting the termination of the first drag gesture: Based on determining that the second position is within the conversation transcript, the device places the electronic sticker at a position in the conversation transcript based on the second position. Based on determining that the second position is not within the conversation transcript, the device stops displaying the electronic sticker at the second position on the display.

[0096] According to some embodiments, an electronic device includes: a display unit configured to display a user interface; a touch-sensitive surface unit configured to detect contacts; and a processing unit coupled to the display unit and the touch-sensitive surface unit. The processing unit is configured to: Enable, on the display unit, the display of an instant messaging user interface of an instant messaging application, the instant messaging user interface including a conversation transcript of an instant messaging session between a user of the electronic device and at least one other user, a plurality of electronic stickers, and a message input area. While displaying the instant messaging user interface, the processing unit is configured to detect a first drag gesture that begins when a focus selector is at a first position corresponding to a first electronic sticker among the plurality of electronic stickers in the instant messaging user interface, the first drag gesture moving the focus selector in a first direction. The processing unit is configured to: Move the first electronic sticker in the first direction in accordance with the movement of the first drag gesture. The processing unit is configured to: Detect the termination of the first drag gesture when the focus selector is at a second position in the instant messaging user interface. In response to detecting the termination of the first drag gesture: Based on determining that the second position is within the conversation transcript, the processing unit is configured to place the electronic sticker at a position in the conversation transcript based on the second position, and based on determining that the second position is not within the conversation transcript, the processing unit is configured to stop displaying the electronic sticker at the second position on the display unit.

[0097] Accordingly, an electronic device having a display and a touch-sensitive surface has improved methods and interfaces for placing electronic stickers in a conversation transcript, thereby enhancing effectiveness, efficiency, and user satisfaction with such devices. Such methods and interfaces may supplement or replace conventional methods for placing electronic stickers in a conversation transcript.

[0098] There is a need for an electronic device having improved methods and interfaces for changing the characteristics of electronic stickers in a conversation transcript. Such methods and interfaces may supplement or replace conventional methods for changing the characteristics of electronic stickers in a conversation transcript of an instant messaging user interface. Such methods and interfaces reduce the amount, degree, and / or nature of input from a user and result in a more efficient human-machine interface.

[0099] According to some embodiments, a method is performed at an electronic device having one or more processors, a memory, a touch-sensitive surface, and a display. The device displays an instant messaging user interface of an instant messaging application on the display, the instant messaging user interface including a conversation transcript of an instant messaging session between a user of the electronic device and at least one other user, a plurality of electronic stickers, and a message input area. While displaying the instant messaging user interface, the device detects a first user input when a focus selector is at a first position in the instant messaging user interface corresponding to a first electronic sticker of the plurality of electronic stickers. In response to detecting the first user input, the device places and displays the first electronic sticker in the conversation transcript. While the first electronic sticker is displayed in the conversation transcript: the device detects a second user input when the focus selector is at a second position in the instant messaging user interface corresponding to the first electronic sticker in the conversation transcript. In response to detecting the second user input, the device changes a position, size, and / or rotation of the first electronic sticker in the conversation transcript.

[0100] According to some embodiments, an electronic device is provided that has a display unit configured to display a user interface; a touch-sensitive surface unit configured to detect contacts; and a processing unit coupled to the display unit and the touch-sensitive surface unit. The processing unit enables the display of an instant messaging user interface for an instant messaging application on the display unit, the instant messaging user interface including a conversation transcript of an instant messaging session between a user of the electronic device and at least one other user, a plurality of electronic stickers, and a message input area. When displaying the instant messaging user interface, the processing unit detects a first user input when a focus selector is at a first position corresponding to a first electronic sticker among the plurality of electronic stickers in the instant messaging user interface. In response to detecting the first user input, the processing unit places the first electronic sticker in the conversation transcript and enables the display of the first electronic sticker. When the first electronic sticker is displayed in the conversation transcript: the processing unit detects a second user input when the focus selector is at a second position corresponding to the first electronic sticker in the conversation transcript in the instant messaging user interface. In response to detecting the second user input, the device changes the position, size, and / or rotation of the first electronic sticker in the conversation transcript.

[0101] Accordingly, an electronic device having a display and a touch-sensitive surface has improved methods and interfaces for changing the characteristics of an electronic sticker in a conversation transcript of an instant messaging user interface, thereby enhancing effectiveness, efficiency, and user satisfaction with such devices. Such methods and interfaces may supplement or replace conventional methods for changing the characteristics of an electronic sticker in a conversation transcript of an instant messaging user interface.

[0102] There is a need for an electronic device having improved methods and interfaces for initiating payments via an instant messaging application. Such methods and interfaces may supplement or replace conventional methods for initiating payments via an instant messaging application. Such methods and interfaces reduce the amount, degree, and / or nature of input from a user and result in a more efficient human-machine interface.

[0103] According to some embodiments, a method is performed at an electronic device having one or more processors, a memory, a touch-sensitive surface, and a display. The device displays, on the display, an instant messaging user interface of an instant messaging application, the instant messaging user interface including a conversation transcript of an instant messaging session between a user of the electronic device and at least one other user and a message input area, wherein each of the other users included in the instant messaging session has a corresponding avatar. While displaying the instant messaging user interface, the device detects a first user input when a focus selector is at a first position corresponding to an avatar of a first other user included in the instant messaging session in the instant messaging user interface. In response to detecting the first user input, the device displays a menu that includes activatable menu items associated with the first other user overlaid on the instant messaging user interface, and the displayed menu includes an activatable menu item for initiating a payment action with the first other user. While displaying the menu including the activatable menu items associated with the first other user, the device detects a second user input when the focus selector is at a second position corresponding to the activatable menu item for initiating a payment action with the first other user in the instant messaging user interface. In response to detecting the second user input, the device displays a user interface configured to start sending a payment to the first other user and / or request the first other user to make a payment.

[0104] In some embodiments, an electronic device is provided that has a display unit configured to display a user interface; a touch-sensitive surface unit configured to detect contact; and a processing unit coupled to the display unit and the touch-sensitive surface unit. The processing unit enables, on the display unit, the display of an instant messaging user interface of an instant messaging application, the instant messaging user interface including a conversation transcript of an instant messaging session between a user of the electronic device and at least one other user and a message input area, wherein each of the other users included in the instant messaging session has a corresponding avatar. While displaying the instant messaging user interface, the processing unit detects a first user input when a focus selector is at a first position corresponding to an avatar of a first other user included in the instant messaging session in the instant messaging user interface. In response to detecting the first user input, the processing unit enables the display of a menu that includes activatable menu items associated with the first other user overlaid on the instant messaging user interface, and the displayed menu includes an activatable menu item for initiating a payment action with the first other user. While displaying the menu including the activatable menu items associated with the first other user, the processing unit detects a second user input when the focus selector is at a second position corresponding to the activatable menu item for initiating a payment action with the first other user in the instant messaging user interface. In response to detecting the second user input, the processing unit enables the display of a user interface configured to start sending a payment to the first other user and / or request the first other user to make a payment.

[0105] Thus, an electronic device having a display and a touch-sensitive surface has improved methods and interfaces for initiating a payment via an instant messaging application, thereby enhancing the effectiveness, efficiency, and user satisfaction by utilizing such a device. Such methods and interfaces may supplement or replace conventional methods for initiating a payment via an instant messaging application.

[0106] There is a need for an electronic device having improved methods and interfaces for selectively activating a menu in an instant messaging session. Such methods and interfaces may supplement or replace conventional methods for selectively activating a menu in an instant messaging session. Such methods and interfaces reduce the amount, degree, and / or nature of input from a user and result in a more efficient human-machine interface.

[0107] According to some embodiments, a method is performed at an electronic device having one or more processors, a memory, a touch-sensitive surface, one or more sensors for detecting the intensity of contact with the touch-sensitive surface, and a display. The device displays an instant messaging user interface of an instant messaging application on the display, the instant messaging user interface including a conversation transcript of an instant messaging session between a user of the electronic device and a plurality of other users, a message input area, and a plurality of avatars, each respective avatar of the plurality of avatars corresponding to a respective other user of the plurality of other users included in the instant messaging session, wherein the plurality of avatars are displayed as an avatar stack, and a first avatar of the plurality of avatars is displayed at the top of the avatar stack. While displaying the instant messaging user interface, the device detects an input via a first contact on the touch-sensitive surface when a focus selector is at a first position corresponding to the first avatar in the instant messaging user interface. In response to detecting the input via the first contact: Based on determining that the input meets a menu activation criterion, the device displays a menu including activatable menu items associated with the first avatar overlaid on the instant messaging user interface, wherein the menu activation criterion requires a characteristic intensity of the contact on the touch-sensitive surface to meet a corresponding intensity threshold in order to meet the menu activation criterion. Based on determining that the input meets an avatar expansion criterion, the device displays the plurality of avatars in an array, wherein the avatar expansion criterion does not require a characteristic intensity of the contact on the touch-sensitive surface to meet a corresponding intensity threshold in order to meet the selection criterion.

[0108] According to some embodiments, an electronic device is provided that includes a display unit configured to display a user interface; a touch-sensitive surface unit configured to detect contacts; and a processing unit coupled to the display unit and the touch-sensitive surface unit. The processing unit enables the display of an instant messaging user interface for an instant messaging application on the display unit, the instant messaging user interface including a conversation transcript of an instant messaging session between a user of the electronic device and a plurality of other users, a message input area, and a plurality of avatars, each respective avatar of the plurality of avatars corresponding to a respective other user of the plurality of other users included in the instant messaging session, wherein the plurality of avatars are displayed as an avatar stack, and a first avatar of the plurality of avatars is displayed at the top of the avatar stack. When displaying the instant messaging user interface, the processing unit detects an input via a first contact on the touch-sensitive surface unit when a focus selector is at a first position corresponding to the first avatar in the instant messaging user interface. In response to detecting the input via the first contact: Based on determining that the input meets a menu activation criterion, the processing unit enables the display of a menu including activatable menu items associated with the first avatar overlaid on the instant messaging user interface, wherein the menu activation criterion requires a characteristic intensity of the contact on the touch-sensitive surface unit to meet a corresponding intensity threshold in order to meet the menu activation criterion. Based on determining that the input meets an avatar expansion criterion, the processing unit enables the display of the plurality of avatars in an array, wherein the avatar expansion criterion does not require a characteristic intensity of the contact on the touch screen to meet a corresponding intensity threshold in order to meet the selection criterion.

[0109] Thus, an electronic device having a display and a touch-sensitive surface has improved methods and interfaces for selectively activating a menu in an instant messaging session, thereby enhancing effectiveness, efficiency, and user satisfaction with such devices. Such methods and interfaces may supplement or replace conventional methods for selectively activating a menu in an instant messaging session.

[0110] There is a need for an electronic device having improved methods and interfaces for providing optional links for words or phrases in a message to access additional content. Such methods and interfaces may supplement or replace conventional methods for providing optional links for words or phrases in a message to access additional content. Such methods and interfaces reduce the amount, degree, and / or nature of input from the user and result in a more efficient human-machine interface.

[0111] According to some embodiments, a method is performed at an electronic device having one or more processors, a memory, a touch-sensitive surface, and a display. The device displays an instant messaging user interface of an instant messaging application on the display, the instant messaging user interface including a conversation transcript of an instant messaging session between a user of the electronic device and at least one other user, and a message input area. While displaying the instant messaging user interface, the device receives a first message in the instant messaging session from an electronic device corresponding to another user included in the instant messaging session. In response to receiving the first message, the device displays the first message in a first message area of the conversation transcript on the display. The device detects a word or phrase in the first message that is associated with additional content available on the Internet; and in response to detecting the word or phrase associated with the additional content available on the Internet, the device displays an optional indication that the additional content associated with the word or phrase is available adjacent to the first message area.

[0112] In some embodiments, an electronic device is provided that includes a display unit configured to display a user interface; a touch-sensitive surface unit configured to detect contacts; and a processing unit coupled to the display unit and the touch-sensitive surface unit. The processing unit enables the display of an instant messaging user interface of an instant messaging application on the display unit, the instant messaging user interface including a conversation transcript of an instant messaging session between a user of the electronic device and at least one other user, and a message input area. While displaying the instant messaging user interface, the processing unit receives a first message in the instant messaging session from an electronic device corresponding to another user included in the instant messaging session. In response to receiving the first message, the processing unit enables the display of the first message in a first message area of the conversation transcript on the display unit. The processing unit detects a word or phrase in the first message that is associated with additional content available on the Internet. In response to detecting the word or phrase associated with the additional content available on the Internet, the processing unit enables the display of an optional indication that the additional content associated with the word or phrase is available adjacent to the first message area.

[0113] Accordingly, an electronic device having a display and a touch-sensitive surface has improved methods and interfaces for providing optional links to access additional content for words or phrases in a message, thereby enhancing effectiveness, efficiency, and user satisfaction with such devices. Such methods and interfaces may supplement or replace conventional methods for providing optional links to access additional content for words or phrases in a message.

[0114] An electronic device is needed that has improved methods and interfaces for navigating between applications in an instant messaging user interface. Such methods and interfaces can supplement or replace conventional methods for navigating between applications in an instant messaging user interface. Such methods and interfaces reduce the amount, degree, and / or nature of input from the user and result in a more efficient human-machine interface.

[0115] According to some embodiments, a method is performed at an electronic device having a display and a touch-sensitive surface. The method includes: displaying an instant messaging user interface on the display, the instant messaging user interface including: a conversation transcript of an instant messaging session between a user of the electronic device and at least one other user; a message input area; an application area; and application area display affordances; while displaying the instant messaging user interface, detecting a first input that activates an application area display affordance; in response to detecting the first input that activates an application area display affordance, and based on determining that a keyboard is being displayed in the application area at the time the first input is detected, replacing the display of the keyboard in the application area by simultaneously displaying: an application selection area that displays a plurality of scrollable application selection affordances, wherein: the plurality of scrollable application selection affordances includes a first application selection affordance corresponding to a currently selected first application; and the respective application selection affordances have respective first sizes; and an application input area that displays one or more activatable objects of the first application; while simultaneously displaying the application selection area and the application input area, detecting a second input that includes a movement of a contact on the touch-sensitive surface corresponding to a movement of a focus selector along a first direction in the application selection area on the display; in response to detecting the second input: scrolling the plurality of application selection affordances along the first direction and displaying a second application selection affordance; while the second application selection affordance and one or more activatable objects of the first application are being displayed in the instant messaging user interface, detecting a third input that activates the second application selection affordance; and in response to detecting the third input that activates the second application selection affordance: stopping displaying the one or more activatable objects of the first application; and displaying, in the application input area, one or more activatable objects of the second application corresponding to the second application selection affordance.

[0116] Thus, an electronic device having a display and a touch-sensitive surface has improved methods and interfaces for navigating between applications in an instant messaging user interface, thereby enhancing effectiveness, efficiency, and user satisfaction with such devices. Such methods and interfaces can supplement or replace conventional methods for navigating between applications in an instant messaging user interface.

[0117] An electronic device is needed that has improved methods and interfaces for managing applications used in an instant messaging application. Such methods and interfaces can supplement or replace conventional methods for managing applications used in an instant messaging application. Such methods and interfaces reduce the amount, degree, and / or nature of input from the user and result in a more efficient human-machine interface.

[0118] According to some embodiments, the method is performed on a device having a display and a touch-sensitive surface. The method includes: displaying an instant messaging user interface of an instant messaging application on the display, the instant messaging user interface including: a conversation transcript of an instant messaging session between a user of the electronic device and at least one other user; a message input area; and an application area that includes: an application input area that displays one or more activatable objects of a first application; and an application selection area that includes: a plurality of scrollable application selection affordances corresponding to a plurality of applications operating in the instant messaging user interface, and a first application configuration affordance; when the application configuration affordance is displayed in the application selection area, detecting a first input that activates the first application configuration affordance; in response to detecting the first input, displaying a first application management interface of the instant messaging application, the first application management interface including: a plurality of installed application affordances corresponding to a plurality of applications operating in the instant messaging user interface of the instant messaging application, and a second application configuration affordance different from the first application configuration affordance; when the first application management interface is displayed, detecting a second input at a position corresponding to a first installed application affordance among the plurality of installed application affordances, where the first installed application affordance corresponds to a first installed application on the electronic device; and in response to detecting the second input, initiating a process for uninstalling at least one component of the first installed application on the mobile device; when the first application management interface is displayed, detecting a third input at a position corresponding to the second application configuration affordance; and in response to detecting the third input, displaying a second application management interface of the instant messaging application, the second application management interface including: a plurality of toggles corresponding to a plurality of applications operating in the instant messaging user interface of the instant messaging application, where activation of a corresponding toggle causes the corresponding application in the instant messaging user interface of the instant messaging application to toggle between a hidden state and a visible state.

[0119] Accordingly, an electronic device having a display and a touch-sensitive surface has improved methods and interfaces for managing applications used in an instant messaging application, thereby enhancing effectiveness, efficiency, and user satisfaction using such a device. Such methods and interfaces may supplement or replace conventional methods for managing applications used in an instant messaging application.

[0120] There is a need for an electronic device having improved methods and interfaces for translating message content in an instant messaging application. Such methods and interfaces may supplement or replace conventional methods for translating message content in an instant messaging application. Such methods and interfaces reduce the amount, degree, and / or nature of input from a user and result in a more efficient human-machine interface.

[0121] According to some embodiments, a method is performed on a device having a display and one or more input devices. The method includes: displaying, on the display, an instant messaging user interface that includes a conversation transcript of an instant messaging session between a user of the electronic device and at least one other user; receiving, from an electronic device corresponding to another user included in the instant messaging session, a first message in the instant messaging session, where the first message includes foreign language text; in response to receiving the first message, displaying the first message in the conversation transcript; detecting a first input at a first location corresponding to the foreign language text in the first message; in response to detecting the first input at the first location corresponding to the foreign language text: displaying a translation of the foreign language text based on determining that the first input meets a translation criterion; and displaying a plurality of activatable markers based on determining that the first input meets an option display criterion.

[0122] According to some embodiments, a method is performed on a device having a display and one or more input devices. The method includes: displaying, on the display, an instant messaging user interface that includes a conversation transcript of an instant messaging session between a user of the electronic device and at least one other user; receiving, from an electronic device corresponding to another user included in the instant messaging session, a first message in the instant messaging session, where the first message includes foreign language text; in response to receiving the first message, displaying the first message in the conversation transcript; detecting a first input at a location corresponding to the foreign language text in the first message; in response to detecting the first input at the location corresponding to the foreign language text: performing a foreign language text translation action based on determining that the first input meets a translation criterion; and foregoing performing the foreign language text translation action based on determining that the first input does not meet the translation criterion.

[0123] Accordingly, an electronic device having a display and a touch-sensitive surface has improved methods and interfaces for translating message content in an instant messaging application, thereby enhancing effectiveness, efficiency, and user satisfaction using such a device. Such methods and interfaces may supplement or replace conventional methods for translating message content in an instant messaging application.

[0124] According to some embodiments, an electronic device includes a display, a touch-sensitive surface, one or more sensors optionally for detecting contact intensity with the touch-sensitive surface, one or more processors, a memory, and one or more programs; the one or more programs are stored in the memory and configured to be executed by the one or more processors, and the one or more programs include instructions for performing or causing to perform the operations of any of the methods described herein. According to some embodiments, a computer-readable storage medium has instructions stored therein that, when executed by an electronic device having a display, a touch-sensitive surface, and one or more sensors optionally for detecting contact intensity with the touch-sensitive surface, cause the device to perform or cause to perform the operations of any of the methods described herein. According to some embodiments, a graphical user interface at an electronic device having a display, a touch-sensitive surface, one or more sensors optionally for detecting contact intensity with the touch-sensitive surface, a memory, and one or more processors for executing one or more programs stored in the memory includes one or more elements that are updated in response to input among the elements displayed by any of the methods described herein, as described by any of the methods described herein. According to some embodiments, an electronic device includes: a display, a touch-sensitive surface, and one or more sensors optionally for detecting contact intensity with the touch-sensitive surface; and means for performing or causing to perform the operations of any of the methods described herein. According to some embodiments, an information processing apparatus in an electronic device having a display, a touch-sensitive surface, and one or more sensors optionally for detecting contact intensity with the touch-sensitive surface includes means for performing or causing to perform the operations of any of the methods described herein.

[0125] Accordingly, an electronic device having a display, a touch-sensitive surface, and one or more sensors optionally for detecting contact intensity with the touch-sensitive surface has faster and more efficient methods and interfaces for messaging, thereby enhancing effectiveness, efficiency, and user satisfaction using such devices. Such methods and interfaces may supplement or replace conventional methods for messaging. BRIEF DESCRIPTION OF THE DRAWINGS

[0126] To better understand the various described embodiments, reference should be made to the following detailed description taken in conjunction with the accompanying drawings, in which like reference numerals indicate corresponding parts throughout the drawings.

[0127] Figure 1A is a block diagram showing a portable multifunctional device having a touch-sensitive display in accordance with some embodiments.

[0128] Figure 1B is a block diagram showing exemplary components for event handling in accordance with some embodiments.

[0129] Figure 2 Shows a portable multifunctional device with a touch screen according to some embodiments.

[0130] Figure 3 Is a block diagram of an exemplary multifunctional device with a display and a touch-sensitive surface according to some embodiments.

[0131] Figure 4A Shows an exemplary user interface of an application menu on a portable multifunctional device according to some embodiments.

[0132] Figure 4B Shows an exemplary user interface for a multifunctional device having a touch-sensitive surface separate from the display according to some embodiments.

[0133] FIG. 4C to FIG. 4E Shows an example of a dynamic intensity threshold according to some embodiments.

[0134] FIG. 5A to FIG. 5K Shows an exemplary user interface for displaying a message transcript and message confirmation.

[0135] Figure 5L to Figure 5T Shows an exemplary user interface for editing a previously sent message when displaying a message transcript.

[0136] Figures 5U to 5BF Shows an exemplary user interface for applying an impact effect option to a message input or message area.

[0137] Figure 5BG to Figure 5CA Shows an exemplary user interface for interacting with a hidden message.

[0138] Figure 5CB to Figure 5CW Shows an exemplary user interface for triggering enhanced message content and applying an effect to an instant message user interface when a message includes an enhanced message content trigger.

[0139] Figure 5CX to Figure 5DC Shows an exemplary user interface for detecting and responding to composable content in a separate message.

[0140] Figure 5DD to Figure 5DI Shows an exemplary user interface for selecting a message area type or shape.

[0141] Figure 5DI to Figure 5DQ Shows an exemplary user interface for automatically displaying and selecting suggested emojis when composing a message.

[0142] FIG. 6A to FIG. 6E Is a flowchart of a process for applying a confirmation to a message area in a conversation transcript according to some embodiments.

[0143] Figure 7 is a functional block diagram of an electronic device according to some embodiments.

[0144] FIG. 8A to FIG. 8C is a flowchart of a process for editing a previously sent message in an instant messaging session according to some embodiments.

[0145] Fig. 9 is a functional block diagram of an electronic device according to some embodiments.

[0146] FIG. 10A to FIG. 10B is a flowchart of a process for editing a previously sent message in an instant messaging session according to some embodiments.

[0147] Fig.11 is a functional block diagram of an electronic device according to some embodiments.

[0148] FIG. 12A to FIG. 12E is a flowchart of a process for applying an impact effect option to message input according to some embodiments.

[0149] Fig.13 is a functional block diagram of an electronic device according to some embodiments.

[0150] FIG. 14A to FIG. 14B is a flowchart of a process for interacting with a hidden message according to some embodiments.

[0151] Fig.15 is a functional block diagram of an electronic device according to some embodiments.

[0152] FIG. 16A to FIG. 16C is a flowchart of a process for applying an effect to an instant messaging user interface when a message includes an enhanced message content trigger according to some embodiments.

[0153] Fig.17 is a functional block diagram of an electronic device according to some embodiments.

[0154] 18A to 18C is a flowchart of a process for detecting composable content in an instant messaging user interface and displaying content corresponding to a predetermined combination when the composable content is detected according to some embodiments.

[0155] Fig.19 is a functional block diagram of an electronic device according to some embodiments.

[0156] FIG. 20A to FIG. 20P illustrates an exemplary user interface for presenting synchronized media content (e.g., audio content and / or video content) in an instant messaging application according to some embodiments.

[0157] FIG. 21A to FIG. 21C It is a flowchart showing a method for presenting synchronized media content in an instant messaging application according to some embodiments.

[0158] Fig. 22 It is a functional block diagram of an electronic device according to some embodiments.

[0159] FIG. 23A to FIG. 23AE It shows an exemplary user interface for providing and presenting user-specific handwritten input in an instant messaging application according to some embodiments.

[0160] FIG. 24A to FIG. 24C It is a flowchart showing a method for providing and presenting user-specific handwritten input in an instant messaging application according to some embodiments.

[0161] Fig.25 It is a functional block diagram of an electronic device according to some embodiments.

[0162] FIG. 26A to FIG. 26B It is a flowchart showing a method for providing and presenting user-specific handwritten input in an instant messaging application according to some embodiments.

[0163] Fig. 27 It is a functional block diagram of an electronic device according to some embodiments.

[0164] FIG. 28A to FIG. 28B It is a flowchart showing a method for providing and presenting user-specific handwritten input in an instant messaging application according to some embodiments.

[0165] FIG. 28C to FIG. 28H It shows a table including an example of a rendering pipeline according to some embodiments.

[0166] Fig.29 It is a functional block diagram of an electronic device according to some embodiments.

[0167] FIG. 30A to FIG. 30G It shows an exemplary user interface for quickly locating different types of content in an instant messaging application according to some embodiments.

[0168] FIG. 31A to FIG. 31B It is a flowchart showing a method for quickly locating different types of content in an instant messaging application according to some embodiments.

[0169] Fig.32 It is a functional block diagram of an electronic device according to some embodiments.

[0170] FIG. 33A to FIG. 33B It is a flowchart showing a method for quickly locating different types of content in an instant messaging application according to some embodiments.

[0171] Fig.34 is a functional block diagram of an electronic device according to some embodiments.

[0172] Figures 35A to 35AP Shows an exemplary user interface for integrating a digital camera into an instant messaging application according to some embodiments.

[0173] FIG. 36A to FIG. 36AL Shows an exemplary user interface for integrating a search function and publishing rich content in an instant messaging application according to some embodiments.

[0174] Figures 37A to 37DJ Shows an exemplary user interface for integrating an interactive application in an instant messaging application according to some embodiments.

[0175] Figures 38A to 38AZ Shows an exemplary user interface for integrating an application in an instant messaging application according to some embodiments.

[0176] FIG. 39A to FIG. 39AW Shows an exemplary user interface for integrating electronic stickers in an instant messaging application according to some embodiments.

[0177] FIG. 40A to FIG. 40W Shows an exemplary user interface for interacting with other users of an instant messaging transcript via an avatar according to some embodiments.

[0178] FIG. 41A to FIG. 41H Shows an exemplary user interface for integrating a data detector into an instant messaging application according to some embodiments.

[0179] FIG. 42A to FIG. 42D Is a flowchart showing a method for capturing and publishing digital images in an instant messaging application according to some embodiments.

[0180] Fig.43 is a functional block diagram of an electronic device according to some embodiments.

[0181] FIG. 44A to FIG. 44D Is a flowchart showing a method for searching and sharing multimedia content in an instant messaging application according to some embodiments.

[0182] Fig.45 is a functional block diagram of an electronic device according to some embodiments.

[0183] FIG. 46A to FIG. 46C Is a flowchart showing a method 4600 for adding an interactive application to an instant messaging application according to some embodiments.

[0184] Fig.47is a functional block diagram of an electronic device according to some embodiments.

[0185] FIG. 48A to FIG. 48D is a flowchart showing a method of posting a message to an instant messaging session from a user interface outside of the user interface of an instant messaging application according to some embodiments.

[0186] Fig.49 is a functional block diagram of an electronic device according to some embodiments.

[0187] FIG. 50A to FIG. 50C is a flowchart showing a method of using an interactive application in an instant messaging application according to some embodiments.

[0188] Fig.51 is a functional block diagram of an electronic device according to some embodiments.

[0189] FIG. 52A to FIG. 52C is a flowchart showing a method of using an interactive application in an instant messaging application according to some embodiments.

[0190] Fig.53 is a functional block diagram of an electronic device according to some embodiments.

[0191] FIG. 54A to FIG. 54C is a flowchart showing a method of using an interactive application in an instant messaging application according to some embodiments.

[0192] Fig.55 is a functional block diagram of an electronic device according to some embodiments.

[0193] FIG. 56A to FIG. 56B is a flowchart showing a method of using an interactive application in an instant messaging application according to some embodiments.

[0194] Fig.57 is a functional block diagram of an electronic device according to some embodiments.

[0195] Fig.58 is a flowchart showing a method of enabling the use of an interactive application in an instant messaging application according to some embodiments.

[0196] Fig.59 is a functional block diagram of an electronic device according to some embodiments.

[0197] FIG. 60A to FIG. 60D is a flowchart showing a method of navigating in an instant messaging application having a related application according to some embodiments.

[0198] Fig.61 is a functional block diagram of an electronic device according to some embodiments.

[0199] Figures 62A to 62C is a flowchart showing a method of adding stickers to an instant message transcript according to some embodiments.

[0200] Fig.63 is a functional block diagram of an electronic device according to some embodiments.

[0201] Figures 64A to 64C is a flowchart showing method 6400 of modifying the display of an electronic sticker in an instant messaging application according to some embodiments.

[0202] Fig.65 is a functional block diagram of an electronic device according to some embodiments.

[0203] Fig.66 is a flowchart showing a method of making a payment from an instant messaging application according to some embodiments.

[0204] Fig.67 is a functional block diagram of an electronic device according to some embodiments.

[0205] FIG. 68A to FIG. 68B is a flowchart showing method 6800 of interacting with an individual user included in a group instant messaging session according to some embodiments.

[0206] Fig.69 is a functional block diagram of an electronic device according to some embodiments.

[0207] FIG. 70A to FIG. 70B is a flowchart showing method 7000 of displaying additional information in an instant messaging session according to some embodiments.

[0208] Fig.71 is a functional block diagram of an electronic device according to some embodiments.

[0209] FIG. 72A to FIG. 72R shows an exemplary user interface for navigating between applications using an application user interface displayed in an instant messaging user interface according to some embodiments.

[0210] Figure 72S to Figure 72AO shows an exemplary user interface for managing applications used in an instant messaging application according to some embodiments.

[0211] Figure 72AP to Figure 72DI shows an exemplary user interface for translating message content in an instant messaging application according to some embodiments.

[0212] Figure 72DJ to Figure 72EV shows an exemplary user interface for connecting message bubbles in an instant messaging application according to some embodiments.

[0213] Figure 72EW to Figure 72FM Shows an exemplary user interface for marking message bubbles according to some embodiments.

[0214] FIG. 73A to FIG. 73D Is a flowchart showing a method of navigating between applications using an application user interface displayed in an instant messaging user interface according to some embodiments.

[0215] FIG. 74A to FIG. 74D Is a flowchart showing a method of managing applications used in an instant messaging application according to some embodiments.

[0216] FIG. 75A to FIG. 75D Is a flowchart showing a method of translating message content in an instant messaging application according to some embodiments.

[0217] Figures 76A to 76C Is a flowchart showing a method of translating message content in an instant messaging application according to some embodiments. Detailed Description

[0218] The methods, devices, and GUIs described herein improve messaging in a variety of ways. For example, they make it easier to: confirm messages; edit previously sent messages; convey what the user is trying to communicate; display private messages; synchronize content viewing between users; and get to handwriting input; quickly locate content in a message transcript; integrate a camera; integrate search and sharing; integrate interactive applications; integrate stickers; make payments; interact with avatars; provide suggestions; navigate in interactive applications; manage interactive applications; translate foreign language text; group messages together; and mark messages.

[0219] Exemplary Devices

[0220] Reference will now be made in detail to the embodiments, examples of which are illustrated in the accompanying drawings. In the following detailed description, numerous specific details are set forth in order to provide a thorough understanding of the various described embodiments. However, it will be apparent to one of ordinary skill in the art that the various described embodiments may be practiced without these specific details. In other instances, well-known methods, procedures, components, circuits, and networks have not been described in detail so as not to unnecessarily obscure aspects of the embodiments.

[0221] It will also be understood that, although in some instances the terms “first,” “second,” etc. are used herein to describe various elements, these elements should not be limited by these terms. These terms are only used to distinguish one element from another. For example, a first contact could be termed a second contact, and similarly, a second contact could be termed a first contact, without departing from the scope of the various described embodiments. The first contact and the second contact are both contacts, but they are not the same contact unless the context clearly indicates otherwise.

[0222] The terms used in the description of the various described embodiments herein are for the purpose of describing particular embodiments only and are not intended to be limiting. As used in the description of the various described embodiments and the appended claims, the singular forms “a,” “an,” and “the” are intended to include the plural forms as well, unless the context clearly indicates otherwise. It will also be understood that the term “and / or” as used herein refers to and encompasses any and all possible combinations of one or more of the associated listed items. It will also be understood that the terms “includes,” “including,” “comprises,” and / or “comprising,” when used in this specification, specify the presence of the stated feature, integer, step, operation, element, and / or component, but do not preclude the presence or addition of one or more other features, integers, steps, operations, elements, components, and / or groups thereof.

[0223] As used herein, depending on the context, the term “if” is optionally construed to mean “when” or “upon” or “in response to determining” or “in response to detecting.” Similarly, depending on the context, the phrases “if determined” or “if detected [the stated condition or event]” are optionally construed to mean “when determining” or “in response to determining” or “when detecting [the stated condition or event]” or “in response to detecting [the stated condition or event].”

[0224] Embodiments of electronic devices, user interfaces for such devices, and related processes for using such devices are described herein. In some embodiments, the device is a portable communication device, such as a mobile phone, that also includes other functions such as PDA and / or music player functions. Exemplary embodiments of the portable multifunctional device include, but are not limited to, those from Apple Inc. (Cupertino, California) iPod known Device. Optionally, other portable electronic devices are used, such as a laptop or a tablet computer having a touch-sensitive surface (e.g., a touch screen display and / or a touchpad). It should also be understood that in some embodiments, the device is not a portable communication device, but a desktop computer having a touch-sensitive surface (e.g., a touch screen display and / or a touchpad).

[0225] In the following discussion, an electronic device including a display and a touch-sensitive surface is described. However, it should be understood that the electronic device optionally includes one or more other physical user interface devices, such as a physical keyboard, a mouse, and / or a joystick.

[0226] In addition to an instant messaging application, the device generally also supports a variety of other applications, such as one or more of the following applications: a notepad-making application, a drawing application, a presentation application, a word processing application, a website creation application, a disk editing application, a spreadsheet application, a game application, a telephone application, a video conferencing application, an email application, a fitness support application, a photo management application, a digital camera application, a digital video camera application, a web browsing application, a digital music player application, and / or a digital video player application.

[0227] The various applications executed on the device optionally use at least one common physical user interface device, such as a touch-sensitive surface. One or more functions of the touch-sensitive surface and the corresponding information displayed on the device are optionally adjusted and / or varied for different applications, and / or within the respective applications. In this way, the common physical architecture of the device (e.g., the touch-sensitive surface) optionally supports various applications using a user interface that is intuitive and clear to the user.

[0228] Attention is now turned to embodiments of a portable device having a touch-sensitive display. Figure 1Ais a block diagram showing a portable multifunctional device 100 having a touch-sensitive display system 112 according to some embodiments. The touch-sensitive display system 112 is sometimes called a "touch screen" for convenience and is sometimes abbreviated as a touch-sensitive display. The device 100 includes a memory 102 (which optionally includes one or more computer-readable storage media), a memory controller 122, one or more processing units (CPUs) 120, a peripheral device interface 118, an RF circuit 108, an audio circuit 110, a speaker 111, a microphone 113, an input / output (I / O) subsystem 106, other input or control devices 116, and an external port 124. The device 100 optionally includes one or more optical sensors 164. The device 100 optionally includes one or more intensity sensors 165 for detecting the intensity of a contact on the device 100 (e.g., a touch-sensitive surface such as the touch-sensitive display system 112 of the device 100). The device 100 optionally includes one or more tactile output generators 167 for generating a tactile output on the device 100 (e.g., generating a tactile output on a touch-sensitive surface such as the touch-sensitive display system 112 of the device 100 or the touchpad 355 of the device 300). These components optionally communicate via one or more communication buses or signal lines 103.

[0229] As used in this specification and the claims, the term "haptic output" refers to a physical displacement of a device relative to a previous position of the device detected by a user using the user's sense of touch, a physical displacement of a component of the device (e.g., a touch-sensitive surface) relative to another component of the device (e.g., a housing), or a displacement of a component relative to the center of mass of the device. For example, in the case of contact between the device or a component of the device and a touch-sensitive surface of a user (e.g., a finger, palm, or other part of the user's hand), the haptic output generated by the physical displacement will be interpreted by the user as a sense of touch that corresponds to a perceived change in the physical characteristics of the device or the component of the device. For example, movement of a touch-sensitive surface (e.g., a touch-sensitive display or a touchpad) is optionally interpreted by the user as a "press click" or "release click" of a physical actuation button. In some cases, the user will feel a sense of touch, such as a "press click" or "release click," even when the physical actuation button associated with the touch-sensitive surface that is physically pressed (e.g., displaced) by the user's movement does not move. As another example, even when there is no change in the smoothness of the touch-sensitive surface, movement of the touch-sensitive surface is optionally interpreted or sensed by the user as "roughness" of the touch-sensitive surface. Although such interpretations of touch by the user will be limited by the user's individual sensory perceptions, there are many sensory perceptions of touch that are common to most users. Thus, when a haptic output is described as corresponding to a particular sensory perception of the user (e.g., "release click," "press click," "roughness"), unless otherwise stated, the generated haptic output corresponds to a physical displacement of the device or a component thereof that would generate the described sensory perception of a typical (or average) user. Providing haptic feedback to the user using haptic output enhances the operability of the device and makes the user device interface more efficient (e.g., by helping the user provide appropriate input and reducing user errors when operating the device / interacting with the device), thereby further reducing power usage and extending the battery life of the device by enabling the user to use the device more quickly and efficiently.

[0230] It should be understood that device 100 is merely an example of a portable multifunctional device, and device 100 optionally has more or fewer components than shown, optionally combines two or more components, or optionally has different configurations or arrangements of these components. Figure 1A The various components shown are implemented in hardware, software, firmware, or any combination thereof (including one or more signal processing circuits and / or application specific integrated circuits).

[0231] Memory 102 optionally includes high-speed random access memory and also optionally includes non-volatile memory, such as one or more disk storage devices, flash memory devices, or other non-volatile solid state memory devices. Access to memory 102 by other components of device 100 (e.g., one or more CPUs 120 and peripheral device interface 118) is optionally controlled by memory controller 122.

[0232] Peripheral device interface 118 can be used to couple input and output peripheral devices of the device to one or more CPUs 120 and memory 102. The one or more processors 120 run or execute various software programs and / or instruction sets stored in memory 102 to perform various functions of device 100 and process data.

[0233] In some embodiments, peripheral device interface 118, one or more CPUs 120, and memory controller 122 are optionally implemented on a single chip such as chip 104. In some other embodiments, they are optionally implemented on separate chips.

[0234] The RF (Radio Frequency) circuit 108 receives and transmits RF signals, which are also called electromagnetic signals. The RF circuit 108 converts electrical signals into electromagnetic signals / converts electromagnetic signals into electrical signals, and communicates with a communication network and other communication devices via electromagnetic signals. The RF circuit 108 optionally includes well-known circuits for performing these functions, including but not limited to an antenna system, an RF transceiver, one or more amplifiers, a tuner, one or more oscillators, a digital signal processor, a codec chipset, a subscriber identity module (SIM) card, a memory, and so on. The RF circuit 108 optionally communicates with the network and other devices wirelessly, and the network is such as the Internet (also known as the World Wide Web (WWW)), an intranet, and / or a wireless network (e.g., a cellular telephone network, a wireless local area network (LAN), and / or a metropolitan area network (MAN)). The wireless communication optionally uses any one of a variety of communication standards, protocols, and technologies, including but not limited to Global System for Mobile Communications (GSM), Enhanced Data GSM Environment (EDGE), High-Speed Downlink Packet Access (HSDPA), High-Speed Uplink Packet Access (HSUPA), Evolution-Data Only (EV-DO), HSPA, HSPA+, Dual Cell HSPA (DC-HSPDA), Long Term Evolution (LTE), Near Field Communication (NFC), Wideband Code Division Multiple Access (W-CDMA), Code Division Multiple Access (CDMA), Time Division Multiple Access (TDMA), Bluetooth, Wi-Fi (e.g., IEEE802.11a, IEEE 802.11ac, IEEE 802.11ax, IEEE 802.11b, IEEE 802.11g, and / or IEEE802.11n), Voice over Internet Protocol (VoIP), Wi-MAX, email protocols (e.g., Internet Message Access Protocol (IMAP) and / or Post Office Protocol (POP)), instant messaging (e.g., Extensible Messaging and Presence Protocol (XMPP), Session Initiation Protocol for Instant Messaging and Presence Leveraging Extensions (SIMPLE), Instant Messaging and Presence Service (IMPS), and / or Short Message Service (SMS)), or any other suitable communication protocol including those not yet developed as of the date of submission of this document.

[0235] The audio circuitry 110, speaker 111, and microphone 113 provide an audio interface between the user and the device 100. The audio circuitry 110 receives audio data from the peripheral interface 118, converts the audio data into an electrical signal, and transmits the electrical signal to the speaker 111. The speaker 111 converts the electrical signal into sound waves audible to humans. The audio circuitry 110 also receives the electrical signal converted from sound waves by the microphone 113. The audio circuitry 110 converts the electrical signal into audio data and transmits the audio data to the peripheral interface 118 for processing. The audio data is optionally retrieved from and / or transmitted to the memory 102 and / or the RF circuitry 108 by the peripheral interface 118. In some embodiments, the audio circuitry 110 also includes an earphone jack (e.g., Figure 2 212). The earphone jack provides an interface between the audio circuitry 110 and a removable audio input / output peripheral device such as an output-only headset or an earphone having both an output (e.g., a mono or stereo earphone) and an input (e.g., a microphone).

[0236] The I / O subsystem 106 couples input / output peripheral devices on the device 100 (e.g., the touch-sensitive display system 112 and other input or control devices 116) to the peripheral interface 118. The I / O subsystem 106 optionally includes a display controller 156, an optical sensor controller 158, an intensity sensor controller 159, a haptic feedback controller 161, and one or more input controllers 160 for other input or control devices. The one or more input controllers 160 receive electrical signals from / transmit electrical signals to the other input or control devices 116. The other input or control devices 116 optionally include physical buttons (e.g., push buttons, rocker buttons, etc.), dials, slide switches, joysticks, click wheels, and the like. In some alternative embodiments, the one or more input controllers 160 are optionally coupled to (or not coupled to) any of the following: a keyboard, an infrared port, a USB port, a stylus, and / or a pointing device (e.g., a mouse). One or more buttons (e.g., Figure 2 208) optionally include up / down buttons for volume control of the speaker 111 and / or the microphone 113. One or more buttons optionally include push buttons (e.g., Figure 2 206).

[0237] The touch-sensitive display system 112 provides an input interface and an output interface between the device and the user. The display controller 156 receives electrical signals from and / or transmits electrical signals to the touch-sensitive display system 112. The touch-sensitive display system 112 displays visual output to the user. The visual output optionally includes graphics, text, icons, video, and any combination thereof (collectively referred to as "graphics"). In some embodiments, some or all of the visual output corresponds to user interface objects. As used herein, the term "indicative" refers to a user-interactive graphical user interface object (e.g., a graphical user interface object configured to respond to input directed to the graphical user interface object). Examples of user-interactive graphical user interface objects include, but are not limited to, buttons, sliders, icons, selectable menu items, switches, hyperlinks, or other user interface controls.

[0238] The touch-sensitive display system 112 has a touch-sensitive surface, sensor, or group of sensors that accepts input from the user based on haptic and / or tactile contact. The touch-sensitive display system 112 and the display controller 156 (along with any associated modules and / or instruction sets in the memory 102) detect contact (and any movement or interruption of the contact) on the touch-sensitive display system 112 and convert the detected contact into an interaction with a user interface object (e.g., one or more soft keys, icons, web page, or image) displayed on the touch-sensitive display system 112. In one exemplary embodiment, the point of contact between the touch-sensitive display system 112 and the user corresponds to the user's finger or stylus.

[0239] The touch-sensitive display system 112 optionally uses LCD (liquid crystal display) technology, LPD (light emitting polymer display) technology, or LED (light emitting diode) technology, but uses other display technologies in other embodiments. The touch-sensitive display system 112 and the display controller 156 optionally use any of a variety of touch-sensing technologies now known or later developed, as well as other proximity sensor arrays or other elements for determining one or more points of contact with the touch-sensitive display system 112 to detect contact and any movement or interruption thereof, the variety of touch-sensing technologies including, but not limited to, capacitive, resistive, infrared, and surface acoustic wave technologies. In one exemplary embodiment, projected mutual capacitance sensing technology is used, such as the technology found in the iPod and found in.

[0240] The touch-sensitive display system 112 optionally has a video resolution of more than 100 dpi. In some embodiments, the touchscreen video resolution exceeds 400 dpi (e.g., 500 dpi, 800 dpi or greater). The user optionally uses any suitable object or attachment (e.g., a stylus, a finger, etc.) to contact the touch-sensitive display system 112. In some embodiments, the user interface is designed to work with finger-based contacts and gestures, which may not be as precise as stylus-based input due to the larger contact area of the finger on the touchscreen. In some embodiments, the device translates the finger-based rough input into an accurate pointer / cursor position or command for performing the action desired by the user.

[0241] In some embodiments, in addition to the touchscreen, the device 100 optionally includes a touchpad (not shown) for activating or deactivating specific functions. In some embodiments, the touchpad is a touch-sensitive area of the device that is different from the touchscreen and does not display visual output. The touchpad is optionally a touch-sensitive surface separate from the touch-sensitive display system 112 or an extension of the touch-sensitive surface formed by the touchscreen.

[0242] The device 100 also includes a power system 162 for powering various components. The power system 162 optionally includes a power management system, one or more power sources (e.g., a battery, alternating current (AC)), a recharge system, a power failure detection circuit, a power converter or inverter, a power status indicator (e.g., a light-emitting diode (LED)), and any other components associated with the generation, management, and distribution of power in a portable device.

[0243] The device 100 optionally also includes one or more optical sensors 164. Figure 1A An optical sensor coupled to the optical sensor controller 158 in the I / O subsystem 106 is shown. One or more optical sensors 164 optionally include a charge-coupled device (CCD) or a complementary metal-oxide-semiconductor (CMOS) phototransistor. One or more optical sensors 164 receive light projected through one or more lenses from the environment and convert the light into data representing an image. In combination with the imaging module 143 (also referred to as a camera module), one or more optical sensors 164 optionally capture a still image or video. In some embodiments, the optical sensor is located on the rear of the device 100, opposite the touch-sensitive display system 112 on the front of the device, such that the touchscreen can be used as a viewfinder for still image and / or video image capture. In some embodiments, another optical sensor is located on the front of the device to acquire an image of the user (e.g., for a selfie, for a video conference while the user views other video conference participants on the touchscreen, etc.).

[0244] Device 100 optionally further includes one or more contact intensity sensors 165. Figure 1A Shown is a contact intensity sensor coupled to an intensity sensor controller 159 in the I / O subsystem 106. One or more contact intensity sensors 165 optionally include one or more piezoresistive strain gauges, capacitive force sensors, electro-mechanical force sensors, piezoelectric force sensors, optical force sensors, capacitive touch-sensitive surfaces, or other intensity sensors (e.g., sensors for measuring the force (or pressure) of contact on a touch-sensitive surface). One or more contact intensity sensors 165 receive contact intensity information (e.g., pressure information or a surrogate of pressure information) from the environment. In some embodiments, at least one contact intensity sensor is juxtaposed or adjacent to a touch-sensitive surface (e.g., the touch-sensitive display system 112). In some embodiments, at least one contact intensity sensor is located on the rear of device 100, opposite the touch-sensitive display system 112 located on the front of device 100.

[0245] Device 100 optionally further includes one or more proximity sensors 166. Figure 1A Shown is a proximity sensor 166 coupled to the peripheral device interface 118. Alternatively, the proximity sensor 166 is coupled to an input controller 160 in the I / O subsystem 106. In some embodiments, when the multifunctional device is placed near a user's ear (e.g., when the user is making a phone call), the proximity sensor turns off and disables the touch-sensitive display system 112.

[0246] Device 100 optionally further includes one or more tactile output generators 167. Figure 1A Shown is a tactile output generator coupled to a tactile feedback controller 161 in the I / O subsystem 106. One or more tactile output generators 167 optionally include one or more electroacoustic devices such as speakers or other audio components, and / or electromechanical devices for converting energy into linear motion such as motors, solenoids, electroactive polymers, piezoelectric actuators, electrostatic actuators, or other tactile output generating components (e.g., components for converting an electrical signal into a tactile output on the device). One or more tactile output generators 167 receive tactile feedback generation instructions from the tactile feedback module 133 and generate a tactile output on device 100 that can be sensed by a user of device 100. In some embodiments, at least one tactile output generator is juxtaposed or adjacent to a touch-sensitive surface (e.g., the touch-sensitive display system 112), and optionally generates a tactile output by moving the touch-sensitive surface vertically (e.g., into / out of the surface of device 100) or laterally (e.g., backward and forward in the same plane as the surface of device 100). In some embodiments, at least one tactile output generator sensor is located on the rear of device 100, opposite the touch-sensitive display system 112 located on the front of device 100.

[0247] Device 100 optionally further includes one or more accelerometers 168. Figure 1A An accelerometer 168 coupled to the peripheral device interface 118 is shown. Alternatively, the accelerometer 168 is optionally coupled to an input controller 160 in the I / O subsystem 106. In some embodiments, information is displayed in a portrait or landscape view on the touch screen display based on an analysis of data received from one or more accelerometers. In addition to the accelerometer 168, device 100 optionally further includes a magnetometer (not shown) and a GPS (or GLONASS or other global navigation system) receiver (not shown) for obtaining information about the location and orientation (e.g., portrait or landscape) of device 100.

[0248] In some embodiments, the software components stored in the memory 102 include an operating system 126, a communication module (or instruction set) 128, a contact / motion module (or instruction set) 130, a graphics module (or instruction set) 132, a haptic feedback module (or instruction set) 133, a text input module (or instruction set) 134, a global positioning system (GPS) module (or instruction set) 135, and application programs (or instruction sets) 136. Additionally, in some embodiments, the memory 102 stores a device / global internal state 157, as Figure 1A and Figure 3 shown. The device / global internal state 157 includes one or more of the following: an active application state that indicates which applications (if any) are currently active; a display state that indicates what applications, views, or other information occupy the respective regions of the touch-sensitive display system 112; a sensor state that includes information obtained from the various sensors of the device and other input or control devices 116; and location and / or orientation information regarding the location and / or orientation of the device.

[0249] The operating system 126 (e.g., iOS, Darwin, RTXC, LINUX, UNIX, OSX, WINDOWS, or an embedded operating system such as VxWorks) includes various software components and / or drivers for controlling and managing general system tasks (e.g., memory management, storage device control, power management, etc.) and facilitates communication between various hardware and software components.

[0250] The communication module 128 facilitates communication with other devices via one or more external ports 124 and also includes various software components for processing data received by the RF circuit 108 and / or the external ports 124. The external ports 124 (e.g., Universal Serial Bus (USB), FireWire, etc.) are adapted to be directly coupled to other devices or indirectly coupled via a network (e.g., the Internet, a wireless LAN, etc.). In some embodiments, the external port is a multi-pin (e.g., 30-pin) connector that is the same as, similar to, and / or compatible with the 30-pin connector used in some iPod and iPod devices of Apple Inc. (Cupertino, California). In some embodiments, the external port is a Lightning connector that is the same as, similar to, and / or compatible with the Lightning connector used in some iPod and iPod devices of Apple Inc. (Cupertino, California).

[0251] The contact / motion module 130 optionally detects contact with the touch-sensitive display system 112 (in conjunction with the display controller 156) and other touch-sensitive devices (e.g., a touchpad or a physical click wheel). The contact / motion module 130 includes various software components for performing various operations related to contact detection (e.g., by a finger or a stylus), such as determining whether contact has occurred (e.g., detecting a finger press event), determining the intensity of the contact (e.g., the force or pressure of the contact, or a surrogate for the force or pressure of the contact), determining whether there is movement of the contact and tracking the movement across the touch-sensitive surface (e.g., detecting one or more finger drag events), and determining whether the contact has stopped (e.g., detecting a finger lift-off event or contact break). The contact / motion module 130 receives contact data from the touch-sensitive surface. Determining the movement of the contact point optionally includes determining the rate (magnitude), velocity (magnitude and direction), and / or acceleration (change in magnitude and / or direction) of the contact point, the movement of the contact point being represented by a series of contact data. These operations are optionally applied to single-point contact (e.g., single-finger contact or stylus contact) or multi-point simultaneous contact (e.g., "multi-touch" / multi-finger contact). In some embodiments, the contact / motion module 130 and the display controller 156 detect contact on the touchpad.

[0252] The contact / motion module 130 optionally detects a user's gesture input. Different gestures on the touch-sensitive surface have different contact patterns (e.g., different motions, timings, and / or intensities of the detected contact). Thus, gestures are optionally detected by detecting a specific contact pattern. For example, detecting a single-finger tap gesture includes detecting a finger-down event and then detecting a finger-lift (lift-off) event at the same location (or substantially the same location) as the finger-down event (e.g., at the icon location). As another example, detecting a finger-swipe gesture on the touch-sensitive surface includes detecting a finger-down event, then detecting one or more finger-drag events, and subsequently detecting a finger-lift (lift-off) event. Similarly, by detecting a specific contact pattern of a stylus, tap, swipe, drag, and other gestures of the stylus are optionally detected.

[0253] In some embodiments, detecting a finger tap gesture depends on the length of time between the detected finger-down event and the finger-lift event, but is independent of the finger contact intensity between the finger-down event and the finger-lift event. In some embodiments, a tap gesture is detected based on determining that the length of time between the finger-down event and the finger-lift event is less than a pre-determined value (e.g., less than 0.1, 0.2, 0.3, 0.4, or 0.5 seconds), regardless of whether the finger contact intensity during the tap reaches a given intensity threshold (greater than the nominal contact detection intensity threshold), such as a light press or deep press intensity threshold. Thus, a finger tap gesture can meet a specific input criterion that does not require the characteristic intensity of the contact to meet a given intensity threshold to meet the specific input criterion. For clarity, finger contact in a tap gesture typically needs to meet the nominal contact detection intensity threshold to detect the finger-down event, below which no contact is detected. A similar analysis applies to detecting tap gestures with a stylus or other contact. In cases where the device can detect finger or stylus contact hovering above the touch-sensitive surface, the nominal contact detection intensity threshold optionally does not correspond to physical contact between the finger or stylus and the touch-sensitive surface.

[0254] The same concepts apply in a similar manner to other types of gestures. For example, a swipe gesture, a pinch gesture, a spread gesture, and / or a long press gesture may optionally be detected based on satisfaction of criteria that are independent of the intensity of contacts included in the gesture or that do not require contacts performing the gesture to reach an intensity threshold in order to be recognized. For example, a swipe gesture is detected based on the amount of movement of one or more contacts; a pinch gesture is detected based on the movement of two or more contacts toward each other; a spread gesture is detected based on the movement of two or more contacts away from each other; and a long press gesture is detected based on the duration of a contact having a movement amount less than a threshold on a touch-sensitive surface. Thus, the statement that a particular gesture recognition criterion does not require contact intensity to meet a corresponding intensity threshold to satisfy the particular gesture recognition criterion means that the particular gesture recognition criterion can be satisfied when the contacts in the gesture do not reach the corresponding intensity threshold and can also be satisfied when one or more of the contacts in the gesture reach or exceed the corresponding intensity threshold. In some embodiments, a tap gesture is detected based on determining that a finger down event and a finger up event are detected within a predefined time period, regardless of whether the contact is above or below the corresponding intensity threshold during the predefined time period, and a swipe gesture is detected based on determining that the contact movement is greater than a predefined amount, even if the contact is above the corresponding intensity threshold at the end of the contact movement. Even in embodiments where the detection of a gesture is affected by the intensity of the contact performing the gesture (e.g., when the intensity of the contact is above the intensity threshold, the device detects a long press more quickly, or when the intensity of the contact is higher, the device delays the detection of a tap input), as long as the criteria for recognizing the gesture can be satisfied when the contact does not reach a particular intensity threshold, the detection of these gestures does not require the contact to reach a particular intensity threshold (e.g., even if the amount of time required to recognize the gesture changes).

[0255] In some cases, the contact strength threshold, duration threshold, and movement threshold are combined in various different combinations in order to create heuristics to distinguish two or more different gestures directed at the same input element or region, such that multiple different interactions with the same input element can provide a richer set of user interactions and responses. A statement that a particular gesture recognition criterion for a set of gestures does not require the strength of the contact to meet the corresponding strength threshold to meet the particular gesture recognition criterion does not preclude simultaneous evaluation of other strength-related gesture recognition criteria to identify other gestures having criteria that are met when the gesture includes a contact having a strength above the corresponding strength threshold. For example, in some cases, a first gesture recognition criterion for a first gesture (which does not require the strength of the contact to meet the corresponding strength threshold to meet the first gesture recognition criterion) competes with a second gesture recognition criterion for a second gesture (which depends on a contact reaching the corresponding strength threshold). In such a competition, if the second gesture recognition criterion for the second gesture is met first, the gesture is optionally not recognized as meeting the first gesture recognition criterion for the first gesture. For example, if the contact reaches the corresponding strength threshold before moving a predefined amount of movement, a deep press gesture is detected instead of a swipe gesture. Conversely, if the contact moves a predefined amount of movement before reaching the corresponding strength threshold, a swipe gesture is detected instead of a deep press gesture. Even in such cases, the first gesture recognition criterion for the first gesture still does not require the strength of the contact to meet the corresponding strength threshold to meet the first gesture recognition criterion, because if the contact remains below the corresponding strength threshold until the end of the gesture (e.g., a swipe gesture with a contact having a strength that does not increase above the corresponding strength threshold), the gesture will be recognized as a swipe gesture by the first gesture recognition criterion. Thus, a particular gesture recognition criterion that does not require the strength of the contact to meet the corresponding strength threshold to meet the particular gesture recognition criterion will (A) in some cases, ignore the contact strength relative to the strength threshold (e.g., for a tap gesture) and / or (B) in some cases, not be met (e.g., for a long press gesture) if a competing set of strength-related gesture recognition criteria (e.g., for a deep press gesture) recognizes the input as corresponding to a strength-related gesture before the particular gesture recognition criterion recognizes the gesture corresponding to the input, and in this sense, still depends on the contact strength relative to the strength threshold (e.g., for a long press gesture competing for recognition with a deep press gesture).

[0256] The graphics module 132 includes various known software components for rendering and displaying graphics on the touch-sensitive display system 112 or other displays, including components for altering the visual impact of the displayed graphics (e.g., brightness, transparency, saturation, contrast, or other visual attributes). As used herein, the term "graphics" includes any object that can be displayed to a user, including but not limited to text, web pages, icons (such as user interface objects including soft keys), digital images, videos, animations, etc.

[0257] In some embodiments, the graphics module 132 stores data for representing graphics to be used. Each graphic is optionally assigned a corresponding code. The graphics module 132 receives from an application program, etc., one or more codes for specifying the graphic to be displayed, and also receives coordinate data and other graphic attribute data as necessary, and then generates screen image data for output to the display controller 156.

[0258] The haptic feedback module 133 includes various software components for generating instructions that are used by the haptic output generator 167 to generate haptic output at one or more locations on the device 100 in response to user interaction with the device 100.

[0259] The text input module 134, which is optionally a component of the graphics module 132, provides a soft keyboard for entering text in various application programs (e.g., contacts 137, email 140, IM 141, browser 147, and any other application that requires text input).

[0260] The GPS module 135 determines the location of the device and provides such information for use in various application programs (e.g., providing to the phone 138 for location-based dialing; providing to the camera 143 as picture / video metadata; and providing to application programs that provide location-based services such as weather widgets, local yellow pages widgets, and map / navigation widgets).

[0261] The application 136 optionally includes the following modules (or instruction sets) or subsets or supersets thereof:

[0262] · The contacts module 137 (sometimes referred to as an address book or contact list);

[0263] · The phone module 138;

[0264] · The video conferencing module 139;

[0265] · The email client module 140;

[0266] · The instant messaging (IM) module 141;

[0267] · The fitness support module 142;

[0268] · A camera module 143 for static images and / or video images;

[0269] · An image management module 144;

[0270] · A browser module 147;

[0271] · A calendar module 148;

[0272] · A desktop widget module 149, optionally including one or more of the following: a weather desktop widget 149-1, a stock desktop widget 149-2, a calculator desktop widget 149-3, an alarm desktop widget 149-4, a dictionary desktop widget 149-5, and other desktop widgets obtained by the user, as well as a user-created desktop widget 149-6;

[0273] · A desktop widget creator module 150 for forming the user-created desktop widget 149-6;

[0274] · A search module 151;

[0275] · A video and music player module 152, optionally composed of a video player module and a music player module;

[0276] · A notepad module 153;

[0277] · A map module 154; and / or

[0278] · An online video module 155.

[0279] Examples of other application programs 136 optionally stored in the memory 102 include other word processing applications, other image editing applications, drawing applications, presentation applications, JAVA-supported applications, encryption, digital rights management, speech recognition, and speech reproduction.

[0280] In combination with the touch-sensitive display system 112, the display controller 156, the contact module 130, the graphics module 132, and the text input module 134, the contact module 137 includes executable instructions for managing an address book or contact list (e.g., the internal state 192 of the application of the contact module 137 stored in the memory 102 or the memory 370), including: adding a name to the address book; deleting a name from the address book; associating a phone number, an email address, a physical address, or other information with a name; associating an image with a name; classifying and sorting names; providing a phone number and / or an email address to initiate and / or facilitate communication via the phone 138, video conferencing 139, email 140, or IM 141, etc.

[0281] In combination with the RF circuit 108, audio circuit 110, speaker 111, microphone 113, touch-sensitive display system 112, display controller 156, contact module 130, graphics module 132, and text input module 134, the telephone module 138 includes executable instructions for performing the following operations: inputting a character sequence corresponding to a telephone number, accessing one or more telephone numbers in the address book 137, modifying the input telephone number, dialing the corresponding telephone number, conducting a conversation, and disconnecting or hanging up when the conversation is completed. As described above, wireless communication optionally uses any one of a variety of communication standards, protocols, and technologies.

[0282] In combination with the RF circuit 108, audio circuit 110, speaker 111, microphone 113, touch-sensitive display system 112, display controller 156, one or more optical sensors 164, optical sensor controller 158, contact module 130, graphics module 132, text input module 134, contact list 137, and telephone module 138, the video conferencing module 139 includes executable instructions for initiating, conducting, and terminating a video conference between the user and one or more other participants according to user instructions.

[0283] In combination with the RF circuit 108, touch-sensitive display system 112, display controller 156, contact module 130, graphics module 132, and text input module 134, the email client module 140 includes executable instructions for creating, sending, receiving, and managing emails in response to user instructions. In combination with the image management module 144, the email client module 140 makes it very easy to create and send emails with static images or video images captured by the camera module 143.

[0284] In combination with the RF circuitry 108, the touch-sensitive display system 112, the display controller 156, the contact module 130, the graphics module 132, and the text input module 134, the instant messaging module 141 includes executable instructions for performing the following operations: inputting a character sequence corresponding to an instant message, modifying a previously input character, transmitting the corresponding instant message (e.g., using the Short Message Service (SMS) or Multimedia Message Service (MMS) protocol for phone-based instant messaging or using XMPP, SIMPLE, Apple Push Notification Service (APN), or IMPS for Internet-based instant messaging), receiving an instant message, viewing the received instant message, and performing the functions of the instant messaging application described in more detail below. In some embodiments, the transmitted and / or received instant messages optionally include graphics, photos, audio files, video files, and / or other attachments supported in MMS and / or Enhanced Messaging Service (EMS). As used herein, "instant message" refers to both phone-based messages (e.g., messages sent using SMS or MMS) and Internet-based messages (e.g., messages sent using XMPP, SIMPLE, APNs, or IMPS).

[0285] In combination with the RF circuitry 108, the touch-sensitive display system 112, the display controller 156, the contact module 130, the graphics module 132, the text input module 134, the GPS module 135, the map module 154, and the music player module 146, the fitness support module 142 includes executable instructions for performing the following operations: creating a fitness (e.g., having time, distance, and / or calorie burn goals); communicating with fitness sensors (in exercise equipment and smartwatches); receiving fitness sensor data; calibrating sensors for monitoring fitness; selecting and playing fitness music; and displaying, storing, and transmitting fitness data.

[0286] In combination with the touch-sensitive display system 112, the display controller 156, one or more optical sensors 164, the optical sensor controller 158, the contact module 130, the graphics module 132, and the image management module 144, the camera module 143 includes executable instructions for performing the following operations: capturing static images or videos (including video streams) and storing them in the memory 102, modifying the characteristics of static images or videos, and / or deleting static images or videos from the memory 102.

[0287] In combination with the touch-sensitive display system 112, the display controller 156, the contact module 130, the graphics module 132, the text input module 134, and the camera module 143, the image management module 144 includes executable instructions for arranging, modifying (e.g., editing), or otherwise manipulating, tagging, deleting, presenting (e.g., in a digital slide show or album), and storing static images and / or video images.

[0288] In combination with the RF circuit 108, the touch-sensitive display system 112, the display system controller 156, the contact module 130, the graphics module 132, and the text input module 134, the browser module 147 includes executable instructions for browsing the Internet according to user instructions (including searching, linking to, receiving, and displaying web pages or portions thereof, and linking to attachments and other files of web pages).

[0289] In combination with the RF circuit 108, the touch-sensitive display system 112, the display system controller 156, the contact module 130, the graphics module 132, the text input module 134, the email client module 140, and the browser module 147, the calendar module 148 includes executable instructions for creating, displaying, modifying, and storing calendars and data associated with the calendars (e.g., calendar entries, to-do items, etc.) according to user instructions.

[0290] In combination with the RF circuit 108, the touch-sensitive display system 112, the display system controller 156, the contact module 130, the graphics module 132, the text input module 134, and the browser module 147, the desktop widget module 149 is a mini-application optionally downloaded and used by the user (e.g., weather desktop widget 149-1, stock market desktop widget 149-2, calculator desktop widget 149-3, alarm clock desktop widget 149-4, and dictionary desktop widget 149-5) or a mini-application created by the user (e.g., user-created desktop widget 149-6). In some embodiments, the desktop widget includes HTML (HyperText Markup Language) files, CSS (Cascading Style Sheets) files, and JavaScript files. In some embodiments, the desktop widget includes XML (Extensible Markup Language) files and JavaScript files (e.g., Yahoo! desktop widget).

[0291] In combination with the RF circuit 108, the touch-sensitive display system 112, the display system controller 156, the contact module 130, the graphics module 132, the text input module 134, and the browser module 147, the desktop widget creator module 150 includes executable instructions for creating desktop widgets (e.g., converting a user-specified portion of a web page into a desktop widget).

[0292] In combination with the touch-sensitive display system 112, the display system controller 156, the contact module 130, the graphics module 132, and the text input module 134, the search module 151 includes executable instructions for searching the memory 102 for text, music, sound, images, videos, and / or other files that match one or more search criteria (e.g., one or more user-specified search terms) according to user instructions.

[0293] In combination with the touch-sensitive display system 112, the display system controller 156, the contact module 130, the graphics module 132, the audio circuit 110, the speaker 111, the RF circuit 108, and the browser module 147, the video and music player module 152 includes executable instructions that allow a user to download and play back recorded music and other sound files stored in one or more file formats (e.g., MP3 or AAC files), and executable instructions for displaying, presenting, or otherwise playing back video (e.g., on the touch-sensitive display system 112 or on an external display connected via a wireless connection or via the external port 124). In some embodiments, the device 100 optionally includes the functionality of an MP3 player, such as an iPod (a trademark of Apple Inc.).

[0294] In combination with the touch-sensitive display system 112, the display controller 156, the contact module 130, the graphics module 132, and the text input module 134, the notepad module 153 includes executable instructions for creating and managing notepads, to-do lists, etc. according to user instructions.

[0295] In combination with the RF circuit 108, the touch-sensitive display system 112, the display system controller 156, the contact module 130, the graphics module 132, the text input module 134, the GPS module 135, and the browser module 147, the map module 154 includes executable instructions for receiving, displaying, modifying, and storing maps and data associated with the maps (e.g., driving routes; data related to stores and other points of interest at or near a particular location; and other location-based data) according to user instructions.

[0296] In combination with the touch-sensitive display system 112, the display system controller 156, the contact module 130, the graphics module 132, the audio circuit 110, the speaker 111, the RF circuit 108, the text input module 134, the email client module 140, and the browser module 147, the online video module 155 includes executable instructions that allow a user to access, browse, receive (e.g., by streaming and / or downloading), play back (e.g., on the touch screen 112 or on an external display connected via a wireless connection or via the external port 124), send an email with a link to a particular online video, and otherwise manage online videos in one or more file formats such as H.264. In some embodiments, the instant message module 141 is used instead of the email client module 140 to send a link to a particular online video.

[0297] Each of the above-mentioned modules and applications corresponds to an executable instruction set for performing one or more of the above functions and the methods described in this patent application (e.g., the computer-implemented methods and other information processing methods described herein). These modules (i.e., instruction sets) do not have to be implemented as separate software programs, processes, or modules, so various subsets of these modules are optionally combined or otherwise rearranged in various embodiments. In some embodiments, the memory 102 optionally stores a subset of the above-mentioned modules and data structures. In addition, the memory 102 optionally stores additional modules and data structures not described above.

[0298] In some embodiments, the device 100 is a device in which the operation of a set of predefined functions on the device is performed uniquely through a touch screen and / or a touchpad. By using the touch screen and / or the touchpad as the main input control device for operating the device 100, the number of physical input control devices (e.g., push buttons, dials, etc.) on the device 100 is optionally reduced.

[0299] The set of predefined functions performed uniquely through the touch screen and / or the touchpad optionally includes navigating between user interfaces. In some embodiments, the touchpad, when touched by the user, navigates the device 100 from any user interface displayed on the device 100 to the main menu, home menu, or root menu. In such embodiments, the touchpad is used to implement the "menu button". In some other embodiments, the menu button is a physical push button or other physical input control device rather than a touchpad.

[0300] Figure 1B is a block diagram showing exemplary components for event processing according to some embodiments. In some embodiments, the memory 102 ( Figure 1A in) or the memory 370 ( Figure 3 ) includes an event classifier 170 (e.g., in the operating system 126) and a corresponding application 136-1 (e.g., any one of the aforementioned applications 136, 137 to 155, 380 to 390).

[0301] The event classifier 170 receives event information and determines the application 136-1 to which the event information is to be delivered and the application view 191 of the application 136-1. The event classifier 170 includes an event monitor 171 and an event dispatcher module 174. In some embodiments, the application 136-1 includes an application internal state 192 that indicates one or more current application views displayed on the touch-sensitive display system 112 when the application is active or executing. In some embodiments, the device / global internal state 157 is used by the event classifier 170 to determine which application(s) is / are currently active, and the application internal state 192 is used by the event classifier 170 to determine the application view 191 to which the event information is to be delivered.

[0302] In some embodiments, the application internal state 192 includes additional information such as one or more of the following: recovery information to be used when the application 136-1 resumes execution, user interface state information indicating information being displayed by the application 136-1 or information ready to be displayed by the application, a state queue for enabling the user to return to a previous state or view of the application 136-1, and a repeat / undo queue of previous actions taken by the user.

[0303] The event monitor 171 receives event information from the peripheral device interface 118. The event information includes information about sub-events (e.g., a user touch on the touch-sensitive display system 112 as part of a multi-touch gesture). The peripheral device interface 118 transmits information that it receives from the I / O subsystem 106 or sensors (e.g., proximity sensor 166, one or more accelerometers 168, and / or microphone 113 (via the audio circuit 110)). The information that the peripheral device interface 118 receives from the I / O subsystem 106 includes information from the touch-sensitive display system 112 or a touch-sensitive surface.

[0304] In some embodiments, the event monitor 171 sends requests to the peripheral device interface 118 at predetermined intervals. In response, the peripheral device interface 118 transmits event information. In other embodiments, the peripheral device interface 118 transmits event information only when there is a significant event (e.g., an input received above a predetermined noise threshold and / or an input received for longer than a predetermined duration).

[0305] In some embodiments, the event classifier 170 further includes a hit view determination module 172 and / or an active event recognizer determination module 173.

[0306] When the touch-sensitive display system 112 displays more than one view, the hit view determination module 172 provides a software process for determining where within one or more views a sub-event has occurred. Views consist of controls and other elements that a user can see on the display.

[0307] Another aspect of the user interface associated with an application is a set of views, sometimes also referred to herein as application views or user interface windows, in which information is displayed and touch-based gestures occur. The application view (of the corresponding application) in which a touch is detected optionally corresponds to a programmatic level within the programmatic or view hierarchy of the application. For example, the lowest-level view in which a touch is detected is optionally referred to as the hit view, and the set of events recognized as correct inputs is optionally determined at least in part based on the hit view of the initial touch that begins a touch-based gesture.

[0308] The hit view determination module 172 receives information related to sub-events of a touch-based gesture. When an application has multiple views organized in a hierarchy, the hit view determination module 172 identifies the hit view as the lowest view in the hierarchy that should process the sub-event. In most cases, the hit view is the lowest-level view in which the initiating sub-event (i.e., the first sub-event in a sequence of sub-events that form an event or potential event) occurs. Once the hit view is identified by the hit view determination module, the hit view generally receives all sub-events related to the same touch or input source for which it was identified as the hit view.

[0309] The active event recognizer determination module 173 determines which view or views within the view hierarchy should receive a particular sequence of sub-events. In some embodiments, the active event recognizer determination module 173 determines that only the hit view should receive a particular sequence of sub-events. In other embodiments, the active event recognizer determination module 173 determines that all views that include the physical location of the sub-event are actively participating views, and thus determines that all actively participating views should receive a particular sequence of sub-events. In other embodiments, even if a touch sub-event is completely confined to an area associated with a particular view, higher views in the hierarchy will still remain as actively participating views.

[0310] The event dispatcher module 174 distributes event information to event recognizers (e.g., event recognizer 180). In embodiments that include the active event recognizer determination module 173, the event dispatcher module 174 delivers the event information to the event recognizer determined by the active event recognizer determination module 173. In some embodiments, the event dispatcher module 174 stores the event information in an event queue, which is retrieved by the corresponding event receiver module 182.

[0311] In some embodiments, the operating system 126 includes an event classifier 170. Alternatively, the application 136-1 includes the event classifier 170. In other embodiments, the event classifier 170 is a separate module or is part of another module (e.g., the contact / motion module 130) stored in the memory 102.

[0312] In some embodiments, the application 136-1 includes a plurality of event handlers 190 and one or more application views 191, where each application view includes instructions for handling touch events occurring within a corresponding view of the application's user interface. Each application view 191 of the application 136-1 includes one or more event recognizers 180. Typically, a corresponding application view 191 includes a plurality of event recognizers 180. In other embodiments, one or more of the event recognizers 180 are part of a separate module, such as a user interface toolkit (not shown) or a higher-level object from which the application 136-1 inherits methods and other properties. In some embodiments, the corresponding event handlers 190 include one or more of the following: a data updater 176, an object updater 177, a GUI updater 178, and / or event data 179 received from the event classifier 170. The event handlers 190 optionally utilize or call the data updater 176, the object updater 177, or the GUI updater 178 to update the application internal state 192. Alternatively, one or more of the application views 191 include one or more corresponding event handlers 190. Additionally, in some embodiments, one or more of the data updater 176, the object updater 177, and the GUI updater 178 are included in the corresponding application view 191.

[0313] The corresponding event recognizer 180 receives event information (e.g., event data 179) from the event classifier 170 and identifies an event from the event information. The event recognizer 180 includes an event receiver 182 and an event comparator 184. In some embodiments, the event recognizer 180 also includes at least a subset of metadata 183 and event delivery instructions 188 (which optionally include sub-event delivery instructions).

[0314] The event receiver 182 receives event information from the event classifier 170. The event information includes information about a sub-event (e.g., a touch or a touch movement). Depending on the sub-event, the event information also includes additional information such as the location of the sub-event. When the sub-event involves the movement of a touch, the event information optionally also includes the rate and direction of the sub-event. In some embodiments, the event includes a rotation of the device from one orientation to another (e.g., from a portrait orientation to a landscape orientation, or vice versa), and the event information includes corresponding information about the current orientation of the device (also referred to as the device pose).

[0315] The event comparator 184 compares the event information with a predefined event or sub-event definition and determines an event or sub-event based on the comparison, or determines or updates the state of an event or sub-event. In some embodiments, the event comparator 184 includes an event definition 186. The event definition 186 contains definitions of events (e.g., predefined sequences of sub-events), such as event 1 (187-1), event 2 (187-2), and others. In some embodiments, the sub-events in event 187 include, for example, touch start, touch end, touch movement, touch cancellation, and multi-touch. In one embodiment, the definition of event 1 (187-1) is a double-tap on a displayed object. For example, a double-tap includes a first touch (touch start) of a predetermined duration on the displayed object, a first lift-off (touch end) of a predetermined duration, a second touch (touch start) of a predetermined duration on the displayed object, and a second lift-off (touch end) of a predetermined duration. As another example, the definition of event 2 (187-2) is a drag on a displayed object. For example, a drag includes a touch (or contact) of a predetermined duration on the displayed object, a movement of the touch on the touch-sensitive display system 112, and a lift-off of the touch (touch end). In some embodiments, the event also includes information for one or more associated event handlers 190.

[0316] In some embodiments, the event definition 187 includes definitions of events for corresponding user interface objects. In some embodiments, the event comparator 184 performs a hit test to determine which user interface object is associated with a sub-event. For example, in an application view that displays three user interface objects on the touch-sensitive display system 112, when a touch is detected on the touch-sensitive display system 112, the event comparator 184 performs a hit test to determine which of the three user interface objects is associated with the touch (sub-event). If each of the displayed objects is associated with a corresponding event handler 190, the event comparator uses the result of the hit test to determine which event handler 190 should be activated. For example, the event comparator 184 selects the event handler associated with the sub-event and the object that triggered the hit test.

[0317] In some embodiments, the definition of the corresponding event 187 also includes a delay action that delays the delivery of event information until it has been determined whether the sub - event sequence does in fact correspond to, or does not correspond to, the event type of the event recognizer.

[0318] When the corresponding event recognizer 180 determines that the sub - event sequence does not match any of the events in the event definition 186, the corresponding event recognizer 180 enters an event - impossible, event - failed, or event - ended state, after which subsequent sub - events of the touch - based gesture are ignored. In such a case, any other event recognizers (if any) for which the hit view remains active continue to track and process the sub - events of the ongoing touch - based gesture.

[0319] In some embodiments, the corresponding event recognizer 180 includes metadata 183 having configurable attributes, tags, and / or lists that indicate how the event delivery system should perform sub - event delivery to the active participating event recognizers. In some embodiments, the metadata 183 includes configurable attributes, tags, and / or lists that indicate how event recognizers interact with each other or can interact with each other. In some embodiments, the metadata 183 includes configurable attributes, flags, and / or lists that indicate whether sub - events are delivered to different levels in the view or the programmatic hierarchy.

[0320] In some embodiments, when one or more specific sub - events of an event are recognized, the corresponding event recognizer 180 activates the event handler 190 associated with the event. In some embodiments, the corresponding event recognizer 180 delivers the event information associated with the event to the event handler 190. Activating the event handler 190 is different from sending (and deferring the sending of) sub - events to the corresponding hit view. In some embodiments, the event recognizer 180 throws a flag associated with the recognized event, and the event handler 190 associated with that flag retrieves the flag and executes a predefined process.

[0321] In some embodiments, the event delivery instruction 188 includes a sub - event delivery instruction that delivers event information about the sub - event without activating the event handler. Instead, the sub - event delivery instruction delivers the event information to the event handler associated with the sub - event series or to the active participating view. The event handler associated with the sub - event series or with the active participating view receives the event information and executes a predetermined process.

[0322] In some embodiments, data updater 176 creates and updates data used in application 136-1. For example, data updater 176 updates phone numbers used in contact module 137 or stores video files used in video player module 145. In some embodiments, object updater 177 creates and updates objects used in application 136-1. For example, object updater 177 creates new user interface objects or updates the position of user interface objects. GUI updater 178 updates the GUI. For example, GUI updater 178 prepares display information and sends it to graphics module 132 for display on a touch-sensitive display.

[0323] In some embodiments, one or more event handlers 190 include data updater 176, object updater 177, and GUI updater 178, or have access to the data updater, the object updater, and the GUI updater. In some embodiments, data updater 176, object updater 177, and GUI updater 178 are included in a single module of corresponding application 136-1 or application view 191. In other embodiments, they are included in two or more software modules.

[0324] It should be understood that the above discussion of event handling for user touches on a touch-sensitive display also applies to other forms of user input for operating multifunctional device 100 using an input device, and not all user input is initiated on a touchscreen. For example, optionally using mouse movement and mouse button presses, optionally in combination with single or multiple keyboard presses or holds; contact movement on a touchpad, such as tapping, dragging, scrolling, etc.; stylus input; movement of the device; verbal instructions; detected eye movement; biometric input; and / or any combination thereof as input corresponding to sub-events that define an event to be recognized.

[0325] Figure 2 Illustrated is a touchscreen (e.g., Figure 1APortable multifunctional device 100 of the touch-sensitive display system 112). The touch screen optionally displays one or more graphics within the user interface (UI) 200. In the present embodiment and other embodiments described hereinafter, the user can select one or more of these graphics by making gestures on the graphics, for example, by using one or more fingers 202 (not drawn to scale in the figures) or by using one or more styli 203 (not drawn to scale in the figures). In some embodiments, when the user interrupts contact with one or more graphics, selection of the one or more graphics will occur. In some embodiments, the gesture optionally includes one or more taps, one or more swipes (from left to right, from right to left, up, and / or down), and / or rolling of a finger that has already made contact with the device 100 (from right to left, from left to right, up, and / or down). In some specific implementations or in some cases, inadvertently contacting a graphic does not select the graphic. For example, when the gesture corresponding to selection is a tap, a swipe gesture that sweeps over an application icon optionally does not select the corresponding application.

[0326] Device 100 optionally further includes one or more physical buttons, such as a "home" button or a menu button 204. As previously described, the menu button 204 is optionally used to navigate to any application 136 among a set of applications optionally executed on the device 100. Alternatively, in some embodiments, the menu button is implemented as a soft key in the GUI displayed on the touch screen display.

[0327] In some embodiments, device 100 includes a touch screen display, a menu button 204, a push button 206 for powering on / off the device and for locking the device, one or more volume adjustment buttons 208, a subscriber identity module (SIM) card slot 210, a headset jack 212, and a docking / charging external port 124. The push button 206 is optionally used for: powering on / off the device by pressing the button and keeping the button in the depressed state for a predefined time interval; locking the device by pressing the button and releasing the button before the predefined time interval has elapsed; and / or unlocking the device or initiating an unlocking process. In some embodiments, device 100 also accepts voice input for activating or deactivating certain functions through the microphone 113. Device 100 also optionally includes one or more contact intensity sensors 165 for detecting the intensity of contact on the touch-sensitive display system 112 and / or one or more tactile output generators 167 for generating tactile output for the user of the device 100.

[0328] Figure 3is a block diagram of an exemplary multifunctional device having a display and a touch-sensitive surface, in accordance with some embodiments. Device 300 need not be portable. In some embodiments, device 300 is a laptop computer, desktop computer, tablet computer, multimedia player device, navigation device, educational device (e.g., a children's learning toy), a gaming system, or a control device (e.g., a home or industrial controller). Device 300 generally includes one or more processing units (CPUs) 310, one or more network or other communication interfaces 360, memory 370, and one or more communication buses 320 for interconnecting these components. The communication bus 320 optionally includes circuitry (sometimes called a chipset) that interconnects system components and controls the communication between them. Device 300 includes an input / output (I / O) interface 330 having a display 340, which is typically a touchscreen display. The I / O interface 330 also optionally includes a keyboard and / or mouse (or other pointing device) 350 and a touchpad 355, a haptic output generator 357 for generating haptic output on device 300 (e.g., similar to one or more of the haptic output generators 167 described above with reference to Figure 1A ), sensors 359 (e.g., optical sensors, acceleration sensors, proximity sensors, touch-sensitive sensors, and / or contact intensity sensors similar to one or more of the contact intensity sensors 165 described above with reference to Figure 1A ). Memory 370 includes high-speed random access memory, such as DRAM, SRAM, DDR RAM, or other random access solid state memory devices, and optionally includes non-volatile memory, such as one or more disk storage devices, optical disk storage devices, flash memory devices, or other non-volatile solid state storage devices. Memory 370 optionally includes one or more storage devices located remotely from one or more CPUs 310. In some embodiments, memory 370 stores programs, modules, and data structures similar to those stored in memory 102 of portable multifunctional device 100 ( Figure 1A ), or subsets thereof. Additionally, memory 370 optionally stores additional programs, modules, and data structures not present in memory 102 of portable multifunctional device 100. For example, memory 370 of device 300 optionally stores a drawing module 380, a presentation module 382, a word processing module 384, a website creation module 386, a disk editing module 388, and / or a spreadsheet module 390, while memory 102 of portable multifunctional device 100 ( Figure 1A ) optionally does not store these modules.

[0329] Figure 3Each of the elements identified above is optionally stored in one or more of the memory devices mentioned previously. Each of the modules identified above corresponds to a set of instructions for performing the functions described above. The modules or programs (i.e., instruction sets) identified above need not be implemented as separate software programs, procedures, or modules, and thus various subsets of these modules are optionally combined or otherwise rearranged in various embodiments. In some embodiments, the memory 370 optionally stores a subgroup of the modules and data structures described above. Additionally, the memory 370 optionally stores additional modules and data structures not described above.

[0330] Attention is now turned to an embodiment of a user interface (“UI”) optionally implemented on the portable multifunctional device 100.

[0331] Figure 4A An exemplary user interface of an application menu on the portable multifunctional device 100 is shown according to some embodiments. A similar user interface is optionally implemented on the device 300. In some embodiments, the user interface 400 includes the following elements or subsets or supersets thereof:

[0332] · One or more signal strength indicators 402 for one or more wireless communications (e.g., cellular signals and Wi-Fi signals);

[0333] · Time 404;

[0334] · Bluetooth indicator 405;

[0335] · Battery status indicator 406;

[0336] · A tray 408 with icons of common applications, such as:

[0337] ο An icon 416 marked “Phone” for the phone module 138, and the icon 416 optionally includes an indicator 414 of the number of missed calls or voicemails;

[0338] ο An icon 418 marked “Mail” for the email client module 140, and the icon 418 optionally includes an indicator 410 of the number of unread emails;

[0339] ο An icon 420 marked “Browser” for the browser module 147; and

[0340] ο An icon 422 marked “iPod” for the video and music player module 152 (also called the iPod (trademark of Apple Inc.) module 152); and icons of other applications, such as:

[0341] ο An icon 424 marked “Messages” for the IM module 141;

[0342] ο The icon 426 labeled "Calendar" of the calendar module 148;

[0343] ο The icon 428 labeled "Photos" of the image management module 144;

[0344] ο The icon 430 labeled "Camera" of the camera module 143;

[0345] ο The icon 432 labeled "Online Video" of the online video module 155;

[0346] ο The icon 434 labeled "Stocks" of the stock desktop applet 149-2;

[0347] ο The icon 436 labeled "Maps" of the map module 154;

[0348] ο The icon 438 labeled "Weather" of the weather desktop applet 149-1;

[0349] ο The icon 440 labeled "Clock" of the alarm desktop applet 149-4;

[0350] ο The icon 442 of the workout support module 142 labeled "Workout Support";

[0351] ο The icon 444 of the notepad module 153 labeled "Notepad"; and

[0352] ο The icon 446 of the settings application or module that provides access to the settings of the device 100 and its various applications 136;

[0353] It should be noted that Figure 4A The icon labels shown in are merely exemplary. For example, in some embodiments, the icon 422 of the video and music player module 152 is labeled "Music" or "Music Player". Other labels are optionally used for the various application icons. In some embodiments, the label of the corresponding application icon includes the name of the application corresponding to the corresponding application icon. In some embodiments, the label of a particular application icon is different from the name of the application corresponding to the particular application icon.

[0354] Figure 4B A device is shown having a touch-sensitive surface 451 separate from the display 450 (e.g., Figure 3 a tablet or touchpad 355 in ), e.g., Figure 3An exemplary user interface on a device 300). The device 300 also optionally includes one or more contact intensity sensors (e.g., one or more of sensors 357) for detecting the intensity of contacts on the touch-sensitive surface 451 and / or one or more tactile output generators 359 for generating tactile output for a user of the device 300.

[0355] Figure 4B An exemplary user interface on a device (e.g., device 300) having a touch-sensitive surface 451 separate from the display 450 (e.g., Figure 3 a tablet or touchpad 355 in Figure 3 device 300). Although many of the following examples will be given with reference to input on a touch screen display 112 (where the touch-sensitive surface and the display are combined), in some embodiments, the device detects input on a touch-sensitive surface separate from the display, as Figure 4B shown in Figure 4B In some embodiments, the touch-sensitive surface (e.g., 451 in Figure 4B has a major axis (e.g., 452 in Figure 4B corresponding to the major axis (e.g., 453 in Figure 4B on the display (e.g., 450). According to these embodiments, the device detects contacts with the touch-sensitive surface 451 at locations corresponding to corresponding locations on the display (e.g., 460 and 462 in Figure 4B e.g., in Figure 4B 460 corresponds to 468 and 462 corresponds to 470). Thus, when the touch-sensitive surface (e.g., 451 in Figure 4B is separate from the display (450) of the multifunctional device, user input detected by the device on the touch-sensitive surface (e.g., contacts 460 and 462 and their movement) is used by the device to manipulate the user interface on the display. It should be understood that a similar method is optionally used for other user interfaces described herein.

[0356] Additionally, while the following examples are given primarily with reference to finger inputs (e.g., finger contacts, single finger tap gestures, finger swipe gestures, etc.), it should be understood that in some embodiments, one or more of these finger inputs are replaced by inputs from another input device (e.g., mouse-based input or stylus input). For example, a swipe gesture is optionally replaced by a mouse click (e.g., instead of a contact), followed by movement of the cursor along the path of the swipe (e.g., instead of movement of a contact). As another example, a tap gesture is optionally replaced by a mouse click when the cursor is positioned above the location of the tap gesture (e.g., instead of detecting a contact, followed by ceasing to detect the contact). Similarly, when multiple user inputs are detected simultaneously, it should be understood that multiple computer mice are optionally used simultaneously, or a mouse and a finger contact are optionally used simultaneously.

[0357] As used herein, the term "focus selector" refers to an input element that indicates the current portion of the user interface with which the user is interacting. In some particular implementations that include a cursor or other location marker, the cursor serves as the "focus selector" such that when an input (e.g., a press input) is detected on a touch-sensitive surface (e.g., Figure 3 the touchpad 355 in Figure 4B or the touch-sensitive surface 451 in Figure 1A when the cursor is above a particular user interface element (e.g., a button, a window, a slider, or other user interface element), that particular user interface element is adjusted in accordance with the detected input. In implementations that include a touchscreen display (e.g., Figure 4AIn some specific implementations (such as the touch screen), the detected contact on the touch screen serves as a "focus selector", such that when an input (such as a press input via contact) is detected at the position of a specific user interface element (such as a button, window, slider, or other user interface element) on the touch screen display, the specific user interface element is adjusted according to the detected input. In some specific implementations, the focus moves from one area of the user interface to another area of the user interface without a corresponding movement of the cursor or a movement of the contact on the touch screen display (such as moving the focus from one button to another button by using the tab key or arrow keys); in these specific implementations, the focus selector moves according to the focus movement between different areas of the user interface. Regardless of the specific form taken by the focus selector, the focus selector is generally a user interface element (or a contact on the touch screen display) that is controlled by the user to convey (for example, by indicating to the device the element of the user interface with which the user intends to interact) the user's intention to interact with the user interface. For example, when a press input is detected on a touch-sensitive surface (such as a touchpad or touch screen), the position of the focus selector (such as a cursor, contact, or selection box) above the corresponding button will indicate that the user expects to activate the corresponding button (rather than other user interface elements shown on the device display).

[0358] As used in this specification and the claims, the "intensity" of a contact on a touch-sensitive surface refers to the force or pressure (force per unit area) of a contact on the touch-sensitive surface (e.g., finger contact or stylus contact), or a surrogate for the force or pressure of a contact on the touch-sensitive surface. The intensity of the contact has a range of values that includes at least four different values and more typically includes hundreds of different values (e.g., at least 256). The intensity of the contact is optionally determined (or measured) using a variety of methods and a variety of sensors or combinations of sensors. For example, one or more force sensors beneath or adjacent to the touch-sensitive surface are optionally used to measure the force at different points on the touch-sensitive surface. In some embodiments, force measurements from multiple force sensors are combined (e.g., weighted average) to determine an estimated contact force. Similarly, the pressure-sensitive tip of a stylus is optionally used to determine the pressure of the stylus on the touch-sensitive surface. Alternatively, the size and / or change in size of the contact area detected on the touch-sensitive surface, the capacitance and / or change in capacitance of the touch-sensitive surface adjacent to the contact, and / or the resistance and / or change in resistance of the touch-sensitive surface adjacent to the contact are optionally used as surrogates for the force or pressure of the contact on the touch-sensitive surface. In some embodiments, the surrogate measurement of the contact force or pressure is directly used to determine whether an intensity threshold has been exceeded (e.g., the intensity threshold is described in units corresponding to the surrogate measurement). In some embodiments, the surrogate measurement of the contact force or pressure is converted to an estimated force or pressure, and the estimated force or pressure is used to determine whether an intensity threshold has been exceeded (e.g., the intensity threshold is a pressure threshold measured in units of pressure). Using the intensity of the contact as an attribute of user input allows the user to access additional device functions that the user would not otherwise be able to easily access on a smaller device with a limited physical area for displaying affordances and / or receiving user input (e.g., via a touch-sensitive display, a touch-sensitive surface, or physical / mechanical controls such as knobs or buttons).

[0359] In some embodiments, the contact / motion module 130 uses a set of one or more intensity thresholds to determine whether an operation has been performed by the user (e.g., to determine whether the user has "clicked" on an icon). In some embodiments, at least a subset of the intensity thresholds is determined according to software parameters (e.g., the intensity thresholds are not determined by the activation thresholds of specific physical actuators and can be adjusted without changing the physical hardware of the device 100). For example, the mouse "click" threshold of a touchpad or touchscreen display can be set to any one of a wide range of predefined thresholds without changing the touchpad or touchscreen display hardware. Additionally, in some embodiments, software settings are provided to the user of the device for adjusting one or more of the intensity thresholds in a set of intensity thresholds (e.g., by adjusting individual intensity thresholds and / or by adjusting multiple intensity thresholds at once using a system-level click on an "intensity" parameter).

[0360] As used in the specification and claims, the term "feature strength" of a contact refers to a feature of the contact based on one or more strengths of the contact. In some embodiments, the feature strength is based on a plurality of strength samples. The feature strength is optionally based on a predefined number or set of strength samples collected during a predefined time period (e.g., 0.05 seconds, 0.1 seconds, 0.2 seconds, 0.5 seconds, 1 second, 2 seconds, 5 seconds, 10 seconds) relative to a predefined event (e.g., after detecting a contact, before detecting a contact lift, before or after detecting a contact start to move, before detecting a contact end, before or after detecting an increase in the strength of the contact, and / or before or after detecting a decrease in the strength of the contact). The feature strength of a contact is optionally based on one or more of the following: the maximum value of the contact strength, the mean of the contact strengths, the average of the contact strengths, the value at the top 10% of the contact strength, the half maximum of the contact strength, the 90% maximum of the contact strength, etc. In some embodiments, the duration of the contact is used in determining the feature strength (e.g., when the feature strength is the average of the contact strength over time). In some embodiments, the feature strength is compared to a set of one or more strength thresholds to determine whether the user has performed an operation. For example, the set of one or more strength thresholds can include a first strength threshold and a second strength threshold. In this example, a contact with a feature strength not exceeding the first threshold results in a first operation, a contact with a feature strength exceeding the first strength threshold but not exceeding the second strength threshold results in a second operation, and a contact with a feature strength exceeding the second threshold results in a third operation. In some embodiments, the comparison between the feature strength and one or more strength thresholds is used to determine whether to perform one or more operations (e.g., whether to execute a corresponding option or forego executing a corresponding operation), rather than for determining whether to perform a first operation or a second operation.

[0361] In some embodiments, a portion of a gesture is identified for determining the feature strength. For example, a touch-sensitive surface may receive a continuous swipe contact that transitions from a starting position to an ending position (e.g., a drag gesture), at which ending position the strength of the contact increases. In this embodiment, the feature strength of the contact at the ending position may be based on only a portion of the continuous swipe contact, rather than the entire swipe contact (e.g., only a portion of the swipe contact at the ending position). In some embodiments, a smoothing algorithm may be applied to the strength of the swipe gesture before determining the feature strength of the contact. For example, the smoothing algorithm optionally includes one or more of the following: an unweighted moving average smoothing algorithm, a triangular smoothing algorithm, a median filter smoothing algorithm, and / or an exponential smoothing algorithm. In some cases, these smoothing algorithms eliminate narrow spikes or dips in the strength of the swipe contact for determining the feature strength.

[0362] The user interface diagrams described herein optionally include various intensity diagrams that show the contact on the touch-sensitive surface relative to one or more intensity thresholds (e.g., contact detection intensity threshold IT0, light press intensity threshold IT L , deep press intensity threshold IT D (e.g., which is initially at least higher than I L ) and / or one or more other intensity thresholds (e.g., an intensity threshold I L lower than I H ). This intensity diagram is generally not part of the displayed user interface but is provided to help explain the diagram. In some embodiments, the light press intensity threshold corresponds to an intensity at which the device will perform an operation typically associated with clicking a button on a physical mouse or a touchpad. In some embodiments, the deep press intensity threshold corresponds to an intensity at which the device will perform an operation different from the operation typically associated with clicking a button on a physical mouse or touchpad. In some embodiments, when a contact with a feature intensity lower than the light press intensity threshold (e.g., and higher than the nominal contact detection intensity threshold IT0, contacts lower than this nominal contact detection intensity threshold are no longer detected) is detected, the device will move the focus selector based on the movement of the contact on the touch-sensitive surface without performing an operation associated with the light press intensity threshold or the deep press intensity threshold. Generally speaking, unless otherwise stated, these intensity thresholds are consistent between different sets of user interface drawings.

[0363] In some embodiments, the device's response to the input detected by the device depends on criteria based on the contact intensity during the input. For example, for some "light press" inputs, the intensity of the contact exceeding the first intensity threshold during the input triggers a first response. In some embodiments, the device's response to the input detected by the device depends on criteria that include both the contact intensity during the input and time-based criteria. For example, for certain "deep press" inputs, the contact intensity that exceeds the second intensity threshold and is greater than the first intensity threshold of the light press during the input triggers a second response only when a delay time between reaching the first intensity threshold and reaching the second intensity threshold has elapsed. The duration of this delay time is typically less than 200 ms (e.g., 40 ms, 100 ms, or 120 ms, depending on the magnitude of the second intensity threshold, and the delay time increases as the second intensity threshold increases). This delay time helps avoid accidental deep press inputs. Another example is that for some "deep press" inputs, there will be a period of reduced sensitivity after reaching the first intensity threshold. During this period of reduced sensitivity, the second intensity threshold increases. This temporary increase in the second intensity threshold also helps avoid accidental deep press inputs. For other deep press inputs, the response to detecting a deep press input does not depend on time-based criteria.

[0364] In some embodiments, one or more of the input intensity threshold and / or corresponding output vary based on one or more factors, such as user settings, contact movement, input timing, application running, rate of applied intensity, number of parallel inputs, user history, environmental factors (e.g., ambient noise), focus selector position, etc. Exemplary factors are described in U.S. Patent Application Serial Numbers 14 / 399,606 and 14 / 624,296, which are hereby incorporated by reference in their entireties.

[0365] For example, Figure 4C illustrates a dynamic intensity threshold 480 that changes over time based in part on the intensity of touch input 476 over time. The dynamic intensity threshold 480 is the sum of two components: a first component 474 that decays over time after a predefined delay time p1 from when the touch input 476 is initially detected, and a second component 478 that tracks the intensity of the touch input 476 over time. The initial high intensity threshold of the first component 474 reduces accidental triggering of a "deep press" response while still allowing an immediate "deep press" response if the touch input 476 provides sufficient intensity. The second component 478 reduces accidental triggering of a "deep press" response due to gradual intensity fluctuations of the touch input. In some embodiments, when the touch input 476 meets the dynamic intensity threshold 480 (e.g., at point 481 in Figure 4C ), a "deep press" response is triggered.

[0366] Figure 4D illustrates another dynamic intensity threshold 486 (e.g., intensity threshold I D ). Figure 4D Also illustrated are two other intensity thresholds: a first intensity threshold I H and a second intensity threshold I L . In Figure 4D , although the touch input 484 meets the first intensity threshold I H and the second intensity threshold I L before time p2, no response is provided until after the delay time p2 at time 482. Additionally, in Figure 4D , the dynamic intensity threshold 486 decays over time, where the decay begins at time 488 after a predefined delay time p1 from time 482 (when the response associated with the second intensity threshold I L is triggered). This type of dynamic intensity threshold reduces accidental triggering of a response associated with the dynamic intensity threshold I H or the second intensity threshold I L immediately after or simultaneously with triggering a response associated with a lower threshold intensity, such as the first intensity threshold I D .

[0367] Figure 4E shows yet another dynamic intensity threshold 492 (e.g., intensity threshold I D ). In Figure 4E , after an initial detection of a touch input 490 and after a delay time p2, a response associated with intensity threshold I L is triggered. At the same time, the dynamic intensity threshold 492 decays after an initial detection of the touch input 490 and after a predefined delay time p1. Thus, reducing the intensity of the touch input 490 and then increasing the intensity of the touch input 490 without releasing the touch input 490 after triggering a response associated with intensity threshold I L can trigger a response associated with intensity threshold I D (e.g., at time 494), even if the intensity of the touch input 490 is below another intensity threshold such as intensity threshold I L .

[0368] The characteristic intensity of a contact increases from an intensity below the light press intensity threshold IT L to an intensity between the light press intensity threshold IT L and the deep press intensity threshold IT D is sometimes referred to as a "light press" input. The characteristic intensity of a contact increases from an intensity below the deep press intensity threshold IT D to an intensity above the deep press intensity threshold IT D is sometimes referred to as a "deep press" input. The characteristic intensity of a contact increases from an intensity below the contact detection intensity threshold IT0 to an intensity between the contact detection intensity threshold IT0 and the light press intensity threshold IT L is sometimes referred to as detecting a contact on the touch surface. The characteristic intensity of a contact decreasing from an intensity above the contact detection intensity threshold IT0 to an intensity below the contact detection intensity threshold IT0 is sometimes referred to as detecting the contact being lifted from the touch surface. In some embodiments, IT0 is zero. In some embodiments, IT0 is greater than zero. In some diagrams, a shaded circle or ellipse is used to represent the contact intensity on the touch-sensitive surface. In some diagrams, an unshaded circle or ellipse is used to represent the corresponding contact on the touch-sensitive surface without specifying the intensity of the corresponding contact.

[0369] In some embodiments described herein, one or more operations are performed in response to detecting a gesture that includes a corresponding press input or in response to detecting a corresponding press input performed using a corresponding contact (or contacts), where the corresponding press input is detected at least in part based on the detected intensity of the contact (or contacts) increasing above a press input intensity threshold. In some embodiments, a corresponding operation is performed in response to detecting the intensity of the corresponding contact increasing above the press input intensity threshold (e.g., performing the corresponding operation on the "down stroke" of the corresponding press input). In some embodiments, the press input includes the intensity of the corresponding contact increasing above the press input intensity threshold and then the intensity of the contact decreasing below the press input intensity threshold, and a corresponding operation is performed in response to detecting the intensity of the corresponding contact then decreasing below the press input threshold (e.g., performing the corresponding operation on the "up stroke" of the corresponding press input).

[0370] In some embodiments, the device employs intensity hysteresis to avoid spurious inputs sometimes referred to as "jitter", where the device defines or selects a hysteresis intensity threshold having a predefined relationship to the press input intensity threshold (e.g., the hysteresis intensity threshold is X intensity units less than the press input intensity threshold, or the hysteresis intensity threshold is 75%, 90%, or some reasonable percentage of the press input intensity threshold). Thus, in some embodiments, the press input includes the intensity of the corresponding contact increasing above the press input intensity threshold and then the intensity of the contact decreasing below the hysteresis intensity threshold corresponding to the press input intensity threshold, and a corresponding operation is performed in response to detecting the intensity of the corresponding contact then decreasing below the hysteresis intensity threshold (e.g., performing the corresponding operation on the "up stroke" of the corresponding press input). Similarly, in some embodiments, a press input is detected only when the device detects the intensity of the contact increasing from an intensity equal to or below the hysteresis intensity threshold to an intensity equal to or above the press input intensity threshold and optionally the intensity of the contact then decreasing to an intensity equal to or below the hysteresis intensity, and a corresponding operation is performed in response to detecting the press input (e.g., depending on the context, the intensity of the contact increases or the intensity of the contact decreases).

[0371] For purposes of explanation, optionally, a description of an operation performed in response to a press input associated with a press input intensity threshold or in response to a gesture including a press input is triggered in response to detecting that: the intensity of the contact increases to be above the press input intensity threshold; the intensity of the contact increases from an intensity below a hysteresis intensity threshold to be above the press input intensity threshold; the intensity of the contact decreases to be below the press input intensity threshold; or the intensity of the contact decreases to be below a hysteresis intensity threshold corresponding to the press input intensity threshold. Additionally, in an example where an operation is described as being performed in response to detecting that the intensity of the contact decreases to be below the press input intensity threshold, the operation is optionally performed in response to detecting that the intensity of the contact decreases to be below a hysteresis intensity threshold corresponding to and less than the press input intensity threshold. As described above, in some embodiments, triggering of these operations also depends on meeting a time-based criterion (e.g., a delay time has elapsed between meeting a first intensity threshold and meeting a second intensity threshold).

[0372] User interface and associated processes

[0373] Attention is now turned to embodiments of a user interface (“UI”) and associated processes that may be implemented on an electronic device such as the portable multifunctional device 100 or device 300 having a display, a touch-sensitive surface, and (optionally) one or more sensors for detecting the intensity of contact with the touch-sensitive surface.

[0374] These user interfaces and associated processes provide new and improved ways for the following functions:

[0375] · Confirm a message;

[0376] · Edit a previously sent message;

[0377] · Display an edit history of a previously sent message;

[0378] · Apply an impact effect option to a message (e.g., to convey what the user is trying to communicate);

[0379] · Display a private message using “invisible ink”;

[0380] · Display enhanced instant message interface content (e.g., “full screen moment”);

[0381] · Display content corresponding to a particular combination of content in two separate messages (e.g., “magic moment”);

[0382] · Create message bubbles;

[0383] · Suggest emojis;

[0384] · Synchronize content viewing among users;

[0385] · Incorporate handwriting input;

[0386] · Optionally contract the content in the message transcript;

[0387] · Integrate a camera;

[0388] · Integrate search and sharing;

[0389] · Integrate interactive applications;

[0390] · Integrate stickers;

[0391] · Make a payment;

[0392] · Interact with an avatar; and

[0393] · Provide suggestions.

[0394] FIG. 5A to FIG. 5K Shows an exemplary user interface for displaying a message transcript and message confirmation according to some embodiments. Specifically, Figure 5A Shows an instant messaging user interface 5002 of an instant messaging user interface (e.g., of an instant messaging application) displayed on a display of an electronic device, which electronic device is sometimes referred to as a first electronic device to help distinguish it from other electronic devices that communicate with the first electronic device. The first electronic device also includes a touch-sensitive surface and one or more sensors, such as sensors configured to detect the intensity of contact on the touch-sensitive surface in a touchscreen display or a touchpad.

[0395] As Figure 5A The instant messaging user interface 5002 shown includes a conversation transcript 5004 of an instant messaging session between a user (e.g., Genevive) of the electronic device and at least one other user (e.g., Isaac) of another electronic device. The conversation transcript 5004 in this embodiment includes a plurality of messages, each message located in a corresponding message area 5008. A first input having a first contact 5010 at a location on the touch-sensitive surface corresponds to a first message 5006. In response to detecting the first input 5010, the electronic device displays a confirmation selection affordance 5012 at a location corresponding to the first message area in the instant messaging interface ( Figure 5B)。In this embodiment, it is confirmed that the selection indication can represent the display of multiple confirmation options: 5014-1 (heart), 5014-2 (like), 5014-3 (dislike), 5014-4 ("HA"), 5014-5 ("!!"), and 5014-6 ("?"). Other embodiments may include fewer, additional, or different confirmation options. The electronic device responds to receiving a second input 5106 through a corresponding confirmation option (or a hit area corresponding to each confirmation option), such as a second contact (e.g., a tap gesture, a light press gesture, a deep press gesture, or a lift-off) on option 5014-2 (like), to select the corresponding confirmation option and apply it to the first message 5006 or the first message area 5008-1, as Figure 5C shown. The confirmation option selected in this exemplary option 5014-2 is displayed in the corresponding confirmation area 5018. As Figure 5H shown, the electronic device of another user (Isaac in this embodiment) participating in the instant messaging session (sometimes referred to as a conversation) displays the same selected confirmation option adjacent to the first message area.

[0396] To edit the selected confirmation option, the user makes a third input through a third contact 5022, as Figure 5C shown. When the third input through the third contact is detected, the electronic device displays a confirmation editing interface 5024, as Figure 5D shown. Optionally, the confirmation editing interface is displayed at the top of the conversation transcript and / or in place of the conversation transcript. Optionally, in this exemplary option 5014-2, the currently selected confirmation option is visually distinguished from other available confirmation options in the confirmation editing interface 5024, as Figure 5D shown.

[0397] Figure 5E An input contact 5026 for selecting a different second confirmation option 5014-1 is shown, and Fig. 5F a message area in the conversation transcript with the edited confirmation (i.e., displaying the second confirmation option 5014-1 instead of the first confirmation option 5014-2) is shown.

[0398] In some embodiments, when a user of the first electronic device edits the confirmation option previously selected for the first message area using the confirmation editing interface 5024, the electronic device of another user in the instant messaging session displays a confirmation preparation indicator 5020 adjacent to (e.g., close to, adjacent to, or partially overlapping) the first message area in the conversation transcript 5004 displayed by the electronic device, as Figure 5G shown.

[0399] Different users in the same instant messaging session can select different confirmation options for the same message or message area. In some embodiments, as Fig.5I As shown, the electronic device displays a marker 5036 in the conversation transcript, which indicates that the user in the instant messaging session has selected multiple confirmation options for the second message area. In Fig.5I the illustrated embodiment, the marker 5036 is a stack of overlapping confirmation option icons, but it can also be multiple individual confirmation option icons. As Fig.5I shown, the marker 5036 is optionally adjacent to and / or partially overlaps the second message area 5008-02.

[0400] Figure 5J An embodiment of a user interface is shown that includes a count of each type of confirmation option selected by the user in the instant messaging session. For example, as Figure 5J shown, the user interface includes counts 5040-1, 5040-2, 5040-3 of three different confirmation options selected by the user in the instant messaging session. In some embodiments, in response to detecting an input made by contact (e.g., Fig.5I contact 5034 in Figure 5J ) at a location on the touch-sensitive surface corresponding to the location of the message area having the marker 5036, the electronic device displays

[0401] the user instant messaging interface shown in Figure 5J where the marker indicates that multiple users in the instant messaging session have selected confirmation options for the same message (or corresponding message area).

[0401] By selecting one of the counts 5040, the user can see the users who have selected any particular confirmation option. In response to an input made by contact (e.g., contact 5041 as Figure 5J shown) at a location on the touch-sensitive surface corresponding to the count 5040 of a particular confirmation option of the corresponding message area, the electronic device displays an icon 5042 (e.g., an avatar) representing the users who have selected the particular confirmation option of the corresponding message area, as Figure 5K shown.

[0402] Figure 5L to Figure 5T An exemplary user interface for editing a previously sent message when displaying a message transcript is shown. Figure 5L An instant messaging user interface 5002 of an instant messaging application on the display of an electronic device is shown. The instant messaging user interface 5002 includes: a conversation transcript 5004 of an instant messaging session between a user of the electronic device and at least one other user, and a first message area 5044 that includes a first message 5046-1 sent from the user's electronic device to the at least one other user in the instant messaging session.

[0403] The first message 5046-1 can be edited even though it has been sent. To begin editing the first message, the user selects the first message using a predefined touch input 5048 on the first message or the message area of the first message (e.g., a tap gesture, a long press gesture, a light press gesture, or a deep press gesture). In some embodiments, the electronic device displays a menu interface, such as Figure 5M the menu interface shown. Alternatively, the electronic device displays a message editing interface 5022 in response to detecting the input 5048, as shown in Figure 5N . In some embodiments, a first input gesture (e.g., a tap gesture) on the first message is used to transition to a menu interface (e.g., as shown in Figure 5M ), while a second input gesture (e.g., a deep press) is used to transition to the Figure 5N message editing interface 5052. From the menu interface as shown in Figure 5M , the user can transition the instant messaging application to the Figure 5M message editing interface 5022 shown in Figure 5N by selecting an edit option in the menu interface using a touch input 5050 ( Figure 5M ).

[0404] Figure 5N The message editing interface 5052 for editing the corresponding message (e.g., the first message 5046-1) as shown in Figure 5N includes a keyboard 5054 and an update affordance indication 5056. When the message editing interface 5052 for the corresponding message is displayed, the electronic device detects one or more inputs (e.g., the input 5057 shown in Figure 5N ) that modify the corresponding message, displays a modified version of the message, and detects an input that activates the update affordance indication (e.g., to send the updated message to one or more other electronic devices of one or more other participants in the instant messaging session).

[0405] Fig.5O shows a conversation transcript 5004 after the message 5046 has been updated. Since the conversation transcript 5004 includes the edited message, the edited message includes one or more indications 5058 that indicate that the specific message has been modified after the original version of the message was sent to other participants in the instant messaging session. In Fig.5O , there are two such modification indications: indication 5058-1 is the shaded area behind the message area; indication 5058-2 is the text (e.g., "Edited") displayed below the message area that contains the modified version of the message.

[0406] An edited or modified message can be edited again. The electronic device displays a message editing interface for the modified version of the message in response to an input (e.g., the input 5060 shown in Fig.5O ) corresponding to a request to edit the modified version 5046-2 of the message, as shown in Figure 5R as shown Figure 5R The message editing interface shown includes a message 5046-2 to be edited, a keyboard, and an update affordance (optionally not shown until at least one modification to the message has been made).

[0407] A participant in an instant messaging session may request to view all versions or two or more versions of an edited message. For example, in response to Fig.5O a predefined input 5060, on the edited message, the electronic device displays Figure 5P the user interface shown, where in addition to a modified version 5046-2 of the first message and a menu 5062 or list of edit options, the display of the conversation transcript is suppressed. In this embodiment, the displayed menu 5062 includes a copy affordance 5064 (for copying the message selected by the input 5060), a show edits affordance 5066 (for showing the edits to the message selected by the input 5060), a delete affordance 5068 (for deleting the message selected by the input 5060, or alternatively for undoing all edits made to the message selected by the input 5060), and a show more options affordance 5070. In Figure 5P the embodiment shown, an input 5072 (e.g., a tap gesture) is detected at a location on the touch-sensitive surface corresponding to the location of the "show edits" affordance 5066, which when activated displays a user interface 5074( Figure 5Q ), which includes the current version 5046-1 of the first message and a previous version 5046-2, as Figure 5Q shown Figure 5Q Another input 5076 or 5078 in the user interface is used to select a version of the message to be edited. For example, the selected version is highlighted, and then a touch input on 5080 will start editing the message of the selected version. Alternatively, a touch input on 5082 terminates the editing of the message of the selected version.

[0408] Figure 5P An alternative to the edit menu interface shown is Figure 5S the edit menu interface shown, which includes the selected message (selected in response to Fig.5O the input 5060 in) and a menu including an affordance (e.g., a "show edits" option 5086), which when activated displays Figure 5T the user interface shown, which includes the current version 5046-2 of the selected message and one or more previous versions (e.g., version 5046-1) of the selected message.

[0409] Figures 5U to 5BFAn exemplary user interface for applying impact effect options to a message input or a message area is shown. Figure 5U An instant messaging user interface 5002 is shown, in which a conversation transcript 5004 of an instant messaging session between a user (Wendy in this embodiment) of an electronic device and at least one other user (e.g., Max, a user of another electronic device in this embodiment) and a message input area 5100 including a first message input 5102 (e.g., text, sticker, image, and / or other graphics input by the user of the electronic device in the message input area but not yet sent to the at least one other user in the instant messaging session). In Figure 5U this case, the first message input 5102 has not been sent yet.

[0410] In some embodiments, in order to trigger Figure 5AA activation of the impact selection interface 5110, a first input 5102 made by a first contact at a position on a touch-sensitive surface corresponding to a position in the message input area 5100 includes a specific gesture (e.g., a swipe gesture) received at the message input area 5100. In this embodiment, the message input area includes an impact selection affordance 5104, and the position of the contact 5106 of the first input corresponds to the impact selection affordance. In some embodiments, the impact selection affordance 5104 is a multi-purpose affordance, and a second gesture (e.g., a tap) on the same affordance 5104 is used to send the message 5102 in the message input area 5100. When an input including the second gesture on the affordance 5104 is detected, the electronic device sends the message 5102 and transitions to Figure 5V the user interface shown. Similarly, after sending the message 5102, the electronic device of another user receives the message and displays Figure 5W the user interface shown.

[0411] In Figure 5X , Figure 5Y and Figure 5Z shown in some alternative embodiments, Figure 5X , Figure 5Y and Figure 5Z when the deep press inputs 5108-1, 5108-2, 5108-3 shown are detected by the electronic device, the instant messaging application will display Figure 5AA an impact selection interface 5110 including a plurality of impact effect options (e.g., impact effect options 5112-1 to 5112-4). The increasing intensity of the deep press input is represented by the intensity graphs in Figure 5X , Figure 5Y and Figure 5Z . In addition, as shown in Figure 5X , Figure 5Y and Figure 5ZAs shown, a deep press input 5108-1, 5108-2, 5108-3 is performed on the impact selection enabling representation 5104, and then dragged to the first impact effect option (e.g., Figure 5AA input 5108-4 on the impact effect option 5112-1), and then paused above the enabling representation of the corresponding impact effect option 5112, and the impact effect option will be selected.

[0412] Figure 5AA The impact selection interface 5110 of Figure 5AA includes a "bubble" enabling representation 5114 for displaying the impact effect options in the selection message area, and a "screen" enabling representation 5116 for selecting the full-screen impact effect options.

[0413] In some embodiments, the impact selection interface 5110 shows an animated preview of the currently selected impact effect option. For example, Figures 5AB to 5AD the sequence of Figures 5AB to 5AD shows an animated preview of the "Shout Loud" impact effect option (which is an impact effect option for the message area) applied to the first message input ("Congratulations!") in response to an input 5108-5 at a position on the touch-sensitive surface corresponding to the position of the "Shout Loud" impact effect option. In this embodiment, the preview of the "Shout Loud" impact effect option shows the font size of the message and the size of the message area first increasing and then decreasing.

[0414] Another example, Figures 5AE to 5AG the sequence of Figures 5AE to 5AG shows an animated preview of the "Boom Explosion" impact effect option (which is an impact effect option for the message area) applied to the first message input ("Congratulations!") in response to a second input 5108-6 at a position on the touch-sensitive surface corresponding to the position of the "Boom Explosion" impact effect option. In this embodiment, the preview of the "Boom Explosion" impact effect option shows the font size of the message and the size of the message area first increasing and then decreasing, while changing the tilt or rotation state of the message area, and optionally changing the hue or color of the background area around the message area. Optionally, the application of the corresponding impact effect option can change additional features of the message area to which the impact effect option is applied, such as the font color, background hue or color, etc. within the message area.

[0415] Figure 5AG A third input 5108-7 on the send enabling representation at the position corresponding to the impact effect option selected by the user is also shown, in this case the "Boom Explosion" option. In response, the electronic device of the user who composes the message stops displaying the impact selection interface, and displays a message area including the first message input in the conversation transcript, and in some embodiments, applies the selected impact effect option to the message area, as Figure 5AH shown, or applies it to the entire conversation transcript, as Figure 5AIas shown (enlarging the message area for the applied impact effect option and reducing the size of one or more other message areas in the conversation transcript), and then transitioning to a final or static display of the conversation transcript including the sent message, as Figure 5AJ shown. Similarly, the sent message is displayed on the electronic device of one or more other users (e.g., Wendy) in an instant messaging session, where the selected impact effect option is applied to either a message area of the sent message or the entire conversation transcript, depending on which impact effect option the sending user selected, an example of which is shown in the sequence of Figure 5AK , Figure 5AL , Figure 5AM .

[0416] Figures 5AN to 5AS The sequence of Figures 5AT to 5AW shows an example of the "Shout" impact effect option applied to the corresponding sent message ("Congratulations").

[0417] In some embodiments, the selected impact effect option is applied to the entire (or substantially the entire) display screen of the electronic device for sending or receiving messages to achieve a full - screen effect, and this display screen includes a message area with the sent message, an example of which is shown by the sequence of user interface images in Figures 5AX to 5BF . Figures 5AX to 5BF shows the progression of the "BOOM! Explosion" effect for the first message input ("Of course not!!"), starting with the first message input being magnified, rotated, and displayed with a dark background ( Figure 5AX ), then even larger and with a slightly lighter background ( Figure 5AY ), then shrinking and rotating at a different angle than before ( Figure 5AZ ), then further shrinking and blurring the boundaries ( Figure 5BA ), then being displayed at a smaller size with a different background and a different rotation angle ( Figure 5BB ), then having a series of different shadows around the message area ( Figure 5BC , Figure 5BD , Figure 5BE ), until the first message input is displayed at its normal (default) size, not rotating, and with a normal (default) background ( Figure 5BF ).

[0418] Figures 5BG to 5CA shows an exemplary user interface for interacting with a hidden message. Figure 5BG The impact selection interface 5110 shown includes a plurality of impact effect options (e.g., impact effect options 5112 - 1 to 5112 - 4, as elsewhere in this document with respect to Figure 5AA ​In this embodiment, the impact selection interface 5110 further includes a "bubble" affordance indication 5114 for displaying the impact effect options in the selection message area, and a "screen" affordance indication 5116 for selecting the full-screen impact effect option.

[0419] In some embodiments, the displayed impact effect options include an option for hiding the message content in the conversation transcript ( Figure 5AA the "obscuring ink" option 5112-1, as indicated by an empty message area in Figure 5BG ). In Figure 5BG the illustrated embodiment, the obscuring ink option includes a send affordance indication 5118 for sending a message with the corresponding impact effect option (with a user-specified message input). In Figure 5BG the illustrated embodiment, the impact selection interface 5110 includes a cancel affordance indication 5120 for canceling the selection of any impact effect option and returning the instant messaging application to the previous user interface of the instant messaging application or a predefined user interface of the instant messaging application.

[0420] Once a message is sent using the obscuring ink option (hereinafter referred to as a "hidden message" for ease of reference), the hidden message will not be displayed or will be blocked, for example, by a screen element 5124 used to hide the message, as shown in Figure 5BH until the user of the electronic device displaying the conversation transcript including the hidden message performs corresponding gestures such as swipe touch inputs 5128-a, 5128-b, 5128-c on the message area including the hidden message, as shown in the sequence of Figures 5BH to 5BL , which will temporarily reveal a portion of the message corresponding to the location of the touch inputs 5128-a, 5128-b, 5128-c; or perform a deep press gesture on the message area including the hidden message, as shown in the sequence of Figures 5BM to 5BP , where the hidden message portion is revealed according to the intensity of the deep press inputs 5130-a, 5130-b, 5130-c and optionally also according to the location of the deep press inputs 5130-a, 5130-b, 5130-c. In these embodiments, in response to detecting the termination of the input made through the contact that causes the hidden message or a portion thereof to be temporarily revealed, the hidden message is hidden again.

[0421] In another embodiment, Figures 5BQ to 5BV the sequence of Figures 5BQ to 5BT shows that the hidden message is gradually revealed, as shown in Figures 5BT to 5BV , and then gradually hidden, as shown in Figures 5BW to 5CA . In yet another embodiment, Figures 5BW to 5CA the sequence of

[0422] Figures 5CB to 5CWAn exemplary user interface for triggering enhanced message content and applying an effect to an instant messaging user interface when a message includes an enhanced message content trigger is shown. More specifically, an enhanced message content trigger can be used to send a corresponding message in an instant messaging session, and when an electronic device with a compatible instant messaging application receives a message with an enhanced message content trigger, the electronic device displays a conversation transcript with the received message and with enhanced message content. In some embodiments, the specific enhanced message content to be displayed is indicated by one or more parameters in the enhanced message content trigger.

[0423] Figure 5CB and Figure 5CC An embodiment of a user interface showing a preview of a full - screen impact effect is shown, in this case a full - screen impact effect including moving or animated balloons 5152 - 1. As Figure 5CB shown, the user of the electronic device who composed the message "Congratulations!" has selected the "Screen" affordance 5116 for selecting the full - screen impact effect option. Similarly, Figures 5CD to 5CF The sequence of Figure 5CC shows an embodiment of a user interface showing a preview of a full - screen impact effect, in this case a full - screen impact effect including moving or animated confetti 5152 - 2. In the embodiment shown here, the user uses a swipe gesture (e.g., Figure 5CC the swipe gesture 5156 shown) to navigate among the available full - screen impact effects, which causes the electronic device to move from Figure 5CD the preview of the balloon full - screen impact effect shown to Figure 5CB and Figure 5CC shown, the user interface can include effect option indicators 5154 (sometimes called page dots) to indicate the currently selected or currently previewed full - screen effect option, as well as to indicate how many full - screen effect options are available and which option or options in the sequence of full - screen effect options are currently being viewed.

[0424] Figure 5CG is an embodiment of a user interface with a conversation transcript where none of the messages include an enhanced message content trigger, so the messages in the transcript are displayed without the enhanced message content corresponding to the trigger.

[0425] Figures 5CH to 5CO The sequence of Figures 5CP to 5CW shows an embodiment of the balloon full - screen effect displayed when a message including the corresponding enhanced message content trigger ("Happy Birthday!!!!") is received. Similarly,

[0426] Figures 5CX to 5DCAn exemplary user interface for detecting and responding to composable content in a separate message is shown. In Figure 5CX , an instant messaging user interface 5002 includes a conversation transcript 5004 of an instant messaging session between a user of an electronic device and at least one other user (e.g., a user of another electronic device) including a first other user, and a message input area 5100. A received first message 5170 in a first message area 5008 is displayed in the conversation transcript 5004. The first message 5170 (e.g., a beer mug) has a first composable content (e.g., an emoticon or an image such as an emoji or a sticker). In Figure 5CY , the user of the electronic device inputs a second message 5172 in the message input area 5100 of the instant messaging user interface 5002, and sends the second message 5172 by an input 5174 for selecting a send enable indication 5118. This results in the display of Figure 5CZ the instant messaging user interface shown.

[0427] If the second message 5172 includes a second composable content that forms a predefined combination with the first composable content (content 5176) in the first message 5170, the electronic device displays content corresponding to the predefined combination, such as an animation of two beer mugs clinking together (as shown in Figure 5DA ) and / or displays the word "Cheers!" (as shown in Figure 5DA ). Similarly, the electronic devices of one or more other users in the instant messaging session will display the first message, the second message, and the content corresponding to the predefined combination. Note that the content 5176 corresponding to the predefined combination may be an animation that is briefly displayed after the second message is sent. Optionally, the content corresponding to the predefined combination is repeatedly displayed periodically while the first message and the second message having composable content are both displayed in the conversation transcript 5004, or when other predefined criteria are met (e.g., the first message and the second message having composable content are both displayed in the conversation transcript 5004, and when N is a predefined value between 1 and 60 seconds, there is no new activity in the instant messaging session for at least N seconds).

[0428] Figure 5DB And Figure 5DC 's sequence shows another embodiment of composable content, where the first user has sent a first message 5178 "Birthday", and the second user inputs a second message 5180 "Happy!". If both the first message and the second message include composable content corresponding to a predefined combination, the content corresponding to the predefined combination will be displayed in the message transcript of the instant messaging user interface displayed by the sender's electronic device or the recipient's electronic device or (usually) both. For example, in this embodiment, the content corresponding to the predefined combination may be balloons, similar to Figures 5CH to 5CO shown.

[0429] Figures 5DD to 5DI An exemplary user interface for selecting a message area type or shape according to some embodiments is shown. Figure 5DD An instant messaging user interface 5002 including a message input area 5100 with a first message input 5102 (“Yes!”) entered into the message input area is shown. The instant messaging user interface 5002 includes a send enablement representation 5200 located in or near the message input area 5100 for sending the message entered into the area. In addition, Figure 5DD An input via contact 5202 on an option enablement representation 5204 is shown.

[0430] Figure 5DE The instant messaging user interface shown is displayed in response to an input via contact 5202 on an option enablement representation 5204, the option enablement representation including an enablement representation of a plurality of message handling options, including Figure 5DE a message area type / shape selection enablement representation 5208 labeled as a “bubble” enablement representation in. When displaying the instant messaging user interface, the electronic device receives an input via contact 5206 on the “bubble” option enablement representation 5208.

[0431] In response to an input via contact 5206 on the “bubble” enablement representation 5208, Figure 5DF the instant messaging user interface shown is displayed. Figure 5DF A preview message area 5210-1 including the first message input 5102 and having a default or previously selected message area type is also shown. In these embodiments, the instant messaging application has a plurality of message area types or options, each message area type or option having a corresponding shape and generally having a corresponding font size, and optionally having one or more of the following: font color, border color, and / or background color. In Figure 5DF the embodiment shown, the send enablement representation 5200 is displayed near the preview message area 5210-1 instead of in the message input area 5100. To select a different message area type for the first message 5172 or to view other available message area types, the user inputs a swipe gesture 5212. In response to the swipe gesture 5212, a set of message area type icons is scrolled, as shown by the progression from Figures 5DF to 5DG shown.

[0432] In Figure 5DG the embodiment of the instant messaging user interface shown, an input via contact 5214 is received, which causes the electronic device to change the message area type of the message area to be used for the message input 5102, as Figure 5DH shown. In Figure 5DH, the message input 5102 is now displayed in the message area 5210-2, which has the same function as that of the message input 5102 as that of the message input 5102. Figure 5DG The user can continue to select different message area types. For example, in Figure 5DI , message input 5102 is now displayed in message area 5210-3, which has a message area type corresponding to the message area type selected by the input with contact 5216.

[0433] Figures 5DJ to 5DQ An exemplary user interface for automatically displaying and selecting suggested emoticons when composing a message is shown. Figure 5DJ , an instant messaging user interface 5002 is shown with a conversation transcript 5004 having an entered but not yet sent message 5220 in a message input area 5100. In this embodiment, the instant messaging user interface 5002 includes a send affordance 5200 located in or near the message input area 5100 for sending the entered message.

[0434] like Figures 5DK to 5DN As shown, the electronic device begins to automatically provide emoticon suggestions to replace one or more words or terms in the message input area 5100. In the illustrated embodiment, the electronic device highlights the words or phrases that are candidates for replacement with emoticons in the order in which they appear in the message, first highlighting the term "sushi" 5222 in the input message 5220, as shown in FIG. Figure 5DK and Figure 5DL As shown, the term "wine" 5224 in the input message 5220 is then highlighted, as shown in FIG. Figure 5DM As shown, the term "bowling" 5226 in the input message 5220 is then highlighted, as shown in FIG. Figure 5DN In response to a user of the electronic device selecting one of the highlighted terms (e.g., input via contact on the highlighted term), such as “sushi” 5222 in input message 5220, the term is replaced by a corresponding emoticon 5232 corresponding to the term, as shown in FIG. Figure 5DO Similarly, Figure 5DP In the example, in response to a user selection of the highlighted term "wine" in the input message 5220, the term "wine" in the input message 5220 has been replaced with an emoji 5234 (e.g., a wine glass emoji) corresponding to the term. In the third example, in response to a user selection of the highlighted term "bowling" in the input message 5220, the term "bowling" in the input message 5220 has been replaced with an emoji 5236 (e.g., a bowling ball emoji) corresponding to the term.

[0435] Message confirmation

[0436] Figures 6A to 6E is a flowchart of a process for applying confirmations to message regions in a conversation transcript according to some embodiments. More specifically, the methods involve displaying a confirmation selection affordance that includes a plurality of confirmation options and applying the selected confirmation option to the received message. In some embodiments, an indication of the applied confirmation option is transmitted to a remote device (e.g., for display in the conversation transcript of the remote device). This confirmation allows a user to quickly convey sentiment without having to type multiple words. This can save the user time by conserving keystrokes, thereby creating a more efficient human-machine interaction.

[0437] One or more examples of an electronic device (e.g., the portable multifunctional device 100 or the device 300) that implements these methods are shown in Figures 5A to 5K FIG.

[0438] Figures 6A to 6E is a flowchart of a method 600 performed by an electronic device (sometimes referred to herein as a first electronic device) having one or more processors, a memory, a touch-sensitive surface, and a display. In some embodiments, the electronic device includes one or more sensors (e.g., sensors in a touch screen display or a touchpad) configured to detect the intensity of a contact on the touch-sensitive surface.

[0439] When performing method 600, the electronic device displays on the display an instant message user interface 602 (e.g., of an instant message application). The instant message user interface includes a conversation transcript of an instant message session between a user of the electronic device and at least one other user (e.g., of another electronic device). See, for example, Figure 5A the conversation transcript 5004 in the instant message user interface 5002 of Figure 5A FIG. The electronic device receives a first message 604 in the instant message session from an electronic device (e.g., a second electronic device) corresponding to another user included in the instant message session. For example, in

[0440] response to receiving the first message, the electronic device displays the first message (e.g., Figure 5A the first message region (e.g., Figure 5A the message region 5008-1 of Figure 5A the conversation transcript 5004 of Figure 5Aa first input 608 made by a contact 5010). For example, the first contact can be a tap gesture, a long press gesture, a light press gesture, or a deep press gesture on the first message area or a hidden hit area of the first message area.

[0441] Next, in response to detecting the first input, the electronic device displays a confirmation selection affordance (e.g., Figure 5B a confirmation selection affordance 5012) 610 at a position corresponding to the first message area in the instant messaging interface. The confirmation selection affordance displays a plurality of confirmation options. For example, see Figure 5B the confirmation options 5014-1 to 5014-6 in. In some embodiments, the confirmation selection affordance is a confirmation selection disk that is adjacent to and / or overlaps the first message area. In some embodiments, the confirmation selection affordance is displayed based on determining that the characteristic intensity of the contact is higher than a first intensity threshold. In some embodiments, in addition to the initially displayed set of confirmation options 5014, the user can also manifest additional confirmation options by performing predefined input gestures (e.g., gestures including repeated deep presses, drag gestures, etc.).

[0442] In some embodiments, the plurality of confirmation options include graphical icons (612) that display at least one of a heart, a like, a dislike, "HA!", "!!", and / or a question mark. (For example, see Figure 5B the confirmation options 5014-1 to 5014-6 shown).

[0443] In some embodiments, method 600 includes transmitting information (614) in response to detecting the first input, the information causing one or more electronic devices corresponding to at least one other user included in the instant messaging session to display a confirmation preparation indicator corresponding to the first message area in the conversation transcript corresponding to the instant messaging session (e.g., causing other devices in the instant messaging session to display a confirmation area with an animated oval marker adjacent to and / or partially overlapping the corresponding first message area of the conversation transcript of the device of the at least one other user, similar to Figure 5G shown).

[0444] After detecting and responding to the first input, the electronic device detects a second contact (e.g., Figure 5B at a position corresponding to the position of the first confirmation option (e.g., Figure 5B the confirmation option 5014-2) in the confirmation selection affordance (e.g., Figure 5Ba second input 616 made at the contact 5016). Optionally, detection of the second contact is achieved by, for example, detecting a tap gesture, a light press gesture, a deep press gesture, or a lift-off on or within a hidden hit region of the first confirmation option. In some embodiments, the first contact and the second contact are different contacts, such as contacts in two different tap gestures made by the same finger. In some embodiments, the first contact and the second contact are different portions of the same continuous contact with the touch-sensitive surface, such as a long press, a light press, or a deep press on the first message area, followed by a drag towards the first confirmation option and a lift-off at the first confirmation option.

[0445] In response to detecting the second input, the electronic device applies the first confirmation option to the first message area 618. For example, Figure 5C shows the first confirmation option 5014-2 applied to the first message area. In some embodiments, the electronic device also stops displaying the confirmation selection affordance in response to detecting the second input.

[0446] In some embodiments, applying the first confirmation option to the first message area 618 includes displaying the first confirmation option 620 at a location adjacent to and / or partially overlapping the first message area. See, for example, Figure 5C which shows the first confirmation option 5014-2 applied to and in this case partially overlapping the corresponding first message area.

[0447] Optionally, in some embodiments, in response to detecting the second input, the electronic device transmits information 622 that causes one or more electronic devices corresponding to at least one other user included in the instant messaging session to apply the first confirmation option to the corresponding first message area in the conversation transcript corresponding to the instant messaging session. In some embodiments, this is achieved by transmitting information that causes other devices in the instant messaging session to display the first confirmation option adjacent to and / or partially overlapping the corresponding first message area of the conversation transcript of the device of the at least one other user. See, for example, Figure 5H which shows a conversation transcript displayed on one of the other devices in the instant messaging session, including the first confirmation option 5014-2 applied to (and in this case partially overlapping) the corresponding first message area. In some embodiments, the first confirmation option (e.g., the first confirmation option 5014-2) replaces the confirmation preparation indicator (e.g., Figure 5G the confirmation preparation indicator 5020) (e.g., via an animated transition) of the corresponding first message area.

[0448] In some embodiments, the first confirmation option is displayed in a confirmation area having a shape different from that of the first message area (e.g., as Figure 5CAs shown, the corresponding message area 5008-1 of a message from another user is rectangular and / or includes a first indicator indicating that the first message is from another user (e.g., the trailing "<" points to the first side of the display), while the corresponding confirmation area 5018 is circular and / or includes a second indicator indicating that the confirmation is from the user (e.g., the trailing "Oo" points to the second side of the display, opposite the first side)).

[0449] In some embodiments, after applying the first confirmation option to the first message area (and in some embodiments, after stopping displaying the confirmation selection enabling indication), method 600 includes performing an operation sequence 632-658, which includes detecting a third input 632 made by a third contact (e.g., Figure 5C contact 5022) at a position corresponding to the position of the first message area (or in some embodiments, the first confirmation option) on the touch-sensitive surface. In some embodiments, detecting the third input 632 includes detecting a tap gesture, a long press gesture, a light press gesture, or a deep press gesture on or within a hidden hit area of the first message area (or the first confirmation option).

[0450] In such embodiments, method 600 further includes, in response to detecting the third input 632 made by a third contact at a position corresponding to the position of the first message area (or in some embodiments, the first confirmation option) on the touch-sensitive surface, displaying a confirmation editing interface (e.g., Figure 5D confirmation editing interface 5024) 634. Optionally, the confirmation editing interface is displayed at the top of and / or in place of the conversation transcript.

[0451] In such embodiments, method 600 further includes detecting one or more inputs in the confirmation editing interface (e.g., Figure 5E detecting contact 5026), editing (e.g., changing or deleting) the confirmation option of the first message area according to the detected one or more inputs 652; stopping displaying the confirmation editing interface 654; displaying the first message area with the edited confirmation in the conversation transcript 656; and transmitting such that one or more electronic devices corresponding to at least one other user included in the instant messaging session display the corresponding first message area with the edited confirmation in the conversation transcript corresponding to the instant messaging session 658. For example, Figure 5D shows a confirmation editing interface 5024 with an indication (e.g., highlighting or graying out) indicating that the confirmation option 5014-2 has been previously selected. Figure 5E shows an input contact 5026 for selecting a different second confirmation option 5014-1, and Figure 5FShows a message area in the conversation transcript with an edited confirmation (i.e., showing the second confirmation option 5014-1 and not showing the first confirmation option 5014-2).

[0452] In some embodiments, in addition to displaying the confirmation editing interface 634 in response to detecting a third input 632 via a third contact, method 600 further includes stopping the display (or dimming) of the conversation transcript 636 in response to detecting the third input via the third contact, an example of which is shown in Figure 5E .

[0453] Furthermore, in some embodiments, in response to detecting a third input via a third contact, method 600 includes displaying a first message area 638 in the confirmation editing interface. For example, Figure 5E Shows an embodiment where the first message area is displayed in the confirmation editing interface and no other message areas are displayed in the conversation transcript in the confirmation editing interface. In some embodiments, the first message area is initially displayed in the confirmation editing interface at the same position as the first message area was displayed in the conversation transcript immediately before the third input was detected.

[0454] In some embodiments, in addition to displaying the confirmation editing interface 634 in response to detecting a third input 632 via a third contact, method 600 further includes displaying, in the confirmation editing interface in response to detecting the third input via the third contact, a confirmation selection affordance that includes a plurality of confirmation options, wherein a first confirmation option is visually distinguished (e.g., highlighted) from the other confirmation options among the plurality of confirmation options to indicate that the first confirmation option is currently selected. For example, Figure 5D Shows that the confirmation editing interface 5024 includes a confirmation selection affordance (similar to the Figure 5B affordance 5012 which has a plurality of confirmation options 5014).

[0455] In some embodiments, in addition to displaying the confirmation editing interface 634 in response to detecting a third input 632 via a third contact, method 600 further includes displaying, in the confirmation editing interface in response to detecting the third input via the third contact, a menu 642 of activatable editing options that includes a first message area. For example, Figure 5D Shows an editing menu 5028 that includes a "Copy" icon 530 for copying the content of the first message area. Although not shown in Figure 5D , the editing menu 5028 optionally includes additional activatable editing options, such as a "Delete" icon for deleting the currently applied confirmation option.

[0456] In some embodiments, method 600 includes, while displaying the instant messaging user interface as described above, simultaneously displaying on a display (A) a second message area in a conversation transcript (e.g., Figure 5I message area 5008-2 of Figure 5I ) 660, where (1) at least some users in the instant messaging session have selected a first confirmation option for the second message area, and (2) at least some users in the instant messaging session have selected a second confirmation option different from the first confirmation option for the second message area; and (B) one or more markers (e.g., marker 5036) indicating that users in the instant messaging session have selected multiple confirmation ...

Claims

1. A method performed at an electronic device having one or more processors, a memory, a touch-sensitive surface, and a display, comprising: Displaying, on the display, an instant messaging user interface of an instant messaging application, the instant messaging user interface including a conversation transcript of an instant messaging session between a user of the electronic device and a plurality of other users, and a message input area, the conversation transcript of the instant messaging session including message representations, wherein the instant messaging user interface includes corresponding representations of respective other users among the plurality of other users, the corresponding representations being different from the message representations; While displaying the instant messaging user interface, Detecting a first user input directed to the corresponding representation of a respective other user among the plurality of other users; In response to detecting the first user input, displaying a menu including activatable menu items associated with the respective other user among the plurality of other users, wherein each of the plurality of activatable menu items is for interacting separately with the respective other user among the plurality of other users, and wherein the menu overlays the instant messaging user interface, and wherein the activatable menu item associated with the respective other user among the plurality of other users in the displayed menu includes an activatable menu item for initiating a payment action with the respective other user among the plurality of other users; After displaying the menu, detecting a second user input selecting, from the displayed menu, the activatable menu item for initiating a payment action with the respective other user among the plurality of other users; And, In response to detecting the second user input, displaying a payment user interface configured to initiate the payment action with the respective other user among the plurality of other users, wherein the payment user interface includes an option for requesting payment from the respective other user among the plurality of other users.

2. The method according to claim 1, wherein the payment action includes sending a payment to the respective other user among the plurality of other users or requesting payment from the respective other user among the plurality of other users.

3. The method according to claim 2, further comprising: After detecting the first user input, while displaying the menu, detecting a third user input corresponding to an instant messaging menu item in the menu; And In response to the third user input, activating a private instant messaging session with the respective other user among the plurality of other users.

4. The method according to claim 3, wherein Activating the private instant messaging session with the respective other user among the plurality of other users includes displaying a private instant messaging conversation transcript of an instant messaging conversation between the user of the electronic device and the respective other user among the plurality of other users.

5. The method according to any one of claims 1-4, wherein Displaying the payment user interface includes displaying the payment user interface on a portion of the instant messaging user interface.

6. The method according to any one of claims 1-4, wherein: The first user input is a first touch gesture, the first touch gesture including a tap, a light press, or a deep press gesture; and The second user input is a second touch gesture.

7. The method according to any one of claims 1 - 4 further comprises: Before detecting the completion of the payment action, detecting a fourth user input corresponding to the payment message input area; And In response to detecting the fourth user input, displaying a numeric keypad.

8. The method according to any one of claims 1 - 4 further comprises: In response to detecting the completion of the payment action, displaying a payment confirmation within the conversation transcript.

9. An electronic device, comprising: A display; A touch - sensitive surface; One or more processors; A memory; And One or more programs, wherein the one or more programs are stored in the memory and configured to be executed by the one or more processors, and the one or more programs include instructions for performing the following operations: Displaying, on the display, an instant message user interface of an instant message application, the instant message user interface including a conversation transcript of an instant message session between a user of the electronic device and a plurality of other users and a message input area, the conversation transcript of the instant message session including message representations, wherein the instant message user interface includes corresponding representations of the corresponding other users among the plurality of other users, and the corresponding representations are different from the message representations; When displaying the instant message user interface, Detecting a first user input pointing to the corresponding representation of the corresponding other user among the plurality of other users; In response to detecting the first user input, displaying a menu including activatable menu items associated with the corresponding other user among the plurality of other users, wherein each of the plurality of activatable menu items is for interacting separately with the corresponding other user among the plurality of other users, and wherein the menu overlays the instant message user interface, and wherein the activatable menu item associated with the corresponding other user among the plurality of other users in the displayed menu includes an activatable menu item for initiating a payment action with the corresponding other user among the plurality of other users; After displaying the menu, detecting a second user input selecting, from the displayed menu, the activatable menu item for initiating a payment action with the corresponding other user among the plurality of other users; And, In response to detecting the second user input, displaying a payment user interface configured to initiate a payment action with the corresponding other user among the plurality of other users, wherein the payment user interface includes an option for requesting payment from the corresponding other user among the plurality of other users.

10. The electronic device according to claim 9, wherein the payment action includes sending a payment to the corresponding other user among the plurality of other users or requesting payment from the corresponding other user among the plurality of other users.

11. The electronic device according to claim 10, wherein, The one or more programs further include instructions for performing the following operations: After detecting the first user input, when displaying the menu, detecting a third user input corresponding to an instant message menu item in the menu; and In response to the third user input, activating a private instant message session with the corresponding other user among the plurality of other users.

12. The electronic device according to claim 11, wherein, Activating the private instant messaging session with a respective other user among the plurality of other users includes displaying a private instant messaging conversation transcript of an instant messaging conversation between the user of the electronic device and the respective other user among the plurality of other users.

13. The electronic device according to any one of claims 9-12, wherein, Displaying the payment user interface includes displaying the payment user interface on a portion of the instant messaging user interface.

14. The electronic device according to any one of claims 9-12, wherein: The first user input is a first touch gesture, and the first touch gesture includes a tap, a light press, or a deep press gesture; and The second user input is a second touch gesture.

15. The electronic device according to any one of claims 9-12, wherein, The one or more programs further include instructions for performing the following operations: Before detecting completion of the payment action, detecting a fourth user input corresponding to a payment message input area; and In response to detecting the fourth user input, displaying a numeric keypad.

16. The electronic device according to any one of claims 9-12, wherein, The one or more programs further include instructions for performing the following operations: In response to detecting completion of the payment action, displaying a payment confirmation within the conversation transcript.

17. A computer-readable storage medium storing one or more programs, the one or more programs including instructions that, when executed by an electronic device having a display and a touch-sensitive surface, cause the electronic device to perform the method according to any one of claims 1-8.

18. A computer program product, the computer program product including one or more programs that, when executed by a processor, cause the processor to perform the method according to any one of claims 1-8.

Images