Applying the confirmation option in the graphical messaging user interface

Abstract

The present disclosure relates to implementing confirmation options in graphical messaging user interfaces. Disclosed herein are electronic devices with improved methods and interfaces for messaging, including improved ways to: confirm messages; edit previously sent messages; express what a user is trying to convey; display private messages; synchronize content viewing between users; incorporate handwriting input; quickly locate content in a message transcript; integrate a camera; integrate search and sharing; integrate interactive applications; integrate stickers; make payments; interact with avatars; provide suggestions; navigate within interactive applications; manage interactive applications; translate foreign language text; group messages; and tag messages.

Description

[0001] This application is a divisional application of the invention patent application with an international application date of May 18, 2017, a national application number of 201780002856.4 (international application number of PCT / US2017 / 033396), and an invention name of “Application of confirmation options in a graphical messaging user interface”. Technical Field

[0002] This document generally relates to electronic devices with touch-sensitive surfaces, including but not limited to electronic devices with touch-sensitive surfaces that send and receive messages (e.g., instant messages). Background Art

[0003] The use of touch-sensitive surfaces as input devices for computers and other electronic computing devices has grown significantly in recent years. Exemplary touch-sensitive surfaces include touchpads and touch screen displays. These devices are often used to send messages, such as instant messages, between users using instant messaging applications.

[0004] However, current instant messaging applications have many shortcomings and limitations. For example, these applications have limited functionality in areas such as confirming messages; editing previously sent messages; expressing what the user is trying to convey; displaying private messages; synchronizing content viewing between users; incorporating handwriting input; quickly locating content within a message transcript; integrating a camera; integrating search and sharing; integrating interactive applications; integrating stickers; making payments; interacting with avatars; providing suggestions; navigating within interactive applications; managing interactive applications; translating foreign language text; grouping messages; and tagging messages. Summary of the Invention

[0005] Therefore, there is a need for electronic devices with improved methods and interfaces for messaging. Such methods and interfaces optionally supplement or replace conventional messaging methods. Such methods and interfaces modify the amount, extent, and / or nature of input from a user and produce a more efficient human-computer interface. For battery-operated devices, such methods and interfaces conserve power and increase the time between battery charges.

[0006] The disclosed device can reduce or eliminate the above-mentioned defects and other problems associated with the user interface of an electronic device with a touch-sensitive surface. In some embodiments, the device is a desktop computer. In some embodiments, the device is portable (e.g., a laptop, tablet computer, or handheld device). In some embodiments, the device is a personal electronic device (e.g., a wearable electronic device, such as a watch). In some embodiments, the device has a touchpad. In some embodiments, the device has a touch-sensitive display (also referred to as a "touch screen" or "touch screen display"). In some embodiments, the device has a graphical user interface (GUI), one or more processors, memory, and one or more modules, a program or instruction set stored in the memory for performing multiple functions. In some embodiments, the user interacts with the GUI primarily through stylus and / or finger contact and gestures on the touch-sensitive surface. In some embodiments, these functions optionally include image editing, drawing, presentation, word processing, spreadsheet creation, playing games, making and receiving calls, video conferencing, sending and receiving emails, instant messaging, fitness support, digital photography, digital video recording, web browsing, digital music playback, notepad creation, and / or digital video playback. Executable instructions for performing these functions are, optionally, included in a non-transitory computer-readable storage medium or other computer program product configured for execution by one or more processors.

[0007] There is a need for electronic devices with improved methods and interfaces for applying confirmations to message areas in conversation transcripts. Such methods and interfaces can supplement or replace conventional methods for applying confirmations to message areas in conversation transcripts. Such methods and interfaces reduce the amount, extent, and / or nature of input from the user and produce a more efficient human-computer interface.

[0008] According to some embodiments, a method for applying a confirmation to a message area in a conversation transcript displayed on a display of an electronic device includes displaying an instant messaging user interface (e.g., an instant messaging application) on the display, wherein the instant messaging user interface includes a conversation transcript of an instant messaging conversation between a user of the electronic device and at least one other user (e.g., a user of another electronic device). The method also includes receiving a first message in the instant messaging conversation from an electronic device corresponding to another user included in the instant messaging conversation (e.g., a second electronic device), and in response to receiving the first message, displaying the first message in a first message area of ​​the conversation transcript on the display. The electronic device detects a first input made by a first contact at a position on a touch-sensitive surface corresponding to the position of the first message area in the conversation transcript, and in response to detecting the first input, displays a confirmation selection enable indication at a position in the instant messaging interface corresponding to the first message area, wherein the confirmation selection enable indication displays multiple confirmation options. Next, the method includes detecting a second input made by a second contact at a position on the touch-sensitive surface corresponding to the position of the first confirmation option in the confirmation selection enable indication, and in response to detecting the second input, applying the first confirmation option to the first message area.

[0009] According to some embodiments, an electronic device includes: a display unit configured to display an instant messaging user interface on the display unit, the instant messaging user interface including a transcript of a conversation between a user of the electronic device and at least one other user; a touch-sensitive surface unit configured to detect contact; and a processing unit coupled to the display unit and the touch-sensitive surface unit. The processing unit is configured to receive a first message in the instant messaging conversation from an electronic device corresponding to another user included in the instant messaging conversation, and in response to receiving the first message, display the first message in a first message area of ​​the conversation transcript on the display unit. The processing unit is further configured to detect a first input via a first contact at a location on the touch-sensitive surface unit corresponding to a location of the first message area in the conversation transcript, and in response to detecting the first input, display a confirmation selection enable indication at a location in the instant messaging interface corresponding to the first message area, wherein the confirmation selection enable indication displays multiple confirmation options. The processing unit is further configured to detect a second input via a second contact at a location on the touch-sensitive surface unit corresponding to a location of the first confirmation option in the confirmation selection enable indication, and in response to detecting the second input, apply the first confirmation option to the first message area.

[0010] Thus, electronic devices with displays and touch-sensitive surfaces have improved methods and interfaces for applying confirmations to message areas in conversation transcripts, thereby increasing effectiveness, efficiency, and user satisfaction with such devices. Such methods and interfaces can supplement or replace conventional methods for applying confirmations to message areas in conversation transcripts.

[0011] There is a need for electronic devices with improved methods and interfaces for editing sent messages. Such methods and interfaces can supplement or replace conventional methods for editing sent messages. Such methods and interfaces reduce the amount, extent, and / or nature of input from the user and produce a more efficient human-computer interface.

[0012] According to some embodiments, a method for editing a message performed at an electronic device (e.g., a first electronic device) having one or more processors, a memory, a touch-sensitive surface, and a display includes displaying an instant messaging user interface on the display. The instant messaging user interface includes: a transcript of a conversation between a user of the electronic device and at least one other user, and a first message area including a first message in the instant messaging conversation sent from the user's electronic device to the at least one other user in the instant messaging conversation. The method also includes detecting a first input corresponding to a request for editing the first message, and in response to detecting the first input, displaying a message editing interface for the first message, the message editing interface including the first message, a keyboard, and an update enable indication, and when displaying the message editing interface for the first message, detecting one or more inputs for modifying the first message, displaying a modified version of the first message; and detecting an input for activating the update enable indication.

[0013] The method also includes: in response to detecting input that activates an update enable representation: stopping displaying the message editing interface of the first message; displaying a modified version of the first message in place of the first message in the conversation transcript; displaying at least one indication of the modification of the first message in the conversation transcript; and transmitting the modified version of the first message to one or more electronic devices corresponding to the at least one other user included in the instant messaging conversation, wherein the one or more electronic devices display the modified version of the first message in place of the first message in the conversation transcript corresponding to the instant messaging conversation, and at least one indication of the modification of the first message in the conversation transcript.

[0014] According to some embodiments, an electronic device includes: a display unit configured to display an instant messaging user interface on the display unit; a touch-sensitive surface unit configured to detect contact; and a processing unit coupled to the display unit and the touch-sensitive surface unit. The instant messaging user interface includes: a transcript of a conversation between a user of the electronic device and at least one other user, and a first message area in the instant messaging conversation that includes a first message sent from the user's electronic device to the at least one other user in the instant messaging conversation. The processing unit is configured to: detect a first input corresponding to a request for editing a first message; and in response to detecting the first input, display a message editing interface for the first message, the message editing interface including the first message, a keyboard, and an update enable indication. The processing unit is further configured to: while displaying a message editing interface for a first message, detect one or more inputs to modify the first message; display a modified version of the first message; detect an input to activate an update affordance; and in response to detecting the input to activate the update affordance: stop displaying the message editing interface for the first message; display the modified version of the first message in place of the first message in a conversation transcript; display at least one indication of the modification of the first message in the conversation transcript; and transmit the modified version of the first message to one or more electronic devices corresponding to the at least one other user included in the instant messaging conversation. The one or more electronic devices display the modified version of the first message in place of the first message in a conversation transcript corresponding to the instant messaging conversation, and at least one indication of the modification of the first message in the conversation transcript.

[0015] Thus, electronic devices with displays and touch-sensitive surfaces have improved methods and interfaces for editing sent messages, thereby increasing the effectiveness, efficiency, and user satisfaction of utilizing such devices. Such methods and interfaces may supplement or replace conventional methods for editing sent messages in instant messaging applications.

[0016] There is a need for electronic devices with improved methods and interfaces for displaying versions of sent messages. Such methods and interfaces can supplement or replace conventional methods for displaying versions of sent messages. Such methods and interfaces reduce the amount, extent, and / or nature of input from the user and produce a more efficient human-computer interface.

[0017] According to some embodiments, a method performed at an electronic device having one or more processors, a memory, a touch-sensitive surface, and a display includes displaying an instant messaging user interface on the display, the instant messaging user interface including: a conversation transcript of an instant messaging conversation between a user of the electronic device and at least one other user, and a first message area including a current version of a first message in the instant messaging conversation, wherein the conversation transcript includes an indication that the current version of the first message is a modified version of the first message in the conversation transcript. The method also includes detecting input corresponding to a request for viewing a version of the first message; and in response to detecting input corresponding to the request for viewing a version of the first message, displaying a version user interface including the current version of the first message and one or more previous versions of the first message.

[0018] According to some embodiments, an electronic device includes: a display unit configured to display an instant messaging user interface on the display unit; a touch-sensitive surface unit configured to detect contact; and a processing unit coupled to the display unit and the touch-sensitive surface unit. The instant messaging user interface includes: a conversation transcript of an instant messaging conversation between a user of the electronic device and at least one other user, and a first message area including a current version of a first message in the instant messaging conversation, wherein the conversation transcript includes an indication that the current version of the first message is a modified version of the first message in the conversation transcript. The processing unit is configured to: detect an input corresponding to a request for viewing a version of the first message; and in response to detecting the input corresponding to the request for viewing a version of the first message, display a version user interface including the current version of the first message and one or more previous versions of the first message.

[0019] Thus, electronic devices with displays and touch-sensitive surfaces have improved methods and interfaces for displaying versions of sent messages, thereby increasing the effectiveness, efficiency, and user satisfaction of utilizing such devices. Such methods and interfaces may supplement or replace conventional methods for displaying versions of sent messages in instant messaging applications.

[0020] There is a need for electronic devices with improved methods and interfaces for selecting impact effects for messages. Such methods and interfaces can supplement or replace conventional methods for selecting impact effects for messages. Such methods and interfaces reduce the amount, extent, and / or nature of input from the user and produce a more efficient human-computer interface.

[0021] According to some embodiments, a method performed at an electronic device having one or more processors, a memory, a touch-sensitive surface, and a display includes displaying an instant messaging user interface on the display, the instant messaging user interface including: a transcript of an instant messaging conversation between a user of the electronic device and at least one other user, and a message input area including a first message input. The method also includes: while displaying the instant messaging user interface, detecting a first input made by a first contact at a position on the touch-sensitive surface corresponding to a position in the message input area; in response to detecting the first input made by the first contact, displaying a shock selection interface including a plurality of shock effect options; while displaying the shock selection interface, detecting a second input made by a second contact at a position on the touch-sensitive surface corresponding to the position of a first shock effect option among the plurality of shock effect options; and in response to detecting a second user input made by the second contact, displaying a preview of applying the first shock effect option to the first message input.

[0022] According to some embodiments, an electronic device includes: a display unit configured to display an instant messaging user interface on the display unit; a touch-sensitive surface unit configured to detect contacts; and a processing unit coupled to the display unit and the touch-sensitive surface unit. The instant messaging user interface includes: a transcript of an instant messaging conversation between a user of the electronic device and at least one other user, and a message input area including a first message input. The processing unit is configured to: while displaying the instant messaging user interface, detect a first input made by a first contact at a position on the touch-sensitive surface unit corresponding to a position in the message input area; and in response to detecting the first input made by the first contact, display a shock selection interface including multiple shock effect options. The processing unit is further configured to: while displaying the shock selection interface, detect a second input made by a second contact at a position on the touch-sensitive surface unit corresponding to the position of a first shock effect option among the multiple shock effect options; and in response to detecting a second user input made by the second contact, display a preview of applying the first shock effect option to the first message input.

[0023] Thus, electronic devices with displays and touch-sensitive surfaces have improved methods and interfaces for selecting impact effects for messages, thereby increasing the effectiveness, efficiency, and user satisfaction of utilizing such devices. Such methods and interfaces may supplement or replace conventional methods for selecting impact effects for messages in instant messaging applications.

[0024] There is a need for electronic devices with improved methods and interfaces for hiding and revealing messages. Such methods and interfaces can supplement or replace conventional methods for hiding and revealing messages. Such methods and interfaces reduce the amount, extent, and / or nature of input from the user and produce a more efficient human-computer interface.

[0025] According to some embodiments, a method performed at an electronic device having one or more processors, a memory, a touch-sensitive surface, and a display includes displaying an instant messaging user interface on the display, the instant messaging user interface including: a transcript of an instant messaging conversation between a user of the electronic device and at least one other user including a first other user, and a message area in the transcript of the conversation of a message received from the first other user, the message area including one or more screen elements for hiding the message received from the first other user. The method also includes detecting a first input made by contact at a location on the touch-sensitive surface corresponding to the message area having a hidden message; and in response to detecting the first input made by contact, revealing the hidden message in the message area.

[0026] According to some embodiments, the electronic device includes: a display unit configured to display an instant messaging user interface on the display unit; a touch-sensitive surface unit configured to detect contact; and a processing unit coupled to the display unit and the touch-sensitive surface unit. The instant messaging user interface includes: a conversation transcript of an instant messaging conversation between a user of the electronic device and at least one other user including a first other user, and a message area in the conversation transcript of a message received from the first other user, the message area including one or more screen elements for hiding the message received from the first other user. The processing unit is further configured to: detect a first input made by contact at a position on the touch-sensitive surface unit corresponding to the message area with a hidden message; and in response to detecting the first input made by contact, reveal the hidden message in the message area.

[0027] Thus, electronic devices with displays and touch-sensitive surfaces have improved methods and interfaces for hiding and revealing messages, thereby increasing the effectiveness, efficiency, and user satisfaction of utilizing such devices. Such methods and interfaces can supplement or replace conventional methods for hiding and revealing messages in instant messaging applications.

[0028] There is a need for electronic devices with improved methods and interfaces for displaying enhanced message content in instant messaging applications. Such methods and interfaces can supplement or replace conventional methods for displaying enhanced message content in instant messaging applications. Such methods and interfaces reduce the amount, extent, and / or nature of input from the user and produce a more efficient human-computer interface.

[0029] According to some embodiments, a method performed at an electronic device having one or more processors, a memory, a touch-sensitive surface, and a display includes: displaying an instant messaging user interface on the display, the instant messaging user interface including a conversation transcript of an instant messaging conversation between a user of the electronic device and at least one other user including a first other user; receiving a first message in the instant messaging conversation from an electronic device corresponding to the first other user included in the instant messaging conversation; and determining whether the first message includes an enhanced message content trigger. The method also includes: based on determining that the first message includes an enhanced message content trigger, displaying the first message in a first message area of ​​the conversation transcript on the display, and displaying enhanced message content corresponding to the trigger, wherein the enhanced message content includes applying an effect to content of at least one message area outside the first message area in the conversation transcript. The method also includes displaying the first message (e.g., without enhanced message content) in the first message area of ​​the conversation transcript on the display based on determining that the first message does not include an enhanced message content trigger.

[0030] According to some embodiments, an electronic device includes: a display unit configured to display an instant messaging user interface on the display unit; a touch-sensitive surface unit configured to detect contact; and a processing unit coupled to the display unit and the touch-sensitive surface unit. The instant messaging user interface includes a conversation transcript of an instant messaging conversation between a user of the electronic device and at least one other user including a first other user. The processing unit is configured to: receive a first message in the instant messaging conversation from an electronic device corresponding to the first other user included in the instant messaging conversation, and determine whether the first message includes an enhanced message content trigger. The processing unit is further configured to: based on determining that the first message includes an enhanced message content trigger, display the first message in a first message area of ​​the conversation transcript on the display unit, and display enhanced message content corresponding to the trigger, wherein the enhanced message content includes applying an effect to content of at least one message area other than the first message area in the conversation transcript. In addition, the processing unit is configured to: based on determining that the first message does not include an enhanced message content trigger, display the first message in the first message area of ​​the conversation transcript on the display unit.

[0031] Thus, electronic devices with displays and touch-sensitive surfaces have improved methods and interfaces for displaying enhanced message content in instant messaging applications, thereby increasing the effectiveness, efficiency, and user satisfaction of utilizing such devices. Such methods and interfaces may supplement or replace conventional methods for displaying enhanced message content in instant messaging applications.

[0032] There is a need for electronic devices with improved methods and interfaces for displaying composable content in instant messaging applications. Such methods and interfaces can supplement or replace conventional methods for displaying composable content in instant messaging applications. Such methods and interfaces reduce the amount, extent, and / or nature of input from the user and produce a more efficient human-computer interface.

[0033] According to some embodiments, a method performed at an electronic device having one or more processors, a memory, a touch-sensitive surface, and a display includes displaying an instant messaging user interface on the display, the instant messaging user interface including a conversation transcript of an instant messaging conversation between a user of the electronic device and at least one other user including a first other user, and a message input area. The method also includes: receiving a first message in the instant messaging conversation from an electronic device corresponding to the first other user included in the instant messaging conversation, wherein the first message includes first combinable content, in response to receiving the first message, displaying the first message in a first message area of ​​the conversation transcript on the display, receiving input of a second message in the message input area, and when the second message is displayed in the message input area, detecting input for sending the second message to the instant messaging conversation. The method also includes: in response to detecting input for sending a second message to the instant messaging conversation: based on determining that the second message contains second combinable content and that the second combinable content and the first combinable content are part of a predefined combination, displaying content corresponding to the predefined combination in a conversation transcript on the display; and based on determining that the second message does not contain the second combinable content that forms a predefined combination together with the first combinable content, displaying the second message in a second message area of ​​the conversation transcript on the display (for example, without displaying content corresponding to the predefined combination in the conversation transcript on the display).

[0034] According to some embodiments, an electronic device includes: a display unit configured to display an instant messaging user interface on the display unit; a touch-sensitive surface unit configured to detect contact; and a processing unit coupled to the display unit and the touch-sensitive surface unit. The instant messaging user interface includes: a conversation transcript of an instant messaging conversation between a user of the electronic device and at least one other user including a first other user, and a message input area. The processing unit is configured to: receive a first message in an instant messaging conversation from an electronic device corresponding to the first other user included in the instant messaging conversation, wherein the first message includes first combinable content; in response to receiving the first message, display the first message in a first message area of ​​the conversation transcript on the display unit; receive input of a second message in the message input area; and when the second message is displayed in the message input area, detect input for sending the second message to the instant messaging conversation. The processing unit is further configured to: in response to detecting an input for sending a second message to the instant messaging session: based on determining that the second message contains second combinable content and that the second combinable content and the first combinable content are part of a predefined combination, display content corresponding to the predefined combination in a conversation transcript on the display unit; and based on determining that the second message does not contain the second combinable content that forms a predefined combination together with the first combinable content, display the second message in a second message area of ​​the conversation transcript on the display unit (for example, without displaying content corresponding to the predefined combination in the conversation transcript on the display).

[0035] Thus, electronic devices with displays and touch-sensitive surfaces have improved methods and interfaces for displaying composable content in instant messaging applications, thereby increasing the effectiveness, efficiency, and user satisfaction of utilizing such devices. Such methods and interfaces may supplement or replace conventional methods for displaying composable content in instant messaging applications.

[0036] There is a need for electronic devices with improved methods and interfaces for synchronizing media presentation in instant messaging applications. Such methods and interfaces optionally supplement or replace conventional methods for synchronizing media presentation in instant messaging applications. Such methods and interfaces produce more efficient human-computer interfaces by allowing users to easily view media content in a synchronized manner directly in the instant messaging application (and without having to be in the same location as another user viewing the media content, and without having to use inefficient methods for synchronized viewing). For battery-powered devices, such methods and interfaces increase user satisfaction with the device, save power and increase the interval between battery charges. In addition, allowing users to easily view media content in a synchronized manner directly in the messaging application enhances the operability of the device and makes the user-device interface (e.g., in the instant messaging application) more efficient (e.g., by allowing effective synchronized viewing of media items), thereby further reducing power usage and extending the battery life of the device by enabling users to use the device more quickly and efficiently.

[0037] According to some embodiments, a method is performed at an electronic device having a display and a touch-sensitive surface. The method includes displaying an instant messaging user interface on the display, the instant messaging user interface including a transcript of a conversation between a user of a first electronic device and at least one other user. In some embodiments, the conversation transcript includes a representation of a media item displayed at a chronological position in the conversation transcript, and the instant messaging conversation is configured to allow the user at the first electronic device to view the media item synchronously with at least one other user at a second electronic device different from the first electronic device. The method also includes receiving a first request in the instant messaging user interface for synchronous viewing of the media item. In response to receiving the first request, the method includes, upon displaying the representation of the media item at the chronological position in the conversation transcript, commencing playback of content corresponding to the media item. After commencing playback of the content corresponding to the media item, the method includes displaying the playback content corresponding to the media item at a fixed position in the instant messaging user interface that is different from the chronological position. While displaying the playback content corresponding to the media item at the fixed position, the method includes displaying messages exchanged between the user and the at least one other user below the playback content corresponding to the media item; and detecting the end of the content corresponding to the media item. In response to detecting an end of the content corresponding to the media item, the method includes ceasing to display the content corresponding to the media item at the fixed position.

[0038] According to some embodiments, an electronic device (e.g., Figure 22The electronic device 2200 includes: a display unit configured to display a user interface; a touch-sensitive surface unit for receiving contact; one or more sensor units for detecting the intensity of contact with the touch-sensitive surface unit; and a processing unit coupled to the display unit, the touch-sensitive surface unit, and the one or more sensor units. The processing unit is configured to (or one or more components thereof, such as Figure 22 The illustrated units 2210-2216 are configured to display an instant messaging user interface on a display, the instant messaging user interface including a transcript of a conversation between a user of a first electronic device and at least one other user. In some embodiments, the conversation transcript includes a representation of a media item displayed at a chronological position in the conversation transcript, and the instant messaging conversation is configured to allow the user at the first electronic device to view the media item synchronously with at least one other user at a second electronic device different from the first electronic device. The processing unit is further configured to: receive a first request for synchronously viewing the media item in the instant messaging user interface, and in response to receiving the first request, start playing content corresponding to the media item when the representation of the media item is displayed at the chronological position in the conversation transcript. After starting to play the content corresponding to the media item, the processing unit is configured to: display the playback content corresponding to the media item at a fixed position in the instant messaging user interface that is different from the chronological position. When displaying the playback content corresponding to the media item at the fixed position, the processing unit is configured to: display messages exchanged between the user and the at least one other user below the playback content corresponding to the media item, and detect the end of the content corresponding to the media item. In response to detecting the end of the content corresponding to the media item, the processing unit is configured to stop displaying the content corresponding to the media item at the fixed position.

[0039] Thus, electronic devices with displays and touch-sensitive surfaces have faster, more efficient methods and interfaces for viewing media content in a synchronized manner within instant messaging applications, thereby improving the effectiveness, efficiency, operability, and user satisfaction of utilizing such devices. Such methods and interfaces may supplement or replace conventional methods for viewing media within instant messaging applications.

[0040] There is a need for electronic devices with improved methods and interfaces for using handwriting input in instant messaging applications. Such methods and interfaces optionally supplement or replace conventional methods for entering messages in instant messaging applications. Such methods and interfaces help increase user satisfaction with their devices and create a more efficient human-computer interface by, for example, allowing the user to simply rotate the device to begin entering handwriting input. Such methods and interfaces also improve device operability by allowing handwriting input to automatically replace typed input and allowing the user to intuitively create a keyboard using handwritten characters as keys. For battery-powered devices, such methods and interfaces save power and increase the time between battery charges. Furthermore, allowing the user to simply rotate the device to begin entering handwriting input, automatically replacing typed input, and creating a keyboard using handwritten characters as keys all help enhance device operability and make the user-device interface (e.g., in instant messaging applications) more efficient (e.g., by allowing the user to easily customize message content using handwriting input), further reducing power usage and extending the device's battery life by enabling users to use the device more quickly and efficiently. For example, users do not need to leave the messaging application, open and use a different application to enter or locate handwriting input, and then return to use those inputs in the messaging application. Instead, users can simply provide and / or select customized handwriting input directly in the messaging application.

[0041] According to some embodiments, a method is performed at an electronic device having a display and a touch-sensitive surface. The method includes: displaying an instant messaging user interface on the display when the electronic device is in a portrait orientation, the instant messaging user interface including a virtual keyboard. The method also includes: detecting an orientation change of the electronic device from a portrait orientation to a landscape orientation; and in response to detecting the orientation change of the electronic device: ceasing to display the virtual keyboard and displaying a handwriting input area on the display configured to accept handwriting input from a user of the electronic device.

[0042] According to some embodiments, an electronic device includes: a display unit configured to display a user interface; a touch-sensitive surface unit for receiving contact; one or more sensor units for detecting the intensity of contact with the touch-sensitive surface unit; and a processing unit coupled to the display unit, the touch-sensitive surface unit, and the one or more sensor units. The processing unit is configured to: when the electronic device is in a portrait orientation, display an instant messaging user interface on the display, the instant messaging user interface including a virtual keyboard; detect an orientation change of the electronic device from a portrait orientation to a landscape orientation; and in response to detecting the orientation change of the electronic device: stop displaying the virtual keyboard; and display a handwriting input area on the display that is configured to accept handwriting input from a user of the electronic device.

[0043] According to some embodiments, a method is performed at an electronic device having a display and a touch-sensitive surface. The method includes: displaying on the display: an instant messaging user interface, the instant messaging user interface including a transcript of an instant messaging conversation between a user of the electronic device and at least one other user, a virtual keyboard, and a message input area. The method also includes: receiving a plurality of typed inputs at the virtual keyboard. Upon receiving the plurality of typed inputs, the method includes: determining whether one or more of the plurality of typed inputs matches a stored character sequence associated with a handwriting input stored by the user. Based on determining that the one or more typed inputs match the stored character string, the method includes: displaying an optional representation of the stored handwriting input at a first position adjacent to a first group of characters displayed in a message input area. In some embodiments, the first group of characters is displayed in the message input area and includes characters corresponding to one or more typed inputs that match the stored character sequence. The method also includes: detecting selection of an optional representation of stored handwriting input via the touch-sensitive surface; and in response to detecting selection of the optional representation of stored handwriting input: ceasing to display the optional representation of stored handwriting input at the first position; and replacing display of a first group of characters corresponding to the one or more typed inputs in the message input area with display of the representation of the stored handwriting input.

[0044] According to some embodiments, an electronic device includes: a display unit configured to display a user interface; a touch-sensitive surface unit for receiving contact; one or more sensor units for detecting the intensity of contact with the touch-sensitive surface unit; and a processing unit coupled to the display unit, the touch-sensitive surface unit, and the one or more sensor units. The processing unit is configured to: display on the display: an instant messaging user interface including a transcript of an instant messaging conversation between a user of the electronic device and at least one other user, a virtual keyboard, and a message input area. The processing unit is configured to: receive multiple typing inputs at a virtual keyboard; upon receiving the multiple typing inputs, determine whether one or more of the multiple typing inputs match a stored character sequence associated with a handwriting input stored by the user; based on determining that the one or more typing inputs match the stored character sequence, display an optional representation of the stored handwriting input at a first position of a first group of characters displayed in an adjacent message input area, the first group of characters being displayed in the message input area and including characters corresponding to the one or more typing inputs that match the stored character sequence; detect a selection of the optional representation of the stored handwriting input via the touch-sensitive surface; and in response to detecting the selection of the optional representation of the stored handwriting input: stop displaying the optional representation of the stored handwriting input at the first position; and replace the display of the first group of characters corresponding to the one or more typing inputs in the message input area with the display of the representation of the stored handwriting input.

[0045] According to some embodiments, a method is performed at an electronic device having a display and a touch-sensitive surface. The method includes: detecting a first input via the touch-sensitive surface; in response to detecting the first input, presenting a keyboard preparation user interface on the display; while presenting the keyboard preparation user interface, receiving handwriting input corresponding to a set of predefined training characters via the touch-sensitive surface; after receiving the handwriting input, detecting a second input corresponding to a request to display an instant messaging user interface including a message input area and a virtual keyboard having multiple keys, wherein a first key of the multiple keys is associated with a first handwriting input in the received handwriting input; in response to detecting the second input, displaying the instant messaging user interface including the message input area and the virtual keyboard having multiple keys; receiving a selection of the first key via the touch-sensitive surface; and in response to receiving the selection of the first key, outputting a representation of the first handwriting input in the message input area.

[0046] According to some embodiments, an electronic device includes: a display unit configured to display a user interface; a touch-sensitive surface unit for receiving contact; one or more sensor units for detecting the intensity of contact with the touch-sensitive surface unit; and a processing unit coupled to the display unit, the touch-sensitive surface unit, and the one or more sensor units. The processing unit is configured to: detect a first input via the touch-sensitive surface; in response to detecting the first input, present a keyboard preparation user interface on the display; while presenting the keyboard preparation user interface, receive handwriting input corresponding to a set of predefined training characters via the touch-sensitive surface; after receiving the handwriting input, detect a second input corresponding to a request for displaying an instant messaging user interface including a message input area and a virtual keyboard having a plurality of keys, wherein a first key of the plurality of keys is associated with a first handwriting input of the received handwriting input; in response to detecting the second input, display the instant messaging user interface including the message input area and the virtual keyboard having the plurality of keys; receive a selection of the first key via the touch-sensitive surface; and in response to receiving the selection of the first key, output a representation of the first handwriting input in the message input area.

[0047] Thus, electronic devices having a display, a touch-sensitive surface, and optionally one or more sensors for detecting intensity of contact with the touch-sensitive surface have faster, more efficient methods and interfaces for handwriting messages, thereby improving the effectiveness, efficiency, and user satisfaction of using such devices. Such methods and interfaces can supplement or replace conventional methods for composing and submitting messages.

[0048] There is a need for electronic devices with improved methods and interfaces for quickly locating different types of content in instant messaging applications. Such methods and interfaces optionally supplement or replace conventional methods. Such methods and interfaces enable users to quickly locate desired content (e.g., users can reduce the display size of all plain text content to quickly locate emoticons, photos, videos, or other types of content that may have been received a long time ago) by allowing users to use only simple gestures, thereby creating a more efficient human-computer interface. For battery-powered devices, such methods and interfaces save power and increase the interval between battery charges (e.g., by allowing users to quickly locate desired content). In addition, allowing users to quickly locate desired content enhances the operability of the device and makes the user-device interface (e.g., in instant messaging applications) more efficient (e.g., by allowing users to easily locate desired content that may be large and difficult to search for in a conversation transcript), thereby further reducing power usage and extending the battery life of the device by enabling users to use the device more quickly and efficiently (e.g., users do not need to scroll through the content in the conversation transcript page by page, but can simply provide intuitive gestures to easily reduce the content and easily locate the desired content).

[0049] According to some embodiments, a method is performed at an electronic device having a display and a touch-sensitive surface. The method includes: displaying an instant messaging user interface including a plurality of content items on the display. In some embodiments, the plurality of content items include content items having a first content type, the plurality of content items include content items having a second content type different from the first content type, and corresponding content items in the plurality of content items are displayed in corresponding first sizes. When displaying the instant messaging user interface, the method includes: detecting a first input via the touch-sensitive surface. In response to detecting the first input, the method includes: reducing the display size of at least some content items having the first content type, while continuing to display content items having the second content type in their corresponding first sizes.

[0050] According to some embodiments, the electronic device includes: a display unit configured to display a user interface; a touch-sensitive surface unit for receiving contact; one or more sensor units for detecting the intensity of contact with the touch-sensitive surface unit; and a processing unit coupled to the display unit, the touch-sensitive surface unit, and the one or more sensor units. The processing unit is configured to: display an instant messaging user interface including multiple content items on the display. In some embodiments, the multiple content items include at least content items having a first content type, the multiple content items include at least content items having a second content type different from the first content type, and corresponding content items in the multiple content items are displayed in corresponding first sizes. When displaying the instant messaging user interface, the processing unit is configured to: detect a first input via the touch-sensitive surface, and in response to detecting the first input, reduce the display size of at least some content items having the first content type, while continuing to display content items having the second content type in their corresponding first sizes.

[0051] According to some embodiments, a method is performed at an electronic device having a display and a touch-sensitive surface. The method includes: displaying an instant messaging user interface including a plurality of content items on the display. In some embodiments, the plurality of content items include content items having a first content type, the plurality of content items include content items having a second content type different from the first content type, and corresponding content items in the plurality of content items are displayed in corresponding first sizes. When displaying the instant messaging user interface, the method includes: detecting a first input via the touch-sensitive surface, and in response to detecting the first input, the method includes: reducing the display size of at least some content items having the first content type, so that the first content item having the first content type is reduced to a corresponding second size smaller than the corresponding first size by a predefined first display size reduction factor; and reducing the display size of at least some content items having the second content type, so that the second content item having the second content type is reduced to a corresponding third size smaller than the corresponding first size by a predefined second display size reduction factor. In some embodiments, the predefined second display size reduction factor is smaller than the predefined first display size reduction factor.

[0052] According to some embodiments, an electronic device includes: a display unit configured to display a user interface; a touch-sensitive surface unit for receiving contacts; one or more sensor units for detecting intensity of contacts with the touch-sensitive surface unit; and a processing unit coupled to the display unit, the touch-sensitive surface unit, and the one or more sensor units. The processing unit is configured to display an instant messaging user interface including multiple content items on the display. In some embodiments, the multiple content items include content items of a first content type, the multiple content items include content items of a second content type different from the first content type, and corresponding content items in the multiple content items are displayed at corresponding first sizes. While displaying the instant messaging user interface, the processing unit is configured to detect a first input via the touch-sensitive surface. In response to detecting the first input, the processing unit is configured to reduce the displayed size of at least some content items of the first content type such that the first content items of the first content type are reduced to corresponding second sizes smaller than the corresponding first sizes by a predefined first display size reduction factor; and reduce the displayed size of at least some content items of the second content type such that the second content items of the second content type are reduced to corresponding third sizes smaller than the corresponding first sizes by a predefined second display size reduction factor. In some embodiments, the predefined second display size reduction factor is less than the predefined first display size reduction factor.

[0053] Thus, an electronic device having a display, a touch-sensitive surface, and optionally one or more sensors for detecting intensity of contact with the touch-sensitive surface has a fast and efficient method and interface for quickly locating different types of content in instant messaging applications, thereby improving the effectiveness, efficiency, and user satisfaction of utilizing such devices.

[0054] There is a need for electronic devices with improved methods and interfaces for sharing images (e.g., photos) in message conversations. Such methods and interfaces can supplement or replace conventional methods for sharing images (e.g., photos) in message conversations. Such methods and interfaces reduce the amount, extent, and / or nature of input from the user and produce a more efficient human-computer interface.

[0055] According to some embodiments, a method is performed at an electronic device having a display, a digital camera, a touch-sensitive surface, and a memory. The method includes displaying an instant messaging user interface on the display, the instant messaging user interface including a conversation transcript of an instant messaging conversation between a user of the electronic device and at least one other user, a keyboard, a message input area, and a digital image enable representation. The method also includes detecting an input that activates the digital image enable representation when the instant messaging user interface is displayed. The method also includes, in response to detecting the input that activates the digital image enable representation, replacing the display of the keyboard with the display of multiple digital images, the multiple digital images including one or more digital images stored in the memory and a real-time preview image from the digital camera. The method also includes detecting an input that selects a real-time image to be displayed among the multiple digital images. The method also includes, in response to detecting the input that selects the real-time image, capturing a digital image using the digital camera while maintaining the display of the conversation transcript.

[0056] According to some embodiments, an electronic device includes: a display unit configured to display a user interface; a digital camera unit configured to capture images; a touch-sensitive surface unit; a memory unit; and a processing unit coupled to the display unit, the digital camera unit, the touch-sensitive surface unit, and the memory unit. The processing unit is configured to display an instant messaging user interface on the display unit, the instant messaging user interface including a transcript of an instant messaging conversation between a user of the electronic device and at least one other user, a keyboard, a message input area, and a digital image affordance. The processing unit is further configured to detect an input activating the digital image affordance while displaying the instant messaging user interface. The processing unit is further configured to, in response to detecting the input activating the digital image affordance, replace the keyboard display with a display of a plurality of digital images, the plurality of digital images including one or more digital images stored in the memory unit and a live preview image from the digital camera unit. The processing unit is further configured to detect an input selecting a live image displayed among the plurality of digital images. The processing unit is further configured to, in response to detecting the input selecting the live image, capture a digital image using the digital camera unit while maintaining the display of the conversation transcript.

[0057] Thus, electronic devices with displays and touch-sensitive surfaces have improved methods and interfaces for sharing images (e.g., photos) in messaging conversations, thereby increasing the effectiveness, efficiency, and user satisfaction of utilizing such devices. Such methods and interfaces may supplement or replace conventional methods for sharing images (e.g., photos) in messaging conversations.

[0058] There is a need for electronic devices with improved methods and interfaces for searching and sharing content (e.g., content from the internet and locally stored content) in message conversations. Such methods and interfaces can supplement or replace conventional methods for searching and sharing content in message conversations. Such methods and interfaces reduce the amount, extent, and / or nature of input from the user and produce a more efficient human-computer interface.

[0059] According to some embodiments, a method is performed at an electronic device having a display and a touch-sensitive surface. The method includes displaying an instant messaging user interface on the display, the instant messaging user interface including a transcript of an instant messaging conversation between a user of the electronic device and at least one other user and a search affordance. The method also includes, while displaying the instant messaging user interface, detecting an input activating the search affordance. The method further includes, in response to detecting the input activating the search affordance: ceasing to display the instant messaging user interface, and displaying a search user interface including a search field and a plurality of categorized content items, wherein the plurality of categorized content items include at least content items stored on the electronic device and content items from the internet. The method also includes, while displaying the search user interface, detecting an input selecting a first content item from the plurality of categorized content items. The method also includes, after detecting the input selecting the first content item from the plurality of categorized content items: ceasing to display the search user interface, displaying the first content item in the transcript of the conversation in the instant messaging user interface, and transmitting the first content item to one or more electronic devices corresponding to the at least one other user included in the instant messaging conversation, wherein the one or more electronic devices display the first content item in the transcript of the conversation corresponding to the instant messaging conversation.

[0060] According to some embodiments, the electronic device includes: a display unit configured to display a user interface; a touch-sensitive surface unit; a memory unit; and a processing unit coupled to the display unit, the touch-sensitive surface unit, and the memory unit. The processing unit is configured to: display an instant messaging user interface on the display unit, the instant messaging user interface including a conversation transcript of an instant messaging conversation between a user of the electronic device and at least one other user and a search enable indication. The processing unit is further configured to: detect an input that activates the search enable indication when displaying the instant messaging user interface. The processing unit is further configured to: in response to detecting the input that activates the search enable indication: stop displaying the instant messaging user interface, and display a search user interface, the search user interface including a search field and a plurality of classified content items, wherein the plurality of classified content items include at least content items stored on the electronic device and content items from the Internet. The processing unit is further configured to: detect an input that selects a first content item from the plurality of classified content items when displaying the search user interface. The processing unit is further configured to: after detecting input selecting a first content item from multiple classified content items: stop displaying the search user interface, display the first content item in a conversation transcript in the instant messaging user interface, and transmit the first content item to one or more electronic devices corresponding to at least one other user included in the instant messaging conversation, wherein the one or more electronic devices display the first content item in a conversation transcript corresponding to the instant messaging conversation.

[0061] Thus, electronic devices with displays and touch-sensitive surfaces have improved methods and interfaces for searching for shared content in message conversations, thereby increasing the effectiveness, efficiency, and user satisfaction of utilizing such devices. Such methods and interfaces may supplement or replace conventional methods for sharing content in conversations.

[0062] There is a need for electronic devices with improved methods and interfaces for adding interactive applications within instant messaging applications. Such methods and interfaces can supplement or replace conventional methods for adding interactive applications within instant messaging applications. Such methods and interfaces reduce the amount, extent, and / or nature of input from the user and produce a more efficient human-computer interface.

[0063] According to some embodiments, a method is performed at an electronic device having one or more processors, a memory, a touch-sensitive surface, and a display. The method includes: displaying an instant messaging user interface of an instant messaging application on the display, the instant messaging user interface including a transcript of an instant messaging conversation between a user of the electronic device and at least one other user and an application enable representation; while displaying the instant messaging user interface, detecting input for activating the application enable representation; in response to detecting input for activating the application enable representation, simultaneously displaying a launch icon for an application store and multiple launch icons for interactive applications, wherein activating a corresponding launch icon for an interactive application will launch a corresponding application displayed in the instant messaging application; detecting input for activating the launch icon for the application store; in response to detecting input for activating the launch icon for the application store: stopping displaying the instant messaging user interface, and Displaying an application store user interface, including displaying at least one interactive application available for download to the electronic device; while displaying the application store user interface, detecting input corresponding to a request for downloading a first interactive application that is not stored in a memory of the electronic device; and in response to detecting the input corresponding to the request for downloading the first interactive application: downloading the first interactive application to the memory of the electronic device; replacing the display of the application store user interface with a display of an instant messaging user interface that includes a transcript of the conversation and at least some of a plurality of launch icons for the interactive applications; and adding a launch icon corresponding to the first interactive application to the display of the plurality of launch icons for the interactive applications.

[0064] According to some embodiments, the electronic device includes: a display unit configured to display a user interface; a touch-sensitive surface unit configured to detect contact; and a processing unit coupled to the display unit and the touch-sensitive surface unit. The processing unit is configured to: enable display of an instant messaging user interface of an instant messaging application on the display unit, the instant messaging user interface including a conversation transcript of an instant messaging conversation between a user of the electronic device and at least one other user and an application enable representation; while displaying the instant messaging user interface, detect input for activating the application enable representation; in response to detecting input for activating the application enable representation, simultaneously enable display of a launch icon for an application store and multiple launch icons for interactive applications, wherein activating a corresponding launch icon for an interactive application will launch a corresponding application displayed in the instant messaging application; detect input for activating the launch icon for the application store; in response to detecting input for activating the launch icon for the application store: stop displaying the instant messaging user interface; a user interface and enabling display of an application store user interface, including displaying at least one interactive application available for download to the electronic device; while displaying the application store user interface, detecting input corresponding to a request for downloading a first interactive application that is not stored in a memory of the electronic device; and in response to detecting the input corresponding to the request for downloading the first interactive application: downloading the first interactive application to the memory of the electronic device; replacing the display of the application store user interface with a display of an instant messaging user interface that includes a transcript of the conversation and at least some of a plurality of launch icons for the interactive applications; and adding a launch icon corresponding to the first interactive application to the display of the plurality of launch icons for the interactive applications.

[0065] Thus, electronic devices with displays and touch-sensitive surfaces have improved methods and interfaces for adding interactive applications to instant messaging applications, thereby increasing the effectiveness, efficiency, and user satisfaction of utilizing such devices. Such methods and interfaces may supplement or replace conventional methods for adding interactive applications to instant messaging applications.

[0066] There is a need for electronic devices with improved methods and interfaces for posting messages. Such methods and interfaces can supplement or replace conventional methods for posting messages. Such methods and interfaces reduce the amount, extent, and / or nature of input from the user and produce a more efficient human-computer interface.

[0067] According to some embodiments, a method is performed at an electronic device having one or more processors, a memory, a touch-sensitive surface, and a display. The method includes: displaying an instant messaging user interface of an instant messaging application on the display, the instant messaging user interface including a transcript of an instant messaging conversation between a user of the electronic device and at least one other user, a first message input area, and a launch icon for an interactive application; while displaying the instant messaging user interface, detecting an input to activate the launch icon for the interactive application; in response to detecting the input to activate the launch icon for the interactive application, displaying a user interface for the interactive application, the interactive application user interface including a second message input area different from the first message input area; while displaying the interactive application user interface, detecting an input of a first message in the second message input area; in response to detecting the input of the first message in the second message input area, displaying the first message in the second message input area; while displaying the first message in the second message input area, detecting an input corresponding to a request to publish content of the second message input area to the instant messaging conversation; and in response to detecting the input corresponding to the request to publish content of the second message input area to the instant messaging conversation, transmitting the first message to one or more electronic devices corresponding to at least one other user included in the instant messaging conversation, wherein the one or more electronic devices display the first message in the conversation transcript corresponding to the instant messaging conversation.

[0068] According to some embodiments, the electronic device includes: a display unit configured to display a user interface; a touch-sensitive surface unit configured to detect contact; and a processing unit coupled to the display unit and the touch-sensitive surface unit. The processing unit is configured to: enable display of an instant messaging user interface of an instant messaging application on a display unit, the instant messaging user interface including a conversation transcript of an instant messaging conversation between a user of the electronic device and at least one other user, a first message input area, and a launch icon of an interactive application; while displaying the instant messaging user interface, detect input for activating the launch icon of the interactive application; in response to detecting the input for activating the launch icon of the interactive application, enable display of the user interface of the interactive application, the interactive application user interface including a second message input area different from the first message input area; while displaying the interactive application user interface, detect input of a first message in the second message input area; in response to detecting input of the first message in the second message input area, enable display of the first message in the second message input area; while displaying the first message in the second message input area, detect input corresponding to a request for posting content of the second message input area to the instant messaging conversation; and in response to detecting input corresponding to the request for posting content of the second message input area to the instant messaging conversation, transmit the first message to one or more electronic devices corresponding to at least one other user included in the instant messaging conversation, wherein the one or more electronic devices display the first message in the conversation transcript corresponding to the instant messaging conversation.

[0069] Thus, electronic devices with displays and touch-sensitive surfaces have improved methods and interfaces for posting messages, thereby increasing effectiveness, efficiency, and user satisfaction with such devices. Such methods and interfaces can supplement or replace conventional methods for posting messages.

[0070] There is a need for electronic devices having improved methods and interfaces for using interactive applications within instant messaging applications. Such methods and interfaces can supplement or replace conventional methods for using interactive applications within instant messaging applications. Such methods and interfaces reduce the amount, extent, and / or nature of input from a user and produce a more efficient human-computer interface.

[0071] According to some embodiments, a method is performed at an electronic device having one or more processors, a memory, a touch-sensitive surface, and a display. The method includes: displaying an instant messaging user interface of an instant messaging application on the display, the instant messaging user interface including a conversation transcript of an instant messaging conversation between a user of the electronic device and at least one other user, a message input area, and an icon of an interactive application displayed in the conversation transcript; while displaying the instant messaging user interface, detecting an input that activates the icon of the interactive application; in response to detecting the input that activates the icon of the interactive application, displaying the user interface of the interactive application in a first state; while displaying the user interface of the interactive application, detecting a first user input in the user interface of the interactive application; and in response to detecting the first user input in the user interface of the interactive application: changing the display of the user interface of the interactive application from the first state to a second state, and sending information to one or more electronic devices corresponding to at least one other user included in the instant messaging conversation, indicating that the first user input was made in the user interface of the interactive application, wherein the one or more electronic devices display a marker for the first user input.

[0072] According to some embodiments, an electronic device includes: a display unit configured to display a user interface; a touch-sensitive surface unit configured to detect contact; and a processing unit coupled to the display unit and the touch-sensitive surface unit. The processing unit is configured to: enable display of an instant messaging user interface of an instant messaging application on the display unit, the instant messaging user interface including a conversation transcript of an instant messaging conversation between a user of the electronic device and at least one other user, a message input area, and an icon of an interactive application displayed in the conversation transcript; while displaying the instant messaging user interface, detect input that activates the icon of the interactive application; in response to detecting the input that activates the icon of the interactive application, enable display of the user interface of the interactive application in a first state; while displaying the user interface of the interactive application, detect a first user input in the user interface of the interactive application; and in response to detecting the first user input in the user interface of the interactive application: change display of the user interface of the interactive application from the first state to a second state, and send information to one or more electronic devices corresponding to at least one other user included in the instant messaging conversation, indicating that the first user input was made in the user interface of the interactive application, wherein the one or more electronic devices display a mark of the first user input.

[0073] Thus, electronic devices with displays and touch-sensitive surfaces have improved methods and interfaces for using interactive applications within instant messaging applications, thereby increasing the effectiveness, efficiency, and user satisfaction of utilizing such devices. Such methods and interfaces may supplement or replace conventional methods for using interactive applications within instant messaging applications.

[0074] There is a need for electronic devices having improved methods and interfaces for using interactive applications within instant messaging applications. Such methods and interfaces can supplement or replace conventional methods for using interactive applications within instant messaging applications. Such methods and interfaces reduce the amount, extent, and / or nature of input from a user and produce a more efficient human-computer interface.

[0075] According to some embodiments, a method is performed at an electronic device having one or more processors, a memory, a touch-sensitive surface, and a display. The method includes: displaying an instant messaging user interface of an instant messaging application on the display, the instant messaging user interface including a conversation transcript of an instant messaging conversation between a user of the electronic device and at least one other user and a message input area; while displaying the instant messaging user interface, receiving an instruction from an electronic device corresponding to another user included in the instant messaging conversation to display an icon of an interactive application in the conversation transcript; in response to receiving the instruction, displaying the icon of the interactive application in the conversation transcript; while displaying the icon of the interactive application in the conversation transcript, detecting an input to activate the icon of the interactive application; and in response to detecting the input to activate the icon of the interactive application displayed in the conversation transcript: displaying the user interface of the interactive application based on determining that the interactive application corresponding to the icon of the interactive application is stored in the memory of the electronic device, and based on determining that the interactive application corresponding to the icon of the interactive application is not stored in the memory of the electronic device: downloading the interactive application from a remote server to the memory of the electronic device, and after downloading the interactive application from the remote server, displaying the user interface of the interactive application.

[0076] According to some embodiments, the electronic device includes: a display unit configured to display a user interface; a touch-sensitive surface unit configured to detect contact; and a processing unit coupled to the display unit and the touch-sensitive surface unit. The processing unit is configured to: enable display of an instant messaging user interface of an instant messaging application on a display unit, the instant messaging user interface including a conversation transcript of an instant messaging conversation between a user of the electronic device and at least one other user and a message input area; when displaying the instant messaging user interface, receive an instruction for displaying an icon of an interactive application in the conversation transcript from an electronic device corresponding to another user included in the instant messaging conversation; in response to receiving the instruction, enable display of the icon of the interactive application in the conversation transcript; when displaying the icon of the interactive application in the conversation transcript, detect input for activating the icon of the interactive application; and in response to detecting the input for activating the icon of the interactive application displayed in the conversation transcript: enable display of the user interface of the interactive application based on determining that the interactive application corresponding to the icon of the interactive application is stored in the memory of the electronic device, and based on determining that the interactive application corresponding to the icon of the interactive application is not stored in the memory of the electronic device: download the interactive application from a remote server to the memory of the electronic device, and after downloading the interactive application from the remote server, enable display of the user interface of the interactive application.

[0077] Thus, electronic devices with displays and touch-sensitive surfaces have improved methods and interfaces for using interactive applications within instant messaging applications, thereby increasing the effectiveness, efficiency, and user satisfaction of utilizing such devices. Such methods and interfaces may supplement or replace conventional methods for using interactive applications within instant messaging applications.

[0078] There is a need for electronic devices having improved methods and interfaces for using interactive applications within instant messaging applications. Such methods and interfaces can supplement or replace conventional methods for using interactive applications within instant messaging applications. Such methods and interfaces reduce the amount, extent, and / or nature of input from a user and produce a more efficient human-computer interface.

[0079] According to some embodiments, a method is performed at an electronic device having a display and a touch-sensitive surface. The method includes: displaying an instant messaging user interface of an instant messaging application on the display, the instant messaging user interface including: a conversation transcript of an instant messaging conversation between a user of the electronic device and at least one other user displayed in a first area of ​​the display, a first interactive application object corresponding to a first interactive application displayed in the conversation transcript, a message input area, and an input area of ​​the first interactive application displayed in a second area of ​​the display that is different from the message input area, the input area of ​​the first interactive application including one or more input enable representations; and detecting an input that activates the first input enable representation in the input area of ​​the interactive application.

[0080] According to some embodiments, the electronic device includes a display unit and a touch-sensitive surface unit, and a processing unit coupled to the display unit and the touch-sensitive surface unit. The processing unit is configured to: enable display of an instant messaging user interface of an instant messaging application on the display unit, the instant messaging user interface including: a conversation transcript of an instant messaging conversation between a user of the electronic device and at least one other user displayed in a first area of ​​the display, a first interactive application object corresponding to a first interactive application displayed in the conversation transcript, a message input area, and an input area of ​​the first interactive application different from the message input area displayed in a second area of ​​the display, the input area of ​​the first interactive application including one or more input enable indications; and detect input of the first input enable indication in the input area that activates the interactive application.

[0081] Thus, electronic devices with displays and touch-sensitive surfaces have improved methods and interfaces for using interactive applications within instant messaging applications, thereby increasing the effectiveness, efficiency, and user satisfaction of utilizing such devices. Such methods and interfaces may supplement or replace conventional methods for using interactive applications within instant messaging applications.

[0082] There is a need for electronic devices having improved methods and interfaces for using interactive applications within instant messaging applications. Such methods and interfaces can supplement or replace conventional methods for using interactive applications within instant messaging applications. Such methods and interfaces reduce the amount, extent, and / or nature of input from a user and produce a more efficient human-computer interface.

[0083] According to some embodiments, a method is performed at an electronic device having a display and a touch-sensitive surface. The method includes: displaying an instant messaging user interface of an instant messaging application on the display, the instant messaging user interface including: a conversation transcript of an instant messaging conversation between a user of the electronic device and at least one other user, a first interactive application object corresponding to a first interactive application displayed in the conversation transcript, and a message input area. The method also includes: detecting a first input when a focus selector is at a position on the touch-sensitive surface corresponding to the first interactive application object displayed in the conversation transcript; in response to detecting the first input, displaying an input area of ​​a first interactive application different from the message input area, the input area of ​​the first interactive application including one or more input enable representations; while displaying the input area of ​​the first interactive application, detecting one or more inputs on the one or more input enable representations; after detecting the one or more inputs on the one or more input enable representations: updating the first interactive application; sending information to one or more electronic devices corresponding to at least one other user included in the instant messaging conversation so as to update the corresponding user interface of the first interactive application displayed in the corresponding conversation transcript of the instant messaging conversation; and stopping displaying the input area of ​​the first interactive application.

[0084] According to some embodiments, an electronic device includes a display unit and a touch-sensitive surface unit, and a processing unit coupled to the display unit and the touch-sensitive surface unit. The processing unit is configured to enable display of an instant messaging user interface of an instant messaging application on the display unit, the instant messaging user interface including: a conversation transcript of an instant messaging conversation between a user of the electronic device and at least one other user, a first interactive application object corresponding to a first interactive application displayed in the conversation transcript, and a message input area. The processing unit is further configured to: detect a first input when the focus selector is at a position on the touch-sensitive surface unit corresponding to a first interactive application object displayed in the conversation transcript; in response to detecting the first input, enable display of an input area of ​​a first interactive application that is different from the message input area, the input area of ​​the first interactive application including one or more input enable representations; while displaying the input area of ​​the first interactive application, detect one or more inputs on the one or more input enable representations; after detecting one or more inputs on the one or more input enable representations: update the first interactive application; send information to one or more electronic devices corresponding to at least one other user included in the instant messaging session, so as to update the corresponding user interface of the first interactive application displayed in the corresponding conversation transcript of the instant messaging session; and stop displaying the input area of ​​the first interactive application.

[0085] Thus, electronic devices with displays and touch-sensitive surfaces have improved methods and interfaces for using interactive applications within instant messaging applications, thereby increasing the effectiveness, efficiency, and user satisfaction of utilizing such devices. Such methods and interfaces may supplement or replace conventional methods for using interactive applications within instant messaging applications.

[0086] There is a need for electronic devices with improved methods and interfaces for enabling the use of interactive applications within instant messaging applications. Such methods and interfaces can supplement or replace conventional methods for enabling the use of interactive applications within instant messaging applications. Such methods and interfaces reduce the amount, extent, and / or nature of input from the user and produce a more efficient human-computer interface.

[0087] According to some embodiments, a method is performed at an electronic device having a display and a touch-sensitive surface, wherein an instant messaging application and a plurality of other applications are stored in a memory, and corresponding applications in the plurality of other applications have a normal mode for operating normally on the electronic device and an embedded mode for operating in the instant messaging application on the electronic device. The method includes: displaying a plurality of toggle enable representations, wherein corresponding toggle enable representations in the plurality of toggle enable representations have corresponding applications in a plurality of other applications stored in the memory; the corresponding toggle enable representations have a first state, which enables the display of a corresponding launch icon in the instant messaging application so as to operate the corresponding application in an embedded mode in the instant messaging application; the corresponding toggle enable representations have a second state, which blocks the display of a corresponding launch icon in the instant messaging application so as to block the operation of the corresponding application in an embedded mode in the instant messaging application; the plurality of toggle enable representations include a first toggle enable representation of a first application displayed in the first state and a second toggle enable representation of a second application displayed in the second state. When displaying multiple toggle enable indications, the method also includes: detecting a first user input corresponding to a first toggle enable indication at a first position; and in response to detecting the first user input corresponding to the first toggle enable indication at the first position: changing the first toggle enable indication from a first state to a second state, and preventing the corresponding launch icon of the first application from being displayed in the instant messaging application.

[0088] According to some embodiments, the electronic device includes a display unit and a touch-sensitive surface unit, and a processing unit coupled to the display unit and the touch-sensitive surface unit, wherein an instant messaging application and multiple other applications are stored in a memory of the electronic device, and corresponding applications among the multiple other applications have a normal mode for normal operation on the electronic device and an embedded mode for operation in the instant messaging application on the electronic device. The processing unit is configured to: enable the display of multiple toggle enable representations, wherein corresponding toggle enable representations among the multiple toggle enable representations have corresponding applications among the multiple other applications stored in the memory; the corresponding toggle enable representations have a first state, which enables the display of a corresponding launch icon in the instant messaging application so as to operate the corresponding application in an embedded mode in the instant messaging application; the corresponding toggle enable representations have a second state, which blocks the display of a corresponding launch icon in the instant messaging application so as to block the operation of the corresponding application in an embedded mode in the instant messaging application; the multiple toggle enable representations include a first toggle enable representation of a first application displayed in the first state and a second toggle enable representation of a second application displayed in the second state. The processing unit is further configured to: when displaying multiple toggle enable indications, detect a first user input corresponding to a first toggle enable indication at a first position; and in response to detecting the first user input corresponding to the first toggle enable indication at the first position: change the first toggle enable indication from a first state to a second state, and prevent the corresponding launch icon of the first application from being displayed in the instant messaging application.

[0089] Thus, electronic devices with displays and touch-sensitive surfaces have improved methods and interfaces for enabling the use of interactive applications within instant messaging applications, thereby increasing the effectiveness, efficiency, and user satisfaction of utilizing such devices. Such methods and interfaces may supplement or replace conventional methods for enabling the use of interactive applications within instant messaging applications.

[0090] There is a need for electronic devices with improved methods and interfaces for navigating within instant messaging applications. Such methods and interfaces can supplement or replace conventional methods for navigating within instant messaging applications. Such methods and interfaces reduce the amount, extent, and / or nature of input from a user and produce a more efficient human-computer interface.

[0091] According to some embodiments, a method is performed at an electronic device having a display, a touch-sensitive surface, and a digital camera. The method includes: displaying an instant messaging user interface on the display, the instant messaging user interface including a conversation transcript of an instant messaging conversation between a user of the electronic device and at least one other user, a message input area, a digital image enable representation, a digital touch enable representation, and an application enable representation; while displaying the instant messaging user interface, detecting a first input on the touch-sensitive surface; in response to detecting the first input: displaying a plurality of digital images in the instant messaging user interface based on determining that the first input was made when a focus selector was at a position in the instant messaging user interface corresponding to the digital image enable representation; displaying a digital drawing canvas in the instant messaging user interface based on determining that the first input was made when the focus selector was at a position in the instant messaging user interface corresponding to the digital canvas enable representation; and displaying one or more launch icons for the application in the instant messaging user interface based on determining that the first input was made when the focus selector was at a position in the instant messaging user interface corresponding to the application enable representation.

[0092] According to some embodiments, an electronic device includes a display unit, a touch-sensitive surface unit, a digital camera unit, and a processing unit coupled to the display unit, the touch-sensitive surface unit, and the digital camera unit. The processing unit is configured to: enable display of an instant messaging user interface on the display unit, the instant messaging user interface including a transcript of an instant messaging conversation between a user of the electronic device and at least one other user, a message input area, a digital image affordance, a digital touch affordance, and an application affordance. The processing unit is further configured to: while displaying the instant messaging user interface, detect a first input on the touch-sensitive surface; in response to detecting the first input: enable display of a plurality of digital images in the instant messaging user interface based on a determination that the first input was made when a focus selector was at a position in the instant messaging user interface corresponding to the digital image affordance; enable display of a digital drawing canvas in the instant messaging user interface based on a determination that the first input was made when the focus selector was at a position in the instant messaging user interface corresponding to the digital canvas affordance; and enable display of one or more launch icons for an application in the instant messaging user interface based on a determination that the first input was made when the focus selector was at a position in the instant messaging user interface corresponding to the application affordance.

[0093] Thus, electronic devices with displays and touch-sensitive surfaces have improved methods and interfaces for navigating within instant messaging applications, thereby increasing the effectiveness, efficiency, and user satisfaction of utilizing such devices. Such methods and interfaces may supplement or replace conventional methods for navigating within instant messaging applications.

[0094] There is a need for electronic devices with improved methods and interfaces for placing electronic stickers in conversation transcripts. Such methods and interfaces can supplement or replace conventional methods for placing electronic stickers in conversation transcripts. Such methods and interfaces reduce the amount, extent, and / or nature of input from the user and produce a more efficient human-computer interface.

[0095] According to some embodiments, a method is performed at an electronic device having one or more processors, a memory, a touch-sensitive surface, and a display. The device displays an instant messaging user interface of an instant messaging application on the display, the instant messaging user interface including a transcript of an instant messaging conversation between a user of the electronic device and at least one other user, a plurality of electronic stickers, and a message input area. While displaying the instant messaging user interface, the device detects a first drag gesture that begins when a focus selector is at a first position in the instant messaging user interface corresponding to a first electronic sticker among the plurality of electronic stickers, the first drag gesture moving the focus selector in a first direction. The device moves the first electronic sticker in the first direction based on the movement of the first drag gesture. When the focus selector is at a second position in the instant messaging user interface, the device detects termination of the first drag gesture. In response to detecting termination of the first drag gesture: based on determining that the second position is in the conversation transcript, the device places the electronic sticker at a position in the conversation transcript based on the second position. Based on determining that the second position is not in the conversation transcript, the device stops displaying the electronic sticker at the second position on the display.

[0096] According to some embodiments, an electronic device includes: a display unit configured to display a user interface; a touch-sensitive surface unit configured to detect contact; and a processing unit coupled to the display unit and the touch-sensitive surface unit. The processing unit is configured to enable display of an instant messaging user interface of an instant messaging application on the display unit, the instant messaging user interface including a transcript of an instant messaging conversation between a user of the electronic device and at least one other user, a plurality of electronic stickers, and a message input area. When displaying the instant messaging user interface, the processing unit is configured to detect a first drag gesture that starts when a focus selector is at a first position in the instant messaging user interface corresponding to a first electronic sticker among the plurality of electronic stickers, the first drag gesture moving the focus selector in a first direction. The processing unit is configured to move the first electronic sticker in the first direction according to the movement of the first drag gesture. The processing unit is configured to detect termination of the first drag gesture when the focus selector is at a second position in the instant messaging user interface. In response to detecting termination of the first drag gesture: based on determining that the second position is in the conversation transcript, the processing unit is configured to place the electronic sticker at a position in the conversation transcript based on the second position, and based on determining that the second position is not in the conversation transcript, the processing unit is configured to stop displaying the electronic sticker at the second position on the display unit.

[0097] Thus, electronic devices with displays and touch-sensitive surfaces have improved methods and interfaces for placing electronic stickers in conversation transcripts, thereby increasing the effectiveness, efficiency, and user satisfaction of using such devices. Such methods and interfaces can supplement or replace conventional methods for placing electronic stickers in conversation transcripts.

[0098] There is a need for electronic devices with improved methods and interfaces for changing the characteristics of electronic stickers in a conversation transcript. Such methods and interfaces can supplement or replace conventional methods for changing the characteristics of electronic stickers in a conversation transcript of an instant messaging user interface. Such methods and interfaces reduce the amount, extent, and / or nature of input from the user and produce a more efficient human-computer interface.

[0099] According to some embodiments, a method is performed at an electronic device having one or more processors, a memory, a touch-sensitive surface, and a display. The device displays an instant messaging user interface of an instant messaging application on the display, the instant messaging user interface including a conversation transcript of an instant messaging conversation between a user of the electronic device and at least one other user, a plurality of electronic stickers, and a message input area. When the instant messaging user interface is displayed, the device detects a first user input when a focus selector is at a first position in the instant messaging user interface corresponding to a first electronic sticker among a plurality of electronic stickers. In response to detecting the first user input, the device places and displays the first electronic sticker in the conversation transcript. When the first electronic sticker is displayed in the conversation transcript: the device detects a second user input when the focus selector is at a second position in the instant messaging user interface corresponding to the first electronic sticker in the conversation transcript. In response to detecting the second user input, the device changes the position, size, and / or rotation of the first electronic sticker in the conversation transcript.

[0100] According to some embodiments, an electronic device is provided, comprising a display unit configured to display a user interface; a touch-sensitive surface unit configured to detect contact; and a processing unit coupled to the display unit and the touch-sensitive surface unit. The processing unit enables display of an instant messaging user interface of an instant messaging application on the display unit, the instant messaging user interface comprising a conversation transcript of an instant messaging conversation between a user of the electronic device and at least one other user, a plurality of electronic stickers, and a message input area. While displaying the instant messaging user interface, the processing unit detects a first user input when a focus selector is at a first position in the instant messaging user interface corresponding to a first electronic sticker among the plurality of electronic stickers. In response to detecting the first user input, the processing unit places the first electronic sticker in the conversation transcript and enables display of the first electronic sticker. While displaying the first electronic sticker in the conversation transcript, the processing unit detects a second user input when the focus selector is at a second position in the instant messaging user interface corresponding to the first electronic sticker in the conversation transcript. In response to detecting the second user input, the device changes the position, size, and / or rotation of the first electronic sticker in the conversation transcript.

[0101] Thus, electronic devices with displays and touch-sensitive surfaces have improved methods and interfaces for changing the characteristics of electronic stickers in a conversation transcript of an instant messaging user interface, thereby increasing the effectiveness, efficiency, and user satisfaction of utilizing such devices. Such methods and interfaces may supplement or replace conventional methods for changing the characteristics of electronic stickers in a conversation transcript of an instant messaging user interface.

[0102] There is a need for electronic devices with improved methods and interfaces for initiating payments through instant messaging applications. Such methods and interfaces can supplement or replace conventional methods for initiating payments through instant messaging applications. Such methods and interfaces reduce the amount, extent, and / or nature of input from the user and produce a more efficient human-computer interface.

[0103] According to some embodiments, a method is performed at an electronic device having one or more processors, a memory, a touch-sensitive surface, and a display. The device displays an instant messaging user interface of an instant messaging application on the display, the instant messaging user interface including a transcript of a conversation between a user of the electronic device and at least one other user and a message input area, wherein each of the other users included in the instant messaging conversation has a corresponding avatar. When displaying the instant messaging user interface, the device detects a first user input when a focus selector is at a first position in the instant messaging user interface corresponding to an avatar of a first other user included in the instant messaging conversation. In response to detecting the first user input, the device displays a menu including an activatable menu item associated with the first other user overlaid on the instant messaging user interface, the displayed menu including an activatable menu item for initiating a payment action with the first other user. When displaying the menu including the activatable menu item associated with the first other user, the device detects a second user input when the focus selector is at a second position in the instant messaging user interface corresponding to the activatable menu item for initiating a payment action with the first other user. In response to detecting the second user input, the device displays a user interface configured to initiate sending a payment to the first other user and / or requesting payment from the first other user.

[0104] In some embodiments, an electronic device is provided, the electronic device having a display unit configured to display a user interface; a touch-sensitive surface unit configured to detect contact; and a processing unit coupled to the display unit and the touch-sensitive surface unit. The processing unit enables display of an instant messaging user interface of an instant messaging application on the display unit, the instant messaging user interface including a conversation transcript of an instant messaging conversation between a user of the electronic device and at least one other user and a message input area, wherein each of the other users included in the instant messaging conversation has a corresponding avatar. When displaying the instant messaging user interface, the processing unit detects a first user input when a focus selector is at a first position in the instant messaging user interface corresponding to an avatar of a first other user included in the instant messaging conversation. In response to detecting the first user input, the processing unit enables display of a menu including an activatable menu item associated with the first other user overlaid on the instant messaging user interface, the displayed menu including an activatable menu item for initiating a payment action with the first other user. While displaying a menu including an activatable menu item associated with a first other user, the processing unit detects a second user input when the focus selector is at a second position in the instant messaging user interface corresponding to the activatable menu item for initiating a payment action with the first other user. In response to detecting the second user input, the processing unit enables display of a user interface configured to initiate sending a payment to the first other user and / or requesting payment from the first other user.

[0105] Thus, electronic devices with displays and touch-sensitive surfaces have improved methods and interfaces for initiating payments through instant messaging applications, thereby increasing the effectiveness, efficiency, and user satisfaction of utilizing such devices. Such methods and interfaces may supplement or replace conventional methods for initiating payments through instant messaging applications.

[0106] There is a need for electronic devices having improved methods and interfaces for selectively activating menus in instant messaging sessions. Such methods and interfaces can supplement or replace conventional methods for selectively activating menus in instant messaging sessions. Such methods and interfaces reduce the amount, extent, and / or nature of input from the user and produce a more efficient human-computer interface.

[0107] According to some embodiments, a method is performed at an electronic device having one or more processors, a memory, a touch-sensitive surface, one or more sensors for detecting intensity of contact with the touch-sensitive surface, and a display. The device displays an instant messaging user interface of an instant messaging application on the display, the instant messaging user interface including a transcript of an instant messaging conversation between a user of the electronic device and multiple other users, a message input area, and multiple avatars, each corresponding avatar in the multiple avatars corresponding to a corresponding other user in the multiple other users included in the instant messaging conversation, wherein the multiple avatars are displayed as an avatar overlay, and a first avatar in the multiple avatars is displayed on top of the avatar overlay. While displaying the instant messaging user interface, the device detects input made via a first contact on the touch-sensitive surface when a focus selector is at a first position in the instant messaging user interface corresponding to the first avatar. In response to detecting the input made via the first contact: based on determining that the input satisfies menu activation criteria, the device displays a menu including an activatable menu item associated with the first avatar overlaid on the instant messaging user interface, wherein the menu activation criteria require that a characteristic intensity of the contact on the touch-sensitive surface satisfies a corresponding intensity threshold in order to satisfy the menu activation criteria. Based on determining that the input satisfies an avatar expansion criterion, the device displays a plurality of avatars in an array, wherein the avatar expansion criterion does not require that a characteristic intensity of a contact on the touch screen satisfy a corresponding intensity threshold in order to satisfy the selection criterion.

[0108] According to some embodiments, an electronic device is provided, which includes a display unit configured to display a user interface; a touch-sensitive surface unit configured to detect contact; and a processing unit coupled to the display unit and the touch-sensitive surface unit. The processing unit enables display of an instant messaging user interface of an instant messaging application on the display unit, the instant messaging user interface including a conversation transcript of an instant messaging conversation between a user of the electronic device and multiple other users, a message input area, and multiple avatars, each corresponding avatar in the multiple avatars corresponding to a corresponding other user in the multiple other users included in the instant messaging conversation, wherein the multiple avatars are displayed as an avatar overlay, and a first avatar in the multiple avatars is displayed on top of the avatar overlay. When displaying the instant messaging user interface, the processing unit detects input made by a first contact on the touch-sensitive surface unit when the focus selector is at a first position corresponding to the first avatar in the instant messaging user interface. In response to detecting input via a first contact: based on determining that the input satisfies menu activation criteria, the processing unit enables display of a menu including an activatable menu item associated with a first avatar overlaid on the instant messaging user interface, wherein the menu activation criteria requires that a characteristic intensity of the contact on the touch-sensitive surface unit satisfies a corresponding intensity threshold in order to satisfy the menu activation criteria. Based on determining that the input satisfies avatar expansion criteria, the processing unit enables display of a plurality of avatars in an array, wherein the avatar expansion criteria does not require that a characteristic intensity of the contact on the touch screen meet the corresponding intensity threshold in order to satisfy the selection criteria.

[0109] Thus, electronic devices with displays and touch-sensitive surfaces have improved methods and interfaces for selectively activating menus in instant messaging sessions, thereby increasing the effectiveness, efficiency, and user satisfaction of utilizing such devices. Such methods and interfaces may supplement or replace conventional methods for selectively activating menus in instant messaging sessions.

[0110] There is a need for electronic devices with improved methods and interfaces for providing selectable links for words or phrases in a message to access additional content. Such methods and interfaces can supplement or replace conventional methods for providing selectable links for words or phrases in a message to access additional content. Such methods and interfaces reduce the amount, extent, and / or nature of input from the user and produce a more efficient human-computer interface.

[0111] According to some embodiments, a method is performed at an electronic device having one or more processors, a memory, a touch-sensitive surface, and a display. The device displays an instant messaging user interface of an instant messaging application on the display, the instant messaging user interface including a conversation transcript of an instant messaging conversation between a user of the electronic device and at least one other user and a message input area. While displaying the instant messaging user interface, the device receives a first message in an instant messaging conversation from an electronic device corresponding to another user included in the instant messaging conversation. In response to receiving the first message, the device displays the first message in a first message area of ​​the conversation transcript on the display. The device detects a word or phrase associated with additional content available on the Internet in the first message; and in response to detecting the word or phrase associated with additional content available on the Internet, the device displays an optional indication that additional content associated with the word or phrase is available adjacent to the first message area.

[0112] In some embodiments, an electronic device is provided, comprising a display unit configured to display a user interface; a touch-sensitive surface unit configured to detect contact; and a processing unit coupled to the display unit and the touch-sensitive surface unit. The processing unit enables display of an instant messaging user interface of an instant messaging application on the display unit, the instant messaging user interface including a conversation transcript of an instant messaging conversation between a user of the electronic device and at least one other user and a message input area. While displaying the instant messaging user interface, the processing unit receives a first message in the instant messaging conversation from an electronic device corresponding to another user included in the instant messaging conversation. In response to receiving the first message, the processing unit enables display of the first message in a first message area of ​​the conversation transcript on the display unit. The processing unit detects a word or phrase associated with additional content available on the Internet in the first message. In response to detecting the word or phrase associated with additional content available on the Internet, the processing unit enables display of an optional indication of the availability of additional content associated with the word or phrase adjacent to the first message area.

[0113] Thus, electronic devices with displays and touch-sensitive surfaces have improved methods and interfaces for providing selectable links to access additional content for words or phrases in messages, thereby increasing the effectiveness, efficiency, and user satisfaction of utilizing such devices. Such methods and interfaces can supplement or replace conventional methods for providing selectable links to access additional content for words or phrases in messages.

[0114] There is a need for electronic devices with improved methods and interfaces for navigating between applications in an instant messaging user interface. Such methods and interfaces can supplement or replace conventional methods for navigating between applications in an instant messaging user interface. Such methods and interfaces reduce the amount, extent, and / or nature of input from a user and produce a more efficient human-computer interface.

[0115] According to some embodiments, a method is performed at an electronic device having a display and a touch-sensitive surface. The method includes: displaying an instant messaging user interface on the display, the instant messaging user interface including: a transcript of an instant messaging conversation between a user of the electronic device and at least one other user; a message input area; an application area; and an application area display enable representation; while displaying the instant messaging user interface, detecting a first input that activates the application area display enable representation; in response to detecting the first input that activates the application area display enable representation, based on determining that the application area is displaying a keyboard when the first input is detected, replacing the display of the keyboard in the application area by simultaneously displaying: an application selection area displaying a plurality of scrollable application selection enable representations, wherein: the plurality of scrollable application selection enable representations include a first application selection enable representation corresponding to a currently selected first application; and the corresponding application selection enable representation has a corresponding first size; and displaying a first application selection enable representation. an application input area for one or more activatable objects of an application; while the application selection area and the application input area are displayed simultaneously, detecting a second input comprising movement of contact on the touch-sensitive surface corresponding to movement of the focus selector in the application selection area on the display along a first direction; in response to detecting the second input: scrolling the multiple application selection enable representations along the first direction and displaying a second application selection enable representation; while displaying the second application selection enable representation and one or more activatable objects of the first application in the instant messaging user interface, detecting a third input that activates the second application selection enable representation; and in response to detecting the third input that activates the second application selection enable representation: ceasing to display the one or more activatable objects of the first application; and displaying one or more activatable objects of the second application corresponding to the second application selection enable representation in the application input area.

[0116] Thus, electronic devices with displays and touch-sensitive surfaces have improved methods and interfaces for navigating between applications in an instant messaging user interface, thereby increasing the effectiveness, efficiency, and user satisfaction of utilizing such devices. Such methods and interfaces may supplement or replace conventional methods for navigating between applications in an instant messaging user interface.

[0117] There is a need for electronic devices having improved methods and interfaces for managing applications used in instant messaging applications. Such methods and interfaces can supplement or replace conventional methods for managing applications used in instant messaging applications. Such methods and interfaces reduce the amount, extent, and / or nature of input from a user and produce a more efficient human-computer interface.

[0118] According to some embodiments, a method is performed on a device having a display and a touch-sensitive surface. The method includes: displaying an instant messaging user interface of an instant messaging application on the display, the instant messaging user interface including: a transcript of an instant messaging conversation between a user of the electronic device and at least one other user; a message input area; and an application area including: an application input area displaying one or more activatable objects of a first application; and an application selection area including: a plurality of scrollable application selection enable representations corresponding to a plurality of applications operating in the instant messaging user interface, and a first application configuration enable representation; when the application configuration enable representation is displayed in the application selection area, detecting a first input that activates the first application configuration enable representation; in response to detecting the first input, displaying a first application management interface of the instant messaging application, the first application management interface including: a plurality of installed application enable representations corresponding to a plurality of applications operating in the instant messaging user interface of the instant messaging application, and a plurality of installed application enable representations different from the first application configuration enable representation. a second application configuration enable representation for setting an enable representation; when displaying the first application management interface, detecting a second input at a position corresponding to a first installed application enable representation among the multiple installed application enable representations, wherein the first installed application enable representation corresponds to a first installed application on the electronic device; and in response to detecting the second input, starting a process for uninstalling at least one component of the first installed application on the mobile device; when displaying the first application management interface, detecting a third input at a position corresponding to the second application configuration enable representation; and in response to detecting the third input, displaying a second application management interface for the instant messaging application, the second application management interface including: a plurality of back and forth switches corresponding to a plurality of applications operated in the instant messaging user interface of the instant messaging application, wherein activation of the corresponding back and forth switches causes the corresponding application in the instant messaging user interface of the instant messaging application to switch back and forth between a hidden state and a visible state.

[0119] Thus, electronic devices with displays and touch-sensitive surfaces have improved methods and interfaces for managing applications used in instant messaging applications, thereby increasing the effectiveness, efficiency, and user satisfaction of utilizing such devices. Such methods and interfaces may supplement or replace conventional methods for managing applications used in instant messaging applications.

[0120] There is a need for electronic devices with improved methods and interfaces for translating message content in instant messaging applications. Such methods and interfaces can supplement or replace conventional methods for translating message content in instant messaging applications. Such methods and interfaces reduce the amount, extent, and / or nature of input from the user and produce a more efficient human-computer interface.

[0121] According to some embodiments, a method is performed on a device having a display and one or more input devices. The method includes: displaying an instant messaging user interface on the display, the instant messaging user interface including a conversation transcript of an instant messaging conversation between a user of the electronic device and at least one other user; receiving a first message in the instant messaging conversation from an electronic device corresponding to another user included in the instant messaging conversation, wherein the first message includes foreign language text; in response to receiving the first message, displaying the first message in the conversation transcript; detecting a first input at a first location corresponding to the foreign language text in the first message; in response to detecting the first input at the first location corresponding to the foreign language text: displaying a translation of the foreign language text based on determining that the first input meets translation criteria; and displaying a plurality of activatable markers based on determining that the first input meets option display criteria.

[0122] According to some embodiments, a method is performed on a device having a display and one or more input devices. The method includes: displaying an instant messaging user interface on the display, the instant messaging user interface including a conversation transcript of an instant messaging conversation between a user of the electronic device and at least one other user; receiving a first message in the instant messaging conversation from an electronic device corresponding to another user included in the instant messaging conversation, wherein the first message includes foreign language text; in response to receiving the first message, displaying the first message in the conversation transcript; detecting a first input at a location corresponding to the foreign language text in the first message; in response to detecting the first input at the location corresponding to the foreign language text: performing a foreign language text translation action based on determining that the first input meets a translation criterion; and abandoning the foreign language text translation action based on determining that the first input does not meet the translation criterion.

[0123] Thus, electronic devices with displays and touch-sensitive surfaces have improved methods and interfaces for translating message content in instant messaging applications, thereby increasing the effectiveness, efficiency, and user satisfaction of utilizing such devices. Such methods and interfaces may supplement or replace conventional methods for translating message content in instant messaging applications.

[0124] According to some embodiments, an electronic device includes a display, a touch-sensitive surface, optionally one or more sensors for detecting the intensity of contact with the touch-sensitive surface, one or more processors, a memory, and one or more programs; the one or more programs are stored in the memory and configured to be executed by the one or more processors, and the one or more programs include instructions for performing or causing the execution of the operations of any of the methods described herein. According to some embodiments, a computer-readable storage medium has instructions stored therein that, when executed by an electronic device having a display, a touch-sensitive surface, and optionally one or more sensors for detecting the intensity of contact with the touch-sensitive surface, causes the device to perform or cause the execution of the operations of any of the methods described herein. According to some embodiments, a graphical user interface at an electronic device having a display, a touch-sensitive surface, optionally one or more sensors for detecting the intensity of contact with the touch-sensitive surface, a memory, and one or more processors for executing the one or more programs stored in the memory includes one or more elements displayed in response to input in any of the methods described herein, as described in any of the methods described herein. According to some embodiments, an electronic device includes: a display, a touch-sensitive surface, and optionally one or more sensors for detecting the intensity of contact with the touch-sensitive surface; and means for performing or causing the execution of the operations of any of the methods described herein. According to some embodiments, an information processing device in an electronic device having a display, a touch-sensitive surface, and optionally one or more sensors for detecting the intensity of contact with the touch-sensitive surface includes a device for performing or causing the performance of the operations of any of the methods described herein.

[0125] Thus, electronic devices having a display, a touch-sensitive surface, and optionally one or more sensors for detecting intensity of contact with the touch-sensitive surface have faster, more efficient methods and interfaces for messaging, thereby increasing the effectiveness, efficiency, and user satisfaction of using such devices. Such methods and interfaces can supplement or replace conventional methods for messaging. BRIEF DESCRIPTION OF THE DRAWINGS

[0126] For a better understanding of the various described embodiments, reference should be made to the following detailed description taken in conjunction with the following drawings, wherein like reference numerals designate corresponding parts throughout the several views.

[0127] Figure 1A is a block diagram illustrating a portable multifunction device with a touch-sensitive display in accordance with some embodiments.

[0128] Figure 1B is a block diagram illustrating example components for event processing according to some embodiments.

[0129] Figure 2 A portable multifunction device with a touch screen according to some embodiments is shown.

[0130] Figure 3 is a block diagram of an exemplary multifunction device with a display and a touch-sensitive surface according to some embodiments.

[0131] Figure 4A An exemplary user interface for an application menu on a portable multifunction device according to some embodiments is shown.

[0132] Figure 4B An exemplary user interface for a multifunction device having a touch-sensitive surface separate from the display is shown according to some embodiments.

[0133] Figures 4C to 4E An example of a dynamic intensity threshold according to some embodiments is shown.

[0134] Figures 5A to 5K An exemplary user interface for displaying a message transcript and message confirmation is shown.

[0135] Figures 5L to 5T An exemplary user interface for editing a previously sent message while displaying a message transcript is shown.

[0136] Figures 5U to 5BF An exemplary user interface for applying a shock effect option to a message input or message area is shown.

[0137] Figures 5BG to 5CA An exemplary user interface for interacting with hidden messages is shown.

[0138] Figure 5CB to Figure 5CW An exemplary user interface is shown for triggering enhanced message content and applying effects to an instant messaging user interface when the message includes an enhanced message content trigger.

[0139] Figures 5CX to 5DC An exemplary user interface for detecting and responding to composable content in a single message is shown.

[0140] Figures 5DD to 5DI An exemplary user interface for selecting a message area type or shape is shown.

[0141] Figure 5DI to Figure 5DQ An exemplary user interface for automatically displaying and selecting suggested emoticons when composing a message is shown.

[0142] Figures 6A to 6E is a flowchart of a process for applying confirmation to a message area in a conversation transcript according to some embodiments.

[0143] Figure 7 is a functional block diagram of an electronic device according to some embodiments.

[0144] Figures 8A to 8C is a flowchart of a process for editing a previously sent message in an instant messaging conversation according to some embodiments.

[0145] Figure 9 is a functional block diagram of an electronic device according to some embodiments.

[0146] FIG. 10A to FIG. 10B is a flowchart of a process for editing a previously sent message in an instant messaging conversation according to some embodiments.

[0147] Figure 11 is a functional block diagram of an electronic device according to some embodiments.

[0148] 12A to 12E is a flowchart of a process for applying a shock effect option to a message input according to some embodiments.

[0149] Figure 13 is a functional block diagram of an electronic device according to some embodiments.

[0150] FIG. 14A to FIG. 14B is a flowchart of a process for interacting with hidden messages according to some embodiments.

[0151] Figure 15 is a functional block diagram of an electronic device according to some embodiments.

[0152] 16A to 16C is a flowchart of a process for applying effects to an instant messaging user interface when the message includes an enhanced message content trigger according to some embodiments.

[0153] Figure 17 is a functional block diagram of an electronic device according to some embodiments.

[0154] 18A to 18C is a flowchart of a process for detecting composable content in an instant messaging user interface and displaying content corresponding to a predetermined combination when the composable content is detected, according to some embodiments.

[0155] Figure 19 is a functional block diagram of an electronic device according to some embodiments.

[0156] Figures 20A to 20P An exemplary user interface for presenting synchronized media content (e.g., audio content and / or video content) in an instant messaging application is shown according to some embodiments.

[0157] Figures 21A to 21C is a flowchart illustrating a method for presenting synchronized media content in an instant messaging application according to some embodiments.

[0158] Figure 22 is a functional block diagram of an electronic device according to some embodiments.

[0159] Figures 23A to 23AE An exemplary user interface for providing and presenting user-specific handwriting input in an instant messaging application is shown according to some embodiments.

[0160] Figures 24A to 24C is a flowchart illustrating a method for providing and presenting user-specific handwriting input in an instant messaging application according to some embodiments.

[0161] Figure 25 is a functional block diagram of an electronic device according to some embodiments.

[0162] Figures 26A to 26B is a flowchart illustrating a method for providing and presenting user-specific handwriting input in an instant messaging application according to some embodiments.

[0163] Figure 27 is a functional block diagram of an electronic device according to some embodiments.

[0164] FIG. 28A to FIG. 28B is a flowchart illustrating a method for providing and presenting user-specific handwriting input in an instant messaging application according to some embodiments.

[0165] Figures 28C to 28H A table is shown including an example of a rendering pipeline according to some embodiments.

[0166] Figure 29 is a functional block diagram of an electronic device according to some embodiments.

[0167] Figures 30A to 30G An exemplary user interface for quickly locating different types of content in an instant messaging application is shown according to some embodiments.

[0168] Figures 31A to 31B is a flowchart illustrating a method for quickly locating different types of content in an instant messaging application according to some embodiments.

[0169] Figure 32 is a functional block diagram of an electronic device according to some embodiments.

[0170] Figures 33A to 33B is a flowchart illustrating a method for quickly locating different types of content in an instant messaging application according to some embodiments.

[0171] Figure 34 is a functional block diagram of an electronic device according to some embodiments.

[0172] Figures 35A to 35AP An exemplary user interface for integrating a digital camera into an instant messaging application is shown according to some embodiments.

[0173] Figures 36A to 36AL An exemplary user interface for integrating search functionality and publishing rich content in an instant messaging application is shown according to some embodiments.

[0174] Figures 37A to 37DJ An exemplary user interface for integrating an interactive application within an instant messaging application is shown according to some embodiments.

[0175] Figures 38A to 38AZ An exemplary user interface for integrating an application within an instant messaging application is shown according to some embodiments.

[0176] Figures 39A to 39AW An exemplary user interface for integrating electronic stickers in an instant messaging application is shown according to some embodiments.

[0177] Figures 40A to 40W An exemplary user interface for interacting with other users of an instant message transcript via an avatar is shown according to some embodiments.

[0178] Figures 41A to 41H An exemplary user interface for integrating a data detector into an instant messaging application is shown according to some embodiments.

[0179] Figures 42A to 42D is a flow chart illustrating a method of capturing and posting a digital image in an instant messaging application according to some embodiments.

[0180] Figure 43 is a functional block diagram of an electronic device according to some embodiments.

[0181] Figures 44A to 44D is a flow chart illustrating a method of searching for and sharing multimedia content in an instant messaging application according to some embodiments.

[0182] Figure 45 is a functional block diagram of an electronic device according to some embodiments.

[0183] Figures 46A to 46C is a flowchart illustrating method 4600 of adding an interactive application to an instant messaging application according to some embodiments.

[0184] Figure 47is a functional block diagram of an electronic device according to some embodiments.

[0185] Figures 48A to 48D is a flowchart illustrating a method for posting a message to an instant messaging conversation from a user interface other than the user interface of an instant messaging application according to some embodiments.

[0186] Figure 49 is a functional block diagram of an electronic device according to some embodiments.

[0187] Figures 50A to 50C is a flowchart illustrating a method for using an interactive application in an instant messaging application according to some embodiments.

[0188] Figure 51 is a functional block diagram of an electronic device according to some embodiments.

[0189] Figures 52A to 52C is a flowchart illustrating a method for using an interactive application in an instant messaging application according to some embodiments.

[0190] Figure 53 is a functional block diagram of an electronic device according to some embodiments.

[0191] Figures 54A to 54C is a flowchart illustrating a method for using an interactive application in an instant messaging application according to some embodiments.

[0192] Figure 55 is a functional block diagram of an electronic device according to some embodiments.

[0193] Figures 56A to 56B is a flowchart illustrating a method for using an interactive application in an instant messaging application according to some embodiments.

[0194] Figure 57 is a functional block diagram of an electronic device according to some embodiments.

[0195] Figure 58 is a flowchart illustrating a method for enabling the use of interactive applications in an instant messaging application according to some embodiments.

[0196] Figure 59 is a functional block diagram of an electronic device according to some embodiments.

[0197] Figures 60A to 60D is a flowchart illustrating a method of navigating in an instant messaging application with related applications according to some embodiments.

[0198] Figure 61 is a functional block diagram of an electronic device according to some embodiments.

[0199] Figures 62A to 62C is a flow chart illustrating a method for adding stickers to an instant message transcript according to some embodiments.

[0200] Figure 63 is a functional block diagram of an electronic device according to some embodiments.

[0201] Figures 64A to 64C is a flowchart illustrating method 6400 for modifying the display of an electronic sticker in an instant messaging application according to some embodiments.

[0202] Figure 65 is a functional block diagram of an electronic device according to some embodiments.

[0203] Figure 66 is a flow chart illustrating a method of making payments from an instant messaging application according to some embodiments.

[0204] Figure 67 is a functional block diagram of an electronic device according to some embodiments.

[0205] Figures 68A to 68B is a flowchart illustrating method 6800 of interacting with a single user included in a group instant messaging conversation according to some embodiments.

[0206] Figure 69 is a functional block diagram of an electronic device according to some embodiments.

[0207] Figures 70A to 70B is a flowchart illustrating method 7000 of displaying additional information in an instant messaging conversation according to some embodiments.

[0208] Figure 71 is a functional block diagram of an electronic device according to some embodiments.

[0209] Figures 72A to 72R An exemplary user interface is shown for navigating between applications using an application user interface displayed in an instant messaging user interface according to some embodiments.

[0210] Figures 72S to 72AO An exemplary user interface for managing applications used in an instant messaging application is shown according to some embodiments.

[0211] Figure 72AP to Figure 72DI An exemplary user interface for translating message content in an instant messaging application is shown according to some embodiments.

[0212] Figure 72DJ to Figure 72EV An exemplary user interface for connecting message bubbles in an instant messaging application is shown according to some embodiments.

[0213] Figures 72EW to 72FM An exemplary user interface for labeling a message bubble is shown according to some embodiments.

[0214] Figures 73A to 73D is a flowchart illustrating a method for navigating between applications using an application user interface displayed in an instant messaging user interface according to some embodiments.

[0215] Figures 74A to 74D is a flowchart illustrating a method for managing applications used in an instant messaging application according to some embodiments.

[0216] Figures 75A to 75D is a flowchart illustrating a method for translating message content in an instant messaging application according to some embodiments.

[0217] Figures 76A to 76C is a flowchart illustrating a method for translating message content in an instant messaging application according to some embodiments. DETAILED DESCRIPTION

[0218] The methods, devices, and GUIs described herein improve messaging in a variety of ways. For example, they make it easier to: confirm messages; edit previously sent messages; express what a user is trying to convey; display private messages; synchronize content between users; incorporate handwriting input; quickly locate content in a message transcript; integrate with a camera; integrate search and sharing; integrate with interactive applications; integrate with stickers; make payments; interact with avatars; provide suggestions; navigate within interactive applications; manage interactive applications; translate foreign language text; group messages; and tag messages.

[0219] Exemplary devices

[0220] Reference will now be made in detail to the embodiments, examples of which are illustrated in the accompanying drawings. In the following detailed description, numerous specific details are set forth in order to provide a thorough understanding of the various described embodiments. However, it will be apparent to one of ordinary skill in the art that the various described embodiments may be practiced without these specific details. In other cases, well-known methods, processes, components, circuits, and networks have not been described in detail so as not to unnecessarily obscure various aspects of the embodiments.

[0221] It will also be understood that, although in some cases, the terms "first," "second," etc., are used herein to describe various elements, these elements should not be limited by these terms. These terms are simply used to distinguish one element from another. For example, a first contact can be named a second contact, and similarly, a second contact can be named a first contact without departing from the scope of the various described embodiments. Both the first contact and the second contact are contacts, but they are not the same contact unless the context clearly indicates otherwise.

[0222] The terms used in the description of the various embodiments described herein are only for the purpose of describing specific embodiments and are not intended to be limiting. As used in the description of the various embodiments described and in the appended claims, the singular forms "a", "an" and "the" are intended to also include the plural forms, unless the context clearly indicates otherwise. It will also be understood that the terms "and / or" used herein refer to and encompass any and all possible combinations of one or more items in the items listed in association. It will also be understood that the terms "includes", "including", "comprises" and / or "comprising" when used in this specification specify the presence of stated features, integers, steps, operations, elements and / or parts, but do not exclude the presence or addition of one or more other features, integers, steps, operations, elements, parts and / or their groupings.

[0223] As used herein, the term "if" is optionally interpreted to mean "when" or "upon," or "in response to determining," or "in response to detecting," depending on the context. Similarly, the phrases "if it is determined that" or "if [a stated condition or event] is detected" are optionally interpreted to mean "upon determining that" or "in response to determining that" or "upon detecting [a stated condition or event]" or "in response to detecting [a stated condition or event]," depending on the context.

[0224] Embodiments of electronic devices, user interfaces for such devices, and processes associated with using such devices are described herein. In some embodiments, the device is a portable communication device, such as a mobile phone, that also includes other functions, such as a PDA and / or music player functions. Exemplary embodiments of portable multifunction devices include, but are not limited to, the Apple Watch from Apple Inc. (Cupertino, California). iPod and Device. Other portable electronic devices, such as laptops or tablets with touch-sensitive surfaces (e.g., touch screen displays and / or touch pads), are optionally used. It should also be understood that in some embodiments, the device is not a portable communication device, but rather a desktop computer with a touch-sensitive surface (e.g., touch screen displays and / or touch pads).

[0225] In the following discussion, an electronic device including a display and a touch-sensitive surface is described. However, it should be understood that the electronic device optionally includes one or more other physical user interface devices, such as a physical keyboard, mouse, and / or joystick.

[0226] In addition to the instant messaging application, the device typically supports a variety of other applications, such as one or more of the following: a note-making application, a drawing application, a rendering application, a word processing application, a website creation application, a disk editing application, a spreadsheet application, a gaming application, a phone application, a video conferencing application, an email application, a fitness support application, a photo management application, a digital camera application, a digital camcorder application, a web browsing application, a digital music player application, and / or a digital video player application.

[0227] Various applications executed on the device optionally use at least one common physical user interface device, such as a touch-sensitive surface. One or more functions of the touch-sensitive surface and corresponding information displayed on the device are optionally adjusted and / or varied for different applications and / or adjusted and / or varied within the respective applications. In this way, the common physical architecture of the device (e.g., the touch-sensitive surface) optionally supports a variety of applications with a user interface that is intuitive and clear to the user.

[0228] Attention is now turned to embodiments of portable devices having touch-sensitive displays. Figure 1A1 is a block diagram illustrating a portable multifunction device 100 with a touch-sensitive display system 112 according to some embodiments. The touch-sensitive display system 112 is sometimes referred to as a "touch screen" for convenience, and sometimes simply as a touch-sensitive display. The device 100 includes memory 102 (which optionally includes one or more computer-readable storage media), a memory controller 122, one or more processing units (CPUs) 120, a peripheral device interface 118, RF circuitry 108, audio circuitry 110, a speaker 111, a microphone 113, an input / output (I / O) subsystem 106, other input or control devices 116, and external ports 124. The device 100 optionally includes one or more optical sensors 164. The device 100 optionally includes one or more intensity sensors 165 for detecting intensity of contacts on the device 100 (e.g., a touch-sensitive surface, such as the touch-sensitive display system 112 of the device 100). Device 100 optionally includes one or more tactile output generators 167 for generating tactile output on device 100 (e.g., generating tactile output on a touch-sensitive surface such as touch-sensitive display system 112 of device 100 or trackpad 355 of device 300). These components optionally communicate via one or more communication buses or signal lines 103.

[0229] As used in this specification and claims, the term "tactile output" refers to a physical displacement of a device relative to a previous position of the device, a physical displacement of a component of a device (e.g., a touch-sensitive surface) relative to another component of the device (e.g., a housing), or a displacement of a component relative to the center of mass of the device that will be detected by a user using the user's sense of touch. For example, when a device or a component of the device is in contact with a touch-sensitive surface of a user (e.g., a finger, palm, or other part of the user's hand), the tactile output generated by the physical displacement will be interpreted by the user as a tactile sensation that corresponds to a perceived change in a physical characteristic of the device or component of the device. For example, movement of a touch-sensitive surface (e.g., a touch-sensitive display or trackpad) is optionally interpreted by the user as a "press click" or "release click" on a physical actuation button. In some cases, the user will feel a tactile sensation, such as a "press click" or "release click," even when the physical actuation button associated with the touch-sensitive surface that was physically pressed (e.g., displaced) by the user's movement does not move. As another example, even when the smoothness of the touch-sensitive surface does not change, movement of the touch-sensitive surface may optionally be interpreted or sensed by the user as "roughness" of the touch-sensitive surface. Although such interpretation of touch by the user will be limited by the user's individualized sensory perception, there are many sensory perceptions of touch that are common to most users. Therefore, when a tactile output is described as corresponding to a specific sensory perception of a user (e.g., "release click," "press click," "roughness"), unless otherwise stated, the tactile output generated corresponds to a physical displacement of the device or a component thereof that would generate the described sensory perception for a typical (or average) user. Providing tactile feedback to the user using tactile output enhances the operability of the device and makes the user-device interface more efficient (e.g., by helping the user provide appropriate input and reducing user errors when operating / interacting with the device), thereby further reducing power usage and extending the battery life of the device by enabling the user to use the device more quickly and efficiently.

[0230] It should be understood that device 100 is only one example of a portable multifunction device and that device 100 optionally has more or fewer components than shown, optionally combines two or more components, or optionally has a different configuration or arrangement of the components. Figure 1A The various components shown are implemented in hardware, software, firmware, or any combination thereof, including one or more signal processing circuits and / or application specific integrated circuits.

[0231] Memory 102 optionally includes high-speed random access memory and optionally includes non-volatile memory, such as one or more disk storage devices, flash memory devices, or other non-volatile solid-state memory devices. Access to memory 102 by other components of device 100 (e.g., one or more CPUs 120 and peripheral device interface 118) is optionally controlled by a memory controller 122.

[0232] The peripherals interface 118 may be used to couple the device's input and output peripherals to the one or more CPUs 120 and memory 102. The one or more processors 120 run or execute various software programs and / or instruction sets stored in memory 102 to perform various functions of the device 100 and process data.

[0233] In some embodiments, peripherals interface 118, one or more CPUs 120, and memory controller 122 are optionally implemented on a single chip, such as chip 104. In some other embodiments, they are optionally implemented on separate chips.

[0234] RF (radio frequency) circuitry 108 receives and transmits RF signals, also known as electromagnetic signals. RF circuitry 108 converts electrical signals into / from electromagnetic signals and communicates with a communication network and other communication devices via the electromagnetic signals. RF circuitry 108 optionally includes well-known circuitry for performing these functions, including but not limited to an antenna system, an RF transceiver, one or more amplifiers, a tuner, one or more oscillators, a digital signal processor, a codec chipset, a subscriber identity module (SIM) card, memory, and the like. RF circuitry 108 optionally communicates with a network and other devices via wireless communications, such as the Internet (also known as the World Wide Web (WWW)), an intranet, and / or a wireless network (e.g., a cellular telephone network, a wireless local area network (LAN), and / or a metropolitan area network (MAN)). The wireless communication optionally uses any of a variety of communication standards, protocols, and technologies, including, but not limited to, Global System for Mobile Communications (GSM), Enhanced Data GSM Environment (EDGE), High Speed ​​Downlink Packet Access (HSDPA), High Speed ​​Uplink Packet Access (HSUPA), Evolution-Data Only (EV-DO), HSPA, HSPA+, Dual Cell HSPA (DC-HSPDA), Long Term Evolution (LTE), Near Field Communication (NFC), Wideband Code Division Multiple Access (W-CDMA), Code Division Multiple Access (CDMA), Time Division Multiple Access (TDMA), Bluetooth, Wireless Fidelity (Wi-Fi) (e.g., IEEE 802.11a, IEEE 802.11ac, IEEE 802.11ax, IEEE 802.11b, IEEE 802.11g, and / or IEEE 802.11n), Voice over Internet Protocol (VoIP), Wi-Fi. MAX, email protocols (e.g., Internet Message Access Protocol (IMAP) and / or Post Office Protocol (POP)), instant messaging (e.g., Extensible Messaging and Presence Protocol (XMPP), Session Initiation Protocol for Instant Messaging and Presence Utilizing Extensions (SIMPLE), Instant Messaging and Presence Service (IMPS), and / or Short Message Service (SMS)), or any other suitable communication protocol, including communication protocols that have not yet been developed on the date of filing of this document.

[0235] The audio circuit 110, speaker 111, and microphone 113 provide an audio interface between the user and the device 100. The audio circuit 110 receives audio data from the peripheral device interface 118, converts the audio data into electrical signals, and transmits the electrical signals to the speaker 111. The speaker 111 converts the electrical signals into sound waves audible to humans. The audio circuit 110 also receives electrical signals converted from sound waves by the microphone 113. The audio circuit 110 converts the electrical signals into audio data and transmits the audio data to the peripheral device interface 118 for processing. The audio data is optionally retrieved from and / or transmitted to the memory 102 and / or the RF circuit 108 by the peripheral device interface 118. In some embodiments, the audio circuit 110 also includes a headset jack (e.g., Figure 2 The headset jack provides an interface between the audio circuit 110 and a removable audio input / output peripheral device, such as an output-only headset or a headset with both output (e.g., a single or dual-ear headset) and input (e.g., a microphone).

[0236] The I / O subsystem 106 couples the input / output peripherals on the device 100 (e.g., the touch-sensitive display system 112 and other input or control devices 116) to the peripherals interface 118. The I / O subsystem 106 optionally includes a display controller 156, an optical sensor controller 158, an intensity sensor controller 159, a tactile feedback controller 161, and one or more input controllers 160 for other input or control devices. The one or more input controllers 160 receive / send electrical signals from / to other input or control devices 116. The other input or control devices 116 optionally include physical buttons (e.g., push buttons, rocker buttons, etc.), dials, slide switches, joysticks, click wheels, and the like. In some alternative embodiments, the one or more input controllers 160 are optionally coupled to any (or none) of the following: a keyboard, an infrared port, a USB port, a stylus, and / or a pointer device (e.g., a mouse). One or more buttons (e.g., Figure 2 208) optionally includes up / down buttons for volume control of the speaker 111 and / or microphone 113. The one or more buttons optionally include a push button (e.g., Figure 2 206 in the ).

[0237] The touch-sensitive display system 112 provides an input interface and an output interface between the device and the user. The display controller 156 receives electrical signals from the touch-sensitive display system 112 and / or sends electrical signals to the touch-sensitive display system 112. The touch-sensitive display system 112 displays visual output to the user. The visual output optionally includes graphics, text, icons, videos, and any combination thereof (collectively referred to as "graphics"). In some embodiments, some visual outputs or all of the visual outputs correspond to user interface objects. As used herein, the term "indicator" refers to a user-interactive graphical user interface object (e.g., a graphical user interface object that is configured to respond to input directed to a graphical user interface object). Examples of user-interactive graphical user interface objects include, but are not limited to, buttons, sliders, icons, selectable menu items, switches, hyperlinks, or other user interface controls.

[0238] The touch-sensitive display system 112 has a touch-sensitive surface, sensor, or set of sensors that accepts input from a user based on tactile and / or haptic contact. The touch-sensitive display system 112 and the display controller 156 (together with any associated modules and / or instruction sets in the memory 102) detect contact (and any movement or interruption of that contact) on the touch-sensitive display system 112 and convert the detected contact into interaction with a user interface object (e.g., one or more soft keys, icons, web pages, or images) displayed on the touch-sensitive display system 112. In an exemplary embodiment, the point of contact between the touch-sensitive display system 112 and the user corresponds to the user's finger or stylus.

[0239] The touch-sensitive display system 112 optionally uses LCD (liquid crystal display) technology, LPD (light emitting polymer display) technology, or LED (light emitting diode) technology, although other display technologies are used in other embodiments. The touch-sensitive display system 112 and display controller 156 optionally use any of a variety of touch sensing technologies now known or later developed, including but not limited to capacitive, resistive, infrared, and surface acoustic wave technologies, as well as other proximity sensor arrays or other elements for determining one or more points of contact with the touch-sensitive display system 112 to detect contact and any movement or interruption thereof. In one exemplary embodiment, projected mutual capacitance sensing technology is used, such as the . iPod and Technology found in.

[0240] The touch-sensitive display system 112 optionally has a video resolution exceeding 100 dpi. In some embodiments, the touch screen video resolution exceeds 400 dpi (e.g., 500 dpi, 800 dpi, or greater). The user optionally uses any suitable object or appendage (e.g., a stylus, a finger, etc.) to contact the touch-sensitive display system 112. In some embodiments, the user interface is designed to work with finger-based contacts and gestures, which may not be as precise as stylus-based input due to the larger contact area of ​​a finger on the touch screen. In some embodiments, the device translates rough finger-based input into precise pointer / cursor positions or commands for performing the action desired by the user.

[0241] In some embodiments, in addition to the touch screen, the device 100 optionally includes a touchpad (not shown) for activating or deactivating specific functions. In some embodiments, the touchpad is a touch-sensitive area of ​​the device that, unlike the touch screen, does not display visual output. The touchpad is optionally a touch-sensitive surface separate from the touch-sensitive display system 112 or an extension of the touch-sensitive surface formed by the touch screen.

[0242] Device 100 also includes a power system 162 for powering the various components. Power system 162 optionally includes a power management system, one or more power sources (e.g., batteries, alternating current (AC)), a recharging system, power fault detection circuitry, a power converter or inverter, a power status indicator (e.g., a light emitting diode (LED)), and any other components associated with the generation, management, and distribution of power in a portable device.

[0243] Device 100 optionally also includes one or more optical sensors 164 . Figure 1A An optical sensor coupled to an optical sensor controller 158 in the I / O subsystem 106 is shown. One or more optical sensors 164 optionally include a charge coupled device (CCD) or a complementary metal oxide semiconductor (CMOS) phototransistor. The one or more optical sensors 164 receive light projected from the environment through one or more lenses and convert the light into data representing an image. In conjunction with the imaging module 143 (also referred to as a camera module), the one or more optical sensors 164 optionally capture still images or video. In some embodiments, the optical sensor is located on the rear of the device 100, facing away from the touch-sensitive display system 112 on the front of the device, so that the touch screen can be used as a viewfinder for still image and / or video image acquisition. In some embodiments, another optical sensor is located on the front of the device to obtain an image of the user (e.g., for self-portraits, for conducting a video conference while the user views other video conference participants on the touch screen, etc.).

[0244] Device 100 optionally also includes one or more contact intensity sensors 165 . Figure 1A A contact force sensor is shown coupled to force sensor controller 159 in I / O subsystem 106. One or more contact force sensors 165 optionally include one or more piezoresistive strain gauges, capacitive force sensors, electrical force sensors, piezoelectric force sensors, optical force sensors, capacitive touch-sensitive surfaces, or other force sensors (e.g., sensors for measuring the force (or pressure) of a contact on a touch-sensitive surface). One or more contact force sensors 165 receive contact force information (e.g., pressure information or a surrogate for pressure information) from the environment. In some embodiments, at least one contact force sensor is juxtaposed with or adjacent to a touch-sensitive surface (e.g., touch-sensitive display system 112). In some embodiments, at least one contact force sensor is located on the rear of device 100, opposite touch-sensitive display system 112 located on the front of device 100.

[0245] Device 100 optionally also includes one or more proximity sensors 166 . Figure 1A A proximity sensor 166 is shown coupled to the peripherals interface 118. Alternatively, the proximity sensor 166 is coupled to the input controller 160 in the I / O subsystem 106. In some embodiments, when the multifunction device is placed near the user's ear (e.g., when the user is on a phone call), the proximity sensor turns off and disables the touch-sensitive display system 112.

[0246] Device 100 optionally also includes one or more tactile output generators 167 . Figure 1AA tactile output generator is shown coupled to the tactile feedback controller 161 in the I / O subsystem 106. One or more tactile output generators 167 optionally include one or more electroacoustic devices such as speakers or other audio components, and / or electromechanical devices for converting energy into linear motion such as motors, solenoids, electroactive polymers, piezoelectric actuators, electrostatic actuators, or other tactile output generating components (e.g., components for converting electrical signals into tactile outputs on the device). One or more tactile output generators 167 receive tactile feedback generation instructions from the tactile feedback module 133 and generate tactile outputs on the device 100 that can be felt by the user of the device 100. In some embodiments, at least one tactile output generator is juxtaposed or adjacent to a touch-sensitive surface (e.g., touch-sensitive display system 112) and optionally generates tactile output by moving the touch-sensitive surface vertically (e.g., inward / outward toward the surface of the device 100) or laterally (e.g., back and forth in the same plane as the surface of the device 100). In some embodiments, at least one tactile output generator sensor is located on the back of the device 100, opposite the touch-sensitive display system 112 located on the front of the device 100.

[0247] Device 100 optionally also includes one or more accelerometers 168 . Figure 1A An accelerometer 168 is shown coupled to the peripherals interface 118. Alternatively, the accelerometer 168 is optionally coupled to the input controller 160 in the I / O subsystem 106. In some embodiments, information is displayed on the touch screen display in a portrait view or a landscape view based on analysis of data received from one or more accelerometers. In addition to the accelerometer 168, the device 100 optionally includes a magnetometer (not shown) and a GPS (or GLONASS or other global navigation system) receiver (not shown) for obtaining information about the position and orientation (e.g., portrait or landscape) of the device 100.

[0248] In some embodiments, the software components stored in memory 102 include an operating system 126, a communication module (or instruction set) 128, a contact / motion module (or instruction set) 130, a graphics module (or instruction set) 132, a tactile feedback module (or instruction set) 133, a text input module (or instruction set) 134, a global positioning system (GPS) module (or instruction set) 135, and an application (or instruction set) 136. In addition, in some embodiments, memory 102 stores device / global internal state 157, such as Figure 1A and Figure 3The device / global internal state 157 includes one or more of the following: an active application state indicating which application, if any, is currently active; a display state indicating what applications, views, or other information occupy various areas of the touch-sensitive display system 112; a sensor state including information obtained from the device's various sensors and other input or control devices 116; and position and / or location information regarding the device's position and / or posture.

[0249] The operating system 126 (e.g., iOS, Darwin, RTXC, LINUX, UNIX, OS X, WINDOWS, or an embedded operating system such as VxWorks) includes various software components and / or drivers for controlling and managing general system tasks (e.g., memory management, storage device control, power management, etc.) and facilitates communication between various hardware and software components.

[0250] The communication module 128 facilitates communication with other devices through one or more external ports 124 and also includes various software components for processing data received by the RF circuit 108 and / or the external port 124. The external port 124 (e.g., Universal Serial Bus (USB), FireWire, etc.) is suitable for coupling directly to other devices, or indirectly through a network (e.g., the Internet, wireless LAN, etc.). In some embodiments, the external port is a device that is compatible with some of Apple Inc. (Cupertino, California). iPod A multi-pin (e.g., 30-pin) connector that is the same as, similar to, and / or compatible with the 30-pin connector used in iPod devices. In some embodiments, the external port is compatible with some of Apple Inc. (Cupertino, California) iPod A Lightning connector that is the same as, similar to, and / or compatible with the Lightning connector used in iPod devices.

[0251] The contact / motion module 130 optionally detects contact with the touch-sensitive display system 112 (in conjunction with the display controller 156) and other touch-sensitive devices (e.g., a touchpad or physical click wheel). The contact / motion module 130 includes various software components for performing various operations related to contact detection (e.g., by a finger or stylus), such as determining whether contact has occurred (e.g., detecting a finger press event), determining the strength of the contact (e.g., the force or pressure of the contact, or a surrogate for the force or pressure of the contact), determining whether there has been movement of the contact and tracking movement across the touch-sensitive surface (e.g., detecting one or more finger drag events), and determining whether the contact has ceased (e.g., detecting a finger lift event or contact break). The contact / motion module 130 receives contact data from the touch-sensitive surface. Determining the movement of a contact point optionally includes determining a rate (magnitude), velocity (magnitude and direction), and / or acceleration (change in magnitude and / or direction) of the contact point, the movement of the contact point being represented by a series of contact data. These operations are optionally applied to a single point of contact (e.g., a single finger contact or stylus contact) or multiple points of simultaneous contact (e.g., "multi-touch" / multi-finger contact). In some embodiments, contact / motion module 130 and display controller 156 detect contact on a touchpad.

[0252] The contact / motion module 130 optionally detects gesture input from a user. Different gestures on a touch-sensitive surface have different contact patterns (e.g., different motions, timings, and / or intensities of the detected contacts). Therefore, gestures are optionally detected by detecting specific contact patterns. For example, detecting a single-finger tap gesture includes detecting a finger press event and then detecting a finger lift (lift-off) event at the same location (or substantially the same location) as the finger press event (e.g., at an icon location). As another example, detecting a finger swipe gesture on a touch-sensitive surface includes detecting a finger press event, then detecting one or more finger drag events, and then detecting a finger lift (lift-off) event. Similarly, taps, swipes, drags, and other gestures of a stylus are optionally detected by detecting specific contact patterns of the stylus.

[0253] In some embodiments, detecting a finger tap gesture depends on detecting the length of time between a finger press event and a finger lift event, but is independent of the intensity of the finger contact between the finger press event and the finger lift event. In some embodiments, a tap gesture is detected based on determining that the length of time between the finger press event and the finger lift event is less than a predetermined value (e.g., less than 0.1, 0.2, 0.3, 0.4, or 0.5 seconds), regardless of whether the intensity of the finger contact during the tap reaches a given intensity threshold (greater than a nominal contact detection intensity threshold), such as a light press or deep press intensity threshold. Thus, a finger tap gesture can meet a particular input criterion that does not require a characteristic intensity of the contact to meet a given intensity threshold to meet the particular input criterion. For clarity, the finger contact in a tap gesture is typically required to meet a nominal contact detection intensity threshold to detect a finger press event, below which the contact is not detected. A similar analysis applies to detecting a tap gesture by a stylus or other contact. In cases where the device is capable of detecting contact by a finger or stylus hovering over the touch-sensitive surface, the nominal contact detection intensity threshold optionally does not correspond to physical contact between the finger or stylus and the touch-sensitive surface.

[0254] The same concepts apply in a similar manner to other types of gestures. For example, a swipe gesture, a pinch gesture, an expand gesture, and / or a long press gesture may optionally be detected based on the satisfaction of a criterion that is independent of the intensity of the contacts included in the gesture or that does not require the contacts performing the gesture to reach an intensity threshold in order to be recognized. For example, a swipe gesture is detected based on the amount of movement of one or more contacts; a pinch gesture is detected based on the movement of two or more contacts toward each other; an expand gesture is detected based on the movement of two or more contacts away from each other; and a long press gesture is detected based on the duration of contacts on the touch-sensitive surface having an amount of movement less than a threshold. Thus, a statement that a particular gesture recognition criterion does not require the intensity of the contacts to meet the corresponding intensity threshold in order to meet the particular gesture recognition criterion means that the particular gesture recognition criterion can be met when the contacts in the gesture do not meet the corresponding intensity threshold, and can also be met when one or more contacts in the gesture meets or exceeds the corresponding intensity threshold. In some embodiments, a tap gesture is detected based on determining that a finger down event and a finger up event are detected within a predefined time period, regardless of whether the contact is above or below a corresponding intensity threshold during the predefined time period, and a swipe gesture is detected based on determining that the contact moves by more than a predefined amount, even if the contact is above the corresponding intensity threshold at the end of the contact movement. Even in specific implementations where detection of gestures is affected by the intensity of the contact performing the gesture (e.g., the device detects a long press more quickly when the intensity of the contact is above an intensity threshold, or the device delays detection of a tap input when the intensity of the contact is higher), detection of these gestures does not require the contact to reach a particular intensity threshold (e.g., even if the amount of time required to recognize the gesture varies), as long as the criteria for recognizing the gesture can be met without the contact reaching the particular intensity threshold.

[0255] In some cases, contact intensity thresholds, duration thresholds, and movement thresholds are combined in various combinations to create heuristic algorithms that distinguish between two or more different gestures directed to the same input element or area, enabling multiple different interactions with the same input element to provide a richer set of user interactions and responses. The statement that a particular set of gesture recognition criteria does not require the intensity of a contact to meet the corresponding intensity threshold to meet the particular gesture recognition criteria does not preclude the simultaneous evaluation of other intensity-related gesture recognition criteria to identify other gestures whose criteria are met when the gesture includes a contact with an intensity above the corresponding intensity threshold. For example, in some cases, a first gesture recognition criterion for a first gesture (which does not require the intensity of the contact to meet the corresponding intensity threshold to meet the first gesture recognition criterion) competes with a second gesture recognition criterion for a second gesture (which depends on the contact meeting the corresponding intensity threshold). In such a competition, if the second gesture recognition criterion for the second gesture is met first, the gesture is optionally not recognized as meeting the first gesture recognition criterion for the first gesture. For example, if the contact reaches the corresponding intensity threshold before the contact moves a predefined amount, a deep press gesture is detected instead of a swipe gesture. Conversely, if the contact moves a predefined amount before the contact reaches the corresponding intensity threshold, a swipe gesture is detected instead of a deep press gesture. Even in this case, the first gesture recognition criterion for the first gesture still does not require the intensity of the contact to meet the corresponding intensity threshold in order to satisfy the first gesture recognition criterion, because if the contact remains below the corresponding intensity threshold until the gesture ends (e.g., a swipe gesture with an intensity of the contact that does not increase above the corresponding intensity threshold), the gesture will be recognized as a swipe gesture by the first gesture recognition criterion. Therefore, a particular gesture recognition criterion that does not require the intensity of the contact to meet the corresponding intensity threshold in order to satisfy the particular gesture recognition criterion may (A) in some cases ignore the intensity of the contact relative to the intensity threshold (e.g., for a tap gesture) and / or (B) in some cases fail to satisfy the particular gesture recognition criterion (e.g., for a long press gesture) if a set of competing intensity-related gesture recognition criteria (e.g., for a deep press gesture) recognizes the input as corresponding to an intensity-related gesture before the particular gesture recognition criterion recognizes the gesture corresponding to the input, and in this sense still depends on the intensity of the contact relative to the intensity threshold (e.g., for a long press gesture competing with a deep press gesture for recognition).

[0256] The graphics module 132 includes various known software components for rendering and displaying graphics on the touch-sensitive display system 112 or other display, including components for changing the visual impact (e.g., brightness, transparency, saturation, contrast, or other visual attributes) of the displayed graphics. As used herein, the term "graphics" includes any object that can be displayed to a user, including but not limited to text, web pages, icons (such as user interface objects including soft keys), digital images, videos, animations, etc.

[0257] In some embodiments, the graphics module 132 stores data to be used to represent graphics. Each graphic is optionally assigned a corresponding code. The graphics module 132 receives one or more codes specifying the graphics to be displayed from an application program, etc., along with coordinate data and other graphic attribute data, if necessary, and then generates screen image data for output to the display controller 156.

[0258] Haptic feedback module 133 includes various software components for generating instructions used by tactile output generator 167 to produce tactile output at one or more locations on device 100 in response to user interaction with device 100 .

[0259] Text input module 134, which is optionally a component of graphics module 132, provides a soft keyboard for entering text in various applications (e.g., contacts 137, email 140, IM 141, browser 147, and any other application requiring text input).

[0260] The GPS module 135 determines the location of the device and provides this information for use in various applications (e.g., to the phone 138 for location-based dialing; to the camera 143 as picture / video metadata; and to applications that provide location-based services such as a weather widget, local pages widget, and map / navigation widget).

[0261] Application 136 optionally includes the following modules (or instruction sets), or a subset or superset thereof:

[0262] Contacts module 137 (sometimes called address book or contact list);

[0263] Telephone module 138;

[0264] Video conferencing module 139;

[0265] Email client module 140;

[0266] Instant messaging (IM) module 141;

[0267] Fitness support module 142;

[0268] A camera module 143 for still and / or video images;

[0269] Image management module 144;

[0270] Browser module 147;

[0271] Calendar module 148;

[0272] Widget module 149, which optionally includes one or more of the following: weather widget 149-1, stock widget 149-2, calculator widget 149-3, alarm clock widget 149-4, dictionary widget 149-5, and other widgets obtained by the user, and user-created widgets 149-6;

[0273] A widget creator module 150 for forming user-created widgets 149-6;

[0274] Search module 151;

[0275] Video and music player module 152, which optionally consists of a video player module and a music player module;

[0276] Notepad module 153;

[0277] Map module 154; and / or

[0278] Online video module 155.

[0279] Examples of other applications 136 optionally stored in memory 102 include other word processing applications, other image editing applications, drawing applications, rendering applications, JAVA-enabled applications, encryption, digital rights management, voice recognition, and voice replication.

[0280] In combination with the touch-sensitive display system 112, the display controller 156, the contact module 130, the graphics module 132, and the text input module 134, the contacts module 137 includes executable instructions for managing an address book or contact list (e.g., stored in the application internal state 192 of the contacts module 137 in memory 102 or memory 370), including: adding names to the address book; deleting names from the address book; associating phone numbers, email addresses, physical addresses, or other information with names; associating images with names; categorizing and sorting names; providing phone numbers and / or email addresses to initiate and / or facilitate communications via telephone 138, video conferencing 139, email 140, or IM 141, and so on.

[0281] In conjunction with RF circuitry 108, audio circuitry 110, speaker 111, microphone 113, touch-sensitive display system 112, display controller 156, contact module 130, graphics module 132, and text input module 134, phone module 138 includes executable instructions for entering a character sequence corresponding to a phone number, accessing one or more phone numbers in address book 137, modifying an entered phone number, dialing the corresponding phone number, conducting a conversation, and disconnecting or hanging up when the conversation is complete. As described above, wireless communication optionally uses any of a variety of communication standards, protocols, and technologies.

[0282] In combination with RF circuitry 108, audio circuitry 110, speaker 111, microphone 113, touch-sensitive display system 112, display controller 156, one or more optical sensors 164, optical sensor controller 158, contact module 130, graphics module 132, text input module 134, contact list 137, and telephony module 138, video conferencing module 139 includes executable instructions for initiating, conducting, and terminating a video conference between a user and one or more other participants in accordance with user instructions.

[0283] In conjunction with RF circuitry 108, touch-sensitive display system 112, display controller 156, contact module 130, graphics module 132, and text input module 134, email client module 140 includes executable instructions for creating, sending, receiving, and managing emails in response to user instructions. In conjunction with image management module 144, email client module 140 makes it very easy to create and send emails with still images or video images captured by camera module 143.

[0284] In conjunction with the RF circuitry 108, the touch-sensitive display system 112, the display controller 156, the contact module 130, the graphics module 132, and the text input module 134, the instant messaging module 141 includes executable instructions for entering a character sequence corresponding to an instant message, modifying previously entered characters, transmitting the corresponding instant message (e.g., using the Short Message Service (SMS) or Multimedia Message Service (MMS) protocols for phone-based instant messaging or using XMPP, SIMPLE, Apple Push Notification Service (APN), or IMPS for Internet-based instant messaging), receiving instant messages, viewing received instant messages, and performing the functions of the instant messaging application described in more detail below. In some embodiments, the transmitted and / or received instant messages optionally include graphics, photos, audio files, video files, and / or other attachments supported in MMS and / or Enhanced Messaging Service (EMS). As used herein, "instant messaging" refers to both telephony-based messaging (eg, messages sent using SMS or MMS) and Internet-based messaging (eg, messages sent using XMPP, SIMPLE, APNs, or IMPS).

[0285] In combination with RF circuitry 108, touch-sensitive display system 112, display controller 156, contact module 130, graphics module 132, text input module 134, GPS module 135, map module 154, and music player module 146, fitness support module 142 includes executable instructions for: creating a workout (e.g., with time, distance, and / or calorie burn goals); communicating with fitness sensors (in sports equipment and smart watches); receiving fitness sensor data; calibrating sensors for monitoring fitness; selecting and playing fitness music; and displaying, storing, and transmitting fitness data.

[0286] In conjunction with touch-sensitive display system 112, display controller 156, one or more optical sensors 164, optical sensor controller 158, contact module 130, graphics module 132, and image management module 144, camera module 143 includes executable instructions for capturing still images or videos (including video streams) and storing them in memory 102, modifying characteristics of still images or videos, and / or deleting still images or videos from memory 102.

[0287] In conjunction with touch-sensitive display system 112, display controller 156, contact module 130, graphics module 132, text input module 134, and camera module 143, image management module 144 includes executable instructions for arranging, modifying (e.g., editing) or otherwise manipulating, labeling, deleting, presenting (e.g., in a digital slideshow or album), and storing still images and / or video images.

[0288] In combination with the RF circuit 108, the touch-sensitive display system 112, the display system controller 156, the contact module 130, the graphics module 132 and the text input module 134, the browser module 147 includes executable instructions for browsing the Internet (including searching for, linking to, receiving and displaying web pages or portions thereof and attachments and other files linked to web pages) in accordance with user instructions.

[0289] In combination with the RF circuit 108, the touch-sensitive display system 112, the display system controller 156, the contact module 130, the graphics module 132, the text input module 134, the email client module 140 and the browser module 147, the calendar module 148 includes executable instructions for creating, displaying, modifying and storing calendars and data associated with the calendars (e.g., calendar entries, to-do items, etc.) in accordance with user instructions.

[0290] In conjunction with the RF circuit 108, the touch-sensitive display system 112, the display system controller 156, the contact module 130, the graphics module 132, the text input module 134, and the browser module 147, the desktop widget module 149 is a mini-application that is optionally downloaded and used by the user (e.g., the weather desktop widget 149-1, the stock desktop widget 149-2, the calculator desktop widget 149-3, the alarm desktop widget 149-4, and the dictionary desktop widget 149-5) or a mini-application created by the user (e.g., the user-created desktop widget 149-6). In some embodiments, the desktop widget includes an HTML (Hypertext Markup Language) file, a CSS (Cascading Style Sheets) file, and a JavaScript file. In some embodiments, the desktop widget includes an XML (Extensible Markup Language) file and a JavaScript file (e.g., the Yahoo! desktop widget).

[0291] In combination with the RF circuit 108, the touch-sensitive display system 112, the display system controller 156, the contact module 130, the graphics module 132, the text input module 134 and the browser module 147, the desktop widget creator module 150 includes executable instructions for creating a desktop widget (e.g., transferring a user-specified portion of a web page into a desktop widget).

[0292] In combination with the touch-sensitive display system 112, the display system controller 156, the contact module 130, the graphics module 132, and the text input module 134, the search module 151 includes executable instructions for searching the memory 102 for text, music, sound, images, videos, and / or other files that match one or more search criteria (e.g., one or more user-specified search terms) in accordance with user instructions.

[0293] In conjunction with touch-sensitive display system 112, display system controller 156, contact module 130, graphics module 132, audio circuitry 110, speaker 111, RF circuitry 108, and browser module 147, video and music player module 152 includes executable instructions that allow a user to download and play back recorded music and other sound files stored in one or more file formats (e.g., MP3 or AAC files), as well as executable instructions for displaying, presenting, or otherwise playing back video (e.g., on touch-sensitive display system 112 or on an external display connected wirelessly or via external port 124). In some embodiments, device 100 optionally includes the functionality of an MP3 player, such as an iPod (trademark of Apple Inc.).

[0294] In conjunction with the touch-sensitive display system 112, display controller 156, contact module 130, graphics module 132, and text input module 134, the notes module 153 includes executable instructions for creating and managing notes, to-do lists, etc. according to user instructions.

[0295] In combination with RF circuitry 108, touch-sensitive display system 112, display system controller 156, contact module 130, graphics module 132, text input module 134, GPS module 135, and browser module 147, map module 154 includes executable instructions for receiving, displaying, modifying, and storing maps and data associated with the maps (e.g., driving directions; data relating to stores and other points of interest at or near a particular location; and other location-based data) in accordance with user instructions.

[0296] In conjunction with touch-sensitive display system 112, display system controller 156, contact module 130, graphics module 132, audio circuit 110, speaker 111, RF circuit 108, text input module 134, email client module 140, and browser module 147, online video module 155 includes executable instructions that allow a user to access, browse, receive (e.g., by streaming and / or downloading), play back (e.g., on touch screen 112, or on an external display connected wirelessly or via external port 124), send an email with a link to a particular online video, and otherwise manage online videos in one or more file formats such as H.264. In some embodiments, instant messaging module 141 is used instead of email client module 140 to send a link to a particular online video.

[0297] Each module and application in the above-mentioned modules and applications corresponds to an executable instruction set for performing one or more functions and the methods described in this patent application (e.g., computer-implemented methods and other information processing methods as described herein). These modules (i.e., instruction sets) do not have to be implemented as independent software programs, processes, or modules, so various subsets of these modules are optionally combined or otherwise rearranged in various embodiments. In some embodiments, memory 102 optionally stores a subset of the above-mentioned modules and data structures. In addition, memory 102 optionally stores additional modules and data structures not described above.

[0298] In some embodiments, device 100 is a device in which operation of a set of predefined functions on the device is performed exclusively through a touch screen and / or a touchpad. By using a touch screen and / or a touchpad as the primary input control device for operating device 100, the number of physical input control devices (e.g., push buttons, dials, etc.) on device 100 is optionally reduced.

[0299] The set of predefined functions that are performed exclusively through the touch screen and / or trackpad optionally includes navigating between user interfaces. In some embodiments, the trackpad, when touched by the user, navigates the device 100 from any user interface displayed on the device 100 to a main menu, home menu, or root menu. In such embodiments, the trackpad is used to implement a "menu button." In some other embodiments, the menu button is a physical push button or other physical input control device, rather than a trackpad.

[0300] Figure 1B is a block diagram illustrating exemplary components for event processing according to some embodiments. In some embodiments, memory 102 ( Figure 1A ) or memory 370 ( Figure 3 ) includes an event classifier 170 (e.g., in the operating system 126) and a corresponding application 136-1 (e.g., any one of the aforementioned applications 136, 137 to 155, 380 to 390).

[0301] The event classifier 170 receives event information and determines the application 136-1 and the application view 191 of the application 136-1 to which the event information is to be delivered. The event classifier 170 includes an event monitor 171 and an event dispatcher module 174. In some embodiments, the application 136-1 includes an application internal state 192 that indicates one or more current application views displayed on the touch-sensitive display system 112 when the application is active or executing. In some embodiments, the device / global internal state 157 is used by the event classifier 170 to determine which application(s) is currently active, and the application internal state 192 is used by the event classifier 170 to determine the application view 191 to which the event information is to be delivered.

[0302] In some embodiments, the application internal state 192 includes additional information, such as one or more of the following: resumption information to be used when the application 136-1 resumes execution, user interface state information indicating information being displayed by the application 136-1 or information ready for display by the application, a state queue for enabling the user to return to a previous state or view of the application 136-1, and a redo / undo queue of previous actions taken by the user.

[0303] Event monitor 171 receives event information from peripherals interface 118. The event information includes information about sub-events (e.g., a user touch on touch-sensitive display system 112 as part of a multi-touch gesture). Peripherals interface 118 transmits information it receives from I / O subsystem 106 or sensors (e.g., proximity sensor 166, one or more accelerometers 168, and / or microphone 113 (via audio circuit 110)). The information that peripherals interface 118 receives from I / O subsystem 106 includes information from touch-sensitive display system 112 or a touch-sensitive surface.

[0304] In some embodiments, event monitor 171 sends requests to peripheral device interface 118 at predetermined intervals. In response, peripheral device interface 118 transmits event information. In other embodiments, peripheral device interface 118 transmits event information only when there is a significant event (e.g., receiving an input above a predetermined noise threshold and / or receiving an input for more than a predetermined duration).

[0305] In some embodiments, the event classifier 170 also includes a hit view determination module 172 and / or an active event identifier determination module 173.

[0306] When the touch-sensitive display system 112 displays more than one view, the hit view determination module 172 provides software procedures for determining where within one or more views a sub-event has occurred. A view consists of controls and other elements that a user can see on the display.

[0307] Another aspect of the user interface associated with an application is a set of views, sometimes referred to herein as application views or user interface windows, in which information is displayed and touch-based gestures occur. The application views (of the respective application) in which a touch is detected optionally correspond to programmatic levels within the application's programmatic or view hierarchy. For example, the lowest-level view in which a touch is detected is optionally referred to as a hit view, and the set of events recognized as correct input is optionally determined based at least in part on the hit view of the initial touch that started the touch-based gesture.

[0308] Hit view determination module 172 receives information related to sub-events of touch-based gestures. When an application has multiple views organized in a hierarchy, hit view determination module 172 identifies the hit view as the lowest view in the hierarchy that should handle the sub-event. In most cases, the hit view is the lowest-level view in which the initiating sub-event (i.e., the first sub-event in a sequence of sub-events that form an event or potential event) occurs. Once a hit view is identified by the hit view determination module, the hit view typically receives all sub-events related to the same touch or input source for which it was identified as the hit view.

[0309] Active event recognizer determination module 173 determines which view or views within the view hierarchy should receive a particular sequence of sub-events. In some embodiments, active event recognizer determination module 173 determines that only the hit view should receive a particular sequence of sub-events. In other embodiments, active event recognizer determination module 173 determines that all views that include the physical location of the sub-event are actively participating views, and therefore determines that all actively participating views should receive a particular sequence of sub-events. In other embodiments, even if a touch sub-event is completely confined to an area associated with one particular view, views higher in the hierarchy will still remain actively participating views.

[0310] Event dispatcher module 174 dispatches event information to event recognizers (e.g., event recognizer 180). In embodiments that include active event recognizer determination module 173, event dispatcher module 174 delivers the event information to the event recognizer determined by active event recognizer determination module 173. In some embodiments, event dispatcher module 174 stores the event information in an event queue, which is retrieved by corresponding event receiver module 182.

[0311] In some embodiments, operating system 126 includes event classifier 170. Alternatively, application 136-1 includes event classifier 170. In other embodiments, event classifier 170 is a standalone module or part of another module stored in memory 102 (e.g., contact / motion module 130).

[0312] In some embodiments, application 136-1 includes multiple event handlers 190 and one or more application views 191, each of which includes instructions for handling touch events that occur within a corresponding view of the application's user interface. Each application view 191 of application 136-1 includes one or more event recognizers 180. Typically, the corresponding application view 191 includes multiple event recognizers 180. In other embodiments, one or more of event recognizers 180 is part of a separate module, such as a user interface toolkit (not shown) or a higher-level object from which application 136-1 inherits methods and other properties. In some embodiments, the corresponding event handler 190 includes one or more of the following: a data updater 176, an object updater 177, a GUI updater 178, and / or event data 179 received from an event classifier 170. Event handler 190 optionally utilizes or calls data updater 176, object updater 177, or GUI updater 178 to update the application internal state 192. Alternatively, one or more of the application views in application view 191 include one or more corresponding event handlers 190. Additionally, in some embodiments, one or more of data updater 176, object updater 177, and GUI updater 178 are included in the corresponding application view 191.

[0313] A corresponding event identifier 180 receives event information (e.g., event data 179) from event classifier 170 and identifies an event from the event information. Event identifier 180 includes an event receiver 182 and an event comparator 184. In some embodiments, event identifier 180 also includes metadata 183 and at least a subset of event delivery instructions 188 (which optionally include sub-event delivery instructions).

[0314] The event receiver 182 receives event information from the event classifier 170. The event information includes information about a sub-event (e.g., a touch or touch movement). Depending on the sub-event, the event information also includes additional information, such as the location of the sub-event. When the sub-event involves the movement of a touch, the event information optionally also includes the rate and direction of the sub-event. In some embodiments, the event includes a rotation of the device from one orientation to another (e.g., from a portrait orientation to a landscape orientation, or vice versa), and the event information includes corresponding information about the current orientation of the device (also referred to as the device posture).

[0315] The event comparator 184 compares the event information with predefined event or sub-event definitions and determines the event or sub-event based on the comparison, or determines or updates the state of the event or sub-event. In some embodiments, the event comparator 184 includes an event definition 186. The event definition 186 includes the definition of the event (e.g., a predefined sequence of sub-events), such as event 1 (187-1), event 2 (187-2), and others. In some embodiments, the sub-events in event 187 include, for example, touch start, touch end, touch move, touch cancel, and multi-touch. In one embodiment, the definition of event 1 (187-1) is a double-click on a displayed object. For example, a double-click includes a first touch (touch start) of a predetermined duration on the displayed object, a first lift-off (touch end) of a predetermined duration, a second touch (touch start) of a predetermined duration on the displayed object, and a second lift-off (touch end) of a predetermined duration. For another example, the definition of event 2 (187-2) is a drag on a displayed object. For example, a drag includes a touch (or contact) of a predetermined duration on a displayed object, movement of the touch on the touch-sensitive display system 112, and lift-off of the touch (touch end). In some embodiments, the event also includes information for one or more associated event handlers 190.

[0316] In some embodiments, event definition 187 includes definitions of events for corresponding user interface objects. In some embodiments, event comparator 184 performs a hit test to determine which user interface object is associated with a sub-event. For example, in an application view displaying three user interface objects on touch-sensitive display system 112, when a touch is detected on touch-sensitive display system 112, event comparator 184 performs a hit test to determine which of the three user interface objects is associated with the touch (sub-event). If each displayed object is associated with a corresponding event handler 190, the event comparator uses the result of the hit test to determine which event handler 190 should be activated. For example, event comparator 184 selects an event handler that is associated with the sub-event and the object that triggered the hit test.

[0317] In some embodiments, the definition of the corresponding event 187 also includes a delay action that delays the delivery of the event information until it has been determined whether the sub-event sequence does or does not correspond to the event type of the event identifier.

[0318] When a corresponding event recognizer 180 determines that a sequence of sub-events does not match any event in event definitions 186, the corresponding event recognizer 180 enters the event not possible, event failed, or event ended state, after which subsequent sub-events of the touch-based gesture are ignored. In this case, other event recognizers (if any) that remain active for the hit view continue to track and process sub-events of the ongoing touch-based gesture.

[0319] In some embodiments, corresponding event recognizers 180 include metadata 183 having configurable properties, flags, and / or lists that indicate how the event delivery system should perform sub-event delivery for actively participating event recognizers. In some embodiments, metadata 183 includes configurable properties, flags, and / or lists that indicate how event recognizers interact or can interact with each other. In some embodiments, metadata 183 includes configurable properties, flags, and / or lists that indicate whether sub-events are delivered to different levels in a view or programmatic hierarchy.

[0320] In some embodiments, when one or more specific sub-events of an event are identified, the corresponding event recognizer 180 activates an event handler 190 associated with the event. In some embodiments, the corresponding event recognizer 180 delivers event information associated with the event to the event handler 190. Activating an event handler 190 is different from sending (and deferred sending) sub-events to the corresponding hit view. In some embodiments, the event recognizer 180 throws a flag associated with the identified event, and the event handler 190 associated with the flag obtains the flag and performs a predefined process.

[0321] In some embodiments, event delivery instructions 188 include sub-event delivery instructions that deliver event information about a sub-event without activating an event handler. Instead, the sub-event delivery instructions deliver the event information to an event handler associated with the sub-event series or to an actively participating view. The event handler associated with the sub-event series or with the actively participating view receives the event information and performs a predetermined process.

[0322] In some embodiments, data updater 176 creates and updates data used in application 136-1. For example, data updater 176 updates phone numbers used in contact module 137 or stores video files used in video player module 145. In some embodiments, object updater 177 creates and updates objects used in application 136-1. For example, object updater 177 creates new user interface objects or updates the location of user interface objects. GUI updater 178 updates the GUI. For example, GUI updater 178 prepares display information and sends it to graphics module 132 for display on a touch-sensitive display.

[0323] In some embodiments, one or more event handlers 190 include or have access to data updater 176, object updater 177, and GUI updater 178. In some embodiments, data updater 176, object updater 177, and GUI updater 178 are included in a single module of the corresponding application 136-1 or application view 191. In other embodiments, they are included in two or more software modules.

[0324] It should be understood that the above discussion of event handling for user touches on a touch-sensitive display also applies to other forms of user input utilizing input devices to operate the multifunction device 100, and not all user input is initiated on a touch screen. For example, mouse movement and mouse button presses, optionally in combination with single or multiple keyboard presses or holds; contact movement on a touchpad, such as taps, drags, scrolls, etc.; stylus input; movement of the device; spoken commands; detected eye movements; biometric input; and / or any combination thereof may be utilized as input corresponding to a sub-event defining an event to be recognized.

[0325] Figure 2 A device with a touch screen (e.g., Figure 1AThe portable multifunction device 100 includes a touch-sensitive display system 112 (e.g., a touch screen). The touch screen optionally displays one or more graphics within a user interface (UI) 200. In this embodiment, and in other embodiments described below, a user can select one or more of the graphics by, for example, making gestures on the graphics using one or more fingers 202 (not drawn to scale in the figures) or using one or more styluses 203 (not drawn to scale in the figures). In some embodiments, selection of the one or more graphics occurs when the user breaks contact with the one or more graphics. In some embodiments, the gesture optionally includes one or more taps, one or more swipes (from left to right, from right to left, up and / or down), and / or rolling of a finger that has made contact with the device 100 (from right to left, from left to right, up and / or down). In some implementations or in some cases, inadvertent contact with a graphic does not select the graphic. For example, a swipe gesture that sweeps over an application icon optionally does not select the corresponding application when the gesture corresponding to selection is a tap.

[0326] The device 100 optionally also includes one or more physical buttons, such as a "home" button or menu button 204. As previously described, the menu button 204 is optionally used to navigate to any application 136 in a set of applications optionally executed on the device 100. Alternatively, in some embodiments, the menu button is implemented as a soft key in a GUI displayed on the touch screen display.

[0327] In some embodiments, the device 100 includes a touch screen display, a menu button 204, a push button 206 for powering the device on / off and for locking the device, one or more volume adjustment buttons 208, a subscriber identity module (SIM) card slot 210, a headset jack 212, and a docking / charging external port 124. The push button 206 is optionally used to: power the device on / off by pressing the button and keeping the button in a depressed state for a predefined time interval; lock the device by pressing the button and releasing the button before a predefined time interval has passed; and / or unlock the device or initiate an unlocking process. In some embodiments, the device 100 also accepts voice input for activating or deactivating certain functions through the microphone 113. The device 100 also optionally includes one or more contact intensity sensors 165 for detecting the intensity of contact on the touch-sensitive display system 112 and / or one or more tactile output generators 167 for generating tactile output for the user of the device 100.

[0328] Figure 3is a block diagram of an exemplary multifunction device with a display and a touch-sensitive surface according to some embodiments. The device 300 does not have to be portable. In some embodiments, the device 300 is a laptop computer, a desktop computer, a tablet computer, a multimedia player device, a navigation device, an educational device (e.g., a children's learning toy), a gaming system, or a control device (e.g., a home controller or an industrial controller). The device 300 typically includes one or more processing units (CPUs) 310, one or more network or other communication interfaces 360, a memory 370, and one or more communication buses 320 for interconnecting these components. The communication bus 320 optionally includes circuits (sometimes referred to as a chipset) that interconnect system components and control communications between system components. The device 300 includes an input / output (I / O) interface 330 having a display 340, which is typically a touch screen display. The I / O interface 330 also optionally includes a keyboard and / or mouse (or other pointing device) 350 and a touchpad 355, a tactile output generator 357 for generating tactile output on the device 300 (e.g., similar to the above referenced embodiments). Figure 1A The one or more tactile output generators 167 described above), sensors 359 (e.g., optical sensors, acceleration sensors, proximity sensors, touch sensors, and / or sensors similar to those described above) Figure 1A Memory 370 includes high-speed random access memory, such as DRAM, SRAM, DDR RAM, or other random access solid-state memory devices, and optionally includes non-volatile memory, such as one or more magnetic disk storage devices, optical disk storage devices, flash memory devices, or other non-volatile solid-state storage devices. Memory 370 optionally includes one or more storage devices located remotely from one or more CPUs 310. In some embodiments, memory 370 stores data related to portable multifunction device 100 ( Figure 1A ), or a subset thereof. In addition, memory 370 optionally stores additional programs, modules, and data structures not present in memory 102 of portable multifunction device 100. For example, memory 370 of device 300 optionally stores a drawing module 380, a presentation module 382, ​​a word processing module 384, a website creation module 386, a disk editing module 388, and / or a spreadsheet module 390, while portable multifunction device 100( Figure 1A )'s memory 102 optionally does not store these modules.

[0329] Figure 3Each element in the above-mentioned identified element is optionally stored in one or more memory devices in the previously mentioned memory device.Each module in the above-mentioned identified module corresponds to a group of instructions for performing the functions described above.The above-mentioned identified module or program (that is, instruction set) need not be implemented as independent software program, process or module, and therefore the various subsets of these modules are optionally combined or otherwise rearranged in various embodiments.In some embodiments, memory 370 optionally stores the subgroup of above-mentioned modules and data structure.In addition, memory 370 optionally stores other modules and data structure not described above.

[0330] Attention is now turned to an embodiment of a user interface (“UI”) that is optionally implemented on portable multifunction device 100 .

[0331] Figure 4A An exemplary user interface for an application menu on portable multifunction device 100 is shown according to some embodiments. A similar user interface is optionally implemented on device 300. In some embodiments, user interface 400 includes the following elements, or a subset or superset thereof:

[0332] One or more signal strength indicators 402 of one or more wireless communications (e.g., cellular signals and Wi-Fi signals);

[0333] Time 404;

[0334] Bluetooth indicator 405;

[0335] Battery status indicator 406;

[0336] A tray 408 with common application icons, such as:

[0337] o an icon 416 labeled “Phone” of the phone module 138, the icon 416 optionally including an indicator 414 of the number of missed calls or voice messages;

[0338] o an icon 418 labeled “Mail” of the email client module 140 , the icon 418 optionally including an indicator 410 of the number of unread emails;

[0339] o an icon 420 labeled "Browser" of the browser module 147; and

[0340] o an icon 422 labeled “iPod” for the video and music player module 152 (also called the iPod (trademark of Apple Inc.) module 152); and

[0341] Icons for other applications, such as:

[0342] o Icon 424 labeled “Message” of IM module 141;

[0343] o Icon 426 labeled “Calendar” of calendar module 148;

[0344] o Icon 428 labeled “Photos” of the image management module 144;

[0345] o an icon 430 labeled “Camera” of the camera module 143;

[0346] o an icon 432 labeled “Online Video” of the online video module 155;

[0347] o Icon 434 labeled "Stocks" of the Stocks widget 149-2;

[0348] o an icon 436 labeled “MAP” of the map module 154;

[0349] o Icon 438 labeled “Weather” of the weather widget 149-1;

[0350] o Icon 440 labeled “Clock” of the alarm clock widget 149-4;

[0351] o Icon 442 of the exercise support module 142 labeled “Exercise Support”;

[0352] o an icon 444 of the Notes module 153 labeled "Notes"; and

[0353] o a settings application or module icon 446 that provides access to settings for the device 100 and its various applications 136;

[0354] It should be noted that Figure 4A The icon labels shown are merely exemplary. For example, in some embodiments, icon 422 of video and music player module 152 is labeled "Music" or "Music Player." Other labels are optionally used for various application icons. In some embodiments, the label of a respective application icon includes the name of the application corresponding to the respective application icon. In some embodiments, the label of a particular application icon is different from the name of the application corresponding to the particular application icon.

[0355] Figure 4B A touch-sensitive surface 451 (e.g., Figure 3 a device (e.g., a tablet or touchpad 355) Figure 3Device 300 also optionally includes one or more contact intensity sensors (e.g., one or more of sensors 357) for detecting intensity of contacts on touch-sensitive surface 451 and / or one or more tactile output generators 359 for generating tactile output for a user of device 300.

[0356] Figure 4B A touch-sensitive surface 451 (e.g., Figure 3 a device (e.g., a tablet or touchpad 355) Figure 3 Although many of the examples that follow will be given with reference to input on the touch screen display 112 (where the touch-sensitive surface and the display are combined), in some embodiments, the device detects input on a touch-sensitive surface that is separate from the display, such as Figure 4B In some embodiments, the touch-sensitive surface (e.g., Figure 4B 4B ) has a main axis (eg, 451 in FIG. 4B ) corresponding to a main axis (eg, 453 in FIG. 4B ) on a display (eg, 450 ). Figure 4B According to these embodiments, the device detects contact with the touch-sensitive surface 451 at a location that corresponds to a corresponding location on the display (e.g., Figure 4B 460 and 462 in (e.g., in Figure 4B , 460 corresponds to 468 and 462 corresponds to 470). Thus, on a touch-sensitive surface (e.g., Figure 4B 451) and the display of the multi-function device ( Figure 4B When the user interface 450 in FIG. 1 is separated, the user input detected by the device on the touch-sensitive surface (e.g., contacts 460 and 462 and their movement) is used by the device to manipulate the user interface on the display. It should be understood that similar methods are optionally used for other user interfaces described herein.

[0357] In addition, although the following examples are primarily given with reference to finger inputs (e.g., finger contacts, single-finger tap gestures, finger swipe gestures, etc.), it should be understood that in some embodiments, one or more of these finger inputs are replaced by input from another input device (e.g., mouse-based input or stylus input). For example, a swipe gesture is optionally replaced by a mouse click (e.g., instead of contact), followed by movement of the cursor along the path of the swipe (e.g., instead of movement of the contact). For another example, a tap gesture is optionally replaced by a mouse click when the cursor is over the location of the tap gesture (e.g., instead of detecting the contact, followed by ceasing to detect the contact). Similarly, when multiple user inputs are detected simultaneously, it should be understood that multiple computer mice are optionally used simultaneously, or that a mouse and finger contact are optionally used simultaneously.

[0358] As used herein, the term "focus selector" refers to an input element that indicates the current portion of a user interface with which a user is interacting. In some implementations that include a cursor or other position marker, the cursor acts as a "focus selector" such that when the cursor is over a particular user interface element (e.g., a button, window, slider, or other user interface element), a focus selector is displayed on a touch-sensitive surface (e.g., Figure 3 Touchpad 355 or Figure 4B In the event that an input (e.g., a press input) is detected on the touch-sensitive surface 451 in FIG, the particular user interface element is adjusted according to the detected input. In the case that the touch-sensitive surface 451 in FIG includes a touch screen display (e.g., Figure 1A touch-sensitive display system 112 or Figure 4AIn some implementations (such as a touch screen in a display), a contact detected on the touch screen acts as a "focus selector" such that when input (e.g., a press input by the contact) is detected on the touch screen display at the location of a particular user interface element (e.g., a button, window, slider, or other user interface element), the particular user interface element is adjusted according to the detected input. In some implementations, focus moves from one area of ​​the user interface to another area of ​​the user interface without corresponding movement of a cursor or movement of a contact on the touch screen display (e.g., by using the tab key or arrow keys to move focus from one button to another); in these implementations, the focus selector moves according to the movement of focus between different areas of the user interface. Regardless of the specific form the focus selector takes, the focus selector is typically controlled by the user to communicate (e.g., by indicating to the device the element of the user interface with which the user intends to interact) the user interface element (or contact on the touch screen display) with which the user intends to interact with the user interface. For example, when a press input is detected on a touch-sensitive surface (e.g., a trackpad or touch screen), the position of a focus selector (e.g., a cursor, contact, or selection box) over a corresponding button will indicate that the user intends to activate the corresponding button (rather than other user interface elements shown on the device display).

[0359] As used in this specification and claims, the term "intensity" of a contact on a touch-sensitive surface refers to the force or pressure (force per unit area) of a contact (e.g., a finger contact or a stylus contact) on the touch-sensitive surface, or to a surrogate (surrogate) for the force or pressure of a contact on the touch-sensitive surface. The intensity of a contact has a range of values ​​that includes at least four different values ​​and more typically includes hundreds of different values ​​(e.g., at least 256). The intensity of a contact is optionally determined (or measured) using various methods and various sensors or combinations of sensors. For example, one or more force sensors below or adjacent to the touch-sensitive surface are optionally used to measure the force at different points on the touch-sensitive surface. In some implementations, the force measurements from multiple force sensors are combined (e.g., a weighted average) to determine an estimated contact force. Similarly, the pressure-sensitive tip of the stylus is optionally used to determine the pressure of the stylus on the touch-sensitive surface. Alternatively, the size of the contact area detected on the touch-sensitive surface and / or its change, the capacitance of the touch-sensitive surface adjacent to the contact and / or its change, and / or the resistance of the touch-sensitive surface adjacent to the contact and / or its change are optionally used as a substitute for the force or pressure of the contact on the touch-sensitive surface. In some embodiments, the substitute measurement of contact force or pressure is used directly to determine whether an intensity threshold has been exceeded (e.g., the intensity threshold is described in units corresponding to the substitute measurement). In some embodiments, the substitute measurement of contact force or pressure is converted into an estimated force or pressure, and the estimated force or pressure is used to determine whether an intensity threshold has been exceeded (e.g., the intensity threshold is a pressure threshold measured in units of pressure). Using the intensity of the contact as an attribute of the user input allows the user to access additional device functionality that the user would not otherwise be able to easily access on a smaller device with limited real estate for displaying indications (e.g., on a touch-sensitive display) and / or receiving user input (e.g., via a touch-sensitive display, touch-sensitive surface, or physical / mechanical controls such as knobs or buttons).

[0360] In some embodiments, the contact / motion module 130 uses a set of one or more intensity thresholds to determine whether an action has been performed by a user (e.g., to determine whether a user has "clicked" an icon). In some embodiments, at least a subset of the intensity thresholds are determined based on software parameters (e.g., the intensity thresholds are not determined by the activation threshold of a particular physical actuator and can be adjusted without changing the physical hardware of the device 100). For example, without changing the touchpad or touchscreen display hardware, the mouse "click" threshold of a touchpad or touchscreen display can be set to any one of a large range of predefined thresholds. In addition, in some specific implementations, a software setting is provided to the user of the device for adjusting one or more intensity thresholds in a set of intensity thresholds (e.g., by adjusting individual intensity thresholds and / or by utilizing a system-level click on an "intensity" parameter to adjust multiple intensity thresholds at once).

[0361] As used in the specification and claims, the term "characteristic intensity" of a contact refers to a characteristic of the contact based on one or more intensities of the contact. In some embodiments, the characteristic intensity is based on multiple intensity samples. The characteristic intensity is optionally based on a predefined number of intensity samples or a set of intensity samples collected during a predetermined time period (e.g., 0.05 seconds, 0.1 seconds, 0.2 seconds, 0.5 seconds, 1 second, 2 seconds, 5 seconds, 10 seconds) relative to a predefined event (e.g., after the contact is detected, before the contact is detected to be lifted, before or after the contact begins to move, before the contact ends, before or after the intensity of the contact is detected to increase, and / or before or after the intensity of the contact is detected to decrease). The characteristic intensity of the contact is optionally based on one or more of the following: the maximum value of the contact intensity, the mean value of the contact intensity, the average value of the contact intensity, the value at the top 10% of the contact intensity, the half-maximum value of the contact intensity, the 90% maximum value of the contact intensity, etc. In some embodiments, the duration of the contact is used in determining the characteristic intensity (e.g., when the characteristic intensity is the average value of the intensity of the contact over time). In some embodiments, the feature intensity is compared to a set of one or more intensity thresholds to determine whether the user has performed an operation. For example, the set of one or more intensity thresholds may include a first intensity threshold and a second intensity threshold. In this example, a contact whose feature intensity does not exceed the first threshold results in a first operation, a contact whose feature intensity exceeds the first intensity threshold but does not exceed the second intensity threshold results in a second operation, and a contact whose feature intensity exceeds the second threshold results in a third operation. In some embodiments, the comparison between the feature intensity and the one or more intensity thresholds is used to determine whether to perform one or more operations (e.g., whether to perform the corresponding option or give up performing the corresponding operation), rather than to determine whether to perform the first operation or the second operation.

[0362] In some embodiments, a portion of a gesture is identified for use in determining the characteristic strength. For example, a touch-sensitive surface may receive a continuous swipe contact that transitions from a starting position and reaches an ending position (e.g., a drag gesture) where the strength of the contact increases. In this embodiment, the characteristic strength of the contact at the ending position may be based on only a portion of the continuous swipe contact, rather than the entire swipe contact (e.g., only a portion of the swipe contact at the ending position). In some embodiments, a smoothing algorithm may be applied to the strength of the swipe gesture before determining the characteristic strength of the contact. For example, the smoothing algorithm optionally includes one or more of the following: an unweighted sliding average smoothing algorithm, a triangular smoothing algorithm, a median filter smoothing algorithm, and / or an exponential smoothing algorithm. In some cases, these smoothing algorithms eliminate narrow peaks or dips in the strength of the swipe contact for use in determining the characteristic strength.

[0363] The user interface diagrams described herein optionally include various intensity diagrams that illustrate the intensity of contacts on the touch-sensitive surface relative to one or more intensity thresholds (e.g., contact detection intensity threshold IT0, light press intensity threshold IT1, and contact detection intensity threshold IT2). L , deep press intensity threshold IT D (For example, it is initially at least above 1 L ) and / or one or more other intensity thresholds (e.g., L Lower intensity threshold I H )). This intensity graph is not typically part of the displayed user interface, but is provided to help explain the graph. In some embodiments, the light press intensity threshold corresponds to an intensity at which the device will perform an operation typically associated with clicking a button of a physical mouse or a trackpad. In some embodiments, the deep press intensity threshold corresponds to an intensity at which the device will perform an operation different from the operation typically associated with clicking a button of a physical mouse or a trackpad. In some embodiments, when a contact is detected having a characteristic intensity below the light press intensity threshold (e.g., and above a nominal contact detection intensity threshold IT0, below which contacts are no longer detected), the device will move the focus selector in accordance with the movement of the contact on the touch-sensitive surface without performing an operation associated with the light press intensity threshold or the deep press intensity threshold. Generally speaking, unless otherwise noted, these intensity thresholds are consistent between different groups of user interface figures.

[0364] In some embodiments, the device's response to an input detected by the device depends on criteria based on the intensity of the contact during the input. For example, for some "light press" inputs, the intensity of the contact exceeding a first intensity threshold during the input triggers a first response. In some embodiments, the device's response to an input detected by the device depends on criteria that include both the intensity of the contact during the input and a time-based criterion. For example, for certain "deep press" inputs, a contact intensity exceeding a second intensity threshold during the input, which is greater than the first intensity threshold for a light press, triggers a second response only after a delay time has elapsed between reaching the first intensity threshold and reaching the second intensity threshold. This delay time typically lasts less than 200ms (e.g., 40ms, 100ms, or 120ms, depending on the magnitude of the second intensity threshold, with the delay time increasing as the second intensity threshold increases). This delay time helps avoid accidental deep press inputs. As another example, for some "deep press" inputs, a period of reduced sensitivity occurs after reaching the first intensity threshold. During this period of reduced sensitivity, the second intensity threshold is increased. This temporary increase in the second intensity threshold also helps avoid accidental deep press inputs. For other deep press inputs, the response to detecting the deep press input does not depend on time-based criteria.

[0365] In some embodiments, one or more of the input intensity thresholds and / or corresponding outputs vary based on one or more factors, such as user settings, contact motion, input timing, application running, rate at which intensity is applied, number of concurrent inputs, user history, environmental factors (e.g., ambient noise), focus selector position, etc. Exemplary factors are described in U.S. patent application serial numbers 14 / 399,606 and 14 / 624,296, which are incorporated herein by reference in their entireties.

[0366] For example, Figure 4C A dynamic intensity threshold 480 is shown that varies over time based in part on the intensity of the touch input 476 over time. The dynamic intensity threshold 480 is the sum of two components: a first component 474 that decays over time after a predefined delay time p1 from when the touch input 476 is initially detected, and a second component 478 that tracks the intensity of the touch input 476 over time. The initial high intensity threshold of the first component 474 reduces accidental triggering of a "deep press" response while still allowing an immediate "deep press" response if the touch input 476 provides sufficient intensity. The second component 478 reduces the unintentional triggering of a "deep press" response through gradual intensity fluctuations of the touch input. In some embodiments, when the touch input 476 satisfies the dynamic intensity threshold 480 (e.g., at Figure 4C ), triggering a “deep press” response.

[0367] Figure 4D Another dynamic intensity threshold 486 (eg, intensity threshold I D ). Figure 4D Two other intensity thresholds are also shown: a first intensity threshold I H and the second intensity threshold I L .exist Figure 4D Although the touch input 484 meets the first intensity threshold I before time p2, H and the second intensity threshold I L , but no response is provided before the delay time p2 at time 482. In addition, Figure 4D In the example, the dynamic intensity threshold 486 decays over time, wherein the decay is from time 482 (when the trigger is connected to the second intensity threshold I L This type of dynamic intensity threshold reduction begins immediately after the trigger is triggered with a lower threshold intensity (such as the first intensity threshold I H Or the second intensity threshold I L ) is triggered after or simultaneously with the response associated with the dynamic intensity threshold I D The associated response.

[0368] Figure 4E Yet another dynamic intensity threshold 492 (eg, intensity threshold I D 4E, after the initial detection of the touch input 490 and the delay time p2, the trigger is triggered with the intensity threshold I L At the same time, the dynamic intensity threshold 492 decays after the initial detection of the touch input 490 and after a predefined delay time p1. L The associated response followed by decreasing the intensity of the touch input 490, then increasing the intensity of the touch input 490 without releasing the touch input 490 may trigger a response associated with the intensity threshold I. D The associated response (e.g., at time 494) is performed even when the intensity of touch input 490 is below another intensity threshold, such as intensity threshold I. L The same is true when.

[0369] The characteristic intensity of the contact is below the light press intensity threshold IT I The intensity increases to between the light press intensity threshold IT L and deep press intensity threshold IT D The intensity between the deep press intensity threshold IT is sometimes referred to as a "light press" input. D The intensity of the deep press increases to above the deep press intensity threshold IT DThe intensity of the contact is sometimes referred to as a "deep press" input. The characteristic intensity of the contact increases from an intensity below the contact detection intensity threshold IT0 to an intensity between the contact detection intensity threshold IT0 and the light press intensity threshold IT0. L A decrease in the characteristic intensity of a contact from an intensity above the contact detection intensity threshold IT0 to an intensity below the contact detection intensity threshold IT0 is sometimes referred to as detecting liftoff of the contact from the touch surface. In some embodiments, IT0 is zero. In some embodiments, IT0 is greater than zero. In some illustrations, shaded circles or ellipses are used to represent the intensity of contacts on the touch-sensitive surface. In some illustrations, unshaded circles or ellipses are used to represent corresponding contacts on the touch-sensitive surface without specifying the intensity of the corresponding contacts.

[0370] In some embodiments described herein, one or more operations are performed in response to detecting a gesture that includes a corresponding press input or in response to detecting a corresponding press input performed using a corresponding contact (or multiple contacts), wherein the corresponding press input is detected at least in part based on detecting that the strength of the contact (or multiple contacts) increases to above a press input strength threshold. In some embodiments, the corresponding operation is performed in response to detecting that the strength of the corresponding contact increases to above the press input strength threshold (e.g., the corresponding operation is performed on a "down stroke" of the corresponding press input). In some embodiments, the press input includes an increase in the strength of the corresponding contact to above the press input strength threshold and the strength of the contact subsequently decreases to below the press input strength threshold, and the corresponding operation is performed in response to detecting that the strength of the corresponding contact subsequently decreases to below the press input threshold (e.g., the corresponding operation is performed on an "up stroke" of the corresponding press input).

[0371] In some embodiments, the device employs intensity hysteresis to avoid unintended input, sometimes referred to as "jitter," where the device defines or selects a hysteresis intensity threshold that has a predefined relationship to a press input intensity threshold (e.g., the hysteresis intensity threshold is X intensity units less than the press input intensity threshold, or the hysteresis intensity threshold is 75%, 90%, or some reasonable proportion of the press input intensity threshold). Thus, in some embodiments, a press input includes an increase in the intensity of the corresponding contact to above the press input intensity threshold and a subsequent decrease in the intensity of the contact to below a hysteresis intensity threshold corresponding to the press input intensity threshold, and a corresponding operation is performed in response to detecting that the intensity of the corresponding contact subsequently decreases below the hysteresis intensity threshold (e.g., performing the corresponding operation on an "up stroke" of the corresponding press input). Similarly, in some embodiments, a press input is detected only when the device detects that the intensity of the contact increases from an intensity equal to or less than a hysteresis intensity threshold to an intensity equal to or greater than a press input intensity threshold and, optionally, the intensity of the contact subsequently decreases to an intensity equal to or less than the hysteresis intensity, and a corresponding operation is performed in response to detecting the press input (e.g., an increase in the intensity of the contact or a decrease in the intensity of the contact, depending on the circumstances).

[0372] For ease of explanation, descriptions of operations performed in response to a press input associated with a press input intensity threshold, or in response to a gesture including a press input, are optionally triggered in response to detecting: the intensity of the contact increasing to above the press input intensity threshold, the intensity of the contact increasing from an intensity below a hysteresis intensity threshold to an intensity above the press input intensity threshold, the intensity of the contact decreasing to below the press input intensity threshold, or the intensity of the contact decreasing to below a hysteresis intensity threshold corresponding to the press input intensity threshold. Additionally, in examples where operations are described as being performed in response to detecting a decrease in the intensity of the contact below the press input intensity threshold, the operations are optionally performed in response to detecting a decrease in the intensity of the contact below a hysteresis intensity threshold that corresponds to and is less than the press input intensity threshold. As described above, in some embodiments, triggering of these operations is also dependent on satisfying a time-based criterion (e.g., a delay time having elapsed between satisfying the first intensity threshold and satisfying the second intensity threshold).

[0373] User interface and associated processes

[0374] Attention now turns to embodiments of a user interface (“UI”) and associated processes that may be implemented on an electronic device such as portable multifunction device 100 or device 300 having a display, a touch-sensitive surface, and (optionally) one or more sensors for detecting intensity of contacts with the touch-sensitive surface.

[0375] These user interfaces and associated procedures provide new and improved methods for:

[0376] Confirm the message;

[0377] Edit previously sent messages;

[0378] Display the edit history of previously sent messages;

[0379] Applying impact effects to messages (e.g., to convey what the user is trying to convey);

[0380] Use "hidden ink" to display private messages;

[0381] Displaying enhanced instant messaging interface content (e.g., "full screen moments");

[0382] Displaying content corresponding to a specific combination of content in two separate messages (e.g., “Magic Moment”);

[0383] Create message bubbles;

[0384] Suggest emojis

[0385] Synchronize viewing of content between users;

[0386] Incorporate handwriting input;

[0387] Selectively shrink content in message transcripts;

[0388] Integrated camera;

[0389] Integrated search and sharing;

[0390] Integrate interactive applications;

[0391] Integrated textures;

[0392] Make a payment;

[0393] Interact with the avatar; and

[0394] Provide advice.

[0395] Figures 5A to 5K An exemplary user interface for displaying message transcripts and message confirmations according to some embodiments is shown. Specifically, Figure 5A Instant messaging user interface 5002 of an instant messaging user interface (e.g., of an instant messaging application) displayed on a display of an electronic device, which is sometimes referred to as a first electronic device to help distinguish it from other electronic devices communicating with the first electronic device. The first electronic device also includes a touch-sensitive surface and one or more sensors, such as in a touch screen display or a touchpad, configured to detect intensity of contact on the touch-sensitive surface.

[0396] like Figure 5A The instant messaging user interface 5002 shown includes a conversation transcript 5004 of an instant messaging conversation between a user of an electronic device (e.g., Genevive) and at least one other user of another electronic device (e.g., Isaac). The conversation transcript 5004 in this embodiment includes multiple messages, each of which is located in a corresponding message area 5008. A first input having a first contact 5010 at a location on the touch-sensitive surface corresponds to a first message 5006. In response to detecting the first input 5010, the electronic device displays a confirmation selection enable indication 5012 ( Figure 5B ). In this embodiment, the confirmation selection indicator indicates that multiple confirmation options are displayed: 5014-1 (heart), 5014-2 (Like), 5014-3 (Dislike), 5014-4 ("HA"), 5014-5 ("!!"), and 5014-6 ("?"). Other embodiments may include fewer, additional, or different confirmation options. The electronic device responds to receiving a second input 5106 through a second contact (e.g., a tap gesture, a light press gesture, a deep press gesture, or lift-off) on a corresponding confirmation option (or a hit area corresponding to each confirmation option), such as option 5014-2 (Like), to select the corresponding confirmation option and apply it to the first message 5006 or the first message area 5008-1, as shown in FIG. Figure 5C As shown. The confirmation option selected in the exemplary option 5014-2 is displayed in the corresponding confirmation area 5018. Figure 5H As shown, the electronic device of the other user (Isaac in this embodiment) participating in the instant messaging session (sometimes referred to as a conversation) displays the same selected confirmation option adjacent to the first message area.

[0397] To edit the selected confirmation option, the user performs a third input through the third contact 5022, as shown in FIG5C. When the third input performed through the third contact is detected, the electronic device displays a confirmation editing interface 5024, as shown in FIG5C. Figure 5D Optionally, the confirmation editing interface is displayed on top of and / or in place of the conversation transcript. Optionally, in this exemplary option 5014-2, the currently selected confirmation option is visually distinguished from other available confirmation options in the confirmation editing interface 5024, as shown. Figure 5D shown.

[0398] Figure 5E An input contact 5026 is shown for selecting a different second confirmation option 5014-1, and Figure 5F The message area in the conversation transcript is shown with the confirmation edited (ie, the second confirmation option 5014-1 is displayed, while the first confirmation option 5014-2 is not displayed).

[0399] In some embodiments, when a user of a first electronic device uses the confirmation editing interface 5024 to edit a confirmation option previously selected for the first message area, an electronic device of another user in the instant messaging conversation displays a confirmation ready indicator 5020 adjacent to (e.g., near, adjacent to, or partially overlapping) the first message area in the conversation transcript 5004 displayed by the electronic device, such as Figure 5G shown.

[0400] Different users in the same instant messaging session can select different confirmation options for the same message or message area. In some embodiments, such as Figure 5I As shown, the electronic device displays a mark 5036 in the conversation transcript, which indicates that the user in the instant messaging conversation has selected multiple confirmation options for the second message area. Figure 5I In the embodiment shown, the mark 5036 is a stack of overlapping confirmation option icons, but it can also be multiple separate confirmation option icons. Figure 5I As shown, the marker 5036 is optionally adjacent to and / or partially overlaps the second message area 5008-02.

[0401] Figure 5J An embodiment of a user interface is shown that includes a count of each type of confirmation option selected by a user in an instant messaging session. Figure 5J As shown, the user interface includes counts 5040-1, 5040-2, 5040-3 of three different confirmation options selected by the user in the instant messaging session. In some embodiments, in response to detecting contact (e.g., Figure 5I The electronic device displays the input made by the contact 5034 in the Figure 5J In the user instant messaging interface shown, the mark indicates that multiple users in the instant messaging conversation have selected the confirmation option for the same message (or corresponding message area).

[0402] By selecting one of the counts 5040, the user can see the user who has selected any particular confirmation option. Figure 5J The electronic device displays an icon 5042 (eg, a head image) representing a user who has selected a specific confirmation option of the corresponding message area, as shown in FIG. Figure 5K shown.

[0403] Figures 5L to 5T An exemplary user interface for editing a previously sent message while displaying a message transcript is shown. Figure 5L An instant messaging user interface 5002 of an instant messaging application on a display of an electronic device is shown. The instant messaging user interface 5002 includes: a conversation transcript 5004 of an instant messaging conversation between a user of the electronic device and at least one other user, and a first message area 5044 including a first message 5046-1 sent from the user's electronic device to the at least one other user in the instant messaging conversation.

[0404] The first message 5046-1 can be edited even though it has already been sent. To begin editing the first message, the user selects the first message using a predefined touch input 5048 (e.g., a tap gesture, a long press gesture, a light press gesture, or a deep press gesture) on the first message or the message area of ​​the first message. In some embodiments, the electronic device displays a menu interface, such as Figure 5M Alternatively, the electronic device displays the message editing interface 5022 in response to detecting the input 5048, as shown in FIG. Figure 5N In some embodiments, a first input gesture (e.g., a tap gesture) on the first message is used to transition to a menu interface (e.g., as shown in FIG. 5M ), and a second input gesture (e.g., a deep press) is used to transition to Figure 5N Message editing interface 5052. Figure 5M The menu interface shown, the user can select the edit option by touch input 5050 ( Figure 5M ) Transform instant messaging applications into Figure 5N Message editing interface 5022 is shown.

[0405] Figure 5N Message editing interface 5052 for editing a corresponding message (e.g., first message 5046-1) includes keyboard 5054 and update-enabled representation 5056. While displaying message editing interface 5052 for the corresponding message, the electronic device detects one or more inputs to modify the corresponding message (e.g., input 5057 shown in FIG. 5N ), displays the modified version of the message, and detects input to activate the update-enabled representation (e.g., to send the updated message to one or more other electronic devices of one or more other participants in the instant messaging conversation).

[0406] Figure 5O The conversation transcript 5004 is shown after the updated message 5046. Because the conversation transcript 5004 includes an edited message, the edited message includes one or more indications 5058 that the particular message was modified after the original version of the message was sent to the other participants in the instant messaging conversation. Figure 5OIn FIG, there are two such modification indications: indication 5058-1 is the shaded area behind the message area; indication 5058-2 is the text (e.g., "Edited") displayed below the message area containing the modified version of the message.

[0407] The edited or modified message can be edited again. The electronic device responds to an input corresponding to a request for editing a modified version 5046-2 of the message (e.g., Figure 5O Input 5060) and display the message editing interface of the modified version of the message, such as Figure 5R shown. Figure 5R The message editing interface shown includes the message 5046-2 to be edited, a keyboard, and an update enable indication (optionally not displayed until the message is modified at least once).

[0408] A participant in an instant messaging session may request to view all versions of an edited message or two or more versions. Figure 5O Predefined input 5060, on the edited message, the electronic device displays Figure 5P 5060) and a menu 5062 or list of edit options. In this embodiment, the displayed menu 5062 includes a copy affordance 5064 (for copying the message selected by input 5060), a show edit affordance 5066 (for displaying edits to the message selected by input 5060), a delete affordance 5068 (for deleting the message selected by input 5060, or alternatively for undoing all edits made to the message selected by input 5060), and a show more options affordance 5070. Figure 5P In the illustrated embodiment, input 5072 (e.g., a tap gesture) is detected on the touch-sensitive surface at a location corresponding to the location of “show edits” affordance 5066, which, when activated, displays user interface 5074 ( FIG. 5Q ) that includes current version 5046-1 and previous version 5046-2 of the first message, as shown in FIG. Figure 5Q shown. Figure 5Q Another input 5076 or 5078 in the user interface of the message is used to select a version of the message to be edited. For example, the selected version is highlighted, and then a touch input on Edit 5080 will start editing the selected version of the message. Alternatively, a touch input on Done 5082 terminates editing of the selected version of the message.

[0409] Figure 5P An alternative to the edit menu interface shown is Figure 5S The edit menu interface shown includes the selected message (in response to Figure 5O) and a menu including an affordance (e.g., a "Show Edit" option 5086) that, when activated, displays Figure 5T 1. The user interface shown includes a current version 5046-2 of the selected message and one or more previous versions (eg, version 5046-1) of the selected message.

[0410] Figures 5U to 5BF An exemplary user interface for applying a shock effect option to a message input or message area is shown. Figure 5U An instant messaging user interface 5002 is shown, which includes a conversation transcript 5004 of an instant messaging conversation between a user of an electronic device (Wendy in this embodiment) and at least one other user (e.g., Max, a user of another electronic device in this embodiment) and a message input area 5100 including a first message input 5102 (e.g., text, stickers, images, and / or other graphics entered by the user of the electronic device in the message input area but not yet sent to the at least one other user in the instant messaging conversation). Figure 5U , the first message input 5102 has not yet been sent.

[0411] In some embodiments, to trigger Figure 5AA Upon activation of the impact selection interface 5110 of the touch-sensitive surface, first input 5102 made by a first contact at a location on the touch-sensitive surface corresponding to a location in the message input area 5100 includes a specific gesture (e.g., a swipe gesture) received at the message input area 5100. In this embodiment, the message input area includes an impact selection enable indication 5104, and the location of the contact 5106 of the first input corresponds to the impact selection enable indication. In some embodiments, the impact selection enable indication 5104 is a multi-purpose enable indication, and a second gesture (e.g., a tap) on the same enable indication 5104 is used to send the message 5102 in the message input area 5100. Upon detecting an input including a second gesture on the enable indication 5104, the electronic device sends the message 5102 and transitions to Figure 5V Similarly, after sending message 5102, another user's electronic device receives the message and displays Figure 5W The user interface shown.

[0412] exist Figure 5X 、 Figure 5Y and Figure 5Z In some alternative embodiments shown, Figure 5X 、 Figure 5Y and Figure 5Z The deep press inputs 5108-1, 5108-2, 5108-3 shown, when detected by the electronic device, will cause the instant messaging application to display Figure 5AA The impact selection interface 5110 includes a plurality of impact effect options (eg, impact effect options 5112-1 to 5112-4). The increasing intensity of the deep press input is determined by Figure 5X 、 Figure 5Y and Figure 5Z In addition, as Figure 5X 、 Figure 5Y As shown in FIG5Z , deep press input 5108 - 1 , 5108 - 2 , 5108 - 3 is performed on the shock selection enable representation 5104 , and then dragged to the first shock effect option (eg, Figure 5AA Input 5108-4 on the shock effect option 5112-1), and then pause above the enable indication of the corresponding shock effect option 5112, to select the shock effect option.

[0413] Figure 5AA The impact selection interface 5110 includes a "bubble" enable representation 5114 for displaying a selection message area impact effect option, and a "screen" enable representation 5116 for selecting a full screen impact effect option.

[0414] In some embodiments, the impact selection interface 5110 shows an animated preview of the currently selected impact effect option. For example, Figures 5AB to 5AD 5 shows an animated preview of the "shout out" shock effect option (which is a message area shock effect option) applied to a first message input ("Congratulations!") in response to input 5108-5 at a location on the touch-sensitive surface corresponding to the location of the "shout out" shock effect option. In this embodiment, the preview of the "shout out" shock effect option shows that the font size of the message and the size of the message area first increase and then decrease.

[0415] For example, Figures 5AE to 5AG The sequence shows an animated preview of a "boom boom explosion" shock effect option (which is a message area shock effect option) applied to a first message input ("Congratulations!") in response to a second input 5108-6 at a location on the touch-sensitive surface corresponding to the location of the "boom boom explosion" shock effect option. In this embodiment, the preview of the "boom boom explosion" shock effect option shows that the font size of the message and the size of the message area first increase and then decrease, while changing the tilt or rotation state of the message area and optionally changing the hue or color of the background area surrounding the message area. Optionally, the application of the corresponding shock effect option can change additional features of the message area to which the shock effect option is applied, such as the font color, background hue or color, etc. within the message area.

[0416] Figure 5AGAlso shown is a third input 5108-7 on the send affordance at a location corresponding to the user-selected shock effect option, in this case the "BOOM BOOM BUMP" option. In response, the electronic device of the user composing the message stops displaying the shock selection interface and displays the message area including the first message input in the conversation transcript, and in some embodiments, applies the selected shock effect option to the message area, as shown in FIG. Figure 5AH as shown, or applied to the entire conversation transcript, as in Figure 5AI (expanding the message area with the shock effect option applied and reducing the size of one or more other message areas in the conversation transcript), and then transitioning to a final or static display of the conversation transcript including the sent message, as shown. Figure 5AJ Similarly, the sent message is displayed on the electronic devices of one or more other users (e.g., Wendy) in the instant messaging conversation, with the selected shock effect option being applied to either the message area of ​​the sent message or the entire conversation transcript, depending on which shock effect option the sending user selected, an example of which is shown in Figure 5AK 、 Figure 5AL 、 Figure 5AM The sequence is shown in FIG.

[0417] Figures 5AN to 5AS The sequence of shows an embodiment of a "shout out" impact effect option applied to a corresponding sent message ("Congratulations"). Figure 5AT to Figure 5AW The sequence of illustrates an embodiment of a "gentle whisper" impact effect option applied to a corresponding sent message ("Sorry.").

[0418] In some embodiments, the selected impact effect option is applied to all (or substantially all) of the display screen of the electronic device sending or receiving the message to achieve a full screen effect, the display screen including the message area with the sent message, an example of which is shown by Figures 5AX to 5BF A sequence of user interface images is shown in FIG. Figures 5AX to 5BF The progression of the "boom boom explosion" effect for the first message input ("Of course not!!") is shown, starting with an enlarged, rotating display of the first message input against a dark background ( Figure 5AX ), then even larger with a slightly lighter background ( Figure 5AY ), then scaled down and rotated at a different angle than before ( Figure 5AZ ), then further reduced in size with blurred borders (Figure 5BA), then displayed at a smaller size with different backgrounds and different rotation angles (Figure 5BB), and then with a range of different shadows around the message area ( Figure 5BC 、 Figure 5BD 、 Figure 5BE ) until the first message input is displayed at normal (default) size, without rotation, and with a normal (default) background ( Figure 5BF ).

[0419] Figures 5BG to 5CA An exemplary user interface for interacting with hidden messages is shown. Figure 5BG The illustrated impact selection interface 5110 includes a plurality of impact effect options (e.g., impact effect options 5112-1 through 5112-4, as described elsewhere in this document with respect to Figure 5AA In this embodiment, impact selection interface 5110 further includes a "bubble" affordance 5114 for displaying a message area impact effect option, and a "screen" affordance 5116 for selecting a full-screen impact effect option.

[0420] In some embodiments, the displayed shock effect options include an option to hide the message content in the conversation transcript ( Figure 5AA The "Hidden Ink" option 5112-1, in Figure 5BG Indicated by an empty message area in the Figure 5BG In the illustrated embodiment, the obscured ink option includes a send affordance 5118 for sending a message (with a user-specified message input) with the corresponding impact effect option. Figure 5BG In the illustrated embodiment, the impact selection interface 5110 includes a cancel indication 5120 for canceling a selection of any impact effect option and returning the instant messaging application to a previous user interface of the instant messaging application or a predefined user interface of the instant messaging application.

[0421] Once a message is sent using the hidden ink option (hereinafter referred to as a "hidden message" for ease of reference), the hidden message will not be displayed or will be obscured, for example, by the screen element 5124 used to hide the message, such as Figure 5BH As shown, until the user of the electronic device displaying the conversation transcript including the hidden message performs a corresponding gesture such as a sliding touch input 5128-a, 5128-b, 5128-c on the message area including the hidden message, as shown Figures 5BH to 5BL As shown in the sequence of , the gesture will temporarily reveal a portion of the message corresponding to the location of the touch input 5128-1, 5128-b, 5128-c; or perform a deep press gesture on the message area including the hidden message, as shown in the sequence of Figure 5BM to Figure 5BP , wherein the hidden message is partially revealed based on the intensity of deep press inputs 5130-a, 5130-b, 5130-c and optionally also based on the location of deep press inputs 5130-a, 5130-b, 5130-c. In these embodiments, in response to detecting termination of input via contact that caused the hidden message or portion thereof to be temporarily revealed, the hidden message is hidden again.

[0422] In another embodiment, Figures 5BQ to 5BV The sequence shows the hidden message being gradually revealed, as Figure 5BQ to Figure 5BT As shown, and then gradually hidden, as Figures 5BT to 5BV In yet another embodiment, Figure 5BW to Figure 5CA The sequence shows a hidden message that includes gradually revealing pictures or photos.

[0423] Figure 5CB to Figure 5CW An exemplary user interface is shown for triggering enhanced message content and applying the effect to an instant messaging user interface when the message includes an enhanced message content trigger. More specifically, the enhanced message content trigger can be used to send a corresponding message in an instant messaging conversation, and when an electronic device with a compatible instant messaging application receives a message with the enhanced message content trigger, the electronic device displays a transcript of the conversation with the received message and the enhanced message content. In some embodiments, the specific enhanced message content to be displayed is indicated by one or more parameters in the enhanced message content trigger.

[0424] Figure 5CB and Figure 5CC An embodiment of a user interface showing a preview of a full-screen impact effect is shown, in this case a full-screen impact effect including a moving or animated balloon 5152-1. As shown in FIG5CB , the electronic device user who wrote the message “Congratulations!” has selected the “Screen” affordance 5116 for selecting the full-screen impact effect option. Similarly, Figures 5CD to 5CF The sequence of FIG5 illustrates an embodiment of a user interface that displays a preview of a full-screen impact effect, in this case a full-screen impact effect that includes moving or animated confetti 5152-2. In the embodiment shown here, the user uses a swipe gesture (e.g., Figure 5CC The swipe gesture 5156 shown navigates through the available full screen impact effects, which allows the electronic device to navigate from Figure 5CC The preview of the balloon full screen impact effect is moved to Figure 5CD The confetti full screen impact effect shown. Figure 5CB and Figure 5CC As shown, the user interface may include effect option indicators 5154 (sometimes referred to as page dots) to indicate the full screen effect option currently selected or currently being previewed, and also to indicate how many full screen effect options are available and which option or options in the sequence of full screen effect options are currently being viewed.

[0425] Figure 5CG is an embodiment of a user interface with a transcript of a conversation in which none of the messages includes an enhanced message content trigger, so the message in the transcript is displayed without the enhanced message content corresponding to the trigger.

[0426] Figures 5CH to 5COThe sequence of shows an embodiment of a balloon full screen effect displayed when a message ("Happy Birthday!!!!") including a corresponding enhanced message content trigger is received. Similarly, Figure 5CP to Figure 5CW The sequence shows an embodiment of a fireworks full-screen effect displayed when a message (“Happy New Year!!!”) including a corresponding enhanced message content trigger is received.

[0427] Figures 5CX to 5DC An exemplary user interface for detecting and responding to composable content in a single message is shown. Figure 5CX In the instant messaging user interface 5002, the instant messaging user interface 5002 includes: a conversation transcript 5004 of an instant messaging conversation between a user of the electronic device and at least one other user (e.g., a user of another electronic device) including a first other user, and a message input area 5100. The received first message 5170 in the first message area 5008 is displayed in the conversation transcript 5004. The first message 5170 (e.g., a beer glass) has a first combinable content (e.g., an emoticon or an image such as an emoticon or a sticker). Figure 5CY , the user of the electronic device enters a second message 5172 in the message input area 5100 of the instant messaging user interface 5002 and sends the second message 5172 by selecting the input 5174 for sending the affordance 5118. This results in the display Figure 5CZ The instant messaging user interface shown.

[0428] If the second message 5172 includes second combinable content that forms a predefined combination with the first combinable content (content 5176) in the first message 5170, the electronic device displays content corresponding to the predefined combination, such as an animation of two beer glasses clinking together (e.g., Figure 5DA and / or display the words "Cheers!" (as shown in Figure 5DA ). Similarly, the electronic devices of one or more other users in the instant messaging conversation will display the first message, the second message, and the content corresponding to the predefined combination. Note that the content 5176 corresponding to the predefined combination can be an animation that is briefly displayed after the second message is sent. Optionally, the content corresponding to the predefined combination is repeatedly displayed periodically while both the first message and the second message with the combinable content are displayed in the conversation transcript 5004, or when other predefined criteria are met (for example, both the first message and the second message with the combinable content are displayed in the conversation transcript 5004, and when N is a predefined value between 1 and 60 seconds, there is no new activity in the instant messaging conversation for at least N seconds).

[0429] Figure 5DB and Figure 5DC5CH to 5CH illustrate another embodiment of combinable content, wherein the first user has sent a first message 5178 "Birthday" and the second user enters a second message 5180 "Happy!" If both the first message and the second message include combinable content corresponding to a predefined combination, the content corresponding to the predefined combination will be displayed in the message transcript of the instant messaging user interface displayed by the sender's electronic device or the recipient's electronic device or (usually) both. For example, in this embodiment, the content corresponding to the predefined combination can be a balloon, similar to FIG. Figure 5CO shown.

[0430] Figures 5DD to 5DI An exemplary user interface for selecting a message area type or shape is shown according to some embodiments. Figure 5DD Instant messaging user interface 5002 is shown including a message input area 5100 with a first message input 5102 ("Yes!") entered into the message input area. Instant messaging user interface 5002 includes a send affordance 5200 located in or near message input area 5100 for sending the message entered into the area. In addition, Figure 5DD Input is shown via contact 5202 on option enable indication 5204.

[0431] Figure 5DE The instant messaging user interface shown is displayed in response to input made by contact 5202 on option enable representation 5204, wherein the option enable representation includes enable representations of multiple message processing options, including Figure 5DE 5208. In the example, the message area type / shape selection affordance 5208 is labeled as a “bubble” affordance. When the instant messaging user interface is displayed, the electronic device receives input by contact 5206 on the “bubble” option affordance 5208.

[0432] In response to input via contact 5206 on the "bubble" indication 5208, the display Figure 5DF The instant messaging user interface shown. Figure 5DFAlso shown is a preview message area 5210-1 that includes a first message input 5102 and has a default or previously selected message area type. In these embodiments, the instant messaging application has multiple message area types or options, each message area type or option having a corresponding shape, and typically having a corresponding font size, and optionally having one or more of the following: font color, border color, and / or background color. In the embodiment shown in Figure 5DF, the send enable indication 5200 is displayed near the preview message area 5210-1, rather than being displayed in the message input area 5100. In order to select a different message area type for the first message 5172 or to view other available message area types, the user enters a swipe gesture 5212. In response to the swipe gesture 5212, a group of message area type icons are scrolled, such as from Figures 5DF to 5DG progress shown.

[0433] exist Figure 5DG In the embodiment of the instant messaging user interface shown, input is received via contact 5214, which causes the electronic device to change the message area type to be used for the message area of ​​message input 5102, such as Figure 5DH As shown. Figure 5DH , the message input 5102 is now displayed in the message area 5210-2, which has the same characteristics as those of the message input 5102 as those of the message input 5102. Figure 5DG The message area type selected by the input (as shown) corresponds to the message area type. The user can continue to select different message area types. For example, Figure 5DI , message input 5102 is now displayed in message area 5210 - 3 , which has a message area type corresponding to the message area type selected by the input with contact 5216 .

[0434] Figures 5DJ to 5DQ An exemplary user interface for automatically displaying and selecting suggested emoticons when composing a message is shown. Figure 5DJ , an instant messaging user interface 5002 is shown having a conversation transcript 5004 with an entered but not yet sent message 5220 in a message input area 5100. In this embodiment, the instant messaging user interface 5002 includes a send affordance 5200 located in or near the message input area 5100 for sending the entered message.

[0435] like Figures 5DK to 5DN As shown, the electronic device begins to automatically provide emoji suggestions to replace one or more words or terms in the message input area 5100. In the embodiment shown, the electronic device highlights the words or phrases that are candidates for replacement with emojis in the order in which they appear in the message, first highlighting the term "sushi" 5222 in the input message 5220, as shown in FIG. Figure 5DK and Figure 5DL As shown, the term "wine" 5224 in the input message 5220 is then highlighted, as shown Figure 5DM As shown, the term "bowling" 5226 in the input message 5220 is then highlighted, as shown in Figure 5DN. In response to the user of the electronic device selecting one of the highlighted terms (e.g., input via contact on the highlighted term), such as "sushi" 5222 in the input message 5220, the term is replaced by the corresponding emoticon 5232 corresponding to the term, as shown in Figure 5DN. Figure 5DO As shown. Similarly, in Figure 5DP In the example, in response to a user selection of the highlighted term "wine" in input message 5220, the term "wine" in input message 5220 has been replaced with an emoji 5234 corresponding to the term (e.g., a wine glass emoji). In a third example, in response to a user selection of the highlighted term "bowling" in input message 5220, the term "bowling" in input message 5220 has been replaced with an emoji 5236 corresponding to the term (e.g., a bowling ball emoji).

[0436] Message confirmation

[0437] Figures 6A to 6E is a flowchart of a process for applying a confirmation to a message area in a conversation transcript according to some embodiments. More specifically, these methods involve displaying a confirmation selection affordance including multiple confirmation options and applying the selected confirmation option to the received message. In some embodiments, an indication of the applied confirmation option is transmitted to a remote device (e.g., to be displayed in the conversation transcript on the remote device). The confirmation allows the user to quickly convey an emotion without having to type multiple words. This can save the user time by saving keystrokes, thereby creating a more efficient human-computer interaction.

[0438] One or more examples of electronic devices (e.g., portable multifunction device 100 or device 300) that implement these methods are described in Figures 5A to 5K Shown in.

[0439] Figures 6A to 6E is a flowchart illustrating a method 600 performed by an electronic device having one or more processors, a memory, a touch-sensitive surface, and a display (sometimes referred to herein as a first electronic device). In some embodiments, the electronic device includes one or more sensors configured to detect intensity of contact on the touch-sensitive surface (e.g., sensors in a touch screen display or a trackpad).

[0440] When executing method 600, the electronic device displays an instant messaging user interface 602 (e.g., of an instant messaging application) on a display. The instant messaging user interface includes a transcript of an instant messaging conversation between a user of the electronic device and at least one other user (e.g., of another electronic device). See, e.g., Figure 5A The electronic device receives the first message 604 in the instant messaging conversation from an electronic device (e.g., a second electronic device) corresponding to another user included in the instant messaging conversation. Figure 5A Among them, message 5006 is the first message.

[0441] In response to receiving the first message, the electronic device displays a transcript of the conversation on the display (e.g., Figure 5A The first message area of ​​the conversation transcript 5004) (e.g., Figure 5A The first message (eg, Figure 5A As used herein, a message area is a message area, bubble, disk, or other container for messages in a conversation transcript of an instant messaging conversation. Additionally, the electronic device detects a first contact (e.g., Figure 5A The first input 608 is performed by a contact 5010 of the first message area. For example, the first contact may be a tap gesture, a long press gesture, a light press gesture, or a deep press gesture on the first message area or on the hidden hit area of ​​the first message area.

[0442] Next, in response to detecting the first input, the electronic device displays a confirmation selection indicator (eg, Figure 5B 5B . For example, see confirmation options 5014-1 to 5014-6 in FIG. 5B . In some embodiments, the confirmation selection enable representation is a confirmation selection disk displayed adjacent to the first message area and / or overlapping with the first message area. In some embodiments, the confirmation selection enable representation is displayed based on determining that the characteristic intensity of the contact is greater than a first intensity threshold. In some embodiments, in addition to the set of confirmation options 5014 initially displayed, the user can also reveal additional confirmation options by performing predefined input gestures (e.g., gestures including repeated deep presses, drag gestures, etc.).

[0443] In some embodiments, the plurality of confirmation options includes a graphic icon (612) displaying at least one of a heart, a thumbs-up, a thumbs-down, "HA!", "!!", and / or a question mark. (See, e.g., Figure 5BConfirmation options 5014-1 to 5014-6 shown).

[0444] In some embodiments, method 600 includes transmitting information (614) in response to detecting the first input, wherein the information causes one or more electronic devices corresponding to at least one other user included in the instant messaging conversation to display a confirmation readiness indicator corresponding to a first message area in the conversation transcript corresponding to the instant messaging conversation (e.g., causing the other devices in the instant messaging conversation to display a confirmation area with an animated elliptical mark adjacent to and / or partially overlapping the first message area of ​​the conversation transcript of the device of the at least one other user, similar to Figure 5G shown).

[0445] After detecting and responding to the first input, the electronic device detects a touch on the touch-sensitive surface that corresponds to a confirmation selection indicator (e.g., Figure 5B The confirmation selection indicator 5012) can indicate the first confirmation option (for example, Figure 5B The confirmation option 5014-2) is located at a position corresponding to the position of the second contact (eg, Figure 5B 5016). Optionally, the detection of the second contact is achieved by, for example, detecting a tap gesture, a light press gesture, a deep press gesture, or a lift-off on the first confirmation option or on a hidden hit area of ​​the first confirmation option. In some embodiments, the first contact and the second contact are different contacts, such as contacts in two different tap gestures made by the same finger. In some embodiments, the first contact and the second contact are different parts of the same continuous contact with the touch-sensitive surface, such as a long press, a light press, or a deep press on the first message area, followed by a drag toward the first confirmation option and a lift-off at the first confirmation option.

[0446] In response to detecting the second input, the electronic device applies the first confirmation option to the first message area 618. For example, Figure 5C A first confirmation option 5014-2 applied to the first message area is shown. In some embodiments, the electronic device also stops displaying the confirmation selection enable representation in response to detecting the second input.

[0447] In some embodiments, applying the first confirmation option to the first message area 618 includes displaying the first confirmation option 620 at a location adjacent to and / or partially overlapping the first message area. See, e.g., Figure 5C , which shows a first confirmation option 5014-2 applied to the corresponding first message area and, in this case, partially overlapping the corresponding first message area.

[0448] Optionally, in some embodiments, in response to detecting the second input, the electronic device transmits information 622 that causes one or more electronic devices corresponding to at least one other user included in the instant messaging conversation to apply the first confirmation option to the corresponding first message area in the conversation transcript corresponding to the instant messaging conversation. In some embodiments, this is achieved by transmitting information that causes the other devices in the instant messaging conversation to display the first confirmation option adjacent to the corresponding first message area of ​​the conversation transcript of the device of the at least one other user and / or partially overlapping the first message area. See, for example Figure 5H 5G , which shows a transcript of the conversation displayed on one of the other devices in the instant messaging conversation, including a first confirmation option 5014-2 applied to (and in this case partially overlapping) the corresponding first message area. In some embodiments, the first confirmation option (e.g., first confirmation option 5014-2) replaces the confirmation-ready indicator (e.g., confirmation-ready indicator 5020 of FIG. 5G ) corresponding to the first message area (e.g., via an animated transition).

[0449] In some embodiments, the first confirmation option is displayed in a confirmation area that is a different shape than the first message area (e.g., Figure 5C As shown, the corresponding message area 5008-1 for the message from another user is rectangular and / or includes a first indicator indicating that the first message is from another user (e.g., the tail “<” points to the first side of the display), while the corresponding confirmation area 5018 is circular and / or includes a second indicator indicating that the confirmation is from the user (e.g., the tail “Oo” points to the second side of the display, opposite to the first side).

[0450] In some embodiments, method 600, after applying the first confirmation option to the first message area (and in some embodiments, ceasing to display the confirmation selection indication), includes performing a sequence of operations 632-658, which includes detecting a touch on the touch-sensitive surface at a location corresponding to the location of the first message area (or in some embodiments, the first confirmation option) by a third contact (e.g., Figure 5C In some embodiments, detecting the third input 632 includes detecting a tap gesture, a long press gesture, a light press gesture, or a deep press gesture on the first message area (or the first confirmation option) or on a hidden hit area of ​​the first message area (or the first confirmation option).

[0451] In such embodiments, method 600 also includes, in response to detecting a third input 632 made by a third contact at a location on the touch-sensitive surface corresponding to the location of the first message area (or in some embodiments, the first confirmation option), displaying a confirmation editing interface (e.g., Figure 5D5024) 634. Optionally, the confirmation edit interface is displayed on top of the conversation transcript and / or in place of the conversation transcript.

[0452] In such embodiments, method 600 further includes detecting one or more inputs in the confirmation editing interface (e.g., Figure 5E Detecting contact 5026) 650, editing (e.g., changing or deleting) a confirmation option 652 of the first message area based on the one or more detected inputs; ceasing to display the confirmation editing interface 654; displaying the first message area 656 with the edited confirmation in the conversation transcript; and transmitting causing one or more electronic devices corresponding to at least one other user included in the instant messaging conversation to display a corresponding first message area 658 with the edited confirmation in the conversation transcript corresponding to the instant messaging conversation. For example, Figure 5D Confirmation edit interface 5024 is shown with an indication (e.g., highlighted or grayed out) that confirmation option 5014-2 was previously selected. FIG5E shows input contact 5026 for selecting a different second confirmation option 5014-1, and Figure 5F The message area in the conversation transcript is shown with the confirmation edited (ie, the second confirmation option 5014-1 is displayed, while the first confirmation option 5014-2 is not displayed).

[0453] In some embodiments, in addition to displaying the confirmation editing interface 634 in response to detecting the third input 632 made through the third contact, method 600 also includes stopping displaying (or dimming) the conversation transcript 636 in response to detecting the third input made through the third contact, an example of which is shown in Figure 5E.

[0454] Furthermore, in some embodiments, in response to detecting a third input via a third contact, method 600 includes displaying a first message area 638 in the confirmation editing interface. For example, Figure 5E An embodiment is shown in which a first message area is displayed in a confirmation editing interface without displaying any other message areas in the conversation transcript in the confirmation editing interface. In some embodiments, the first message area is initially displayed in the confirmation editing interface at the same location as the first message area was displayed in the conversation transcript immediately before the third input was detected.

[0455] In some embodiments, in addition to displaying the confirmation editing interface 634 in response to detecting the third input 632 performed by the third contact, method 600 also includes displaying a confirmation selection enable representation including multiple confirmation options in the confirmation editing interface in response to detecting the third input performed by the third contact, wherein the first confirmation option is visually distinguished (e.g., highlighted) from other confirmation options in the multiple confirmation options to indicate that the first confirmation option is currently selected. For example, Figure 5D The confirmation editing interface 5024 is shown to include a confirmation selection affordance (similar to Figure 5B The enable indication 5012 has multiple confirmation options 5014).

[0456] In some embodiments, in addition to displaying the confirmation editing interface 634 in response to detecting the third input 632 made by the third contact, method 600 also includes displaying a menu 642 of activatable editing options including the first message area in the confirmation editing interface in response to detecting the third input made by the third contact. For example, Figure 5D An edit menu 5028 is shown, which includes a "copy" icon 530 for copying the contents of the first message area. Figure 5D , but edit menu 5028 optionally includes additional activatable editing options, such as a "delete" icon for a confirmation option to delete the current application.

[0457] In some embodiments, method 600 includes simultaneously displaying on the display (A) a second message area (e.g., Figure 5I 5008-2) 660, wherein (1) at least some of the users in the instant messaging session have selected a first confirmation option for the second message area, and (2) at least some of the users in the instant messaging session have selected a second confirmation option for the second message area that is different from the first confirmation option; and (B) one or more indicia (e.g., indicia 5036) indicating that users in the instant messaging session have selected multiple confirmation options for the second message area. Figure 5I In the embodiment shown, the mark 5036 is a stack of overlapping confirmation option icons, but it can also be multiple separate confirmation option icons. Figure 5I As shown, mark 5036 is optionally adjacent to and / or partially overlaps with second message area 5008-02. In some embodiments, for a given confirmation option that has been selected, if more than a threshold number of users (e.g., more than 2, 3, or 4 users) in the instant messaging session have selected the confirmation option, the selections are stacked.

[0458] In such an embodiment (i.e., showing a second message area and indicia indicating that a user in the instant messaging conversation has selected a plurality of confirmation options for the second message area), method 600 includes detecting input by contact at a location on the touch-sensitive surface corresponding to the location of the second message area (e.g., Figure 5I Alternatively, the detected input corresponds to the location of one or more markers indicating that the user in the instant messaging conversation has selected multiple confirmation options for the second m...

Claims

1. A method for managing an instant messaging application, performed by an electronic device having a display and at least one input device, comprising: Displaying an instant messaging user interface of the instant messaging application on the display, the instant messaging user interface including a conversation transcript of an instant messaging conversation between a user of the electronic device and at least one other user and a message input area, wherein the conversation transcript includes: a plurality of messages and a plurality of message areas, each message area containing a corresponding message of the plurality of messages; a first corresponding message contained in a first corresponding message area among the plurality of message areas; a second message in a second message area of ​​the plurality of message areas; and a grouping flag for a message area group including the first corresponding message area and the second message area; While displaying the instant messaging user interface, detecting a first input at a position on the at least one input device corresponding to the grouping marker; In response to detecting the first input at a location corresponding to the grouping marker, a message area group including the first corresponding message area and the second message area is displayed, the message area group overlapping an ungrouped message area in the conversation transcript.

2. The method of claim 1, wherein the first corresponding message is earlier in the conversation transcript than the last message in the conversation transcript. 3 . The method of claim 1 , wherein the grouping mark comprises a line connecting the first corresponding message area and the second message area.

4. The method according to any one of claims 1 to 3, wherein The at least one input device is a touch-sensitive surface, and the first input is a press input on the touch-sensitive surface.

5. The method according to any one of claims 1 to 3, further comprising: detecting a second input at a location that does not correspond to the first corresponding message area or the second message area; as well as In response to detecting the second input, ceasing to display a second message area and the first corresponding message area overlaid on the conversation transcript.

6. An electronic device comprising: monitor; touch-sensitive surfaces; one or more processors; Memory; and One or more programs, wherein the one or more programs are stored in the memory and configured to be executed by the one or more processors, the one or more programs comprising instructions for executing the method according to any one of claims 1 to 5.

7. A computer-readable storage medium storing one or more programs, wherein the one or more programs include instructions, which, when executed by an electronic device having a display and at least one input device, cause the electronic device to perform the method according to any one of claims 1 to 5.

8. A computer program product, comprising one or more programs, which, when executed by a processor, cause the processor to perform the method according to any one of claims 1 to 5.

Images