Applying the Confirmation Option in the Graphical Messaging User Interface

Abstract

The present disclosure relates to applying confirmation options in graphical messaging user interfaces. Electronic devices with improved methods and interfaces for messaging are disclosed herein, including improved ways to: confirm messages; edit previously sent messages; express what a user is trying to convey; display private messages; synchronize viewing of content between users; incorporate handwriting input; quickly locate content in a message transcript; integrate a camera; integrate search and share; integrate interactive applications; integrate stickers; make payments; interact with avatars; provide suggestions; navigate in interactive applications; manage interactive applications; translate foreign language text; merge messages into a group; and tag messages.

Description

[0001] This application is a divisional application of an invention patent application with an international application date of May 18, 2017, a national application number of 201780002856.4 (international application number of PCT / US2017 / 033396), and an invention name of “APPLYING CONFIRMATION OPTIONS IN A GRAPHICAL MESSAGING USER INTERFACE”. Technical Field

[0002] This document generally relates to electronic devices with touch-sensitive surfaces, including but not limited to electronic devices with touch-sensitive surfaces for sending and receiving messages (e.g., instant messaging). Background Art

[0003] The use of touch-sensitive surfaces as input devices for computers and other electronic computing devices has grown significantly in recent years. Exemplary touch-sensitive surfaces include touch pads and touch screen displays. These devices are often used to send messages, such as instant messages, between users using instant messaging applications.

[0004] However, current instant messaging applications have many shortcomings and limitations. For example, these applications have limited functionality in the following areas: confirming messages; editing previously sent messages; expressing what the user is trying to convey; displaying private messages; viewing content simultaneously between users; incorporating handwriting input; quickly locating content in a message transcript; integrating a camera; integrating search and sharing; integrating interactive applications; integrating stickers; making payments; interacting with avatars; providing suggestions; navigating in interactive applications; managing interactive applications; translating foreign language text; merging messages into a group; and tagging messages. Summary of the invention

[0005] Therefore, there is a need for electronic devices with improved methods and interfaces for message transmission. Such methods and interfaces optionally supplement or replace conventional message transmission methods. Such methods and interfaces change the amount, degree and / or nature of input from the user and produce a more efficient human-computer interface. For battery-driven devices, such methods and interfaces save power and increase the interval between battery charges.

[0006] The above-mentioned defects and other problems associated with the user interface of an electronic device with a touch-sensitive surface can be reduced or eliminated by means of the disclosed device. In some embodiments, the device is a desktop computer. In some embodiments, the device is portable (e.g., a laptop, a tablet computer, or a handheld device). In some embodiments, the device is a personal electronic device (e.g., a wearable electronic device, such as a watch). In some embodiments, the device has a touchpad. In some embodiments, the device has a touch-sensitive display (also referred to as a "touch screen" or a "touch screen display"). In some embodiments, the device has a graphical user interface (GUI), one or more processors, a memory, and one or more modules, a program or instruction set stored in the memory for performing multiple functions. In some embodiments, the user interacts with the GUI mainly through stylus and / or finger contact and gestures on the touch-sensitive surface. In some embodiments, these functions optionally include image editing, drawing, presentation, word processing, spreadsheet creation, playing games, making and receiving calls, video conferencing, sending and receiving emails, instant messaging, fitness support, digital photography, digital video recording, web browsing, digital music playback, notepad creation, and / or digital video playback. Executable instructions for performing these functions are optionally included in a non-transitory computer-readable storage medium or other computer program product configured for execution by one or more processors.

[0007] There is a need for electronic devices with improved methods and interfaces for applying confirmations to message areas in a conversation transcript. Such methods and interfaces may supplement or replace conventional methods for applying confirmations to message areas in a conversation transcript. Such methods and interfaces reduce the amount, extent, and / or nature of input from a user and produce a more efficient human-computer interface.

[0008] According to some embodiments, a method for applying confirmation to a message area in a conversation transcript displayed on a display of an electronic device includes displaying an instant messaging user interface (e.g., an instant messaging application) on the display, wherein the instant messaging user interface includes a conversation transcript of an instant messaging conversation between a user of the electronic device and at least one other user (e.g., a user of another electronic device). The method also includes receiving a first message in the instant messaging conversation from an electronic device (e.g., a second electronic device) corresponding to another user included in the instant messaging conversation, and in response to receiving the first message, displaying the first message in a first message area of ​​the conversation transcript on the display. The electronic device detects a first input made by a first contact at a position corresponding to the position of the first message area in the conversation transcript on a touch-sensitive surface, and in response to detecting the first input, displays a confirmation selection enable indication at a position corresponding to the first message area in the instant messaging interface, wherein the confirmation selection enable indication displays multiple confirmation options. Next, the method includes detecting a second input made by a second contact at a position corresponding to the position of the first confirmation option in the confirmation selection enable indication on the touch-sensitive surface, and in response to detecting the second input, applying the first confirmation option to the first message area.

[0009] According to some embodiments, an electronic device includes: a display unit configured to display an instant messaging user interface on the display unit, the instant messaging user interface including a conversation transcript of an instant messaging conversation between a user of the electronic device and at least one other user; a touch-sensitive surface unit configured to detect contact; and a processing unit coupled to the display unit and the touch-sensitive surface unit. The processing unit is configured to: receive a first message in an instant messaging conversation from an electronic device corresponding to another user included in the instant messaging conversation, and in response to receiving the first message, display the first message in a first message area of ​​the conversation transcript on the display unit. The processing unit is further configured to detect a first input made by a first contact at a position on the touch-sensitive surface unit corresponding to the position of the first message area in the conversation transcript, and in response to detecting the first input, display a confirmation selection enable indication at a position corresponding to the first message area in the instant messaging interface, wherein the confirmation selection enable indication displays multiple confirmation options. The processing unit is further configured to detect a second input made by a second contact at a position on the touch-sensitive surface unit corresponding to the position of the first confirmation option in the confirmation selection enable indication, and in response to detecting the second input, apply the first confirmation option to the first message area.

[0010] Thus, electronic devices with displays and touch-sensitive surfaces have improved methods and interfaces for applying confirmations to message areas in a conversation transcript, thereby increasing effectiveness, efficiency, and user satisfaction with such devices. Such methods and interfaces may supplement or replace conventional methods for applying confirmations to message areas in a conversation transcript.

[0011] There is a need for electronic devices with improved methods and interfaces for editing sent messages. Such methods and interfaces can supplement or replace conventional methods for editing sent messages. Such methods and interfaces reduce the amount, degree and / or nature of input from the user and produce a more efficient human-computer interface.

[0012] According to some embodiments, a method for editing a message performed at an electronic device (e.g., a first electronic device) having one or more processors, a memory, a touch-sensitive surface, and a display includes displaying an instant messaging user interface on the display. The instant messaging user interface includes: a transcript of a conversation between an instant messaging session between a user of the electronic device and at least one other user, and a first message area including a first message in the instant messaging session sent from the user's electronic device to the at least one other user in the instant messaging session. The method also includes detecting a first input corresponding to a request for editing the first message, and in response to detecting the first input, displaying a message editing interface for the first message, the message editing interface including the first message, a keyboard, and an update enable representation, and when displaying the message editing interface for the first message, detecting one or more inputs for modifying the first message, displaying a modified version of the first message; and detecting an input for activating the update enable representation.

[0013] The method also includes: in response to detecting input that activates an update enable representation: stopping displaying a message editing interface for the first message; displaying a modified version of the first message in the conversation transcript instead of the first message; displaying at least one indication of the modification of the first message in the conversation transcript; and transmitting the modified version of the first message to one or more electronic devices corresponding to the at least one other user included in the instant messaging conversation, wherein the one or more electronic devices display the modified version of the first message in the conversation transcript corresponding to the instant messaging conversation instead of the first message, and at least one indication of the modification of the first message in the conversation transcript.

[0014] According to some embodiments, an electronic device includes: a display unit configured to display an instant messaging user interface on the display unit; a touch-sensitive surface unit configured to detect contact; and a processing unit coupled to the display unit and the touch-sensitive surface unit. The instant messaging user interface includes: a transcript of a conversation between a user of the electronic device and at least one other user, and a first message area in the instant messaging conversation including a first message sent from the user's electronic device to the at least one other user in the instant messaging conversation. The processing unit is configured to: detect a first input corresponding to a request for editing a first message; and in response to detecting the first input, display a message editing interface for the first message, the message editing interface including the first message, a keyboard, and an update enable representation. The processing unit is further configured to: while displaying a message editing interface for a first message, detect one or more inputs for modifying the first message; display a modified version of the first message; detect an input for activating an update affordance; and in response to detecting the input for activating an update affordance: stop displaying the message editing interface for the first message; display a modified version of the first message in place of the first message in a conversation transcript; display at least one indication of the modification of the first message in the conversation transcript; and transmit the modified version of the first message to one or more electronic devices corresponding to the at least one other user included in the instant messaging conversation. The one or more electronic devices display the modified version of the first message in place of the first message in a conversation transcript corresponding to the instant messaging conversation, and at least one indication of the modification of the first message in the conversation transcript.

[0015] Therefore, electronic devices with displays and touch-sensitive surfaces have improved methods and interfaces for editing sent messages, thereby increasing effectiveness, efficiency, and user satisfaction with such devices. Such methods and interfaces can supplement or replace conventional methods for editing sent messages in instant messaging applications.

[0016] There is a need for electronic devices with improved methods and interfaces for displaying versions of sent messages. Such methods and interfaces can supplement or replace conventional methods for displaying versions of sent messages. Such methods and interfaces reduce the amount, extent, and / or nature of input from a user and produce a more efficient human-computer interface.

[0017] According to some embodiments, a method performed at an electronic device having one or more processors, a memory, a touch-sensitive surface, and a display includes displaying an instant messaging user interface on the display, the instant messaging user interface including: a conversation transcript of an instant messaging conversation between a user of the electronic device and at least one other user, and a first message area including a current version of a first message in the instant messaging conversation, wherein the conversation transcript includes an indication that the current version of the first message is a modified version of the first message in the conversation transcript. The method also includes detecting an input corresponding to a request for viewing a version of the first message; and in response to detecting the input corresponding to the request for viewing a version of the first message, displaying a version user interface including the current version of the first message and one or more previous versions of the first message.

[0018] According to some embodiments, an electronic device includes: a display unit configured to display an instant messaging user interface on the display unit; a touch-sensitive surface unit configured to detect contact; and a processing unit coupled to the display unit and the touch-sensitive surface unit. The instant messaging user interface includes: a conversation transcript of an instant messaging conversation between a user of the electronic device and at least one other user, and a first message area including a current version of a first message in the instant messaging conversation, wherein the conversation transcript includes an indication that the current version of the first message is a modified version of the first message in the conversation transcript. The processing unit is configured to: detect an input corresponding to a request for viewing a version of the first message; and in response to detecting the input corresponding to the request for viewing a version of the first message, display a version user interface including the current version of the first message and one or more previous versions of the first message.

[0019] Therefore, electronic devices with displays and touch-sensitive surfaces have improved methods and interfaces for displaying versions of sent messages, thereby increasing effectiveness, efficiency, and user satisfaction with such devices. Such methods and interfaces can supplement or replace conventional methods for displaying versions of sent messages in instant messaging applications.

[0020] There is a need for electronic devices with improved methods and interfaces for selecting impact effects for messages. Such methods and interfaces can supplement or replace conventional methods for selecting impact effects for messages. Such methods and interfaces reduce the amount, degree, and / or nature of input from a user and produce a more efficient human-computer interface.

[0021] According to some embodiments, a method performed at an electronic device having one or more processors, a memory, a touch-sensitive surface, and a display includes displaying an instant messaging user interface on the display, the instant messaging user interface including: a transcript of a conversation between a user of the electronic device and at least one other user, and a message input area including a first message input. The method also includes: while displaying the instant messaging user interface, detecting a first input made by a first contact at a position on the touch-sensitive surface corresponding to a position in the message input area; in response to detecting the first input made by the first contact, displaying a shock selection interface including a plurality of shock effect options; while displaying the shock selection interface, detecting a second input made by a second contact at a position on the touch-sensitive surface corresponding to a position of a first shock effect option among the plurality of shock effect options; and in response to detecting a second user input made by the second contact, displaying a preview of applying the first shock effect option to the first message input.

[0022] According to some embodiments, an electronic device includes: a display unit configured to display an instant messaging user interface on the display unit; a touch-sensitive surface unit configured to detect contact; and a processing unit coupled to the display unit and the touch-sensitive surface unit. The instant messaging user interface includes: a transcript of a conversation between a user of the electronic device and at least one other user, and a message input area including a first message input. The processing unit is configured to: when displaying the instant messaging user interface, detect a first input made by a first contact at a position on the touch-sensitive surface unit corresponding to a position in the message input area; and in response to detecting the first input made by the first contact, display an impact selection interface including multiple impact effect options. The processing unit is further configured to: when displaying the impact selection interface, detect a second input made by a second contact at a position on the touch-sensitive surface unit corresponding to a position of a first impact effect option among multiple impact effect options; and in response to detecting a second user input made by the second contact, display a preview of applying the first impact effect option to the first message input.

[0023] Thus, electronic devices with displays and touch-sensitive surfaces have improved methods and interfaces for selecting impact effects for messages, thereby increasing effectiveness, efficiency, and user satisfaction with such devices. Such methods and interfaces may supplement or replace conventional methods for selecting impact effects for messages in instant messaging applications.

[0024] There is a need for electronic devices with improved methods and interfaces for hiding and revealing messages. Such methods and interfaces can supplement or replace conventional methods for hiding and revealing messages. Such methods and interfaces reduce the amount, degree and / or nature of input from a user and produce a more efficient human-computer interface.

[0025] According to some embodiments, a method performed at an electronic device having one or more processors, a memory, a touch-sensitive surface, and a display includes displaying an instant messaging user interface on the display, the instant messaging user interface including: a transcript of a conversation between a user of the electronic device and at least one other user including a first other user, and a message area in the transcript of the conversation of a message received from the first other user, the message area including one or more screen elements for hiding the message received from the first other user. The method also includes detecting a first input made by contact at a location on the touch-sensitive surface corresponding to the message area having a hidden message; and in response to detecting the first input made by contact, revealing the hidden message in the message area.

[0026] According to some embodiments, the electronic device includes: a display unit configured to display an instant messaging user interface on the display unit; a touch-sensitive surface unit configured to detect contact; and a processing unit coupled to the display unit and the touch-sensitive surface unit. The instant messaging user interface includes: a transcript of a conversation between an instant messaging conversation between a user of the electronic device and at least one other user including a first other user, and a message area in the transcript of the conversation of a message received from the first other user, the message area including one or more screen elements for hiding the message received from the first other user. The processing unit is further configured to: detect a first input made by contact at a position on the touch-sensitive surface unit corresponding to the message area with a hidden message; and in response to detecting the first input made by contact, reveal the hidden message in the message area.

[0027] Therefore, electronic devices with displays and touch-sensitive surfaces have improved methods and interfaces to hide and reveal messages, thereby increasing effectiveness, efficiency, and user satisfaction with such devices. Such methods and interfaces can supplement or replace conventional methods for hiding and revealing messages in instant messaging applications.

[0028] There is a need for electronic devices with improved methods and interfaces for displaying enhanced message content in instant messaging applications. Such methods and interfaces can supplement or replace conventional methods for displaying enhanced message content in instant messaging applications. Such methods and interfaces reduce the amount, extent, and / or nature of input from a user and produce a more efficient human-computer interface.

[0029] According to some embodiments, a method performed at an electronic device having one or more processors, a memory, a touch-sensitive surface, and a display includes: displaying an instant messaging user interface on the display, the instant messaging user interface including a transcript of a conversation between an instant messaging conversation between a user of the electronic device and at least one other user including a first other user; receiving a first message in the instant messaging conversation from an electronic device corresponding to the first other user included in the instant messaging conversation; and determining whether the first message includes an enhanced message content trigger. The method also includes: based on determining that the first message includes an enhanced message content trigger, displaying the first message in a first message area of ​​the conversation transcript on the display, and displaying enhanced message content corresponding to the trigger, wherein the enhanced message content includes applying an effect to the content of at least one message area outside the first message area in the conversation transcript. The method also includes displaying the first message (e.g., without enhanced message content) in the first message area of ​​the conversation transcript on the display based on determining that the first message does not include an enhanced message content trigger.

[0030] According to some embodiments, the electronic device includes: a display unit configured to display an instant messaging user interface on the display unit; a touch-sensitive surface unit configured to detect contact; and a processing unit coupled to the display unit and the touch-sensitive surface unit. The instant messaging user interface includes a transcript of a conversation between an instant messaging session between a user of the electronic device and at least one other user including a first other user. The processing unit is configured to: receive a first message in the instant messaging session from an electronic device corresponding to the first other user included in the instant messaging session, and determine whether the first message includes an enhanced message content trigger. The processing unit is further configured to: display the first message in a first message area of ​​the conversation transcript on the display unit based on determining that the first message includes an enhanced message content trigger, and display the enhanced message content corresponding to the trigger, wherein the enhanced message content includes applying an effect to the content of at least one message area outside the first message area in the conversation transcript. In addition, the processing unit is configured to: display the first message in a first message area of ​​the conversation transcript on the display unit based on determining that the first message does not include an enhanced message content trigger.

[0031] Therefore, electronic devices with displays and touch-sensitive surfaces have improved methods and interfaces for displaying enhanced message content in instant messaging applications, thereby increasing the effectiveness, efficiency, and user satisfaction of using such devices. Such methods and interfaces can supplement or replace conventional methods for displaying enhanced message content in instant messaging applications.

[0032] There is a need for electronic devices with improved methods and interfaces for displaying composable content in instant messaging applications. Such methods and interfaces can supplement or replace conventional methods for displaying composable content in instant messaging applications. Such methods and interfaces reduce the amount, extent, and / or nature of input from a user and produce a more efficient human-computer interface.

[0033] According to some embodiments, a method performed at an electronic device having one or more processors, a memory, a touch-sensitive surface, and a display includes displaying an instant messaging user interface on the display, the instant messaging user interface including a conversation transcript of an instant messaging conversation between a user of the electronic device and at least one other user including a first other user, and a message input area. The method also includes: receiving a first message in the instant messaging conversation from an electronic device corresponding to the first other user included in the instant messaging conversation, wherein the first message includes a first combinable content, in response to receiving the first message, displaying the first message in a first message area of ​​the conversation transcript on the display, receiving input of a second message in the message input area, and when the second message is displayed in the message input area, detecting input for sending the second message to the instant messaging conversation. The method also includes: in response to detecting an input for sending a second message to the instant messaging session: based on determining that the second message contains second combinable content and that the second combinable content and the first combinable content are part of a predefined combination, displaying content corresponding to the predefined combination in a conversation transcript on the display; and based on determining that the second message does not contain the second combinable content that together with the first combinable content forms a predefined combination, displaying the second message in a second message area of ​​the conversation transcript on the display (for example, without displaying the content corresponding to the predefined combination in the conversation transcript on the display).

[0034] According to some embodiments, the electronic device includes: a display unit configured to display an instant messaging user interface on the display unit; a touch-sensitive surface unit configured to detect contact; and a processing unit coupled to the display unit and the touch-sensitive surface unit. The instant messaging user interface includes: a conversation transcript of an instant messaging conversation between a user of the electronic device and at least one other user including a first other user, and a message input area. The processing unit is configured to: receive a first message in an instant messaging conversation from an electronic device corresponding to the first other user included in the instant messaging conversation, wherein the first message includes a first combinable content; in response to receiving the first message, display the first message in a first message area of ​​the conversation transcript on the display unit; receive an input of a second message in the message input area; and when the second message is displayed in the message input area, detect an input for sending the second message to the instant messaging conversation. The processing unit is further configured to: in response to detecting an input for sending a second message to the instant messaging session: based on determining that the second message contains second combinable content and that the second combinable content and the first combinable content are part of a predefined combination, display content corresponding to the predefined combination in a conversation transcript on the display unit; and based on determining that the second message does not contain the second combinable content that forms a predefined combination together with the first combinable content, display the second message in a second message area of ​​the conversation transcript on the display unit (for example, without displaying the content corresponding to the predefined combination in the conversation transcript on the display).

[0035] Thus, electronic devices with displays and touch-sensitive surfaces have improved methods and interfaces for displaying composable content in instant messaging applications, thereby increasing effectiveness, efficiency, and user satisfaction with such devices. Such methods and interfaces may supplement or replace conventional methods for displaying composable content in instant messaging applications.

[0036] There is a need for an electronic device with an improved method and interface for synchronizing media presentation in an instant messaging application. Such methods and interfaces optionally supplement or replace conventional methods for synchronizing media presentation in an instant messaging application. Such methods and interfaces produce a more efficient human-machine interface by allowing a user to easily view media content in a synchronous manner directly in an instant messaging application (and not necessarily in the same position as another user viewing the media content, and not necessarily using an inefficient method for synchronous viewing). For battery-driven devices, such methods and interfaces increase user satisfaction with the device, save power and increase the interval between two battery charges. In addition, allowing a user to easily view media content in a synchronous manner directly in a message application enhances the operability of the device, and makes the user device interface (e.g., in an instant messaging application) more efficient (e.g., by allowing effective synchronous viewing of media items), thereby further reducing power use and extending the battery life of the device by enabling the user to use the device more quickly and efficiently.

[0037] According to some embodiments, a method is performed at an electronic device having a display and a touch-sensitive surface. The method includes: displaying an instant messaging user interface on the display, the instant messaging user interface including a conversation transcript of an instant messaging session between a user of a first electronic device and at least one other user. In some embodiments, the conversation transcript includes a representation of a media item displayed at a certain time sequence position in the conversation transcript, and the instant messaging session is configured to allow the user at the first electronic device to view the media item synchronously with at least one other user at a second electronic device different from the first electronic device. The method also includes: receiving a first request for synchronously viewing the media item in the instant messaging user interface. In response to receiving the first request, the method includes: when displaying the representation of the media item at the time sequence position in the conversation transcript, start playing the content corresponding to the media item. After starting to play the content corresponding to the media item, the method includes: displaying the playback content corresponding to the media item at a fixed position different from the time sequence position in the instant messaging user interface. When displaying the playback content corresponding to the media item at a fixed position, the method includes: displaying the message exchanged between the user and at least one other user below the playback content corresponding to the media item; and detecting the end of the content corresponding to the media item. In response to detecting an end of the content corresponding to the media item, the method includes ceasing to display the content corresponding to the media item at the fixed position.

[0038] According to some embodiments, an electronic device (e.g., Fig. 22The electronic device 2200 includes: a display unit configured to display a user interface; a touch-sensitive surface unit for receiving contact; one or more sensor units for detecting the intensity of contact with the touch-sensitive surface unit; and a processing unit coupled to the display unit, the touch-sensitive surface unit, and the one or more sensor units. The processing unit is configured to (or one or more of its components, such as Fig. 22 The units 2210-2216 shown are configured to) display an instant messaging user interface on a display, the instant messaging user interface including a transcript of a conversation between an instant messaging session between a user of a first electronic device and at least one other user. In some embodiments, the conversation transcript includes a representation of a media item displayed at a certain time sequence position in the conversation transcript, and the instant messaging session is configured to allow a user at the first electronic device to view the media item synchronously with at least one other user at a second electronic device different from the first electronic device. The processing unit is also configured to: receive a first request for synchronously viewing a media item in the instant messaging user interface, and in response to receiving the first request, when displaying a representation of a media item at a time sequence position in the conversation transcript, start playing content corresponding to the media item. After starting to play content corresponding to the media item, the processing unit is configured to: display the playback content corresponding to the media item at a fixed position different from the time sequence position in the instant messaging user interface. When displaying the playback content corresponding to the media item at a fixed position, the processing unit is configured to: display messages exchanged between the user and at least one other user below the playback content corresponding to the media item, and detect the end of the content corresponding to the media item. In response to detecting the end of the content corresponding to the media item, the processing unit is configured to stop displaying the content corresponding to the media item at the fixed position.

[0039] Thus, electronic devices with displays and touch-sensitive surfaces have faster, more efficient methods and interfaces for viewing media content in a synchronized manner within an instant messaging application, thereby increasing effectiveness, efficiency, operability, and user satisfaction with such devices. Such methods and interfaces may supplement or replace conventional methods for viewing media within an instant messaging application.

[0040] An electronic device with an improved method and interface for using handwriting input in an instant messaging application is needed. Such methods and interfaces optionally supplement or replace conventional methods for inputting messages in an instant messaging application. Such methods and interfaces help to improve user satisfaction with their devices, and generate a more efficient human-machine interface by, for example, allowing the user to simply rotate the device to start inputting handwriting input. Such methods and interfaces also generate a more efficient human-machine interface by allowing the use of handwriting input to automatically replace the input typed in and allowing the user to use handwritten characters as keys to intuitively form a keyboard to improve the operability of the device. For battery-driven devices, such methods and interfaces save power and increase the interval between two battery charges. In addition, allowing the user to simply rotate the device to start inputting handwriting input, automatically replace the input typed in, and use handwritten characters as keys to form a keyboard all help to enhance the operability of the device, and make the user device interface (e.g., in an instant messaging application) more efficient (e.g., by allowing the user to easily customize the message content using handwriting input), thereby further reducing power use and extending the battery life of the device by enabling the user to use the device more quickly and efficiently. For example, the user does not need to leave the instant messaging application, open and use a different application to enter or position handwriting input, and then return to use those inputs in the instant messaging application. Instead, the user can simply provide and / or select customized handwriting input directly in the messaging application.

[0041] According to some embodiments, a method is performed at an electronic device having a display and a touch-sensitive surface. The method includes: when the electronic device is in a portrait orientation, displaying an instant messaging user interface on the display, the instant messaging user interface including a virtual keyboard. The method also includes: detecting an orientation change of the electronic device from a portrait orientation to a landscape orientation; and in response to detecting the orientation change of the electronic device: stopping displaying the virtual keyboard and displaying a handwriting input area on the display that is configured to accept handwriting input from a user of the electronic device.

[0042] According to some embodiments, the electronic device includes: a display unit configured to display a user interface; a touch-sensitive surface unit for receiving contact; one or more sensor units for detecting the intensity of contact with the touch-sensitive surface unit; and a processing unit coupled to the display unit, the touch-sensitive surface unit, and the one or more sensor units. The processing unit is configured to: when the electronic device is in a portrait orientation, display an instant messaging user interface on the display, the instant messaging user interface including a virtual keyboard; detect an orientation change of the electronic device from a portrait orientation to a landscape orientation; and in response to detecting an orientation change of the electronic device: stop displaying the virtual keyboard; and display a handwriting input area on the display that is configured to accept handwriting input from a user of the electronic device.

[0043] According to some embodiments, a method is performed at an electronic device having a display and a touch-sensitive surface. The method includes: displaying on the display: an instant messaging user interface, which includes a conversation transcript of an instant messaging conversation between a user of the electronic device and at least one other user, a virtual keyboard, and a message input area. The method also includes: receiving multiple typed inputs at the virtual keyboard. Upon receiving the multiple typed inputs, the method includes: determining whether one or more of the multiple typed inputs match a stored character sequence associated with a handwritten input stored by the user. Based on determining that the one or more typed inputs match the stored character string, the method includes: displaying an optional representation of the stored handwritten input at a first position of a first group of characters displayed in an adjacent message input area. In some embodiments, the first group of characters is displayed in the message input area and includes characters corresponding to one or more typed inputs that match the stored character sequence. The method also includes: detecting selection of an optional representation of stored handwriting input via the touch-sensitive surface; and in response to detecting selection of the optional representation of stored handwriting input: ceasing to display the optional representation of stored handwriting input at the first position; and replacing display of a first group of characters corresponding to the one or more typed inputs in the message input area with display of the representation of the stored handwriting input.

[0044] According to some embodiments, the electronic device includes: a display unit configured to display a user interface; a touch-sensitive surface unit for receiving contact; one or more sensor units for detecting the intensity of contact with the touch-sensitive surface unit; and a processing unit coupled to the display unit, the touch-sensitive surface unit, and the one or more sensor units. The processing unit is configured to: display on the display: an instant messaging user interface, the instant messaging user interface including a transcript of an instant messaging conversation between a user of the electronic device and at least one other user, a virtual keyboard, and a message input area. The processing unit is configured to: receive multiple typing inputs at a virtual keyboard; when receiving the multiple typing inputs, determine whether one or more of the multiple typing inputs match a stored character sequence associated with a handwriting input stored by a user; based on determining that the one or more typing inputs match the stored character sequence, display an optional representation of the stored handwriting input at a first position of a first group of characters displayed in an adjacent message input area, the first group of characters being displayed in the message input area and including characters corresponding to the one or more typing inputs matching the stored character sequence; detect a selection of the optional representation of the stored handwriting input via a touch-sensitive surface; and in response to detecting the selection of the optional representation of the stored handwriting input: stop displaying the optional representation of the stored handwriting input at the first position; and replace the display of the first group of characters corresponding to the one or more typing inputs in the message input area with the display of the representation of the stored handwriting input.

[0045] According to some embodiments, a method is performed at an electronic device having a display and a touch-sensitive surface. The method includes: detecting a first input via the touch-sensitive surface; in response to detecting the first input, presenting a keyboard preparation user interface on the display; while presenting the keyboard preparation user interface, receiving a handwriting input corresponding to a set of predefined training characters via the touch-sensitive surface; after receiving the handwriting input, detecting a second input corresponding to a request for displaying an instant messaging user interface including a message input area and a virtual keyboard having a plurality of keys, wherein a first key of the plurality of keys is associated with a first handwriting input in the received handwriting input; in response to detecting the second input, displaying an instant messaging user interface including a message input area and a virtual keyboard having a plurality of keys; receiving a selection of the first key via the touch-sensitive surface; and in response to receiving the selection of the first key, outputting a representation of the first handwriting input in the message input area.

[0046] According to some embodiments, the electronic device includes: a display unit configured to display a user interface; a touch-sensitive surface unit for receiving contact; one or more sensor units for detecting the intensity of contact with the touch-sensitive surface unit; and a processing unit coupled to the display unit, the touch-sensitive surface unit and the one or more sensor units. The processing unit is configured to: detect a first input via the touch-sensitive surface; in response to detecting the first input, present a keyboard preparation user interface on the display; when presenting the keyboard preparation user interface, receive a handwriting input corresponding to a set of predefined training characters via the touch-sensitive surface; after receiving the handwriting input, detect a second input corresponding to a request for displaying an instant messaging user interface including a message input area and a virtual keyboard with multiple keys, wherein a first key of the multiple keys is associated with a first handwriting input in the received handwriting input; in response to detecting the second input, display an instant messaging user interface including a message input area and a virtual keyboard with multiple keys; receive a selection of the first key via the touch-sensitive surface; and in response to receiving the selection of the first key, output a representation of the first handwriting input in the message input area.

[0047] Thus, electronic devices having a display, a touch-sensitive surface, and optionally one or more sensors for detecting intensity of contact with the touch-sensitive surface have faster, more efficient methods and interfaces for handwriting messages, thereby increasing effectiveness, efficiency, and user satisfaction with such devices. Such methods and interfaces may supplement or replace conventional methods for composing and submitting messages.

[0048] An electronic device with an improved method and interface for quickly locating different types of content in an instant messaging application is needed. Such methods and interfaces optionally supplement or replace conventional methods. Such methods and interfaces enable users to quickly locate desired content (e.g., users can reduce all plain text content to quickly locate emoticons, photos, videos, or other types of content that may have been received a long time ago) by allowing users to use only simple gestures to quickly reduce the display size of the content in the instant messaging application, thereby producing a more efficient human-computer interface. For battery-driven devices, such methods and interfaces save power and increase the interval between two battery charges (e.g., by allowing users to quickly locate desired content). In addition, allowing users to quickly locate desired content enhances the operability of the device, and makes the user device interface (e.g., in an instant messaging application) more efficient (e.g., by allowing users to easily locate desired content that may be large and difficult to search in a conversation transcript), thereby further reducing power use and extending the battery life of the device by enabling users to use the device more quickly and efficiently (e.g., users do not need to scroll through the content in the conversation transcript page by page, and only need to provide intuitive gestures to easily reduce the content, thereby easily locating the desired content).

[0049] According to some embodiments, a method is performed at an electronic device having a display and a touch-sensitive surface. The method includes: displaying an instant messaging user interface including multiple content items on the display. In some embodiments, the multiple content items include content items having a first content type, the multiple content items include content items having a second content type different from the first content type, and the corresponding content items in the multiple content items are displayed in a corresponding first size. When displaying the instant messaging user interface, the method includes: detecting a first input via the touch-sensitive surface. In response to detecting the first input, the method includes: reducing the display size of at least some content items having the first content type, while continuing to display the content items having the second content type in their corresponding first size.

[0050] According to some embodiments, the electronic device includes: a display unit configured to display a user interface; a touch-sensitive surface unit for receiving contact; one or more sensor units for detecting the intensity of contact with the touch-sensitive surface unit; and a processing unit coupled to the display unit, the touch-sensitive surface unit and the one or more sensor units. The processing unit is configured to: display an instant messaging user interface including multiple content items on the display. In some embodiments, the multiple content items include at least content items having a first content type, the multiple content items include at least content items having a second content type different from the first content type, and the corresponding content items in the multiple content items are displayed in a corresponding first size. When displaying the instant messaging user interface, the processing unit is configured to: detect a first input via the touch-sensitive surface, and in response to detecting the first input, reduce the display size of at least some content items having the first content type, while continuing to display the content items having the second content type in their corresponding first size.

[0051] According to some embodiments, a method is performed at an electronic device having a display and a touch-sensitive surface. The method includes: displaying an instant messaging user interface including multiple content items on the display. In some embodiments, the multiple content items include content items having a first content type, the multiple content items include content items having a second content type different from the first content type, and the corresponding content items in the multiple content items are displayed in a corresponding first size. When displaying the instant messaging user interface, the method includes: detecting a first input via the touch-sensitive surface, and in response to detecting the first input, the method includes: reducing the display size of at least some content items having a first content type, so that the first content item having the first content type is reduced to a corresponding second size smaller than the corresponding first size by a predefined first display size reduction factor; and reducing the display size of at least some content items having a second content type, so that the second content item having the second content type is reduced to a corresponding third size smaller than the corresponding first size by a predefined second display size reduction factor. In some embodiments, the predefined second display size reduction factor is smaller than the predefined first display size reduction factor.

[0052] According to some embodiments, the electronic device includes: a display unit configured to display a user interface; a touch-sensitive surface unit for receiving contact; one or more sensor units for detecting the contact intensity with the touch-sensitive surface unit; and a processing unit coupled to the display unit, the touch-sensitive surface unit and the one or more sensor units. The processing unit is configured to: display an instant messaging user interface including multiple content items on the display. In some embodiments, the multiple content items include content items with a first content type, the multiple content items include content items with a second content type different from the first content type, and the corresponding content items in the multiple content items are displayed in a corresponding first size. When displaying the instant messaging user interface, the processing unit is configured to: detect a first input via the touch-sensitive surface. In response to detecting the first input, the processing unit is configured to: reduce the display size of at least some content items with the first content type, so that the first content item with the first content type is reduced to a corresponding second size smaller than the corresponding first size by a predefined first display size reduction factor; and reduce the display size of at least some content items with the second content type, so that the second content item with the second content type is reduced to a corresponding third size smaller than the corresponding first size by a predefined second display size reduction factor. In some embodiments, the predefined second display size reduction factor is less than the predefined first display size reduction factor.

[0053] Thus, an electronic device with a display, a touch-sensitive surface, and optionally one or more sensors for detecting intensity of contact with the touch-sensitive surface has a fast and efficient method and interface for quickly locating different types of content in instant messaging applications, thereby improving the effectiveness, efficiency, and user satisfaction of utilizing such devices.

[0054] There is a need for electronic devices with improved methods and interfaces for sharing images (e.g., photos) in message conversations. Such methods and interfaces may supplement or replace conventional methods for sharing images (e.g., photos) in message conversations. Such methods and interfaces reduce the amount, extent, and / or nature of input from a user and produce a more efficient human-computer interface.

[0055] According to some embodiments, a method is performed at an electronic device having a display, a digital camera, a touch-sensitive surface, and a memory. The method includes displaying an instant messaging user interface on a display, the instant messaging user interface including a conversation transcript of an instant messaging conversation between a user of the electronic device and at least one other user, a keyboard, a message input area, and a digital image affordance representation. The method also includes detecting an input that activates the digital image affordance representation when displaying the instant messaging user interface. The method also includes replacing the display of the keyboard with the display of multiple digital images in response to detecting an input that activates the digital image affordance representation, the multiple digital images including one or more digital images stored in the memory and a real-time preview image from a digital camera. The method also includes detecting an input that selects a real-time image displayed in the multiple digital images. The method also includes capturing a digital image using a digital camera while keeping the conversation transcript displayed in response to detecting an input that selects a real-time image.

[0056] According to some embodiments, an electronic device includes: a display unit configured to display a user interface; a digital camera unit configured to capture images; a touch-sensitive surface unit; a memory unit; and a processing unit coupled to the display unit, the digital camera unit, the touch-sensitive surface unit, and the memory unit. The processing unit is configured to: display an instant messaging user interface on the display unit, the instant messaging user interface including a conversation transcript of an instant messaging conversation between a user of the electronic device and at least one other user, a keyboard, a message input area, and a digital image affordance. The processing unit is further configured to: while displaying the instant messaging user interface, detect an input that activates the digital image affordance. The processing unit is further configured to: in response to detecting an input that activates the digital image affordance, replace the display of the keyboard with the display of multiple digital images, the multiple digital images including one or more digital images stored in the memory unit and a real-time preview image from the digital camera unit. The processing unit is further configured to detect an input that selects a real-time image displayed in the multiple digital images. The processing unit is further configured to, in response to detecting an input that selects a real-time image, use the digital camera unit to capture a digital image while keeping the conversation transcript displayed.

[0057] Thus, electronic devices with displays and touch-sensitive surfaces have improved methods and interfaces for sharing images (e.g., photos) in message conversations, thereby increasing effectiveness, efficiency, and user satisfaction with such devices. Such methods and interfaces may supplement or replace conventional methods for sharing images (e.g., photos) in message conversations.

[0058] There is a need for electronic devices with improved methods and interfaces for searching and sharing content (e.g., content from the Internet and locally stored content) in a message conversation. Such methods and interfaces can supplement or replace conventional methods for searching and sharing content in a message conversation. Such methods and interfaces reduce the amount, extent, and / or nature of input from a user and produce a more efficient human-computer interface.

[0059] According to some embodiments, a method is performed at an electronic device having a display and a touch-sensitive surface. The method includes displaying an instant messaging user interface on the display, the instant messaging user interface including a conversation transcript of an instant messaging conversation between a user of the electronic device and at least one other user and a search affordance. The method also includes detecting an input to activate the search affordance when the instant messaging user interface is displayed. The method also includes: in response to detecting the input to activate the search affordance: stopping displaying the instant messaging user interface, and displaying a search user interface, the search user interface including a search field and a plurality of classified content items, wherein the plurality of classified content items at least include content items stored on the electronic device and content items from the Internet. The method also includes: when displaying the search user interface, detecting an input to select a first content item from the plurality of classified content items. The method also includes: after detecting the input to select the first content item from the plurality of classified content items: stopping displaying the search user interface, displaying the first content item in the conversation transcript in the instant messaging user interface, and transmitting the first content item to one or more electronic devices corresponding to at least one other user included in the instant messaging conversation, wherein the one or more electronic devices display the first content item in the conversation transcript corresponding to the instant messaging conversation.

[0060] According to some embodiments, the electronic device includes: a display unit configured to display a user interface; a touch-sensitive surface unit; a memory unit; and a processing unit coupled to the display unit, the touch-sensitive surface unit, and the memory unit. The processing unit is configured to: display an instant messaging user interface on the display unit, the instant messaging user interface including a transcript of a conversation between a user of the electronic device and at least one other user and a search enable representation. The processing unit is further configured to: detect an input that activates the search enable representation when displaying the instant messaging user interface. The processing unit is further configured to: in response to detecting an input that activates the search enable representation: stop displaying the instant messaging user interface, and display a search user interface, the search user interface including a search field and a plurality of classified content items, wherein the plurality of classified content items at least include content items stored on the electronic device and content items from the Internet. The processing unit is further configured to: detect an input that selects a first content item from a plurality of classified content items when displaying the search user interface. The processing unit is further configured to: after detecting input selecting a first content item from multiple classified content items: stop displaying the search user interface, display the first content item in a conversation transcript in an instant messaging user interface, and transmit the first content item to one or more electronic devices corresponding to at least one other user included in the instant messaging conversation, wherein the one or more electronic devices display the first content item in a conversation transcript corresponding to the instant messaging conversation.

[0061] Thus, electronic devices with displays and touch-sensitive surfaces have improved methods and interfaces for searching for shared content in message conversations, thereby increasing effectiveness, efficiency, and user satisfaction with such devices. Such methods and interfaces may supplement or replace conventional methods for sharing content in conversations.

[0062] There is a need for electronic devices with improved methods and interfaces for adding interactive applications in instant messaging applications. Such methods and interfaces can supplement or replace conventional methods for adding interactive applications in instant messaging applications. Such methods and interfaces reduce the amount, extent, and / or nature of input from a user and produce a more efficient human-computer interface.

[0063] According to some embodiments, a method is performed at an electronic device having one or more processors, a memory, a touch-sensitive surface, and a display. The method includes: displaying an instant messaging user interface of an instant messaging application on a display, the instant messaging user interface including a transcript of an instant messaging conversation between a user of the electronic device and at least one other user and an application enable indication; while displaying the instant messaging user interface, detecting input for activating the application enable indication; in response to detecting input for activating the application enable indication, simultaneously displaying a launch icon for an application store and multiple launch icons for interactive applications, wherein activating a corresponding launch icon for an interactive application will launch a corresponding application displayed in the instant messaging application; detecting input for activating the launch icon for the application store; in response to detecting input for activating the launch icon for the application store: stopping displaying the instant messaging user interface, and Displaying an application store user interface, including displaying at least one interactive application available for download to an electronic device; while displaying the application store user interface, detecting an input corresponding to a request for downloading a first interactive application that is not stored in a memory of the electronic device; and in response to detecting the input corresponding to the request for downloading the first interactive application: downloading the first interactive application to a memory of the electronic device; replacing the display of the application store user interface with a display of an instant messaging user interface that includes a transcript of the conversation and at least some of a plurality of launch icons for the interactive application; and adding a launch icon corresponding to the first interactive application to the display of the plurality of launch icons for the interactive application.

[0064] According to some embodiments, the electronic device includes: a display unit configured to display a user interface; a touch-sensitive surface unit configured to detect contact; and a processing unit coupled to the display unit and the touch-sensitive surface unit. The processing unit is configured to: enable display of an instant messaging user interface of an instant messaging application on the display unit, the instant messaging user interface including a transcript of a conversation between a user of the electronic device and at least one other user and an application enable representation; while displaying the instant messaging user interface, detect input for activating the application enable representation; in response to detecting input for activating the application enable representation, simultaneously enable display of a launch icon for an application store and multiple launch icons for interactive applications, wherein activating a corresponding launch icon for an interactive application will launch a corresponding application displayed in the instant messaging application; detect input for activating the launch icon for the application store; in response to detecting input for activating the launch icon for the application store: stop displaying the instant messaging user interface; A user interface is provided, and display of an application store user interface is enabled, including displaying at least one interactive application available for download to the electronic device; while displaying the application store user interface, detecting an input corresponding to a request for downloading a first interactive application that is not stored in a memory of the electronic device; and in response to detecting the input corresponding to the request for downloading the first interactive application: downloading the first interactive application to the memory of the electronic device; replacing the display of the application store user interface with a display of an instant messaging user interface that includes a transcript of the conversation and at least some of a plurality of launch icons for the interactive application; and adding a launch icon corresponding to the first interactive application to the display of the plurality of launch icons for the interactive application.

[0065] Thus, electronic devices with displays and touch-sensitive surfaces have improved methods and interfaces for adding interactive applications to instant messaging applications, thereby increasing effectiveness, efficiency, and user satisfaction with such devices. Such methods and interfaces may supplement or replace conventional methods for adding interactive applications to instant messaging applications.

[0066] There is a need for electronic devices with improved methods and interfaces for posting messages. Such methods and interfaces can supplement or replace conventional methods for posting messages. Such methods and interfaces reduce the amount, degree and / or nature of input from a user and produce a more efficient human-computer interface.

[0067] According to some embodiments, a method is performed at an electronic device having one or more processors, a memory, a touch-sensitive surface, and a display. The method includes: displaying an instant messaging user interface of an instant messaging application on a display, the instant messaging user interface including a transcript of an instant messaging conversation between a user of the electronic device and at least one other user, a first message input area, and a launch icon of an interactive application; while displaying the instant messaging user interface, detecting an input for activating the launch icon of the interactive application; in response to detecting the input for activating the launch icon of the interactive application, displaying a user interface of the interactive application, the interactive application user interface including a second message input area different from the first message input area; while displaying the interactive application user interface, detecting an input of a first message in the second message input area; in response to detecting the input of the first message in the second message input area, displaying the first message in the second message input area; while displaying the first message in the second message input area, detecting an input corresponding to a request for publishing the content of the second message input area to the instant messaging conversation; and in response to detecting the input corresponding to the request for publishing the content of the second message input area to the instant messaging conversation, transmitting the first message to one or more electronic devices corresponding to at least one other user included in the instant messaging conversation, wherein the one or more electronic devices display the first message in the conversation transcript corresponding to the instant messaging conversation.

[0068] According to some embodiments, an electronic device includes: a display unit configured to display a user interface; a touch-sensitive surface unit configured to detect contact; and a processing unit coupled to the display unit and the touch-sensitive surface unit. The processing unit is configured to: enable display of an instant messaging user interface of an instant messaging application on a display unit, the instant messaging user interface including a transcript of a conversation between a user of the electronic device and at least one other user, a first message input area, and a launch icon of an interactive application; when displaying the instant messaging user interface, detect input for activating the launch icon of the interactive application; in response to detecting the input for activating the launch icon of the interactive application, enable display of the user interface of the interactive application, the interactive application user interface including a second message input area different from the first message input area; when displaying the interactive application user interface, detect input of a first message in the second message input area; in response to detecting input of the first message in the second message input area, enable display of the first message in the second message input area; when displaying the first message in the second message input area, detect input corresponding to a request for publishing content of the second message input area to the instant messaging session; and in response to detecting input corresponding to a request for publishing content of the second message input area to the instant messaging session, transmit the first message to one or more electronic devices corresponding to at least one other user included in the instant messaging session, wherein the one or more electronic devices display the first message in a conversation transcript corresponding to the instant messaging session.

[0069] Therefore, electronic devices with displays and touch-sensitive surfaces have improved methods and interfaces for posting messages, thereby increasing effectiveness, efficiency, and user satisfaction with such devices. Such methods and interfaces can supplement or replace conventional methods for posting messages.

[0070] There is a need for electronic devices with improved methods and interfaces for using interactive applications in instant messaging applications. Such methods and interfaces can supplement or replace conventional methods for using interactive applications in instant messaging applications. Such methods and interfaces reduce the amount, extent, and / or nature of input from a user and produce a more efficient human-computer interface.

[0071] According to some embodiments, a method is performed at an electronic device having one or more processors, a memory, a touch-sensitive surface, and a display. The method includes: displaying an instant messaging user interface of an instant messaging application on a display, the instant messaging user interface including a conversation transcript of an instant messaging conversation between a user of the electronic device and at least one other user, a message input area, and an icon of an interactive application displayed in the conversation transcript; while displaying the instant messaging user interface, detecting an input to activate the icon of the interactive application; in response to detecting the input to activate the icon of the interactive application, displaying the user interface of the interactive application in a first state; while displaying the user interface of the interactive application, detecting a first user input in the user interface of the interactive application; and in response to detecting the first user input in the user interface of the interactive application: changing the display of the user interface of the interactive application from the first state to the second state, and sending information to one or more electronic devices corresponding to at least one other user included in the instant messaging conversation, indicating that the first user input was made in the user interface of the interactive application, wherein the one or more electronic devices display a mark of the first user input.

[0072] According to some embodiments, an electronic device includes: a display unit configured to display a user interface; a touch-sensitive surface unit configured to detect contact; and a processing unit coupled to the display unit and the touch-sensitive surface unit. The processing unit is configured to: enable display of an instant messaging user interface of an instant messaging application on the display unit, the instant messaging user interface including a conversation transcript of an instant messaging conversation between a user of the electronic device and at least one other user, a message input area, and an icon of an interactive application displayed in the conversation transcript; while displaying the instant messaging user interface, detect an input that activates the icon of the interactive application; in response to detecting the input that activates the icon of the interactive application, enable display of the user interface of the interactive application in a first state; while displaying the user interface of the interactive application, detect a first user input in the user interface of the interactive application; and in response to detecting the first user input in the user interface of the interactive application: change the display of the user interface of the interactive application from the first state to the second state, and send information to one or more electronic devices corresponding to at least one other user included in the instant messaging conversation, indicating that the first user input was made in the user interface of the interactive application, wherein the one or more electronic devices display a mark of the first user input.

[0073] Thus, electronic devices with displays and touch-sensitive surfaces have improved methods and interfaces for using interactive applications in instant messaging applications, thereby increasing effectiveness, efficiency, and user satisfaction with such devices. Such methods and interfaces may supplement or replace conventional methods for using interactive applications in instant messaging applications.

[0074] There is a need for electronic devices with improved methods and interfaces for using interactive applications in instant messaging applications. Such methods and interfaces can supplement or replace conventional methods for using interactive applications in instant messaging applications. Such methods and interfaces reduce the amount, extent, and / or nature of input from a user and produce a more efficient human-computer interface.

[0075] According to some embodiments, a method is performed at an electronic device having one or more processors, a memory, a touch-sensitive surface, and a display. The method includes: displaying an instant messaging user interface of an instant messaging application on a display, the instant messaging user interface including a conversation transcript of an instant messaging conversation between a user of the electronic device and at least one other user and a message input area; when displaying the instant messaging user interface, receiving an instruction for displaying an icon of an interactive application in the conversation transcript from an electronic device corresponding to another user included in the instant messaging conversation; in response to receiving the instruction, displaying the icon of the interactive application in the conversation transcript; when displaying the icon of the interactive application in the conversation transcript, detecting an input for activating the icon of the interactive application; and in response to detecting the input for activating the icon of the interactive application displayed in the conversation transcript: displaying the user interface of the interactive application based on determining that the interactive application corresponding to the icon of the interactive application is stored in the memory of the electronic device, and based on determining that the interactive application corresponding to the icon of the interactive application is not stored in the memory of the electronic device: downloading the interactive application from a remote server to the memory of the electronic device, and after downloading the interactive application from the remote server, displaying the user interface of the interactive application.

[0076] According to some embodiments, an electronic device includes: a display unit configured to display a user interface; a touch-sensitive surface unit configured to detect contact; and a processing unit coupled to the display unit and the touch-sensitive surface unit. The processing unit is configured to: enable display of an instant messaging user interface of an instant messaging application on a display unit, the instant messaging user interface including a conversation transcript of an instant messaging conversation between a user of the electronic device and at least one other user and a message input area; when displaying the instant messaging user interface, receive an instruction for displaying an icon of an interactive application in the conversation transcript from an electronic device corresponding to another user included in the instant messaging conversation; in response to receiving the instruction, enable display of the icon of the interactive application in the conversation transcript; when displaying the icon of the interactive application in the conversation transcript, detect an input for activating the icon of the interactive application; and in response to detecting the input for activating the icon of the interactive application displayed in the conversation transcript: based on determining that the interactive application corresponding to the icon of the interactive application is stored in the memory of the electronic device, enable display of the user interface of the interactive application, and based on determining that the interactive application corresponding to the icon of the interactive application is not stored in the memory of the electronic device: download the interactive application from a remote server to the memory of the electronic device, and after downloading the interactive application from the remote server, enable display of the user interface of the interactive application.

[0077] Thus, electronic devices with displays and touch-sensitive surfaces have improved methods and interfaces for using interactive applications in instant messaging applications, thereby increasing effectiveness, efficiency, and user satisfaction with such devices. Such methods and interfaces may supplement or replace conventional methods for using interactive applications in instant messaging applications.

[0078] There is a need for electronic devices with improved methods and interfaces for using interactive applications in instant messaging applications. Such methods and interfaces can supplement or replace conventional methods for using interactive applications in instant messaging applications. Such methods and interfaces reduce the amount, extent, and / or nature of input from a user and produce a more efficient human-computer interface.

[0079] According to some embodiments, a method is performed at an electronic device having a display and a touch-sensitive surface. The method includes: displaying an instant messaging user interface of an instant messaging application on the display, the instant messaging user interface including: a conversation transcript of an instant messaging conversation between a user of the electronic device and at least one other user displayed in a first area of ​​the display, a first interactive application object corresponding to a first interactive application displayed in the conversation transcript, a message input area, and an input area of ​​the first interactive application different from the message input area displayed in a second area of ​​the display, the input area of ​​the first interactive application including one or more input enable indications; and detecting an input of the first input enable indication in the input area of ​​the activated interactive application.

[0080] According to some embodiments, the electronic device includes a display unit and a touch-sensitive surface unit, and a processing unit coupled to the display unit and the touch-sensitive surface unit. The processing unit is configured to: enable display of an instant messaging user interface of an instant messaging application on the display unit, the instant messaging user interface including: a conversation transcript of an instant messaging conversation between a user of the electronic device and at least one other user displayed in a first area of ​​the display, a first interactive application object corresponding to a first interactive application displayed in the conversation transcript, a message input area, and an input area of ​​the first interactive application different from the message input area displayed in a second area of ​​the display, the input area of ​​the first interactive application including one or more input enable indications; and detect input of the first input enable indication in the input area of ​​the activated interactive application.

[0081] Thus, electronic devices with displays and touch-sensitive surfaces have improved methods and interfaces for using interactive applications in instant messaging applications, thereby increasing effectiveness, efficiency, and user satisfaction with such devices. Such methods and interfaces may supplement or replace conventional methods for using interactive applications in instant messaging applications.

[0082] There is a need for electronic devices with improved methods and interfaces for using interactive applications in instant messaging applications. Such methods and interfaces can supplement or replace conventional methods for using interactive applications in instant messaging applications. Such methods and interfaces reduce the amount, extent, and / or nature of input from a user and produce a more efficient human-computer interface.

[0083] According to some embodiments, a method is performed at an electronic device having a display and a touch-sensitive surface. The method includes: displaying an instant messaging user interface of an instant messaging application on the display, the instant messaging user interface including: a conversation transcript of an instant messaging conversation between a user of the electronic device and at least one other user, a first interactive application object corresponding to a first interactive application displayed in the conversation transcript, and a message input area. The method also includes: detecting a first input when the focus selector is at a position corresponding to the first interactive application object displayed in the conversation transcript on the touch-sensitive surface; in response to detecting the first input, displaying an input area of ​​a first interactive application different from the message input area, the input area of ​​the first interactive application including one or more input enable representations; when displaying the input area of ​​the first interactive application, detecting one or more inputs on one or more input enable representations; after detecting one or more inputs on one or more input enable representations: updating the first interactive application; sending information to one or more electronic devices corresponding to at least one other user included in the instant messaging conversation, so as to update the corresponding user interface of the first interactive application displayed in the corresponding conversation transcript of the instant messaging conversation; and stopping displaying the input area of ​​the first interactive application.

[0084] According to some embodiments, the electronic device includes a display unit and a touch-sensitive surface unit, and a processing unit coupled to the display unit and the touch-sensitive surface unit. The processing unit is configured to enable display of an instant messaging user interface of an instant messaging application on the display unit, the instant messaging user interface including: a conversation transcript of an instant messaging conversation between a user of the electronic device and at least one other user, a first interactive application object corresponding to a first interactive application displayed in the conversation transcript, and a message input area. The processing unit is further configured to: detect a first input when the focus selector is at a position on the touch-sensitive surface unit corresponding to a first interactive application object displayed in a conversation transcript; in response to detecting the first input, enable display of an input area of ​​a first interactive application that is different from a message input area, the input area of ​​the first interactive application including one or more input enable indications; while displaying the input area of ​​the first interactive application, detect one or more inputs on the one or more input enable indications; after detecting the one or more inputs on the one or more input enable indications: update the first interactive application; send information to one or more electronic devices corresponding to at least one other user included in the instant messaging session so as to update a corresponding user interface of the first interactive application displayed in a corresponding conversation transcript of the instant messaging session; and stop displaying the input area of ​​the first interactive application.

[0085] Thus, electronic devices with displays and touch-sensitive surfaces have improved methods and interfaces for using interactive applications in instant messaging applications, thereby increasing effectiveness, efficiency, and user satisfaction with such devices. Such methods and interfaces may supplement or replace conventional methods for using interactive applications in instant messaging applications.

[0086] There is a need for electronic devices with improved methods and interfaces for enabling the use of interactive applications in instant messaging applications. Such methods and interfaces can supplement or replace conventional methods for enabling the use of interactive applications in instant messaging applications. Such methods and interfaces reduce the amount, extent, and / or nature of input from a user and produce a more efficient human-computer interface.

[0087] According to some embodiments, a method is performed at an electronic device having a display and a touch-sensitive surface, wherein an instant messaging application and a plurality of other applications are stored in a memory, and a corresponding application among the plurality of other applications has a normal mode for normal operation on the electronic device and an embedded mode for operation in the instant messaging application on the electronic device. The method includes: displaying a plurality of toggle enable representations, wherein a corresponding toggle enable representation among the plurality of toggle enable representations has a corresponding application among a plurality of other applications stored in the memory; the corresponding toggle enable representation has a first state, which enables display of a corresponding launch icon in the instant messaging application so as to operate the corresponding application in an embedded mode in the instant messaging application; the corresponding toggle enable representation has a second state, which blocks display of a corresponding launch icon in the instant messaging application so as to block operation of the corresponding application in an embedded mode in the instant messaging application; the plurality of toggle enable representations include a first toggle enable representation of a first application displayed in a first state and a second toggle enable representation of a second application displayed in a second state. When displaying multiple toggle enable indications, the method also includes: detecting a first user input at a first position corresponding to a first toggle enable indication; and in response to detecting a first user input at a first position corresponding to the first toggle enable indication: changing the first toggle enable indication from a first state to a second state, and preventing the corresponding launch icon of the first application from being displayed in the instant messaging application.

[0088] According to some embodiments, the electronic device includes a display unit and a touch-sensitive surface unit, and a processing unit coupled to the display unit and the touch-sensitive surface unit, wherein an instant messaging application and a plurality of other applications are stored in a memory of the electronic device, and a corresponding application in the plurality of other applications has a normal mode for normal operation on the electronic device and an embedded mode for operation in the instant messaging application on the electronic device. The processing unit is configured to: enable the display of a plurality of toggle enable representations, wherein a corresponding toggle enable representation in the plurality of toggle enable representations has a corresponding application in a plurality of other applications stored in the memory; the corresponding toggle enable representation has a first state, which enables the display of a corresponding launch icon in the instant messaging application so as to operate the corresponding application in an embedded mode in the instant messaging application; the corresponding toggle enable representation has a second state, which blocks the display of a corresponding launch icon in the instant messaging application so as to block the operation of the corresponding application in an embedded mode in the instant messaging application; the plurality of toggle enable representations include a first toggle enable representation of a first application displayed in a first state and a second toggle enable representation of a second application displayed in a second state. The processing unit is further configured to: when displaying multiple toggle enable indications, detect a first user input at a first position corresponding to a first toggle enable indication; and in response to detecting the first user input at the first position corresponding to the first toggle enable indication: change the first toggle enable indication from a first state to a second state, and prevent the corresponding launch icon of the first application from being displayed in the instant messaging application.

[0089] Thus, electronic devices with displays and touch-sensitive surfaces have improved methods and interfaces to enable the use of interactive applications in instant messaging applications, thereby increasing the effectiveness, efficiency, and user satisfaction of utilizing such devices. Such methods and interfaces may supplement or replace conventional methods for enabling the use of interactive applications in instant messaging applications.

[0090] There is a need for electronic devices with improved methods and interfaces for navigating in instant messaging applications. Such methods and interfaces can supplement or replace conventional methods for navigating in instant messaging applications. Such methods and interfaces reduce the amount, extent, and / or nature of input from a user and produce a more efficient human-computer interface.

[0091] According to some embodiments, a method is performed at an electronic device having a display, a touch-sensitive surface, and a digital camera. The method includes: displaying an instant messaging user interface on the display, the instant messaging user interface including a transcript of a conversation between a user of the electronic device and at least one other user, a message input area, a digital image enable representation, a digital touch enable representation, and an application enable representation; while displaying the instant messaging user interface, detecting a first input on the touch-sensitive surface; in response to detecting the first input: displaying a plurality of digital images in the instant messaging user interface based on determining that the first input is made when the focus selector is at a position corresponding to the digital image enable representation in the instant messaging user interface; displaying a digital drawing canvas in the instant messaging user interface based on determining that the first input is made when the focus selector is at a position corresponding to the digital canvas enable representation in the instant messaging user interface; and displaying one or more launch icons of the application in the instant messaging user interface based on determining that the first input is made when the focus selector is at a position corresponding to the application enable representation in the instant messaging user interface.

[0092] According to some embodiments, the electronic device includes a display unit, a touch-sensitive surface unit, a digital camera unit, and a processing unit coupled to the display unit, the touch-sensitive surface unit, and the digital camera unit. The processing unit is configured to: enable display of an instant messaging user interface on the display unit, the instant messaging user interface including a transcript of a conversation of an instant messaging conversation between a user of the electronic device and at least one other user, a message input area, a digital image enable representation, a digital touch enable representation, and an application enable representation. The processing unit is further configured to: detect a first input on the touch-sensitive surface while displaying the instant messaging user interface; in response to detecting the first input: enable display of multiple digital images in the instant messaging user interface based on determining that the first input is made when the focus selector is at a position corresponding to the digital image enable representation in the instant messaging user interface; enable display of a digital drawing canvas in the instant messaging user interface based on determining that the first input is made when the focus selector is at a position corresponding to the digital canvas enable representation in the instant messaging user interface; and enable display of one or more launch icons of the application in the instant messaging user interface based on determining that the first input is made when the focus selector is at a position corresponding to the application enable representation in the instant messaging user interface.

[0093] Therefore, electronic devices with displays and touch-sensitive surfaces have improved methods and interfaces for navigating in instant messaging applications, thereby increasing effectiveness, efficiency, and user satisfaction with such devices. Such methods and interfaces can supplement or replace conventional methods for navigating in instant messaging applications.

[0094] There is a need for electronic devices with improved methods and interfaces for placing electronic stickers in a conversation transcript. Such methods and interfaces may supplement or replace conventional methods for placing electronic stickers in a conversation transcript. Such methods and interfaces reduce the amount, extent, and / or nature of input from a user and produce a more efficient human-computer interface.

[0095] According to some embodiments, a method is performed at an electronic device having one or more processors, a memory, a touch-sensitive surface, and a display. The device displays an instant messaging user interface of an instant messaging application on a display, and the instant messaging user interface includes a conversation transcript of an instant messaging conversation between a user of the electronic device and at least one other user, a plurality of electronic stickers, and a message input area. When the instant messaging user interface is displayed, the device detects a first drag gesture that starts when the focus selector is at a first position corresponding to a first electronic sticker in a plurality of electronic stickers in the instant messaging user interface, and the first drag gesture moves the focus selector in a first direction. The device moves the first electronic sticker in a first direction according to the movement of the first drag gesture. When the focus selector is at a second position in the instant messaging user interface, the device detects the termination of the first drag gesture. In response to detecting the termination of the first drag gesture: based on determining that the second position is in the conversation transcript, the device places the electronic sticker at a position based on the second position in the conversation transcript. Based on determining that the second position is not in the conversation transcript, the device stops displaying the electronic sticker at the second position of the display.

[0096] According to some embodiments, an electronic device includes: a display unit configured to display a user interface; a touch-sensitive surface unit configured to detect contact; and a processing unit coupled to the display unit and the touch-sensitive surface unit. The processing unit is configured to enable display of an instant messaging user interface of an instant messaging application on the display unit, the instant messaging user interface including a transcript of a conversation of an instant messaging conversation between a user of the electronic device and at least one other user, a plurality of electronic stickers, and a message input area. When displaying the instant messaging user interface, the processing unit is configured to detect a first drag gesture that starts when a focus selector is at a first position in the instant messaging user interface corresponding to a first electronic sticker among a plurality of electronic stickers, the first drag gesture moving the focus selector in a first direction. The processing unit is configured to move the first electronic sticker in a first direction according to the movement of the first drag gesture. The processing unit is configured to detect termination of the first drag gesture when the focus selector is at a second position in the instant messaging user interface. In response to detecting termination of the first drag gesture: based on determining that the second position is in the conversation transcript, the processing unit is configured to place the electronic sticker at a position in the conversation transcript based on the second position, and based on determining that the second position is not in the conversation transcript, the processing unit is configured to stop displaying the electronic sticker at the second position on the display unit.

[0097] Thus, electronic devices with displays and touch-sensitive surfaces have improved methods and interfaces for placing electronic stickers in conversation transcripts, thereby increasing effectiveness, efficiency, and user satisfaction with such devices. Such methods and interfaces may supplement or replace conventional methods for placing electronic stickers in conversation transcripts.

[0098] There is a need for electronic devices with improved methods and interfaces for changing the characteristics of electronic stickers in a conversation transcript. Such methods and interfaces can supplement or replace conventional methods for changing the characteristics of electronic stickers in a conversation transcript of an instant messaging user interface. Such methods and interfaces reduce the amount, degree and / or nature of input from the user and produce a more efficient human-computer interface.

[0099] According to some embodiments, a method is performed at an electronic device having one or more processors, a memory, a touch-sensitive surface, and a display. The device displays an instant messaging user interface of an instant messaging application on the display, and the instant messaging user interface includes a conversation transcript of an instant messaging conversation between a user of the electronic device and at least one other user, a plurality of electronic stickers, and a message input area. When the instant messaging user interface is displayed, the device detects a first user input when the focus selector is at a first position corresponding to a first electronic sticker in a plurality of electronic stickers in the instant messaging user interface. In response to detecting the first user input, the device places and displays the first electronic sticker in the conversation transcript. When the first electronic sticker is displayed in the conversation transcript: the device detects a second user input when the focus selector is at a second position corresponding to the first electronic sticker in the conversation transcript in the instant messaging user interface. In response to detecting the second user input, the device changes the position, size, and / or rotation of the first electronic sticker in the conversation transcript.

[0100] According to some embodiments, an electronic device is provided, which has a display unit configured to display a user interface; a touch-sensitive surface unit configured to detect contact; and a processing unit coupled to the display unit and the touch-sensitive surface unit. The processing unit enables display of an instant messaging user interface of an instant messaging application on the display unit, and the instant messaging user interface includes a conversation transcript of an instant messaging conversation between a user of the electronic device and at least one other user, a plurality of electronic stickers, and a message input area. When the instant messaging user interface is displayed, the processing unit detects a first user input when the focus selector is at a first position corresponding to a first electronic sticker in a plurality of electronic stickers in the instant messaging user interface. In response to detecting the first user input, the processing unit places the first electronic sticker in the conversation transcript and enables display of the first electronic sticker. When the first electronic sticker is displayed in the conversation transcript: the processing unit detects a second user input when the focus selector is at a second position corresponding to the first electronic sticker in the conversation transcript in the instant messaging user interface. In response to detecting the second user input, the device changes the position, size, and / or rotation of the first electronic sticker in the conversation transcript.

[0101] Thus, an electronic device with a display and a touch-sensitive surface has an improved method and interface for changing the characteristics of an electronic sticker in a conversation transcript of an instant messaging user interface, thereby improving the effectiveness, efficiency, and user satisfaction of using such a device. Such methods and interfaces can supplement or replace conventional methods for changing the characteristics of an electronic sticker in a conversation transcript of an instant messaging user interface.

[0102] There is a need for electronic devices with improved methods and interfaces for initiating payments through instant messaging applications. Such methods and interfaces may supplement or replace conventional methods for initiating payments through instant messaging applications. Such methods and interfaces reduce the amount, extent, and / or nature of input from a user and produce a more efficient human-computer interface.

[0103] According to some embodiments, a method is performed at an electronic device having one or more processors, a memory, a touch-sensitive surface, and a display. The device displays an instant messaging user interface of an instant messaging application on a display, the instant messaging user interface including a transcript of a conversation between an instant messaging session between a user of the electronic device and at least one other user and a message input area, wherein each of the other users included in the instant messaging session has a corresponding avatar. When displaying the instant messaging user interface, the device detects a first user input when a focus selector is at a first position in the instant messaging user interface corresponding to an avatar of a first other user included in the instant messaging session. In response to detecting the first user input, the device displays a menu including an activatable menu item associated with the first other user overlaid on the instant messaging user interface, the displayed menu including an activatable menu item for initiating a payment action with the first other user. When displaying a menu including an activatable menu item associated with the first other user, the device detects a second user input when the focus selector is at a second position in the instant messaging user interface corresponding to an activatable menu item for initiating a payment action with the first other user. In response to detecting the second user input, the device displays a user interface configured to initiate sending a payment to the first other user and / or requesting payment from the first other user.

[0104] In some embodiments, an electronic device is provided, the electronic device having a display unit configured to display a user interface; a touch-sensitive surface unit configured to detect contact; and a processing unit coupled to the display unit and the touch-sensitive surface unit. The processing unit enables display of an instant messaging user interface of an instant messaging application on the display unit, the instant messaging user interface including a transcript of a conversation of an instant messaging conversation between a user of the electronic device and at least one other user and a message input area, wherein each of the other users included in the instant messaging conversation has a corresponding avatar. When displaying the instant messaging user interface, the processing unit detects a first user input when a focus selector is at a first position in the instant messaging user interface corresponding to an avatar of a first other user included in the instant messaging conversation. In response to detecting the first user input, the processing unit enables display of a menu including an activatable menu item associated with a first other user overlaid on the instant messaging user interface, the displayed menu including an activatable menu item for initiating a payment action with the first other user. While displaying a menu including an activatable menu item associated with a first other user, the processing unit detects a second user input when the focus selector is at a second position in the instant messaging user interface corresponding to the activatable menu item for initiating a payment action with the first other user. In response to detecting the second user input, the processing unit enables display of a user interface configured to initiate sending a payment to the first other user and / or requesting payment from the first other user.

[0105] Thus, electronic devices with displays and touch-sensitive surfaces have improved methods and interfaces for initiating payments through instant messaging applications, thereby increasing effectiveness, efficiency, and user satisfaction with such devices. Such methods and interfaces may supplement or replace conventional methods for initiating payments through instant messaging applications.

[0106] There is a need for electronic devices with improved methods and interfaces for selectively activating menus in an instant messaging session. Such methods and interfaces can supplement or replace conventional methods for selectively activating menus in an instant messaging session. Such methods and interfaces reduce the amount, extent, and / or nature of input from a user and produce a more efficient human-computer interface.

[0107] According to some embodiments, a method is performed at an electronic device having one or more processors, a memory, a touch-sensitive surface, one or more sensors for detecting contact strength with the touch-sensitive surface, and a display. The device displays an instant messaging user interface of an instant messaging application on the display, the instant messaging user interface including a transcript of a conversation between an instant messaging session between a user of the electronic device and multiple other users, a message input area, and multiple avatars, each corresponding avatar in the multiple avatars corresponding to a corresponding other user in the multiple other users included in the instant messaging session, wherein the multiple avatars are displayed as an avatar overlay, and the first avatar in the multiple avatars is displayed on top of the avatar overlay. When the instant messaging user interface is displayed, the device detects input made by a first contact on the touch-sensitive surface when the focus selector is at a first position corresponding to the first avatar in the instant messaging user interface. In response to detecting the input made by the first contact: based on determining that the input meets a menu activation criterion, the device displays a menu including an activatable menu item associated with the first avatar overlaid on the instant messaging user interface, wherein the menu activation criterion requires that the characteristic intensity of the contact on the touch-sensitive surface meets a corresponding intensity threshold in order to meet the menu activation criterion. Based on determining that the input satisfies an avatar expansion criterion, the device displays a plurality of avatars in an array, wherein the avatar expansion criterion does not require that a characteristic intensity of a contact on the touch screen satisfies a corresponding intensity threshold in order to satisfy a selection criterion.

[0108] According to some embodiments, an electronic device is provided, which includes a display unit configured to display a user interface; a touch-sensitive surface unit configured to detect contact; and a processing unit coupled to the display unit and the touch-sensitive surface unit. The processing unit enables display of an instant messaging user interface of an instant messaging application on the display unit, the instant messaging user interface including a transcript of a conversation between a user of the electronic device and multiple other users, a message input area, and multiple avatars, each corresponding avatar in the multiple avatars corresponding to a corresponding other user in the multiple other users included in the instant messaging conversation, wherein the multiple avatars are displayed as an avatar overlay, and a first avatar in the multiple avatars is displayed on top of the avatar overlay. When displaying the instant messaging user interface, the processing unit detects input made by a first contact on the touch-sensitive surface unit when the focus selector is at a first position corresponding to the first avatar in the instant messaging user interface. In response to detecting input via a first contact: based on determining that the input satisfies menu activation criteria, the processing unit enables display of a menu including activatable menu items associated with a first avatar overlaid on the instant messaging user interface, wherein the menu activation criteria requires that a characteristic intensity of the contact on the touch-sensitive surface unit satisfies a corresponding intensity threshold in order to satisfy the menu activation criteria. Based on determining that the input satisfies avatar expansion criteria, the processing unit enables display of multiple avatars in an array, wherein the avatar expansion criteria does not require that a characteristic intensity of the contact on the touch screen satisfy a corresponding intensity threshold in order to satisfy the selection criteria.

[0109] Therefore, electronic devices with displays and touch-sensitive surfaces have improved methods and interfaces for selectively activating menus in instant messaging sessions, thereby increasing effectiveness, efficiency, and user satisfaction with such devices. Such methods and interfaces can supplement or replace conventional methods for selectively activating menus in instant messaging sessions.

[0110] There is a need for electronic devices with improved methods and interfaces for providing optional links for words or phrases in a message to access additional content. Such methods and interfaces can supplement or replace conventional methods for providing optional links for words or phrases in a message to access additional content. Such methods and interfaces reduce the amount, extent, and / or nature of input from a user and produce a more efficient human-computer interface.

[0111] According to some embodiments, a method is performed at an electronic device having one or more processors, a memory, a touch-sensitive surface, and a display. The device displays an instant messaging user interface of an instant messaging application on a display, and the instant messaging user interface includes a conversation transcript of an instant messaging conversation between a user of the electronic device and at least one other user and a message input area. While displaying the instant messaging user interface, the device receives a first message in an instant messaging conversation from an electronic device corresponding to another user included in the instant messaging conversation. In response to receiving the first message, the device displays the first message in a first message area of ​​the conversation transcript on the display. The device detects a word or phrase associated with additional content available on the Internet in the first message; and in response to detecting a word or phrase associated with additional content available on the Internet, the device displays an optional indication of the availability of additional content associated with the word or phrase adjacent to the first message area.

[0112] In some embodiments, an electronic device is provided, the electronic device comprising a display unit configured to display a user interface; a touch-sensitive surface unit configured to detect contact; and a processing unit coupled to the display unit and the touch-sensitive surface unit. The processing unit enables display of an instant messaging user interface of an instant messaging application on the display unit, the instant messaging user interface comprising a conversation transcript of an instant messaging conversation between a user of the electronic device and at least one other user and a message input area. While displaying the instant messaging user interface, the processing unit receives a first message in an instant messaging conversation from an electronic device corresponding to another user included in the instant messaging conversation. In response to receiving the first message, the processing unit enables display of the first message in a first message area of ​​the conversation transcript on the display unit. The processing unit detects a word or phrase associated with additional content available on the Internet in the first message. In response to detecting a word or phrase associated with additional content available on the Internet, the processing unit enables display of an optional indication of the availability of additional content associated with the word or phrase adjacent to the first message area.

[0113] Thus, electronic devices with displays and touch-sensitive surfaces have improved methods and interfaces for providing selectable links to access additional content for words or phrases in messages, thereby increasing effectiveness, efficiency, and user satisfaction with such devices. Such methods and interfaces can supplement or replace conventional methods for providing selectable links to access additional content on words or phrases in messages.

[0114] There is a need for electronic devices with improved methods and interfaces for navigating between applications in an instant messaging user interface. Such methods and interfaces can supplement or replace conventional methods for navigating between applications in an instant messaging user interface. Such methods and interfaces reduce the amount, extent, and / or nature of input from a user and produce a more efficient human-computer interface.

[0115] According to some embodiments, a method is performed at an electronic device having a display and a touch-sensitive surface. The method includes: displaying an instant messaging user interface on the display, the instant messaging user interface including: a transcript of a conversation between a user of the electronic device and at least one other user; a message input area; an application area; and an application area display enable representation; while displaying the instant messaging user interface, detecting a first input that activates the application area display enable representation; in response to detecting the first input that activates the application area display enable representation, based on determining that the application area is displaying a keyboard when the first input is detected, replacing the display of the keyboard in the application area by simultaneously displaying the following: an application selection area that displays multiple scrollable application selection enable representations, wherein: the multiple scrollable application selection enable representations include a first application selection enable representation corresponding to the currently selected first application; and the corresponding application selection enable representation has a corresponding first size; and displaying the first application selection enable representation. an application input area for one or more activatable objects of an application; while simultaneously displaying an application selection area and the application input area, detecting a second input comprising movement of a contact on the touch-sensitive surface corresponding to movement of a focus selector in the application selection area on the display along a first direction; in response to detecting the second input: scrolling the multiple application selection enable representations along the first direction, and displaying a second application selection enable representation; while displaying the second application selection enable representation and one or more activatable objects of the first application in an instant messaging user interface, detecting a third input that activates the second application selection enable representation; and in response to detecting the third input that activates the second application selection enable representation: ceasing to display the one or more activatable objects of the first application; and displaying one or more activatable objects of the second application corresponding to the second application selection enable representation in the application input area.

[0116] Therefore, electronic devices with displays and touch-sensitive surfaces have improved methods and interfaces for navigating between applications in an instant messaging user interface, thereby increasing effectiveness, efficiency, and user satisfaction with such devices. Such methods and interfaces can supplement or replace conventional methods for navigating between applications in an instant messaging user interface.

[0117] There is a need for electronic devices with improved methods and interfaces for managing applications used in instant messaging applications. Such methods and interfaces may supplement or replace conventional methods for managing applications used in instant messaging applications. Such methods and interfaces reduce the amount, extent, and / or nature of input from a user and produce a more efficient human-computer interface.

[0118] According to some embodiments, a method is performed on a device having a display and a touch-sensitive surface. The method includes: displaying an instant messaging user interface of an instant messaging application on the display, the instant messaging user interface including: a transcript of a conversation between a user of the electronic device and at least one other user; a message input area; and an application area, which includes: an application input area that displays one or more activatable objects of a first application; and an application selection area, which includes: a plurality of scrollable application selection enable representations corresponding to a plurality of applications operated in the instant messaging user interface, and a first application configuration enable representation; when the application configuration enable representation is displayed in the application selection area, a first input that activates the first application configuration enable representation is detected; in response to detecting the first input, a first application management interface of the instant messaging application is displayed, the first application management interface including: a plurality of installed application enable representations corresponding to a plurality of applications operated in the instant messaging user interface of the instant messaging application, and a plurality of application configuration enable representations different from the first application configuration enable representation; a second application configuration enable representation of the setting enable representation; when displaying the first application management interface, detecting a second input at a position corresponding to a first installed application enable representation among the multiple installed application enable representations, wherein the first installed application enable representation corresponds to a first installed application on the electronic device; and in response to detecting the second input, initiating a process for uninstalling at least one component of the first installed application on the mobile device; when displaying the first application management interface, detecting a third input at a position corresponding to the second application configuration enable representation; and in response to detecting the third input, displaying a second application management interface of the instant messaging application, the second application management interface comprising: a plurality of back and forth switches corresponding to a plurality of applications operated in the instant messaging user interface of the instant messaging application, wherein activation of the corresponding back and forth switches causes the corresponding application in the instant messaging user interface of the instant messaging application to switch back and forth between a hidden state and a visible state.

[0119] Thus, electronic devices with displays and touch-sensitive surfaces have improved methods and interfaces for managing applications used in instant messaging applications, thereby increasing effectiveness, efficiency, and user satisfaction with such devices. Such methods and interfaces may supplement or replace conventional methods for managing applications used in instant messaging applications.

[0120] There is a need for electronic devices with improved methods and interfaces for translating message content in instant messaging applications. Such methods and interfaces may supplement or replace conventional methods for translating message content in instant messaging applications. Such methods and interfaces reduce the amount, extent, and / or nature of input from a user and produce a more efficient human-computer interface.

[0121] According to some embodiments, a method is performed on a device having a display and one or more input devices. The method includes: displaying an instant messaging user interface on the display, the instant messaging user interface including a conversation transcript of an instant messaging conversation between a user of the electronic device and at least one other user; receiving a first message in the instant messaging conversation from an electronic device corresponding to another user included in the instant messaging conversation, wherein the first message includes foreign language text; in response to receiving the first message, displaying the first message in the conversation transcript; detecting a first input at a first position corresponding to the foreign language text in the first message; in response to detecting the first input at a first position corresponding to the foreign language text: displaying a translation of the foreign language text based on determining that the first input meets the translation criteria; and displaying multiple activatable marks based on determining that the first input meets the option display criteria.

[0122] According to some embodiments, a method is performed on a device having a display and one or more input devices. The method includes: displaying an instant messaging user interface on the display, the instant messaging user interface including a conversation transcript of an instant messaging conversation between a user of the electronic device and at least one other user; receiving a first message in the instant messaging conversation from an electronic device corresponding to another user included in the instant messaging conversation, wherein the first message includes foreign language text; in response to receiving the first message, displaying the first message in the conversation transcript; detecting a first input at a position corresponding to the foreign language text in the first message; in response to detecting the first input at a position corresponding to the foreign language text: performing a foreign language text translation action based on determining that the first input meets the translation criteria; and abandoning the foreign language text translation action based on determining that the first input does not meet the translation criteria.

[0123] Therefore, electronic devices with displays and touch-sensitive surfaces have improved methods and interfaces for translating message content in instant messaging applications, thereby increasing effectiveness, efficiency, and user satisfaction with such devices. Such methods and interfaces can supplement or replace conventional methods for translating message content in instant messaging applications.

[0124] According to some embodiments, an electronic device includes a display, a touch-sensitive surface, one or more sensors for detecting contact intensity with the touch-sensitive surface, one or more processors, a memory, and one or more programs; the one or more programs are stored in the memory and configured to be executed by the one or more processors, and the one or more programs include instructions for performing or causing the execution of the operations of any of the methods described herein. According to some embodiments, a computer-readable storage medium has instructions stored therein, which, when executed by an electronic device having a display, a touch-sensitive surface, and one or more sensors for detecting contact intensity with the touch-sensitive surface, causes the device to perform or cause the execution of the operations of any of the methods described herein. According to some embodiments, a graphical user interface at an electronic device having a display, a touch-sensitive surface, one or more sensors for detecting contact intensity with the touch-sensitive surface, a memory, and one or more processors for executing one or more programs stored in the memory includes one or more elements updated in response to input in an element displayed in any of the methods described herein, as described in any of the methods described herein. According to some embodiments, an electronic device includes: a display, a touch-sensitive surface, and one or more sensors for detecting contact intensity with the touch-sensitive surface; and a device for performing or causing the execution of the operations of any of the methods described herein. According to some embodiments, an information processing device in an electronic device having a display, a touch-sensitive surface, and optionally one or more sensors for detecting intensity of contact with the touch-sensitive surface includes a device for performing or causing the performance of operations of any of the methods described herein.

[0125] Thus, electronic devices having a display, a touch-sensitive surface, and optionally one or more sensors for detecting intensity of contact with the touch-sensitive surface have faster, more efficient methods and interfaces for messaging, thereby increasing effectiveness, efficiency, and user satisfaction with such devices. Such methods and interfaces may supplement or replace conventional methods for messaging. BRIEF DESCRIPTION OF THE DRAWINGS

[0126] For a better understanding of the various described embodiments, reference should be made to the following detailed description taken in conjunction with the following drawings, wherein like reference numerals designate corresponding parts throughout the several views.

[0127] Figure 1A is a block diagram illustrating a portable multifunction device with a touch-sensitive display in accordance with some embodiments.

[0128] Figure 1B is a block diagram illustrating example components for event processing according to some embodiments.

[0129] Figure 2 A portable multifunction device with a touch screen according to some embodiments is shown.

[0130] Figure 3 is a block diagram of an exemplary multifunction device with a display and a touch-sensitive surface according to some embodiments.

[0131] Figure 4A An exemplary user interface for an application menu on a portable multifunction device according to some embodiments is shown.

[0132] Figure 4B An exemplary user interface for a multifunction device having a touch-sensitive surface separate from a display is shown according to some embodiments.

[0133] FIG. 4C to FIG. 4E Examples of dynamic intensity thresholds according to some embodiments are shown.

[0134] FIG. 5A to FIG. 5K An exemplary user interface for displaying a message transcript and a message confirmation is shown.

[0135] Figure 5L to Figure 5T An exemplary user interface for editing a previously sent message while displaying a transcript of the message is shown.

[0136] Figures 5U to 5BF An exemplary user interface for applying an impact effect option to a message input or message area is shown.

[0137] Figure 5BG to Figure 5CA An exemplary user interface for interacting with hidden messages is shown.

[0138] Figure 5CB to Figure 5CW An exemplary user interface is shown for triggering enhanced message content and applying the effect to an instant messaging user interface when the message includes an enhanced message content trigger.

[0139] Figure 5CX to Figure 5DC An exemplary user interface for detecting and responding to composable content in a single message is shown.

[0140] Figure 5DD to Figure 5DI An exemplary user interface for selecting a message area type or shape is shown.

[0141] Figure 5DI to Figure 5DQ An exemplary user interface for automatically displaying and selecting suggested emoticons when composing a message is shown.

[0142] FIG. 6A to FIG. 6E is a flowchart of a process for applying confirmation to a message area in a conversation transcript according to some embodiments.

[0143] Figure 7 is a functional block diagram of an electronic device according to some embodiments.

[0144] FIG. 8A to FIG. 8C is a flowchart of a process for editing a previously sent message in an instant messaging conversation according to some embodiments.

[0145] Fig. 9 is a functional block diagram of an electronic device according to some embodiments.

[0146] FIG. 10A to FIG. 10B is a flowchart of a process for editing a previously sent message in an instant messaging conversation according to some embodiments.

[0147] Fig.11 is a functional block diagram of an electronic device according to some embodiments.

[0148] FIG. 12A to FIG. 12E is a flowchart of a process for applying an impact effect option to a message input according to some embodiments.

[0149] Fig.13 is a functional block diagram of an electronic device according to some embodiments.

[0150] FIG. 14A to FIG. 14B is a flowchart of a process for interacting with hidden messages according to some embodiments.

[0151] Fig.15 is a functional block diagram of an electronic device according to some embodiments.

[0152] FIG. 16A to FIG. 16C is a flowchart of a process for applying effects to an instant messaging user interface when the message includes an enhanced message content trigger according to some embodiments.

[0153] Fig.17 is a functional block diagram of an electronic device according to some embodiments.

[0154] 18A to 18C is a flowchart of a process for detecting combinable content in an instant messaging user interface and displaying content corresponding to a predetermined combination when the combinable content is detected, according to some embodiments.

[0155] Fig.19 is a functional block diagram of an electronic device according to some embodiments.

[0156] FIG. 20A to FIG. 20P An exemplary user interface is shown for presenting synchronized media content (e.g., audio content and / or video content) in an instant messaging application according to some embodiments.

[0157] FIG. 21A to FIG. 21C is a flowchart illustrating a method for presenting synchronized media content in an instant messaging application according to some embodiments.

[0158] Fig. 22 is a functional block diagram of an electronic device according to some embodiments.

[0159] FIG. 23A to FIG. 23AE An exemplary user interface is shown for providing and presenting user-specific handwriting input in an instant messaging application according to some embodiments.

[0160] FIG. 24A to FIG. 24C is a flowchart illustrating a method for providing and presenting user-specific handwriting input in an instant messaging application according to some embodiments.

[0161] Fig.25 is a functional block diagram of an electronic device according to some embodiments.

[0162] FIG. 26A to FIG. 26B is a flowchart illustrating a method for providing and presenting user-specific handwriting input in an instant messaging application according to some embodiments.

[0163] Fig. 27 is a functional block diagram of an electronic device according to some embodiments.

[0164] FIG. 28A to FIG. 28B is a flowchart illustrating a method for providing and presenting user-specific handwriting input in an instant messaging application according to some embodiments.

[0165] FIG. 28C to FIG. 28H A table is shown including an example of a rendering pipeline according to some embodiments.

[0166] Fig.29 is a functional block diagram of an electronic device according to some embodiments.

[0167] FIG. 30A to FIG. 30G An exemplary user interface for quickly locating different types of content in an instant messaging application is shown according to some embodiments.

[0168] FIG. 31A to FIG. 31B is a flowchart illustrating a method for quickly locating different types of content in an instant messaging application according to some embodiments.

[0169] Fig.32 is a functional block diagram of an electronic device according to some embodiments.

[0170] FIG. 33A to FIG. 33B is a flowchart illustrating a method for quickly locating different types of content in an instant messaging application according to some embodiments.

[0171] Fig.34 is a functional block diagram of an electronic device according to some embodiments.

[0172] Figures 35A to 35AP An exemplary user interface for integrating a digital camera into an instant messaging application is shown according to some embodiments.

[0173] FIG. 36A to FIG. 36AL An exemplary user interface for integrating search functionality and publishing rich content in an instant messaging application is shown according to some embodiments.

[0174] Figures 37A to 37DJ An exemplary user interface for integrating an interactive application within an instant messaging application is shown according to some embodiments.

[0175] Figures 38A to 38AZ An exemplary user interface for integrating an application within an instant messaging application is shown according to some embodiments.

[0176] FIG. 39A to FIG. 39AW An exemplary user interface for integrating electronic stickers in an instant messaging application according to some embodiments is shown.

[0177] FIG. 40A to FIG. 40W An exemplary user interface for interacting with other users of an instant message transcript via an avatar is shown according to some embodiments.

[0178] FIG. 41A to FIG. 41H An exemplary user interface for integrating a data detector into an instant messaging application is shown according to some embodiments.

[0179] FIG. 42A to FIG. 42D is a flow chart illustrating a method of capturing and posting a digital image in an instant messaging application according to some embodiments.

[0180] Fig.43 is a functional block diagram of an electronic device according to some embodiments.

[0181] FIG. 44A to FIG. 44D is a flow chart illustrating a method for searching and sharing multimedia content in an instant messaging application according to some embodiments.

[0182] Fig.45 is a functional block diagram of an electronic device according to some embodiments.

[0183] FIG. 46A to FIG. 46C is a flowchart illustrating method 4600 of adding an interactive application to an instant messaging application according to some embodiments.

[0184] Fig.47is a functional block diagram of an electronic device according to some embodiments.

[0185] FIG. 48A to FIG. 48D is a flowchart illustrating a method for posting a message to an instant messaging conversation from a user interface other than the user interface of an instant messaging application according to some embodiments.

[0186] Fig.49 is a functional block diagram of an electronic device according to some embodiments.

[0187] FIG. 50A to FIG. 50C is a flowchart illustrating a method of using an interactive application in an instant messaging application according to some embodiments.

[0188] Fig.51 is a functional block diagram of an electronic device according to some embodiments.

[0189] FIG. 52A to FIG. 52C is a flowchart illustrating a method of using an interactive application in an instant messaging application according to some embodiments.

[0190] Fig.53 is a functional block diagram of an electronic device according to some embodiments.

[0191] FIG. 54A to FIG. 54C is a flowchart illustrating a method of using an interactive application in an instant messaging application according to some embodiments.

[0192] Fig.55 is a functional block diagram of an electronic device according to some embodiments.

[0193] FIG. 56A to FIG. 56B is a flowchart illustrating a method of using an interactive application in an instant messaging application according to some embodiments.

[0194] Fig.57 is a functional block diagram of an electronic device according to some embodiments.

[0195] Fig.58 is a flowchart illustrating a method for enabling the use of an interactive application in an instant messaging application according to some embodiments.

[0196] Fig.59 is a functional block diagram of an electronic device according to some embodiments.

[0197] FIG. 60A to FIG. 60D is a flowchart illustrating a method of navigating in an instant messaging application with related applications according to some embodiments.

[0198] Fig.61 is a functional block diagram of an electronic device according to some embodiments.

[0199] Figures 62A to 62C is a flow chart illustrating a method for adding stickers to an instant message transcript according to some embodiments.

[0200] Fig.63 is a functional block diagram of an electronic device according to some embodiments.

[0201] Figures 64A to 64C is a flowchart illustrating method 6400 for modifying the display of an electronic sticker in an instant messaging application according to some embodiments.

[0202] Fig.65 is a functional block diagram of an electronic device according to some embodiments.

[0203] Fig.66 is a flow chart illustrating a method of making payments from an instant messaging application according to some embodiments.

[0204] Fig.67 is a functional block diagram of an electronic device according to some embodiments.

[0205] FIG. 68A to FIG. 68B is a flowchart illustrating method 6800 of interacting with a single user included in a group instant messaging conversation according to some embodiments.

[0206] Fig.69 is a functional block diagram of an electronic device according to some embodiments.

[0207] FIG. 70A to FIG. 70B is a flowchart illustrating method 7000 of displaying additional information in an instant messaging conversation according to some embodiments.

[0208] Fig.71 is a functional block diagram of an electronic device according to some embodiments.

[0209] FIG. 72A to FIG. 72R An exemplary user interface is shown for navigating between applications using an application user interface displayed in an instant messaging user interface according to some embodiments.

[0210] Figure 72S to Figure 72AO An exemplary user interface for managing applications used in an instant messaging application is shown according to some embodiments.

[0211] Figure 72AP to Figure 72DI An exemplary user interface for translating message content in an instant messaging application according to some embodiments is shown.

[0212] Figure 72DJ to Figure 72EV An exemplary user interface for connecting message bubbles in an instant messaging application is shown according to some embodiments.

[0213] Figure 72EW to Figure 72FM An exemplary user interface for marking a message bubble is shown according to some embodiments.

[0214] FIG. 73A to FIG. 73D is a flowchart illustrating a method for navigating between applications using an application user interface displayed in an instant messaging user interface according to some embodiments.

[0215] FIG. 74A to FIG. 74D is a flowchart illustrating a method for managing applications used in an instant messaging application according to some embodiments.

[0216] FIG. 75A to FIG. 75D is a flowchart illustrating a method for translating message content in an instant messaging application according to some embodiments.

[0217] Figures 76A to 76C is a flowchart illustrating a method for translating message content in an instant messaging application according to some embodiments. DETAILED DESCRIPTION

[0218] The methods, devices, and GUIs described herein improve messaging in a variety of ways. For example, they make it easier to: confirm messages; edit previously sent messages; express what a user is trying to convey; display private messages; synchronize content between users; incorporate handwriting input; quickly locate content in a message transcript; integrate a camera; integrate search and share; integrate interactive applications; integrate stickers; make payments; interact with avatars; provide suggestions; navigate in interactive applications; manage interactive applications; translate foreign language text; merge messages into a group; and tag messages.

[0219] Exemplary Devices

[0220] Reference will now be made in detail to the embodiments, examples of which are illustrated in the accompanying drawings. In the detailed description that follows, many specific details are set forth in order to provide a full understanding of the various described embodiments. However, it will be apparent to one of ordinary skill in the art that the various described embodiments may be practiced without these specific details. In other cases, well-known methods, processes, components, circuits, and networks are not described in detail, thereby not unnecessarily obscuring various aspects of the embodiments.

[0221] It will also be understood that, although in some cases, the terms "first", "second", etc. are used to describe various elements in this article, these elements should not be limited by these terms. These terms are only used to distinguish one element from another element. For example, the first contact can be named as the second contact, and similarly, the second contact can be named as the first contact, without departing from the scope of the various described embodiments. The first contact and the second contact are both contacts, but they are not the same contact unless the context clearly indicates otherwise.

[0222] The terms used in the description of the various embodiments described herein are only for the purpose of describing specific embodiments, and are not intended to be limiting. As used in the description of the various embodiments described and in the appended claims, the singular forms "a", "an" and "the" are intended to also include plural forms, unless the context clearly indicates otherwise. It will also be understood that the term "and / or" used herein refers to and encompasses any and all possible combinations of one or more items in the items listed in association. It will also be understood that the term "includes", "including", "comprises" and / or "comprising" when used in this specification specifies the presence of stated features, integers, steps, operations, elements and / or parts, but does not exclude the presence or addition of one or more other features, integers, steps, operations, elements, parts and / or their groupings.

[0223] As used herein, the term "if" is optionally interpreted to mean "when" or "upon" or "in response to determining" or "in response to detecting," depending on the context. Similarly, the phrases "if it is determined that" or "if [a stated condition or event] is detected" are optionally interpreted to mean "upon determining that" or "in response to determining that" or "upon detecting [a stated condition or event]" or "in response to detecting [a stated condition or event]," depending on the context.

[0224] Embodiments of electronic devices, user interfaces for such devices, and associated processes for using such devices are described herein. In some embodiments, the device is a portable communication device, such as a mobile phone, that also includes other functions, such as a PDA and / or a music player function. Exemplary embodiments of portable multifunction devices include, but are not limited to, the Apple iPod from Apple Inc. (Cupertino, California). iPod Know Device. Other portable electronic devices, such as laptops or tablet computers with touch-sensitive surfaces (e.g., touch screen displays and / or touch pads) are optionally used. It should also be understood that in some embodiments, the device is not a portable communication device, but a desktop computer with a touch-sensitive surface (e.g., touch screen displays and / or touch pads).

[0225] In the following discussion, an electronic device including a display and a touch-sensitive surface is described. However, it should be understood that the electronic device optionally includes one or more other physical user interface devices, such as a physical keyboard, mouse and / or joystick.

[0226] In addition to the instant messaging application, the device typically supports a variety of other applications, such as one or more of the following applications: a note-making application, a drawing application, a presentation application, a word processing application, a website creation application, a disk editing application, a spreadsheet application, a game application, a phone application, a video conferencing application, an email application, a fitness support application, a photo management application, a digital camera application, a digital camcorder application, a web browsing application, a digital music player application, and / or a digital video player application.

[0227] Various applications executed on the device optionally use at least one common physical user interface device, such as a touch-sensitive surface. One or more functions of the touch-sensitive surface and corresponding information displayed on the device are optionally adjusted and / or varied for different applications, and / or adjusted and / or varied within the respective applications. In this way, the common physical architecture of the device (e.g., touch-sensitive surface) optionally supports a variety of applications with a user interface that is intuitive and clear to the user.

[0228] Attention is now turned to embodiments of portable devices having touch-sensitive displays. Figure 1A1 is a block diagram illustrating a portable multifunction device 100 with a touch-sensitive display system 112 according to some embodiments. The touch-sensitive display system 112 is sometimes referred to as a "touch screen" for convenience, and is sometimes simply referred to as a touch-sensitive display. The device 100 includes a memory 102 (which optionally includes one or more computer-readable storage media), a memory controller 122, one or more processing units (CPUs) 120, a peripheral device interface 118, an RF circuit 108, an audio circuit 110, a speaker 111, a microphone 113, an input / output (I / O) subsystem 106, other input or control devices 116, and an external port 124. The device 100 optionally includes one or more optical sensors 164. The device 100 optionally includes one or more intensity sensors 165 for detecting the intensity of contact on the device 100 (e.g., a touch-sensitive surface, such as the touch-sensitive display system 112 of the device 100). Device 100 optionally includes one or more tactile output generators 167 for generating tactile output on device 100 (e.g., generating tactile output on a touch-sensitive surface such as touch-sensitive display system 112 of device 100 or trackpad 355 of device 300). These components optionally communicate via one or more communication buses or signal lines 103.

[0229] As used in this specification and claims, the term "tactile output" refers to a physical displacement of a device relative to a previous position of the device, a physical displacement of a component of the device (e.g., a touch-sensitive surface) relative to another component of the device (e.g., a housing), or a displacement of a component relative to the center of mass of the device, which will be detected by a user using the user's sense of touch. For example, in the case where a device or a component of the device is in contact with a user's touch-sensitive surface (e.g., a finger, palm, or other part of the user's hand), the tactile output generated by the physical displacement will be interpreted by the user as a tactile sensation corresponding to a perceived change in a physical characteristic of the device or component of the device. For example, movement of a touch-sensitive surface (e.g., a touch-sensitive display or trackpad) is optionally interpreted by the user as a "press click" or "release click" to a physical actuation button. In some cases, the user will feel a tactile sensation, such as a "press click" or "release click", even when the physical actuation button associated with the touch-sensitive surface that is physically pressed (e.g., displaced) by the user's movement does not move. As another example, even when the smoothness of the touch-sensitive surface does not change, the movement of the touch-sensitive surface may be optionally interpreted or sensed by the user as the "roughness" of the touch-sensitive surface. Although such interpretation of touch by the user will be limited by the user's individualized sensory perception, there are many sensory perceptions of touch that are common to most users. Therefore, when a tactile output is described as corresponding to a specific sensory perception of a user (e.g., "release click", "press click", "roughness"), unless otherwise stated, the tactile output generated corresponds to a physical displacement of the device or its components that will generate the described sensory perception of a typical (or ordinary) user. Providing tactile feedback to the user using tactile output enhances the operability of the device and makes the user-device interface more efficient (e.g., by helping the user provide appropriate input and reducing user errors when operating / interacting with the device), thereby further reducing power usage and extending the battery life of the device by enabling the user to use the device more quickly and efficiently.

[0230] It should be understood that device 100 is only one example of a portable multifunction device, and that device 100 optionally has more or fewer components than shown, optionally combines two or more components, or optionally has a different configuration or arrangement of the components. Figure 1A The various components shown are implemented in hardware, software, firmware, or any combination thereof, including one or more signal processing circuits and / or application specific integrated circuits.

[0231] The memory 102 optionally includes a high-speed random access memory, and optionally also includes a non-volatile memory, such as one or more disk storage devices, flash memory devices, or other non-volatile solid-state memory devices. The access of other components of the device 100 (e.g., one or more CPUs 120 and peripheral device interface 118) to the memory 102 is optionally controlled by a memory controller 122.

[0232] The peripheral device interface 118 can be used to couple the input peripheral devices and output peripheral devices of the device to one or more CPUs 120 and memory 102. The one or more processors 120 run or execute various software programs and / or instruction sets stored in the memory 102 to perform various functions of the device 100 and process data.

[0233] In some embodiments, peripherals interface 118, one or more CPUs 120, and memory controller 122 are optionally implemented on a single chip, such as chip 104. In some other embodiments, they are optionally implemented on separate chips.

[0234] RF (radio frequency) circuit 108 receives and transmits RF signals, also called electromagnetic signals. RF circuit 108 converts electrical signals into / from electromagnetic signals and communicates with communication networks and other communication devices via electromagnetic signals. RF circuit 108 optionally includes well-known circuits for performing these functions, including but not limited to antenna systems, RF transceivers, one or more amplifiers, tuners, one or more oscillators, digital signal processors, codec chipsets, subscriber identity modules (SIM) cards, memory, and the like. RF circuit 108 optionally communicates with networks and other devices via wireless communications, such as the Internet (also known as the World Wide Web (WWW)), intranets, and / or wireless networks (e.g., cellular telephone networks, wireless local area networks (LANs), and / or metropolitan area networks (MANs)). The wireless communication optionally uses any of a variety of communication standards, protocols, and technologies, including, but not limited to, Global System for Mobile Communications (GSM), Enhanced Data GSM Environment (EDGE), High Speed ​​Downlink Packet Access (HSDPA), High Speed ​​Uplink Packet Access (HSUPA), Evolution-Data Only (EV-DO), HSPA, HSPA+, Dual Cell HSPA (DC-HSPDA), Long Term Evolution (LTE), Near Field Communication (NFC), Wideband Code Division Multiple Access (W-CDMA), Code Division Multiple Access (CDMA), Time Division Multiple Access (TDMA), Bluetooth, Wireless Fidelity (Wi-Fi) (e.g., IEEE 802.11a, IEEE 802.11ac, IEEE 802.11ax, IEEE 802.11b, IEEE 802.11g and / or IEEE 802.11n), Voice over Internet Protocol (VoIP), Wi-MAX, email protocols (e.g., Internet Message Access Protocol (IMAP) and / or Post Office Protocol (POP)), instant messaging (e.g., Extensible Messaging and Presence Protocol (XMPP), Session Initiation Protocol for Instant Messaging and Presence using Extensions (SIMPLE), Instant Messaging and Presence Service (IMPS), and / or Short Message Service (SMS)), or any other suitable communication protocol including communication protocols that have not been developed on the date of filing of this document.

[0235] The audio circuit 110, speaker 111, and microphone 113 provide an audio interface between a user and the device 100. The audio circuit 110 receives audio data from the peripheral device interface 118, converts the audio data into electrical signals, and transmits the electrical signals to the speaker 111. The speaker 111 converts the electrical signals into sound waves audible to humans. The audio circuit 110 also receives electrical signals converted from sound waves by the microphone 113. The audio circuit 110 converts the electrical signals into audio data and transmits the audio data to the peripheral device interface 118 for processing. The audio data is optionally retrieved from and / or transmitted to the memory 102 and / or the RF circuit 108 by the peripheral device interface 118. In some embodiments, the audio circuit 110 also includes a headphone jack (e.g., Figure 2 The headset jack provides an interface between the audio circuit 110 and a removable audio input / output peripheral device, such as an output-only headset or a headset with both output (e.g., a single-ear headset or a dual-ear headset) and input (e.g., a microphone).

[0236] The I / O subsystem 106 couples input / output peripherals on the device 100 (e.g., touch-sensitive display system 112 and other input or control devices 116) to a peripheral device interface 118. The I / O subsystem 106 optionally includes a display controller 156, an optical sensor controller 158, an intensity sensor controller 159, a tactile feedback controller 161, and one or more input controllers 160 for other input or control devices. The one or more input controllers 160 receive / send electrical signals from / to other input or control devices 116. Other input or control devices 116 optionally include physical buttons (e.g., push buttons, rocker buttons, etc.), dials, slide switches, joysticks, click wheels, and the like. In some alternative embodiments, one or more input controllers 160 are optionally coupled to any (or none) of the following: a keyboard, an infrared port, a USB port, a stylus, and / or a pointer device (e.g., a mouse). One or more buttons (e.g., Figure 2 208) optionally includes an up / down button for volume control of the speaker 111 and / or the microphone 113. The one or more buttons optionally include a push button (e.g., Figure 2 206).

[0237] The touch-sensitive display system 112 provides an input interface and an output interface between the device and the user. The display controller 156 receives electrical signals from the touch-sensitive display system 112 and / or sends electrical signals to the touch-sensitive display system 112. The touch-sensitive display system 112 displays visual output to the user. The visual output optionally includes graphics, text, icons, videos, and any combination thereof (collectively referred to as "graphics"). In some embodiments, some visual outputs or all of the visual outputs correspond to user interface objects. As used herein, the term "indicator" refers to a user-interactive graphical user interface object (e.g., a graphical user interface object configured to respond to input directed to a graphical user interface object). Examples of user-interactive graphical user interface objects include, but are not limited to, buttons, sliders, icons, selectable menu items, switches, hyperlinks, or other user interface controls.

[0238] The touch-sensitive display system 112 has a touch-sensitive surface, sensor, or sensor group that accepts input from a user based on tactile and / or haptic contact. The touch-sensitive display system 112 and display controller 156 (together with any associated modules and / or instruction sets in memory 102) detect contact (and any movement or interruption of that contact) on the touch-sensitive display system 112 and convert the detected contact into interaction with a user interface object (e.g., one or more soft keys, icons, web pages, or images) displayed on the touch-sensitive display system 112. In an exemplary embodiment, the point of contact between the touch-sensitive display system 112 and the user corresponds to the user's finger or stylus.

[0239] The touch-sensitive display system 112 optionally uses LCD (liquid crystal display) technology, LPD (light emitting polymer display) technology, or LED (light emitting diode) technology, although other display technologies are used in other embodiments. The touch-sensitive display system 112 and display controller 156 optionally use any of a variety of touch sensing technologies now known or later developed, as well as other proximity sensor arrays or other elements for determining one or more points of contact with the touch-sensitive display system 112 to detect contact and any movement or interruption thereof, including but not limited to capacitive, resistive, infrared, and surface acoustic wave technologies. In an exemplary embodiment, projected mutual capacitance sensing technology is used, such as the . iPod Know Technology found in.

[0240] The touch-sensitive display system 112 optionally has a video resolution of more than 100 dpi. In some embodiments, the touch screen video resolution exceeds 400 dpi (e.g., 500 dpi, 800 dpi, or greater). The user optionally uses any suitable object or appendage (e.g., a stylus, a finger, etc.) to contact the touch-sensitive display system 112. In some embodiments, the user interface is designed to work with finger-based contacts and gestures, which may not be as precise as stylus-based input due to the larger contact area of ​​a finger on the touch screen. In some embodiments, the device translates rough finger-based input into precise pointer / cursor positions or commands for performing the actions desired by the user.

[0241] In some embodiments, in addition to the touch screen, the device 100 optionally includes a touchpad (not shown) for activating or deactivating specific functions. In some embodiments, the touchpad is a touch-sensitive area of ​​the device that, unlike the touch screen, does not display visual output. The touchpad is optionally a touch-sensitive surface separate from the touch-sensitive display system 112, or an extension of the touch-sensitive surface formed by the touch screen.

[0242] The device 100 also includes a power system 162 for powering the various components. The power system 162 optionally includes a power management system, one or more power sources (e.g., batteries, alternating current (AC)), a recharging system, a power fault detection circuit, a power converter or inverter, a power status indicator (e.g., a light emitting diode (LED)), and any other components associated with the generation, management, and distribution of power in a portable device.

[0243] Device 100 optionally also includes one or more optical sensors 164 . Figure 1A An optical sensor coupled to an optical sensor controller 158 in the I / O subsystem 106 is shown. One or more optical sensors 164 optionally include a charge coupled device (CCD) or a complementary metal oxide semiconductor (CMOS) phototransistor. One or more optical sensors 164 receive light projected through one or more lenses from the environment and convert the light into data representing an image. In conjunction with an imaging module 143 (also referred to as a camera module), one or more optical sensors 164 optionally capture a still image or video. In some embodiments, the optical sensor is located on the rear of the device 100, opposite to the touch-sensitive display system 112 on the front of the device, so that the touch screen can be used as a viewfinder for still image and / or video image acquisition. In some embodiments, another optical sensor is located on the front of the device to obtain an image of the user (e.g., for self-portraits, for video conferencing while the user is watching other video conference participants on the touch screen, etc.).

[0244] Device 100 optionally also includes one or more contact intensity sensors 165 . Figure 1A A contact force sensor coupled to a force sensor controller 159 in the I / O subsystem 106 is shown. One or more contact force sensors 165 optionally include one or more piezoresistive strain gauges, capacitive force sensors, electrical force sensors, piezoelectric force sensors, optical force sensors, capacitive touch-sensitive surfaces, or other force sensors (e.g., sensors for measuring the force (or pressure) of contact on a touch-sensitive surface). One or more contact force sensors 165 receive contact force information (e.g., pressure information or a surrogate for pressure information) from the environment. In some embodiments, at least one contact force sensor is juxtaposed or adjacent to a touch-sensitive surface (e.g., touch-sensitive display system 112). In some embodiments, at least one contact force sensor is located on the rear of the device 100, opposite to the touch-sensitive display system 112 located on the front of the device 100.

[0245] Device 100 optionally also includes one or more proximity sensors 166 . Figure 1A A proximity sensor 166 is shown coupled to the peripherals interface 118. Alternatively, the proximity sensor 166 is coupled to the input controller 160 in the I / O subsystem 106. In some embodiments, when the multifunction device is placed near the user's ear (e.g., when the user is making a phone call), the proximity sensor turns off and disables the touch-sensitive display system 112.

[0246] Device 100 optionally also includes one or more tactile output generators 167 . Figure 1A A tactile output generator coupled to a tactile feedback controller 161 in the I / O subsystem 106 is shown. One or more tactile output generators 167 optionally include one or more electroacoustic devices such as speakers or other audio components, and / or electromechanical devices for converting energy into linear motion such as motors, solenoids, electroactive polymers, piezoelectric actuators, electrostatic actuators, or other tactile output generating components (e.g., components for converting electrical signals into tactile outputs on the device). One or more tactile output generators 167 receive tactile feedback generation instructions from the tactile feedback module 133 and generate tactile outputs on the device 100 that can be felt by a user of the device 100. In some embodiments, at least one tactile output generator is arranged in juxtaposition or proximity to a touch-sensitive surface (e.g., a touch-sensitive display system 112), and optionally generates tactile outputs by moving the touch-sensitive surface vertically (e.g., inward / outward of the surface of the device 100) or laterally (e.g., backward and forward in the same plane as the surface of the device 100). In some embodiments, at least one tactile output generator sensor is located on the back of the device 100, opposite the touch-sensitive display system 112 located on the front of the device 100.

[0247] Device 100 optionally also includes one or more accelerometers 168 . Figure 1A An accelerometer 168 is shown coupled to the peripheral device interface 118. Alternatively, the accelerometer 168 is optionally coupled to the input controller 160 in the I / O subsystem 106. In some embodiments, information is displayed in a portrait view or a landscape view on the touch screen display based on an analysis of data received from one or more accelerometers. In addition to the accelerometer 168, the device 100 optionally also includes a magnetometer (not shown) and a GPS (or GLONASS or other global navigation system) receiver (not shown) for obtaining information about the position and orientation (e.g., portrait or landscape) of the device 100.

[0248] In some embodiments, the software components stored in memory 102 include an operating system 126, a communication module (or instruction set) 128, a contact / motion module (or instruction set) 130, a graphics module (or instruction set) 132, a tactile feedback module (or instruction set) 133, a text input module (or instruction set) 134, a global positioning system (GPS) module (or instruction set) 135, and an application (or instruction set) 136. In addition, in some embodiments, memory 102 stores device / global internal state 157, such as Figure 1A and Figure 3 The device / global internal state 157 includes one or more of the following: an active application state indicating which applications, if any, are currently active; a display state indicating what applications, views, or other information occupy various areas of the touch-sensitive display system 112; a sensor state including information obtained from various sensors and other input or control devices 116 of the device; and position and / or location information regarding the device's position and / or posture.

[0249] The operating system 126 (e.g., iOS, Darwin, RTXC, LINUX, UNIX, OSX, WINDOWS, or an embedded operating system such as VxWorks) includes various software components and / or drivers for controlling and managing general system tasks (e.g., memory management, storage device control, power management, etc.), and facilitates communication between various hardware and software components.

[0250] The communication module 128 facilitates communication with other devices through one or more external ports 124, and also includes various software components for processing data received by the RF circuit 108 and / or the external port 124. The external port 124 (e.g., Universal Serial Bus (USB), FireWire, etc.) is suitable for coupling directly to other devices, or indirectly through a network (e.g., the Internet, wireless LAN, etc.). In some embodiments, the external port is a device that is compatible with some of Apple Inc. (Cupertino, California). iPod A multi-pin (e.g., 30-pin) connector that is the same as or similar to and / or compatible with the 30-pin connector used in iPod devices. In some embodiments, the external port is compatible with some of Apple Inc. (Cupertino, California) iPod A Lightning connector that is the same as, similar to, and / or compatible with the Lightning connector used in iPod devices.

[0251] The contact / motion module 130 optionally detects contact with the touch-sensitive display system 112 (in conjunction with the display controller 156) and other touch-sensitive devices (e.g., a touchpad or physical click wheel). The contact / motion module 130 includes various software components for performing various operations related to contact detection (e.g., by a finger or stylus), such as determining whether contact has occurred (e.g., detecting a finger press event), determining the strength of the contact (e.g., the force or pressure of the contact, or a surrogate for the force or pressure of the contact), determining whether there is movement of the contact and tracking movement across the touch-sensitive surface (e.g., detecting one or more finger drag events), and determining whether the contact has stopped (e.g., detecting a finger lift event or contact disconnection). The contact / motion module 130 receives contact data from the touch-sensitive surface. Determining the movement of a contact point optionally includes determining a rate (magnitude), velocity (magnitude and direction), and / or acceleration (change in magnitude and / or direction) of the contact point, the movement of the contact point being represented by a series of contact data. These operations are optionally applied to a single point of contact (e.g., a single finger contact or stylus contact) or multiple points of simultaneous contact (e.g., "multi-touch" / multi-finger contact). In some embodiments, contact / motion module 130 and display controller 156 detect contact on a touch pad.

[0252] The contact / motion module 130 optionally detects gesture input from a user. Different gestures on the touch-sensitive surface have different contact patterns (e.g., different motions, timings, and / or intensities of the detected contacts). Therefore, gestures are optionally detected by detecting specific contact patterns. For example, detecting a single-finger tap gesture includes detecting a finger press event, and then detecting a finger lift (lift-off) event at the same location (or substantially the same location) as the finger press event (e.g., at an icon location). As another example, detecting a finger swipe gesture on the touch-sensitive surface includes detecting a finger press event, then detecting one or more finger drag events, and then detecting a finger lift (lift-off) event. Similarly, taps, swipes, drags, and other gestures of the stylus are optionally detected by detecting specific contact patterns of the stylus.

[0253] In some embodiments, detecting a finger tap gesture depends on detecting the length of time between a finger press event and a finger lift event, but is independent of the strength of the finger contact between the finger press event and the finger lift event. In some embodiments, a tap gesture is detected based on determining that the length of time between a finger press event and a finger lift event is less than a predetermined value (e.g., less than 0.1, 0.2, 0.3, 0.4, or 0.5 seconds), regardless of whether the strength of the finger contact during the tap reaches a given strength threshold (greater than a nominal contact detection strength threshold), such as a light press or deep press strength threshold. Therefore, a finger tap gesture can meet a specific input criterion that does not require the characteristic strength of the contact to meet a given strength threshold to meet the specific input criterion. For clarity, the finger contact in a tap gesture is generally required to meet a nominal contact detection strength threshold to detect a finger press event, below which the contact is not detected. A similar analysis applies to detecting a tap gesture by a stylus or other contact. In the case where the device is capable of detecting contact with a finger or stylus hovering over the touch-sensitive surface, the nominal contact detection intensity threshold optionally does not correspond to physical contact between the finger or stylus and the touch-sensitive surface.

[0254] The same concepts apply in a similar manner to other types of gestures. For example, a swipe gesture, a pinch gesture, an expand gesture, and / or a long press gesture may be optionally detected based on the satisfaction of criteria that are independent of the strength of the contacts included in the gesture or that do not require the contacts performing the gesture to reach a strength threshold in order to be recognized. For example, a swipe gesture is detected based on the amount of movement of one or more contacts; a pinch gesture is detected based on the movement of two or more contacts toward each other; an expand gesture is detected based on the movement of two or more contacts away from each other; and a long press gesture is detected based on the duration of contacts on the touch-sensitive surface having an amount of movement less than a threshold. Thus, the statement that a particular gesture recognition criterion does not require the strength of the contacts to meet a corresponding strength threshold in order to meet the particular gesture recognition criterion means that the particular gesture recognition criterion can be satisfied when the contacts in the gesture do not meet the corresponding strength threshold, and can also be satisfied when one or more contacts in the gesture meet or exceed the corresponding strength threshold. In some embodiments, a tap gesture is detected based on determining that a finger down event and a finger up event are detected within a predefined time period, regardless of whether the contact is above or below a corresponding strength threshold during the predefined time period, and a swipe gesture is detected based on determining that the contact moves greater than a predefined amount, even if the contact is above the corresponding strength threshold at the end of the contact movement. Even in specific implementations where detection of gestures is affected by the strength of the contact performing the gesture (e.g., the device detects a long press more quickly when the strength of the contact is above the strength threshold, or the device delays detection of a tap input when the strength of the contact is higher), detection of these gestures does not require the contact to reach a particular strength threshold (e.g., even if the amount of time required to recognize the gesture varies), as long as the criteria for recognizing the gesture can be met without the contact reaching the particular strength threshold.

[0255] In some cases, the contact intensity threshold, duration threshold, and movement threshold are combined in various combinations to create a heuristic algorithm to distinguish between two or more different gestures for the same input element or area, so that multiple different interactions with the same input element can provide a richer set of user interactions and responses. The statement that a particular set of gesture recognition criteria does not require the intensity of the contact to meet the corresponding intensity threshold to meet the particular gesture recognition criteria does not exclude the simultaneous evaluation of other intensity-related gesture recognition criteria to identify other gestures with criteria that are met when the gesture includes a contact with an intensity above the corresponding intensity threshold. For example, in some cases, a first gesture recognition criterion for a first gesture (which does not require the intensity of the contact to meet the corresponding intensity threshold to meet the first gesture recognition criterion) competes with a second gesture recognition criterion for a second gesture (which depends on the contact reaching the corresponding intensity threshold). In such a competition, if the second gesture recognition criterion for the second gesture is met first, the gesture is optionally not recognized as meeting the first gesture recognition criterion for the first gesture. For example, if the contact reaches the corresponding intensity threshold before the contact moves a predefined amount of movement, a deep press gesture is detected instead of a swipe gesture. Conversely, if the contact moves a predefined amount of movement before the contact reaches the corresponding intensity threshold, a swipe gesture is detected instead of a deep press gesture. Even in this case, the first gesture recognition criterion for the first gesture still does not require the intensity of the contact to meet the corresponding intensity threshold to satisfy the first gesture recognition criterion because if the contact remains below the corresponding intensity threshold until the gesture ends (e.g., a swipe gesture with an intensity of the contact that does not increase to above the corresponding intensity threshold), the gesture will be recognized as a swipe gesture by the first gesture recognition criterion. Therefore, a particular gesture recognition criterion that does not require the intensity of the contact to meet the corresponding intensity threshold to satisfy the particular gesture recognition criterion will (A) in some cases ignore the intensity of the contact relative to the intensity threshold (e.g., for a tap gesture) and / or (B) in some cases fail to satisfy the particular gesture recognition criterion (e.g., for a long press gesture) if a set of competing intensity-related gesture recognition criteria (e.g., for a deep press gesture) recognizes the input as corresponding to an intensity-related gesture before the particular gesture recognition criterion recognizes the gesture corresponding to the input, and in this sense still depends on the intensity of the contact relative to the intensity threshold (e.g., for a long press gesture that competes with the deep press gesture for recognition).

[0256] Graphics module 132 includes various known software components for rendering and displaying graphics on touch-sensitive display system 112 or other displays, including components for changing the visual impact (e.g., brightness, transparency, saturation, contrast, or other visual attributes) of displayed graphics. As used herein, the term "graphics" includes any object that can be displayed to a user, including but not limited to text, web pages, icons (such as user interface objects including soft keys), digital images, videos, animations, etc.

[0257] In some embodiments, the graphics module 132 stores data to be used to represent graphics. Each graphic is optionally assigned a corresponding code. The graphics module 132 receives one or more codes for specifying the graphics to be displayed from an application program, etc., and also receives coordinate data and other graphic attribute data together if necessary, and then generates screen image data to be output to the display controller 156.

[0258] Haptic feedback module 133 includes various software components for generating instructions used by tactile output generator 167 to produce tactile output at one or more locations on device 100 in response to user interaction with device 100 .

[0259] Text input module 134, which is optionally a component of graphics module 132, provides a soft keyboard for entering text in various applications (e.g., contacts 137, email 140, IM 141, browser 147, and any other application requiring text input).

[0260] The GPS module 135 determines the location of the device and provides such information for use in various applications (e.g., to the phone 138 for location-based dialing; to the camera 143 as picture / video metadata; and to applications that provide location-based services such as weather widgets, local yellow pages widgets, and maps / navigation widgets).

[0261] The application 136 optionally includes the following modules (or instruction sets) or a subset or superset thereof:

[0262] Contacts module 137 (sometimes called address book or contact list);

[0263] Telephone module 138;

[0264] Video conferencing module 139;

[0265] Email client module 140;

[0266] Instant messaging (IM) module 141;

[0267] Fitness support module 142;

[0268] A camera module 143 for still images and / or video images;

[0269] Image management module 144;

[0270] Browser module 147;

[0271] Calendar module 148;

[0272] A widget module 149, which optionally includes one or more of the following: a weather widget 149-1, a stock widget 149-2, a calculator widget 149-3, an alarm widget 149-4, a dictionary widget 149-5, and other widgets obtained by the user, and a user-created widget 149-6;

[0273] A widget creator module 150 for forming a user-created widget 149-6;

[0274] Search module 151;

[0275] Video and music player module 152, which optionally consists of a video player module and a music player module;

[0276] Notepad module 153;

[0277] Map module 154; and / or

[0278] Online video module 155.

[0279] Examples of other applications 136 optionally stored in memory 102 include other word processing applications, other image editing applications, drawing applications, rendering applications, JAVA-enabled applications, encryption, digital rights management, voice recognition, and voice replication.

[0280] In combination with the touch-sensitive display system 112, the display controller 156, the contact module 130, the graphics module 132, and the text input module 134, the contact module 137 includes executable instructions for managing an address book or contact list (e.g., stored in the application internal state 192 of the contact module 137 in the memory 102 or the memory 370), including: adding a name to the address book; deleting a name from the address book; associating a phone number, email address, physical address, or other information with a name; associating an image with a name; categorizing and sorting names; providing a phone number and / or email address to initiate and / or facilitate communications via telephone 138, video conferencing 139, email 140, or IM 141, and the like.

[0281] In conjunction with RF circuitry 108, audio circuitry 110, speaker 111, microphone 113, touch-sensitive display system 112, display controller 156, contact module 130, graphics module 132, and text input module 134, phone module 138 includes executable instructions for entering a sequence of characters corresponding to a phone number, accessing one or more phone numbers in address book 137, modifying an entered phone number, dialing a corresponding phone number, conducting a conversation, and disconnecting or hanging up when the conversation is complete. As described above, wireless communications optionally use any of a variety of communication standards, protocols, and technologies.

[0282] In combination with RF circuitry 108, audio circuitry 110, speaker 111, microphone 113, touch-sensitive display system 112, display controller 156, one or more optical sensors 164, optical sensor controller 158, contact module 130, graphics module 132, text input module 134, contact list 137, and telephone module 138, video conferencing module 139 includes executable instructions for initiating, conducting, and terminating a video conference between a user and one or more other participants in accordance with user instructions.

[0283] In conjunction with RF circuit 108, touch-sensitive display system 112, display controller 156, contact module 130, graphics module 132, and text input module 134, email client module 140 includes executable instructions for creating, sending, receiving, and managing emails in response to user instructions. In conjunction with image management module 144, email client module 140 makes it very easy to create and send emails with still images or video images captured by camera module 143.

[0284] In conjunction with the RF circuit 108, the touch-sensitive display system 112, the display controller 156, the contact module 130, the graphics module 132, and the text input module 134, the instant messaging module 141 includes executable instructions for performing the following operations: entering a character sequence corresponding to an instant message, modifying previously entered characters, transmitting the corresponding instant message (e.g., using the Short Message Service (SMS) or Multimedia Message Service (MMS) protocol for phone-based instant messaging or using XMPP, SIMPLE, Apple Push Notification Service (APN) or IMPS for Internet-based instant messaging), receiving instant messages, viewing received instant messages, and performing the functions of the instant messaging application described in more detail below. In some embodiments, the transmitted and / or received instant messages optionally include graphics, photos, audio files, video files, and / or other attachments supported in MMS and / or Enhanced Messaging Service (EMS). As used herein, "instant messaging" refers to both telephony-based messaging (eg, messages sent using SMS or MMS) and Internet-based messaging (eg, messages sent using XMPP, SIMPLE, APNs, or IMPS).

[0285] In combination with RF circuitry 108, touch-sensitive display system 112, display controller 156, contact module 130, graphics module 132, text input module 134, GPS module 135, map module 154, and music player module 146, fitness support module 142 includes executable instructions for: creating a workout (e.g., with time, distance, and / or calorie burn goals); communicating with fitness sensors (in sports equipment and smart watches); receiving fitness sensor data; calibrating sensors for monitoring fitness; selecting fitness music and playing it; and displaying, storing, and transmitting fitness data.

[0286] In conjunction with touch-sensitive display system 112, display controller 156, one or more optical sensors 164, optical sensor controller 158, contact module 130, graphics module 132, and image management module 144, camera module 143 includes executable instructions for capturing still images or videos (including video streams) and storing them in memory 102, modifying characteristics of still images or videos, and / or deleting still images or videos from memory 102.

[0287] In conjunction with touch-sensitive display system 112, display controller 156, contact module 130, graphics module 132, text input module 134, and camera module 143, image management module 144 includes executable instructions for arranging, modifying (e.g., editing) or otherwise manipulating, labeling, deleting, presenting (e.g., in a digital slide show or album), and storing still images and / or video images.

[0288] In combination with the RF circuit 108, the touch-sensitive display system 112, the display system controller 156, the contact module 130, the graphics module 132 and the text input module 134, the browser module 147 includes executable instructions for browsing the Internet in accordance with user instructions (including searching, linking to, receiving and displaying web pages or portions thereof and attachments and other files linked to web pages).

[0289] In combination with the RF circuit 108, the touch-sensitive display system 112, the display system controller 156, the contact module 130, the graphics module 132, the text input module 134, the email client module 140 and the browser module 147, the calendar module 148 includes executable instructions for creating, displaying, modifying and storing calendars and data associated with the calendar (e.g., calendar entries, to-do items, etc.) in accordance with user instructions.

[0290] In conjunction with the RF circuit 108, the touch-sensitive display system 112, the display system controller 156, the contact module 130, the graphics module 132, the text input module 134, and the browser module 147, the desktop widget module 149 is a mini-application that is optionally downloaded and used by the user (e.g., the weather desktop widget 149-1, the stock desktop widget 149-2, the calculator desktop widget 149-3, the alarm desktop widget 149-4, and the dictionary desktop widget 149-5) or a mini-application created by the user (e.g., the user-created desktop widget 149-6). In some embodiments, the desktop widget includes an HTML (Hypertext Markup Language) file, a CSS (Cascading Style Sheets) file, and a JavaScript file. In some embodiments, the desktop widget includes an XML (Extensible Markup Language) file and a JavaScript file (e.g., the Yahoo! desktop widget).

[0291] In combination with the RF circuit 108, the touch-sensitive display system 112, the display system controller 156, the contact module 130, the graphics module 132, the text input module 134 and the browser module 147, the desktop widget creator module 150 includes executable instructions for creating a desktop widget (e.g., transferring a user-specified portion of a web page to a desktop widget).

[0292] In conjunction with the touch-sensitive display system 112, the display system controller 156, the contact module 130, the graphics module 132, and the text input module 134, the search module 151 includes executable instructions for searching the memory 102 for text, music, sound, images, videos, and / or other files that match one or more search criteria (e.g., one or more user-specified search terms) in accordance with user instructions.

[0293] In conjunction with touch-sensitive display system 112, display system controller 156, contact module 130, graphics module 132, audio circuitry 110, speaker 111, RF circuitry 108, and browser module 147, video and music player module 152 includes executable instructions that allow a user to download and play back recorded music and other sound files stored in one or more file formats (e.g., MP3 or AAC files), as well as executable instructions for displaying, presenting, or otherwise playing back video (e.g., on touch-sensitive display system 112 or on an external display connected wirelessly or via external port 124). In some embodiments, device 100 optionally includes the functionality of an MP3 player, such as an iPod (trademark of Apple Inc.).

[0294] In conjunction with the touch-sensitive display system 112, display controller 156, contact module 130, graphics module 132, and text input module 134, the notepad module 153 includes executable instructions for creating and managing notes, to-do lists, etc. according to user instructions.

[0295] In combination with RF circuitry 108, touch-sensitive display system 112, display system controller 156, contact module 130, graphics module 132, text input module 134, GPS module 135, and browser module 147, map module 154 includes executable instructions for receiving, displaying, modifying, and storing maps and data associated with maps (e.g., driving routes; data relating to stores and other points of interest at or near a particular location; and other location-based data) in accordance with user instructions.

[0296] In conjunction with touch-sensitive display system 112, display system controller 156, contact module 130, graphics module 132, audio circuit 110, speaker 111, RF circuit 108, text input module 134, email client module 140, and browser module 147, online video module 155 includes executable instructions that allow a user to access, browse, receive (e.g., by streaming and / or downloading), play back (e.g., on touch screen 112, or on an external display connected wirelessly or via external port 124), send emails with links to specific online videos, and otherwise manage online videos in one or more file formats such as H.264. In some embodiments, instant messaging module 141 is used instead of email client module 140 to send a link to a specific online video.

[0297] Each module and application in the above-mentioned modules and applications corresponds to an executable instruction set for performing one or more functions and the methods described in this patent application (e.g., computer-implemented methods and other information processing methods described herein). These modules (i.e., instruction sets) do not have to be implemented as independent software programs, processes, or modules, so various subsets of these modules are optionally combined or otherwise rearranged in various embodiments. In some embodiments, memory 102 optionally stores a subset of the above-mentioned modules and data structures. In addition, memory 102 optionally stores additional modules and data structures not described above.

[0298] In some embodiments, the device 100 is a device on which operation of a set of predefined functions is performed exclusively through a touch screen and / or a touch pad. By using a touch screen and / or a touch pad as the primary input control device for operating the device 100, the number of physical input control devices (e.g., push buttons, dials, etc.) on the device 100 is optionally reduced.

[0299] The set of predefined functions that are performed exclusively through the touch screen and / or trackpad optionally includes navigating between user interfaces. In some embodiments, the trackpad, when touched by the user, navigates the device 100 to a main menu, a home menu, or a root menu from any user interface displayed on the device 100. In such embodiments, a "menu button" is implemented using a trackpad. In some other embodiments, the menu button is a physical push button or other physical input control device, rather than a trackpad.

[0300] Figure 1B 1 is a block diagram illustrating exemplary components for event processing according to some embodiments. In some embodiments, memory 102 ( Figure 1A ) or memory 370 ( Figure 3 ) includes an event classifier 170 (e.g., in the operating system 126) and a corresponding application 136-1 (e.g., any one of the aforementioned applications 136, 137 to 155, 380 to 390).

[0301] The event classifier 170 receives event information and determines the application 136-1 and the application view 191 of the application 136-1 to which the event information is to be delivered. The event classifier 170 includes an event monitor 171 and an event distributor module 174. In some embodiments, the application 136-1 includes an application internal state 192, which indicates one or more current application views displayed on the touch-sensitive display system 112 when the application is active or executing. In some embodiments, the device / global internal state 157 is used by the event classifier 170 to determine which application(s) is currently active, and the application internal state 192 is used by the event classifier 170 to determine the application view 191 to which the event information is to be delivered.

[0302] In some embodiments, the application internal state 192 includes additional information, such as one or more of the following: resumption information to be used when the application 136-1 resumes execution, user interface state information indicating information being displayed by the application 136-1 or information ready to be displayed by the application, a state queue for enabling a user to return to a previous state or view of the application 136-1, and a repeat / undo queue of previous actions taken by the user.

[0303] Event monitor 171 receives event information from peripherals interface 118. Event information includes information about sub-events (e.g., user touches on touch-sensitive display system 112 as part of a multi-touch gesture). Peripherals interface 118 transmits information it receives from I / O subsystem 106 or sensors (e.g., proximity sensor 166, one or more accelerometers 168, and / or microphone 113 (through audio circuit 110)). The information that peripherals interface 118 receives from I / O subsystem 106 includes information from touch-sensitive display system 112 or a touch-sensitive surface.

[0304] In some embodiments, event monitor 171 sends requests to peripheral device interface 118 at predetermined intervals. In response, peripheral device interface 118 transmits event information. In other embodiments, peripheral device interface 118 transmits event information only when there is a significant event (e.g., receiving an input above a predetermined noise threshold and / or receiving an input for more than a predetermined duration).

[0305] In some embodiments, the event classifier 170 also includes a hit view determination module 172 and / or an active event identifier determination module 173.

[0306] When the touch-sensitive display system 112 displays more than one view, the hit view determination module 172 provides software procedures for determining where within one or more views a sub-event has occurred. A view consists of controls and other elements that a user can see on the display.

[0307] Another aspect of the user interface associated with an application is a set of views, sometimes referred to herein as application views or user interface windows, in which information is displayed and touch-based gestures occur. The application views (of the respective application) in which a touch is detected optionally correspond to a programmatic level within the programmatic or view hierarchy of the application. For example, the lowest level view in which a touch is detected is optionally referred to as a hit view, and the set of events recognized as correct input is optionally determined at least in part based on the hit view of the initial touch that started the touch-based gesture.

[0308] Hit view determination module 172 receives information related to sub-events of touch-based gestures. When an application has multiple views organized in a hierarchy, hit view determination module 172 identifies the hit view as the lowest view in the hierarchy that should handle the sub-event. In most cases, the hit view is the lowest level view in which the initiating sub-event (i.e., the first sub-event in a sequence of sub-events that form an event or potential event) occurs. Once a hit view is identified by the hit view determination module, the hit view typically receives all sub-events related to the same touch or input source for which it is identified as the hit view.

[0309] Active event recognizer determination module 173 determines which view or views within the view hierarchy should receive a particular sequence of sub-events. In some embodiments, active event recognizer determination module 173 determines that only the hit view should receive a particular sequence of sub-events. In other embodiments, active event recognizer determination module 173 determines that all views that include the physical location of the sub-event are actively participating views, and therefore determines that all actively participating views should receive a particular sequence of sub-events. In other embodiments, even if a touch sub-event is completely confined to an area associated with one particular view, views higher in the hierarchy will still remain actively participating views.

[0310] Event distributor module 174 distributes event information to event recognizers (e.g., event recognizers 180). In embodiments including active event recognizer determination module 173, event distributor module 174 delivers the event information to the event recognizers determined by active event recognizer determination module 173. In some embodiments, event distributor module 174 stores the event information in an event queue, which is retrieved by corresponding event receiver module 182.

[0311] In some embodiments, operating system 126 includes event classifier 170. Alternatively, application 136-1 includes event classifier 170. In other embodiments, event classifier 170 is a standalone module or is part of another module (e.g., contact / motion module 130) stored in memory 102.

[0312] In some embodiments, application 136-1 includes multiple event handlers 190 and one or more application views 191, each of which includes instructions for handling touch events occurring within a corresponding view of the user interface of the application. Each application view 191 of application 136-1 includes one or more event recognizers 180. Typically, the corresponding application view 191 includes multiple event recognizers 180. In other embodiments, one or more event recognizers in event recognizers 180 are part of an independent module, such as a user interface toolkit (not shown) or a higher-level object from which application 136-1 inherits methods and other properties. In some embodiments, the corresponding event handler 190 includes one or more of the following: data updater 176, object updater 177, GUI updater 178 and / or event data 179 received from event classifier 170. Event handler 190 optionally utilizes or calls data updater 176, object updater 177 or GUI updater 178 to update application internal state 192. Alternatively, one or more of the application views in the application views 191 include one or more corresponding event handlers 190. In addition, in some embodiments, one or more of the data updater 176, the object updater 177, and the GUI updater 178 are included in the corresponding application view 191.

[0313] A corresponding event identifier 180 receives event information (e.g., event data 179) from event classifier 170 and identifies an event from the event information. Event identifier 180 includes an event receiver 182 and an event comparator 184. In some embodiments, event identifier 180 also includes metadata 183 and at least a subset of event delivery instructions 188 (which optionally include sub-event delivery instructions).

[0314] Event receiver 182 receives event information from event classifier 170. Event information includes information about sub-events (e.g., touch or touch movement). Depending on the sub-event, the event information also includes additional information, such as the location of the sub-event. When the sub-event involves the movement of the touch, the event information optionally also includes the rate and direction of the sub-event. In some embodiments, the event includes a rotation of the device from one orientation to another orientation (e.g., from a longitudinal orientation to a transverse orientation, or vice versa), and the event information includes corresponding information about the current orientation of the device (also referred to as the device posture).

[0315] Event comparator 184 compares event information with predefined event or sub-event definitions, and determines an event or sub-event based on the comparison, or determines or updates the state of an event or sub-event. In some embodiments, event comparator 184 includes event definition 186. Event definition 186 includes the definition of an event (e.g., a predefined sequence of sub-events), such as event 1 (187-1), event 2 (187-2), and others. In some embodiments, sub-events in event 187 include, for example, touch start, touch end, touch move, touch cancel, and multi-touch. In one embodiment, the definition of event 1 (187-1) is a double-click on a displayed object. For example, a double-click includes a first touch (touch start) of a predetermined duration on a displayed object, a first lift-off (touch end) of a predetermined duration, a second touch (touch start) of a predetermined duration on a displayed object, and a second lift-off (touch end) of a predetermined duration. For another example, the definition of event 2 (187-2) is a drag on a displayed object. For example, dragging includes a touch (or contact) of a predetermined duration on a displayed object, movement of the touch on the touch-sensitive display system 112, and lifting of the touch (touch end). In some embodiments, the event also includes information for one or more associated event handlers 190.

[0316] In some embodiments, event definition 187 includes definitions of events for corresponding user interface objects. In some embodiments, event comparator 184 performs a hit test to determine which user interface object is associated with a sub-event. For example, in an application view displaying three user interface objects on touch-sensitive display system 112, when a touch is detected on touch-sensitive display system 112, event comparator 184 performs a hit test to determine which of the three user interface objects is associated with the touch (sub-event). If each displayed object is associated with a corresponding event handler 190, the event comparator uses the result of the hit test to determine which event handler 190 should be activated. For example, event comparator 184 selects an event handler associated with the sub-event and the object that triggered the hit test.

[0317] In some embodiments, the definition of the corresponding event 187 also includes a delay action that delays the delivery of the event information until it has been determined whether the sub-event sequence does or does not correspond to the event type of the event identifier.

[0318] When a corresponding event recognizer 180 determines that a sequence of sub-events does not match any event in event definition 186, the corresponding event recognizer 180 enters an event not possible, event failed, or event ended state, after which subsequent sub-events of the touch-based gesture are ignored. In this case, other event recognizers (if any) that remain active for the hit view continue to track and process sub-events of the ongoing touch-based gesture.

[0319] In some embodiments, the corresponding event recognizers 180 include metadata 183 with configurable properties, flags, and / or lists that indicate how the event delivery system should perform sub-event delivery to actively participating event recognizers. In some embodiments, metadata 183 includes configurable properties, flags, and / or lists that indicate how event recognizers interact or can interact with each other. In some embodiments, metadata 183 includes configurable properties, flags, and / or lists that indicate whether sub-events are delivered to different levels in a view or programmatic hierarchy.

[0320] In some embodiments, when one or more specific sub-events of an event are identified, the corresponding event recognizer 180 activates an event handler 190 associated with the event. In some embodiments, the corresponding event recognizer 180 delivers event information associated with the event to the event handler 190. Activating the event handler 190 is different from sending (and deferred sending) the sub-events to the corresponding hit view. In some embodiments, the event recognizer 180 throws a flag associated with the identified event, and the event handler 190 associated with the flag obtains the flag and performs a predefined process.

[0321] In some embodiments, the event delivery instructions 188 include a sub-event delivery instruction that delivers event information about a sub-event without activating an event handler. Instead, the sub-event delivery instruction delivers the event information to an event handler associated with a sub-event series or to an actively participating view. The event handler associated with the sub-event series or with an actively participating view receives the event information and performs a predetermined process.

[0322] In some embodiments, data updater 176 creates and updates data used in application 136-1. For example, data updater 176 updates phone numbers used in contact module 137 or stores video files used in video player module 145. In some embodiments, object updater 177 creates and updates objects used in application 136-1. For example, object updater 177 creates new user interface objects or updates the position of user interface objects. GUI updater 178 updates the GUI. For example, GUI updater 178 prepares display information and sends it to graphics module 132 for display on a touch-sensitive display.

[0323] In some embodiments, one or more event handlers 190 include or have access to data updater 176, object updater 177, and GUI updater 178. In some embodiments, data updater 176, object updater 177, and GUI updater 178 are included in a single module of the corresponding application 136-1 or application view 191. In other embodiments, they are included in two or more software modules.

[0324] It should be understood that the above discussion of event processing of user touches on a touch-sensitive display also applies to other forms of user input using input devices to operate the multifunction device 100, not all of which are initiated on the touch screen. For example, mouse movement and mouse button presses, optionally in combination with single or multiple keyboard presses or holds; contact movement on a touch pad, such as tapping, dragging, scrolling, etc.; stylus input; movement of the device; verbal commands; detected eye movements; biometric input; and / or any combination thereof as input corresponding to a sub-event defining an event to be recognized.

[0325] Figure 2 A device having a touch screen (e.g., Figure 1AThe portable multifunction device 100 of the present invention is a touch-sensitive display system 112 of the present invention. The touch screen optionally displays one or more graphics within the user interface (UI) 200. In this embodiment and in other embodiments described below, the user can select one or more of the graphics by, for example, making gestures on the graphics using one or more fingers 202 (not drawn to scale in the drawings) or using one or more styluses 203 (not drawn to scale in the drawings). In some embodiments, when the user interrupts contact with the one or more graphics, selection of the one or more graphics will occur. In some embodiments, the gesture optionally includes one or more taps, one or more swipes (from left to right, from right to left, up and / or down) and / or rolling of the fingers that have been in contact with the device 100 (from right to left, from left to right, up and / or down). In some specific implementations or in some cases, inadvertent contact with the graphics will not select the graphics. For example, when the gesture corresponding to the selection is a tap, a swipe gesture that sweeps over an application icon optionally does not select the corresponding application.

[0326] The device 100 optionally also includes one or more physical buttons, such as a "home" button or menu button 204. As previously described, the menu button 204 is optionally used to navigate to any application 136 in a set of applications that are optionally executed on the device 100. Alternatively, in some embodiments, the menu button is implemented as a soft key in a GUI displayed on the touch screen display.

[0327] In some embodiments, the device 100 includes a touch screen display, a menu button 204, a push button 206 for powering the device on / off and for locking the device, one or more volume adjustment buttons 208, a user identity module (SIM) card slot 210, an earphone jack 212, and a docking / charging external port 124. The push button 206 is optionally used to: power on / off the device by pressing the button and keeping the button in a pressed state for a predefined time interval; lock the device by pressing the button and releasing the button before a predefined time interval; and / or unlock the device or initiate an unlocking process. In some embodiments, the device 100 also accepts voice input for activating or deactivating certain functions through a microphone 113. The device 100 also optionally includes one or more contact strength sensors 165 for detecting the intensity of contact on the touch-sensitive display system 112 and / or one or more tactile output generators 167 for generating tactile output for a user of the device 100.

[0328] Figure 3300 is a block diagram of an exemplary multifunction device with a display and a touch-sensitive surface according to some embodiments. Device 300 does not have to be portable. In some embodiments, device 300 is a laptop computer, a desktop computer, a tablet computer, a multimedia player device, a navigation device, an educational device (e.g., a children's learning toy), a game system, or a control device (e.g., a home controller or an industrial controller). Device 300 typically includes one or more processing units (CPUs) 310, one or more network or other communication interfaces 360, a memory 370, and one or more communication buses 320 for interconnecting these components. The communication bus 320 optionally includes circuits (sometimes referred to as chipsets) that interconnect system components and control communications between system components. Device 300 includes an input / output (I / O) interface 330 with a display 340, which is typically a touch screen display. The I / O interface 330 also optionally includes a keyboard and / or a mouse (or other pointing device) 350 and a touchpad 355, a tactile output generator 357 for generating tactile output on the device 300 (e.g., similar to the above reference). Figure 1A The one or more tactile output generators 167 described above), sensors 359 (e.g., optical sensors, acceleration sensors, proximity sensors, touch sensors, and / or sensors similar to those described above) Figure 1A Memory 370 includes high-speed random access memory, such as DRAM, SRAM, DDR RAM, or other random access solid-state memory devices, and optionally includes non-volatile memory, such as one or more magnetic disk storage devices, optical disk storage devices, flash memory devices, or other non-volatile solid-state storage devices. Memory 370 optionally includes one or more storage devices located remotely from one or more CPUs 310. In some embodiments, memory 370 stores information related to portable multifunction device 100 ( Figure 1A ) or a subset thereof. In addition, memory 370 optionally stores additional programs, modules, and data structures not present in memory 102 of portable multifunction device 100. For example, memory 370 of device 300 optionally stores a drawing module 380, a presentation module 382, ​​a word processing module 384, a website creation module 386, a disk editing module 388, and / or a spreadsheet module 390, while portable multifunction device 100 ( Figure 1A )'s memory 102 optionally does not store these modules.

[0329] Figure 3Each element in the above-mentioned identified element is optionally stored in one or more memory devices in the previously mentioned memory device. Each module in the above-mentioned identified module corresponds to a group of instructions for performing the above-mentioned functions. The above-mentioned identified module or program (that is, instruction set) need not be implemented as a separate software program, process or module, and therefore the various subsets of these modules are optionally combined or otherwise rearranged in various embodiments. In some embodiments, memory 370 optionally stores the subgroup of the above-mentioned modules and data structures. In addition, memory 370 optionally stores other modules and data structures not described above.

[0330] Attention is now turned to an embodiment of a user interface (“UI”) that is optionally implemented on portable multifunction device 100 .

[0331] Figure 4A An exemplary user interface of an application menu on portable multifunction device 100 is shown according to some embodiments. A similar user interface is optionally implemented on device 300. In some embodiments, user interface 400 includes the following elements, or a subset or superset thereof:

[0332] One or more signal strength indicators 402 of one or more wireless communications (e.g., cellular signals and Wi-Fi signals);

[0333] Time 404;

[0334] Bluetooth indicator 405;

[0335] Battery status indicator 406;

[0336] A tray 408 with common application icons, such as:

[0337] o an icon 416 labeled “Phone” of the phone module 138, the icon 416 optionally including an indicator 414 of the number of missed calls or voice messages;

[0338] o an icon 418 labeled “Mail” of the email client module 140, the icon 418 optionally including an indicator 410 of the number of unread emails;

[0339] o an icon 420 labeled "Browser" of the browser module 147; and

[0340] o an icon 422 labeled “iPod” of a video and music player module 152 (also called an iPod (trademark of Apple Inc.) module 152); and

[0341] Icons for other applications, such as:

[0342] o Icon 424 labeled "Message" of IM module 141;

[0343] o An icon 426 labeled “Calendar” of the calendar module 148;

[0344] o Icon 428 labeled “Photos” of the image management module 144;

[0345] o An icon 430 labeled “Camera” of the camera module 143;

[0346] o Icon 432 labeled “Online Video” of the online video module 155;

[0347] o Icon 434 labeled "Stock" of the Stocks desktop applet 149-2;

[0348] o an icon 436 labeled “MAP” of the map module 154;

[0349] o Icon 438 labeled "Weather" of the Weather widget 149-1;

[0350] o Icon 440 labeled "Clock" of the alarm clock widget 149-4;

[0351] o Icon 442 of exercise support module 142 labeled “Exercise Support”;

[0352] o an icon 444 of the Notepad module 153 labeled "Notepad"; and

[0353] o an icon 446 for a settings application or module that provides access to settings for the device 100 and its various applications 136;

[0354] It should be noted that Figure 4A The icon labels shown in are exemplary only. For example, in some embodiments, icon 422 of video and music player module 152 is labeled "Music" or "Music Player". Other labels are optionally used for various application icons. In some embodiments, the label of the corresponding application icon includes the name of the application corresponding to the corresponding application icon. In some embodiments, the label of a particular application icon is different from the name of the application corresponding to the particular application icon.

[0355] Figure 4B A touch-sensitive surface 451 (eg, Figure 3 A device (e.g., a tablet or touchpad 355) Figure 3Device 300 also optionally includes one or more contact intensity sensors (e.g., one or more of sensors 357) for detecting intensity of contact on touch-sensitive surface 451 and / or one or more tactile output generators 359 for generating tactile output for a user of device 300.

[0356] Figure 4B A touch-sensitive surface 451 (eg, Figure 3 A device (e.g., a tablet or touch pad 355) Figure 3 Although many of the examples that follow will be given with reference to input on a touch screen display 112 (where a touch-sensitive surface and a display are combined), in some embodiments, the device detects input on a touch-sensitive surface that is separate from the display, such as Figure 4B In some embodiments, the touch-sensitive surface (e.g., Figure 4B 451) has a main axis (e.g., Figure 4B 453) corresponding to the main axis (for example, Figure 4B According to these embodiments, the device detects contact with touch-sensitive surface 451 at a location corresponding to a corresponding location on the display (e.g., Figure 4B 460 and 462) (e.g., in Figure 4B 460 corresponds to 468 and 462 corresponds to 470). Thus, on a touch-sensitive surface (e.g., Figure 4B 451) and the display of a multi-function device ( Figure 4B When the user input detected by the device on the touch-sensitive surface (e.g., contacts 460 and 462 and their movement) is separated, the device is used to manipulate the user interface on the display. It should be understood that similar methods are optionally used for other user interfaces described herein.

[0357] In addition, although the following examples are primarily given with reference to finger inputs (e.g., finger contacts, single-finger tap gestures, finger swipe gestures, etc.), it should be understood that in some embodiments, one or more of these finger inputs are replaced by input from another input device (e.g., mouse-based input or stylus input). For example, a swipe gesture is optionally replaced by a mouse click (e.g., instead of contact), followed by movement of the cursor along the path of the swipe (e.g., instead of movement of the contact). As another example, a tap gesture is optionally replaced by a mouse click when the cursor is over the location of the tap gesture (e.g., instead of detecting contact, followed by ceasing to detect contact). Similarly, when multiple user inputs are detected simultaneously, it should be understood that multiple computer mice are optionally used simultaneously, or that a mouse and finger contact are optionally used simultaneously.

[0358] As used herein, the term "focus selector" refers to an input element that indicates the current portion of a user interface that a user is interacting with. In some implementations that include a cursor or other position marker, the cursor acts as a "focus selector" such that when the cursor is over a particular user interface element (e.g., a button, window, slider, or other user interface element), a focus selector is displayed on a touch-sensitive surface (e.g., Figure 3 Touchpad 355 or Figure 4B In the event that an input (e.g., a press input) is detected on the touch-sensitive surface 451 in the display, the particular user interface element is adjusted according to the detected input. In the case that the touch-sensitive surface 451 in the display includes a touch-screen display (e.g., Figure 1A A touch-sensitive display system 112 or Figure 4AIn some implementations of a touch screen (e.g., a touch screen in a touch screen display), a contact detected on the touch screen acts as a "focus selector" such that when an input (e.g., a press input by the contact) is detected at the location of a particular user interface element (e.g., a button, window, slider, or other user interface element) on the touch screen display, the particular user interface element is adjusted according to the detected input. In some implementations, the focus moves from one area of ​​the user interface to another area of ​​the user interface without a corresponding movement of a cursor or movement of the contact on the touch screen display (e.g., by using a tab key or arrow keys to move the focus from one button to another); in these implementations, the focus selector moves according to the movement of focus between different areas of the user interface. Regardless of the specific form taken by the focus selector, the focus selector is typically controlled by the user to communicate (e.g., by indicating to the device the element of the user interface with which the user intends to interact) the user interface element (or contact on the touch screen display) that the user intends to interact with the user interface. For example, when a press input is detected on a touch-sensitive surface (e.g., a trackpad or touch screen), the position of a focus selector (e.g., a cursor, contact, or selection box) over a corresponding button will indicate that the user intends to activate the corresponding button (rather than other user interface elements shown on the device display).

[0359] As used in this specification and claims, the term "intensity" of a contact on a touch-sensitive surface refers to the force or pressure (force per unit area) of a contact (e.g., a finger contact or a stylus contact) on the touch-sensitive surface, or to a surrogate (surrogate) of the force or pressure of a contact on the touch-sensitive surface. The intensity of a contact has a range of values ​​that includes at least four different values ​​and more typically includes hundreds of different values ​​(e.g., at least 256). The intensity of a contact is optionally determined (or measured) using various methods and various sensors or combinations of sensors. For example, one or more force sensors below or adjacent to the touch-sensitive surface are optionally used to measure the force at different points on the touch-sensitive surface. In some implementations, force measurements from multiple force sensors are combined (e.g., a weighted average) to determine an estimated contact force. Similarly, the pressure-sensitive tip of the stylus is optionally used to determine the pressure of the stylus on the touch-sensitive surface. Alternatively, the size of the contact area detected on the touch-sensitive surface and / or its change, the capacitance of the touch-sensitive surface adjacent to the contact and / or its change, and / or the resistance of the touch-sensitive surface adjacent to the contact and / or its change are optionally used as a substitute for the force or pressure of the contact on the touch-sensitive surface. In some embodiments, the alternative measurement of the contact force or pressure is used directly to determine whether an intensity threshold has been exceeded (e.g., the intensity threshold is described in units corresponding to the alternative measurement). In some embodiments, the alternative measurement of the contact force or pressure is converted into an estimated force or pressure, and the estimated force or pressure is used to determine whether an intensity threshold has been exceeded (e.g., the intensity threshold is a pressure threshold measured in units of pressure). Using the intensity of the contact as an attribute of the user input allows the user to access additional device functions that the user cannot easily access on a smaller device with limited real estate for displaying indications (e.g., on a touch-sensitive display) and / or receiving user input (e.g., via a touch-sensitive display, touch-sensitive surface, or physical controls / mechanical controls such as knobs or buttons).

[0360] In some embodiments, the contact / motion module 130 uses a set of one or more intensity thresholds to determine whether an operation has been performed by a user (e.g., to determine whether a user has "clicked" an icon). In some embodiments, at least a subset of the intensity thresholds are determined based on software parameters (e.g., the intensity thresholds are not determined by the activation thresholds of specific physical actuators and can be adjusted without changing the physical hardware of the device 100). For example, without changing the touchpad or touchscreen display hardware, the mouse "click" threshold of a touchpad or touchscreen display can be set to any one of a large range of predefined thresholds. In addition, in some specific implementations, a software setting is provided to the user of the device for adjusting one or more intensity thresholds in a set of intensity thresholds (e.g., by adjusting individual intensity thresholds and / or by utilizing a system-level click on an "intensity" parameter to adjust multiple intensity thresholds at once).

[0361] As used in the specification and claims, the term "characteristic intensity" of a contact refers to a characteristic of a contact based on one or more intensities of the contact. In some embodiments, the characteristic intensity is based on multiple intensity samples. The characteristic intensity is optionally based on a predefined number of intensity samples or a set of intensity samples collected during a predetermined time period (e.g., 0.05 seconds, 0.1 seconds, 0.2 seconds, 0.5 seconds, 1 second, 2 seconds, 5 seconds, 10 seconds) relative to a predefined event (e.g., after contact is detected, before contact is detected to be lifted, before or after contact starts to move, before contact ends, before or after contact intensity is detected to increase, and / or before or after contact intensity is detected to decrease). The characteristic intensity of a contact is optionally based on one or more of the following: the maximum value of contact intensity, the mean value of contact intensity, the average value of contact intensity, the value at the top 10% of contact intensity, the half-maximum value of contact intensity, the 90% maximum value of contact intensity, etc. In some embodiments, the duration of the contact is used when determining the characteristic intensity (e.g., when the characteristic intensity is the average value of the intensity of the contact over time). In some embodiments, the feature strength is compared to a set of one or more strength thresholds to determine whether the user has performed an operation. For example, the set of one or more strength thresholds may include a first strength threshold and a second strength threshold. In this example, a contact whose feature strength does not exceed the first threshold results in a first operation, a contact whose feature strength exceeds the first strength threshold but does not exceed the second strength threshold results in a second operation, and a contact whose feature strength exceeds the second threshold results in a third operation. In some embodiments, a comparison between the feature strength and one or more strength thresholds is used to determine whether to perform one or more operations (e.g., whether to perform the corresponding option or give up performing the corresponding operation), rather than to determine whether to perform the first operation or the second operation.

[0362] In some embodiments, a portion of a gesture is identified for determining a characteristic strength. For example, a touch-sensitive surface may receive a continuous swipe contact that transitions from a starting position and reaches an end position (e.g., a drag gesture) where the strength of the contact increases. In this embodiment, the characteristic strength of the contact at the end position may be based only on a portion of the continuous swipe contact, rather than the entire swipe contact (e.g., only a portion of the swipe contact at the end position). In some embodiments, a smoothing algorithm may be applied to the strength of the swipe gesture before determining the characteristic strength of the contact. For example, the smoothing algorithm optionally includes one or more of the following: an unweighted sliding average smoothing algorithm, a triangular smoothing algorithm, a median filter smoothing algorithm, and / or an exponential smoothing algorithm. In some cases, these smoothing algorithms eliminate narrow peaks or dips in the strength of the swipe contact for determining the characteristic strength.

[0363] The user interface diagrams described herein optionally include various intensity diagrams that illustrate contacts on the touch-sensitive surface relative to one or more intensity thresholds (e.g., contact detection intensity threshold IT ). 0 , Light press intensity threshold IT L , deep compression intensity threshold IT D (For example, it is initially at least higher than 1 L ) and / or one or more other intensity thresholds (e.g., ratio I L Lower intensity threshold I H )). The intensity graph is typically not part of the displayed user interface, but is provided to help interpret the graph. In some embodiments, the light press intensity threshold corresponds to an intensity at which the device will perform an operation typically associated with clicking a button of a physical mouse or a trackpad. In some embodiments, the deep press intensity threshold corresponds to an intensity at which the device will perform an operation different from that typically associated with clicking a button of a physical mouse or a trackpad. In some embodiments, when a characteristic intensity is detected that is below the light press intensity threshold (e.g., and above the nominal contact detection intensity threshold IT 0 , contacts lower than the nominal contact detection intensity threshold are no longer detected), the device moves the focus selector based on the movement of the contact on the touch-sensitive surface without performing the operations associated with the light press intensity threshold or the deep press intensity threshold. Generally speaking, unless otherwise noted, these intensity thresholds are consistent between different groups of user interface figures.

[0364] In some embodiments, the response of the device to the input detected by the device depends on a criterion based on the contact strength during the input. For example, for some "light press" inputs, the strength of the contact exceeding the first strength threshold during the input triggers the first response. In some embodiments, the response of the device to the input detected by the device depends on a criterion including both the contact strength during the input and the time-based criterion. For example, for some "deep press" inputs, the contact strength exceeding the second strength threshold during the input, which is greater than the first strength threshold of the light press, triggers the second response only when the delay time between reaching the first strength threshold and reaching the second strength threshold has passed. The duration of this delay time is typically less than 200ms (e.g., 40ms, 100ms, or 120ms, depending on the magnitude of the second strength threshold, and the delay time increases as the second strength threshold increases). This delay time helps avoid accidental deep press inputs. For example, for some "deep press" inputs, a period of reduced sensitivity will occur after reaching the first strength threshold. During this period of reduced sensitivity, the second strength threshold increases. This temporary increase in the second strength threshold also helps avoid accidental deep press inputs. For other deep press inputs, the response to detecting the deep press input is not dependent on time-based criteria.

[0365] In some embodiments, one or more of the input intensity thresholds and / or corresponding outputs vary based on one or more factors, such as user settings, contact motion, input timing, application running, rate at which intensity is applied, number of concurrent inputs, user history, environmental factors (e.g., ambient noise), focus selector position, etc. Exemplary factors are described in U.S. Patent Application Serial Nos. 14 / 399,606 and 14 / 624,296, which are incorporated herein by reference in their entirety.

[0366] For example, Figure 4C A dynamic intensity threshold 480 is shown that changes over time based in part on the intensity of touch input 476 over time. Dynamic intensity threshold 480 is the sum of two components: a first component 474 that decays over time after a predefined delay time p1 from when touch input 476 is initially detected, and a second component 478 that tracks the intensity of touch input 476 over time. The initial high intensity threshold of first component 474 reduces accidental triggering of a “deep press” response while still allowing an immediate “deep press” response if touch input 476 provides sufficient intensity. Second component 478 reduces unintentional triggering of a “deep press” response through gradual intensity fluctuations of the touch input. In some embodiments, when touch input 476 satisfies dynamic intensity threshold 480 (e.g., at Figure 4C ), triggering a "deep press" response.

[0367] Figure 4D Another dynamic intensity threshold 486 (eg, intensity threshold I D ). Figure 4D Two other intensity thresholds are also shown: a first intensity threshold I H and the second intensity threshold I L .exist Figure 4D Although the touch input 484 satisfies the first intensity threshold I before time p2, H and the second intensity threshold I L , but no response is provided before the delay time p2 at time 482. In addition, Figure 4D In the example, the dynamic intensity threshold 486 decays over time, wherein the decay is from time 482 (when the trigger is connected to the second intensity threshold I L This type of dynamic intensity threshold reduction begins immediately after the trigger is triggered with a lower threshold intensity (such as the first intensity threshold I H Or the second intensity threshold I L ) is triggered after or simultaneously with the response associated with the dynamic intensity threshold I D The associated response.

[0368] Figure 4E Another dynamic intensity threshold 492 (eg, intensity threshold I D ).exist Figure 4E In the example, after the initial detection of the touch input 490 and the delay time p2, the trigger and the intensity threshold I L At the same time, the dynamic intensity threshold 492 decays after the initial detection of the touch input 490 and after a predefined delay time p1. L The associated response then decreases the intensity of the touch input 490, then increases the intensity of the touch input 490 without releasing the touch input 490, which may trigger a response associated with the intensity threshold I. D The associated response (e.g., at time 494) is performed even when the intensity of touch input 490 is below another intensity threshold, such as intensity threshold I L The same is true when.

[0369] The characteristic intensity of the contact is below the light press intensity threshold IT L The intensity increases to between the light pressure intensity threshold IT L and deep compression intensity threshold IT D The intensity between is sometimes referred to as a "light press" input. The characteristic intensity of the contact is from below the deep press intensity threshold IT D The intensity of the deep compression increases to above the deep compression intensity threshold IT DThe strength of the contact is sometimes referred to as a "deep press" input. The characteristic strength of the contact is below the contact detection strength threshold IT 0 The intensity increases to between the contact detection intensity threshold IT 0 With light pressure intensity threshold IT L The strength between is sometimes referred to as detecting contact on the touch surface. The characteristic strength of the contact is above the contact detection strength threshold IT 0 The intensity decreases to below the contact detection intensity threshold IT 0 The strength of IT is sometimes referred to as detecting a contact lift-off from the touch surface. 0 In some embodiments, IT 0 Greater than zero. In some illustrations, shaded circles or ovals are used to represent the intensity of contacts on the touch-sensitive surface. In some illustrations, unshaded circles or ovals are used to represent corresponding contacts on the touch-sensitive surface without specifying the intensity of the corresponding contacts.

[0370] In some embodiments described herein, one or more operations are performed in response to detecting a gesture that includes a corresponding press input or in response to detecting a corresponding press input performed using a corresponding contact (or multiple contacts), wherein the corresponding press input is detected at least in part based on detecting that the strength of the contact (or multiple contacts) increases to above a press input strength threshold. In some embodiments, the corresponding operation is performed in response to detecting that the strength of the corresponding contact increases to above the press input strength threshold (e.g., the corresponding operation is performed on a "down stroke" of the corresponding press input). In some embodiments, the press input includes an increase in the strength of the corresponding contact to above the press input strength threshold and the strength of the contact subsequently decreases to below the press input strength threshold, and the corresponding operation is performed in response to detecting that the strength of the corresponding contact subsequently decreases to below the press input threshold (e.g., the corresponding operation is performed on an "up stroke" of the corresponding press input).

[0371] In some embodiments, the device employs intensity hysteresis to avoid unexpected input, sometimes referred to as "jitter," where the device defines or selects a hysteresis intensity threshold that has a predefined relationship to a press input intensity threshold (e.g., the hysteresis intensity threshold is X intensity units less than the press input intensity threshold, or the hysteresis intensity threshold is 75%, 90%, or some reasonable proportion of the press input intensity threshold). Thus, in some embodiments, a press input includes an increase in the intensity of the corresponding contact to above the press input intensity threshold and a subsequent decrease in the intensity of the contact to below a hysteresis intensity threshold corresponding to the press input intensity threshold, and a corresponding operation is performed in response to detecting that the intensity of the corresponding contact subsequently decreases to below the hysteresis intensity threshold (e.g., performing the corresponding operation on an "up stroke" of the corresponding press input). Similarly, in some embodiments, a press input is detected only when the device detects that the strength of the contact increases from an strength equal to or below a hysteresis strength threshold to an strength equal to or above a press input strength threshold and, optionally, the strength of the contact subsequently decreases to an strength equal to or below the hysteresis strength, and a corresponding operation is performed in response to detecting the press input (for example, depending on the circumstances, the strength of the contact increases or the strength of the contact decreases).

[0372] For ease of explanation, optionally, descriptions of operations performed in response to a press input associated with a press input intensity threshold or in response to a gesture including a press input are triggered in response to detecting that the intensity of the contact increases to above the press input intensity threshold, the intensity of the contact increases from an intensity below a hysteresis intensity threshold to an intensity above the press input intensity threshold, the intensity of the contact decreases to below the press input intensity threshold, or the intensity of the contact decreases to below a hysteresis intensity threshold corresponding to the press input intensity threshold. Additionally, in examples where operations are described as being performed in response to detecting that the intensity of the contact decreases to below the press input intensity threshold, the operations are optionally performed in response to detecting that the intensity of the contact decreases to below a hysteresis intensity threshold that corresponds to and is less than the press input intensity threshold. As described above, in some embodiments, triggering of these operations is also dependent on satisfying a time-based criterion (e.g., a delay time has elapsed between satisfying the first intensity threshold and satisfying the second intensity threshold).

[0373] User interface and associated processes

[0374] Attention now turns to embodiments of a user interface ("UI") and associated processes that may be implemented on an electronic device such as portable multifunction device 100 or device 300 having a display, a touch-sensitive surface, and (optionally) one or more sensors for detecting intensity of contacts with the touch-sensitive surface.

[0375] These user interfaces and associated procedures provide new and improved methods for:

[0376] Confirmation message;

[0377] Edit previously sent messages;

[0378] Display the editing history of previously sent messages;

[0379] Applying impact effects options to messages (e.g., to convey what the user is trying to convey);

[0380] Use "hidden ink" to display private messages;

[0381] Display enhanced instant messaging interface content (e.g., "full screen moments");

[0382] Displaying content corresponding to a particular combination of content in two separate messages (e.g., “Magic Moment”);

[0383] Create message bubbles;

[0384] Suggest emojis

[0385] Synchronize viewing of content between users;

[0386] Incorporate handwriting input;

[0387] Selectively shrink content in message transcripts;

[0388] Integrated camera

[0389] Integrated search and sharing;

[0390] Integrate interactive applications;

[0391] Integrated textures;

[0392] Make payments;

[0393] Interact with the avatar; and

[0394] Provide suggestions.

[0395] FIG. 5A to FIG. 5K An exemplary user interface for displaying a message transcript and message confirmation according to some embodiments is shown. Specifically, Figure 5A An instant messaging user interface 5002 of an instant messaging user interface (e.g., of an instant messaging application) displayed on a display of an electronic device is shown, which is sometimes referred to as a first electronic device to help distinguish it from other electronic devices that communicate with the first electronic device. The first electronic device also includes a touch-sensitive surface and one or more sensors, such as in a touch screen display or a trackpad, configured to detect the intensity of contact on the touch-sensitive surface.

[0396] like Figure 5A The instant messaging user interface 5002 shown includes a conversation transcript 5004 of an instant messaging conversation between a user of an electronic device (e.g., Genevive) and at least one other user of another electronic device (e.g., Isaac). The conversation transcript 5004 in this embodiment includes multiple messages, each of which is located in a corresponding message area 5008. A first input having a first contact 5010 at a location on the touch-sensitive surface corresponds to a first message 5006. In response to detecting the first input 5010, the electronic device displays a confirmation selection enable indication 5012 ( Figure 5B ). In this embodiment, the confirmation selection indicator indicates displaying multiple confirmation options: 5014-1 (heart), 5014-2 (Like), 5014-3 (Dislike), 5014-4 ("HA"), 5014-5 ("!!"), and 5014-6 ("?"). Other embodiments may include fewer, additional, or different confirmation options. The electronic device responds to receiving a second input 5106 through a second contact (e.g., a tap gesture, a light press gesture, a deep press gesture, or a lift-off) on a corresponding confirmation option (or a hit area corresponding to each confirmation option), such as option 5014-2 (Like), to select the corresponding confirmation option and apply it to the first message 5006 or the first message area 5008-1, as shown in FIG. Figure 5C The confirmation option selected in the exemplary option 5014-2 is displayed in the corresponding confirmation area 5018. Figure 5H As shown, the electronic device of the other user (Isaac in this embodiment) participating in the instant messaging session (sometimes referred to as a conversation) displays the same selected confirmation option adjacent to the first message area.

[0397] To edit the selected confirmation option, the user makes a third input via the third contact 5022, such as Figure 5C When the third input is detected through the third contact, the electronic device displays a confirmation editing interface 5024, such as Figure 5D Optionally, the confirmation editing interface is displayed on top of and / or in place of the conversation transcript. Optionally, in this exemplary option 5014-2, the currently selected confirmation option is visually distinguished from other available confirmation options in the confirmation editing interface 5024, such as Figure 5D shown.

[0398] Figure 5E An input contact 5026 is shown for selecting a different second confirmation option 5014-1, and Fig. 5F The message area in the conversation transcript is shown with the edited confirmation (ie, the second confirmation option 5014-1 is displayed, and the first confirmation option 5014-2 is not displayed).

[0399] In some embodiments, when a user of the first electronic device uses the confirmation editing interface 5024 to edit a confirmation option previously selected for the first message area, an electronic device of another user in the instant messaging conversation displays a confirmation ready indicator 5020 adjacent to (e.g., close to, adjacent to, or partially overlapping) the first message area in the conversation transcript 5004 displayed by the electronic device, such as Figure 5G shown.

[0400] Different users in the same instant messaging session can select different confirmation options for the same message or message area. In some embodiments, such as Fig.5I As shown, the electronic device displays a mark 5036 in the conversation transcript, which indicates that the user in the instant messaging session has selected multiple confirmation options for the second message area. Fig.5I In the embodiment shown, the mark 5036 is a stack of overlapping confirmation option icons, but it can also be a plurality of separate confirmation option icons. Fig.5I As shown, the mark 5036 is optionally adjacent to and / or partially overlaps the second message area 5008-02.

[0401] Figure 5J An embodiment of a user interface is shown that includes a count of each type of confirmation option selected by a user in an instant messaging session. Figure 5J As shown, the user interface includes counts 5040-1, 5040-2, 5040-3 of three different confirmation options selected by the user in the instant messaging session. In some embodiments, in response to detecting contact (e.g., Fig.5I The electronic device displays the input made by the contact 5034 in the Figure 5J In the user instant messaging interface shown, the mark indicates that multiple users in the instant messaging conversation have selected the confirmation option for the same message (or the corresponding message area).

[0402] By selecting one of the counts 5040, the user can see the user who has selected any particular confirmation option. In response to contact (e.g., as shown in FIG. 5A ) at a location on the touch-sensitive surface corresponding to the count 5040 of the particular confirmation option of the corresponding message area, Figure 5J The electronic device displays an icon 5042 (eg, a head image) representing a user who has selected a specific confirmation option in the corresponding message area, such as a touch 5041 as shown. Figure 5K shown.

[0403] Figure 5L to Figure 5T An exemplary user interface for editing a previously sent message while displaying a transcript of the message is shown. Figure 5L An instant messaging user interface 5002 of an instant messaging application on a display of an electronic device is shown. The instant messaging user interface 5002 includes: a conversation transcript 5004 of an instant messaging session between a user of the electronic device and at least one other user, and a first message area 5044 including a first message 5046-1 sent from the user's electronic device to the at least one other user in the instant messaging session.

[0404] The first message 5046-1 can be edited even though it has already been sent. To begin editing the first message, the user selects the first message using a predefined touch input 5048 (e.g., a tap gesture, a long press gesture, a light press gesture, or a deep press gesture) on the first message or the message area of ​​the first message. In some embodiments, the electronic device displays a menu interface in response to detecting the input 5048, such as Figure 5M Alternatively, the electronic device displays a message editing interface 5022 in response to detecting input 5048, such as Figure 5N In some embodiments, a first input gesture (e.g., a tap gesture) on the first message is used to transition to a menu interface (e.g., Figure 5M ), and a second input gesture (e.g., a deep press) is used to transition to Figure 5N Message editing interface 5052. Figure 5M The menu interface shown in the figure can be used by the user to select the edit option through touch input 5050 ( Figure 5M ) Transform your instant messaging application to Figure 5N Message editing interface 5022 is shown.

[0405] Figure 5N The message editing interface 5052 for editing the corresponding message (e.g., the first message 5046-1) includes a keyboard 5054 and an update enable indication 5056. When the message editing interface 5052 of the corresponding message is displayed, the electronic device detects one or more inputs (e.g., Figure 5N 5057 shown), displaying a modified version of the message, and detecting input activating an update affordance representation (e.g., to send the updated message to one or more other electronic devices of one or more other participants in the instant messaging session).

[0406] Fig.5O The conversation transcript 5004 is shown after the updated message 5046. Because the conversation transcript 5004 includes the edited message, the edited message includes one or more indications 5058 that the particular message was modified after the original version of the message was sent to the other participants in the instant messaging conversation. Fig.5OIn FIG. 5058 , there are two such modification indications: indication 5058-1 is the shaded area behind the message area; indication 5058-2 is the text (e.g., “Edited”) displayed below the message area containing the modified version of the message.

[0407] The edited or modified message can be edited again. The electronic device responds to an input corresponding to a request for editing a modified version 5046-2 of the message (e.g., Fig.5O Input 5060) and display the message editing interface of the modified version of the message, such as Figure 5R shown. Figure 5R The message editing interface shown includes the message 5046-2 to be edited, a keyboard, and an update enable indication (optionally not displayed until the message is modified at least once).

[0408] A participant in an instant messaging session may request to view all versions of an edited message or two or more versions. Fig.5O Predefined input 5060, on the edited message, the electronic device displays Figure 5P 44. The user interface shown in FIG. 44 shows a dialog box in which display of the conversation transcript is suppressed except for modified version 5046-2 of the first message and menu 5062 or a list of edit options. In this embodiment, displayed menu 5062 includes copy affordance 5064 (for copying the message selected by input 5060), show edit affordance 5066 (for displaying edits to the message selected by input 5060), delete affordance 5068 (for deleting the message selected by input 5060, or alternatively for undoing all edits made to the message selected by input 5060), and show more options affordance 5070. Figure 5P In the illustrated embodiment, input 5072 (e.g., a tap gesture) is detected on the touch-sensitive surface at a location corresponding to the location of “show edits” affordance 5066, which, when activated, displays user interface 5074 ( FIG. 50 ) that includes current version 5046-1 and previous version 5046-2 of the first message, as shown in FIG. Figure 5Q shown. Figure 5Q Another input 5076 or 5078 in the user interface of is used to select a version of the message to be edited. For example, the selected version is highlighted, and then a touch input on edit 5080 will start editing the selected version of the message. Alternatively, a touch input on done 5082 terminates editing of the selected version of the message.

[0409] Figure 5P An alternative to the edit menu interface shown is Figure 5S The edit menu interface shown includes the selected message (in response to Fig.5O) and a menu including an affordance (e.g., a "Show Edit" option 5086) that, when activated, displays Figure 5T 1. A user interface is shown that includes a current version 5046-2 of a selected message and one or more previous versions (eg, version 5046-1) of the selected message.

[0410] Figures 5U to 5BF An exemplary user interface for applying an impact effect option to a message input or message area is shown. Figure 5U An instant messaging user interface 5002 is shown, which includes a conversation transcript 5004 of an instant messaging conversation between a user of an electronic device (Wendy in this embodiment) and at least one other user (e.g., Max, a user of another electronic device in this embodiment) and a message input area 5100 including a first message input 5102 (e.g., text, stickers, images, and / or other graphics entered by the user of the electronic device in the message input area but not yet sent to the at least one other user in the instant messaging conversation). Figure 5U , the first message input 5102 has not yet been sent.

[0411] In some embodiments, to trigger Figure 5AA Upon activation of the impact selection interface 5110 of the touch sensitive surface, the first input 5102 made by a first contact at a location on the touch sensitive surface corresponding to a location in the message input area 5100 includes a specific gesture (e.g., a swipe gesture) received at the message input area 5100. In this embodiment, the message input area includes an impact selection enable indication 5104, and the location of the contact 5106 of the first input corresponds to the impact selection enable indication. In some embodiments, the impact selection enable indication 5104 is a multi-purpose enable indication, and a second gesture (e.g., a tap) on the same enable indication 5104 is used to send the message 5102 in the message input area 5100. Upon detecting an input including a second gesture on the enable indication 5104, the electronic device sends the message 5102 and transitions to Figure 5V Similarly, after sending message 5102, another user's electronic device receives the message and displays Figure 5W The user interface shown.

[0412] exist Figure 5X , Figure 5Y and Figure 5Z In some alternative embodiments shown, Figure 5X , Figure 5Y and Figure 5Z The deep press inputs 5108-1, 5108-2, 5108-3 shown, when detected by the electronic device, will cause the instant messaging application to display Figure 5AAThe impact selection interface 5110 includes a plurality of impact effect options (eg, impact effect options 5112-1 to 5112-4). The increased strength of the deep press input is determined by Figure 5X , Figure 5Y and Figure 5Z In addition, Figure 5X , Figure 5Y and Figure 5Z As shown, deep press input 5108-1, 5108-2, 5108-3 is performed on the impact selection enable representation 5104, and then dragging to the first impact effect option (e.g., Figure 5AA Input 5108-4 on the shock effect option 5112-1), and then pause above the enable indication of the corresponding shock effect option 5112, to select the shock effect option.

[0413] Figure 5AA The impact selection interface 5110 includes a "bubble" enable indication 5114 for displaying a selection message area impact effect option, and a "screen" enable indication 5116 for selecting a full screen impact effect option.

[0414] In some embodiments, the impact selection interface 5110 shows an animated preview of the currently selected impact effect option. For example, Figures 5AB to 5AD 5 shows an animated preview of the “shout out loud” impact effect option (which is a message area impact effect option) applied to a first message input (“Congratulations!”) in response to input 5108-5 at a location on the touch-sensitive surface corresponding to the location of the “shout out loud” impact effect option. In this embodiment, the preview of the “shout out loud” impact effect option shows that the font size of the message and the size of the message area first increase and then decrease.

[0415] Another example: Figures 5AE to 5AG The sequence of 5108 shows an animated preview of the "boom bang bang" shock effect option (which is a message area shock effect option) applied to the first message input ("Congratulations!") in response to the second input 5108-6 at a position on the touch-sensitive surface corresponding to the position of the "boom bang bang" shock effect option. In this embodiment, the preview of the "boom bang bang" shock effect option shows that the font size of the message and the size of the message area are first increased and then decreased, while changing the tilt or rotation state of the message area, and optionally changing the hue or color of the background area surrounding the message area. Optionally, the application of the corresponding shock effect option can change additional features of the message area to which the shock effect option is applied, such as the font color, background hue or color, etc. within the message area.

[0416] Figure 5AGAlso shown is a third input 5108-7 on the send affordance at a location corresponding to the user-selected shock effect option, in this case the "BOOM BOOM BUMP" option. In response, the electronic device of the user composing the message stops displaying the shock selection interface and displays a message area including the first message input in the conversation transcript, and in some embodiments, applies the selected shock effect option to the message area, such as Figure 5AH , or applied to the entire conversation transcript, as in Figure 5AI (enlarging the message area to which the impact effect option is applied and reducing the size of one or more other message areas in the conversation transcript), and then transitioning to a final or static display of the conversation transcript including the sent message, such as Figure 5AJ Similarly, the sent message is displayed on the electronic devices of one or more other users (e.g., Wendy) in the instant messaging conversation, where the selected impact effect option is applied to either the message area of ​​the sent message or the entire conversation transcript, depending on which impact effect option the sending user selected, an example of which is shown in Figure 5AK , Figure 5AL , Figure 5AM The sequence is shown in FIG.

[0417] Figure 5AN to Figure 5AS The sequence of exemplifies an embodiment of a “shout out” impact effect option applied to a corresponding sent message (“Congratulations”). Figure 5AT to Figure 5AW The sequence of illustrates an embodiment of a "gentle whisper" impact effect option applied to a corresponding sent message ("Sorry.").

[0418] In some embodiments, the selected impact effect option is applied to the entire (or substantially the entire) display screen of the electronic device sending or receiving the message to achieve a full screen effect, the display screen including a message area with the sent message, an example of which is shown in FIG. Figures 5AX to 5BF A sequence of user interface images is shown. Figures 5AX to 5BF The progression of the "boom boom explosion" effect for the first message input ("Of course not!!") is shown, starting with an enlarged, rotating display of the first message input with a dark background ( Figure 5AX ), then even larger and with a slightly lighter background ( Figure 5AY ), then zoom out and rotate at a different angle than before ( Figure 5AZ ), and then further scale down and blur the borders ( Figure 5BA ), and then at a smaller size with a different background and a different rotation angle ( Figure 5BB ), and then have a series of different shadows around the message area ( Figure 5BC , Figure 5BD , Figure 5BE) until the first message input is displayed at normal (default) size, without rotation, and with a normal (default) background ( Fig. 5BF ).

[0419] Figure 5BG to Figure 5CA An exemplary user interface for interacting with hidden messages is shown. Figure 5BG The impact selection interface 5110 shown includes a plurality of impact effect options (e.g., impact effect options 5112-1 through 5112-4, as described elsewhere in this document with respect to Figure 5AA In this embodiment, the impact selection interface 5110 also includes a "bubble" indication 5114 for displaying a message area impact effect option, and a "screen" indication 5116 for selecting a full-screen impact effect option.

[0420] In some embodiments, the displayed impact effect options include an option to hide the message content in the conversation transcript ( Figure 5AA The "Hidden Ink" option 5112-1, in Figure 5BG Indicated by an empty message area in the Figure 5BG In the illustrated embodiment, the obscured ink option includes a send affordance 5118 for sending a message (with a user-specified message input) with a corresponding impact effect option. Figure 5BG In the illustrated embodiment, the impact selection interface 5110 includes a cancel indication 5120 for canceling a selection of any impact effect option and returning the instant messaging application to a previous user interface of the instant messaging application or a predefined user interface of the instant messaging application.

[0421] Once a message is sent using the hidden ink option (hereinafter referred to as a "hidden message" for ease of reference), the hidden message will not be displayed or will be blocked, such as by the screen element 5124 used to hide the message, such as Figure 5BH As shown, until the user of the electronic device displaying the transcript of the conversation including the hidden message performs a corresponding gesture such as a sliding touch input 5128-a, 5128-b, 5128-c on the message area including the hidden message, as shown in Figures 5BH to 5BL As shown in the sequence of , the gesture will temporarily reveal a portion of the message corresponding to the location of the touch input 5128-1, 5128-b, 5128-c; or perform a deep press gesture on the message area including the hidden message, such as Figure 5BM to Figure 5BP, wherein the hidden message portion is revealed based on the intensity of deep press inputs 5130-a, 5130-b, 5130-c and optionally also based on the location of deep press inputs 5130-a, 5130-b, 5130-c. In these embodiments, in response to detecting termination of input through contact that caused the hidden message or portion thereof to be temporarily revealed, the hidden message is hidden again.

[0422] In another embodiment, Figure 5BQ to Figure 5BV The sequence shows that the hidden message is gradually revealed, such as Figure 5BQ to Figure 5BT As shown, and then gradually hidden, as Figure 5BT to Figure 5BV In yet another embodiment, Figure 5BW to Figure 5CA The sequence shows a hidden message including a gradually revealed picture or photo.

[0423] Figure 5CB to Figure 5CW An exemplary user interface for triggering enhanced message content and applying the effect to an instant messaging user interface when the message includes an enhanced message content trigger is shown. More specifically, the enhanced message content trigger can be used to send a corresponding message in an instant messaging conversation, and when an electronic device with a compatible instant messaging application receives a message with the enhanced message content trigger, the electronic device displays a transcript of the conversation with the received message and with the enhanced message content. In some embodiments, the specific enhanced message content to be displayed is indicated by one or more parameters in the enhanced message content trigger.

[0424] Figure 5CB and Figure 5CC An embodiment of a user interface is shown that displays a preview of a full screen impact effect, in this case a full screen impact effect including a moving or animated balloon 5152-1. Figure 5CB As shown, the electronic device user who wrote the message "Congratulations!" has selected the "screen" affordance 5116 for selecting the full-screen impact effect option. Similarly, Figure 5CD to Figure 5CF The sequence of FIG. 51 shows an embodiment of a user interface that displays a preview of a full-screen impact effect, in this case a full-screen impact effect that includes moving or animated confetti 5152-2. In the embodiment shown here, the user uses a swipe gesture (e.g., Figure 5CC The swipe gesture 5156 shown navigates through the available full-screen impact effects, which enables the electronic device to navigate from Figure 5CC The preview of the balloon full screen impact effect is moved to Figure 5CD The confetti full screen impact effect shown. Figure 5CB and Figure 5CCAs shown, the user interface may include an effects option indicator 5154 (sometimes referred to as a page dot) to indicate the full screen effects option currently selected or currently being previewed, and also to indicate how many full screen effects options are available and which option or options in the sequence of full screen effects options are currently being viewed.

[0425] Figure 5CG is an embodiment of a user interface having a transcript of a conversation in which none of the messages includes an enhanced message content trigger, so the message in the transcript is displayed without the enhanced message content corresponding to the trigger.

[0426] Figure 5CH to Figure 5CO The sequence of shows an embodiment of a balloon full screen effect displayed when a message ("Happy Birthday!!!!") including a corresponding enhanced message content trigger is received. Similarly, Figure 5CP to Figure 5CW The sequence shows an embodiment of a fireworks full-screen effect displayed when a message (“Happy New Year!!!”) including a corresponding enhanced message content trigger is received.

[0427] Figure 5CX to Figure 5DC An exemplary user interface for detecting and responding to composable content in a single message is shown. Figure 5CX In the instant messaging user interface 5002, the instant messaging user interface 5002 includes: a conversation transcript 5004 of an instant messaging conversation between a user of the electronic device and at least one other user (e.g., a user of another electronic device) including a first other user, and a message input area 5100. A received first message 5170 in the first message area 5008 is displayed in the conversation transcript 5004. The first message 5170 (e.g., a beer glass) has a first combinable content (e.g., an emoticon or an image such as an emoticon or a sticker). Figure 5CY In the example, the user of the electronic device enters a second message 5172 in the message input area 5100 of the instant messaging user interface 5002, and sends the second message 5172 by input 5174 for selecting the send affordance 5118. This results in the display Figure 5CZ The instant messaging user interface is shown.

[0428] If the second message 5172 includes second combinable content that forms a predefined combination with the first combinable content (content 5176) in the first message 5170, the electronic device displays content corresponding to the predefined combination, such as an animation of two beer glasses being bumped together (e.g., Figure 5DA ) and / or display the words "Cheers!" (such as Figure 5DA). Similarly, the electronic devices of one or more other users in the instant messaging session will display the first message, the second message, and the content corresponding to the predefined combination. It should be noted that the content 5176 corresponding to the predefined combination can be an animation that is briefly displayed after the second message is sent. Optionally, the content corresponding to the predefined combination is repeatedly displayed periodically, and the first message and the second message with the combinable content are both displayed in the conversation transcript 5004, or when other predefined criteria are met (for example, the first message and the second message with the combinable content are both displayed in the conversation transcript 5004, and when N is a predefined value between 1 and 60 seconds, there is no new activity in the instant messaging session for at least N seconds).

[0429] Figure 5DB and Figure 5DC 51 shows another embodiment of combinable content, where the first user has sent a first message 5178 "Birthday", and the second user enters a second message 5180 "Happy!" If both the first message and the second message include combinable content corresponding to a predefined combination, the content corresponding to the predefined combination will be displayed in the message transcript of the instant messaging user interface displayed by the sender's electronic device or the recipient's electronic device or (usually) both. For example, in this embodiment, the content corresponding to the predefined combination can be a balloon, similar to Figure 5CH to Figure 5CO shown.

[0430] Figure 5DD to Figure 5DI An exemplary user interface for selecting a message area type or shape is shown according to some embodiments. Figure 5DD Instant messaging user interface 5002 is shown including message input area 5100 with first message input 5102 ("Yes!") already entered into the message input area. Instant messaging user interface 5002 includes a send affordance 5200 located in or near message input area 5100 for sending the message entered into the area. In addition, Figure 5DD Input is shown via contact 5202 on option enable indication 5204.

[0431] Figure 5DE The instant messaging user interface shown is displayed in response to input made by contact 5202 on option enable representation 5204, wherein the option enable representation includes an enable representation of multiple message processing options, including Figure 5DE The message area type / shape selection indication 5208 is marked as a “bubble” indication. When the instant messaging user interface is displayed, the electronic device receives input through contact 5206 on the “bubble” option indication 5208.

[0432] In response to input via contact 5206 on "bubble" indication 5208, display Figure 5DF The instant messaging user interface is shown. Figure 5DF Also shown is a preview message area 5210-1 including a first message input 5102 and having a default or previously selected message area type. In these embodiments, the instant messaging application has multiple message area types or options, each message area type or option having a corresponding shape, and typically having a corresponding font size, and optionally having one or more of the following: font color, border color, and / or background color. Figure 5DF In the illustrated embodiment, send affordance 5200 is displayed near preview message area 5210-1, rather than in message input area 5100. To select a different message area type for first message 5172 or to view other available message area types, the user enters swipe gesture 5212. In response to swipe gesture 5212, a set of message area type icons are scrolled, such as from Figure 5DF to Figure 5DG as shown in the progress.

[0433] exist Figure 5DG In the embodiment of the instant messaging user interface shown, input is received through contact 5214, which causes the electronic device to change the message area type of the message area to be used for message input 5102, such as Figure 5DH As shown. Figure 5DH , the message input 5102 is now displayed in the message area 5210-2, which has the same function as that of the message input 5102 as that of the message input 5102. Figure 5DG The user can continue to select different message area types. For example, in Figure 5DI , message input 5102 is now displayed in message area 5210-3, which has a message area type corresponding to the message area type selected by the input with contact 5216.

[0434] Figure 5DJ to Figure 5DQ An exemplary user interface for automatically displaying and selecting suggested emoticons when composing a message is shown. Figure 5 DJ , an instant messaging user interface 5002 is shown with a conversation transcript 5004 having an entered but not yet sent message 5220 in a message input area 5100. In this embodiment, the instant messaging user interface 5002 includes a send affordance 5200 located in or near the message input area 5100 for sending the entered message.

[0435] like Figure 5DK to Figure 5DNAs shown, the electronic device begins to automatically provide emoticon suggestions to replace one or more words or terms in the message input area 5100. In the illustrated embodiment, the electronic device highlights the words or phrases that are candidates for replacement with emoticons in the order in which they appear in the message, first highlighting the term "sushi" 5222 in the input message 5220, as shown in FIG. Figure 5DK and Figure 5DL As shown, the term "wine" 5224 in the input message 5220 is then highlighted, as shown in FIG. Figure 5DM As shown, the term "bowling" 5226 in the input message 5220 is then highlighted, as shown in FIG. Figure 5DN In response to a user of the electronic device selecting one of the highlighted terms (e.g., input via contact on the highlighted term), such as “sushi” 5222 in input message 5220, the term is replaced by a corresponding emoticon 5232 corresponding to the term, as shown in FIG. Figure 5DO Similarly, Figure 5DP In the example, in response to a user selection of the highlighted term "wine" in the input message 5220, the term "wine" in the input message 5220 has been replaced with an emoji 5234 (e.g., a wine glass emoji) corresponding to the term. In the third example, in response to a user selection of the highlighted term "bowling" in the input message 5220, the term "bowling" in the input message 5220 has been replaced with an emoji 5236 (e.g., a bowling ball emoji) corresponding to the term.

[0436] Message confirmation

[0437] FIG. 6A to FIG. 6E Flowchart of a process for applying confirmation to a message area in a conversation transcript according to some embodiments. More specifically, these methods involve displaying a confirmation selection affordance including multiple confirmation options and applying the selected confirmation option to the received message. In some embodiments, an indication of the applied confirmation option is transmitted to a remote device (e.g., to be displayed in the conversation transcript of the remote device). The confirmation allows the user to quickly convey emotions without having to type multiple words. This can save user time by saving keystrokes, thereby creating a more efficient human-computer interaction.

[0438] One or more examples of electronic devices (eg, portable multifunction device 100 or device 300) that implement these methods are described in FIG. 5A to FIG. 5K Shown in.

[0439] FIG. 6A to FIG. 6E6 is a flow chart illustrating a method 600 performed by an electronic device having one or more processors, a memory, a touch-sensitive surface, and a display (sometimes referred to herein as a first electronic device). In some embodiments, the electronic device includes one or more sensors configured to detect intensity of contact on the touch-sensitive surface (e.g., sensors in a touch screen display or a trackpad).

[0440] When executing method 600, the electronic device displays an instant messaging user interface 602 (e.g., of an instant messaging application) on a display. The instant messaging user interface includes a transcript of a conversation between a user of the electronic device and at least one other user (e.g., of another electronic device). See, e.g. Figure 5A The electronic device receives the first message 604 in the instant messaging conversation from an electronic device (e.g., a second electronic device) corresponding to another user included in the instant messaging conversation. Figure 5A Among them, message 5006 is the first message.

[0441] In response to receiving the first message, the electronic device displays a transcript of the conversation on the display (e.g., Figure 5A The first message area of ​​the conversation transcript 5004) (e.g., Figure 5A The first message (for example, Figure 5A As used herein, a message area is a message area, bubble, disk, or other container for messages in a conversation transcript of an instant messaging session. In addition, the electronic device detects a first contact (e.g., Figure 5A The first input 608 is performed by a touch 5010 of the touch screen. For example, the first contact may be a tap gesture, a long press gesture, a light press gesture, or a deep press gesture on the first message area or on the hidden hit area of ​​the first message area.

[0442] Next, in response to detecting the first input, the electronic device displays a confirmation selection indicator (eg, Figure 5B The confirmation selection indication 5012) 610. The confirmation selection indication displays multiple confirmation options. For example, see Figure 5B5014-1 to 5014-6 in the confirmation options 5014. In some embodiments, the confirmation selection indication is a confirmation selection disk displayed adjacent to the first message area and / or overlapping the first message area. In some embodiments, the confirmation selection indication is displayed based on determining that the characteristic intensity of the contact is greater than a first intensity threshold. In some embodiments, in addition to the initially displayed set of confirmation options 5014, the user can also display additional confirmation options by performing predefined input gestures (e.g., gestures including repeated deep presses, drag gestures, etc.).

[0443] In some embodiments, the plurality of confirmation options include a graphic icon (612) showing at least one of a heart, a thumbs up, a thumbs down, "HA!", "!!", and / or a question mark. (See, e.g., Figure 5B Confirmation options 5014-1 to 5014-6 shown).

[0444] In some embodiments, method 600 includes transmitting information (614) in response to detecting the first input, wherein the information causes one or more electronic devices corresponding to at least one other user included in the instant messaging conversation to display a confirmation readiness indicator corresponding to a first message area in the conversation transcript corresponding to the instant messaging conversation (e.g., causing the other devices in the instant messaging conversation to display a confirmation area with an animated elliptical mark adjacent to the corresponding first message area of ​​the conversation transcript of the at least one other user's device and / or partially overlapping the first message area, similar to Figure 5G shown).

[0445] After detecting and responding to the first input, the electronic device detects a touch on the touch-sensitive surface that is consistent with a confirmation selection indicator (e.g., Figure 5B The confirmation selection indicator 5012) can indicate the first confirmation option (for example, Figure 5B The confirmation option 5014-2) is located at a position corresponding to the position of the second contact (for example, Figure 5B The second input 616 is performed by contact 5016 of the touch-sensitive surface. Optionally, the detection of the second contact is achieved by, for example, detecting a tap gesture, a light press gesture, a deep press gesture, or a lift-off on the first confirmation option or on a hidden hit area of ​​the first confirmation option. In some embodiments, the first contact and the second contact are different contacts, such as contacts in two different tap gestures performed by the same finger. In some embodiments, the first contact and the second contact are different parts of the same continuous contact with the touch-sensitive surface, such as a long press, a light press, or a deep press on the first message area, followed by a drag toward the first confirmation option and a lift-off at the first confirmation option.

[0446] In response to detecting the second input, the electronic device applies the first confirmation option to the first message area 618. For example, Figure 5C A first confirmation option 5014-2 applied to the first message area is shown. In some embodiments, the electronic device also stops displaying the confirmation selection indicator in response to detecting the second input.

[0447] In some embodiments, applying the first confirmation option to the first message area 618 includes displaying the first confirmation option 620 at a location adjacent to and / or partially overlapping the first message area. See, e.g. Figure 5C , which shows a first confirmation option 5014-2 applied to the corresponding first message area and, in this case, partially overlapping the corresponding first message area.

[0448] Optionally, in some embodiments, in response to detecting the second input, the electronic device transmits information 622 that causes one or more electronic devices corresponding to at least one other user included in the instant messaging session to apply the first confirmation option to the corresponding first message area in the conversation transcript corresponding to the instant messaging session. In some embodiments, this is achieved by transmitting information that causes other devices in the instant messaging session to display the first confirmation option adjacent to the corresponding first message area of ​​the conversation transcript of the device of the at least one other user and / or partially overlapping the first message area. See, e.g. Figure 5H , which shows a transcript of the conversation displayed on one of the other devices in the instant messaging conversation, including a first confirmation option 5014-2 applied to (and in this case partially overlapping) the corresponding first message area. In some embodiments, the first confirmation option (e.g., first confirmation option 5014-2) replaces the confirmation preparation indicator (e.g., Figure 5G confirmation readiness indicator 5020) (e.g., via an animated transition).

[0449] In some embodiments, the first confirmation option is displayed in a confirmation area that is different in shape from the first message area (e.g., Figure 5C As shown, the corresponding message area 5008-1 for the message from another user is rectangular and / or includes a first indicator indicating that the first message is from another user (e.g., the tail "<" points to the first side of the display), while the corresponding confirmation area 5018 is circular and / or includes a second indicator indicating that the confirmation is from the user (e.g., the tail "Oo" points to the second side of the display, opposite to the first side)).

[0450] In some embodiments, method 600, after applying the first confirmation option to the first message area (and in some embodiments, ceasing to display the confirmation selection indication), includes performing a sequence of operations 632-658, which includes detecting a third contact (e.g., Figure 5C In some embodiments, detecting the third input 632 includes detecting a tap gesture, a long press gesture, a light press gesture, or a deep press gesture on the first message area (or the first confirmation option) or on a hidden hit area of ​​the first message area (or the first confirmation option).

[0451] In such embodiments, method 600 also includes, in response to detecting a third input 632 made by a third contact at a location on the touch-sensitive surface corresponding to the location of the first message area (or in some embodiments, the first confirmation option), displaying a confirmation editing interface (e.g., Figure 5D A confirmation editing interface 5024) 634. Optionally, the confirmation editing interface is displayed on top of the conversation transcript and / or in place of the conversation transcript.

[0452] In such embodiments, method 600 also includes detecting one or more inputs in the confirmation editing interface (e.g., Figure 5E Detecting contact 5026) 650, editing (e.g., changing or deleting) a confirmation option 652 of the first message area based on the detected one or more inputs; stopping displaying the confirmation editing interface 654; displaying the first message area 656 with the edited confirmation in the conversation transcript; and transmitting so that one or more electronic devices corresponding to at least one other user included in the instant messaging conversation display the corresponding first message area 658 with the edited confirmation in the conversation transcript corresponding to the instant messaging conversation. For example, Figure 5D Confirmation edit interface 5024 is shown with an indication (eg, highlighted or grayed out) that confirmation option 5014-2 was previously selected. Figure 5E An input contact 5026 is shown for selecting a different second confirmation option 5014-1, and Fig. 5F The message area in the conversation transcript is shown with the edited confirmation (ie, the second confirmation option 5014-1 is displayed, and the first confirmation option 5014-2 is not displayed).

[0453] In some embodiments, in addition to displaying the confirmation editing interface 634 in response to detecting the third input 632 performed by the third contact, method 600 also includes stopping displaying (or dimming) the conversation transcript 636 in response to detecting the third input performed by the third contact, an example of which is shown in FIG. Figure 5E middle.

[0454] Additionally, in some embodiments, in response to detecting a third input via a third contact, method 600 includes displaying a first message area 638 in the confirmation editing interface. For example, Figure 5E An embodiment is shown in which a first message area is displayed in a confirmation editing interface without displaying any other message areas in the conversation transcript in the confirmation editing interface. In some embodiments, the first message area is initially displayed in the confirmation editing interface at the same location as the first message area was displayed in the conversation transcript immediately before the third input was detected.

[0455] In some embodiments, in addition to displaying the confirmation editing interface 634 in response to detecting the third input 632 performed by the third contact, method 600 also includes displaying a confirmation selection enable representation including multiple confirmation options in the confirmation editing interface in response to detecting the third input performed by the third contact, wherein the first confirmation option is visually distinguished (e.g., highlighted) from other confirmation options in the multiple confirmation options to indicate that the first confirmation option is currently selected. For example, Figure 5D The confirmation editing interface 5024 is shown to include a confirmation selection indicator (similar to Figure 5B The enable indication 5012 has multiple confirmation options 5014).

[0456] In some embodiments, in addition to displaying the confirmation editing interface 634 in response to detecting the third input 632 performed by the third contact, method 600 also includes displaying a menu 642 of activatable editing options including the first message area in the confirmation editing interface in response to detecting the third input performed by the third contact. For example, Figure 5D An edit menu 5028 is shown, which includes a "copy" icon 530 for copying the contents of the first message area. Figure 5D , but edit menu 5028 optionally includes additional activatable editing options, such as a "delete" icon for deleting a confirmation option currently applied.

[0457] In some embodiments, method 600 includes simultaneously displaying (A) a second message area (eg, Fig.5Imessage area 5008-2) 660, wherein (1) at least some of the users in the instant messaging session have selected a first confirmation option for the second message area, and (2) at least some of the users in the instant messaging session have selected a second confirmation option for the second message area that is different from the first confirmation option; and (B) one or more indicia (e.g., indicia 5036) indicating that users in the instant messaging session have selected multiple confirmation options for the second message area. Fig.5I In the embodiment shown, the mark 5036 is a stack of overlapping confirmation option icons, but it can also be a plurality of separate confirmation option icons. Fig.5I As shown, mark 5036 is optionally adjacent to and / or partially overlaps with second message area 5008-02. In some embodiments, for a given confirmation option that has been selected, if more than a threshold number of users (e.g., more than 2, 3, or 4 users) have selected the confirmation option in the instant messaging session, the selections are stacked.

[0458] In such an embodiment (i.e., showing a second message area and indicia indicating that a user in the instant messaging conversation has selected a plurality of confirmation options for the...

Claims

1. A method comprising: At electronic devices with displays and touch-sensitive surfaces: An instant messaging user interface is displayed on the display, wherein the instant messaging user interface includes the following items displayed simultaneously: a transcript of a conversation between an instant messaging conversation between a user of the electronic device and at least one other user; Message input area; Application area; and The application area displays affordances; While displaying the instant messaging user interface, detecting a first input that activates the application area display affordance; In response to detecting the first input activating the application area to display an affordance, based on determining that the application area was displaying a keyboard when the first input was detected, replacing display of the keyboard in the application area by simultaneously displaying: An application selection area that displays a plurality of scrollable application selection affordances, wherein: The plurality of scrollable application selection affordances includes a first application selection affordance corresponding to a currently selected first application; and The corresponding application selection affordance has a corresponding first size; and an application input area, the application input area displaying one or more activatable objects of the first application; while the application selection area and the application input area are displayed simultaneously, detecting a second input comprising movement of a contact on the touch-sensitive surface corresponding to movement of a focus selector in a first direction in the application selection area on the display; In response to detecting the second input: scrolling the plurality of application selection affordances along the first direction, and displaying a second application selection affordance; When the second application selection affordance and the one or more activatable objects of the first application are displayed in the instant messaging user interface, detecting a third input for activating the second application selection affordance; and, In response to detecting the third input activating the second application selection affordance: ceasing to display the one or more activatable objects of the first application; and One or more activatable objects of a second application corresponding to the second application selection affordance are displayed in the application input area.

2. The method according to claim 1, comprising: When scrolling the multiple application selection enable representations along the first direction, for at least some of the scrolling application selection enable representations, the size of the corresponding application selection enable representation is increased from the corresponding first size to the corresponding second size, and the corresponding second size is larger than the corresponding first size.

3. The method according to claim 2, comprising: After scrolling the plurality of application selection affordances along the first direction, reducing the size of the respective application selection affordances from the respective second size to the respective first size.

4. The method according to any one of claims 1 to 3, comprising: When the multiple application selection enable representations are scrolled along the first direction, the number of application selection enable representations displayed in the application input area is reduced from a first number of application selection enable representations to a second number of application selection enable representations, and the second number of application selection enable representations is smaller than the first number of application selection enable representations.

5. The method according to any one of claims 1 to 3, comprising: After scrolling the plurality of application selection enable representations along the first direction, stop displaying at least one application selection enable representation among the plurality of scrollable application selection enable representations that was displayed before scrolling the plurality of application selection enable representations along the first direction.

6. The method according to any one of claims 1 to 3, comprising: When displaying the application input area in the first size: Displaying an application input area expansion affordance in the application input area; as well as Detecting a fourth input that activates the application input area expansion affordance; as well as In response to detecting the fourth input, a size of the application input area is increased from the first size to a second size, the second size being larger than the first size.

7. The method according to any one of claims 1 to 3, comprising: In response to detecting the first input that activates the application area to display an indication, based on determining that the application area is displaying the application selection area and the application input area in the application area when the first input is detected, the display of the application selection area and the application input area is replaced with the display of the keyboard in the application area.

8. The method according to claim 1, comprising: while displaying the one or more activatable objects of the second application in the application input area, detecting a fifth input activating the application area displayed affordances; in response to detecting the fifth input activating the application area display affordance, replacing the simultaneous display of the application selection area and the application input area with the display of the keyboard; while displaying the keyboard in the application area, detecting a sixth input activating the application area display affordance; In response to detecting the sixth input activating the application area display affordance: ceasing to display the keyboard in the application area, and The application selection area and the application input area are displayed simultaneously, wherein the application selection area simultaneously displays a group of pre-selected application selection enable representations including the first application selection enable representation.

9. An electronic device, comprising: monitor; Touch-sensitive surfaces; one or more processors; Memory; and One or more programs, wherein the one or more programs are stored in the memory and configured to be executed by the one or more processors, the one or more programs comprising instructions for executing the method according to any one of claims 1-8.

10. A computer-readable storage medium storing one or more programs, wherein the one or more programs include instructions, which, when executed by an electronic device having a display and a touch-sensitive surface, cause the electronic device to perform the method of any one of claims 1-8.

11. A method comprising: At electronic devices with displays and touch-sensitive surfaces: An instant messaging user interface of an instant messaging application is displayed on the display, wherein the instant messaging user interface comprises: a transcript of a conversation between an instant messaging conversation between a user of the electronic device and at least one other user; a message input area; and An application area, the application area comprising: an application input area that displays one or more activatable objects of a first application; and An application selection area, the application selection area comprising: a plurality of scrollable application selection affordances corresponding to a plurality of applications operating within the instant messaging user interface, and A first application configures the affordance; When the first application configuration enable indication is displayed in the application selection area, detecting a first input that activates the first application configuration enable indication; In response to detecting the first input, displaying a first application management interface of an instant messaging application, the first application management interface comprising: a plurality of installed application affordances corresponding to the plurality of applications operating in the instant messaging user interface of the instant messaging application; and a second application configuration affordance representation different from the first application configuration affordance representation; while displaying the first application management interface, detecting a second input at a location corresponding to a first installed application enable representation among the plurality of installed application enable representations, wherein the first installed application enable representation corresponds to a first installed application on the electronic device; In response to detecting the second input, initiating a process for uninstalling at least one component of a first installed application on the electronic device; While displaying the first application management interface, detecting a third input at a location corresponding to the second application configuration affordance; and In response to detecting the third input, displaying a second application management interface of the instant messaging application, the second application management interface comprising: A plurality of toggles corresponding to the plurality of applications operating within the instant messaging user interface of the instant messaging application, wherein activation of a corresponding toggle causes the corresponding application in the instant messaging user interface of the instant messaging application to toggle between a hidden state and a visible state.

12. A method according to claim 11, wherein the first application configuration enable representation is located at a fixed position relative to the multiple application selection enable representations corresponding to the multiple applications.

13. The method according to claim 11 or 12, comprising: Displaying a search input area in the first application management interface; Receiving input from the search input area; as well as Input in the search input area is used to perform a search for a plurality of applications operable within the instant messaging user interface.

14. The method according to claim 11 or 12, comprising: while displaying the second application management interface, detecting a fourth input at a location corresponding to a first toggle of the plurality of toggles, wherein the first toggle corresponds to a second application of the plurality of applications operating within the instant messaging user interface of the instant messaging application; In response to detecting the fourth input: According to determining that the current state of the second application is the visible state, switching the state of the second application from the visible state to the hidden state; as well as According to determining that the current state of the second application is a hidden state, switching the second application from the hidden state to the visible state; After toggling the first toggle, redisplaying the application selection area including the plurality of scrollable application selection affordances, wherein: Based on determining that the second application is in the revealed state, displaying a first application selection affordance corresponding to the second application in the redisplayed application selection area; as well as Based on determining that the second application is in the hidden state, displaying the first application selection enable representation corresponding to the second application in the redisplayed application selection area is abandoned.

15. The method according to claim 11 or 12, comprising: Displaying, in the second application management interface, a plurality of arrangement marks corresponding to the plurality of applications operating in the instant messaging user interface of the instant messaging application, wherein the plurality of arrangement marks include: a first placement indicator corresponding to a third application operating within the instant messaging user interface, and a second arrangement indicator corresponding to a fourth application operating within the instant messaging user interface; while displaying the second application management interface, detecting a fifth input comprising movement of a contact on the touch-sensitive surface from a first location corresponding to the first placement indicator; and In response to detecting the fifth input: Based on determining that movement of the contact on the touch-sensitive surface satisfies a rearrangement criterion, an order of the first arrangement indicator relative to the second arrangement indicator is changed.

16. The method according to claim 15, comprising: after changing said order of said first arrangement indicators relative to said second arrangement indicators, redisplaying said application selection area including said plurality of scrollable application selection affordances; as well as In the application selection area are displayed: a second application selection affordance of the plurality of scrollable application selection affordances, wherein the second application selection affordance corresponds to the third application operating within the instant messaging user interface, and a third application selection affordance among the plurality of scrollable application selection affordances, wherein the third application selection affordance corresponds to the fourth application operating within the instant messaging user interface, Wherein the order of the second application selection enable indication relative to the third application selection enable indication corresponds to the order of the first arrangement indicator relative to the second arrangement indicator.

17. An electronic device comprising: monitor; Touch-sensitive surfaces; one or more processors; Memory; and One or more programs, wherein the one or more programs are stored in the memory and configured to be executed by the one or more processors, the one or more programs comprising instructions for executing the method according to any one of claims 11-16.

18. A computer-readable storage medium storing one or more programs, the one or more programs comprising instructions, which, when executed by an electronic device having a display and a touch-sensitive surface, cause the electronic device to perform the method of any one of claims 11-16.

19. A computer program product, comprising one or more programs, which, when executed by a processor, cause the processor to perform the method according to any one of claims 1 to 8.

20. A computer program product, comprising one or more programs, which, when executed by a processor, cause the processor to perform the method according to any one of claims 11 to 16.

Images