DEVICE, METHOD, AND GRAPHICAL USER INTERFACE FOR MANAGING SIMULTANEOUSLY OPEN SOFTWARE APPLICATIONS - Patent application

Abstract

To provide electronic devices with faster, more efficient methods and user interfaces for managing concurrently open applications.SOLUTION: A method with a multifunction device comprising a touch-sensitive display comprises detecting a gesture on the touch-sensitive display. In response to detecting the gesture on the touch-sensitive display, the method further comprises: when the gesture is a first swipe gesture in a first direction, displaying at least a list of recent electronic notifications; and, when the gesture is a second swipe gesture in a second direction distinct from the first direction, displaying one or more user specified application icons and one or more setting icons in a setting panel.SELECTED DRAWING: Figure 15

Description

[Technical field]

[0001] This application relates generally to portable electronic devices with touch-sensitive surfaces, including, but not limited to, portable electronic devices with touch-sensitive surfaces configured to have multiple open software applications. [Background technology]

[0002] The use of touch-sensitive surfaces as input devices for computers and other electronic computing devices has grown significantly in recent years. Exemplary touch-sensitive surfaces include touchpads and touch screen displays. Such surfaces are widely used to select, launch, and manage software applications.

[0003] For portable electronic devices, existing methods for managing simultaneously open applications are cumbersome and inefficient. For example, portable devices with small screens (e.g., smartphones and other pocket-sized devices) typically display a single application at a time, even if multiple applications are running on the device. On such devices, it may be difficult for a user to view and manage currently open applications. This situation creates a significant cognitive burden for the user. Moreover, existing methods for managing currently open applications waste energy by taking longer than necessary. This latter consideration is particularly important for battery-operated devices. Summary of the Invention

[0004] Thus, there is a need for computing devices with faster, more efficient methods and interfaces for managing simultaneously open applications. Such methods and interfaces can complement or replace conventional methods for managing simultaneously open applications. Such methods and interfaces reduce the cognitive burden on users and create a more efficient human-machine interface. For battery-operated computing devices, such methods and interfaces conserve power and increase the time between battery charges.

[0005] The above deficiencies and other problems associated with user interfaces for computing devices with touch-sensitive surfaces are reduced or eliminated by the disclosed device. In some embodiments, the device is portable (e.g., a notebook computer, a tablet computer, or a handheld device). In some embodiments, the device has a touchpad. In some embodiments, the device has a touch-sensitive display (also known as a "touch screen" or "touch screen display"). In some embodiments, the device has a graphical user interface (GUI), one or more processors, memory, and one or more modules, programs, or sets of instructions stored in the memory for performing a number of functions. In some embodiments, a user interacts with the GUI primarily through finger contacts and gestures on the touch-sensitive surface. In some embodiments, the functions may include image editing, drawing, presenting, word processing, website creation, disk authoring, spreadsheet creation, game playing, making phone calls, video conferencing, emailing, instant messaging, training support, digital photography, digital videography, web browsing, digital music playback, and / or digital video playback. Executable instructions to perform these functions may be contained in a computer-readable storage medium or other computer program product configured for execution by one or more processors.

[0006] According to some embodiments, a method is performed on a multifunction device with a touch-sensitive display. The method includes displaying a first application view on the touch-sensitive display corresponding to a first application in a plurality of simultaneously open applications, the first application view being displayed without simultaneously displaying application views for any other applications in the plurality of simultaneously open applications. The method also includes detecting a first input, and in response to detecting the first input, entering an application view selection mode for selecting one of the simultaneously open applications for display in the corresponding application view, displaying an initial group of icons of the open applications corresponding to at least some of the plurality of simultaneously open applications in a first default area, and simultaneously displaying at least a portion of the first application view adjacent to the first default area. The method further includes detecting a gesture on an icon of each open application within the first predefined area, and in response to detecting the gesture on each open application icon, displaying a respective application view on the touch-sensitive display for a corresponding application in the multiple simultaneously open applications, ceasing to display the icon of the open application within the first predefined area, and exiting the application view selection mode, wherein the respective application view is displayed without simultaneously displaying application views for any other applications in the multiple simultaneously open applications.

[0007] According to some embodiments, a method is performed on a multifunction device with a touch-sensitive display. The method includes displaying a first application view on the touch-sensitive display corresponding to a first application in a plurality of simultaneously open applications. The first application view is displayed without simultaneously displaying application views for any other applications in the plurality of simultaneously open applications. The method also includes detecting a first input, and in response to detecting the first input, entering an application view selection mode for selecting one of the simultaneously open applications for display in the corresponding application view, and displaying images of the open applications in a default area corresponding to at least some of the plurality of simultaneously open applications. The images of the open applications are displayed in a three-dimensional stack extending backwards on the display. The method further includes detecting a gesture on each image of the open applications in the three-dimensional stack, and in response to detecting the gesture on each image of the open applications, displaying a respective application view for the corresponding application in the plurality of simultaneously open applications on the touch-sensitive display, ceasing to display the three-dimensional stack of images of the open applications, and exiting the application view selection mode. Each application view is displayed without simultaneously displaying an application view for any other application in the multiple simultaneously open applications.

[0008] According to some embodiments, a method is performed on a multifunction device with a touch-sensitive display. The method includes displaying a first application view on the touch-sensitive display at a first size, the first application view corresponding to a first application in a plurality of simultaneously open applications, the first application view being displayed without simultaneously displaying application views for any other applications in the plurality of simultaneously open applications at the first size. The method also includes detecting a first input, and in response to detecting the first input, entering an application view selection mode for selecting one of the simultaneously open applications for display in the corresponding application view, and displaying images of the open applications in a default area, each image being displayed at a second size smaller than the first size, the images corresponding to at least a portion of the plurality of simultaneously open applications. The method further includes detecting a gesture on an image of each of the open applications within the predefined area, and in response to detecting the gesture on the respective image, displaying a respective application view for a corresponding application in the multiple simultaneously open applications at a first size on the touch-sensitive display, ceasing to display the image within the predefined area, and exiting the application view selection mode, wherein the respective application view is displayed without simultaneously displaying an application view for any other application in the multiple simultaneously open applications at the first size.

[0009] According to some embodiments, a method is performed on a multifunction device with a touch-sensitive display. The method includes displaying a first application view on the touch-sensitive display at a first size, the first application view corresponding to a first application in a plurality of simultaneously open applications, the first application view being displayed without simultaneously displaying application views for any other applications in the plurality of simultaneously open applications at the first size. The method also includes simultaneously displaying images of the open applications within a predefined area, each image being displayed at a second size smaller than the first size, the images corresponding to at least some of the plurality of simultaneously open applications. The method further includes detecting a gesture on each image of the open applications within the predefined area, and displaying a respective application view for a corresponding application in the plurality of simultaneously open applications at a first size on the touch-sensitive display in response to detecting the gesture on the respective image. The respective application view is displayed without simultaneously displaying application views for any other applications in the plurality of simultaneously open applications at the first size.

[0010] According to some embodiments, a method is performed on a multifunction device with a touch-sensitive display. The method includes performing the following actions during an application view selection mode for selecting one of a plurality of simultaneously open applications for display in a corresponding application view: The method includes displaying an initial group of icons of the open applications corresponding to at least some of the plurality of simultaneously open applications in a default zone, detecting a gesture in the default zone, and performing one of the following actions in response to detecting the gesture in the default zone: If the gesture is a first scrolling gesture in a first direction, the method includes scrolling other open application icons in the plurality of simultaneously open application icons to display in the default zone; If the gesture is a second scrolling gesture in a second direction opposite the first direction, the method includes scrolling to display a settings icon in the default zone. If the gesture is a first gesture over an icon of each open application, the method includes displaying a respective application view for a corresponding application in the multiple simultaneously open applications on the touch-sensitive display, ceasing to display the icon of the open application within the default area, and exiting the application view selection mode.

[0011] According to some embodiments, a method is performed on a multifunction device with a touch-sensitive display. The method includes displaying a first application view at a first size within a first application. The first application view includes a user selectable object associated with a second application different from the first application. The method also includes detecting a first gesture at a first location corresponding to the user selectable object, ceasing to display the first application view in response to detecting the first gesture, and displaying a second application view within the second application. The method further includes detecting an input during the second application, and entering an application view selection mode in response to detecting the input to select one of a plurality of simultaneously open applications for display within the corresponding application view, displaying an image of the open application within a first default area, and displaying a portion of the view having an application icon for launching the application within a second default area different from the first default area. The images of the open applications correspond to at least some of a plurality of simultaneously open applications, each image being displayed at a second size smaller than the first size, the images including an image of a first application view and an image of a view within the second application. The method includes detecting a second gesture while in an application view selection mode, and performing one of the following actions in response to detecting the second gesture: if the second gesture is at a location corresponding to the image of the first application view, within the first application, displaying the first application view at a first size, ceasing to display images within the first default area, and exiting the application view selection mode.The method includes, if the second gesture is at a location corresponding to the second default area, displaying a view having an application icon for launching the application, ceasing to display images in the first default area, and exiting the application view selection mode.

[0012] According to some embodiments, a method is performed on a multifunction device with a touch-sensitive display. The method includes displaying a first application view on the touch-sensitive display at a first size, the first application view corresponding to a first application in a plurality of simultaneously open applications, the first application view being displayed without simultaneously displaying application views for any other applications in the plurality of simultaneously open applications at the first size. The method includes detecting a first input, and in response to detecting the first input, entering an application view selection mode for selecting one of the simultaneously open applications for display in the corresponding application view, and displaying images of the open applications. Each image is displayed at a second size smaller than the first size, and an icon of the corresponding open application is displayed simultaneously with each image, the images and the corresponding open application icon corresponding to at least a portion of the plurality of simultaneously open applications. The method includes detecting a selection gesture on each image of the open applications, and in response to detecting the selection gesture on the each image, displaying a respective application view for a corresponding application in the multiple simultaneously open applications at a first size on the touch-sensitive display, ceasing to display the images and icons of the corresponding open applications, and exiting an application view selection mode, where each application view is displayed without simultaneously displaying application views for any other applications in the multiple simultaneously open applications at the first size.

[0013] According to some embodiments, a method is performed on a multifunction device with a touch-sensitive display. The method includes detecting a gesture on the touch-sensitive display. In response to detecting the gesture on the touch-sensitive display, the method includes displaying icons of a plurality of open applications corresponding to at least some of the plurality of simultaneously open applications if the gesture is a first swipe gesture in a first direction. The method further includes displaying one or more settings icons if the gesture is a second swipe gesture in a second direction different from the first direction. In some embodiments, the first direction is a horizontal direction and the second direction is an upward direction.

[0014] According to some embodiments, a method is performed on a multifunction device with a touch-sensitive display. The method includes detecting a gesture on the touch-sensitive display. In response to detecting the gesture on the touch-sensitive display, the method includes displaying at least a list of recent electronic notifications if the gesture is a first swipe gesture in a first direction. The method further includes displaying one or more settings icons if the gesture is a second swipe gesture in a second direction different from the first direction. In some embodiments, the first direction is a downward direction and the second direction is an upward direction.

[0015] According to some embodiments, an electronic device includes a touch-sensitive display, one or more processors, a memory, and one or more programs, the one or more programs being stored in memory and configured to be executed by the one or more processors, the one or more programs including instructions for performing operations of any of the above-mentioned methods. According to some embodiments, a graphical user interface on an electronic device including a touch-sensitive display, a memory, and one or more processors for executing the one or more programs stored in the memory includes one or more of the elements displayed in any of the above-mentioned methods, which are updated in response to an input as described in any of the above-mentioned methods. According to some embodiments, a computer-readable storage medium has instructions stored therein that, when executed by an electronic device including a touch-sensitive display, cause the device to perform operations of any of the above-mentioned methods. According to some embodiments, the electronic device includes a touch-sensitive display and means for performing operations of any of the above-mentioned methods. According to some embodiments, an information processing apparatus for use in an electronic device including a touch-sensitive display includes means for performing operations of any of the above-mentioned methods.

[0016] According to some embodiments, an electronic device includes a touch-sensitive display unit configured to display a first application view on the touch-sensitive display unit at a first size, the first application view corresponding to a first application in a plurality of simultaneously open applications, the first application view being displayed without simultaneously displaying application views for any other applications in the plurality of simultaneously open applications at the first size. The electronic device also includes a processing unit coupled to the touch-sensitive display unit. The processing unit is configured to detect a first input and, in response to detecting the first input, enter an application view selection mode for selecting one of the simultaneously open applications for display in the corresponding application view and enable display of images of the open applications. Each image is displayed at a second size smaller than the first size. An icon of the corresponding open application is displayed simultaneously with each image. The images and the corresponding open application icons correspond to at least some of the plurality of simultaneously open applications. The processing unit is configured to detect a selection gesture on each image of the open applications and, in response to detecting the selection gesture on the each image, enable displaying a respective application view for a corresponding application in the multiple simultaneously open applications at a first size on the touch-sensitive display, where each application view is displayed without simultaneously displaying application views for any other applications in the multiple simultaneously open applications at the first size, cease displaying the images and icons of the corresponding open applications, and exit the application view selection mode.

[0017] According to some embodiments, an electronic device includes a touch-sensitive display unit and a processing unit coupled to the touch-sensitive display unit. The processing unit is configured to detect a gesture on a touch-sensitive display of the touch-sensitive display unit. The processing unit is configured, in response to detecting the gesture on the touch-sensitive display, to enable display of icons of a plurality of open applications corresponding to at least some of the plurality of simultaneously open applications if the gesture is a first swipe gesture in a first direction. The processing unit is further configured to enable display of one or more settings icons if the gesture is a second swipe gesture in a second direction different from the first direction. In some embodiments, the first direction is a horizontal direction and the second direction is an upward direction.

[0018] According to some embodiments, an electronic device includes a touch-sensitive display unit and a processing unit coupled to the touch-sensitive display unit. The processing unit is configured to detect a gesture on a touch-sensitive display of the touch-sensitive display unit. The processing unit is configured, in response to detecting the gesture on the touch-sensitive display, to enable display of at least a list of recent electronic notifications if the gesture is a first swipe gesture in a first direction. The processing unit is further configured to enable display of one or more settings icons if the gesture is a second swipe gesture in a second direction different from the first direction. In some embodiments, the first direction is a downward direction and the second direction is an upward direction.

[0019] Thus, multifunction devices with touch-sensitive displays are provided with faster, more efficient methods and interfaces for managing simultaneously open software applications, thereby increasing the effectiveness, efficiency, and user satisfaction with such devices. Such methods and interfaces can complement or replace conventional methods for managing simultaneously open software applications. [Brief description of the drawings]

[0020] For a better understanding of the foregoing embodiments of the present invention, as well as additional embodiments thereof, reference should be made to the following description of the embodiments in connection with the following drawings, in which like reference numerals refer to corresponding parts throughout the drawings, in which:

[0021] [Figure 1A] 1 is a block diagram illustrating a portable multifunction device with a touch-sensitive display in accordance with some embodiments. [Figure 1B] 1 is a block diagram illustrating a portable multifunction device with a touch-sensitive display in accordance with some embodiments.

[0022] [Figure 1C] FIG. 2 is a block diagram illustrating example components for event processing according to some embodiments.

[0023] [Diagram 2] 1 illustrates a portable multifunction device with a touch screen according to some embodiments.

[0024] [Diagram 3] 1 is a block diagram of an exemplary multifunction device with a display and a touch-sensitive surface in accordance with some embodiments.

[0025] [Figure 4A]1 illustrates an exemplary user interface for a menu of applications on a portable multifunction device in accordance with some embodiments. [Figure 4B] 1 illustrates an exemplary user interface for a menu of applications on a portable multifunction device in accordance with some embodiments.

[0026] [Figure 4C] 1 illustrates an exemplary user interface for a multifunction device with a touch-sensitive surface separate from a display in accordance with some embodiments.

[0027] [Figure 5A] 1 illustrates an exemplary user interface for selecting one of simultaneously open applications according to some embodiments. [Figure 5B] 1 illustrates an exemplary user interface for selecting one of simultaneously open applications according to some embodiments. [Figure 5C] 1 illustrates an exemplary user interface for selecting one of simultaneously open applications according to some embodiments. [Figure 5D] 1 illustrates an exemplary user interface for selecting one of simultaneously open applications according to some embodiments. [Figure 5E] 1 illustrates an exemplary user interface for selecting one of simultaneously open applications according to some embodiments. [Figure 5F] 1 illustrates an exemplary user interface for selecting one of simultaneously open applications according to some embodiments. [Figure 5G] 1 illustrates an exemplary user interface for selecting one of simultaneously open applications according to some embodiments. [Figure 5H]1 illustrates an exemplary user interface for selecting one of simultaneously open applications according to some embodiments. [Figure 5I] 1 illustrates an exemplary user interface for selecting one of simultaneously open applications according to some embodiments. [Figure 5J] 1 illustrates an exemplary user interface for selecting one of simultaneously open applications according to some embodiments. [Figure 5K] 1 illustrates an exemplary user interface for selecting one of simultaneously open applications according to some embodiments. [Figure 5L] 1 illustrates an exemplary user interface for selecting one of simultaneously open applications according to some embodiments. [Figure 5M] 1 illustrates an exemplary user interface for selecting one of simultaneously open applications according to some embodiments. [Figure 5N] 1 illustrates an exemplary user interface for selecting one of simultaneously open applications according to some embodiments. [Figure 5O] 1 illustrates an exemplary user interface for selecting one of simultaneously open applications according to some embodiments. [Figure 5P] 1 illustrates an exemplary user interface for selecting one of simultaneously open applications according to some embodiments. [Figure 5Q] 1 illustrates an exemplary user interface for selecting one of simultaneously open applications according to some embodiments. [Figure 5R] 1 illustrates an exemplary user interface for selecting one of simultaneously open applications according to some embodiments. [Figure 5S]1 illustrates an exemplary user interface for selecting one of simultaneously open applications according to some embodiments. [Figure 5T] 1 illustrates an exemplary user interface for selecting one of simultaneously open applications according to some embodiments. [Figure 5U] 1 illustrates an exemplary user interface for selecting one of simultaneously open applications according to some embodiments. [Figure 5V] 1 illustrates an exemplary user interface for selecting one of simultaneously open applications according to some embodiments. [Figure 5W] 1 illustrates an exemplary user interface for selecting one of simultaneously open applications according to some embodiments. [Figure 5X] 1 illustrates an exemplary user interface for selecting one of simultaneously open applications according to some embodiments. [Figure 5Y] 1 illustrates an exemplary user interface for selecting one of simultaneously open applications according to some embodiments. [Figure 5Z] 1 illustrates an exemplary user interface for selecting one of simultaneously open applications according to some embodiments. [Figure 5AA] 1 illustrates an exemplary user interface for selecting one of simultaneously open applications according to some embodiments. [Figure 5BB] 1 illustrates an exemplary user interface for selecting one of simultaneously open applications according to some embodiments. [Figure 5CC] 1 illustrates an exemplary user interface for selecting one of simultaneously open applications according to some embodiments. [Figure 5DD]1 illustrates an exemplary user interface for selecting one of simultaneously open applications according to some embodiments. [Figure 5EE] 1 illustrates an exemplary user interface for selecting one of simultaneously open applications according to some embodiments. [Figure 5FF] 1 illustrates an exemplary user interface for selecting one of simultaneously open applications according to some embodiments. [Figure 5GG] 1 illustrates an exemplary user interface for selecting one of simultaneously open applications according to some embodiments. [Figure 5HH] 1 illustrates an exemplary user interface for selecting one of simultaneously open applications according to some embodiments. [Figure 5II] 1 illustrates an exemplary user interface for selecting one of simultaneously open applications according to some embodiments. [Figure 5JJ] 1 illustrates an exemplary user interface for selecting one of simultaneously open applications according to some embodiments. [Figure 5KK] 1 illustrates an exemplary user interface for selecting one of simultaneously open applications according to some embodiments. [Figure 5LL] 1 illustrates an exemplary user interface for selecting one of simultaneously open applications according to some embodiments. [Figure 5MM] 1 illustrates an exemplary user interface for selecting one of simultaneously open applications according to some embodiments. [Figure 5NN] 1 illustrates an exemplary user interface for selecting one of simultaneously open applications according to some embodiments. [Figure 5OO]1 illustrates an exemplary user interface for selecting one of simultaneously open applications according to some embodiments. [Figure 5PP] 1 illustrates an exemplary user interface for selecting one of simultaneously open applications according to some embodiments. [Figure 5QQ] 1 illustrates an exemplary user interface for selecting one of simultaneously open applications according to some embodiments. [Figure 5RR] 1 illustrates an exemplary user interface for selecting one of simultaneously open applications according to some embodiments. [Figure 5SS] 1 illustrates an exemplary user interface for selecting one of simultaneously open applications according to some embodiments. [Figure 5TT] 1 illustrates an exemplary user interface for selecting one of simultaneously open applications according to some embodiments. [Figure 5UU] 1 illustrates an exemplary user interface for selecting one of simultaneously open applications according to some embodiments. [Figure 5VV] 1 illustrates an exemplary user interface for selecting one of simultaneously open applications according to some embodiments. [Figure 5WW] 1 illustrates an exemplary user interface for selecting one of simultaneously open applications according to some embodiments. [Figure 5XX] 1 illustrates an exemplary user interface for selecting one of simultaneously open applications according to some embodiments. [Figure 5YY] 1 illustrates an exemplary user interface for selecting one of simultaneously open applications according to some embodiments. [Figure 5ZZ]1 illustrates an exemplary user interface for selecting one of simultaneously open applications according to some embodiments.

[0028] [Figure 5AAA] 1 illustrates an exemplary user interface for displaying settings icons and other information according to some embodiments. [Figure 5BBB] 1 illustrates an exemplary user interface for displaying settings icons and other information according to some embodiments. [Figure 5CC] 1 illustrates an exemplary user interface for displaying settings icons and other information according to some embodiments. [Figure 5DDD] 1 illustrates an exemplary user interface for displaying settings icons and other information according to some embodiments. [Figure 5EEE] 1 illustrates an exemplary user interface for displaying settings icons and other information according to some embodiments. [Figure 5FFF] 1 illustrates an exemplary user interface for displaying settings icons and other information according to some embodiments. [Figure 5GGG] 1 illustrates an exemplary user interface for displaying settings icons and other information according to some embodiments. [Figure 5HHH] 1 illustrates an exemplary user interface for displaying settings icons and other information according to some embodiments.

[0029] [Figure 6A] 1 is a flow diagram illustrating a method for selecting one of simultaneously open applications according to some embodiments. [Figure 6B] 1 is a flow diagram illustrating a method for selecting one of simultaneously open applications according to some embodiments. [Figure 6C] 1 is a flow diagram illustrating a method for selecting one of simultaneously open applications according to some embodiments.

[0030] [Figure 7] 1 is a flow diagram illustrating a method for selecting one of simultaneously open applications according to some embodiments.

[0031] [Figure 8A] 1 is a flow diagram illustrating a method for selecting one of simultaneously open applications according to some embodiments. [Figure 8B] 1 is a flow diagram illustrating a method for selecting one of simultaneously open applications according to some embodiments. [Figure 8C] 1 is a flow diagram illustrating a method for selecting one of simultaneously open applications according to some embodiments.

[0032] [Figure 9] 1 is a flow diagram illustrating a method for selecting one of simultaneously open applications according to some embodiments.

[0033] [Figure 10] 1 is a flow diagram illustrating a method for selecting one of simultaneously open applications according to some embodiments.

[0034] [Figure 11A] 1 is a flow diagram illustrating a method for selecting one of simultaneously open applications according to some embodiments. [Figure 11B] 1 is a flow diagram illustrating a method for selecting one of simultaneously open applications according to some embodiments.

[0035] [Figure 12A] 1 is a flow diagram illustrating a method for selecting one of simultaneously open applications according to some embodiments. [Figure 12B] 1 is a flow diagram illustrating a method for selecting one of simultaneously open applications according to some embodiments.

[0036] [Figure 13] FIG. 2 is a functional block diagram of an electronic device according to some embodiments.

[0037] [Figure 14] 1 is a flow diagram illustrating a method for displaying a settings icon according to some embodiments.

[0038] [Figure 15] 1 is a flow diagram illustrating a method for displaying a settings icon according to some embodiments.

[0039] [Figure 16] FIG. 2 is a functional block diagram of an electronic device according to some embodiments. DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS

[0040] Reference will now be made in detail to the embodiments, examples of which are illustrated in the accompanying drawings. In the following detailed description, numerous specific details are set forth in order to provide a thorough understanding of the present invention. However, it will be apparent to those skilled in the art that the present invention may be practiced without these specific details. In other instances, well-known methods, procedures, components, circuits, and networks have not been described in detail so as not to unnecessarily obscure aspects of the embodiments.

[0041] It will also be understood that although terms such as first, second, etc. may be used herein to describe various elements, the elements should not be limited by these terms. These terms are used only to distinguish one element from another. For example, a first contact can be called a second contact, and similarly, a second contact can be called a first contact, without departing from the scope of the present invention. Although a first contact and a second contact are both contacts, they are not the same contact.

[0042] The terminology used in the description of the invention in this specification is for the sole purpose of describing particular embodiments and is not intended to limit the invention. When used in the description of the invention and the appended claims, the singular forms "a", "an", and "the" are intended to include the plural forms as well, unless the context clearly indicates otherwise. As used herein, the term "and / or" refers to any and all possible combinations of one or more of the associated listed items and is also understood to encompass those combinations. The terms "includes", "including", "comprises", and / or "comprising", as used herein, specify the presence of the features, integers, steps, operations, elements, and / or components described, but do not preclude the presence or addition of one or more other features, integers, steps, operations, elements, components, and / or groups thereof.

[0043] As used herein, the term "in the case of" can be interpreted to mean "when", "upon", or "in response to the determination that" or "in response to the detection of", depending on the context. Similarly, the phrases "when determined to be" or "when (the described condition or event) is detected" can be interpreted to mean "when determined to be", "in response to the determination that", "when (the described condition or event) is detected", or "in response to the detection of (the described condition or event)", depending on the context.

[0044] As used herein, the term "resolution" of a display refers to the number of pixels along each axis or within each dimension of the display (also referred to as "number of pixels" or "pixel resolution"). For example, a display may have a resolution of 320x480 pixels. Furthermore, as used herein, the term "resolution" of a multifunction device refers to the resolution of the display within that multifunction device. The term "resolution" does not imply any limitation on the size of each pixel or the spacing of pixels. For example, compared to a first display having a pixel resolution of 1024x768, a second display having a pixel resolution of 320x480 has a lower resolution. However, it should be noted that the physical size of a display depends not only on the pixel resolution but also on many other factors, including pixel size and pixel spacing. Thus, a first display may have the same, smaller, or larger physical size compared to a second display.

[0045] As used herein, the term "video resolution" of a display refers to the density of pixels along each axis or within each dimension of the display. Video resolution is often measured in dots per inch (DPI), which counts the number of pixels that can be placed in a row within a distance of one inch along each dimension of the display.

[0046] Embodiments of a computing device, a user interface for such a device, and related processes for using such a device are described. In some embodiments, the computing device is a portable communication device such as a mobile phone that also includes other functions such as PDA functionality and / or music player functionality. Exemplary embodiments of portable multifunctional devices include, but are not limited to, the iPhone® and iPod Touch® devices by Apple Inc. (Cupertino, California). Other portable devices such as laptop computers or tablet computers having a touch-sensitive surface (e.g., a touch screen display and / or a touch pad) can also be used. It should also be understood that in some embodiments, the device is a desktop computer having a touch-sensitive surface (e.g., a touch screen display and / or a touch pad) rather than a portable communication device.

[0047] In the following discussion, a computing device including a display and a touch-sensitive surface is described. However, it should be understood that the computing device can include one or more other physical user interface devices such as a physical keyboard, a mouse, and / or a joystick.

[0048] The device supports a variety of applications, such as one or more of drawing applications, presentation applications, word processing applications, website creation applications, disc authoring applications, spreadsheet applications, gaming applications, telephony applications, video conferencing applications, email applications, instant messaging applications, training support applications, photo management applications, digital camera applications, digital video camera applications, web browsing applications, digital music player applications, and / or digital video player applications.

[0049] Various applications that may be executed on the device may use at least one common physical user-interface device, such as a touch-sensitive surface. One or more features of the touch-sensitive surface and corresponding information displayed on the device may be adjusted and / or changed for each application and / or within each application. In this manner, the common physical architecture (such as the touch-sensitive surface) of the device may support a variety of applications using a user interface that is intuitive and transparent to the user.

[0050] The user interface may include one or more soft keyboard embodiments. Soft keyboard embodiments may include standard (QWERTY) and / or non-standard configurations of symbols on displayed keyboard icons, such as those described in U.S. Patent Application No. 11 / 459,606, entitled "Keyboards For Portable Electronic Devices," filed July 24, 2006, and U.S. Patent Application No. 11 / 459,615, entitled "Touch Screen Keyboards For Portable Electronic Devices," filed July 24, 2006, the contents of which are incorporated herein by reference in their entirety. These keyboard embodiments may include a reduced number of icons (or soft keys) compared to the number of keys in existing physical keyboards, such as those for typewriters. This allows a user to more easily select one or more icons in the keyboard, and therefore one or more corresponding symbols. These keyboard embodiments may be adaptive. For example, the displayed icons may change according to user actions, such as selecting one or more icons and / or one or more corresponding symbols. One or more applications on a device may utilize a common keyboard and / or different keyboard embodiments. Thus, the keyboard embodiment used may be tailored to at least some of those applications. In some embodiments, one or more keyboard embodiments may be tailored to a respective user. For example, one or more keyboard embodiments may be tailored to a respective user based on the respective user's word usage history (lexicography, slang, personal use). Some of these keyboard embodiments may be adjusted to reduce the probability of user error in selecting one or more icons, and therefore one or more symbols, when using a soft keyboard embodiment.

[0051] Attention is now directed to an embodiment of a portable device with a touch-sensitive display. Figures 1A and 1B are block diagrams illustrating a portable multifunction device 100 with a touch-sensitive display 112, according to some embodiments. The touch-sensitive display 112 may be conveniently referred to as a "touch screen" and may also be known or referred to as a touch-sensitive display system. The device 100 may include memory 102 (which may include one or more computer-readable storage media), a memory controller 122, one or more processing units (CPUs) 120, a peripherals interface 118, RF circuitry 108, audio circuitry 110, a speaker 111, a microphone 113, an input / output (I / O) subsystem 106, other input or control devices 116, and an external port 124. The device 100 may include one or more light sensors 164. These components may communicate over one or more communication buses or signal lines 103.

[0052] It should be understood that device 100 is only one example of a portable multifunction device, and that device 100 may have more or fewer components than those shown, may combine two or more components, or may have a different configuration or arrangement of its components. The various components shown in Figures 1A and 1B may be implemented as hardware, software, or a combination of both hardware and software, including one or more signal processing circuits and / or application specific integrated circuits.

[0053] Memory 102 may include high-speed random access memory and may also include non-volatile memory, such as one or more magnetic disk storage devices, flash memory devices, or other non-volatile semiconductor memory devices. Access to memory 102 by other components of device 100, such as CPU 120 and peripherals interface 118, may be controlled by memory controller 122.

[0054] A peripheral interface 118 can be used to couple input and output peripherals of the device to the CPU 120 and memory 102. The one or more processors 120 perform various functions and process data for the device 100 by running or executing various software programs and / or instruction sets stored in the memory 102.

[0055] In some embodiments, the peripherals interface 118, the CPU 120, and the memory controller 122 may be implemented on a single chip, such as chip 104. In some other embodiments, they may be implemented on separate chips.

[0056] The RF (Radio Frequency) circuitry 108 transmits and receives RF signals, also called electromagnetic signals. The RF circuitry 108 converts electrical signals to and from electromagnetic signals and communicates with communication networks and other communication devices via the electromagnetic signals. The RF circuitry 108 may include well-known circuitry for performing these functions, including, but not limited to, an antenna system, an RF transceiver, one or more amplifiers, a tuner, one or more oscillators, a digital signal processor, a CODEC chipset, a subscriber identity module (SIM) card, memory, and the like. The RF circuitry 108 may communicate by wireless communication with networks such as the Internet, also known as the World Wide Web (WWW), cellular telephone networks, intranets, and / or wireless networks such as wireless local area networks (LANs) and / or metropolitan area networks (MANs), and other devices.The wireless communication may use any of a number of communication standards, protocols, and technologies, including Global System for Mobile Communications (GSM), Enhanced Data GSM Environment (EDGE), High Speed ​​Downlink Packet Access (HSDPA), Wideband Code Division Multiple Access (W-CDMA), Code Division Multiple Access (CDMA), Time Division Multiple Access (TDMA), Bluetooth®, Wireless Fidelity (Wi-Fi)® (e.g., IEEE 802.11a, IEEE 802.11b, IEEE 802.11g, and / or IEEE 802.11g). 802.11n), Voice over Internet Protocol (VoIP), Wi-MAX, protocols for email (e.g., Internet Message Access Protocol (IMAP) and / or Post Office Protocol (POP)), instant messaging (e.g., Extensible Messaging and Presence Protocol (XMPP), Session Initiation Protocol for Instant Messaging and Presence Extensions (SIMPLE), Instant Messaging and Presence Service (IMPS)), and / or Short Message Service (SMS), or any other suitable communications protocol, including communications protocols not yet developed as of the filing date of this document.

[0057] The audio circuitry 110, speaker 111, and microphone 113 provide an audio interface between a user and the device 100. The audio circuitry 110 receives audio data from the peripherals interface 118, converts the audio data to an electrical signal, and transmits the electrical signal to the speaker 111. The speaker 111 converts the electrical signal to sound waves audible to humans. The audio circuitry 110 also receives an electrical signal converted from the sound waves by the microphone 113. The audio circuitry 110 converts the electrical signal to audio data and transmits the audio data to the peripherals interface 118 for processing. The audio data can be read from and / or transmitted to the memory 102 and / or RF circuitry 108 by the peripherals interface 118. In some embodiments, the audio circuitry 110 also includes a headset jack (e.g., 212 in FIG. 2). The headset jack provides an interface between audio circuitry 110 and a removable audio input / output peripheral, such as an output-only headphone or a headset with both an output (e.g., one- or binaural headphones) and an input (e.g., a microphone).

[0058] The I / O subsystem 106 couples input / output peripherals on the device 100, such as the touch screen 112 and other input control devices 116, to the peripheral interface 118. The I / O subsystem 106 may include a display controller 156 as well as one or more input controllers 160 for other input or control devices. The one or more input controllers 160 receive / send electrical signals to / from the other input or control devices 116. The other input control devices 116 may include physical buttons (e.g., push buttons, rocker buttons, etc.), dials, slider switches, joysticks, click wheels, etc. In some alternative embodiments, the input controller(s) 160 may be coupled to any (or none) of a keyboard, an infrared port, a USB port, and a pointer device such as a mouse. The one or more buttons (e.g., 208 in FIG. 2) may include up / down buttons for adjusting the volume of the speaker 111 and / or microphone 113. The one or more buttons may include a push button (e.g., 206 in FIG. 2). A quick press of the push button may unlock the touch screen 112 or may initiate the process of unlocking the device using gestures on the touch screen, as described in U.S. Patent Application Serial No. 11 / 322,549, filed December 23, 2005, entitled "Unlocking a Device by Performing Gestures on an Unlock Image," which is incorporated herein by reference in its entirety. A longer press of the push button (e.g., 206) may turn power to the device 100 on or off. A user may be able to customize the functionality of one or more of these buttons. The touch screen 112 may be used to implement virtual or soft buttons and one or more soft keyboards.

[0059] The touch-sensitive display 112 provides an input and output interface between the device and a user. The display controller 156 receives and / or transmits electrical signals to and from the touchscreen 112. The touchscreen 112 displays visual output to the user. This visual output may include graphics, text, icons, video, and any combination thereof (collectively referred to as "graphics"). In some embodiments, some or all of these visual outputs may correspond to user interface objects.

[0060] Touchscreen 112 has a touch-sensitive surface, sensor, or set of sensors that accepts input from a user based on haptic and / or tactile contact. Touchscreen 112 and display controller 156 (along with any associated modules and / or instruction sets in memory 102) detects contacts (and any movement or breaking of contacts) on touchscreen 112 and translates the detected contacts into interactions with user interface objects (e.g., one or more soft keys, icons, web pages, or images) that are displayed on touchscreen 112. In an exemplary embodiment, the point of contact between touchscreen 112 and the user corresponds to the user's finger.

[0061] Touch screen 112 may use LCD (liquid crystal display), LPD (light emitting polymer display), or LED (light emitting diode) technology, although other display technologies may be used in other embodiments. Touch screen 112 and display controller 156 may detect contact and any movement or interruption of that contact using any of a number of touch sensing technologies now known or later developed, including, but not limited to, capacitive, resistive, infrared, and surface ultrasonic technologies, as well as other proximity sensor arrays or other elements to determine one or more points of contact with touch screen 112. In an exemplary embodiment, projected mutual capacitance sensing technology is used, such as that found in the iPhone® and iPod Touch® by Apple Inc. (Cupertino, Calif.).

[0062] The touch-sensitive display in some embodiments of touchscreen 112 may be similar to the multi-touch-sensing touchpad described in U.S. Patent Nos. 6,323,846 (Westerman et al.), 6,570,557 (Westerman et al.), and / or 6,677,932 (Westerman), and / or U.S. Patent Publication No. 2002 / 0015024 (A1), each of which is incorporated by reference in its entirety. However, touchscreen 112 displays visual output from portable device 100, whereas a touch-sensitive touchpad does not provide visual output.

[0063] The touch-sensitive display in some embodiments of touch screen 112 may be as described in the following applications: (1) U.S. Patent Application No. 11 / 381,313, filed May 2, 2006, entitled "Multipoint Touch Surface Controller"; (2) U.S. Patent Application No. 10 / 840,862, filed May 6, 2004, entitled "Multipoint Touchscreen"; (3) U.S. Patent Application No. 10 / 903,964, filed July 30, 2004, entitled "Gestures For Touch Sensitive Input Devices"; (4) U.S. Patent Application No. 11 / 048,264, filed January 31, 2005, entitled "Gestures For Touch Sensitive Input Devices"; (5) U.S. Patent Application No. 11 / 038,590, filed January 18, 2005, entitled "Mode-Based Graphical User Interfaces For Touch Sensitive Input Devices"; (6) U.S. Patent Application No. 11 / 228,758, filed September 16, 2005, entitled "Virtual Input Device Placement On A Touch Screen User Interface"; No. 11 / 228,700, filed Sep. 16, 2005, entitled "Operation Of A Computer With A Touch Screen Interface," (7) No. 11 / 228,700, filed Sep. 16, 2005, entitled "Operation Of A Computer With A Touch Screen Interface," (8) No. 11 / 228,737, filed Sep. 16, 2005, entitled "Activating Virtual Keys Of A Touch-Screen Virtual Keyboard," and (9) No. 11 / 367,749, filed Mar. 3, 2006, entitled "Multi-Functional Hand-Held Device," all of which are incorporated herein by reference in their entirety.

[0064] The touch screen 112 may have a video resolution of more than 100 dpi. In some embodiments, the touch screen has a video resolution of approximately 160 dpi. A user may contact the touch screen 112 using any suitable object or appendage, such as a stylus, a finger, etc. In some embodiments, the user interface is designed to function primarily with finger-based contacts and gestures, which may be less precise than stylus-based input due to the larger contact area of ​​a finger on the touch screen. In some embodiments, the device translates the coarse finger-based input into precise pointer / cursor positions or commands to perform the action desired by the user.

[0065] In some embodiments, in addition to a touchscreen, device 100 may include a touchpad (not shown) for activating or deactivating certain functions. In some embodiments, the touchpad is a touch-sensitive area of ​​the device that, unlike the touchscreen, does not display visual output. The touchpad can be a touch-sensitive surface separate from touchscreen 112 or an extension of the touch-sensitive surface formed by the touchscreen.

[0066] In some embodiments, device 100 may include a physical or virtual wheel (e.g., a click wheel) as an input control device 116. A user may navigate among and interact with one or more graphical objects (e.g., icons) displayed in touch screen 112 by rotating the click wheel or by moving a contact point on the click wheel (e.g., in this case, the amount of movement of the contact point is measured by its angular displacement with respect to the center point of the click wheel). The click wheel may also be used to select one or more of the displayed icons. For example, a user may depress at least a portion of the click wheel or an associated button. User commands and navigation commands provided by a user via the click wheel may be processed by input controller 160 and one or more of the modules and / or instruction sets in memory 102. For a virtual click wheel, the click wheel and click wheel controller may be part of touch screen 112 and display controller 156, respectively. For a virtual click wheel, the click wheel may be an opaque or semi-transparent object that appears and disappears on the touch screen display depending on user interaction with the device. In some embodiments, the virtual click wheel is displayed on a touchscreen of the portable multifunction device and is operated by user contact with the touchscreen.

[0067] Device 100 also includes a power system 162 for providing power to the various components. Power system 162 may include a power management system, one or more power sources (e.g., batteries, alternating current (AC)), a recharging system, power failure detection circuitry, power converters or inverters, power status indicators (e.g., light emitting diodes (LEDs)), and any other components associated with the generation, management, and distribution of power within a portable device.

[0068] Device 100 may also include one or more light sensors 164. FIGS. 1A and 1B show a light sensor coupled to light sensor controller 158 in I / O subsystem 106. Light sensor 164 may include a charge-coupled device (CCD) or a complementary metal-oxide semiconductor (CMOS) phototransistor. Light sensor 164 receives light from the environment, projected through one or more lenses, and converts the light into data representing an image. In conjunction with imaging module 143 (also called a camera module), light sensor 164 may capture still images or video. In some embodiments, a light sensor is located on the back of device 100, opposite touchscreen display 112 on the front of the device, allowing the touchscreen display to be used as a viewfinder for capturing still and / or video images. In some embodiments, a light sensor is located on the front of the device, allowing an image of a user to be captured for a video conference while the user views other videoconference participants on the touchscreen display. In some embodiments, the position of the light sensor 164 can be changed by the user (e.g., by rotating the lens and sensor within the device housing), thereby allowing a single light sensor 164 to be used in conjunction with a touch screen display for both video conferencing and capturing still and / or video images.

[0069] Device 100 may also include one or more proximity sensors 166. Figures 1A and 1B show proximity sensor 166 coupled to peripheral interface 118. Alternatively, proximity sensor 166 may be coupled to input controller 160 in I / O subsystem 106. Proximity sensor 166 may function as described in U.S. patent application Ser. No. 11 / 241,839, "Proximity Detector In Handheld Device," Ser. No. 11 / 240,788, "Proximity Detector In Handheld Device," Ser. No. 11 / 620,702, "Using Ambient Light Sensor To Augment Proximity Sensor Output," Ser. No. 11 / 586,862, "Automated Response To And Sensing Of User Activity In Portable Devices," and Ser. No. 11 / 638,251, "Methods And Systems For Automatic Configuration Of Peripherals," which are incorporated herein by reference in their entireties. In some embodiments, when the multifunction device is placed near a user's ear (eg, when the user is making a phone call), the proximity sensor turns off and disables touchscreen 112.

[0070] Device 100 may also include one or more accelerometers 168. Figures 1A and 1B show accelerometer 168 coupled to peripherals interface 118. Alternatively, accelerometer 168 may be coupled to input controller 160 in I / O subsystem 106. Accelerometer 168 may function as described in U.S. Patent Publication Nos. 20050190059, "Acceleration-based Theft Detection System for Portable Electronic Devices," and 20060017692, "Methods And Apparatuses For Operating A Portable Device Based On An Accelerometer," both of which are incorporated herein by reference in their entireties. In some embodiments, information is displayed on a touchscreen display in portrait or landscape view based on an analysis of data received from one or more accelerometers. Device 100 optionally includes a magnetometer (not shown) and a GPS (or GLONASS or other global navigation system) receiver (not shown) for obtaining information regarding the location and orientation (e.g., portrait or landscape) of device 100, in addition to accelerometer(s) 168.

[0071] In some embodiments, the software components stored in memory 102 include an operating system 126, a communication module (or instruction set) 128, a touch / motion module (or instruction set) 130, a graphics module (or instruction set) 132, a text input module (or instruction set) 134, a global positioning system (GPS) module (or instruction set) 135, and applications (or instruction sets) 136. Additionally, in some embodiments, as shown in Figures 1A, 1B, and 3, memory 102 stores device / global internal state 157. Device / global internal state 157 includes one or more of: active application state, which indicates which applications, if any, are currently active; display state, which indicates which applications, views, or other information occupy various regions of touchscreen display 112; sensor state, which includes information obtained from the device's various sensors and input control devices 116; and location information relating to the location and / or orientation of the device.

[0072] Operating system 126 (e.g., an embedded operating system such as Darwin®, RTXC®, LINUX®, UNIX®, OS X®, WINDOWS®, or VxWorks®) includes various software components and / or drivers for controlling and managing common system tasks (e.g., memory management, storage device control, power management, etc.) and facilitating communication between various hardware and software components.

[0073] Communications module 128 facilitates communication with other devices via one or more external ports 124 and also includes various software components for processing data received by RF circuitry 108 and / or external port 124. External port 124 (e.g., Universal Serial Bus (USB), FIREWIRE®, etc.) is adapted to couple directly to other devices or indirectly via a network (e.g., Internet, wireless LAN, etc.). In some embodiments, the external port is a multi-pin (e.g., 30-pin) connector the same as or similar to the 30-pin connector used on iPod (trademark of Apple Inc.) devices and / or a compatible multi-pin (e.g., 30-pin) connector.

[0074] The contact / motion module 130 can detect contact with the touch screen 112 (in relation to the display controller 156) and contact with other touch sensing devices (e.g., a touch pad or a physical click wheel). The contact / motion module 130 performs various operations related to the detection of contact, such as determining whether contact has occurred (e.g., detecting an event of a finger being lowered), determining whether there is movement of the contact, tracking movement across the touch sensing surface (e.g., detecting one or more events of a finger being dragged), and determining whether the contact has stopped (e.g., detecting an event of a finger being raised or an interruption of contact), and includes various software components for this purpose. The contact / motion module 130 receives contact data from the touch sensing surface. Determining the movement of the contact point, represented by a series of contact data, may include determining the speed (magnitude), velocity (magnitude and direction), and / or acceleration (change in magnitude and / or direction) of the contact point. These operations can be applied to a single contact (e.g., contact with one finger) or multiple simultaneous contacts (e.g., "multi-touch" / contact with multiple fingers). In some embodiments, the contact / motion module 130 and the display controller 156 detect contact on the touch pad. In some embodiments, the contact / motion module 130 and the controller 160 detect contact on the click wheel.

[0075] Contact / motion module 130 can detect gesture input by a user. Different gestures on a touch-sensitive surface have different contact patterns. Therefore, a gesture can be detected by detecting a particular contact pattern. For example, detecting a finger tap gesture includes detecting a finger down event, followed by a finger lift off event at the same location (or substantially the same location) as the finger down event (e.g., at the location of an icon). As another example, detecting a finger swipe gesture on a touch-sensitive surface includes detecting a finger down event, followed by one or more finger drag events, followed by a finger lift off event.

[0076] Graphics module 132 includes various known software components for rendering and displaying graphics on touch screen 112 or other display, including components for changing the brightness of the displayed graphics. As used herein, the term "graphics" includes any object that can be displayed to a user, including, but not limited to, text, web pages, icons (such as user interface objects including soft keys), digital images, video, animations, and the like.

[0077] In some embodiments, graphics module 132 stores data representing the graphics to be used. Each graphic may be assigned a corresponding code. Graphics module 132 receives one or more codes specifying the graphics to be displayed, including, as appropriate, coordinate data and other graphic characteristic data, from an application or the like, and then generates screen image data for output to display controller 156.

[0078] Text input module 134, which may be a component of graphics module 132, provides a soft keyboard for entering text within various applications (e.g., contacts 137, email 140, IM 141, browser 147, and any other application requiring text input).

[0079] The GPS module 135 determines the location of the device and provides this information for use in various applications (e.g., to the phone 138 for use in location-based dialing, to the camera 143 as photo / video metadata, and to applications that provide location-based services, such as a weather widget, a local yellow pages widget, and a maps / navigation widget).

[0080] The application 136 may include the following modules (or sets of instructions), or a subset or superset thereof: ● a contacts module 137 (sometimes called an address book or contact list); ●Telephone module 138, ● Videoconferencing module 139, ● an email client module 140; ● Instant messaging (IM) module 141; ● Training support module 142, A camera module 143 for still and / or video images, ● Image management module 144, ●Video player module 145, ● Music player module 146, ● Browser module 147, ● Calendar module 148, A widget module 149, which may include one or more of a weather widget 149-1, a stock price widget 149-2, a calculator widget 149-3, an alarm clock widget 149-4, a dictionary widget 149-5, and other widgets obtained by the user, as well as user-created widgets 149-6; ● a widget creation module 150 for creating user-created widgets 149-6; ● Search module 151, A video and music player module 152 that merges the video player module 145 and the music player module 146; ● Memo module 153, Map module 154, and / or ●Online video module 155.

[0081] Examples of other applications 136 that may be stored in memory 102 include other word processing applications, other image editing applications, drawing applications, presentation applications, Java-enabled applications, encryption, digital rights management, voice recognition, and voice duplication.

[0082] In conjunction with the touch screen 112, the display controller 156, the contact module 130, the graphics module 132, and the text input module 134, the contacts module 137 can be used to manage an address book or contact list (e.g., stored in the memory 102 or in the application internal state 192 of the contacts module 137 in the memory 370), including adding a name(s) to the address book, deleting a name(s) from the address book, associating a phone number(s), email address(es), physical address(es), or other information with a name, associating an image with a name, categorizing and sorting names, providing a phone number or email address to initiate and / or facilitate communication, such as by telephone 138, video conference 139, email 140, or IM 141, and the like.

[0083] In conjunction with RF circuitry 108, audio circuitry 110, speaker 111, microphone 113, touch screen 112, display controller 156, contact module 130, graphics module 132, and text input module 134, telephone module 138 can be used to enter a series of characters corresponding to a telephone number, access one or more telephone numbers in address book 137, modify an entered telephone number, dial each telephone number, conduct a conversation, and disconnect or hang up when the conversation is completed. As mentioned above, this wireless communication can use any of a number of communication standards, protocols, and technologies.

[0084] In association with RF circuitry 108, audio circuitry 110, speaker 111, microphone 113, touch screen 112, display controller 156, light sensor 164, light sensor controller 158, contact module 130, graphics module 132, text input module 134, contact list 137, and telephone module 138, videoconferencing module 139 includes executable instructions for initiating, conducting, and terminating a videoconference between a user and one or more other participants in accordance with the user's instructions.

[0085] In conjunction with RF circuitry 108, touch screen 112, display controller 156, contact module 130, graphics module 132, and text input module 134, email client module 140 contains executable instructions for composing, sending, receiving, and managing emails in response to user instructions. In conjunction with image management module 144, email client module 140 makes it very easy to compose and send emails with still or video images captured by camera module 143.

[0086] In conjunction with the RF circuitry 108, touch screen 112, display controller 156, contact module 130, graphics module 132, and text input module 134, instant messaging module 141 includes executable instructions for entering a series of characters corresponding to an instant message, modifying previously entered characters, sending each instant message (e.g., using Short Message Service (SMS) or Multimedia Message Service (MMS) protocols for telephone-based instant messaging, or using XMPP, SIMPLE, or IMPS for Internet-based instant messaging), receiving instant messages, and viewing received instant messages. In some embodiments, sent and / or received instant messages may include graphics, photos, audio files, video files, and / or other attachments, such as those supported by MMS and / or Enhanced Messaging Service (EMS). As used herein, "instant messaging" refers to both telephone-based messages (e.g., messages sent using SMS or MMS) and Internet-based messages (e.g., messages sent using XMPP, SIMPLE, or IMPS).

[0087] In conjunction with the RF circuitry 108, touch screen 112, display controller 156, contact module 130, graphics module 132, text input module 134, GPS module 135, map module 154, and music player module 146, the training support module 142 includes executable instructions for creating workouts (e.g., having time, distance, and / or calorie burn goals), communicating with training sensors (sports devices), receiving training sensor data, calibrating sensors used to monitor the workouts, selecting and playing music for the workouts, and displaying, storing, and transmitting the workout data.

[0088] In conjunction with touch screen 112, display controller 156, light sensor(s) 164, light sensor controller 158, contact module 130, graphics module 132, and image management module 144, camera module 143 contains executable instructions for capturing still images or video (including video streams), storing them in memory 102, modifying characteristics of the still images or video, or deleting the still images or video from memory 102.

[0089] In conjunction with touch screen 112, display controller 156, contact module 130, graphics module 132, text input module 134, and camera module 143, image management module 144 contains executable instructions for arranging, modifying (e.g., editing) or otherwise manipulating, labeling, deleting, presenting (e.g., in a digital slide show or album), and storing still and / or video images.

[0090] In association with touchscreen 112, display controller 156, contact module 130, graphics module 132, audio circuitry 110, and speaker 111, video player module 145 contains executable instructions for displaying, presenting, or otherwise playing video (e.g., on touchscreen 112 or on an externally connected display via external port 124).

[0091] Music player module 146, in conjunction with touch screen 112, display system controller 156, contact module 130, graphics module 132, audio circuitry 110, speaker 111, RF circuitry 108, and browser module 147, contains executable instructions that enable a user to download and play pre-recorded music and other sound files stored in one or more file formats, such as MP3 or AAC files. In some embodiments, device 100 may include the functionality of an MP3 player, such as an iPod (a trademark of Apple Inc.).

[0092] In association with RF circuitry 108, touch screen 112, display system controller 156, contact module 130, graphics module 132, and text input module 134, browser module 147 contains executable instructions for browsing the Internet in accordance with a user's instructions, including retrieving, linking to, receiving, and displaying web pages or portions thereof, as well as attachments and other files linked to web pages.

[0093] In association with the RF circuitry 108, touch screen 112, display system controller 156, contact module 130, graphics module 132, text input module 134, email client module 140, and browser module 147, calendar module 148 includes executable instructions for creating, displaying, modifying, and storing calendars and data associated with the calendars (e.g., calendar items, to-do lists, etc.) in accordance with a user's instructions.

[0094] In conjunction with the RF circuitry 108, touch screen 112, display system controller 156, contact module 130, graphics module 132, text input module 134, and browser module 147, widget modules 149 are mini-applications that can be downloaded and used by a user (e.g., weather widget 149-1, stock quotes widget 149-2, calculator widget 149-3, alarm clock widget 149-4, and dictionary widget 149-5) or created by a user (e.g., user-created widget 149-6). In some embodiments, widgets include HTML (HyperText Markup Language) files, CSS (Cascading Style Sheets) files, and JavaScript files. In some embodiments, widgets include XML (Extensible Markup Language) files and JavaScript files (e.g., Yahoo! Widgets).

[0095] In conjunction with the RF circuitry 108, touch screen 112, display system controller 156, contact module 130, graphics module 132, text input module 134, and browser module 147, widget creation module 150 can be used by a user to create a widget (e.g., turn a user-specified portion of a web page into a widget).

[0096] In association with touch screen 112, display system controller 156, contact module 130, graphics module 132, and text input module 134, search module 151 contains executable instructions for searching for text, music, audio, images, video, and / or other files in memory 102 that match one or more search criteria (e.g., one or more user-specified search terms) in accordance with a user's instructions.

[0097] In conjunction with the touch screen 112, display controller 156, contact module 130, graphics module 132, and text input module 134, the notes module 153 contains executable instructions for creating and managing notes, to-do lists, and the like, in accordance with a user's instructions.

[0098] In conjunction with RF circuitry 108, touch screen 112, display system controller 156, contact module 130, graphics module 132, text input module 134, GPS module 135, and browser module 147, map module 154 can be used to receive, display, modify, and store maps and data associated with the maps (e.g., driving directions, data about businesses and other points of interest at or near a particular location, and other location-based data) in accordance with a user's instructions.

[0099] In conjunction with touchscreen 112, display system controller 156, contact module 130, graphics module 132, audio circuitry 110, speaker 111, RF circuitry 108, text input module 134, email client module 140, and browser module 147, online video module 155 contains instructions that enable a user to access, view, receive (e.g., by streaming and / or downloading), play (e.g., on the touchscreen or on an external display connected via external port 124), send emails with links to the online videos, and otherwise manage the online videos in one or more file formats, such as H.264. In some embodiments, instant messaging module 141 is used to send links to particular online videos rather than email client module 140. Further description of online video applications can be found in U.S. Provisional Patent Application No. 60 / 936,562, filed June 20, 2007, entitled "Portable Multifunction Device, Method, and Graphical User Interface for Playing Online Videos," and U.S. Patent Application No. 11 / 968,067, filed December 31, 2007, entitled "Portable Multifunction Device, Method, and Graphical User Interface for Playing Online Videos," the contents of which are incorporated herein by reference in their entireties.

[0100] Each of the above-identified modules and applications corresponds to a set of executable instructions that perform one or more of the functions described above and methods described in the present application (e.g., computer-implemented methods and other information processing methods described herein). These modules (i.e., sets of instructions) need not be implemented as separate software programs, procedures, or modules, and thus, in various embodiments, various subsets of these modules may be combined or otherwise reconfigured. For example, video player module 145 may be combined with music player module 146 into a single module (e.g., video and music player module 152 of FIG. 1B). In some embodiments, memory 102 may store a subset of the above-identified modules and data structures. Additionally, memory 102 may store additional modules and data structures not described above.

[0101] In some embodiments, device 100 is a device in which operation of a predefined set of functions on the device is performed exclusively via a touchscreen and / or touchpad. By using the touchscreen and / or touchpad as the primary input control device for operation of device 100, the number of physical input control devices (push buttons, dials, etc.) on device 100 can be reduced.

[0102] A predefined set of functions that may be performed exclusively via the touchscreen and / or touchpad includes navigation between user interfaces. In some embodiments, the touchpad, when touched by a user, navigates device 100 to a main, home, or root menu from any user interface that may be displayed on device 100. In such embodiments, the touchpad may be referred to as a "menu button." In some other embodiments, the menu button may be a physical push button or other physical input control device rather than a touchpad.

[0103] 1C is a block diagram illustrating example components for event processing, according to some embodiments. In some embodiments, memory 102 (in FIGS. 1A and 1B) or memory 370 (in FIG. 3) includes event sorter 170 (e.g., in operating system 126) and a respective application 136-1 (e.g., any of applications 137-151, 155, and 380-390 discussed above).

[0104] Event sorter 170 receives the event information and determines which application 136-1 and application view 191 of application 136-1 to deliver the event information to. Event sorter 170 includes an event monitor 171 and an event dispatcher module 174. In some embodiments, application 136-1 includes application internal state 192 that indicates the current application view(s) that are displayed on touch-sensitive display 112 when the application is active or running. In some embodiments, device / global internal state 157 is used by event sorter 170 to determine which application(s) are currently active, and application internal state 192 is used by event sorter 170 to determine which application view 191 to deliver the event information to.

[0105] In some embodiments, application internal state 192 includes additional information, such as one or more of resume information used when application 136-1 resumes execution, user interface state information indicating information is being displayed or ready to be displayed by application 136-1, a state queue to allow the user to return to a previous state or view of application 136-1, and a redo / undo queue of actions previously performed by the user.

[0106] Event monitor 171 receives event information from peripherals interface 118. The event information includes information about sub-events (e.g., a user's touch on touch-sensitive display 112 as part of a multi-touch gesture). Peripherals interface 118 transmits information it receives from I / O subsystem 106 or from sensors such as proximity sensor 166, accelerometer(s) 168, and / or microphone 113 (via audio circuitry 110). Information that peripherals interface 118 receives from I / O subsystem 106 includes information from touch-sensitive display 112 or a touch-sensitive surface.

[0107] In some embodiments, event monitor 171 sends a request to peripherals interface 118 at predetermined intervals. In response, peripherals interface 118 transmits event information. In other embodiments, peripherals interface 118 transmits event information only if there is a significant event (e.g., receiving an input above a predetermined noise threshold and / or for a predetermined duration).

[0108] In some embodiments, event sorter 170 also includes a hit view determination module 172 and / or an active event recognizer determination module 173.

[0109] Hit view determination module 172 provides software procedures for determining where in one or more views a sub-event occurred when touch-sensitive display 112 displays more than one view. A view consists of controls and other elements that a user can see on the display.

[0110] Another aspect of a user interface associated with an application is the set of views, sometimes referred to herein as application views or user interface windows, in which information is displayed and touch-based gestures are performed. The application view (of the respective application) in which a touch is detected may correspond to a programmatic level within the programmatic or view hierarchy of that application. For example, the lowest level view in which a touch is detected may be referred to as a hit view, and the set of events that are recognized as appropriate inputs may be determined, at least in part, based on the hit view of the initial touch that initiates a touch-based gesture.

[0111] Hit view determination module 172 receives information related to sub-events of a touch-based gesture. If an application has multiple views organized as a hierarchy, hit view determination module 172 identifies the hit view as the lowest view in the hierarchy that should process the sub-events. In most situations, the hit view is the lowest level view in which an initiating sub-event occurs (i.e., the first sub-event in a sequence of sub-events that form an event or potential event). Once a hit view is identified by the hit view determination module, the hit view typically receives all sub-events associated with the same touch or input source for which it was identified as the hit view.

[0112] Active event recognizer determination module 173 determines which views in the view hierarchy should receive a particular sequence of sub-events. In some embodiments, active event recognizer determination module 173 determines that only the hit view should receive a particular sequence of sub-events. In other embodiments, active event recognizer determination module 173 determines that all actively participating views should receive a particular sequence of sub-events by determining that all views that contain the physical location of the sub-events are actively participating views. In other embodiments, even if a touch sub-event is entirely confined to the area associated with a particular view, views higher in the hierarchy still remain as actively participating views.

[0113] Event dispatcher module 174 distributes event information to event recognizers (e.g., event recognizer 180). In embodiments that include active event recognizer determination module 173, event dispatcher module 174 delivers event information to event recognizers determined by active event recognizer determination module 173. In some embodiments, event dispatcher module 174 stores event information in an event queue, which is read by each event receiver module 182.

[0114] In some embodiments, operating system 126 includes event sorter 170. Alternatively, application 136-1 includes event sorter 170. In yet other embodiments, event sorter 170 is a stand-alone module or is part of another module stored in memory 102, such as contact / movement module 130.

[0115] In some embodiments, application 136-1 includes multiple event handlers 190 and one or more application views 191, each including instructions for handling touch events that occur within a respective view of the application's user interface. Each application view 191 of application 136-1 includes one or more event recognizers 180. Typically, each application view 191 includes multiple event recognizers 180. In other embodiments, one or more of the event recognizers 180 are part of a separate module, such as a user interface kit (not shown) or a higher level object from which application 136-1 inherits methods and other properties. In some embodiments, each event handler 190 includes one or more of data updater 176, object updater 177, GUI updater 178, and / or event data 179 received from event sorter 170. Event handler 190 can utilize or call data updater 176, object updater 177, or GUI updater 178 to update application internal state 192. Alternatively, one or more of the application views 191 include one or more respective event handlers 190. In some embodiments, one or more of a data updater 176, an object updater 177, and a GUI updater 178 are also included within each application view 191.

[0116] Each event recognizer 180 receives event information (e.g., event data 179) from event sorter 170 and identifies an event from the event information. Event recognizer 180 includes an event receiver 182 and an event comparator 184. In some embodiments, event recognizer 180 also includes at least a subset of metadata 183 and event delivery instructions 188 (which may include sub-event delivery instructions).

[0117] Event receiver 182 receives event information from event sorter 170. This event information includes information about a sub-event, such as a touch or a movement of a touch. Depending on the sub-event, the event information also includes additional information, such as the location of the sub-event. If the sub-event relates to a movement of a touch, the event information may also include the speed and direction of the sub-event. In some embodiments, an event includes a rotation of the device from one orientation to another (e.g., from portrait to landscape or vice versa), and the event information includes corresponding information about the current orientation of the device (also called the device's attitude).

[0118] The event comparator 184 compares the event information to predefined event or sub-event definitions and determines the event or sub-event or determines or updates the state of the event or sub-event based on the comparison. In some embodiments, the event comparator 184 includes an event definition 186. The event definition 186 includes definitions of events (e.g., predefined sequences of sub-events), such as, for example, event 1 (187-1), event 2 (187-2), etc. In some embodiments, sub-events in the event 187 include, for example, touch start, touch end, touch move, touch cancel, and multiple touches. In one example, the definition for event 1 (187-1) is a double tap on a display object. The double tap includes, for example, a first touch on a display object for a given stage (touch start), a first lift off (touch end) for a given stage, a second touch on a display object for a given stage (touch start), and a second lift off (touch end) for a given stage. In another example, the definition for event 2 (187-2) is dragging on a display object, which may include, for example, a touch (or contact) on a display object for a given step, a movement of the touch across the touch-sensitive display 112, and a lift-off of the touch (end of the touch). In some embodiments, the event also includes information regarding one or more associated event handlers 190.

[0119] In some embodiments, event definition 187 includes a definition of the event for each user interface object. In some embodiments, event comparator 184 performs a hit test to determine which user interface object is associated with the sub-event. For example, in an application view in which three user interface objects are displayed on touch-sensitive display 112, when a touch is detected on touch-sensitive display 112, event comparator 184 performs a hit test to determine which of the three user interface objects is associated with the touch (sub-event). If each display object is associated with a respective event handler 190, event comparator 184 uses the result of the hit test to determine which event handler 190 should be activated. For example, event comparator 184 selects the event handler associated with the sub-event and object that triggers the hit test.

[0120] In some embodiments, the definition for each event 187 also includes a delay action that delays delivery of the event information until it is determined whether the sequence of sub-events corresponds to the event type of the event recognizer.

[0121] If the respective event recognizer 180 determines that the sequence of sub-events does not match any of the events in the event definition 186, then the respective event recognizer 180 enters an event disabled state, an event failed state, or an event finished state and thereafter ignores subsequent sub-events for this touch-based gesture. In this situation, other event recognizers, if any, that remain active for the hit view continue to track and process sub-events for the ongoing touch-based gesture.

[0122] In some embodiments, each event recognizer 180 includes metadata 183 with configurable properties, flags, and / or lists that indicate how the event delivery system should perform sub-event delivery to actively participating event recognizers. In some embodiments, metadata 183 includes configurable properties, flags, and / or lists that indicate how event recognizers may interact with each other. In some embodiments, metadata 183 includes configurable properties, flags, and / or lists that indicate whether sub-events are delivered to various levels in a view or programmatic hierarchy.

[0123] In some embodiments, each event recognizer 180 activates an event handler 190 associated with an event when one or more particular sub-events of the event are recognized. In some embodiments, each event recognizer 180 delivers event information associated with the event to the event handler 190. Activating the event handler 190 is distinct from sending (and postponing) the sub-events to the respective hit view. In some embodiments, the event recognizer 180 throws a flag associated with the recognized event, and the event handler 190 associated with the flag catches the flag and performs a predefined process.

[0124] In some embodiments, the event delivery instructions 188 include sub-event delivery instructions that deliver event information about a sub-event without activating an event handler. Instead, the sub-event delivery instructions deliver the event information to an event handler associated with a set of sub-events or an actively interested view. The event handler associated with the set of sub-events or an actively interested view receives the event information and performs a predetermined process.

[0125] In some embodiments, data updater 176 creates and updates data used by application 136-1. For example, data updater 176 updates phone numbers used by contacts module 137 or stores video files used by video player module 145. In some embodiments, object updater 177 creates and updates objects used by application 136-1. For example, object updater 176 creates new user interface objects or updates the positions of user interface objects. GUI updater 178 updates the GUI. For example, GUI updater 178 prepares display information and sends the display information to graphics module 132 for display on the touch-sensitive display.

[0126] In some embodiments, event handler(s) 190 includes or has access to data updater 176, object updater 177, and GUI updater 178. In some embodiments, data updater 176, object updater 177, and GUI updater 178 are contained within a single module of the respective application 136-1 or application view 191. In other embodiments, they are contained within two or more software modules.

[0127] It should be understood that the foregoing discussion regarding event processing of user touches on a touch-sensitive display also applies to other forms of user input for operating multifunction device 100 using input devices, not all of which are initiated on the touch screen, and that, for example, mouse movements and mouse button presses can be utilized as inputs corresponding to sub-events that define the event to be recognized, either in conjunction with single or multiple presses or holds of a keyboard, user movements on a touchpad, taps, drags, scrolling, etc., pen stylus input, device movements, verbal cues, detected eye movements, biometric input, and / or any combination thereof.

[0128] FIG. 2 illustrates portable multifunction device 100 having touch screen 112, according to some embodiments. The touch screen can display one or more graphics within user interface (UI) 200. In this embodiment, as well as other embodiments described below, a user can select one or more of the graphics by contacting or touching the graphics, for example, using one or more fingers 202 (not drawn to scale) or one or more styluses 203 (not drawn to scale). In some embodiments, selection of one or more graphics occurs when a user breaks contact with one or more graphics. In some embodiments, this contact can include gestures such as one or more taps, one or more swipes (left to right, right to left, upwards, and / or downwards), and / or rolling of a finger (right to left, left to right, upwards, and / or downwards) in contact with device 100. In some embodiments, accidental contact with a graphic may not select that graphic. For example, a swipe gesture sweeping over an application icon may not select the corresponding application if the gesture corresponding to selection is a tap.

[0129] The device 100 may also include one or more physical buttons, such as a "home" or menu button 204. As mentioned above, the menu button 204 can be used to navigate to any application 136 in a set of applications capable of running on the device 100. Alternatively, in some embodiments, the menu button is implemented as a soft key in a GUI displayed on the touch screen 112.

[0130] In one embodiment, device 100 includes a touch screen 112, a menu button 204, a push button 206 for powering the device on / off and locking the device, volume control button(s) 208, a subscriber identity module (SIM) card slot 210, a headset jack 212, and an external port 124 for docking / charging. Push button 206 can be used to turn power on / off on the device by pressing the button and holding it down for a predefined time interval, lock the device by pressing the button and releasing it before the predefined time interval has elapsed, and / or unlock the device or initiate an unlocking process. In an alternative embodiment, device 100 can also accept verbal input via microphone 113 for activation or deactivation of some features.

[0131] FIG. 3 is a block diagram of an exemplary multifunction device with a display and a touch-sensitive surface, according to some embodiments. Device 300 need not be portable. In some embodiments, device 300 is a laptop computer, a desktop computer, a tablet computer, a multimedia player device, a navigation device, an educational device (such as a child's learning toy), a gaming system, or a control device (e.g., a home or commercial controller). Device 300 typically includes one or more processing units (CPUs) 310, one or more network or other communication interfaces 360, memory 370, and one or more communication buses 320 for interconnecting these components. Communication bus 320 may include circuitry (sometimes called a chipset) that interconnects and controls communication between system components. Device 300 includes input / output (I / O) interface 330 with display 340, typically a touchscreen display. I / O interface 330 may also include a keyboard and / or mouse (or other pointing device) 350, and a touchpad 355. Memory 370 may include high-speed random access memory, such as DRAM, SRAM, DDR RAM, or other random access solid-state memory devices, and may also include non-volatile memory, such as one or more magnetic disk storage devices, optical disk storage devices, flash memory devices, or other non-volatile solid-state storage devices. Memory 370 may optionally include one or more storage devices located remotely from CPU(s) 310. In some embodiments, memory 370 stores programs, modules, and data structures similar to, or a subset of, the programs, modules, and data structures stored in memory 102 of portable multifunction device 100 (FIG. 1). Additionally, memory 370 may store additional programs, modules, and data structures not present in memory 102 of portable multifunction device 100.For example, memory 370 of device 300 may store drawing module 380, presentation module 382, ​​word processing module 384, website creation module 386, disk authoring module 388, and / or spreadsheet module 390, while memory 102 of portable multifunction device 100 (FIG. 1) may not store these modules.

[0132] Each of the elements of FIG. 3 identified above can be stored in one or more of the memory devices mentioned above. Each of the modules identified above corresponds to an instruction set that performs the functions described above. The modules or programs (i.e., instruction sets) identified above need not be implemented as separate software programs, procedures, or modules, and thus, in various embodiments, various subsets of these modules can be combined or reconfigured in other manners. In some embodiments, memory 370 can store a subset of the modules and data structures identified above. Additionally, memory 370 can store additional modules and data structures not described above.

[0133] Attention is now directed to embodiments of a user interface (“UI”) that may be implemented on portable multifunction device 100.

[0134] 4A and 4B show exemplary user interfaces for a menu of applications on portable multifunction device 100, according to some embodiments. A similar user interface may be implemented on device 300. In some embodiments, user interface 400A includes the following elements, or a subset or superset thereof: ● signal strength indicator(s) 402 for wireless communication(s), such as cellular and Wi-Fi signals; ●Time 404, ●Bluetooth indicator 405, ● Battery status indicator 406, ● Tray 408 having icons for frequently used applications as follows, ○ Phone 138, which may include an indicator 414 of the number of missed calls or voicemail messages, ○ Email client 140, which may include an indicator 410 of the number of unread emails, ○ Browser 147, and ○ Music player 146, and ● Icons for other applications as follows, ○ IM 141, ○ Image management 144, ○ Camera 143, ○ Video player 145, ○ Weather 149-1, ○ Stock price 149-2, ○ Training support 142, ○ Calendar 148, ○ Calculator 149-3, ○ Alarm clock 149-4, ○ Dictionary 149-5, and ○ User-created widget 149-6.

[0135] In some embodiments, the user interface 400B includes the following elements, or subsets or supersets thereof. ● 402, 404, 405, 406, 141, 148, 144, 143, 149-3, 149-2, 149-1, 149-4, 410, 414, 138, 140, and 147 as described above, ● Map 154, ● Memo 153, ● Settings 412 that provide access to settings related to the device 100 and its various applications 136 as further described below, ● Video and music player module 152, also referred to as the iPod (registered trademark of Apple Inc.) module 152, and, • An online video module 155, also referred to as a YouTube (registered trademark of Google Inc.) module 155.

[0136] FIG. 4C illustrates an exemplary user interface on a device (e.g., device 300 of FIG. 3) that includes a touch-sensitive surface 451 (e.g., tablet or touchpad 355 of FIG. 3) that is separate from a display 450 (e.g., touchscreen display 112). While many of the following examples are described with reference to input on touchscreen display 112 (where the touch-sensitive surface and display are combined), in some embodiments, the device detects input on a touch-sensitive surface that is separate from the display, as shown in FIG. 4C. In some embodiments, this touch-sensitive surface (e.g., 451 in FIG. 4C) has a major axis (e.g., 452 in FIG. 4C) that corresponds to a major axis (e.g., 453 in FIG. 4C) on the display (e.g., 450). According to these embodiments, the device detects contact with touch-sensitive surface 451 (e.g., 460 and 462 in FIG. 4C) at locations that correspond to respective locations on the display (e.g., in FIG. 4C, 460 corresponds to 468 and 462 corresponds to 470). In this manner, when the touch-sensitive surface is separate from the display, user input (e.g., contacts 460 and 462 and their movement) detected by the device on the touch-sensitive surface (e.g., 451 in FIG. 4C ) is used by the device to manipulate a user interface on the display (e.g., 450 in FIG. 4C ) of the multifunction device. It should be understood that similar methods can be used with respect to the other user interfaces described herein.

[0137] Attention is now directed to embodiments of user interfaces (“UI”) and associated processes that may be implemented on a multifunction device with a display and a touch-sensitive surface, such as device 300 or portable multifunction device 100.

[0138] Figures 5A-5ZZ show example user interfaces for managing simultaneously open applications according to some embodiments. The user interfaces in these figures are used to illustrate the processes described below, including the processes in Figures 6A-6C, 7, 8A-8C, 9, 10, 11A, 11B, and 12A-12B.

[0139] As used herein and in the claims, the term "open application" refers to a software application for which state information is maintained (e.g., as part of device / global internal state 157 and / or application internal state 192). An open application is any one of the following types of applications: the active applications currently displayed on the display 112 (or whose corresponding application views are currently displayed on the display); background applications (or background processes) that are not currently displayed on the display 112, but where one or more application processes (e.g., instructions) related to a corresponding application are being processed (i.e., running) by one or more processors 120; suspended applications that are not currently running and that are stored in volatile memory (e.g., DRAM, SRAM, DDR, RAM, or other volatile random access semiconductor memory devices of memory 102); and ●An application that is not running, is in a dormant state, and is stored in non-volatile memory (e.g., one or more magnetic disk storage devices, optical disk storage devices, flash memory devices, or other non-volatile semiconductor storage devices in memory 102).

[0140] As used herein, the term "closed application" refers to a software application for which no state information is maintained (e.g., no state information for the closed application is stored in the memory of the device). Thus, closing an application includes stopping and / or removing the application process for that application, as well as removing state information for that application from the memory of the device. Generally, opening a second application during a first application does not close the first application. When a second application is displayed and the display of the first application is stopped, the first application, which was the active application when displayed, may become a background application, a suspended application, or a hibernated application, but the first application remains an open application while its state information is maintained by the device.

[0141] 5A-5D show exemplary user interfaces for selecting one of the simultaneously open applications to display the corresponding application view.

[0142] FIG. 5A illustrates an exemplary user interface ("Home Screen" 5001) displaying multiple application icons 5002 (e.g., 5002-21 through 5002-38) on touch screen 112 of a portable electronic device (e.g., portable multifunction device 100). In FIG. 5A, finger gesture 505 (e.g., a tap gesture) is detected on touch screen 112 at a location that corresponds to map application icon 5002-27. (Note that application icons 5002 on the home page displayed in FIG. 5A may or may not correspond to icons of open applications, whereas application icons 5002 in FIGS. 5C-5Z correspond to icons of open applications.)

[0143] In Figure 5B, in response to detecting the finger gesture, a map application is launched and a map application view 5004-1 is displayed on touch screen 112. In this example, the map application view includes a portion of a map and user interface objects, such as a search input field, a search icon, and a directions icon. Also in Figure 5B, an input 507 (e.g., a click or double click on home button 204) is detected.

[0144] 5C illustrates that in response to detecting input 507, a portion of map application view 5004-1 and application icon area 5006 are displayed simultaneously. In some embodiments, in response to detecting input 507, the device enters an application selection mode for selecting one of the simultaneously open applications, and a portion of map application view 5004-1 and application icon area 5006 are displayed simultaneously as part of the application selection mode. Application icon area 5006 includes an initial group of icons of open applications corresponding to at least some of the simultaneously open applications. In this example, the multifunction device has multiple applications open simultaneously, but the applications are not displayed all at once. Also in this example, application icon area 5006 includes application icons for a web browser (Safari), a music application (iPod), a financial application (stocks), and a multimedia store application (iTunes®).

[0145] In some embodiments, the simultaneous display of the map application view and the application icon area may include an animation. For example, the map application view can slide up such that a portion of the map application view moves and disappears from the display while a portion of the map application view remains on the display. This animation gives the visual appearance that the map application view and the application icon area are connected, since the application icon area can slide in simultaneously from the bottom of the screen.

[0146] In FIG. 5C, a finger gesture 509 (e.g., a tap gesture) is detected at a location on the touch screen 112 corresponding to the web browser application icon 5002-37.

[0147] FIG. 5D shows that in response to the detection of a finger gesture at a location corresponding to the web browser application icon, the web browser application view 5004-2 is displayed on the touch screen 112.

[0148] FIGS. 5E and 5F show the scrolling of the application icon area. In FIG. 5E, a contact 511 (e.g., a finger contact) is detected at a location 511-A on the touch screen 112 corresponding to the application icon area 5006. In FIGS. 5E and 5F, the contact 511 moves across the touch screen 112 to a different location (e.g., 511-B), and the application icons within the application icon area 5006 are scrolled in accordance with the movement of this contact 511.

[0149] 5G-5I illustrate an exemplary user interface for closing one of the simultaneously open applications. In FIG. 5G, while the device is in an application selection mode, finger gesture 513 (e.g., a press and hold gesture) is detected on touch screen 112 at a location corresponding to music application icon 5002-38. FIG. 5H illustrates that in response to detecting this finger gesture, the multifunction device enters an application exit mode. In the application exit mode, the music application icon is visually distinguished from the remaining application icons displayed on touch screen 112. In this example, the music application icon is animated (e.g., wobbles) and the remaining displayed application icons are dimmed. Additionally, an application exit indicia (e.g., an application exit icon such as "-" icon 5012-1) is displayed adjacent to the music application icon.

[0150] In FIG. 5H, finger gesture 515 (e.g., a tap gesture) is detected on touch screen 112 at a location corresponding to a visually distinct application icon (e.g., music icon 5002-38). FIG. 5I illustrates that in response to detecting this gesture, the visually distinct application icon (e.g., 5002-38) is removed from the application icon area. In response to this gesture, the multifunction device also closes the corresponding application (e.g., music application). After the visually distinct application icon (e.g., 5002-38) is removed, the multifunction device displays a new set of application icons without visual distinction (e.g., the application icons are no longer dimmed). This new set of application icons includes the application icons (e.g., 5002-37, 5002-26, and 5002-32) that were included in the initial set of application icons, except for the closed application icon. An additional application icon (e.g., 5002-35) is added to the new set of application icons. Also, after removing the visually distinct application icon, the multifunction device exits the application termination mode and returns to the application selection mode. In some embodiments, a finger gesture (e.g., a tap gesture) at a location corresponding to application termination icon 5012-1 removes the visually distinct application icon.

[0151] 5J and 5K show an example user interface including a music application view. In FIG. 5J, music application view 5004-3 (e.g., an iPod application view) is displayed. Music application view 5004-3 includes music controls (e.g., play / pause, fast forward / next track, and rewind / previous track, and / or a scrub bar). FIG. 5J also shows that input 517 (e.g., a single click or double click on home button 204) is detected.

[0152] 5K, a portion of music application view 5004-3 and application icon area 5006 are displayed simultaneously. Note that in this example, a music application icon (e.g., 5002-38) is not displayed within the application icon area while a music application view (e.g., 5004-3) is displayed, regardless of how recently the corresponding music application has been used or whether the corresponding music application is playing music.

[0153] FIG. 5L shows an exemplary user interface including music control icons in a default area (e.g., music control icons 5106 (e.g., pause, previous track, and next track icons) in application icon area 5006-1). Note that music control icons 5106 and application icons are displayed on separate rows in (expanded) default area 5006-1. In some embodiments, music control icons 5106 remain on the display while application icons are scrolled. In FIG. 5L, a left-to-right swipe gesture 537 is detected on touch screen 112.

[0154] FIG. 5M illustrates an exemplary user interface including settings icons in a default region. In some embodiments, these settings icons are displayed in response to detection of a left-to-right swipe gesture 537. In FIG. 5M, settings icons (e.g., rotation lock icon 5102-1, Wi-Fi icon 5102-2, and Bluetooth icon 5102-3) are displayed in application icon region 5006-1. Each setting icon, when activated (e.g., by a finger gesture), changes a corresponding setting (e.g., Wi-Fi icon 5102-2, when activated, turns Wi-Fi connection on or off). In some embodiments, one or more application icons can be displayed in application icon region 5006 simultaneously with the settings icons (not shown).

[0155] FIG. 5N illustrates a rotation of multifunction device 100. In response to detecting a rotation of multifunction device 100, application icons 5002 are rotated and reconfigured. In some embodiments, the number of application icons displayed in landscape mode (e.g., five, six, etc.) is different from the number of application icons displayed in portrait mode (e.g., three, four, etc.). In some embodiments, the application icons displayed in landscape mode include application icons displayed in portrait mode (e.g., after a device rotation from portrait mode to landscape mode as shown in FIG. 5L, the device may display at least a stock icon, a map icon, an iTunes icon, and a Game Center icon (not shown)). In other embodiments, the application icons displayed in landscape mode do not include application icons displayed in portrait mode (e.g., FIGS. 5M and 5N).

[0156] 5O illustrates an alternative user interface for selecting an open application. When the device enters application selection mode (e.g., by input 507 in FIG. 5B), instead of displaying application icons (e.g., as shown in FIG. 5C), images of the open applications (e.g., 5008-10, 5008-11, and 5008-13) can be displayed within default area 5006.

[0157] 5P-5Y show an exemplary user interface including user interface objects corresponding to open applications arranged in a grid, where these user interface objects are typically user selectable (or user activatable).

[0158] 5P and 5Q illustrate scrolling open application icons arranged in a grid. In FIG. 5P, open application icons 5002 (e.g., 5002-1 through 5002-9) are displayed in a 3×3 grid. In some embodiments, application icons 5002 may be the same as the application icons shown in FIGS. 5A through 5K (e.g., map application icon 5002-6 and map application icon 5002-27 may be the same). In other embodiments, application icons 5002 displayed in the grid may be different than application icons displayed elsewhere (e.g., in application icon area 5006 or on home screen 5001).

[0159] FIGURE 5P also shows that gesture 519 (e.g., a swipe gesture) is detected on touch screen 112. FIGURE 5Q shows that, in response to detecting gesture 519, open application icons 5002 displayed on touch screen 112 in FIGURE 5P are scrolled off the display and a different set of open application icons 5002 (e.g., 5002-10 through 5002-18) are displayed on touch screen 112.

[0160] 5R and 5T show an example user interface including images of open applications (or corresponding application views). In FIG. 5R, images 5008 (e.g., 5008-10 through 5008-18) of open applications or application views (e.g., live thumbnails) are displayed in a grid. In some embodiments, these images of open applications are updated when the corresponding application changes the corresponding application view (e.g., a browser displays new content on a web page, a movie player plays a movie, etc.).

[0161] In FIG. 5S, the icons of the open applications (e.g., 5002-36, 5002-35, and 5002-37) are displayed at least partially overlapping the images of the corresponding open applications (e.g., 5008-10, 5008-11, and 5008-12). In some embodiments, the icon 5002 of the open application is displayed adjacent to the image 5008 of the corresponding open application without overlapping. In some embodiments, the icon 5002 of the open application is displayed completely overlapping the image 5008 of the corresponding open application.

[0162] FIG. 5T shows that at least a subset of the images 5008 includes status indicators for the corresponding applications. In this example, the map application image 5008-6 includes a compass icon 5010-1 indicating that a particular mechanism (e.g., the GPS tracking function) is activated within the corresponding map application. In some embodiments, the icon (e.g., 5002) of the open application may include a status indicator.

[0163] FIGS. 5U and 5V show exemplary user interfaces including an application termination mode. In FIG. 5U, one of the images (e.g., 5008-12) is displayed with a swaying animation. Further, the image 5008-12 includes an application termination icon 5012-2. When the image 5008-12 is selected (e.g., by a finger tap gesture), the image 5008-12 is removed from the set of displayed images, closing the corresponding application (e.g., a web browser application). Thereafter, as shown in FIG. 5V, the remaining images (e.g., 5008-10, 5008-11, 5008-13 to 5008-18) and new images (e.g., 5008-19) are displayed. This application termination icon operates in a manner similar to the application termination mode as described above with reference to FIGS. 5G to 5I.

[0164] 5W and 5X illustrate an exemplary user interface including the simultaneous display of icons of open applications and a search icon 5004. In FIG. 5W, contact 521 is detected on touch screen 112 at a location corresponding to search icon 5104. FIG. 5X illustrates that in response to detecting contact 521 at a location corresponding to search icon 5104, keyboard 5014 is displayed on touch screen 112. In some embodiments, search icon 5104 and keyboard 5014 are displayed on touch screen 112 simultaneously with at least a subset of icons 5002 of open applications (e.g., application icons 5002 of FIG. 5X). In some embodiments, the simultaneously displayed application icons correspond to applications matching the search term(s). In some embodiments, search icon 5104 and keyboard 5014 are displayed simultaneously with a list of applications (e.g., applications matching the search term(s)).

[0165] 5Y illustrates rotation of multifunction device 100. In response to detecting this rotation of multifunction device 100, icons 5002 of open applications are rotated and reconfigured. In some embodiments, the number of application icons displayed in landscape mode (e.g., 2x4, 2x5, etc.) is different than the number of application icons displayed in portrait mode (e.g., 3x3, 4x3, 4x2, etc.).

[0166] FIG. 5Z or FIG. 5AA illustrates a gesture for displaying user-selected information. In FIG. 5Z, a gesture 523 (e.g., a swipe down gesture) is detected on the touch screen 112 from the top edge of the display. FIG. 5AA illustrates that in response to detecting the gesture 523, an exemplary user interface is displayed that includes the user-selected information. The user-selected information user interface includes, for example, a user-selectable icon (e.g., a done icon 5020), user-selected information (e.g., local weather 5016), and recent electronic notifications (e.g., new emails 5018-1 and upcoming events 5018-2). In some embodiments, a notification panel 5021 is displayed, and the user-selectable icon (e.g., a done icon 5020), user-selected information (e.g., local weather 5016), and recent electronic notifications (e.g., new emails 5018-1 and upcoming events 5018-2) are displayed within the notification panel 5021.

[0167] In some embodiments, the notification panel 5021 is displayed over a portion of the touchscreen 112. In some embodiments, the notification panel 5021 occupies less than the entirety of the touchscreen 112 (e.g., at least 80% or 90%, but less than 100%). In some embodiments, at least one edge of the notification panel 5021 touches an edge of the touchscreen 112 and / or appears docked to an edge of the touchscreen 112. In some embodiments, the notification panel 5021 does not touch an edge of the touchscreen 112 (e.g., portions of the home screen 5001 are visible on all sides of the notification panel 5021). In some embodiments, the home screen 5001 (e.g., the background image of the home screen and / or icons displayed within the home screen) are visible on portions of the touchscreen 112 not occupied by the notification panel 5021. In some embodiments, portions of the home screen 5001 that are visible when the notification panel 5021 is displayed are blurred, shaded, or otherwise visually obscured when the notification panel 5021 is displayed. In some embodiments, if the notification panel 5021 occupies less than the entire touch screen 112, the areas not occupied by the notification panel 5021 are blank (e.g., home screen 5001 graphics, icons, wallpaper, etc. are not displayed in those areas).

[0168] 5BB and 5CC illustrate an exemplary user interface including a three-dimensional stack of images of open applications. In FIG. 5BB, the images of the open applications are displayed in a three-dimensional stack that extends backwards on the display. For example, the image of the most recently used open application (e.g., 5008-10) is displayed in the foreground, the image of the second most recently used open application (e.g., 5008-11) is displayed directly behind the most recently used application (e.g., 5008-10), and so on. In some embodiments, a swipe gesture can scroll through the images, and a tap gesture can select the corresponding application. In FIG. 5BB, a gesture 533 (e.g., a tap gesture) is detected at a location corresponding to each image of an open application (e.g., a mail application). In response, a mail application view is displayed, as shown in FIG. 5CC.

[0169] 5CC-5HH show exemplary user interfaces for selecting one of the simultaneously open applications. FIG. 5CC shows a mail application view 5004-4 for an email application (e.g., Mail). In FIG. 5CC, mail application view 5004-4 includes email text, which includes a link 5020-1 to a web page. Gesture 525 (e.g., a tap gesture) is detected on touch screen 112 at a location corresponding to link 5020-1.

[0170] In Figure 5DD, in response to detecting gesture 525 at a location corresponding to link 5020-1, the corresponding web page is displayed in web browser application view 5004-2. Figure 5DD also shows that input 527 (e.g., a single click or double click on home button 204) is detected.

[0171] FIG. 5EE illustrates that in response to detecting input 527, a portion of home screen 5001, web browser application view 5008-12, and a portion of mail application view 5008-10 are displayed. FIG. 5EE also illustrates that a tap gesture 535 can be detected at a location corresponding to image 5008-10 of the mail application. In response to detecting tap gesture 535, mail application view 5004-4 (as shown in FIG. 5CC) will be displayed without simultaneously displaying any other application views. FIG. 5EE also illustrates that a swipe gesture 529 can be detected at a location on the touch screen corresponding to mail application view 5008-10, and in FIG. 5FF, in response to detecting swipe gesture 529, the application views (e.g., 5008-10 and 5008-12) are scrolled and a portion of map application view 5008-6 is displayed.

[0172] In FIG. 5FF, gesture 531 (eg, a tap gesture) is detected at a location corresponding to map application view 5008-6, and in response, the map application view is displayed, as shown in FIG. 5GG.

[0173] In FIG. 5FF, gesture 533 (eg, a tap gesture) is detected at a location corresponding to home screen 5001, and in response, home screen 5001 is displayed, as shown in FIG. 5HH.

[0174] 5II-5ZZ illustrate exemplary user interfaces for selecting one of the simultaneously open applications according to some embodiments. In FIGURES 5II-5ZZ, it is assumed that the simultaneously open applications include (in some embodiments, in order of recency of use) a web browser application, a mail application, a maps application, a phone application, a bookmarks application, a documents application, a contacts application, a racing application, a notes application, a Sudoku application, and a calendar application.

[0175] Figure 5II illustrates a swipe gesture that begins at location 539-1 on touch screen 112. In Figure 5II, location 539-1 corresponds to an edge of touch screen 112. Alternatively, swipe gesture 551 is detected on touch screen 112. As used herein, a swipe gesture that begins at an edge of touch screen 112 is referred to as an edge swipe (e.g., a swipe gesture that begins at location 539-1), and a swipe gesture that begins at a location other than on an edge of touch screen 112 is referred to as a non-edge swipe (e.g., gesture 541).

[0176] Figures 5JJ and 5KK show animations that are displayed in response to detection of a swipe gesture (Figure 5II) starting from location 539-1. However, in some embodiments, the animations shown in Figures 5JJ and 5KK are displayed in response to detection of a non-edge swipe gesture (e.g., gesture 541 in Figure 5II). In some other embodiments, a non-edge swipe gesture (e.g., horizontal gesture 541 in Figure 5II) initiates scrolling to the next page of a home screen or to an application launch pad (not shown) that includes one or more application icons not shown in Figure 5II.

[0177] In FIG. 5JJ, in response to detecting a swipe gesture (FIG. 5II) originating from location 539-1, the application icons shown in FIG. 5II are clustered. In some embodiments, as shown in FIG. 5JJ, the labels for the application icons are removed (e.g., the label "Weather" for the weather application icon is removed). The swipe gesture originating from location 539-1 includes moving a touch through location 539-2. At the same time, an image 5008-12 of an open application (e.g., a web browser application) is scrolled in on the touch screen 112. FIG. 5JJ also shows that an application icon 5002-37 corresponding to the web browser application is scrolled in on the touch screen 112.

[0178] FIGURE 5KK shows that the application icons shown in FIGURE 5II have been further reduced in size and that image 5008-12 of an open application (e.g., a web browser application) has been further scrolled onto touch screen 112. At the same time, a portion of image 5008-10 of an open application (e.g., an email application) has been scrolled onto touch screen 112. FIGURE 5KK also shows that application icon 5002-37 has been further scrolled onto touch screen 112 and that application icon 5002-36 corresponding to the email application has been simultaneously scrolled onto touch screen 112. In FIGURE 5KK, the display user interface includes search icon 5104, described above with respect to FIGURES 5W and 5X.

[0179] 5JJ and 5KK show the open application icons (e.g., 5002-37 and 5002-36) being scrolled in simultaneously with the images of the open applications (e.g., 5008-12 and 5008-10), in some embodiments the timing of displaying the open application icons is not simultaneous with displaying the images of the open applications. For example, in some embodiments the open application icons are displayed following the scrolling of the images of the open applications.

[0180] In FIG. 5KK, a tap gesture is detected on touch screen 112. In one embodiment, tap gesture 545 is detected on image 5008-10 of a mail application, and in response, application view 5004-4 for the mail application is displayed (e.g., FIG. 5CC). In another embodiment, tap gesture 547 is detected on icon 5002-36 for a mail application, and in response, application view 5004-4 for the mail application is displayed (e.g., FIG. 5CC). Alternatively, tap gesture 541 is detected on image 5008-12 of a web browser application, and in response, application view 5004-2 for the web browser application is displayed (e.g., FIG. 5LL). In yet another embodiment, tap gesture 543 is detected on icon 5002-37 for a web browser application, and in response, application view 5004-2 for the web browser application is displayed (e.g., FIG. 5LL).

[0181] FIGURE 5LL illustrates application view 5004-2 for a web browser application. In some embodiments, application view 5004-2 is displayed in response to detecting tap gesture 541 or tap gesture 543 in FIGURE 5KK. FIGURE 5LL also illustrates that a swipe gesture beginning at location 549-1 is detected on touch screen 112. Alternatively, swipe gesture 551 is detected on touch screen 112.

[0182] 5MM and 5NN illustrate animations that are displayed in response to detection of a swipe gesture (FIG. 5LL) beginning at location 549-1. However, in some embodiments, the animations illustrated in FIGS. 5MM and 5NN are displayed in response to detection of a non-edge swipe gesture (e.g., gesture 551 in FIG. 5LL). In some other embodiments, the non-edge swipe gesture (e.g., horizontal gesture 551 in FIG. 5LL) initiates an action supported by the displayed application (e.g., scrolling to the next page in the displayed application, not shown). Alternatively, if the displayed application does not support the detected non-edge swipe gesture, the non-edge swipe gesture is ignored.

[0183] In Figure 5MM, in response to detecting a swipe gesture (Figure 5LL) initiated from location 549-1, the application view 5004-2 shown in Figure 5LL is reduced in size. The swipe gesture initiated from location 549-1 includes moving a touch past location 549-2. At the same time, an image 5008-10 of an open application (e.g., an email application) is scrolled onto the touch screen 112. Figure 5MM also shows that an application icon 5002-36 corresponding to the email application is scrolled onto the touch screen 112.

[0184] FIG. 5NN shows that application view 5004-2 shown in FIG. 5MM is further reduced in size and image 5008-10 of an open application (e.g., a mail application) is further scrolled onto touch screen 112. Additionally, a portion of image 5008-6 of an open application icon (e.g., a maps application) is scrolled onto touch screen 112. FIG. 5NN also shows that application icon 5002-36 is further scrolled onto touch screen 112 and application icon 5002-27 corresponding to the maps application is simultaneously scrolled onto touch screen 112. Application icon 5002-37 corresponding to a web browser application is also displayed in FIG. 5NN. In some embodiments, one of the images of the open applications (e.g., 5008-12) corresponds to the most recently used application. In some embodiments, one of the images of the open applications (e.g., 5008-10) corresponds to the second most recently used application. In some embodiments, one of the images of the open applications (e.g., 5008-6) corresponds to the third most recently used application. In other words, in some embodiments, the display images of the open applications correspond to the most recently used applications.

[0185] 5MM and 5NN show that the icons of the open applications (e.g., 5002-36 and 5002-27) are scrolled simultaneously with the images of the open applications (e.g., 5008-10 and 5008-6), in some embodiments the timing of displaying the icons of the open applications is not simultaneous with displaying the images of the open applications. For example, in some embodiments the icons of the open applications are displayed subsequent to the scrolling of the images of the open applications.

[0186] In FIG. 5NN, a tap gesture is detected on touch screen 112. In one embodiment, tap gesture 553 is detected on image 5008-12 of a web browser application, and in response, application view 5004-2 for the web browser application is displayed (e.g., FIG. 5LL). In another embodiment, tap gesture 555 is detected on icon 5002-37 for the web browser application, and in response, application view 5004-2 for the web browser application is displayed (e.g., FIG. 5LL). Alternatively, tap gesture 557 is detected on image 5008-10 of a mail application, and in response, application view 5004-4 for the mail application is displayed (e.g., FIG. 5CC). In yet another embodiment, tap gesture 559 is detected on icon 5002-36 for a mail application, and in response, application view 5004-4 for the mail application is displayed (e.g., FIG. 5CC). In one embodiment, if a tap gesture 561 is detected on image 5008-6 or icon 5002-27 related to a map application, then in response, application view 5004-1 related to the map application is displayed (eg, FIG. 5B).

[0187] 5NN also shows that swipe gesture 565 is detected at a location corresponding to one of the images of the open applications (e.g., image 5008-6). In some embodiments, swipe gesture 565 is detected at a location corresponding to an area surrounding the display images of the open applications (e.g., the area between image 5008-10 and image 5008-6).

[0188] 5OO, in response to detecting swipe gesture 565 (FIG. 5NN), images 5008-12, 5008-10, and 5008-6 are scrolled such that image 5008-12 is scrolled off touch screen 112 and a portion of image 5008-11 is scrolled onto touch screen 112. Icons 5002-37, 5002-36, and 5002-27 are simultaneously scrolled such that icon 5002-37 is scrolled off touch screen 112 and icon 5002-35 is scrolled onto touch screen 112.

[0189] FIGURE 5PP illustrates an alternative user interface displayed in response to detection of swipe gesture 565. In FIGURE 5PP, in response to detection of swipe gesture 565 (FIGURE 5NN), images 5008-12, 5008-10, and 5008-6 are scrolled such that image 5008-12 is scrolled off of touch screen 112 and a portion of image 5008-11 is scrolled onto touch screen 112, as shown in FIGURE 5OO. In FIGURE 5PP, icons 5002-37, 5002-36, and 5002-27 are scrolled simultaneously such that icons 5002-35 and 5002-13 are scrolled onto touch screen 112 while icons 5002-37, 5002-36, and 5002-27 remain on touch screen 112.

[0190] As shown in FIGS. 5NN to 5PP above, in some embodiments, a swipe gesture 565 (FIG. 5NN) at a location corresponding to an area surrounding the display image of an open application starts scrolling the images of the open applications one by one. In some embodiments, as shown in FIG. 5OO, the swipe gesture 565 also starts scrolling the icons of the open applications one by one. In some embodiments, another swipe gesture detected at a location corresponding to an area surrounding the display image of an open application starts scrolling the images of the open applications one by one and starts scrolling the icons of the open applications one by one.

[0191] In some embodiments, as shown in FIG. 5PP, by increasing the number of icons of the open applications being displayed (e.g., from 3 to 5), the icons of the open applications being displayed include the icons of the open applications corresponding to the display images of the open applications (e.g., icons 5002-36, 5002-27, and 5002-35), the icons of the first open applications corresponding to the open applications that have been used more recently than the open applications corresponding to the display images of the open applications (e.g., icon 5002-37), and the icons of the second open applications corresponding to the open applications that have been used earlier than the open applications corresponding to the display images of the open applications (e.g., icon 5002-13). For example, in some embodiments, the icons of the open applications being displayed correspond to the five most recently used applications. In some embodiments, another swipe gesture detected at a location corresponding to an area surrounding the display image of an open application starts scrolling the images of the open applications one by one and starts scrolling the icons of the open applications one by one.

[0192] Figure 5QQ illustrates a user interface equivalent to that illustrated in Figure 5NN. In Figure 5QQ, a swipe gesture 567 is detected at a location corresponding to one of the open application icons (e.g., icon 5002-27). In some embodiments, the swipe gesture 567 is detected at a location corresponding to an area surrounding the displayed open application icons (e.g., the area between icon 5002-36 and icon 5002-27).

[0193] 5RR, in response to detecting swipe gesture 567 (FIG. 5QQ), icons 5002-37, 5002-36, and 5002-27 (FIG. 5QQ) are scrolled such that icons 5002-37, 5002-36, and 5002-27 are scrolled off touch screen 112 and icons 5002-35, 5002-13, and 5002-14 are scrolled onto touch screen 112. Images 5008-12, 5008-10, and 5008-6 (FIG. 5QQ) are simultaneously scrolled off touch screen 112 and images 5008-11, 5008-13, and 5008-14 are scrolled onto touch screen 112.

[0194] FIG. 5SS illustrates an alternative user interface displayed in response to detection of swipe gesture 567. In FIG. 5SS, in response to detection of swipe gesture 567 (FIG. 5QQ), images 5008-12, 5008-10, and 5008-6 (FIG. 5QQ) are scrolled off of touch screen 112 and images 5008-11, 5008-13, and 5008-14 are scrolled onto touch screen 112, as shown in FIG. 5RR. In FIG. 5SS, icons 5002-37, 5002-36, and 5002-27 (FIG. 5QQ) are scrolled such that icons 5002-37 and 5002-36 are scrolled off of touch screen 112 and icon 5002-27 remains on touch screen 112. Additionally, icons 5002-35, 5002-13, 5002-14, and 5002-15 are scrolled onto the touch screen 112.

[0195] As shown in Figures 5QQ-5SS above, a swipe gesture 567 (Figure 5QQ) detected at a location corresponding to an area surrounding the displayed open application icons initiates scrolling of the open application icons by groups of open application icons. In comparison, as described above, a swipe gesture (e.g., gesture 565 in Figure 5NN) detected at a location corresponding to an area surrounding the images of the open applications initiates scrolling of the open application icons by one icon at a time. Thus, by displaying a first number of images of open applications and a second number of icons of open applications different from the first number, a user can quickly navigate and move through the simultaneously open applications. For example, a user can quickly flip through the simultaneously open applications using a swipe gesture on the icons of the open applications. Alternatively, a user can flip through the simultaneously open applications by scrolling with a swipe gesture on the images of the open applications.

[0196] In some embodiments, as shown in Figures 5QQ, 5RR, the swipe gesture 567 (Figure 5QQ) initiates scrolling of the open application icons to replace all open application icons (e.g., three open application icons are removed and the next three open application icons are displayed based on their recency of use). In some embodiments, as shown in Figure 5SS, one of the open application icons (e.g., map application icon 5002-27 in Figure 5QQ) that was displayed prior to detection of the swipe gesture 567 remains on the touch screen 112, providing a clue as to the relationship of the open application icons shown in Figure 5QQ to the open application icons shown in Figure 5SS.

[0197] 5SS also shows that a swipe gesture 569 is detected at a location corresponding to one of the images of the open applications (e.g., image 5002-14). In some embodiments, the swipe gesture 569 is detected at a location corresponding to an area surrounding the displayed icons of the open applications.

[0198] In FIG. 5TT, in response to detecting swipe gesture 569 (FIG. 5SS), icons 5002-27, 5002-35, 5002-13, 5002-14, and 5002-15 (in FIG. 5SS) are scrolled such that icons 5002-27, 5002-35, 5002-13, and 5002-14 are scrolled off touch screen 112, while icon 5002-15 remains on touch screen 112. Additionally, icons 5002-16, 5002-17, 5002-18, and 5002-19 are scrolled onto touch screen 112. Additionally, images 5008-11, 5008-13, and 5008-14 are simultaneously scrolled off touch screen 112, and images 5008-16, 5008-17, and 5008-18 are scrolled onto touch screen 112. "Contacts" application icon 5002-15 shown in FIG. 5SS remains on touch screen 112 after gesture 569 (FIG. 5TT), providing a clue as to the relationship of the open application icons shown in FIG. 5SS to the open application icons shown in FIG. 5TT.

[0199] Alternatively, in response to detecting a swipe gesture 569 (FIG. 5SS), in some embodiments, icons 5002-27, 5002-35, 5002-13, 5002-14, and 5002-15 (FIG. 5SS) are scrolled such that icons 5002-27, 5002-35, and 5002-13 are scrolled off the touch screen 112, while icons 5002-14 and 5002-15 remain on the touch screen 112 (not shown). Additionally, icons 5002-16, 5002-17, and 5002-18 are scrolled onto the touch screen 112 (not shown). Images of open applications corresponding to application icons 5002-15, 5002-16, and 5002-17 are simultaneously displayed (not shown). By replacing images 5008-11, 5008-13, and 5008-14 (FIG. 5SS) with images corresponding to application icons 5002-15, 5002-16, and 5002-17, images of the open applications corresponding to open application icons 5002-35, 5002-13, 5002-14, 5002-15, 5002-16, and 5002-17 are displayed without omitting images for any of open application icons 5002-35, 5002-13, 5002-14, 5002-15, 5002-16, and 5002-17. In comparison, in the transition from FIG. 5SS to FIG. 5TT, the image of the open application corresponding to the open application icon 5002-15 is skipped (e.g., by scrolling away the image of the open application corresponding to the open application icon 5002-15) or is not displayed (e.g., displaying the image of the open application corresponding to the open application icon 5002-15 is abandoned).

[0200] Figure 5UU shows an alternative user interface that is displayed in response to the detection of a swipe gesture 569. In Figure 5UU, the icons 5002-27, 5002-35, 5002-13, 5002-14, and 5002-15 (from Figure 5SS) are scrolled off the touch screen 112, and the icons 5002-16, 5002-17, 5002-18, and 5002-19 are scrolled onto the touch screen 112. Further, the images 5008-11, 5008-13, and 5008-14 are simultaneously scrolled off the touch screen 112, and the images 5008-17, 5008-18, and 5008-19 are scrolled onto the touch screen 112. The icons of the open applications shown in Figure 5UU and the icons of the open applications shown in Figure 5SS do not have icons of the same open applications, enabling faster navigation for moving the icons of the open applications. In some embodiments, in the transition from Figure 5SS to Figure 5UU, the image of the open application corresponding to the icon 5002-15 of the open application is skipped (e.g., by scrolling and moving the image of the open application corresponding to the icon 5002-15 of the open application) or not displayed (e.g., the display of the image of the open application corresponding to the icon 5002-15 of the open application is abandoned).

[0201] Figure 5VV shows that a gesture 571 (e.g., a tap gesture) is detected at a location corresponding to the search icon 5104.

[0202] In Figure 5WW, a search input user interface including keyboard 5014 is displayed in response to gesture 571 (Figure 5VV). As shown in Figure 5WW, in some embodiments, keyboard 5014 is displayed over a user interface that is displayed prior to detection of gesture 571. Figure 5WW also shows that gesture 573 (e.g., a tap gesture) is detected on keyboard 5014 at a location corresponding to the letter "O."

[0203] 5XX illustrates an alternative user interface displayed in response to detection of gesture 571. In response to detection of gesture 571, the display images of the open applications (e.g., images 5008-17, 5008-18, and 5008-19) and the icons of the open applications (e.g., icons 5002-16, 5002-17, 5002-18, and 5002-19) are scrolled up. In some embodiments, the display images of the open applications and the icons of the open applications are scrolled up so that the display images of the open applications and the icons of the open applications do not overlap the search input user interface (e.g., keyboard 5014). Alternatively, the images of the open applications and the simultaneously open applications (e.g., images 5008 and icons 5002) have been positioned prior to detection of gesture 571 such that the display images of the open applications and the icons of the open applications do not overlap the search input user interface (e.g., keyboard 5014).

[0204] FIG. 5XX also shows that gesture 573 (eg, a tap gesture) is detected at a location on keyboard 5014 that corresponds to the letter "O."

[0205] FIG. 5YY illustrates that in response to detecting gesture 573 (FIG. 5WW or FIG. 5XX), search icon 5014 is updated to display the received input, i.e., the letter "O". Furthermore, in response to gesture 573, the previous open application display images and open application icons (e.g., images 5008-17, 5008-18, and 5008-19, and icons 5002-16, 5002-17, 5002-18, and 5002-19) are replaced with open application icons for at least some of the open applications that match the received input (e.g., open applications having application names that include the letter "O") and images for at least some of the open applications that match the received input. In FIG. 5YY, open application icons for application names "Phone", "Bookmark", "Document", "Contacts", and "Notes" are displayed. Furthermore, images for "Bookmark", "Document", and "Contact" are displayed. In Figure 5YY, these images correspond to a preset number (e.g., three) of open application icons displayed in the center. In some other embodiments, images of open applications may be displayed that correspond to a preset number of left-most open application icons (e.g., "Phone," "Bookmark," and "Document") or right-most open application icons (e.g., "Document," "Contacts," and "Notes").

[0206] FIG. 5YY also shows that gesture 575 (eg, a tap gesture) is detected at a location on keyboard 5014 that corresponds to the letter "N."

[0207] FIG. 5ZZ illustrates that in response to detecting gesture 575 (FIG. 5YY), search icon 5014 is updated to display the received input, i.e., the letters "ON." Moreover, in response to gesture 577, the previous open application display images and open application icons (e.g., images 5008-13, 5008-14, and 5008-15, and icons 5002-35, 5002-13, 5002-14, 5002-15, and 5002-17) are replaced with open application icons for at least some of the open applications that match the received input (e.g., open applications having application names that include "ON") and images for at least some of the open applications that match the received input. In FIG. 5ZZ, open application icons and images for application names "Phone" and "Contacts" are displayed.

[0208] Although the user interfaces shown in Figures 5KK and 5NN-5ZZ include a search icon 5104, one skilled in the art will understand that similar user interfaces that do not include a search icon 5104 can be used.

[0209] 5AAA-5HHH show exemplary user interfaces for displaying settings icons and other information.

[0210] FIG. 5AAA illustrates an example user interface (e.g., home screen 5001) displaying multiple application icons (e.g., corresponding to application icons 5002-21 through 5002-38 shown in FIG. 5A). FIG. 5AAA illustrates upward swipe gestures 570 and 571 that may be detected by device 100. Upward swipe gesture 570 is a non-edge swipe (e.g., initiated from contact “inside” touchscreen 112). Upward swipe gesture 571 is an edge swipe (e.g., initiated from contact with an edge of touchscreen 112 and / or both a touch-sensitive portion of device 100 and a non-touch-sensitive portion of device 100). Swipe gestures 570 and 571 may cause one or more settings icons (and / or other information) to be displayed on device 100. In some embodiments, only one of swipe gesture 570 or 571 can cause one or more settings icons to be displayed. In some embodiments, either swipe gesture 570 or swipe gesture 571 can cause one or more settings icons to be displayed.

[0211] FIG. 5BBB illustrates an exemplary user interface that displays one or more settings icons in response to detecting swipe gesture 570 or swipe gesture 571. As shown in FIG. 5BBB, a settings panel 5024 is displayed. In some embodiments, the settings panel 5024 is displayed over a portion of the touch screen 112. In some embodiments, the settings panel 5024 occupies less than the entirety of the touch screen 112 (e.g., at least 80% or 90%, but less than 100%). In some embodiments, at least one edge of the settings panel 5024 touches an edge of the touch screen 112 and / or appears docked to an edge of the touch screen 112. In some embodiments, the settings panel 5024 does not touch an edge of the touch screen 112 (e.g., portions of the home screen 5001 are visible on all sides of the settings panel 5024). In some embodiments, the home screen 5001 (e.g., the home screen's background image and / or icons displayed within the home screen) is visible in portions of the touch screen 112 not occupied by the settings panel 5024. In some embodiments, portions of the home screen 5001 that are visible when the settings panel 5024 is displayed are obscured, shaded, or otherwise visually obscured when the settings panel 5024 is displayed. In some embodiments, if the settings panel 5024 occupies less than the entire touch screen 112, the areas not occupied by the settings panel 5024 are blank (e.g., the home screen 5001's graphics, icons, wallpaper, etc. are not displayed in those areas).

[0212] In some embodiments, the settings panel 5024 appears substantially similar to the notification panel 5021. For example, the settings panel 5024 and the notification panel may use the same or substantially similar background graphics and / or colors. In some embodiments, the settings panel 5024 appears substantially different from the notification panel 5021. For example, the settings panel 5024 and the notification panel may use different background graphics and / or colors.

[0213] In FIG. 5BBB, setting icons (e.g., setting icons 5022-1 to 5022-5) are displayed within the setting panel 5024. The setting icons include, for example, a Wi-Fi icon 5022-1, a Bluetooth icon 5022-2, an in-flight mode icon 5022-3, a bedtime mode icon 5022-4, and a rotation lock icon 5022-5. In some embodiments, the bedtime mode icon 5022-4 corresponds to a setting in which notifications (e.g., incoming call sounds, audible email notifications, etc.) are turned off while the "bedtime mode" setting is selected or "on". In some embodiments, other setting icons are displayed. In some embodiments, the specific settings (and thus the setting icons) displayed within the setting panel are determined by the user. Thus, the user can select more settings, fewer settings, or different settings to be displayed within the setting panel 5024. For example, a setting icon (not shown) corresponding to a "3G" setting can be replaced with the rotation lock icon 5022-5.

[0214] In some embodiments, the setting icons 5022-1 to 5022-5 are "on / off" switches (e.g., they represent settings that can have one of two different states). In some embodiments, the appearance of the setting icons 5022-1 to 5022-5 changes based on the state of the underlying setting. For example, the setting icons 5022-1 to 5022-5 can have a first color, shape, or other characteristic when the underlying setting is "off", and can have a second color, shape, or other characteristic different from the first when the underlying setting is "on".

[0215] 5BBB, also displayed within the settings panel 5024 are a brightness adjustment control 5026 (e.g., a slider bar), audio control icons 5028 (e.g., play / pause, fast forward, rewind, stop, volume control, and / or track control), and user-specified application icons 5030-1 through 5030-4. As shown in FIG. 5BBB, the settings icons 5022-1 through 5022-5 are displayed within a first portion of the settings panel 5024, the brightness adjustment control 5026 is displayed within a second portion of the settings panel 5024 below the first portion, the audio control icon 5028 is displayed within a third portion of the settings panel 5024 below the second portion, and the user-specified application icons 5030-1 through 5030-4 are displayed within a fourth portion of the settings panel 5024 below the third portion. Some embodiments display these items in a different arrangement.

[0216] FIGURE 5CCC illustrates another exemplary user interface that displays one or more settings icons in response to detecting swipe gesture 570 or swipe gesture 571. In FIGURE 5CCC, settings icons 5022-1 through 5022-5, brightness adjustment control 5026, audio control icon 5028, and user-specified application icons 5030-1 through 5030-4 are displayed on touch screen 112 without a settings panel.

[0217] FIG. 5DDD illustrates an exemplary user interface that displays one or more settings icons in response to detecting swipe gesture 570 or swipe gesture 571 (e.g., in FIG. 5AAA). As shown in FIG. 5DDD, a settings panel 5024 is displayed. In some embodiments, the settings panel 5024 is displayed over a portion of the touch screen 112. In some embodiments, the settings panel 5024 occupies less than the entirety of the touch screen 112 (e.g., at least 80% or 90%, but less than 100%). In some embodiments, at least one edge of the settings panel 5024 touches an edge of the touch screen 112 and / or appears docked to an edge of the touch screen 112. In some embodiments, the settings panel 5024 does not touch an edge of the touch screen 112 (e.g., portions of the home screen 5001 are visible on all sides of the settings panel 5024). In some embodiments, the home screen 5001 (e.g., the home screen's background image and / or icons displayed within the home screen) is visible in portions of the touch screen 112 not occupied by the settings panel 5024. In some embodiments, portions of the home screen 5001 that are visible when the settings panel 5024 is displayed are obscured, shaded, or otherwise visually obscured when the settings panel 5024 is displayed. In some embodiments, if the settings panel 5024 occupies less than the entire touch screen 112, the areas not occupied by the settings panel 5024 are blank (e.g., the home screen 5001's graphics, icons, wallpaper, etc. are not displayed in those areas).

[0218] In some embodiments, the settings panel 5024 appears substantially similar to the notification panel 5021 shown in FIG. 5AA. For example, the settings panel 5024 and the notification panel may use the same or substantially similar background graphics and / or colors. In some embodiments, the settings panel 5024 appears substantially different from the notification panel 5021. For example, the settings panel 5024 and the notification panel may use different background graphics and / or colors.

[0219] In FIG. 5DDD, setting icons (e.g., setting icons 5022-1 through 5022-5) are displayed in settings panel 5024. The setting icons include, for example, Wi-Fi icon 5022-1, Bluetooth icon 5022-2, airplane mode icon 5022-3, Do Not Disturb icon 5022-4, and rotation lock icon 5022-5. In some embodiments, Do Not Disturb icon 5022-4 corresponds to a setting where notifications (e.g., ringtones, audible email notifications, etc.) are turned off while the "Do Not Disturb" setting is selected or "on". In some embodiments, other setting icons are displayed. In some embodiments, the specific settings (and therefore setting icons) displayed in the settings panel are determined by the user. Thus, the user can select more settings, fewer settings, or different settings for display in settings panel 5024. For example, a setting icon (not shown) corresponding to a "3G" setting can be replaced with rotation lock icon 5022-5.

[0220] In some embodiments, settings icons 5022-1-5022-5 are "on / off" switches (e.g., they represent settings that can have one of two different states). In some embodiments, settings icons 5022-1-5022-5 change appearance based on the state of the underlying setting. For example, settings icons 5022-1-5022-5 may have a first color, shape, or other characteristic when the underlying setting is "off" and may have a second color, shape, or other characteristic, different from the first, when the underlying setting is "on."

[0221] In FIG. 5DDD, also displayed within the settings panel 5024 are a brightness adjustment control 5026 (e.g., a slider bar), audio control icons 5028 (e.g., play / pause, fast forward, rewind, stop, volume control, and / or track control), a shared status indicator icon 5032 and a remote media control icon 5034, as well as user-specified application icons 5030-1 to 5030-4. 5DDD, settings icons 5022-1 through 5022-5 are displayed in a first portion of a settings panel 5024, a brightness adjustment control 5026 is displayed in a second portion of the settings panel 5024 below the first portion, an audio control icon 5028 is displayed in a third portion of the settings panel 5024 below the second portion, a shared status indicator icon 5032 and a remote media control icon 5034 are displayed in a fourth portion of the settings panel 5024 below the third portion, and user-specified application icons 5030-1 through 5030-4 are displayed in a fifth portion of the settings panel 5024 below the fourth portion. Some embodiments display these items in another arrangement.

[0222] In some embodiments, the sharing status indicator icon 5032, when activated, causes the device 100 to display a discoverability interface for changing the discoverability (or availability) of the device 100 with respect to the sharing feature. In some embodiments, the sharing feature allows the device 100 to share media content with one or more devices different from the device 100. Further details regarding the sharing feature are described in U.S. Provisional Application No. ____, filed June 9, 2013, and entitled "Device, Method, and Graphical User Interface for Sharing Content From a Respective Application" (Attorney Docket No. P20003USP1 / 063266-5898-PR). In some embodiments, the remote media control icon 5034, when activated, causes the device 100 to display an interface for adjusting media player settings with respect to one or more remote devices different from the device 100.

[0223] FIGURE 5EEE illustrates another exemplary user interface that displays one or more settings icons in response to detecting swipe gesture 570 or swipe gesture 571. In FIGURE 5EEE, settings icons 5022-1 through 5022-5, brightness adjustment control 5026, audio control icon 5028, shared status indicator icon 5032 and remote media control icon 5034, and user-specified application icons 5030-1 through 5030-4 are displayed on touch screen 112 without a settings panel. FIGURE 5EEE also illustrates device 100 detecting gesture 580 (e.g., a tap gesture) at a location corresponding to shared status indicator icon 5032.

[0224] Figure 5FFF shows device 100 displaying a discoverability interface 5036 on touch screen 112 in response to detecting gesture 580 in Figure 5EEE. In Figure 5FFF, discoverability interface 5036 includes one or more options for adjusting the discoverability (or availability) of device 100 with respect to sharing functions. In FIG. 5FFF, the discoverability interface 5036 includes an "off" affordance 5038-1 that, when activated, causes the device 100 to disable the sharing functionality; a "contacts only" affordance 5038-2 that, when activated, causes the device 100 to be available for sharing only with contacts within the "sharing scope" of the device 100 (e.g., contacts in an address book associated with the user of the device 100 or a specified list of contacts associated with the sharing functionality); an "everyone" affordance 5038-3 that, when activated, causes the device 100 to be available for sharing (e.g., advertising the availability of the device 100) with everyone within the "sharing scope" of the device 100 (e.g., all users who have compatible sharing functionality enabled on their respective devices); and a "cancel" affordance 5038-4 that, when activated, causes the device 100 to close the discoverability interface 5036. In some embodiments, the "sharing scope" is limited to the current WiFi capabilities of device 100, or to short-range wireless communication, or to a wireless protocol specified by the sharing feature. Figure 5FFF also shows device 100 detecting gesture 581 (e.g., a tap gesture) at a location corresponding to "everyone" affordance 5038-3.

[0225] Figure 5GGG shows device 100 displaying an example user interface displaying one or more settings icons. In Figure 5GGG, share state indicator icon 5032 displays text indicating that the share functionality is currently in the "everyone" share mode in response to selection of "everyone" affordance 5038-3 in Figure 5FFF. Figure 5GGG also shows device 100 detecting gesture 582 (e.g., a tap gesture) at a location corresponding to remote media control icon 5034.

[0226] FIGURE 5HHH shows device 100 displaying a remote media control interface 5040 on touch screen 112 in response to detecting gesture 582 in FIGURE 5GGG. In FIGURE 5HHH, remote media control interface 5040 includes controls (e.g., an on / off switch and a volume slider) for selecting one or more of a plurality of remote devices 5042-1, 5042-2, 5042-3, 5042-4 for playing media content. In FIGURE 5HHH, remote media control interface 5040 also includes main controls 5044 (e.g., play / pause, fast forward, rewind, stop, volume control, and / or track control) for controlling the media content played on the selected one or more remote devices.

[0227] 6A-6C are flow diagrams illustrating a method 600 for selecting one of simultaneously open applications according to some embodiments. Method 600 is performed on a multifunction device (e.g., device 300 of FIG. 3 or portable multifunction device 100 of FIG. 1) that includes a display and a touch-sensitive surface. In some embodiments, the display is a touchscreen display and the touch-sensitive surface is on the display. In some embodiments, the display is separate from the touch-sensitive surface. Some operations in method 600 may be combined and / or the order of some operations may be changed.

[0228] As described below, the method 600 provides an intuitive way to select one of the simultaneously open applications. This method creates a more efficient human-machine interface by reducing the cognitive burden on the user when selecting one of the simultaneously open applications. For battery-operated computing devices, allowing a user to select one of the simultaneously open applications more quickly and efficiently conserves power and increases the time between battery charges.

[0229] The device displays (602) on the touch-sensitive display a first application view (e.g., map application view 5004-1 in FIG. 5B) corresponding to a first application in a plurality of simultaneously open applications (e.g., the device may have a plurality of open applications, such as Safari, iPod, stocks, and iTunes). The first application view is displayed without simultaneously displaying an application view for any other application in the plurality of simultaneously open applications (e.g., in FIG. 5B, map application view 5004-1 is displayed without simultaneously displaying an application view for any other application). In other words, in a normal operating mode, only a single application view corresponding to one of the plurality of simultaneously open applications is displayed. The other open applications (e.g., the other open applications, such as Safari, iPod, stocks, and iTunes) may be running in the background or in a suspended or paused operating state.

[0230] The device detects (604) a first input (e.g., input 507 in FIG. 5B). In some embodiments, the first input is a single tap on the home button (e.g., 204). In some embodiments, the first input is a double tap on the home button (e.g., 204). In some embodiments, the first input is a gesture on a touch-sensitive display, such as a three-finger pinch gesture or a swipe gesture.

[0231] In response to detecting this first input (606), the device performs the following actions: The device enters an application view selection mode (608) to select one of the simultaneously open applications for display in a corresponding application view. The device displays (610) an initial group of open application icons (e.g., application icons 5002 in application icon region 5006 in FIG. 5C ) corresponding to at least some of the multiple simultaneously open applications in a first predefined region (e.g., a strip in a predefined location on the touch-sensitive display). In some embodiments, the device maintains the display of this first predefined region without further input (e.g., a press and hold on home button 204 or on touch screen 112) until the application view selection mode is exited. In some embodiments, this region displays the open application icons as a scrollable strip having a linear array of the open application icons (e.g., application icon region 5006 is scrollable as shown in FIGS. 5E and 5F ). The device simultaneously displays (612) at least a portion of the first application view adjacent to this first default region (e.g., in FIG. 5C , at least a portion of the map application view 5004-1 and the application icon region 5006 are displayed simultaneously). This simultaneous display provides several benefits. For example, it provides context by maintaining the first application view while selecting an icon of an open application. Furthermore, it is easy to return to the first application (and stop displaying the application icon region), for example, by tapping on the first application view.

[0232] In some embodiments, at least a subset of the icons of the open applications include a status indicia for the corresponding application (624 in FIG. 6B). For example, an audio application icon includes a "recording" indicia (e.g., a red circle) displayed on or proximate to the audio application icon. In another example, a map application icon includes a "GPS active" indicia (e.g., an image of a compass) displayed on or proximate to the map application icon (see, e.g., a similar example in FIG. 5S, where image 5008-6 includes compass icon 5010-1).

[0233] In some embodiments, the initial group of open application icons includes an audio application icon if a corresponding audio application is in use (626). For example, if a music player application is playing music, the initial group of open application icons always includes a corresponding music player application icon (e.g., iPod application icon 5002-38 in FIG. 5C). Displaying the audio application icon as part of the initial group of open application icons facilitates quick selection and display of the corresponding audio application. For example, there is no need to scroll through the open application icons in a default area to display the audio application icon.

[0234] In some embodiments, the open application icons are displayed (628) in a particular order within the first predefined area, where the order is determined according to a usage history for the corresponding open applications. For example, assume that a multimedia store application, iTunes, is used first, then a financial application, Stocks, then a music application, iPod, then a web browser application, Safari, and finally a map application is the last application used before entering the application view selection mode. In this case, in some embodiments, the initial group of open application icons is iTunes, Stocks, iPod, and Safari. Furthermore, the order of the open application icons is Safari, iPod, Stocks, and iTunes (as shown in FIG. 5C). In some embodiments, selecting an open application icon that corresponds to one of the initial group of open applications does not change the order in which the initial group of open application icons is displayed. For example, selecting the iTunes application icon in FIG. 5C and re-entering the application view selection mode does not change the order of the open application icons: Safari, iPod, Stocks, and iTunes. This has the benefit of avoiding the need for the user to learn a new arrangement of the open application icons by providing a previously presented order of the open application icons (which is familiar to the user), which reduces the cognitive burden on the user and creates a more efficient human-machine interface.

[0235] In some embodiments, the device displays a page, list, or array of scrollable icons (e.g., application launcher icons and / or folder icons) in a default area of ​​the display (e.g., in FIG. 5A, application icons 5002-21 through 5002-34 are displayed on a page of scrollable icons). The device simultaneously displays pinned icons (e.g., frequently used or favorite application launcher icons and / or folder icons selected by the user) in another different default area of ​​the display (e.g., the dock area) (e.g., application icons 5002-35 through 5002-38 are pinned icons in the dock area). In some embodiments, the device can also enter an application view selection mode from this display in response to detecting an input (e.g., in response to detecting a double tap on the home button). In some embodiments, in response to detecting this input, the pinned icons in the dock area are replaced by an initial group of icons of open applications corresponding to at least a portion of the multiple simultaneously open applications. In other words, the dock area in the normal operating mode is replaced by the first default area having the icons of the open applications in the application view selection mode. In some embodiments, in response to detecting this input, the application icons on the scrollable page and dock area (e.g., application icons 5002-21 through 5002-38) slide up to simultaneously display at least a subset of the application icons and the default area containing the icons of the open applications in a manner similar to the simultaneous display of application view 5004-1 and default area 5006 in FIG. 5C.

[0236] In some embodiments, the device displays (630) a settings icon (e.g., settings icon 5102 in FIG. 5M) in the first predefined area while in the application view selection mode. Exemplary settings icons include a rotation lock icon; communication mode icons, such as an airplane mode icon, a Wi-Fi icon, and / or a Bluetooth icon; and audio controls, such as play / pause, fast forward, rewind, stop, volume control, and / or track control.

[0237] In some embodiments, if a settings icon for an open application is displayed in the first default region, the icon of the corresponding open application is not displayed in the first default region (632). For example, if a music player control is displayed in the first default region, the corresponding music player application icon is not displayed (e.g., in FIG. 5L, if music player control 5106 is displayed in application icon region 5006-1, the corresponding music player application icon (e.g., iPod) is not displayed in application icon region 5006-1).

[0238] In some embodiments, the device simultaneously displays (634) an audio control icon and icons of open applications other than the corresponding audio application icon, in their respective rows, in the first default region (e.g., audio control icon 5106 and other application icons, in their respective rows, in application icon region 5006-1 in FIG. 5L).

[0239] In some embodiments, at least a portion of the first application view is displayed 636 within a second predefined area that is larger than and adjacent to the first predefined area. For example, in FIG. 5C, the area in which a portion of the map application view 5004-1 is displayed is larger than and adjacent to the application icon area 5006.

[0240] In some embodiments, the first set of open application icons includes an initial group of open application icons, and the first set of open application icons is displayed in a first orientation. The device detects a rotation of the multifunction device from the first orientation to a second orientation and displays a second set of open application icons in the second orientation (e.g., FIG. 5N). The initial group of open application icons and the second set of open application icons have a different number of open application icons (e.g., in FIG. 5N, the second set of open application icons has six open application icons, while the initial group of applications in FIG. 5C has four open application icons). In some embodiments, displaying the second set of open application icons in the second orientation includes ceasing to display the first set of open application icons in the first orientation. In some embodiments, displaying the second set of open application icons in the second orientation includes reconfiguring the first set of open application icons in the first orientation.

[0241] The device detects (614 in FIG. 6A) a gesture (e.g., a tap gesture) on an icon of each open application within the first predefined region (e.g., gesture 509 on application icon 5002-37 in FIG. 5C). In response to detecting (616) the gesture on each open application icon, the device performs the following actions: The device displays (618) on the touch-sensitive display a respective application view (e.g., browser application view 5004-2 in FIG. 5D) for a corresponding application in the multiple simultaneously open applications. Each application view is displayed without simultaneously displaying application views for any other applications in the multiple simultaneously open applications (e.g., in FIG. 5D browser application view 5004-2 is displayed without simultaneously displaying any other application views). The device stops displaying 620 the icons of the open applications in the first default region (e.g., application icon region 5006 and application icon 5002 within application icon region 5006 are no longer displayed in FIG. 5D ), and the device exits 622 the application view selection mode (and enters the normal operating mode for the respective application).

[0242] In some embodiments, while in the application view selection mode, the device performs the following actions (640 in FIG. 6C): The device detects a gesture (e.g., a tap gesture) on at least a portion of the first application view. In response to detecting the gesture on that portion of the first application view, the device displays the first application view on the touch-sensitive display without simultaneously displaying an application view for any other application in the multiple simultaneously open applications and exits the application view selection mode (and enters a normal operation mode for the first application). For example, in FIG. 5C, when a gesture is detected on the touch screen 112 at a location corresponding to the map application view 5004-1, the device displays the map application view 5004-1 without simultaneously displaying the application icon area 5006 or an application view for any other application, as shown in FIG. 5B.

[0243] In some embodiments, in response to detecting this first input, the device slides the first application view (638 in FIG. 6C ) such that a portion of the first application view moves off the display and a portion of the first application view remains on the display (e.g., in FIG. 5C , a portion of the map application view 5004-1 moves off the display and a portion of the map application view 5004-1 remains on the display).

[0244] In some embodiments, while in the application view selection mode, the device detects (642) a scrolling gesture (e.g., a swipe gesture) within a first predefined region, and in response to detecting the scrolling gesture, causes icons of multiple simultaneously open applications within the first predefined region to scroll in accordance with the scrolling gesture (e.g., FIGS. 5E and 5F).

[0245] In some embodiments, while displaying an initial group of icons of open applications in the application view selection mode, the device performs one of the following actions (646): When a first scrolling gesture in a first direction (e.g., a right-to-left swipe gesture) is detected in the first predefined area, the device scrolls to display icons of other open applications among the icons of the multiple simultaneously open applications in the first predefined area (e.g., FIGS. 5E and 5F); When a second scrolling gesture in a second direction opposite to the first direction (e.g., a left-to-right swipe gesture) is detected in the first predefined area, the device scrolls to display a settings icon in the first predefined area (e.g., FIGS. 5L, 5M). In some embodiments, when a second scrolling gesture in a second direction different from the first direction (e.g., a top-to-bottom swipe gesture, a bottom-to-top swipe gesture, or a diagonal swipe gesture) is detected within the first predefined region, the device scrolls to display the settings icon within the first predefined region.

[0246] In some embodiments, while in the application view selection mode, the device detects (646) a swipe down gesture (e.g., gesture 523 in FIG. 5Z) starting from the top edge of the display. In response to detecting this swipe down gesture, the device displays a user-selected icon (e.g., done icon 5020 in FIG. 5AA) and displays at least one of a list of recent electronic notifications (e.g., new emails 5018-1 and / or upcoming events 5018-2) and user-selected information (e.g., local weather information 5016, stock prices (not shown), news headlines (not shown), etc.).

[0247] In some embodiments, during the application view selection mode, the device performs the following actions: The device detects (648) a gesture in the first predefined area at a location corresponding to an open application's icon (e.g., a press and hold gesture 513 on the open application's icon 5002-38 in FIG. 5G). In response to detecting the gesture at the location corresponding to the open application's icon, the device displays an application termination icon (e.g., an "X" icon or a "-" icon 5012-1 on or proximate to the open application's icon) for closing the corresponding application. The device detects a gesture at a location corresponding to the application termination icon (e.g., a tap gesture on the application termination icon 5012-1). In response to detecting the gesture at the location corresponding to the application termination icon, the device closes the corresponding application. In other words, the device performs an exit / termination of the corresponding application, causing the corresponding application to cease being an open application. Alternatively, a tap gesture on an icon of an open application, including an application exit icon (eg, gesture 515 on open application icon 5002-38 in FIG. 5H), has the same effect.

[0248] In some embodiments, in response to detecting a gesture at a location corresponding to the open application's icon, the device wobbles the open application's icon at that location (650). In some embodiments, in response to detecting a gesture at a location corresponding to the open application's icon, the device visually distinguishes the open application's icon by dimming the icons of other open applications (e.g., FIG. 5H).

[0249] As described above, method 600 is used to select a single application for display from among multiple simultaneously open applications. A similar method can also be used to select a single view for display from among multiple simultaneously open views within a single application (e.g., select a web page for display from among multiple simultaneously open web pages in a browser application).

[0250] It should be noted that the details of the processes described above with respect to method 600 (e.g., FIGS. 6A, 6B, and 5A-5HH) are also applicable in an analogous manner to the methods described below. For example, methods 700, 800, 900, 1000, and 1100 may include one or more of the characteristics of the various methods described above with reference to method 600. For the sake of brevity, these details will not be repeated below.

[0251] 7 is a flow diagram illustrating a method 700 for selecting one of simultaneously open applications according to some embodiments. Method 700 is performed on a multifunction device (e.g., device 300 of FIG. 3 or portable multifunction device 100 of FIG. 1) that includes a display and a touch-sensitive surface. In some embodiments, the display is a touchscreen display and the touch-sensitive surface is on the display. In some embodiments, the display is separate from the touch-sensitive surface. Some operations in method 700 may be combined and / or the order of some operations may be changed.

[0252] As described below, the method 700 provides an intuitive way to select one of the simultaneously open applications. This method creates a more efficient human-machine interface by reducing the cognitive burden on the user when selecting one of the simultaneously open applications. For battery-operated computing devices, allowing a user to select one of the simultaneously open applications more quickly and efficiently conserves power and increases the time between battery charges.

[0253] The device displays (702) a first application view on the touch-sensitive display corresponding to a first application in the multiple simultaneously open applications, the first application view being displayed without simultaneously displaying an application view for any other application in the multiple simultaneously open applications (e.g., map application view 5004-1 in FIG. 5B).

[0254] The device detects (704) a first input (e.g., input 507 in FIG. 5B). In response to detecting (706) this first input, the device enters (708) an application view selection mode for selecting one of the simultaneously open applications for display in a corresponding application view, and displays (710) images of the open applications in a default area that correspond to at least some of the multiple simultaneously open applications (e.g., in FIG. 5BB, image 5008 is displayed that corresponds to at least some of the multiple simultaneously open applications). The images of the open applications are displayed in a three-dimensional stack (e.g., in FIG. 5BB, the three-dimensional stack of images 5008) that extends backwards on the display.

[0255] In some embodiments, these open application images include icons of the open applications (see, e.g., a similar example of image 5008 including open application icons 5002 in FIG. 5S.) Alternatively, the device may display open application icons corresponding to at least some of the multiple simultaneously open applications in a three-dimensional stack within a predefined area.

[0256] In some embodiments, the images of open applications in the three-dimensional stack are ordered (712) based at least in part on the recency of use of the corresponding open applications (e.g., images of open applications corresponding to open applications that have been used most recently are displayed at the front of the stack, while progressively less recently used applications are displayed progressively further back in the stack).

[0257] The device detects (714) a gesture (e.g., 533 in FIG. 5BB) on each image of an open application in the three-dimensional stack. In response to detecting (716) the gesture on each image of an open application, the device performs the following actions: The device displays (718) a respective application view (e.g., mail application view 5004-4 in FIG. 5CC) for a corresponding application in the multiple simultaneously open applications on the touch-sensitive display. Each application view is displayed without simultaneously displaying an application view for any other application in the multiple simultaneously open applications (e.g., mail application view 5004-4 in FIG. 5CC). The device stops displaying (720) the three-dimensional stack of icons of the open applications and exits (722) the application view selection mode.

[0258] It should be noted that the details of the processes described above with respect to method 700 (e.g., FIGS. 7 and 5A-5HH) are also applicable in an analogous manner to the methods described below. For example, methods 800, 900, 1000, and 1100 may include one or more of the characteristics of the various methods described above with reference to method 700. For the sake of brevity, these details will not be repeated below.

[0259] 8A-8C are flow diagrams illustrating a method 800 for selecting one of simultaneously open applications according to some embodiments. Method 800 is performed on a multifunction device (e.g., device 300 of FIG. 3 or portable multifunction device 100 of FIG. 1) that includes a display and a touch-sensitive surface. In some embodiments, the display is a touchscreen display and the touch-sensitive surface is on the display. In some embodiments, the display is separate from the touch-sensitive surface. Some operations in method 800 may be combined and / or the order of some operations may be changed.

[0260] As described below, the method 800 provides an intuitive way to select one of the simultaneously open applications. This method creates a more efficient human-machine interface by reducing the cognitive burden on the user when selecting one of the simultaneously open applications. For battery-operated computing devices, allowing a user to select one of the simultaneously open applications more quickly and efficiently conserves power and increases the time between battery charges.

[0261] The device displays (802) a first application view on the touch-sensitive display at a first size (e.g., the first size of the application view occupies all or substantially all (e.g., at least 80% or 90%) of the touch-sensitive display (e.g., map application view 5004-1 in FIG. 5B occupies at least 80% of touch screen 112). The first application view corresponds to a first application in the multiple simultaneously open applications (804), and the first application view is displayed without simultaneously displaying application views for any other applications in the multiple simultaneously open applications at the first size (806).

[0262] The device detects (808) a first input (e.g., input 507 in FIG. 5B). In response to detecting (810) this first input, the device enters (812) an application view selection mode for selecting one of the simultaneously open applications for display in a corresponding application view, and displays (814) images of the open applications (e.g., images of the open applications 5008 in FIG. 5R) in a default area. Typically, the images of the open applications are user-selectable, and when selected (e.g., by a gesture), the images of the open applications initiate a particular process (e.g., displaying the corresponding application view) associated with the images of those applications.

[0263] In some embodiments, the images of open applications in the default region (e.g., images of open applications 5008 in FIG. 5O) are displayed in a single scrollable row or column (826 in FIG. 8B). In some embodiments, the images of open applications in the default region (e.g., images of open applications 5008 in FIG. 5R) are displayed in a grid (828). The grid includes at least two rows of images of open applications.

[0264] In some embodiments, the device simultaneously displays (830) a default area and a search icon (e.g., search icon 5104 in FIG. 5W). In some embodiments, the device detects (832) a gesture (e.g., 521 in FIG. 5W) at a location corresponding to the search icon, and in response to detecting the gesture at a location corresponding to the search icon, the device displays a search input user interface (e.g., a user interface in FIG. 5X that includes keyboard 5014) within the search input user interface, receives one or more search terms, performs a search using the one or more search terms, and displays results of the search.

[0265] Each image (e.g., a live thumbnail) is displayed (834) at a second size smaller than the first size. For example, each image 5008 in Figure 5R is smaller than the map application view 5004-1 in Figure 5B. In some embodiments, these images are updated to display a reduced-sized image of the corresponding application (or the current view within the corresponding application).

[0266] The images and corresponding open application icons correspond to at least some of the multiple simultaneously open applications (844). For example, in FIG. 5S, image 5008-10 and application icon 5002-36 correspond to an email application. Thus, in some embodiments, removing image 5008-10 and application icon 5002-36 closes the corresponding email application within device 100.

[0267] In some embodiments, reduced-scale images of the open applications and / or a grid of icons of the open applications are displayed (e.g., as a linear array or as an array having at least two rows) within a predefined area within the search input user interface (e.g., application icon 5002 in FIG. 5X).

[0268] The device detects a gesture on each image of the open applications (e.g., a gesture on image 5008-10, not shown) within the default area (816 in FIG. 8A). In response to detecting the gesture on each image (818), the device performs the following actions: The device displays (820) a respective application view for a corresponding application in the multiple simultaneously open applications on the touch-sensitive display at a first size. Each application view is displayed without simultaneously displaying application views for any other applications in the multiple simultaneously open applications at the first size (e.g., mail application view 5004-4 in FIG. 5CC). The device stops displaying (822) the images and icons of the corresponding open applications within the default area and exits (824) the application view selection mode.

[0269] In some embodiments, displaying the images of the open applications in the predefined area includes simultaneously displaying the corresponding open application icons with each image (836 in FIG. 8C) (e.g., in FIG. 5S, application icons 5002-36, 5002-35, and 5002-38 are displayed simultaneously with images 5008-10, 5008-11, and 5008-12). The images and corresponding open application icons correspond to at least some of the multiple simultaneously open applications. In response to detecting a gesture on each image, the device stops displaying the images and corresponding open application icons in the predefined area. This simultaneous display of images and application icons provides several benefits. In particular, a user can easily identify the application to which each miniature image corresponds. In the absence of simultaneous display of application icons, it can be difficult to distinguish between multiple images with similar backgrounds. Therefore, providing simultaneous display of application icons and images reduces the cognitive burden on a user and creates a better human-machine interface.

[0270] In some embodiments, an icon for each open application in the predefined region is displayed adjacent to an image of the corresponding open application (838) (not shown). In some embodiments, an icon for each open application in the predefined region is displayed at least partially overlaid on the image of the corresponding open application (840) (e.g., application icon 5002 in FIG. 5S). In some embodiments, an icon for each open application in the predefined region is displayed completely overlaid on the image of the corresponding open application (842) (not shown).

[0271] It should be noted that the details of the processes described above with respect to method 800 (e.g., FIGS. 8A-8C and 5A-5HH) are also applicable in an analogous manner to the methods described below. For example, methods 900, 1000, and 1100 may include one or more of the characteristics of the various methods described above with reference to method 800. For the sake of brevity, these details will not be repeated below.

[0272] 9 is a flow diagram illustrating a method 900 for selecting one of simultaneously open applications according to some embodiments. Method 900 is performed on a multifunction device (e.g., device 300 of FIG. 3 or portable multifunction device 100 of FIG. 1) that includes a display and a touch-sensitive surface. In some embodiments, the display is a touchscreen display and the touch-sensitive surface is on the display. In some embodiments, the display is separate from the touch-sensitive surface. Some operations in method 900 may be combined and / or the order of some operations may be changed.

[0273] As described below, the method 900 provides an intuitive way to select one of the simultaneously open applications. This method creates a more efficient human-machine interface by reducing the cognitive burden on the user when selecting one of the simultaneously open applications. For battery-operated computing devices, allowing a user to select one of the simultaneously open applications more quickly and efficiently conserves power and increases the time between battery charges.

[0274] The device displays (902) a first application view on a touch-sensitive display at a first size (e.g., the first size of the application view occupies more than 50% of the touch-sensitive display). The first application view corresponds to a first application in the multiple simultaneously open applications (904). The first application view is displayed (906) without simultaneously displaying application views at the first size for any other applications in the multiple simultaneously open applications. For example, in FIG. 5B , map application view 5004-1 is displayed without simultaneously displaying application views for any other applications.

[0275] The device simultaneously displays images of the open applications within the predefined area (908) (e.g., FIG. 5O). Each image is displayed at a second size (910) (e.g., a live thumbnail) that is smaller than the first size. The images correspond to at least some of the multiple simultaneously open applications (912). In some embodiments, simultaneously displaying the images of the open applications within the predefined area includes simultaneously displaying icons of the corresponding open applications with each image (914). The images and corresponding icons of the open applications correspond to at least some of the multiple simultaneously open applications.

[0276] The device detects (916) a gesture on each image of an open application within the predefined area. In response to detecting the gesture on each image, the device displays (918) a respective application view for a corresponding application in the multiple simultaneously open applications at a first size on the touch-sensitive display (e.g., a gesture on image 5008-10 of an email application initiates the display of mail application view 5004-4, as shown in 5CC). The respective application view is displayed without simultaneously displaying application views for any other applications in the multiple simultaneously open applications at a first size (e.g., mail application view 5004-4 in 5CC).

[0277] It should be noted that the details of the processes described above with respect to method 900 (e.g., FIGS. 9 and 5A-5HH) are also applicable in an analogous manner to the methods described below. For example, methods 1000 and 1100 may include one or more of the characteristics of the various methods described above with reference to method 900. For the sake of brevity, these details will not be repeated below.

[0278] 10 is a flow diagram illustrating a method 1000 of selecting one of simultaneously open applications according to some embodiments. Method 1000 is performed on a multifunction device (e.g., device 300 of FIG. 3 or portable multifunction device 100 of FIG. 1) that includes a display and a touch-sensitive surface. In some embodiments, the display is a touchscreen display and the touch-sensitive surface is on the display. In some embodiments, the display is separate from the touch-sensitive surface. Some operations in method 1000 may be combined and / or the order of some operations may be changed.

[0279] As described below, the method 1000 provides an intuitive way to select one of the simultaneously open applications. This method creates a more efficient human-machine interface by reducing the cognitive burden on the user when selecting one of the simultaneously open applications. For battery-operated computing devices, allowing a user to select one of the simultaneously open applications more quickly and efficiently conserves power and increases the time between battery charges.

[0280] During an application view selection mode (1002) for selecting one of multiple simultaneously open applications for display in a corresponding application view, the device performs the following actions:

[0281] The device displays (1004) within the default region an initial group of open application icons (eg, application icons 5002 in FIG. 5C) that correspond to at least some of the multiple simultaneously open applications.

[0282] The device detects a gesture within the predefined area (1006). In response to detecting a gesture within the predefined area (1008), the device performs one of the following actions:

[0283] If the gesture is a first scrolling gesture in a first direction (e.g., a right-to-left swipe gesture), the device scrolls (1010) the icons of other open applications in the icons of multiple simultaneously open applications to be displayed within the default area (e.g., the application icons in FIGS. 5E and 5F).

[0284] If the gesture is a second scrolling gesture in a second direction opposite to the first direction (e.g., a swipe gesture from left to right), the device scrolls (1012) to display the settings icon within the default zone (e.g., settings icon 5102 in FIG. 5L, FIG. 5M). In some embodiments, if the gesture is a second scrolling gesture in a second direction different from the first direction (e.g., a swipe gesture from top to bottom), the device scrolls to display the settings icon within the default zone.

[0285] If the gesture is a first gesture (e.g., a tap gesture) on the icon of the respective open application (1014), the device displays (1016) a respective application view for the corresponding application in the multiple simultaneously open applications on the touch-sensitive display, stops displaying (1020) the icon of the open application in the default area, and exits (1022) the application view selection mode (and enters (1018) the normal operation mode for the respective application). In some embodiments, the respective application view is displayed (1018) without simultaneously displaying application views for any other applications in the multiple simultaneously open applications.

[0286] In some embodiments, if the gesture is a first gesture (e.g., a tap gesture) on the respective setting icon, the device changes the corresponding setting, stops displaying the icons of the open applications in the default area, and exits the application view selection mode (and enters the normal operation mode for the respective application).

[0287] In some embodiments, upon detection of a gesture within the predefined region, if the gesture is a second gesture different from the first gesture (e.g., tap and hold gesture 513 in FIG. 5G) on the icon of the respective open application, the device displays (1024) an application termination icon (e.g., an "X" icon or a "-" icon 5002-38 in FIG. 5H on or proximate to the icon of the open application) to close the corresponding application.

[0288] It should be noted that the details of the processes described above with respect to method 1000 (e.g., FIG. 10 and FIG. 5A-5HH) are also applicable in an analogous manner to the methods described below. For example, method 1100 may include one or more of the characteristics of the various methods described above with reference to method 1000. For the sake of brevity, these details will not be repeated below.

[0289] 11A and 11B are flow diagrams illustrating a method 1100 of selecting one of simultaneously open applications according to some embodiments. Method 1100 is performed on a multifunction device (e.g., device 300 of FIG. 3 or portable multifunction device 100 of FIG. 1) that includes a display and a touch-sensitive surface. In some embodiments, the display is a touchscreen display and the touch-sensitive surface is on the display. In some embodiments, the display is separate from the touch-sensitive surface. Some operations in method 1100 may be combined and / or the order of some operations may be changed.

[0290] As described below, the method 1100 provides an intuitive way to select one of the simultaneously open applications. This method creates a more efficient human-machine interface by reducing the cognitive burden on the user when selecting one of the simultaneously open applications. For battery-operated computing devices, allowing the user to select one of the simultaneously open applications faster and more efficiently conserves power and increases the time between battery charges.

[0291] The device displays (1102) a first application view (e.g., email application view 5004-4 in an email application in FIG. 5CC) at a first size within a first application, the first application view including a user-selectable object (e.g., link 5020-1) associated with a second application (e.g., a web browser application) that is different from the first application.

[0292] The device detects (1104) a first gesture (e.g., gesture 525 in FIG. 5CC) at a location corresponding to the user-selectable object. In response to detecting (1106) the first gesture, the device stops displaying (1108) the first application view and displays (1110) a second application view within the second application (e.g., browser application view 5004-2 in FIG. 5DD). In some embodiments, the second application view replaces the first application view (e.g., browser application view 5004-2 replaces mail application view 5004-4 in FIGS. 5CC, 5DD).

[0293] During the second application, the device detects (1112) an input (e.g., input 527 in FIG. 5DD). In response to detecting (1114) this input, the device performs the following actions: The device enters (1116) an application view selection mode to select one of the multiple simultaneously open applications for display in a corresponding application view. The device displays (1118) images of the open applications (e.g., images 5008-12 and 5008-10 in FIG. 5EE) in a first predefined area. The images of the open applications correspond to at least some of the multiple simultaneously open applications. In some embodiments, the images are displayed as a scrollable, linear strip of images (e.g., image 5008 is scrollable as shown in FIGS. 5EE, 5FF). Each image is displayed at a second size smaller than the first size (e.g., a live thumbnail). The images include an image of the first application view and an image of a view in the second application (e.g., image 5008-12 of a browser application view and image 5008-10 of a mail application view). The device displays (1120) a portion of a view (e.g., a home screen or springboard with application icons) with application icons for launching applications in a second default area (e.g., a portion of the "home screen" 5001) that is different from the first default area.

[0294] In some embodiments, the device displays images of logically related open applications. For example, assume that within an email application (e.g., FIG. 5CC), a web browser application is opened (e.g., FIG. 5DD). Also assume that within the web browser application, an e-book application is opened (not shown). In this case, the device displays images of a subset of the email application, the web browser application, and the e-book application, without regard to any other simultaneously open applications.

[0295] While in this application view selection mode, the device detects a second gesture (e.g., a tap gesture) (1122 in FIG. 11B). In response to detecting this second gesture (1124), the device performs one of the following actions:

[0296] If the second gesture is at a location that corresponds to an image of the first application view (1126) (e.g., gesture 535 in FIG. 5EE), the device displays (1128) the first application view (e.g., map application view 5004-4 in FIG. 5C) at a first size within the first application, stops displaying images within the first default area (1130), and exits (1132) the application view selection mode (and enters a normal operating mode for the respective application).

[0297] If the second gesture is at a location that corresponds to the second default area (1134) (e.g., gesture 533 in FIG. 5FF), the device displays (1136) a view having application icons for launching applications (e.g., home screen 5001, as shown in FIG. 5HH) (in other words, displays the view having application launch items in its entirety rather than merely a portion of that view), stops displaying images in the first default area (1138), and exits (1140) the application view selection mode (and enters the normal operating mode for launching applications from the view having application icons).

[0298] In some embodiments, if the second gesture is within the first predefined region at a location corresponding to an image of the respective application (1142), the device displays (1144) a respective application view for the corresponding application in the multiple simultaneously open applications on the touch-sensitive display, stops displaying (1148) the image within the first predefined region, and exits (1150) the application view selection mode (and enters a normal operation mode for the respective application). For example, in response to detecting gesture 531 at a location corresponding to image 5008-6 of the map application, a map application view is displayed on the display (e.g., FIG. 5GG).

[0299] In some embodiments, each application view is displayed (1146) without simultaneously displaying application views for any other applications in the multiple simultaneously open applications (eg, FIG. 5GG).

[0300] 12A and 12B are flow diagrams illustrating a method 1200 of selecting one of simultaneously open applications according to some embodiments. Method 1200 is performed on a multifunction device (e.g., device 300 of FIG. 3 or portable multifunction device 100 of FIG. 1) that includes a display and a touch-sensitive surface. In some embodiments, the display is a touch screen display and the touch-sensitive surface is on the display (e.g., a touch-sensitive display). In some embodiments, the display is separate from the touch-sensitive surface. Some operations in method 1200 may be combined and / or the order of some operations may be changed.

[0301] As described below, the method 1200 provides an intuitive way to select one of the simultaneously open applications. This method creates a more efficient human-machine interface by reducing the cognitive burden on the user when selecting one of the simultaneously open applications. For battery-operated computing devices, allowing the user to select one of the simultaneously open applications faster and more efficiently conserves power and increases the time between battery charges.

[0302] The device displays (1202) a first application view at a first size on the touch-sensitive display. In some embodiments, the first size of the application view occupies all or substantially all (e.g., at least 80% or 90%) of the touch-sensitive display. For example, map application view 5004-1 in FIG. 5B occupies at least 80% of touch screen 112, and web browser application view 5004-2 in FIG. 5LL occupies at least 80% of touch screen 112. The first application view corresponds to a first application in the multiple simultaneously open applications. For example, map application view 5004-2 in FIG. 5LL corresponds to a map application, and web browser application view 5004-2 in FIG. 5LL corresponds to a web browser application. The first application view is displayed without simultaneously displaying application views for any other applications in the multiple simultaneously open applications at the first size. For example, in FIG. 5B, no application views for any applications other than the map application are displayed. In FIG. 5LL, no application views are displayed for any applications other than the web browser application.

[0303] The device detects 1204 a first input. For example, in FIG. 5B, input 507 is detected. In another example, in FIG. 5LL, a swipe gesture including touch 549-1 is detected. Alternatively, as shown in FIG. 5LL, swipe gesture 551 can be detected.

[0304] In some embodiments, this first input includes a swipe gesture on the touch-sensitive display initiated from an edge of the touch-sensitive display (1206). For example, in FIG. 5LL, the swipe gesture is initiated from location 549-1, which corresponds to an edge of touch screen 112. In some embodiments, this first input includes a horizontal swipe gesture on the touch-sensitive display initiated from a side edge of the touch-sensitive display (e.g., a horizontal swipe gesture initiated from location 549-1 in FIG. 5LL).

[0305] In response to detecting this first input, the device enters an application view selection mode (1208) for selecting one of the simultaneously open applications for displaying a corresponding application view, and displays (1210) images of the open applications (e.g., images of open applications 5008 in FIGS. 5S and 5NN). Each image is displayed at a second size that is smaller than the first size. For example, each image 5008 in FIG. 5S is displayed at a size smaller than the size of the map application view 5004-1 in FIG. 5B. In another example, each image 5008 in FIG. 5NN is displayed at a size smaller than the size of the web browser application view 5004-2 in FIG. 5LL. A corresponding open application icon (e.g., open application icon 5002 in FIGS. 5S and 5NN) is displayed simultaneously with each image. In some embodiments, the open application icon is displayed below the image of the open application. The images and corresponding open application icons correspond to at least a portion of the multiple simultaneously open applications. In some embodiments, the images and corresponding open application icons correspond to the entirety of the multiple simultaneously open applications. In some embodiments, the images and corresponding open application icons correspond to a subset of the multiple simultaneously open applications. For example, open application image 5008 in Figure 5S may not correspond to all simultaneously open applications. For example, image 5008-19 of a simultaneously open calendar application is not shown in Figure 5S.

[0306] In some embodiments, images of open applications (eg, images of open applications 5008 in Figures 5O and 5NN) are displayed 1212 in a single scrollable row or column.

[0307] In some embodiments, the images of open applications (e.g., images of open applications 5008 in FIG. 5R) are displayed 1214 in a grid, the grid including at least two rows of images of open applications.

[0308] In some embodiments, the device simultaneously displays 1216 the images of the open applications and the search icon. For example, in FIG. 5VV, the search icon 5104 is displayed simultaneously with the images of the open applications 5008-17, 5008-18, and 5008-19.

[0309] In some embodiments, the device detects (1218) a gesture at a location corresponding to a search icon. For example, the device detects gesture 571 in FIG. 5VV. In response to detecting the gesture at a location corresponding to the search icon, the device displays a search input user interface (e.g., the user interface in FIG. 5WW that includes keyboard 5014). The device receives one or more search terms within the search input user interface. For example, in FIG. 5XX, gesture 573 is detected at a location corresponding to the letter "O" on keyboard 5014. The device performs a search using the one or more search terms (e.g., a search for open applications that include the letter "O" in the application name) and displays the results of the search. For example, in FIG. 5YY, at least a portion of the open applications that include the letter "O" in the application name (e.g., the phone, bookmark, document, contacts, and notes applications) are displayed. In some embodiments, results of the search are displayed with images of a first subset of simultaneously open applications that match the one or more search terms, and open application icons of a second subset of simultaneously open applications that match the one or more search terms (e.g., bookmark, document, and contacts application images 5008-13, 5008-14, and 5008-15, and phone, bookmark, document, contacts, and notes application icons 5002-35, 5002-13, 5002-14, 5002-15, and 5002-17). In some embodiments, the number of simultaneously open applications in the first subset differs from the number of simultaneously open applications in the second subset. In some embodiments, more open application icons are displayed than images of open applications.

[0310] In some embodiments, the device detects a swipe gesture (e.g., swipe gesture 565 in FIG. 5NN at a location corresponding to image 5008-6) over one of the images of the open applications (1220 in FIG. 12B). In response to detecting the swipe gesture over one of the images of the open applications, the device scrolls the images of the open applications such that at least one of the images of the open applications is removed from the touch-sensitive display and at least a portion of another one of the images of the open applications is added to the touch-sensitive display. For example, in response to swipe gesture 565 in FIG. 5NN, images 5008-12, 5008-10, and 5008-6 are scrolled such that image 5008-12 is removed from touch screen 112 and a portion of image 5008-11 is added to touch screen 112, as shown in FIG. 5OO. The device simultaneously scrolls the icons of the open applications. For example, open application icons 5002-37, 5002-36, and 5002-27 are scrolled simultaneously, thereby removing open application icon 5002-37 from touch screen 112. In some embodiments, an icon of the open application (e.g., application icon 5002-35 in FIG. 500) that corresponds to the added image of the open application is displayed.

[0311] In some embodiments, the device detects (1222) a swipe gesture over one of the open application icons (e.g., gesture 567 in FIG. 5QQ at a location corresponding to icon 5002-27). In response to detecting the swipe gesture over one of the open application icons, the device scrolls the open application icons such that the icons of the multiple open applications are removed from the touch-sensitive display and a second plurality of open application icons are added to the touch-sensitive display. For example, in response to the swipe gesture 567 in FIG. 5QQ, icons 5002-37, 5002-36, and 5002-27 in FIG. 5QQ are replaced with icons 5002-35, 5002-13, and 5002-14 in FIG. 5RR such that icons 5002-37, 5002-36, and 5002-27 are scrolled away. The device scrolls the images of the open applications simultaneously, thereby removing the display images of the open applications from the touch-sensitive display and adding the images of the multiple open applications to the touch-sensitive display. For example, in response to swipe gesture 567 in FIG. 5QQ, images 5008-12, 5008-10, and 5008-6 are scrolled simultaneously, thereby removing images 5008-12, 5008-10, and 5008-6 from touch screen 112 and adding images 5008-11, 5008-13, and 5008-14 to touch screen 112. In some embodiments, the images of the multiple added open applications do not include any of the images of the removed open applications. For example, icons 5008-11, 5008-13, and 5008-14 do not include any of images 5008-12, 5008-10, and 5008-6.

[0312] In some embodiments, following scrolling the open application images and the open application icons, the device simultaneously displays (1224) a first number of open application images and a second number of open application icons, the second number being greater than the first number. For example, in some embodiments, in response to swipe gesture 565 in FIG. 5NN, a first number of open application images (e.g., images 5008-12, 5008-10, and 5008-6 in FIG. 5PP) and a second number of open application icons (e.g., icons 5002-37, 5002-36, 5002-27, 5002-35, and 5002-13 in FIG. 5PP) are simultaneously displayed. In this example, the second number (e.g., five) is greater than the first number (e.g., three). In some embodiments, the open application icons are displayed in a single scrollable row or column, with the open application images corresponding to a predefined number of open application icons in the middle of the displayed open application icons.

[0313] The device detects 1226 a selection gesture on each image of an open application. For example, in Figure 5FF, gesture 531 is detected at a location corresponding to image 5008-6. In another example, in Figure 5NN, tap gesture 553 is detected on image 5008-12 associated with a web browser application, tap gesture 557 on image 5008-10 associated with a mail application, or tap gesture 561 is detected on image 5008-6 associated with a maps application.

[0314] In response to detecting a selection gesture on each image, the device displays (1228) a respective application view for the corresponding application in the multiple simultaneously open applications on the touch-sensitive display at a first size. For example, in FIG. 5GG, in response to gesture 531 in FIG. 5FF, a map application view is displayed. Each application view is displayed without simultaneously displaying application views for any other applications in the multiple simultaneously open applications at the first size. The device stops displaying the images and icons of the corresponding open applications and exits the application view selection mode.

[0315] In some embodiments, during this application view selection mode, the device detects (1230) a selection gesture (e.g., a tap gesture) on the icon of each open application. For example, in FIG. 5NN, tap gesture 555 is detected at a location corresponding to icon 5002-37 for a web browser application, tap gesture 559 is detected at a location corresponding to icon 5002-36 for a mail application, or tap gesture 563 is detected at a location corresponding to icon 5002-27 for a map application. In response to detecting the selection gesture on each open application's icon, the device displays a particular application view for the corresponding application in the multiple simultaneously open applications at a first size on the touch-sensitive display. For example, in some embodiments, in response to detecting tap gesture 563 on icon 5002-27 for a map application, a map application view is displayed (e.g., FIG. 5GG). This particular application view is displayed without simultaneously displaying application views for any other applications in the multiple simultaneously open applications at a first size. The device will stop displaying those images and the icons of the corresponding open applications and will exit the application view selection mode.

[0316] It should be understood that the particular order in which the operations in Figures 12A and 12B are described is merely illustrative and is not intended to indicate that the described order is the only order in which the operations can be performed. Those skilled in the art will recognize various ways to reorder the operations described herein. For the sake of brevity, these details will not be repeated here. Furthermore, it should be noted that other process details described herein with respect to method 600 (e.g., Figures 6A-6C), method 700 (e.g., Figure 7), method 800 (e.g., Figures 8A-8C), method 900 (e.g., Figure 9), method 1000 (e.g., Figure 10), and method 1100 (e.g., Figures 11A and 11B) are also applicable in a similar manner to method 1200 described above with respect to Figures 12A and 12B. For example, the open application icons described above with reference to method 800 may have one or more of the characteristics of the open application icons described herein with reference to method 1200. For the sake of brevity, these details will not be repeated here.

[0317] According to some embodiments, FIG. 13 illustrates a functional block diagram of an electronic device 1300 configured according to the principles of the present invention as described above. The functional blocks of the device can be implemented by hardware, software, or a combination of hardware and software to execute the principles of the present invention. It will be understood by those skilled in the art that the functional blocks described in FIG. 13 can be combined or divided into sub-blocks to implement the principles of the present invention as described above. Therefore, the description herein may support any possible combination or separation or further definition of the functional blocks described herein.

[0318] 13, the electronic device 1300 includes a touch-sensitive display unit 1302 configured to display a first application view at a first size on the touch-sensitive display unit 1302. The first application view corresponds to a first application in the multiple simultaneously open applications, and the first application view is displayed without simultaneously displaying application views for any other applications in the multiple simultaneously open applications at the first size. The electronic device 1300 also includes a processing unit 1306 coupled to the touch-sensitive display unit 1302. In some embodiments, the processing unit 1306 includes a detection unit 1308, a mode transition unit 1310, a mode exit unit 1312, a display enable unit 134, a display stop unit 1316, a search term receiving unit 1318, a search performing unit 1320, and a scroll enable unit 1322.

[0319] The processing unit 1306 is configured to detect a first input (e.g., on the touch-sensitive display unit 1302, using the detection unit 1308) and, in response to detecting the first input, enter an application view selection mode (e.g., using the mode transition unit 1310) for selecting one of the simultaneously open applications for display in a corresponding application view and enable display of images of the open applications (e.g., on the touch-sensitive display unit 1302, using the display enablement unit 1314). Each image is displayed in a second size that is smaller than the first size. An icon of the corresponding open application is displayed simultaneously with each image. The images and the corresponding open application icons correspond to at least a portion of the multiple simultaneously open applications. The processing unit 1306 is configured to detect a selection gesture on each image of the open applications (e.g., on the touch-sensitive display unit 1302, using the detection unit 1308), and in response to detecting the selection gesture on the each image, enable (e.g., on the touch-sensitive display unit 1302, using the display enable unit 1314) each application view for a corresponding application in the multiple simultaneously open applications to be displayed in a first size on the touch-sensitive display unit 1302, without simultaneously displaying application views for any other applications in the multiple simultaneously open applications in the first size, stop displaying (e.g., using the display stop unit 1316) the images and icons of the corresponding open applications, and exit the application view selection mode (e.g., using the mode exit unit 1312).

[0320] In some embodiments, images of open applications are displayed (eg, on the touch-sensitive display unit 1302) in a single scrollable row or column.

[0321] In some embodiments, the images of the open applications are displayed (eg, on the touch-sensitive display unit 1302) on a grid, the grid comprising at least two rows of images of the open applications.

[0322] In some embodiments, the processing unit 1306 is configured to enable simultaneous display of images of open applications and a search icon (eg, using the display enablement unit 1314).

[0323] In some embodiments, the processing unit 1306 is configured to detect a gesture at a location corresponding to a search icon (e.g., using the detection unit 1308 on the touch-sensitive display unit 1302), and in response to detecting the gesture at the location corresponding to the search icon, enable display of a search input user interface (e.g., using the display enabling unit 1314 on the touch-sensitive display unit 1302), receive one or more search terms into the search input user interface (e.g., using the search term receiving unit 1318), perform a search using the one or more search terms (e.g., using the search performing unit 1320), and enable display of results of the search (e.g., using the display enabling unit 1314 on the touch-sensitive display unit 1302).

[0324] In some embodiments, the processing unit 1306 is configured to detect a selection gesture on an icon of a respective open application during the application view selection mode (e.g., using the detection unit 1308), and in response to detecting the selection gesture on the icon of the respective open application, enable (e.g., using the display enablement unit 1314 on the touch-sensitive display unit 1302) a particular application view for a corresponding application in the multiple simultaneously open applications to be displayed in a first size on the touch-sensitive display unit 1302, where the particular application view is displayed without simultaneously displaying application views for any other applications in the multiple simultaneously open applications in the first size, stop displaying those images and the icons of the corresponding open applications (e.g., using the display stop unit 1316), and exit the application view selection mode (e.g., using the mode exit unit 1312).

[0325] In some embodiments, the processing unit 1306 is configured to detect a swipe gesture on one of the images of the open applications (e.g., using the detection unit 1308) and, in response to detecting the swipe gesture on one of the images of the open applications, enable scrolling of the images of the open applications (e.g., using the scroll enablement unit 1322) such that at least one of the images of the open applications is removed from the touch-sensitive display unit 1302 and at least a portion of another one of the images of the open applications is added to the touch-sensitive display unit 1302, enabling simultaneous scrolling of the icons of the open applications (e.g., using the scroll enablement unit 1322).

[0326] In some embodiments, the processing unit 1306 detects a swipe gesture on one of the icons of the open applications (e.g., on the touch-sensitive display unit 1302, using the detection unit 1308), and in response to the detection of the swipe gesture on one of the icons of the open applications, enables scrolling of the icons of the open applications (e.g., using the scrolling enabling unit 1322), so that the icons of the plurality of open applications are removed from the touch-sensitive display unit 1302, the icons of a second plurality of open applications are added to the touch-sensitive display unit 1302, and by enabling simultaneous scrolling of the images of the open applications (e.g., using the scrolling enabling unit 1322), the displayed images of the open applications are removed from the touch-sensitive display unit 1302, and the images of the plurality of open applications are added to the touch-sensitive display unit 1302.

[0327] In some embodiments, the processing unit 1306 is configured to enable simultaneous display of the images of the first number of open applications and the icons of the second number of open applications (e.g., using the display enabling unit 1314) following scrolling of the images of the open applications and the icons of the open applications, where the second number is greater than the first number.

[0328] In some embodiments, this first input includes a swipe gesture on the touch-sensitive display unit 1302 starting from an edge of the touch-sensitive display unit 1302.

[0329] The operations in the above-mentioned information processing methods can be implemented by running one or more functional modules in an information processing device, such as a general-purpose processor or an application-specific chip. All of these modules, combinations of these modules, and / or their combination with common hardware (e.g., as described above with respect to Figures 1A, 1B, and 3) are within the scope of protection of the present invention.

[0330] 14 is a flow diagram illustrating a method 1400. Method 1400 is performed on a multifunction device (e.g., device 300 of FIG. 3 or portable multifunction device 100 of FIG. 1) that includes a display and a touch-sensitive surface. In some embodiments, the display is a touch screen display and the touch-sensitive surface is on the display. In some embodiments, the display is separate from the touch-sensitive surface. Some operations in method 1400 may be combined and / or the order of some operations may be changed.

[0331] As described below, method 1400 provides an intuitive way to display a settings icon and / or an icon of an open application. This method creates a more efficient human-machine interface by reducing the cognitive burden on a user when selecting one of the simultaneously open applications and / or when selecting a settings icon. For battery-operated computing devices, allowing a user to select one of the simultaneously open applications and / or a settings icon more quickly and efficiently conserves power and increases the time between battery charges.

[0332] The device detects a gesture on the touch-sensitive display 1402. In response to detecting the gesture 1402, the device performs one of the following actions:

[0333] If the gesture is a first swipe gesture in a first direction, the device displays (1404) icons of the multiple open applications (e.g., application icon 5002 in FIGS. 5C, 5JJ, 5KK, and 5KK-5ZZ) corresponding to at least some of the multiple simultaneously open applications. In some embodiments, if the gesture is a first swipe gesture in a first direction, the device displays an image of the multiple open applications (e.g., image 5008 in FIG. 5FF) corresponding to at least some of the multiple simultaneously open applications. In some embodiments, if the gesture is a first swipe gesture in a first direction, the device displays an image of the multiple open applications corresponding to at least some of the multiple simultaneously open applications and an icon of the multiple open applications (e.g., image 5008 and icon 5002 in FIGS. 5MM-5ZZ) corresponding to at least some of the multiple simultaneously open applications.

[0334] In some embodiments, the first swipe gesture in the first direction is a horizontal swipe (e.g., a swipe gesture starting at location 539-1 or location 541 in FIG. 5II). In some embodiments, this first swipe is either a left-to-right swipe or a right-to-left swipe (e.g., as shown in FIG. 5II).

[0335] If the gesture is a second swipe gesture in a second direction different from the first direction, the device displays (1406) one or more settings icons (e.g., settings icon 5102 in FIG. 5M, settings icon 5022 in FIG. 5BBB, FIG. 5CCC, or FIG. 5DDD, FIG. 5EEE). In some embodiments, if the gesture is a second swipe gesture in a second direction different from the first direction, the device displays (1408) one or more settings icons (e.g., settings icon 5022 in FIG. 5BBB or FIG. 5DDD) in a settings panel (e.g., settings panel 5024 in FIG. 5BBB or FIG. 5DDD).

[0336] In some embodiments, the second swipe gesture in the second direction is a swipe in a horizontal direction (e.g., a left-to-right swipe gesture starting at location 537 in FIG. 5L). In some embodiments, if both the first swipe gesture and the second swipe gesture correspond to horizontal swipe gestures, the first direction is a left-to-right direction and the second direction is a right-to-left direction (or vice versa). In some embodiments, the second swipe gesture in the second direction is a swipe in an upward direction (e.g., a swipe gesture starting at location 571 or 570 in FIG. 5AAA).

[0337] In some embodiments, displaying one or more settings icons (1406) includes displaying at least one of a Wi-Fi icon (e.g., icon 5102-2 in FIG. 5M, icon 5022-1 in FIG. 5BBB, FIG. 5CCC, or FIG. 5DDD, FIG. 5EEE), a Bluetooth icon (e.g., icon 5102-3 in FIG. 5M, icon 5022-2 in FIG. 5BBB, FIG. 5CCC, or FIG. 5DDD, FIG. 5EEE), an airplane mode icon (e.g., icon 5022-1 in FIG. 5BBB, FIG. 5CCC, or FIG. 5DDD, FIG. 5EEE), and a rotation lock icon (e.g., icon 5102-1 in FIG. 5M, icon 5022-5 in FIG. 5BBB, FIG. 5CCC, or FIG. 5DDD, FIG. 5EEE). In some embodiments, displaying 1406 one or more settings icons includes displaying a do not disturb icon (e.g., icon 5022-4 in FIG. 5BBB, FIG. 5CCC, or FIG. 5DDD, FIG. 5EEE).

[0338] In some embodiments, if the gesture is a second swipe gesture in a second direction different from the first direction, the device displays (1410) one or more audio control icons in the settings panel (e.g., audio control icons (e.g., play / pause, fast forward, rewind) in FIG. 5M, audio control icon 5028 in FIG. 5BBB, FIG. 5CCC, or FIG. 5DDD, FIG. 5EEE). These audio control icons are configured to control any active audio presentation, regardless of its source (e.g., whether the audio is generated by the video and music player module 152 or another application and / or module). In some embodiments, when the settings panel is displayed (1408), the audio control icons are displayed only if audio is being presented simultaneously.

[0339] In some embodiments, if the gesture is a second swipe gesture in a second direction different from the first direction, the device displays (1412) a brightness adjustment control in the settings panel (e.g., brightness adjustment control 5026 in FIG. 5BBB, FIG. 5CCC, or FIG. 5DDD, FIG. 5EEE). The brightness adjustment control allows the user to change the brightness of the touch screen 112. In some embodiments, the brightness control is a slider control that allows the user to slide a displayed position indicator to a desired position on a displayed slider bar or tap on a particular location on the slider bar to move the position indicator to the selected location.

[0340] In some embodiments, if the gesture is a second swipe gesture in a second direction different from the first direction, the device displays (1414) one or more user-specified application icons (e.g., user-specified application icons 5030-1 through 5030-4 in FIG. 5BBB, FIG. 5CCC, or FIG. 5DDD, FIG. 5EEE) in the settings panel. In some embodiments, the application icons include any application icon specified by the user. In some embodiments, the application icons include a flashlight application icon, a clock application icon, a camera application icon, and a calculator application icon.

[0341] In some embodiments, if the gesture is a second swipe gesture in a second direction, the device simultaneously displays one or more settings icons, a brightness adjustment control, one or more music control icons, and one or more user-specified application icons in a settings panel (e.g., settings panel 5024 in FIG. 5BBB or FIG. 5DDD). In some embodiments, the one or more settings icons are displayed in a first portion of the settings panel, the brightness adjustment control is displayed in a second portion of the settings panel that is below the first portion, the one or more music control icons are displayed in a third portion of the settings panel that is below the second portion, and the one or more user-specified application icons are displayed in a fourth portion of the settings panel that is below the third portion (e.g., as shown in FIG. 5BBB or FIG. 5DDD).

[0342] In some embodiments, if the gesture is a third swipe gesture in a third direction different from the first direction and the second direction, the device displays 1416 a list of at least the most recent electronic notifications. In some embodiments, the third swipe gesture in the third direction is a swipe in a downward direction (e.g., a downward swipe gesture starting at location 523 in FIG. 5Z).

[0343] In some embodiments, if the gesture is a third swipe gesture in a third direction, the device displays (1418) an informational user interface including a list of recent electronic notifications. In some embodiments, this informational user interface replaces a user interface on the touch-sensitive display that was displayed prior to detecting the third swipe gesture (e.g., part or all of home screen 5001 in FIG. 5A). In some embodiments, displaying the informational user interface includes ceasing to display one or more application icons and displaying the informational user interface. In some embodiments, the informational user interface is or includes a panel (e.g., notification panel 5021 in FIG. 5AA).

[0344] 15 is a flow diagram illustrating method 1500. Method 1500 is performed on a multifunction device (e.g., device 300 of FIG. 3 or portable multifunction device 100 of FIG. 1) that includes a display and a touch-sensitive surface. In some embodiments, the display is a touch screen display and the touch-sensitive surface is on the display. In some embodiments, the display is separate from the touch-sensitive surface. Some operations in method 1500 may be combined and / or the order of some operations may be changed.

[0345] As described below, method 1500 provides an intuitive way to display a settings icon and / or an icon of an open application. This method creates a more efficient human-machine interface by reducing the cognitive burden on the user when selecting one of the simultaneously open applications and / or when selecting the settings icon. For battery-operated computing devices, allowing a user to select one of the simultaneously open applications and / or the settings icon more quickly and efficiently conserves power and increases the time between battery charges.

[0346] The device detects a gesture on the touch-sensitive display 1502. In response to detecting the gesture 1502, the device performs one of the following actions:

[0347] If the gesture is a first swipe gesture in a first direction, the device displays 1504 a list of at least recent electronic notifications. In some embodiments, the first swipe gesture in a first direction is a swipe in a downward direction (e.g., a downward swipe gesture starting at location 523 in FIG. 5Z).

[0348] In some embodiments, if the gesture is a first swipe gesture in a first direction, the device displays (1506) an informational user interface including a list of recent electronic notifications. In some embodiments, this informational user interface replaces a user interface (e.g., part or all of home screen 5001 in FIG. 5A) that was displayed prior to detecting the third swipe gesture on the touch-sensitive display. In some embodiments, displaying the informational user interface includes ceasing to display one or more application icons and displaying the informational user interface. In some embodiments, the informational user interface is or includes a panel (e.g., notification panel 5021 in FIG. 5AA).

[0349] If the gesture is a second swipe gesture in a second direction different from the first direction, the device displays (1508) one or more settings icons (e.g., settings icon 5102 in FIG. 5M, settings icon 5022 in FIG. 5BBB, FIG. 5CCC, or FIG. 5DDD, FIG. 5EEE). In some embodiments, if the gesture is a second swipe gesture in a second direction different from the first direction, the device displays (1510) one or more settings icons (e.g., settings icon 5022 in FIG. 5BBB or FIG. 5DDD) in a settings panel (e.g., settings panel 5024 in FIG. 5BBB or FIG. 5DDD).

[0350] In some embodiments, the second swipe gesture in the second direction is a swipe in a horizontal direction (e.g., a left-to-right swipe gesture starting at location 537 in FIG. 5L). In some embodiments, the second swipe gesture in the second direction is a swipe in an upward direction (e.g., a swipe gesture starting at location 571 or 570 in FIG. 5AAA).

[0351] In some embodiments, displaying (1508) the one or more settings icons includes displaying at least one of a Wi-Fi icon (e.g., icon 5102-2 in FIG. 5M, icon 5022-1 in FIG. 5BBB, FIG. 5CCC, or FIG. 5DDD, FIG. 5EEE), a Bluetooth icon (e.g., icon 5102-3 in FIG. 5M, icon 5022-2 in FIG. 5BBB, FIG. 5CCC, or FIG. 5DDD, FIG. 5EEE), an airplane mode icon (e.g., icon 5022-1 in FIG. 5BBB, FIG. 5CCC, or FIG. 5DDD, FIG. 5EEE), and a rotation lock icon (e.g., icon 5102-1 in FIG. 5M, icon 5022-5 in FIG. 5BBB, FIG. 5CCC, or FIG. 5DDD, FIG. 5EEE). In some embodiments, displaying 1508 one or more settings icons includes displaying a do not disturb icon (e.g., icon 5022-4 in FIG. 5BBB, FIG. 5CCC, or FIG. 5DDD, FIG. 5EEE).

[0352] In some embodiments, if the gesture is a second swipe gesture in a second direction different from the first direction, the device displays (1512) one or more audio control icons in the settings panel (e.g., audio control icons (e.g., play / pause, fast forward, rewind) in FIG. 5M, audio control icon 5028 in FIG. 5BBB, FIG. 5CCC, or FIG. 5DDD, FIG. 5EEE). These audio control icons are configured to control any active audio presentation, regardless of its source (e.g., whether the audio is generated by the video and music player module 152 or another application and / or module). In some embodiments, when the settings panel is displayed (1510) (e.g., in response to an upward swipe gesture), the audio control icons are displayed only if audio is being presented simultaneously.

[0353] In some embodiments, if the gesture is a second swipe gesture in a second direction different from the first direction, the device displays (1514) a brightness adjustment control in the settings panel (e.g., brightness adjustment control 5026 in FIG. 5BBB, FIG. 5CCC, or FIG. 5DDD, FIG. 5EEE). The brightness adjustment control allows the user to change the brightness of the touch screen 112. In some embodiments, the brightness control is a slider control that allows the user to slide a displayed position indicator to a desired position on a displayed slider bar or to move the position indicator to a selected location by tapping on the slider bar.

[0354] In some embodiments, if the gesture is a second swipe gesture in a second direction different from the first direction, the device displays (1516) one or more user-specified application icons (e.g., user-specified application icons 5030-1 through 5030-4 in FIG. 5BBB, FIG. 5CCC, or FIG. 5DDD, FIG. 5EEE) in the settings panel. In some embodiments, the application icons include any application icon specified by the user. In some embodiments, the application icons include a flashlight application icon, a clock application icon, a camera application icon, and a calculator application icon.

[0355] In some embodiments, if the gesture is a second swipe gesture in a second direction, the device simultaneously displays one or more settings icons, a brightness adjustment control, one or more music control icons, and one or more user-specified application icons in a settings panel (e.g., settings panel 5024 in FIG. 5BBB or FIG. 5DDD). In some embodiments, the one or more settings icons are displayed in a first portion of the settings panel, the brightness adjustment control is displayed in a second portion of the settings panel that is below the first portion, the one or more music control icons are displayed in a third portion of the settings panel that is below the second portion, and the one or more user-specified application icons are displayed in a fourth portion of the settings panel that is below the third portion (e.g., as shown in FIG. 5BBB or FIG. 5DDD).

[0356] In some embodiments, if the gesture is a third swipe gesture in a third direction different from the first direction and the second direction, the device displays (1518) icons of the multiple open applications (e.g., application icon 5002 in FIGS. 5C, 5JJ, 5KK, and 5KK-5ZZ) corresponding to at least some of the multiple simultaneously open applications. In some embodiments, if the gesture is a third swipe gesture in the third direction, the device displays an image of the multiple open applications (e.g., image 5008 in FIG. 5FF) corresponding to at least some of the multiple simultaneously open applications. In some embodiments, if the gesture is a third swipe gesture in the third direction, the device displays an image of the multiple open applications corresponding to at least some of the multiple simultaneously open applications and icons of the multiple open applications (e.g., image 5008 and icon 5002 in FIGS. 5MM-5ZZ) corresponding to at least some of the multiple simultaneously open applications.

[0357] In some embodiments, the third swipe gesture in the third direction is a horizontal swipe (e.g., a swipe gesture starting at location 539-1 or location 541 in FIG. 5II). In some embodiments, this third swipe is either a left-to-right swipe or a right-to-left swipe (e.g., as shown in FIG. 5II).

[0358] According to some embodiments, FIG. 16 illustrates a functional block diagram of an electronic device 1600 configured according to the principles of the present invention as described above. The functional blocks of the device can be implemented by hardware, software, or a combination of hardware and software to execute the principles of the present invention. It will be understood by those skilled in the art that the functional blocks described in FIG. 16 can be combined or divided into sub-blocks to implement the principles of the present invention as described above. Therefore, the description in this specification may support any possible combination or separation or further definition of the functional blocks described in this specification.

[0359] 16, the electronic device 1600 includes a touch-sensitive display unit 1602. The electronic device 1600 also includes a processing unit 1606 coupled to the touch-sensitive display unit 1602. In some embodiments, the processing unit 1606 includes a detection unit 1608 and a display enabling unit 1610.

[0360] In some embodiments, the processing unit 1606 is configured to detect a gesture on a touch-sensitive display of the touch-sensitive display unit (e.g., using the detection unit 1608) and, in response to detecting the gesture on the touch-sensitive display, enable (e.g., using the display enablement unit 1610) the display of icons of the multiple open applications corresponding to at least some of the multiple simultaneously open applications if the gesture is a first swipe gesture in a first direction, and enable (e.g., using the display enablement unit 1610) the display of one or more settings icons if the gesture is a second swipe gesture in a second direction different from the first direction. In some embodiments, the first swipe gesture corresponds to a horizontal direction and the second swipe gesture corresponds to an upward direction.

[0361] In some embodiments, the processing unit 1606 is configured to detect a gesture on a touch-sensitive display of the touch-sensitive display unit (e.g., using the detection unit 1608) and, in response to detecting the gesture on the touch-sensitive display, enable (e.g., using the display enablement unit 1610) a display of at least a list of recent electronic notifications if the gesture is a first swipe gesture in a first direction, and enable (e.g., using the display enablement unit 1610) a display of one or more settings icons if the gesture is a second swipe gesture in a second direction different from the first direction. In some embodiments, the first swipe gesture corresponds to a downward direction and the second swipe gesture corresponds to an upward direction.

[0362] The operations in the above-mentioned information processing methods can be implemented by running one or more functional modules in an information processing device, such as a general-purpose processor or an application-specific chip. All of these modules, combinations of these modules, and / or their combination with common hardware (e.g., as described above with respect to Figures 1A, 1B, and 3) are within the scope of protection of the present invention.

[0363] The operations described above with reference to Figures 6A-6C, 7, 8A-8C, 9, 10, 11A, 11B, 12A, 12B, and 14-15 may be implemented by the components shown in Figures 1A-1C. For example, detect operation 604, enter application view selection mode operation 608, and exit operation 622 may be implemented by event sorter 170, event recognizer 180, and event handler 190. Event monitor 171 in event sorter 170 detects a contact on touch-sensitive display 112, and event dispatcher module 174 delivers the event information to application 136-1. Each event recognizer 180 of application 136-1 consults its event information against a respective event definition 186 to determine whether a first contact at a first location on the touch-sensitive surface (or a rotation of the device) corresponds to a predefined event or sub-event, such as a selection of an object on a user interface or a rotation of the device from one orientation to another. When a respective predefined event or sub-event is detected, event recognizer 180 activates an event handler 190 associated with the detection of that event or sub-event. Event handler 190 may utilize or call data updater 176, object updater 177, or GUI updater 178 to update application internal state 192. In some embodiments, event handler 190 accesses a respective GUI updater 178 to update what is being displayed by the application. Similarly, it will be apparent to one of ordinary skill in the art how other processes can be implemented based on the components shown in FIGS. 1A-1C.

[0364] The foregoing description has been described with reference to specific embodiments for purposes of explanation. However, the exemplary discussion above is not intended to be exhaustive or to limit the invention to the precise forms disclosed. Many modifications and variations are possible in light of the above teachings. These embodiments have been chosen and described in order to best explain the principles of the invention and its practical application, and to thereby enable others skilled in the art to best utilize the invention and its various embodiments with various modifications as suited to the particular applications contemplated.

Claims

1. It is a method A multifunction device having a touch-sensitive display, Detecting a swipe gesture on the touch-sensitive display; displaying one or more user-specified application icons and one or more settings icons in a settings panel in response to detecting the swipe gesture on the touch-sensitive display; detecting a selection input directed to an individual icon within the settings panel while displaying the settings panel; and in response to detecting the selection input directed to the individual icon in the settings panel, displaying a number of controls associated with the individual icon in a user interface displayed on the settings panel.

2. The swipe gesture is a first swipe gesture in a first direction, and the method comprises:

10. The method of claim 1 , further comprising: in response to detecting a second swipe gesture on the touch-sensitive display in a second direction different from the first direction, displaying icons of a plurality of open applications corresponding to at least some of a plurality of simultaneously open applications.

3. 3. The method of claim 2, wherein the first direction is an upward direction.

4. 4. The method of claim 1, wherein displaying the one or more settings icons comprises displaying at least one of an airplane mode icon, a Wi-Fi icon, a Bluetooth icon, and a rotation lock icon.

5. The method of claim 1 , wherein displaying the one or more settings icons further comprises displaying a do not disturb icon.

6. 6. A method according to claim 1, further comprising displaying one or more audio control icons in the settings panel in response to detecting the swipe gesture on the touch-sensitive display.

7. 7. A method according to claim 1, further comprising displaying a brightness adjustment control in the settings panel in response to detecting the swipe gesture on the touch-sensitive display.

8. in response to detecting the swipe gesture on the touch-sensitive display, the one or more setting icons; A brightness adjustment control unit; one or more audio control icons; one or more user-specified application icons; 8. The method according to claim 1, further comprising simultaneously displaying

9. the one or more settings icons are displayed within a first portion of the settings panel; the brightness adjustment control is displayed in a second portion of the settings panel, the second portion being below the first portion; the one or more audio control icons are displayed within a third portion of the settings panel, the third portion being below the second portion; 9. The method of claim 8, wherein the one or more user-specified application icons are displayed in a fourth portion of the settings panel, the fourth portion being below the third portion.

10. The method of claim 1, wherein the user interface displayed on the settings panel is partially transparent.

11. Displaying the plurality of controls associated with the respective icons within the user interface displayed on the settings panel, if the respective icon is a first icon, displaying a first set of controls within the user interface displayed on the settings panel; 2. The method of claim 1, further comprising: if the respective icon is a second icon, displaying a second set of controls in the user interface displayed on the settings panel, the second set of controls being different from the first set of controls and the second icon being different from the first icon.

12. A multifunction device, A touch-sensitive display; one or more processors; Memory, one or more programs stored in the memory and configured to be executed by the one or more processors, the one or more programs comprising: Detecting a swipe gesture on the touch-sensitive display; displaying one or more user-specified application icons and one or more settings icons in a settings panel in response to detecting the swipe gesture on the touch-sensitive display; detecting a selection input directed to an individual icon within the settings panel while displaying the settings panel; and one or more programs including instructions for: in response to detecting the selection input directed to the individual icon in the settings panel, displaying a plurality of controls associated with the individual icon in a user interface displayed on the settings panel.

13. 13. The multifunction device of claim 12, wherein the one or more programs contain instructions for carrying out the method of any one of claims 2 to 11.

14. When executed by a multifunction device having a touch-sensitive display, the multifunction device: Detecting a swipe gesture on the touch-sensitive display; displaying one or more user-specified application icons and one or more settings icons in a settings panel in response to detecting the swipe gesture on the touch-sensitive display; detecting a selection input directed to an individual icon within the settings panel while displaying the settings panel; and in response to detecting the selection input directed to the individual icon in the settings panel, displaying a plurality of controls associated with the individual icon in a user interface displayed on the settings panel.

15. 15. A program according to claim 14, characterized in that the program contains instructions which, when executed by the multifunction device, cause the multifunction device to carry out the method according to any one of claims 2 to 11.

Images