Method and interface for media control with dynamic feedback

Abstract

The invention relates to a method and interface for media control with dynamic feedback. The present disclosure generally relates to techniques and interfaces for managing media playback devices. In some embodiments, the techniques include altering feedback based on movement of the computer system toward or away from the external device. In some embodiments, the techniques include displaying an interface while the computer system and external device are playing media, the interface including controls for controlling playback of media on the external device. In some embodiments, the techniques include performing an operation at a computer system in response to an input having a size less than or greater than a size threshold. In some embodiments, the techniques include performing different operations at a computer system when state light has states indicative of different states of the computer system.

Description

[0001] This application is a divisional application of a patent application for "Methods and Interfaces for Media Control with Dynamic Feedback", with an international filing date of August 31, 2021, a national application number of 202180079002.2 (international application number PCT / US2021 / 048358).

[0002] Cross - Reference to Related Applications

[0003] This application claims priority to U.S. Provisional Application Serial No. 63 / 083,820, filed September 25, 2020, and titled "METHODS AND INTERFACES FOR MEDIA CONTROL WITH DYNAMIC FEEDBACK", and U.S. Non-Provisional Application Serial No. 17 / 168,069, filed February 4, 2021, and titled "METHODS AND INTERFACES FOR MEDIA CONTROL WITH DYNAMIC FEEDBACK". The entire contents of these two patent applications are incorporated herein by reference for all purposes. TECHNICAL FIELD

[0004] This disclosure relates generally to computer user interfaces, and more particularly to techniques for managing media playback devices. BACKGROUND ART

[0005] The number of electronic devices, and particularly smart devices, in a user's home is increasing. These devices are becoming more complex, capable of interconnecting with each other, and capable of performing more complex tasks. As such, these devices can benefit from additional methods and interfaces for managing media playback. SUMMARY OF THE INVENTION

[0006] However, some techniques for using an electronic device to manage a media playback device are generally cumbersome and inefficient. For example, some prior art uses complex and time-consuming user interfaces that may include multiple button presses or keystrokes. The prior art takes more time than necessary, which results in wasted user time and device energy. This latter consideration is particularly important in battery-powered devices.

[0007] Accordingly, the present technology provides faster and more efficient methods and interfaces for an electronic device to manage a media playback device. Such methods and interfaces optionally supplement or replace other methods for controlling media playback. Such methods and interfaces reduce the cognitive burden imposed on the user and result in a more effective human-machine interface. For battery-powered computing devices, such methods and interfaces save power and increase the time between battery charges.

[0008] According to some embodiments, a method performed at a computer system communicating with a first external device is described. The method includes: detecting a change in distance between the computer system and the first external device; and in response to detecting the change in distance: generating a feedback indicating that a first operation will be performed when a second threshold distance is reached, based on determining that a current distance of the computer system from the first external device is less than a first threshold distance but greater than the second threshold distance, wherein the feedback changes at least in part based on the distance of the computer system from the first external device, including: changing a current value of a feedback parameter of the feedback in a first direction based on determining that the change in distance includes the computer system moving towards the first external device; and changing the current value of the feedback parameter of the feedback in a second direction different from the first direction based on determining that the change in distance includes the computer system moving away from the first external device; and performing the first operation based on determining that the current distance of the computer system from the first external device is less than the second threshold distance.

[0009] According to some embodiments, a non-transitory computer-readable storage medium storing one or more programs configured to be executed by one or more processors of a computer system communicating with a first external device is described. The one or more programs include instructions for: detecting a change in distance between the computer system and the first external device; and in response to detecting the change in distance: generating a feedback indicating that a first operation will be performed when a second threshold distance is reached, based on determining that a current distance of the computer system from the first external device is less than a first threshold distance but greater than the second threshold distance, wherein the feedback changes at least in part based on the distance of the computer system from the first external device, including: changing a current value of a feedback parameter of the feedback in a first direction based on determining that the change in distance includes the computer system moving towards the first external device; and changing the current value of the feedback parameter of the feedback in a second direction different from the first direction based on determining that the change in distance includes the computer system moving away from the first external device; and performing the first operation based on determining that the current distance of the computer system from the first external device is less than the second threshold distance.

[0010] According to some embodiments, a transient computer-readable storage medium is described that stores one or more programs configured to be executed by one or more processors of a computer system that communicates with a first external device. The one or more programs include instructions for: detecting a change in distance between the computer system and the first external device; and in response to detecting the change in distance: generating feedback indicating that a first operation will be performed when a second threshold distance is reached, based on determining that a current distance of the computer system from the first external device is less than a first threshold distance but greater than the second threshold distance, wherein the feedback changes at least in part based on the distance of the computer system from the first external device, including: changing a current value of a feedback parameter of the feedback in a first direction based on determining that the change in distance includes the computer system moving towards the first external device; and changing the current value of the feedback parameter of the feedback in a second direction different from the first direction based on determining that the change in distance includes the computer system moving away from the first external device; and performing the first operation based on determining that the current distance of the computer system from the first external device is less than the second threshold distance.

[0011] According to some embodiments, a computer system that communicates with a first external device is described. The computer system includes one or more processors and a memory that stores one or more programs configured to be executed by the one or more processors. The one or more programs include instructions for: detecting a change in distance between the computer system and the first external device; and in response to detecting the change in distance: generating feedback indicating that a first operation will be performed when a second threshold distance is reached, based on determining that a current distance of the computer system from the first external device is less than a first threshold distance but greater than the second threshold distance, wherein the feedback changes at least in part based on the distance of the computer system from the first external device, including: changing a current value of a feedback parameter of the feedback in a first direction based on determining that the change in distance includes the computer system moving towards the first external device; and changing the current value of the feedback parameter of the feedback in a second direction different from the first direction based on determining that the change in distance includes the computer system moving away from the first external device; and performing the first operation based on determining that the current distance of the computer system from the first external device is less than the second threshold distance.

[0012] According to some embodiments, a computer system that communicates with a first external device is described. The computer system includes means for detecting a change in distance between the computer system and the first external device; and means for performing the following operations: in response to detecting the change in distance: generating feedback indicating that a first operation will be performed when a second threshold distance is reached, based on determining that a current distance of the computer system from the first external device is less than a first threshold distance but greater than the second threshold distance, wherein the feedback changes at least in part based on the distance of the computer system from the first external device, including: changing a current value of a feedback parameter of the feedback in a first direction based on determining that the change in distance includes movement of the computer system towards the first external device; and changing the current value of the feedback parameter of the feedback in a second direction different from the first direction based on determining that the change in distance includes movement of the computer system away from the first external device; and performing the first operation based on determining that the current distance of the computer system from the first external device is less than the second threshold distance.

[0013] According to some embodiments, a method performed at a computer system that communicates with a display generation component and one or more input devices is described. The method includes: in response to determining that a distance between the computer system and a first external device is less than a first threshold distance: displaying a media control user interface based on determining that a first set of criteria is met, wherein the first set of criteria includes criteria that are met when the computer system is currently playing a first media and the first external device is playing a second media, the media control user interface including: a first selectable graphical user interface object for initiating playback of the first media on the first external device; and one or more selectable user interface objects for controlling playback of the second media on the first external device, including a first media control selectable graphical user interface object; receiving input via the one or more input devices while the media control user interface is displayed; and in response to receiving the input: initiating a process for causing the first external device to play the first media based on determining that the input corresponds to the first selectable graphical user interface object; and initiating a process for controlling playback of the second media on the first external device by the first external device based on determining that the input corresponds to the first media control selectable graphical user interface object.

[0014] According to some embodiments, a non-transitory computer-readable storage medium is described that stores one or more programs configured to be executed by one or more processors of a computer system in communication with a display generation component and one or more input devices. The one or more programs include instructions for the following operations: in response to determining that the distance between the computer system and a first external device is less than a first threshold distance: in accordance with determining that a first set of criteria is met, where the first set of criteria includes criteria met when the computer system is currently playing a first media and the first external device is playing a second media, display a media control user interface, the media control user interface including: a first selectable graphical user interface object for initiating playback of the first media on the first external device; and one or more selectable user interface objects for controlling playback of the second media on the first external device, including a first media control selectable graphical user interface object; when the media control user interface is displayed, receive input via the one or more input devices; and in response to receiving the input: in accordance with determining that the input corresponds to the first selectable graphical user interface object, initiate a process for causing the first external device to playback the first media; and in accordance with determining that the input corresponds to the first media control selectable graphical user interface object, initiate a process for controlling the playback of the second media on the first external device.

[0015] According to some embodiments, a transitory computer-readable storage medium is described that stores one or more programs configured to be executed by one or more processors of a computer system in communication with a display generation component and one or more input devices. The one or more programs include instructions for the following operations: in response to determining that the distance between the computer system and a first external device is less than a first threshold distance: in accordance with determining that a first set of criteria is met, where the first set of criteria includes criteria met when the computer system is currently playing a first media and the first external device is playing a second media, display a media control user interface, the media control user interface including: a first selectable graphical user interface object for initiating playback of the first media on the first external device; and one or more selectable user interface objects for controlling playback of the second media on the first external device, including a first media control selectable graphical user interface object; when the media control user interface is displayed, receive input via the one or more input devices; and in response to receiving the input: in accordance with determining that the input corresponds to the first selectable graphical user interface object, initiate a process for causing the first external device to playback the first media; and in accordance with determining that the input corresponds to the first media control selectable graphical user interface object, initiate a process for controlling the playback of the second media on the first external device.

[0016] According to some embodiments, a computer system is described that communicates with a display generation component and one or more input devices. The computer system includes a display generation component, one or more input devices, one or more processors, and a memory storing one or more programs configured to be executed by the one or more processors. The one or more programs include instructions for: in response to determining that the distance between the computer system and a first external device is less than a first threshold distance: displaying a media control user interface based on determining that a first set of criteria is met, where the first set of criteria includes criteria met when the computer system is currently playing a first media and the first external device is playing a second media, the media control user interface including: a first selectable graphical user interface object for initiating playback of the first media on the first external device; and one or more selectable user interface objects for controlling playback of the second media on the first external device, including a first media control selectable graphical user interface object; receiving input via the one or more input devices while the media control user interface is displayed; and in response to receiving the input: initiating a process for causing the first external device to play the first media based on determining that the input corresponds to the first selectable graphical user interface object; and initiating a process for controlling playback of the second media on the first external device by the first external device based on determining that the input corresponds to the first media control selectable graphical user interface object.

[0017] According to some embodiments, a computer system is described that communicates with a display generation component and one or more input devices. The computer system includes a display generation component, one or more input devices, and means for: in response to determining that the distance between the computer system and a first external device is less than a first threshold distance: displaying a media control user interface based on determining that a first set of criteria is met, where the first set of criteria includes criteria met when the computer system is currently playing a first media and the first external device is playing a second media, the media control user interface including: a first selectable graphical user interface object for initiating playback of the first media on the first external device; and one or more selectable user interface objects for controlling playback of the second media on the first external device, including a first media control selectable graphical user interface object; receiving input via the one or more input devices while the media control user interface is displayed; and in response to receiving the input: initiating a process for causing the first external device to play the first media based on determining that the input corresponds to the first selectable graphical user interface object; and initiating a process for controlling playback of the second media on the first external device by the first external device based on determining that the input corresponds to the first media control selectable graphical user interface object.

[0018] According to some embodiments, a method is described that is performed at a computer system in communication with a touch-sensitive surface. The touch-sensitive surface includes a first portion associated with a first operation and a second portion associated with a second operation different from the first operation. The method includes: detecting a first input via the touch-sensitive surface, wherein detecting the first input includes detecting a first contact having a corresponding size; and in response to detecting the first input: initiating a process for performing the first operation based on determining that the corresponding size of the first contact is less than a first threshold size and the first input is directed to the first portion of the touch-sensitive surface; and initiating a process for performing the second operation based on determining that the corresponding size of the first contact is less than the first threshold size and the first input is directed to the second portion of the touch-sensitive surface; and initiating a process for performing the first operation regardless of whether the first input is directed to the first portion or the second portion of the touch-sensitive surface based on determining that the corresponding size of the first contact is greater than the first threshold size.

[0019] According to some embodiments, a non-transitory computer-readable storage medium is described that stores one or more programs configured to be executed by one or more processors of a computer system in communication with a touch-sensitive surface. The touch-sensitive surface includes a first portion associated with a first operation and a second portion associated with a second operation different from the first operation. The one or more programs include instructions for: detecting a first input via the touch-sensitive surface, wherein detecting the first input includes detecting a first contact having a corresponding size; and in response to detecting the first input: initiating a process for performing the first operation based on determining that the corresponding size of the first contact is less than a first threshold size and the first input is directed to the first portion of the touch-sensitive surface; and initiating a process for performing the second operation based on determining that the corresponding size of the first contact is less than the first threshold size and the first input is directed to the second portion of the touch-sensitive surface; and initiating a process for performing the first operation regardless of whether the first input is directed to the first portion or the second portion of the touch-sensitive surface based on determining that the corresponding size of the first contact is greater than the first threshold size.

[0020] According to some embodiments, a transient computer-readable storage medium is described that stores one or more programs configured to be executed by one or more processors of a computer system in communication with a touch-sensitive surface. The touch-sensitive surface includes a first portion associated with a first operation and a second portion associated with a second operation different from the first operation. The one or more programs include instructions for: detecting a first input via the touch-sensitive surface, wherein detecting the first input includes detecting a first contact having a corresponding size; and in response to detecting the first input: initiating a process for performing the first operation based on determining that the corresponding size of the first contact is less than a first threshold size and the first input is directed to the first portion of the touch-sensitive surface; and initiating a process for performing the second operation based on determining that the corresponding size of the first contact is less than the first threshold size and the first input is directed to the second portion of the touch-sensitive surface; and initiating a process for performing the first operation regardless of whether the first input is directed to the first portion or the second portion of the touch-sensitive surface based on determining that the corresponding size of the first contact is greater than the first threshold size.

[0021] According to some embodiments, a computer system in communication with a touch-sensitive surface is described. The computer system includes a touch-sensitive surface that includes a first portion associated with a first operation and a second portion associated with a second operation different from the first operation; one or more processors; and a memory storing one or more programs configured to be executed by the one or more processors. The one or more programs include instructions for: detecting a first input via the touch-sensitive surface, wherein detecting the first input includes detecting a first contact having a corresponding size; and in response to detecting the first input: initiating a process for performing the first operation based on determining that the corresponding size of the first contact is less than a first threshold size and the first input is directed to the first portion of the touch-sensitive surface; and initiating a process for performing the second operation based on determining that the corresponding size of the first contact is less than the first threshold size and the first input is directed to the second portion of the touch-sensitive surface; and initiating a process for performing the first operation regardless of whether the first input is directed to the first portion or the second portion of the touch-sensitive surface based on determining that the corresponding size of the first contact is greater than the first threshold size.

[0022] According to some embodiments, a computer system communicating with a touch-sensitive surface is described. The computer system includes a touch-sensitive surface including a first portion associated with a first operation and a second portion associated with a second operation different from the first operation; and means for detecting a first input via the touch-sensitive surface, wherein detecting the first input includes detecting a first contact having a corresponding size; and means for: in response to detecting the first input: initiating a process for performing the first operation according to determining that the corresponding size of the first contact is less than a first threshold size and the first input points to the first portion of the touch-sensitive surface; and initiating a process for performing the second operation according to determining that the corresponding size of the first contact is less than the first threshold size and the first input points to the second portion of the touch-sensitive surface; and initiating a process for performing the first operation regardless of whether the first input points to the first portion or the second portion of the touch-sensitive surface according to determining that the corresponding size of the first contact is greater than the first threshold size.

[0023] According to some embodiments, a method performed at a computer system including a touch-sensitive display is described. The touch-sensitive display has a first portion and a second portion and includes one or more physical features that distinguish the second portion from the first portion. The method includes: outputting a visual indicator on the touch-sensitive display when the first portion of the touch-sensitive display is configured to cause the computer system to perform a first operation in response to detecting an input on the first portion, wherein the visual indicator occupies at least a subgroup of the first portion of the touch-sensitive display, wherein a first visual characteristic of the visual indicator indicates an operating state of the second portion for performing a second operation different from the first operation, including: outputting a first-varied visual indicator having the first visual characteristic according to determining that the second portion of the touch-sensitive display is operable to initiate a process for performing the second operation; and outputting a second-varied visual indicator having a first visual characteristic different from the first variation according to determining that the second portion of the touch-sensitive display is not operable to initiate a process for performing the second operation; detecting an input pointing to the touch-sensitive display; and in response to detecting the input pointing to the touch-sensitive display: initiating a process for performing the second operation according to determining that the input points to the second portion of the touch-sensitive display when the visual indicator has the first variation of the first visual characteristic; and forgoing initiating a process for performing the second operation according to determining that the input points to the second portion of the touch-sensitive display when the visual indicator has the second variation of the first visual characteristic.

[0024] According to some embodiments, a non-transitory computer-readable storage medium is described that stores one or more programs configured to be executed by one or more processors of a computer system including a touch-sensitive display. The touch-sensitive display has a first portion and a second portion and includes one or more physical features that distinguish the second portion from the first portion. The one or more programs include instructions for: outputting a visual indicator on the touch-sensitive display when the first portion of the touch-sensitive display is configured to cause the computer system to perform a first operation in response to detecting an input on the first portion, wherein the visual indicator occupies at least a subgroup of the first portion of the touch-sensitive display, and wherein a first visual characteristic of the visual indicator indicates an operating state of the second portion for performing a second operation different from the first operation, including: outputting a first-varied visual indicator having the first visual characteristic based on determining that the second portion of the touch-sensitive display is operable to initiate a process for performing the second operation; and outputting a second-varied visual indicator having a first visual characteristic different from the first variation based on determining that the second portion of the touch-sensitive display is not operable to initiate a process for performing the second operation; detecting an input directed to the touch-sensitive display; and in response to detecting the input directed to the touch-sensitive display: initiating a process for performing the second operation based on determining that the input is directed to the second portion of the touch-sensitive display when the visual indicator has the first variation of the first visual characteristic; and abandoning initiating a process for performing the second operation based on determining that the input is directed to the second portion of the touch-sensitive display when the visual indicator has the second variation of the first visual characteristic.

[0025] According to some embodiments, a transient computer-readable storage medium is described that stores one or more programs configured to be executed by one or more processors of a computer system including a touch-sensitive display. The touch-sensitive display has a first portion and a second portion and includes one or more physical features that distinguish the second portion from the first portion. The one or more programs include instructions for: outputting a visual indicator on the touch-sensitive display when the first portion of the touch-sensitive display is configured to cause the computer system to perform a first operation in response to detecting an input on the first portion, wherein the visual indicator occupies at least a subgroup of the first portion of the touch-sensitive display, and wherein a first visual characteristic of the visual indicator indicates an operating state of the second portion for performing a second operation different from the first operation, including: outputting a first-varied visual indicator having the first visual characteristic based on determining that the second portion of the touch-sensitive display is operable to initiate a process for performing the second operation; and outputting a second-varied visual indicator having a first visual characteristic different from the first variation based on determining that the second portion of the touch-sensitive display is not operable to initiate a process for performing the second operation; detecting an input directed to the touch-sensitive display; and in response to detecting the input directed to the touch-sensitive display: initiating a process for performing the second operation based on determining that the input is directed to the second portion of the touch-sensitive display when the visual indicator has the first variation of the first visual characteristic; and abandoning initiating a process for performing the second operation based on determining that the input is directed to the second portion of the touch-sensitive display when the visual indicator has the second variation of the first visual characteristic.

[0026] According to some embodiments, a computer system is described. The computer system includes a touch-sensitive display. The touch-sensitive display has a first portion and a second portion, and includes one or more physical features that distinguish the second portion from the first portion. The computer system also includes one or more processors, and a memory storing one or more programs configured to be executed by the one or more processors. The one or more programs include instructions for: outputting a visual indicator on the touch-sensitive display when the first portion of the touch-sensitive display is configured to cause the computer system to perform a first operation in response to detecting an input on the first portion, wherein the visual indicator occupies at least a subgroup of the first portion of the touch-sensitive display, and wherein a first visual characteristic of the visual indicator indicates an operating state of the second portion for performing a second operation different from the first operation, including: outputting a first-varied visual indicator having the first visual characteristic based on determining that the second portion of the touch-sensitive display is operable to initiate a process for performing the second operation; and outputting a second-varied visual indicator having a first visual characteristic different from the first variation based on determining that the second portion of the touch-sensitive display is not operable to initiate a process for performing the second operation; detecting an input directed to the touch-sensitive display; and in response to detecting the input directed to the touch-sensitive display: initiating a process for performing the second operation based on determining that the input is directed to the second portion of the touch-sensitive display when the visual indicator has the first variation of the first visual characteristic; and abandoning initiating a process for performing the second operation based on determining that the input is directed to the second portion of the touch-sensitive display when the visual indicator has the second variation of the first visual characteristic.

[0027] According to some embodiments, a computer system is described. The computer system includes a touch-sensitive display. The touch-sensitive display has a first portion and a second portion, and includes one or more physical features that distinguish the second portion from the first portion. The computer system also includes means for: outputting a visual indicator on the touch-sensitive display when the first portion of the touch-sensitive display is configured to cause the computer system to perform a first operation in response to detecting an input on the first portion, wherein the visual indicator occupies at least a subgroup of the first portion of the touch-sensitive display, and wherein a first visual characteristic of the visual indicator indicates an operating state of the second portion for performing a second operation different from the first operation, including: outputting a visually indicatory first change having the first visual characteristic in accordance with determining that the second portion of the touch-sensitive display is operable to initiate a process for performing the second operation; and outputting a visually indicatory second change having a first visual characteristic different from the first change in accordance with determining that the second portion of the touch-sensitive display is not operable to initiate a process for performing the second operation; means for detecting an input directed to the touch-sensitive display; and means for: in response to detecting an input directed to the touch-sensitive display: initiating a process for performing the second operation in accordance with determining that the input is directed to the second portion of the touch-sensitive display when the visual indicator has the first visual characteristic of the first change; and abandoning initiating a process for performing the second operation in accordance with determining that the input is directed to the second portion of the touch-sensitive display when the visual indicator has the first visual characteristic of the second change.

[0028] Executable instructions for performing these functions are optionally included in a non-transitory computer-readable storage medium or other computer program product configured to be executed by one or more processors. Executable instructions for performing these functions are optionally included in a transitory computer-readable storage medium or other computer program product configured to be executed by one or more processors.

[0029] Accordingly, faster and more efficient methods and interfaces are provided for a device to manage a media playback device, thereby enhancing the effectiveness, efficiency, and user satisfaction of such devices. Such methods and interfaces may supplement or replace other methods for managing a media playback device. BRIEF DESCRIPTION OF THE DRAWINGS

[0030] To better understand the various described embodiments, reference should be made to the following detailed description taken in conjunction with the accompanying drawings, in which like reference numerals indicate corresponding parts throughout the drawings.

[0031] Figure 1A is a block diagram showing a portable multifunctional device having a touch-sensitive display in accordance with some embodiments.

[0032] Figure 1Bis a block diagram showing exemplary components for event handling according to some embodiments.

[0033] Figure 2 shows a portable multifunctional device with a touch screen according to some embodiments.

[0034] Figure 3 is a block diagram of an exemplary multifunctional device with a display and a touch-sensitive surface according to some embodiments.

[0035] Figure 4A shows an exemplary user interface for a menu of an application on a portable multifunctional device according to some embodiments.

[0036] Figure 4B shows an exemplary user interface for a multifunctional device having a touch-sensitive surface separate from the display according to some embodiments.

[0037] Figure 5A shows a personal electronic device according to some embodiments.

[0038] Figure 5B is a block diagram showing a personal electronic device according to some embodiments.

[0039] Figures 5C - 5D shows exemplary components of a personal electronic device having a touch-sensitive display and an intensity sensor according to some embodiments.

[0040] Figures 5E - 5H shows exemplary components and a user interface of a personal electronic device according to some embodiments.

[0041] Figure 5I shows an electronic device according to some embodiments.

[0042] Figure 5J is a block diagram showing an electronic device according to some embodiments.

[0043] Figures 6A to 6X shows an exemplary user interface for managing a media playback device according to some embodiments.

[0044] Figure 7 is a flowchart showing a method for managing a media playback device according to some embodiments.

[0045] Figure 8 is a flowchart showing a method for managing a media playback device according to some embodiments.

[0046] Figures 9A to 9R shows an exemplary implementation for managing a media playback device according to some embodiments.

[0047] Figure 10 is a flowchart showing a method for managing a media playback device according to some embodiments.

[0048] Figures 11A to 11R An exemplary embodiment for managing a media playback device according to some embodiments is shown.

[0049] Figure 12A and Figure 12B depicts a flowchart showing a method for managing a media playback device according to some embodiments. DETAILED DESCRIPTION

[0050] The following description sets forth exemplary methods, parameters, etc. However, it should be recognized that such description is not intended to limit the scope of the present disclosure, but rather is provided as a description of exemplary embodiments.

[0051] An electronic device needs to provide effective methods and interfaces for managing a media playback device. For example, methods and techniques for transmitting or controlling media playback at an electronic device are described below. Such techniques can reduce the cognitive burden on a user for managing media playback across various devices, thereby increasing productivity. Additionally, such techniques can reduce processor power and battery power otherwise wasted on redundant user input.

[0052] Below Figures 1A to 1B , Figure 2 , Figure 3 , Figures 4A to 4B and Figures 5A to 5J provide a description of exemplary devices for performing techniques for managing a media playback device. Figures 6A to 6X An exemplary user interface for managing a media playback device is shown. Figure 7 and Figure 8 is a flowchart showing a method for managing a media playback device according to some embodiments. Figures 6A to 6X The user interface in Figure 7 and Figure 8 is used to show the processes described below, including the processes in Figures 9A to 9R An exemplary embodiment for managing a media playback device is shown. Figure 10 is a flowchart showing a method for managing a media playback device according to some embodiments. Figures 9A to 9R The embodiment in Figure 10 is used to show the processes described below, including the processes in Figures 11A to 11R An exemplary embodiment for managing a media playback device is shown. Figure 12A and Figure 12B depict a flowchart showing a method for managing a media playback device according to some embodiments. Figures 11A to 11RThe embodiments in are used to illustrate the processes described below, including Figure 12A and Figure 12B the processes in.

[0053] In addition, in a method where one or more of the steps described herein depend on one or more conditions being met, it should be understood that the method can be repeated in multiple iterations such that, during the repeated process, all conditions that determine the steps in the method are met in different iterations of the method. For example, if a method requires performing a first step (if a condition is met) and a second step (if the condition is not met), then one of ordinary skill in the art will know to repeat the stated steps until both the condition being met and the condition not being met (in no particular order) occur. Thus, a method described as having one or more steps that depend on one or more conditions being met can be rewritten as a method that repeats until each condition described in the method is met. However, this does not require the system or computer-readable medium to state that the system or computer-readable medium includes instructions for performing conditional operations based on the satisfaction of corresponding one or more conditions and is thus capable of determining whether the possible conditions have been met without explicitly repeating the steps of the method until all conditions that determine the steps in the method are met. One of ordinary skill in the art will also understand that, similar to a method with conditional steps, a system or computer-readable storage medium can repeat the steps of the method as many times as needed to ensure that all conditional steps have been performed.

[0054] Although the following description uses terms such as "first", "second", etc. to describe various elements, these elements should not be limited by the terms. These terms are only used to distinguish one element from another. For example, a first touch could be named a second touch and similarly a second touch could be named a first touch without departing from the scope of the various described embodiments. Both the first touch and the second touch are touches, but they are not the same touch.

[0055] The terms used in the description of the various embodiments herein are for the purpose of describing particular embodiments only and are not intended to be limiting. As used in the description of the various embodiments and the appended claims, the singular forms "a" and "the" are intended to include the plural forms as well, unless the context clearly indicates otherwise. It will also be understood that the term "and / or" as used herein refers to and encompasses any and all possible combinations of one or more of the associated listed items. It will also be understood that the terms "includes", "including", "comprises" and / or "comprising", when used in this specification, specify the presence of the stated features, integers, steps, operations, elements and / or components, but do not preclude the presence or addition of one or more other features, integers, steps, operations, elements, components and / or groups thereof.

[0056] Depending on the context, the term "if" is optionally interpreted to mean "when", "upon", or "in response to determining" or "in response to detecting". Similarly, depending on the context, the phrase "if it is determined that..." or "if [the stated condition or event] is detected" is optionally interpreted to mean "when it is determined that..." or "in response to determining..." or "when [the stated condition or event] is detected" or "in response to detecting [the stated condition or event]".

[0057] Embodiments of electronic devices, user interfaces for such devices, and related processes for using such devices are described herein. In some embodiments, the device is a portable communication device, such as a mobile phone, that also includes other functions such as PDA and / or music player functions. Exemplary embodiments of the portable multifunctional device include, but are not limited to, devices from Apple Inc. (Cupertino, California), devices, iPod devices, and Device. Optionally, other portable electronic devices are used, such as a laptop or a tablet computer having a touch-sensitive surface (e.g., a touch screen display and / or a touchpad). It should also be understood that in some embodiments, the device is not a portable communication device, but a desktop computer having a touch-sensitive surface (e.g., a touch screen display and / or a touchpad). In some embodiments, the electronic device is a computer system that communicates (e.g., via wireless communication, via wired communication) with a display generation component. The display generation component is configured to provide a visual output, such as a display via a CRT monitor, a display via an LED monitor, or a display via image projection. In some embodiments, the display generation component is integrated with the computer system. In some embodiments, the display generation component is separate from the computer system. As used herein, "displaying" content includes displaying content (e.g., video data rendered or decoded by a display controller 156) by transmitting data (e.g., image data or video data) via a wired or wireless connection to an integrated or external display generation component to visually generate the content.

[0058] In the following discussion, an electronic device including a display and a touch-sensitive surface is described. However, it should be understood that the electronic device optionally includes one or more other physical user interface devices, such as a physical keyboard, a mouse, and / or a joystick.

[0059] The device generally supports a variety of applications, such as one or more of the following: drawing applications, presentation applications, word processing applications, website creation applications, disk editing applications, spreadsheet applications, gaming applications, telephone applications, video conferencing applications, email applications, instant messaging applications, fitness support applications, photo management applications, digital camera applications, digital video camera applications, web browsing applications, digital music player applications, and / or digital video player applications.

[0060] The various applications executed on the device optionally use at least one common physical user interface device, such as a touch-sensitive surface. One or more functions of the touch-sensitive surface and the corresponding information displayed on the device are optionally adjusted and / or varied for different applications, and / or within the respective applications. Thus, a common physical architecture of the device, such as a touch-sensitive surface, optionally supports a variety of applications with a user interface that is intuitive and clear to the user.

[0061] Attention is now turned to embodiments of a portable device having a touch-sensitive display. Figure 1AFIG. 0 is a block diagram of a portable multifunctional device 100 having a touch-sensitive display system 112 in accordance with some embodiments. The touch-sensitive display 112 is sometimes called a "touch screen" for convenience and is sometimes known as or called a "touch-sensitive display system". The device 100 includes memory 102 (which optionally includes one or more computer-readable storage media), a memory controller 122, one or more processing units (CPUs) 120, a peripheral device interface 118, an RF circuit 108, an audio circuit 110, a speaker 111, a microphone 113, an input / output (I / O) subsystem 106, other input control devices 116, and an external port 124. The device 100 optionally includes one or more optical sensors 164. The device 100 optionally includes one or more contact intensity sensors 165 for detecting the intensity of contacts on the device 100 (e.g., a touch-sensitive surface such as the touch-sensitive display system 112 of the device 100). The device 100 optionally includes one or more tactile output generators 167 for generating tactile outputs on the device 100 (e.g., generating tactile outputs on a touch-sensitive surface such as the touch-sensitive display system 112 of the device 100 or the touchpad 355 of the device 300). These components optionally communicate over one or more communication buses or signal lines 103.

[0062] As used in this specification and the claims, the "intensity" of a contact on a touch-sensitive surface refers to the force or pressure (force per unit area) of a contact (e.g., a finger contact) on the touch-sensitive surface, or to a surrogate for the force or pressure of a contact on the touch-sensitive surface. The intensity of a contact has a range of values that includes at least four different values and more typically includes hundreds of different values (e.g., at least 256). The intensity of a contact is optionally determined (or measured) using a variety of methods and a variety of sensors or combinations of sensors. For example, one or more force sensors beneath or adjacent to the touch-sensitive surface are optionally used to measure the force at different points on the touch-sensitive surface. In some embodiments, force measurements from multiple force sensors are combined (e.g., weighted averaged) to determine the estimated contact force. Similarly, the pressure-sensitive tip of a stylus is optionally used to determine the pressure of the stylus on the touch-sensitive surface. Alternatively, the size and / or change thereof of the contact area detected on the touch-sensitive surface, the capacitance and / or change thereof of the touch-sensitive surface near the contact, and / or the resistance and / or change thereof of the touch-sensitive surface near the contact are optionally used as surrogates for the force or pressure of a contact on the touch-sensitive surface. In some embodiments, the surrogate measurements of the contact force or pressure are directly used to determine whether an intensity threshold has been exceeded (e.g., the intensity threshold is described in units corresponding to the surrogate measurements). In some embodiments, the surrogate measurements of the contact force or pressure are converted into an estimated force or pressure, and the estimated force or pressure is used to determine whether the intensity threshold has been exceeded (e.g., the intensity threshold is a pressure threshold measured in units of pressure). Using the intensity of a contact as an attribute of a user input allows a user to access additional device functions that would otherwise be inaccessible to the user on a smaller device with limited footprint, the smaller device being used to (e.g., on a touch-sensitive display) display affordances and / or receive user input (e.g., via a touch-sensitive display, a touch-sensitive surface, or physical / mechanical controls such as knobs or buttons).

[0063] As used in this specification and the claims, the term "haptic output" refers to a physical displacement of a device relative to a previous position of the device detected by a user using the user's sense of touch, a physical displacement of a component of the device (e.g., a touch-sensitive surface) relative to another component of the device (e.g., a housing), or a displacement of a component relative to the center of mass of the device. For example, in the case of contact between the device or a component of the device and a surface that is sensitive to touch by the user (e.g., a finger, palm, or other part of the user's hand), the haptic output generated by the physical displacement will be interpreted by the user as a sense of touch that corresponds to a perceived change in the physical characteristics of the device or the component of the device. For example, movement of a touch-sensitive surface (e.g., a touch-sensitive display or a touchpad) may optionally be interpreted by the user as a "press click" or "release click" of a physical actuation button. In some cases, the user will feel a sense of touch, such as a "press click" or "release click", even when the physical actuation button associated with the touch-sensitive surface that is physically depressed (e.g., displaced) by the user's movement does not move. As another example, movement of a touch-sensitive surface may optionally be interpreted or sensed by the user as a "roughness" of the touch-sensitive surface even when there is no change in the smoothness of the touch-sensitive surface. Although such interpretations of touch by the user will be limited by the user's individual sensory perception, many sensory perceptions of touch are common to most users. Thus, when a haptic output is described as corresponding to a particular sensory perception of the user (e.g., "press click", "release click", "roughness"), unless otherwise stated, the haptic output generated corresponds to a physical displacement of the device or a component thereof that would generate the stated sensory perception of a typical (or average) user.

[0064] It should be understood that device 100 is merely an example of a portable multifunctional device, and device 100 may optionally have more or fewer components than those shown, may optionally combine two or more components, or may optionally have a different configuration or arrangement of these components. Figure 1A The various components shown are implemented in hardware, software, or a combination of both hardware and software, including one or more signal processing and / or application specific integrated circuits.

[0065] Memory 102 optionally includes high-speed random access memory and also optionally includes non-volatile memory, such as one or more disk storage devices, flash memory devices, or other non-volatile solid state memory devices. Memory controller 122 optionally controls access to memory 102 by other components of device 100.

[0066] The peripheral device interface 118 can be used to couple input and output peripheral devices of the device to the CPU 120 and the memory 102. The one or more processors 120 run or execute various software programs (such as computer programs (e.g., including instructions)) and / or instruction sets stored in the memory 102 to perform various functions of the device 100 and process data. In some embodiments, the peripheral device interface 118, the CPU 120, and the memory controller 122 are optionally implemented on a single chip such as chip 104. In some other embodiments, they are optionally implemented on separate chips.

[0067] The RF (Radio Frequency) circuit 108 receives and transmits RF signals, which are also referred to as electromagnetic signals. The RF circuit 108 converts electrical signals into electromagnetic signals / converts electromagnetic signals into electrical signals, and communicates with a communication network and other communication devices via electromagnetic signals. The RF circuit 108 optionally includes well-known circuits for performing these functions, including but not limited to an antenna system, an RF transceiver, one or more amplifiers, a tuner, one or more oscillators, a digital signal processor, a codec chipset, a subscriber identity module (SIM) card, a memory, and so on. The RF circuit 108 optionally communicates with the network and other devices via wireless communication, and these networks are such as the Internet (also known as the World Wide Web (WWW)), an intranet, and / or a wireless network (such as a cellular phone network, a wireless local area network (LAN), and / or a metropolitan area network (MAN)). The RF circuit 108 optionally includes well-known circuits for detecting a near field communication (NFC) field, such as via a short-range communication radio component. The wireless communication optionally uses any one of a variety of communication standards, protocols, and technologies, including but not limited to Global System for Mobile Communications (GSM), Enhanced Data GSM Environment (EDGE), High-Speed Downlink Packet Access (HSDPA), High-Speed Uplink Packet Access (HSUPA), Evolution-Data Only (EV-DO), HSPA, HSPA+, Dual-Cell HSPA (DC-HSPDA), Long-Term Evolution (LTE), Near Field Communication (NFC), Wideband Code Division Multiple Access (W-CDMA), Code Division Multiple Access (CDMA), Time Division Multiple Access (TDMA), Bluetooth, Bluetooth Low Energy (BTLE), Wi-Fi (e.g., IEEE 802.11a, IEEE 802.11b, IEEE 802.11g, IEEE 802.11n, and / or IEEE 802.11ac), Voice over Internet Protocol (VoIP), WiMAX, email protocols (e.g., Internet Message Access Protocol (IMAP) and / or Post Office Protocol (POP)), instant messaging (e.g., Extensible Messaging and Presence Protocol (XMPP), Session Initiation Protocol for Instant Messaging and Presence Leveraging Extensions (SIMPLE), Instant Messaging and Presence Service (IMPS)), and / or Short Message Service (SMS), or any other suitable communication protocol, including communication protocols not yet developed as of the date of submission of this document.

[0068] The audio circuit 110, speaker 111, and microphone 113 provide an audio interface between the user and the device 100. The audio circuit 110 receives audio data from the peripheral device interface 118, converts the audio data into an electrical signal, and transmits the electrical signal to the speaker 111. The speaker 111 converts the electrical signal into sound waves audible to humans. The audio circuit 110 also receives the electrical signal converted from sound waves by the microphone 113. The audio circuit 110 converts the electrical signal into audio data and transmits the audio data to the peripheral device interface 118 for processing. The audio data is optionally retrieved from and / or transmitted to the memory 102 and / or the RF circuit 108 by the peripheral device interface 118. In some embodiments, the audio circuit 110 also includes an earphone jack (e.g., Figure 2 212 in

[0069] The I / O subsystem 106 couples input / output peripheral devices such as the touch screen 112 and other input control devices 116 on the device 100 to the peripheral device interface 118. The I / O subsystem 106 optionally includes a display controller 156, an optical sensor controller 158, a depth camera controller 169, an intensity sensor controller 159, a haptic feedback controller 161, and one or more input controllers 160 for other input or control devices. The one or more input controllers 160 receive electrical signals from / transmit electrical signals to the other input control devices 116. The other input control devices 116 optionally include physical buttons (e.g., push buttons, rocker buttons, etc.), dials, slide switches, joysticks, click wheels, etc. In some embodiments, the input controller 160 is optionally coupled to (or not coupled to) any of the following: a keyboard, an infrared port, a USB port, and a pointing device such as a mouse. One or more buttons (e.g., Figure 2 208 in Figure 2206) in. In some embodiments, the electronic device is a computer system that communicates with one or more input devices (e.g., via wireless communication, via wired communication). In some embodiments, the one or more input devices include a touch-sensitive surface (e.g., a touchpad, as part of a touch-sensitive display). In some embodiments, the one or more input devices include one or more camera sensors (e.g., one or more optical sensors 164 and / or one or more depth camera sensors 175), such as for tracking a user's gestures (e.g., hand gestures) as input. In some embodiments, the one or more input devices are integrated with the computer system. In some embodiments, the one or more input devices are separate from the computer system.

[0070] Quickly pressing the depress button optionally disengages the lock of the touch screen 112 or optionally starts the process of unlocking the device using gestures on the touch screen, as described in U.S. Patent Application No. 11 / 322,549, filed on December 23, 2005, entitled "Unlocking a Device by Performing Gestures on an Unlock Image" (i.e., U.S. Patent No. 7,657,849), which is hereby incorporated by reference in its entirety. Long pressing the depress button (e.g., 206) optionally powers on or powers off the device 100. The functions of the one or more buttons are optionally user-customizable. The touch screen 112 is used to implement virtual buttons or soft buttons and one or more soft keyboards.

[0071] The touch-sensitive display 112 provides an input interface and an output interface between the device and the user. The display controller 156 receives electrical signals from the touch screen 112 and / or sends electrical signals to the touch screen 112. The touch screen 112 displays visual output to the user. The visual output optionally includes graphics, text, icons, videos, and any combination thereof (collectively referred to as "graphics"). In some embodiments, some or all of the visual output optionally corresponds to user interface objects.

[0072] The touch screen 112 has a touch-sensitive surface, sensor, or group of sensors that accepts input from the user based on tactile and / or haptic contact. The touch screen 112 and the display controller 156 (along with any associated modules and / or instruction sets in the memory 102) detect contact (and any movement or interruption of the contact) on the touch screen 112 and convert the detected contact into an interaction with user interface objects (e.g., one or more soft keys, icons, web pages, or images) displayed on the touch screen 112. In an exemplary embodiment, the point of contact between the touch screen 112 and the user corresponds to the user's finger.

[0073] The touch screen 112 optionally uses LCD (liquid crystal display) technology, LPD (light emitting polymer display) technology, or LED (light emitting diode) technology, but other display technologies are used in other embodiments. The touch screen 112 and the display controller 156 optionally use any of a variety of touch sensing technologies now known or later developed, as well as other proximity sensor arrays or other elements for determining one or more points of contact with the touch screen 112 to detect contact and any movement or interruption thereof, the variety of touch sensing technologies including but not limited to capacitive, resistive, infrared, and surface acoustic wave technologies. In an exemplary embodiment, projected mutual capacitance sensing technology is used, such as the technology used in and the iPod as used in.

[0074] The touch-sensitive display in some embodiments of the touch screen 112 optionally resembles the multi-touch sensitive touchpad described in the following U.S. patents: 6,323,846 (Westerman et al.), 6,570,557 (Westerman et al.), and / or 6,677,932 (Westerman et al.) and / or U.S. Patent Publication 2002 / 0015024A1, each of which is hereby incorporated by reference in its entirety. However, the touch screen 112 displays the visual output from the device 100, while the touch-sensitive touchpad does not provide a visual output.

[0075] Some implementations of the touch-sensitive display in touch screen 112 are described in the following applications: (1) U.S. Patent Application No. 11 / 381,313, "Multipoint Touch Surface Controller," filed May 2, 2006; (2) U.S. Patent Application No. 10 / 840,862, "Multipoint Touchscreen," filed May 6, 2004; (3) U.S. Patent Application No. 10 / 903,964, "Gestures For Touch Sensitive Input Devices," filed Jul. 30, 2004; (4) U.S. Patent Application No. 11 / 048,264, "Gestures For Touch Sensitive Input Devices," filed Jan. 31, 2005; (5) U.S. Patent Application No. 11 / 038,590, "Mode-Based Graphical User Interfaces For Touch Sensitive Input Devices," filed Jan. 18, 2005; (6) U.S. Patent Application No. 11 / 228,758, "Virtual Input Device Placement On A Touch Screen User Interface," filed Sep. 16, 2005; (7) U.S. Patent Application No. 11 / 228,700, "Operation Of A Computer With A Touch Screen Interface," filed Sep. 16, 2005; (8) U.S. Patent Application No. 11 / 228,737, "Activating Virtual Keys Of A Touch-Screen Virtual Keyboard," filed Sep. 16, 2005; and (9) U.S. Patent Application No. 11 / 367,749, "Multi-Functional Hand-Held Device," filed Mar. 3, 2006. All of these applications are hereby incorporated by reference in their entirety.

[0076] The touch screen 112 optionally has a video resolution of more than 100 dpi. In some embodiments, the touch screen has a video resolution of approximately 160 dpi. The user optionally uses any suitable object or attachment such as a stylus, finger, etc. to contact the touch screen 112. In some embodiments, the user interface is designed to work primarily through finger-based contact and gestures, which may not be as precise as stylus-based input due to the larger contact area of the finger on the touch screen. In some embodiments, the device converts the rough finger-based input into an accurate pointer / cursor position or command for performing the action desired by the user.

[0077] In some embodiments, in addition to the touch screen, the device 100 optionally further includes a touchpad for activating or deactivating specific functions. In some embodiments, the touchpad is a touch-sensitive area of the device, which, unlike the touch screen, does not display a visual output. The touchpad is optionally a touch-sensitive surface separate from the touch screen 112, or an extension of the touch-sensitive surface formed by the touch screen.

[0078] The device 100 further includes a power system 162 for powering various components. The power system 162 optionally includes a power management system, one or more power sources (e.g., batteries, alternating current (AC)), a recharge system, a power failure detection circuit, a power converter or inverter, a power status indicator (e.g., a light-emitting diode (LED)), and any other components associated with the generation, management, and distribution of power in a portable device.

[0079] The device 100 optionally further includes one or more optical sensors 164. Figure 1AShows an optical sensor coupled to an optical sensor controller 158 in the I / O subsystem 106. The optical sensor 164 optionally includes a charge-coupled device (CCD) or a complementary metal-oxide semiconductor (CMOS) phototransistor. The optical sensor 164 receives light projected through one or more lenses from the environment and converts the light into data representing an image. In conjunction with the imaging module 143 (also called the camera module), the optical sensor 164 optionally captures still images or video. In some embodiments, the optical sensor is located on the rear of the device 100, opposite the touchscreen display 112 on the front of the device, such that the touchscreen display can be used as a viewfinder for still image and / or video image capture. In some embodiments, the optical sensor is located on the front of the device such that an image of the user can optionally be captured for a video conference while the user views other video conference participants on the touchscreen display. In some embodiments, the position of the optical sensor 164 can be changed by the user (e.g., by rotating the lens and sensor in the device housing) such that a single optical sensor 164 can be used with the touchscreen display for both video conferencing and still image and / or video image capture.

[0080] The device 100 optionally further includes one or more depth camera sensors 175. Figure 1A Shows a depth camera sensor coupled to a depth camera controller 169 in the I / O subsystem 106. The depth camera sensor 175 receives data from the environment to create a three-dimensional model of an object (e.g., a face) within a scene from a viewpoint (e.g., the depth camera sensor). In some embodiments, in conjunction with the imaging module 143 (also referred to as the camera module), the depth camera sensor 175 is optionally used to determine depth maps of different portions of an image captured by the imaging module 143. In some embodiments, the depth camera sensor is located on the front of the device 100 such that an image of the user with depth information can optionally be captured for a video conference while the user views other video conference participants on the touchscreen display, and a selfie with depth map data can be captured. In some embodiments, the depth camera sensor 175 is located on the rear of the device, or on both the rear and front of the device 100. In some embodiments, the position of the depth camera sensor 175 can be changed by the user (e.g., by rotating the lens and sensor in the device housing) such that the depth camera sensor 175 can be used with the touchscreen display for both video conferencing and still image and / or video image capture.

[0081] The device 100 optionally further includes one or more contact intensity sensors 165. Figure 1AA contact intensity sensor coupled to the intensity sensor controller 159 in the I / O subsystem 106 is shown. The contact intensity sensor 165 optionally includes one or more piezoresistive strain gauges, capacitive force sensors, electrical force sensors, piezoelectric force sensors, optical force sensors, capacitive touch-sensitive surfaces, or other intensity sensors (e.g., sensors for measuring the force (or pressure) of a contact on a touch-sensitive surface). The contact intensity sensor 165 receives contact intensity information (e.g., pressure information or a surrogate for pressure information) from the environment. In some embodiments, at least one contact intensity sensor is juxtaposed or adjacent to a touch-sensitive surface (e.g., the touch-sensitive display system 112). In some embodiments, at least one contact intensity sensor is located on the rear of the device 100, opposite the touchscreen display 112 located on the front of the device 100).

[0082] The device 100 optionally further includes one or more proximity sensors 166. Figure 1A A proximity sensor 166 coupled to the peripheral device interface 118 is shown. Alternatively, the proximity sensor 166 is optionally coupled to the input controller 160 in the I / O subsystem 106. The proximity sensor 166 optionally operates as described in the following U.S. patent applications: No. 11 / 241,839, entitled "Proximity Detector In Handheld Device"; No. 11 / 240,788, entitled "Proximity Detector In Handheld Device"; No. 11 / 620,702, entitled "Using Ambient Light Sensor To Augment Proximity Sensor Output"; No. 11 / 586,862, entitled "Automated Response To And Sensing Of User Activity In Portable Devices"; and No. 11 / 638,251, entitled "Methods And Systems For Automatic Configuration Of Peripherals", which U.S. patent applications are hereby incorporated by reference in their entirety. In some embodiments, when the multifunctional device is placed near the user's ear (e.g., when the user is making a phone call), the proximity sensor turns off and disables the touchscreen 112.

[0083] The device 100 optionally further includes one or more haptic output generators 167. Figure 1AIllustrated is a haptic output generator coupled to haptic feedback controller 161 in I / O subsystem 106. The haptic output generator 167 optionally includes one or more electroacoustic devices such as speakers or other audio components; and / or electromechanical devices for converting energy into linear motion such as motors, solenoids, electroactive polymers, piezoelectric actuators, electrostatic actuators, or other haptic output generating components (e.g., components for converting an electrical signal into a haptic output on the device). The contact intensity sensor 165 receives haptic feedback generation instructions from the haptic feedback module 133 and generates a haptic output on device 100 that can be felt by a user of device 100. In some embodiments, at least one haptic output generator is juxtaposed or adjacent to a touch-sensitive surface (e.g., touch-sensitive display system 112), and optionally generates a haptic output by moving the touch-sensitive surface vertically (e.g., into / out of the surface of device 100) or laterally (e.g., backward and forward in the same plane as the surface of device 100). In some embodiments, at least one haptic output generator sensor is located on the rear of device 100, opposite the touch screen display 112 located on the front of device 100.

[0084] Device 100 optionally further includes one or more accelerometers 168. Figure 1A Illustrated is accelerometer 168 coupled to peripheral device interface 118. Alternatively, accelerometer 168 is optionally coupled to input controller 160 in I / O subsystem 106. Accelerometer 168 optionally operates as described in the following U.S. Patent Publications: U.S. Patent Publication No. 20050190059, titled "Acceleration-based Theft Detection System for Portable Electronic Devices" and U.S. Patent Publication No. 20060017692, titled "Methods And Apparatuses For Operating A Portable Device Based On An Accelerometer", both of which are hereby incorporated by reference in their entireties. In some embodiments, information is displayed in a portrait view or a landscape view on the touch screen display based on an analysis of data received from one or more accelerometers. Device 100 optionally further includes a magnetometer and a GPS (or GLONASS or other global navigation system) receiver in addition to accelerometer 168 for obtaining information about the location and orientation (e.g., portrait or landscape) of device 100.

[0085] In some embodiments, the software components stored in the memory 102 include an operating system 126, a communication module (or instruction set) 128, a touch / motion module (or instruction set) 130, a graphics module (or instruction set) 132, a text input module (or instruction set) 134, a Global Positioning System (GPS) module (or instruction set) 135, and application programs (or instruction sets) 136. Additionally, in some embodiments, the memory 102 ( Figure 1A ) or 370 ( Figure 3 ) stores a device / global internal state 157, as shown in Figure 1A and Figure 3 . The device / global internal state 157 includes one or more of the following: an active application state, which indicates which applications (if any) are currently active; a display state, indicating what applications, views, or other information occupy the various regions of the touchscreen display 112; a sensor state, including information obtained from the various sensors and input control devices 116 of the device; and location information related to the location and / or orientation of the device.

[0086] The operating system 126 (e.g., Darwin, RTXC, LINUX, UNIX, OS X, iOS, WINDOWS, or an embedded operating system such as VxWorks) includes various software components and / or drivers for controlling and managing general system tasks (e.g., memory management, storage device control, power management, etc.), and facilitates communication between the various hardware components and software components.

[0087] The communication module 128 facilitates communication with other devices via one or more external ports 124, and also includes various software components for processing data received by the RF circuit 108 and / or the external ports 124. The external ports 124 (e.g., Universal Serial Bus (USB), FireWire, etc.) are adapted to be directly coupled to other devices, or indirectly coupled via a network (e.g., the Internet, a wireless LAN, etc.). In some embodiments, the external port is the same as or similar to and / or compatible with the 30-pin connector used on (a trademark of Apple Inc.) devices, a multi-pin (e.g., 30-pin) connector.

[0088] The contact / motion module 130 optionally detects contact with the touch screen 112 (in conjunction with the display controller 156) and other touch-sensitive devices (e.g., a touchpad or a physical click wheel). The contact / motion module 130 includes various software components for performing various operations related to contact detection, such as determining whether contact has occurred (e.g., detecting a finger press event), determining the intensity of the contact (e.g., the force or pressure of the contact, or a surrogate for the force or pressure of the contact), determining whether there is movement of the contact and tracking the movement on the touch-sensitive surface (e.g., detecting one or more finger drag events), and determining whether the contact has ceased (e.g., detecting a finger lift event or contact break). The contact / motion module 130 receives contact data from the touch-sensitive surface. Determining the movement of the contact point optionally includes determining the rate (magnitude), velocity (magnitude and direction), and / or acceleration (change in magnitude and / or direction) of the contact point, the movement of the contact point being represented by a series of contact data. These operations are optionally applied to single-point contact (e.g., single-finger contact) or multi-point simultaneous contact (e.g., "multi-touch" / multiple finger contact). In some embodiments, the contact / motion module 130 and the display controller 156 detect contact on the touchpad.

[0089] In some embodiments, the contact / motion module 130 uses a set of one or more intensity thresholds to determine whether an operation has been performed by the user (e.g., determining whether the user has "clicked" on an icon). In some embodiments, at least a subset of the intensity thresholds is determined based on software parameters (e.g., the intensity thresholds are not determined by the activation threshold of a particular physical actuator and can be adjusted without changing the physical hardware of the device 100). For example, the mouse "click" threshold of a touchpad or touch screen can be set to any one of a wide range of predefined thresholds without changing the touchpad or touch screen display hardware. Additionally, in some implementations, software settings are provided to the user of the device for adjusting one or more of the intensity thresholds in a set of intensity thresholds (e.g., by adjusting individual intensity thresholds and / or by using a system-level click on an "intensity" parameter to adjust multiple intensity thresholds at once).

[0090] The contact / motion module 130 optionally detects gesture inputs made by a user. Different gestures on the touch-sensitive surface have different contact patterns (e.g., different motions, timings, and / or intensities of the detected contacts). Thus, gestures are optionally detected by detecting a particular contact pattern. For example, detecting a finger tap gesture includes detecting a finger down event and then detecting a finger lift (lift-off) event at the same position (or substantially the same position) as the finger down event (e.g., at the position of an icon). As another example, detecting a finger swipe gesture on the touch-sensitive surface includes detecting a finger down event, then detecting one or more finger drag events, and subsequently detecting a finger lift (lift-off) event.

[0091] The graphics module 132 includes various known software components for presenting and displaying graphics on the touch screen 112 or other display, including components for altering the visual impact of the displayed graphics (e.g., brightness, transparency, saturation, contrast, or other visual attributes). As used herein, the term "graphics" includes any object that can be displayed to a user, including but not limited to text, web pages, icons (such as user interface objects including soft keys), digital images, videos, animations, etc.

[0092] In some embodiments, the graphics module 132 stores data representing the graphics to be used. Each graphic is optionally assigned a corresponding code. The graphics module 132 receives one or more codes for specifying the graphics to be displayed from an application, etc., and also receives coordinate data and other graphic attribute data as necessary, and then generates screen image data for output to the display controller 156.

[0093] The haptic feedback module 133 includes various software components for generating instructions that are used by the haptic output generator 167 to generate haptic output at one or more locations on the device 100 in response to user interaction with the device 100.

[0094] The text input module 134, which is optionally a component of the graphics module 132, provides a soft keyboard for entering text in various applications (e.g., contacts 137, email 140, IM 141, browser 147, and any other application that requires text input).

[0095] The GPS module 135 determines the location of the device and provides this information for use in various applications (e.g., provided to the phone 138 for use in location-based dialing; provided to the camera 143 as picture / video metadata; and provided to applications that provide location-based services, such as weather widgets, local yellow pages widgets, and map / navigation widgets).

[0096] The application 136 optionally includes the following modules (or instruction sets) or subsets or supersets thereof:

[0097] · A contacts module 137 (sometimes referred to as an address book or contact list);

[0098] · A phone module 138;

[0099] · A video conferencing module 139;

[0100] · An email client module 140;

[0101] · An instant messaging (IM) module 141;

[0102] · A fitness support module 142;

[0103] · A camera module 143 for still images and / or video images;

[0104] · An image management module 144;

[0105] · A video player module;

[0106] · A music player module;

[0107] · A browser module 147;

[0108] · A calendar module 148;

[0109] · A widget module 149, which optionally includes one or more of the following: a weather widget 149-1, a stock market widget 149-2, a calculator widget 149-3, an alarm clock widget 149-4, a dictionary widget 149-5, and other widgets obtained by the user, as well as user-created widgets 149-6;

[0110] · A widget creator module 150 for forming user-created widgets 149-6;

[0111] · A search module 151;

[0112] · A video and music player module 152, which combines the video player module and the music player module;

[0113] · A notes module 153;

[0114] · A maps module 154; and / or

[0115] · An online video module 155.

[0116] Examples of other application programs 136 that are optionally stored in the memory 102 include other word processing applications, other image editing applications, drawing applications, presentation applications, JAVA-enabled applications, encryption, digital rights management, voice recognition, and voice reproduction.

[0117] In conjunction with the touch screen 112, the display controller 156, the contact / motion module 130, the graphics module 132, and the text input module 134, the contacts module 137 is optionally used to manage an address book or a contacts list (e.g., in the application internal state 192 of the contacts module 137 stored in the memory 102 or the memory 370), including: adding one or more names to the address book; deleting names from the address book; associating a phone number, an email address, a physical address, or other information with a name; associating an image with a name; classifying and categorizing names; providing a phone number or an email address to initiate and / or facilitate communication via the phone 138, the video conferencing module 139, the email 140, or the IM 141; and so on.

[0118] In conjunction with the RF circuit 108, the audio circuit 110, the speaker 111, the microphone 113, the touch screen 112, the display controller 156, the contact / motion module 130, the graphics module 132, and the text input module 134, the phone module 138 is optionally used to input a character sequence corresponding to a phone number, access one or more phone numbers in the contacts module 137, modify the input phone number, dial the corresponding phone number, conduct a session, and disconnect or hang up when the session is completed. As described above, the wireless communication optionally uses any one of a variety of communication standards, protocols, and technologies.

[0119] In conjunction with the RF circuit 108, the audio circuit 110, the speaker 111, the microphone 113, the touch screen 112, the display controller 156, the optical sensor 164, the optical sensor controller 158, the contact / motion module 130, the graphics module 132, the text input module 134, the contacts module 137, and the phone module 138, the video conferencing module 139 includes executable instructions for initiating, conducting, and terminating a video conference between the user and one or more other participants according to user instructions.

[0120] In conjunction with the RF circuit 108, the touch screen 112, the display controller 156, the contact / motion module 130, the graphics module 132, and the text input module 134, the email client module 140 includes executable instructions for creating, sending, receiving, and managing emails in response to user instructions. In conjunction with the image management module 144, the email client module 140 makes it very easy to create and send emails with static images or video images taken by the camera module 143.

[0121] In combination with the RF circuit 108, the touch screen 112, the display controller 156, the contact / motion module 130, the graphics module 132, and the text input module 134, the instant messaging module 141 includes executable instructions for the following operations: inputting a character sequence corresponding to an instant message, modifying a previously input character, transmitting the corresponding instant message (e.g., using the Short Message Service (SMS) or Multimedia Message Service (MMS) protocol for phone-based instant messaging or using XMPP, SIMPLE, or IMPS for Internet-based instant messaging), receiving an instant message, and viewing the received instant message. In some embodiments, the transmitted and / or received instant messages optionally include graphics, photos, audio files, video files, and / or other attachments supported in MMS and / or Enhanced Messaging Service (EMS). As used herein, "instant message" refers to both phone-based messages (e.g., messages sent using SMS or MMS) and Internet-based messages (e.g., messages sent using XMPP, SIMPLE, or IMPS).

[0122] In combination with the RF circuit 108, the touch screen 112, the display controller 156, the contact / motion module 130, the graphics module 132, the text input module 134, the GPS module 135, the map module 154, and the music player module, the fitness support module 142 includes executable instructions for creating a fitness (e.g., having time, distance, and / or calorie burn goals); communicating with a fitness sensor (exercise device); receiving fitness sensor data; calibrating the sensors for monitoring fitness; selecting and playing music for the fitness; and displaying, storing, and transmitting fitness data.

[0123] In combination with the touch screen 112, the display controller 156, the optical sensor 164, the optical sensor controller 158, the contact / motion module 130, the graphics module 132, and the image management module 144, the camera module 143 includes executable instructions for the following operations: capturing a still image or video (including a video stream) and storing them in the memory 102, modifying the characteristics of the still image or video, or deleting the still image or video from the memory 102.

[0124] In combination with the touch screen 112, the display controller 156, the contact / motion module 130, the graphics module 132, the text input module 134, and the camera module 143, the image management module 144 includes executable instructions for arranging, modifying (e.g., editing), or otherwise manipulating, tagging, deleting, presenting (e.g., in a digital slide show or album), and storing still images and / or video images.

[0125] In combination with RF circuit 108, touch screen 112, display controller 156, contact / motion module 130, graphics module 132, and text input module 134, browser module 147 includes executable instructions for browsing the Internet according to user instructions, including searching, linking to, receiving, and displaying web pages or portions thereof, and linking to attachments and other files of web pages.

[0126] In combination with RF circuit 108, touch screen 112, display controller 156, contact / motion module 130, graphics module 132, text input module 134, email client module 140, and browser module 147, calendar module 148 includes executable instructions for creating, displaying, modifying, and storing calendars and data associated with the calendars (e.g., calendar entries, to-do items, etc.) according to user instructions.

[0127] In combination with RF circuit 108, touch screen 112, display controller 156, contact / motion module 130, graphics module 132, text input module 134, and browser module 147, widget module 149 is a mini - application optionally downloaded and used by the user (e.g., weather widget 149 - 1, stock market widget 149 - 2, calculator widget 149 - 3, alarm clock widget 149 - 4, and dictionary widget 149 - 5) or a mini - application created by the user (e.g., user - created widget 149 - 6). In some embodiments, widgets include HTML (HyperText Markup Language) files, CSS (Cascading Style Sheets) files, and JavaScript files. In some embodiments, widgets include XML (Extensible Markup Language) files and JavaScript files (e.g., Yahoo! widgets).

[0128] In combination with RF circuit 108, touch screen 112, display controller 156, contact / motion module 130, graphics module 132, text input module 134, and browser module 147, widget creator module 150 is optionally used by the user to create widgets (e.g., transforming a user - specified portion of a web page into a widget).

[0129] In combination with touch screen 112, display controller 156, contact / motion module 130, graphics module 132, and text input module 134, search module 151 includes executable instructions for searching memory 102 for text, music, sound, images, videos, and / or other files that match one or more search criteria (e.g., one or more user - specified search terms) according to user instructions.

[0130] In combination with touch screen 112, display controller 156, contact / motion module 130, graphics module 132, audio circuit 110, speaker 111, RF circuit 108, and browser module 147, video and music player module 152 includes executable instructions that allow a user to download and play back recorded music and other sound files stored in one or more file formats such as MP3 or AAC files, as well as executable instructions for displaying, presenting, or otherwise playing back video (e.g., on touch screen 112 or on an external display connected via external port 124). In some embodiments, device 100 optionally includes the functionality of an MP3 player such as an iPod (a trademark of Apple Inc.).

[0131] In combination with touch screen 112, display controller 156, contact / motion module 130, graphics module 132, and text input module 134, note module 153 includes executable instructions for creating and managing notes, to-do lists, etc. in accordance with user instructions.

[0132] In combination with RF circuit 108, touch screen 112, display controller 156, contact / motion module 130, graphics module 132, text input module 134, GPS module 135, and browser module 147, map module 154 is optionally used to receive, display, modify, and store maps and data associated with the maps (e.g., driving directions, data related to stores and other points of interest at or near a particular location, and other location-based data) in accordance with user instructions.

[0133] In combination with touch screen 112, display controller 156, contact / motion module 130, graphics module 132, audio circuit 110, speaker 111, RF circuit 108, text input module 134, e-mail client module 140, and browser module 147, online video module 155 includes instructions for performing the following operations: allowing a user to access, browse, receive (e.g., via streaming and / or downloading), play back (e.g., on the touch screen or on an external display connected via external port 124), send an e-mail with a link to a particular online video, and otherwise manage online videos in one or more file formats such as H.264. In some embodiments, the instant message module 141 is used instead of the e-mail client module 140 to send a link to a particular online video. Other descriptions of the online video application can be found in U.S. Provisional Patent Application No. 60 / 936,562, filed Jun. 20, 2007, and titled “Portable Multifunction Device, Method, and Graphical User Interface for Playing Online Videos,” and U.S. Patent Application No. 11 / 968,067, filed Dec. 31, 2007, and titled “Portable Multifunction Device, Method, and Graphical User Interface for Playing Online Videos,” the contents of both of which are hereby incorporated by reference in their entirety.

[0134] Each of the above-described modules and applications corresponds to a set of executable instructions for performing one or more of the above-described functions and the methods described in this patent application (e.g., the computer-implemented methods and other information processing methods described herein). These modules (e.g., sets of instructions) need not be implemented as separate software programs (such as computer programs (e.g., including instructions)), processes, or modules, and thus various subsets of these modules are optionally combined or otherwise rearranged in various embodiments. For example, the video player module is optionally combined with the music player module into a single module (e.g., Figure 1A the video and music player module 152 in ). In some embodiments, memory 102 optionally stores a subgroup of the above-described modules and data structures. Additionally, memory 102 optionally stores additional modules and data structures not described above.

[0135] In some embodiments, device 100 is a device in which operation of a predefined set of functions on the device is performed uniquely via a touch screen and / or a touchpad. By using the touch screen and / or the touchpad as the primary input control device for operating device 100, the number of physical input control devices (e.g., push buttons, dials, etc.) on device 100 is optionally reduced.

[0136] The predefined set of functions performed uniquely via the touch screen and / or the touchpad optionally includes navigation between user interfaces. In some embodiments, the touchpad, when touched by a user, navigates device 100 from any user interface displayed on device 100 to a main menu, a home menu, or a root menu. In such embodiments, the touchpad is used to implement a "menu button". In some other embodiments, the menu button is a physical push button or other physical input control device rather than the touchpad.

[0137] Figure 1B is a block diagram showing exemplary components for event handling according to some embodiments. In some embodiments, memory 102 ( Figure 1A ) or memory 370 ( Figure 3 ) includes an event classifier 170 (e.g., in operating system 126) and corresponding application 136-1 (e.g., any one of the foregoing applications 137 to 151, 155, 380 to 390).

[0138] Event classifier 170 receives event information and determines application 136-1 to which the event information is to be delivered and application view 191 of application 136-1. Event classifier 170 includes event monitor 171 and event dispatcher module 174. In some embodiments, application 136-1 includes application internal state 192, which indicates one or more current application views displayed on touch-sensitive display 112 when the application is active or executing. In some embodiments, device / global internal state 157 is used by event classifier 170 to determine which application(s) is / are currently active, and application internal state 192 is used by event classifier 170 to determine application view 191 to which the event information is to be delivered.

[0139] In some embodiments, application internal state 192 includes additional information such as one or more of the following: recovery information to be used when application 136-1 resumes execution, user interface state information indicating that information is being displayed or is ready for display by application 136-1, a state queue for enabling a user to return to a previous state or view of application 136-1, and a repeat / undo queue of previous actions taken by the user.

[0140] The event monitor 171 receives event information from the peripheral interface 118. The event information includes information about sub-events (e.g., a user touch on the touch-sensitive display 112 as part of a multi-touch gesture). The peripheral interface 118 transmits information that it receives from the I / O subsystem 106 or sensors such as proximity sensor 166, one or more accelerometers 168, and / or microphone 113 (via the audio circuitry 110). The information that the peripheral interface 118 receives from the I / O subsystem 106 includes information from the touch-sensitive display 112 or a touch-sensitive surface.

[0141] In some embodiments, the event monitor 171 sends requests to the peripheral interface 118 at predetermined intervals. In response, the peripheral interface 118 transmits event information. In other embodiments, the peripheral interface 118 transmits event information only when there is a significant event (e.g., receiving an input above a predetermined noise threshold and / or receiving an input for more than a predetermined duration).

[0142] In some embodiments, the event classifier 170 further includes a hit view determination module 172 and / or an active event recognizer determination module 173.

[0143] When the touch-sensitive display 112 displays more than one view, the hit view determination module 172 provides a software process for determining where within one or more of the views a sub-event has occurred. Views are composed of controls and other elements that a user can see on the display.

[0144] Another aspect of the user interface associated with an application is a set of views, sometimes also referred to herein as application views or user interface windows, in which information is displayed and touch-based gestures occur. The application view (of the corresponding application) in which a touch is detected optionally corresponds to a programmatic level within the programmatic or view hierarchy of the application. For example, the lowest level view in which a touch is detected is optionally referred to as the hit view, and the set of events identified as correct inputs is optionally determined at least in part based on the hit view of the initial touch that begins the touch-based gesture.

[0145] The hit view determination module 172 receives information related to sub-events of a touch-based gesture. When an application has multiple views organized in a hierarchical structure, the hit view determination module 172 identifies the hit view as the lowest view in the hierarchical structure that should handle the sub-events. In most cases, the hit view is the lowest-level view in which the initiating sub-event (e.g., the first sub-event in a sequence of sub-events that form an event or a potential event) occurs. Once the hit view is identified by the hit view determination module 172, the hit view generally receives all sub-events related to the same touch or input source for which it was identified as the hit view.

[0146] The active event recognizer determination module 173 determines which view or views within the view hierarchy should receive a particular sequence of sub-events. In some embodiments, the active event recognizer determination module 173 determines that only the hit view should receive a particular sequence of sub-events. In other embodiments, the active event recognizer determination module 173 determines that all views that include the physical location of the sub-event are actively participating views and, thus, determines that all actively participating views should receive a particular sequence of sub-events. In other embodiments, even if a touch sub-event is completely confined to an area associated with a particular view, higher views in the hierarchy will still remain as actively participating views.

[0147] The event dispatcher module 174 distributes event information to event recognizers (e.g., event recognizer 180). In embodiments that include the active event recognizer determination module 173, the event dispatcher module 174 delivers the event information to the event recognizer determined by the active event recognizer determination module 173. In some embodiments, the event dispatcher module 174 stores the event information in an event queue, which is retrieved by the corresponding event receiver 182.

[0148] In some embodiments, the operating system 126 includes the event classifier 170. Alternatively, the application 136-1 includes the event classifier 170. In yet another embodiment, the event classifier 170 is an independent module or is part of another module (such as the contact / motion module 130) stored in the memory 102.

[0149] In some embodiments, application 136-1 includes a plurality of event handlers 190 and one or more application views 191, each of which includes instructions for handling touch events that occur within a corresponding view of the user interface of the application. Each application view 191 of application 136-1 includes one or more event recognizers 180. Typically, a corresponding application view 191 includes a plurality of event recognizers 180. In other embodiments, one or more of the event recognizers 180 are part of an independent module that is a higher-level object such as a user interface toolkit or from which application 136-1 inherits methods and other properties. In some embodiments, the corresponding event handlers 190 include one or more of the following: data updater 176, object updater 177, GUI updater 178, and / or event data 179 received from event classifier 170. The event handlers 190 optionally utilize or call the data updater 176, object updater 177, or GUI updater 178 to update the internal state 192 of the application. Alternatively, one or more of the application views 191 include one or more corresponding event handlers 190. Additionally, in some embodiments, one or more of the data updater 176, object updater 177, and GUI updater 178 are included in the corresponding application view 191.

[0150] The corresponding event recognizer 180 receives event information (e.g., event data 179) from event classifier 170 and identifies an event based on the event information. The event recognizer 180 includes an event receiver 182 and an event comparator 184. In some embodiments, the event recognizer 180 also includes at least a subset of metadata 183 and event delivery instructions 188 (which optionally include sub-event delivery instructions).

[0151] The event receiver 182 receives event information from event classifier 170. The event information includes information about sub-events such as touches or touch movements. Depending on the sub-event, the event information also includes additional information such as the location of the sub-event. When the sub-event involves the movement of a touch, the event information optionally also includes the rate and direction of the sub-event. In some embodiments, the event includes the device rotating from one orientation to another (e.g., from a portrait orientation to a landscape orientation, or vice versa), and the event information includes corresponding information about the current orientation of the device (also referred to as the device pose).

[0152] Event comparator 184 compares event information with predefined event or sub - event definitions and determines an event or sub - event based on that comparison, or determines or updates the status of an event or sub - event. In some embodiments, event comparator 184 includes event definition 186. Event definition 186 contains definitions of events (e.g., predefined sequences of sub - events), such as event 1 (187 - 1), event 2 (187 - 2), and others. In some embodiments, sub - events in an event (187) include, for example, touch start, touch end, touch move, touch cancel, and multi - touch. In one example, the definition of event 1 (187 - 1) is a double - tap on a displayed object. For example, a double - tap includes a first touch (touch start) of a predetermined duration on the displayed object, a first lift - off (touch end) of a predetermined duration, a second touch (touch start) of a predetermined duration on the displayed object, and a second lift - off (touch end) of a predetermined duration. In another example, the definition of event 2 (187 - 2) is a drag on a displayed object. For example, a drag includes a touch (or contact) of a predetermined duration on the displayed object, movement of the touch on the touch - sensitive display 112, and lift - off of the touch (touch end). In some embodiments, an event also includes information for one or more associated event handlers 190.

[0153] In some embodiments, event definition 187 includes definitions of events for corresponding user - interface objects. In some embodiments, event comparator 184 performs a hit test to determine which user - interface object is associated with a sub - event. For example, in an application view that displays three user - interface objects on touch - sensitive display 112, when a touch is detected on touch - sensitive display 112, event comparator 184 performs a hit test to determine which of the three user - interface objects is associated with the touch (sub - event). If each displayed object is associated with a corresponding event handler 190, event comparator uses the result of the hit test to determine which event handler 190 should be activated. For example, event comparator 184 selects the event handler associated with the sub - event and the object that triggered the hit test.

[0154] In some embodiments, the definition of a corresponding event (187) also includes a delay action that delays the delivery of event information until it has been determined that the sub - event sequence does or does not correspond to the event type of the event recognizer.

[0155] When the corresponding event recognizer 180 determines that the sub - event sequence does not match any event in the event definition 186, the corresponding event recognizer 180 enters an event - impossible, event - failed, or event - ended state, after which subsequent sub - events of the touch - based gesture are ignored. In such a case, other event recognizers (if any) that remain active for the hit view continue to track and process sub - events of the ongoing touch - based gesture.

[0156] In some embodiments, the corresponding event recognizer 180 includes metadata 183 having configurable attributes, flags, and / or lists indicating how the event delivery system should perform sub - event delivery to the active participating event recognizers. In some embodiments, the metadata 183 includes configurable attributes, flags, and / or lists indicating how event recognizers interact with each other or can interact with each other. In some embodiments, the metadata 183 includes configurable attributes, flags, and / or lists indicating whether sub - events are delivered to different levels in the view or the programmatic hierarchy.

[0157] In some embodiments, when one or more specific sub - events of an event are recognized, the corresponding event recognizer 180 activates an event handler 190 associated with the event. In some embodiments, the corresponding event recognizer 180 delivers event information associated with the event to the event handler 190. Activating the event handler 190 is different from sending (and deferring to send) sub - events to the corresponding hit view. In some embodiments, the event recognizer 180 throws a token associated with the recognized event, and the event handler 190 associated with the token retrieves the token and executes a predefined process.

[0158] In some embodiments, the event delivery instruction 188 includes a sub - event delivery instruction that delivers event information about the sub - event without activating the event handler. Instead, the sub - event delivery instruction delivers the event information to the event handler associated with the sub - event sequence or to the actively participating view. The event handler associated with the sub - event sequence or with the actively participating view receives the event information and executes a predetermined process.

[0159] In some embodiments, the data updater 176 creates and updates data used in the application 136-1. For example, the data updater 176 updates the phone numbers used in the contact module 137, or stores the video files used in the video player module. In some embodiments, the object updater 177 creates and updates objects used in the application 136-1. For example, the object updater 177 creates new user interface objects or updates the positions of user interface objects. The GUI updater 178 updates the GUI. For example, the GUI updater 178 prepares the display information and sends the display information to the graphics module 132 for display on the touch-sensitive display.

[0160] In some embodiments, the event handler 190 includes the data updater 176, the object updater 177, and the GUI updater 178, or has access to the data updater, the object updater, and the GUI updater. In some embodiments, the data updater 176, the object updater 177, and the GUI updater 178 are included in a single module of the corresponding application 136-1 or the application view 191. In other embodiments, they are included in two or more software modules.

[0161] It should be understood that the above discussion regarding event handling of user touches on the touch-sensitive display also applies to other forms of user input for operating the multifunctional device 100 using an input device, and not all user input is initiated on the touch screen. For example, mouse movement and mouse button presses optionally in cooperation with single or multiple keyboard presses or holds; contact movement on a touchpad, such as tapping, dragging, scrolling, etc.; stylus input; movement of the device; voice commands; detected eye movement; biometric input; and / or any combination thereof are optionally used as inputs corresponding to sub-events that define the events to be discriminated.

[0162] Figure 2FIG. 0 shows a portable multifunctional device 100 having a touch screen 112, according to some embodiments. The touch screen optionally displays one or more graphics within a user interface (UI) 200. In this and other embodiments described below, a user can select one or more of these graphics by making gestures on the graphics, such as by using one or more fingers 202 (not drawn to scale in the figures) or one or more styli 203 (not drawn to scale in the figures). In some embodiments, selection of one or more graphics occurs when the user breaks contact with the one or more graphics. In some embodiments, gestures optionally include one or more taps, one or more swipes (from left to right, right to left, up, and / or down), and / or rolling of a finger that has made contact with the device 100 (from right to left, left to right, up, and / or down). In some implementations or in some cases, inadvertently contacting a graphic does not select the graphic. For example, when the gesture corresponding to selection is a tap, a swipe gesture that sweeps over an application icon optionally does not select the corresponding application.

[0163] Device 100 optionally further includes one or more physical buttons, such as a "home" or menu button 204. As previously described, menu button 204 is optionally used to navigate to any of a set of applications 136 optionally executed on device 100. Alternatively, in some embodiments, the menu button is implemented as a soft key in a GUI displayed on touch screen 112.

[0164] In some embodiments, device 100 includes a touch screen 112, a menu button 204, a push button 206 for powering on / off the device and for locking the device, one or more volume adjustment buttons 208, a subscriber identity module (SIM) card slot 210, an earphone jack 212, and a docking / charging external port 124. Push button 206 is optionally used to power on / off the device by pressing and holding the button for a predefined time interval; lock the device by pressing and releasing the button before the predefined time interval has elapsed; and / or unlock the device or initiate an unlock process. In an alternative embodiment, device 100 also accepts voice input for activating or deactivating certain functions via microphone 113. Device 100 also optionally includes one or more contact intensity sensors 165 for detecting the intensity of contact on touch screen 112, and / or one or more tactile output generators 167 for generating tactile output for a user of device 100.

[0165] Figure 3is a block diagram of an exemplary multifunctional device having a display and a touch-sensitive surface, in accordance with some embodiments. Device 300 need not be portable. In some embodiments, device 300 is a laptop computer, a desktop computer, a tablet computer, a multimedia player device, a navigation device, an educational device (such as a children's learning toy), a gaming system, or a control device (e.g., a home or industrial controller). Device 300 generally includes one or more processing units (CPUs) 310, one or more network or other communication interfaces 360, memory 370, and one or more communication buses 320 for interconnecting these components. The communication bus 320 optionally includes circuitry (sometimes called a chipset) that interconnects the system components and controls the communication between the system components. Device 300 includes an input / output (I / O) interface 330 having a display 340, which is typically a touch screen display. The I / O interface 330 also optionally includes a keyboard and / or mouse (or other pointing device) 350 and a touchpad 355, a haptic output generator 357 for generating haptic output on device 300 (e.g., similar to the haptic output generator 167 described above with reference to Figure 1A ), sensors 359 (e.g., optical sensors, acceleration sensors, proximity sensors, touch-sensitive sensors, and / or contact intensity sensors (similar to the contact intensity sensor 165 described above with reference to Figure 1A ). Memory 370 includes high-speed random access memory, such as DRAM, SRAM, DDR RAM, or other random access solid state memory devices; and optionally includes non-volatile memory, such as one or more disk storage devices, optical disk storage devices, flash memory devices, or other non-volatile solid state storage devices. Memory 370 optionally includes one or more storage devices located remotely from the CPU 310. In some embodiments, memory 370 stores programs, modules, and data structures similar to or a subset of the programs, modules, and data structures stored in the memory 102 of the portable multifunctional device 100 ( Figure 1A ). Additionally, memory 370 optionally stores additional programs, modules, and data structures not present in the memory 102 of the portable multifunctional device 100. For example, memory 370 of device 300 optionally stores a drawing module 380, a presentation module 382, a word processing module 384, a website creation module 386, a disk editing module 388, and / or a spreadsheet module 390, while the memory 102 of the portable multifunctional device 100 ( Figure 1A ) optionally does not store these modules.

[0166] Figure 3Each of the above elements in [the above] is optionally stored in one or more of the aforementioned memory devices of the memory device. Each of the above modules corresponds to an instruction set for performing the above functions. The above modules or computer programs (e.g., instruction sets or including instructions) need not be implemented as separate software programs (such as computer programs (e.g., including instructions)), processes, or modules, and thus various subsets of these modules are optionally combined or otherwise rearranged in various embodiments. In some embodiments, the memory 370 optionally stores a subgroup of the above modules and data structures. Additionally, the memory 370 optionally stores additional modules and data structures not described above.

[0167] Attention is now turned to an embodiment of a user interface optionally implemented on, for example, the portable multifunctional device 100.

[0168] Figure 4A An exemplary user interface of an application menu on the portable multifunctional device 100 according to some embodiments is shown. A similar user interface is optionally implemented on the device 300. In some embodiments, the user interface 400 includes the following elements or a subset or superset thereof:

[0169] · A signal strength indicator 402 for wireless communications such as cellular signals and Wi-Fi signals;

[0170] · Time 404;

[0171] · A Bluetooth indicator 405;

[0172] · A battery status indicator 406;

[0173] · A tray 408 with icons for commonly used applications, such as:

[0174] ○ An icon 416 labeled "Phone" for the phone module 138, which icon 416 optionally includes an indicator 414 of the number of missed calls or voicemails;

[0175] ○ An icon 418 labeled "Mail" for the email client module 140, which icon 418 optionally includes an indicator 410 of the number of unread emails;

[0176] ○ An icon 420 labeled "Browser" for the browser module 147; and

[0177] ○ An icon 422 labeled "iPod" for the video and music player module 152 (also known as the iPod (a trademark of Apple Inc.) module 152); and

[0178] · Icons for other applications, such as:

[0179] ○ The icon 424 of the IM module 141 labeled "Message";

[0180] ○ The icon 426 of the calendar module 148 labeled "Calendar";

[0181] ○ The icon 428 of the image management module 144 labeled "Photo";

[0182] ○ The icon 430 of the camera module 143 labeled "Camera";

[0183] ○ The icon 432 of the online video module 155 labeled "Online Video";

[0184] ○ The icon 434 of the stock market widget 149-2 labeled "Stock Market";

[0185] ○ The icon 436 of the map module 154 labeled "Map";

[0186] ○ The icon 438 of the weather widget 149-1 labeled "Weather";

[0187] ○ The icon 440 of the alarm clock widget 149-4 labeled "Clock";

[0188] ○ The icon 442 of the fitness support module 142 labeled "Fitness Support";

[0189] ○ The icon 444 of the note module 153 labeled "Note"; and

[0190] ○ The icon 446 of the settings application or module labeled "Settings", which provides access to the settings of the device 100 and its various applications 136.

[0191] It should be noted that Figure 4A The icon labels shown in Figure 4A are merely exemplary. For example, the icon 422 of the video and music player module 152 is labeled "Music" or "Music Player". Other labels are optionally used for the various application icons. In some embodiments, the label of the corresponding application icon includes the name of the application corresponding to the corresponding application icon. In some embodiments, the label of a particular application icon is different from the name of the application corresponding to the particular application icon.

[0192] Figure 4B A device (e.g., Figure 3 a tablet or touchpad 355) having a touch-sensitive surface 451 (e.g., Figure 3Exemplary user interface on device 300). Device 300 also optionally includes one or more contact intensity sensors (e.g., one or more of sensors 359) for detecting the intensity of a contact on the touch-sensitive surface 451 and / or one or more tactile output generators 357 for generating tactile output for a user of device 300.

[0193] Although some examples below will be given with reference to input on a touch screen display 112 (where a touch-sensitive surface and a display are combined), in some embodiments, the device detects input on a touch-sensitive surface separate from the display, as Figure 4B shown. In some embodiments, the touch-sensitive surface (e.g., Figure 4B 451 in ) has a major axis (e.g., Figure 4B 452 in ) corresponding to the major axis (e.g., Figure 4B 453 in ) on the display (e.g., 450). According to these embodiments, the device detects contact (e.g., Figure 4B 460 and 462 in ) with the touch-sensitive surface 451 at a position corresponding to a respective position on the display (e.g., in Figure 4B 460 corresponds to 468 and 462 corresponds to 470). Thus, when the touch-sensitive surface (e.g., Figure 4B 451 in ) is separate from the display of the multifunctional device (e.g., Figure 4B 450 in ), user input detected by the device on the touch-sensitive surface (e.g., contacts 460 and 462 and their movement) is used by the device to manipulate the user interface on the display. It should be understood that similar methods are optionally used for other user interfaces described herein.

[0194] Additionally, although the examples below are mainly given with reference to finger input (e.g., finger contact, single-finger tap gesture, finger swipe gesture), it should be understood that in some embodiments, one or more of these finger inputs are replaced by input from another input device (e.g., mouse-based input or stylus input). For example, a swipe gesture is optionally replaced by a mouse click (e.g., instead of a contact), followed by movement of the cursor along the path of the swipe (e.g., instead of movement of the contact). As another example, a tap gesture is optionally replaced by a mouse click when the cursor is above the position of the tap gesture (e.g., instead of detecting a contact, followed by ceasing to detect the contact). Similarly, when multiple user inputs are detected simultaneously, it should be understood that multiple computer mice are optionally used simultaneously, or a mouse and a finger contact are optionally used simultaneously.

[0195] Figure 5AAn exemplary personal electronic device 500 is shown. The device 500 includes a body 502. In some embodiments, the device 500 may include some or all of the features described with respect to devices 100 and 300 (e.g., Figures 1A to 4B ). In some embodiments, the device 500 has a touch-sensitive display screen 504 hereinafter referred to as a touch screen 504. As an alternative or addition to the touch screen 504, the device 500 has a display and a touch-sensitive surface. As in the case of devices 100 and 300, in some embodiments, the touch screen 504 (or the touch-sensitive surface) optionally includes one or more intensity sensors for detecting the intensity of an applied contact (e.g., a touch). One or more intensity sensors of the touch screen 504 (or the touch-sensitive surface) may provide output data representative of the intensity of the touch. The user interface of the device 500 may respond to the touch based on the intensity of the touch, meaning that touches of different intensities may invoke different user interface operations on the device 500.

[0196] Exemplary techniques for detecting and processing touch intensity are found, for example, in the following related patent applications: International Patent Application Serial No. PCT / US2013 / 040061, filed May 8, 2013, entitled "Device, Method, and Graphical User Interface for Displaying User Interface Objects Corresponding to an Application," published as WIPO Patent Publication No. WO / 2013 / 169849; and International Patent Application Serial No. PCT / US2013 / 069483, filed November 11, 2013, entitled "Device, Method, and Graphical User Interface for Transitioning Between Touch Input to Display Output Relationships," published as WIPO Patent Publication No. WO / 2014 / 105276, each of which is hereby incorporated by reference in its entirety.

[0197] In some embodiments, device 500 has one or more input mechanisms 506 and 508. Input mechanisms 506 and 508 (if included) can be in physical form. Examples of physical input mechanisms include push buttons and rotatable mechanisms. In some embodiments, device 500 has one or more attachment mechanisms. Such attachment mechanisms (if included) may allow device 500 to be attached to, for example, hats, glasses, earrings, necklaces, shirts, jackets, bracelets, watchbands, bracelets, pants, belts, shoes, wallets, backpacks, etc. These attachment mechanisms allow the user to wear device 500.

[0198] Figure 5B An exemplary personal electronic device 500 is depicted. In some embodiments, device 500 may include some or all of the components referred to in Figure 1A , Figure 1B and Figure 3 Device 500 has a bus 512 that operatively couples the I / O section 514 to one or more computer processors 516 and a memory 518. The I / O section 514 may be connected to a display 504, which may have a touch-sensitive component 522 and optionally a strength sensor 524 (e.g., a contact strength sensor). Additionally, the I / O section 514 may be connected to a communication unit 530 for receiving application and operating system data using Wi-Fi, Bluetooth, near field communication (NFC), cellular, and / or other wireless communication technologies. Device 500 may include input mechanisms 506 and / or 508. For example, input mechanism 506 is optionally a rotatable input device or a pressable input device and a rotatable input device. In some examples, input mechanism 508 is optionally a button.

[0199] In some examples, input mechanism 508 is optionally a microphone. Personal electronic device 500 optionally includes various sensors, such as a GPS sensor 532, an accelerometer 534, an orientation sensor 540 (e.g., a compass), a gyroscope 536, a motion sensor 538, and / or combinations thereof, all of which are operatively connected to the I / O section 514.

[0200] The memory 518 of personal electronic device 500 may include one or more non-transitory computer-readable storage media for storing computer-executable instructions that, when executed by one or more computer processors 516, may cause the computer processors to perform the techniques described below, including processes 700, 800, 1000, and 1200 ( Figure 7 , Figure 8 , Figure 10 , Figure 12A and Figure 12B)。A computer-readable storage medium can be any medium that tangibly contains or stores computer-executable instructions for use by or in connection with an instruction execution system, apparatus, and device. In some examples, the storage medium is a transient computer-readable storage medium. In some examples, the storage medium is a non-transient computer-readable storage medium. Non-transient computer-readable storage media can include, but are not limited to, magnetic storage devices, optical storage devices, and / or semiconductor storage devices. Examples of such storage devices include magnetic disks, optical discs based on CD, DVD, or Blu-ray technology, and persistent solid-state memories such as flash memory, solid-state drives, etc. Personal electronic device 500 is not limited to Figure 5B the components and configurations thereof, but may include other components or additional components in a variety of configurations.

[0201] As used herein, the term "affordance" refers to a user-interactive graphical user interface object optionally displayed on the display screen of devices 100, 300, and / or 500 ( Figure 1A , Figure 3 and Figures 5A to 5B ). For example, images (e.g., icons), buttons, and text (e.g., hyperlinks) optionally each constitute an affordance.

[0202] As used herein, the term "focus selector" refers to an input element for indicating the current portion of the user interface with which the user is interacting. In some specific implementations including a cursor or other position marker, the cursor acts as the "focus selector" such that when an input (e.g., a press input) is detected on a touch-sensitive surface (e.g., Figure 3 the touchpad 355 in Figure 4B or Figure 1A the touch-sensitive display system 112 in Figure 4AIn some specific implementations of the touch screen 112), the detected contact on the touch screen serves as a "focus selector", such that when an input (e.g., a press input made by the contact) is detected at the position of a specific user interface element (e.g., a button, a window, a slider, or other user interface element) on the touch screen display, the specific user interface element is adjusted according to the detected input. In some specific implementations, the focus moves from one area of the user interface to another area of the user interface without a corresponding movement of the cursor or a movement of the contact on the touch screen display (e.g., moving the focus from one button to another button by using the tab key or arrow keys); in these specific implementations, the focus selector moves according to the movement of the focus between different areas of the user interface. Regardless of the specific form taken by the focus selector, the focus selector is generally a user interface element (or a contact on the touch screen display) that is controlled by the user to deliver the interaction with the user interface expected by the user (e.g., by indicating to the device the element of the user interface that the user expects to interact with). For example, when a press input is detected on a touch-sensitive surface (e.g., a touchpad or a touch screen), the position of the focus selector (e.g., a cursor, a contact, or a selection box) above the corresponding button will indicate that the user expects to activate the corresponding button (rather than other user interface elements shown on the device display).

[0203] As used in the specification and claims, the term "feature strength" of a contact refers to a feature of the contact based on one or more strengths of the contact. In some embodiments, the feature strength is based on a plurality of strength samples. The feature strength is optionally based on a predefined number or set of strength samples collected during a predefined time period (e.g., 0.05 seconds, 0.1 seconds, 0.2 seconds, 0.5 seconds, 1 second, 2 seconds, 5 seconds, 10 seconds) relative to a predefined event (e.g., after detecting the contact, before detecting the contact lift-off, before or after detecting the contact start to move, before detecting the contact end, before or after detecting the increase in the strength of the contact, and / or before or after detecting the decrease in the strength of the contact). The feature strength of the contact is optionally based on one or more of the following: the maximum value of the strength of the contact, the mean value of the strength of the contact, the average value of the strength of the contact, the value at the top 10% of the strength of the contact, the half-maximum value of the strength of the contact, the 90% maximum value of the strength of the contact, etc. In some embodiments, the duration of the contact is used in determining the feature strength (e.g., when the feature strength is the average value of the strength of the contact over time). In some embodiments, the feature strength is compared with a set of one or more strength thresholds to determine whether the user has performed an operation. For example, the set of one or more strength thresholds optionally includes a first strength threshold and a second strength threshold. In this example, a contact with a feature strength not exceeding the first threshold results in a first operation, a contact with a feature strength exceeding the first strength threshold but not exceeding the second strength threshold results in a second operation, and a contact with a feature strength exceeding the second threshold results in a third operation. In some embodiments, the comparison between the feature strength and one or more thresholds is used to determine whether to perform one or more operations (e.g., whether to perform the corresponding operation or to forgo performing the corresponding operation) rather than for determining whether to perform a first operation or a second operation.

[0204] Figure 5C Illustrated is the detection of a plurality of contacts 552A - 552E on a touch-sensitive display screen 504 using a plurality of intensity sensors 524A - 524D. Figure 5C Also included is an intensity map that shows the current intensity measurements of the intensity sensors 524A - 524D relative to intensity units. In this example, the intensity measurements of both intensity sensors 524A and 524D are 9 intensity units, and the intensity measurements of both intensity sensors 524B and 524C are 7 intensity units. In some specific implementations, the cumulative intensity is the sum of the intensity measurements of the plurality of intensity sensors 524A - 524D, which is 32 intensity units in this example. In some embodiments, each contact is assigned a corresponding strength, which is a portion of the cumulative intensity. Figure 5DShows the assignment of cumulative intensity to contacts 552A - 552E based on their distance from the center of force 554. In this example, each of contacts 552A, 552B, and 552E is assigned an intensity of 8 intensity units of cumulative intensity, and each of contacts 552C and 552D is assigned an intensity of 4 intensity units of cumulative intensity. More generally, in some embodiments, each contact j is assigned a corresponding intensity Ij according to a predefined mathematical function Ij = A·(Dj / ΣDi), which is a part of the cumulative intensity A, where Dj is the distance of the corresponding contact j from the center of force, and ΣDi is the sum of the distances of all corresponding contacts (e.g., i = 1 to the last) from the center of force. An electronic device similar to or equivalent to devices 100, 300, or 500 can perform the operations referred to Figures 5C - 5D above. In some embodiments, the characteristic intensity of a contact is based on one or more intensities of the contact. In some embodiments, intensity sensors are used to determine a single characteristic intensity (e.g., the single characteristic intensity of a single contact). It should be noted that the intensity map is not part of the displayed user interface but is included in Figures 5C - 5D to assist the reader.

[0205] In some embodiments, a portion of the recognized gesture is used to determine the characteristic intensity. For example, the touch-sensitive surface optionally receives a continuous swiping contact that transitions from a starting position and reaches an ending position, at which the contact intensity increases. In this example, the characteristic intensity of the contact at the ending position is optionally based only on a portion of the continuous swiping contact, rather than the entire swiping contact (e.g., only the portion of the swiping contact at the ending position). In some embodiments, a smoothing algorithm is optionally applied to the intensity of the swiping contact before determining the characteristic intensity of the contact. For example, the smoothing algorithm optionally includes one or more of the following: unweighted moving average smoothing algorithm, triangular smoothing algorithm, median filter smoothing algorithm, and / or exponential smoothing algorithm. In some cases, these smoothing algorithms eliminate narrow spikes or dips in the intensity of the swiping contact for the purpose of determining the characteristic intensity.

[0206] Optionally, characterize the contact intensity on the touch-sensitive surface relative to one or more intensity thresholds such as a contact detection intensity threshold, a light press intensity threshold, a deep press intensity threshold, and / or one or more other intensity thresholds. In some embodiments, the light press intensity threshold corresponds to an intensity at which the device will perform an operation typically associated with clicking a button of a physical mouse or touchpad. In some embodiments, the deep press intensity threshold corresponds to an intensity at which the device will perform an operation different from an operation typically associated with clicking a button of a physical mouse or touchpad. In some embodiments, when a contact is detected with a characteristic intensity below the light press intensity threshold (e.g., and above a nominal contact detection intensity threshold, contacts below the nominal contact detection intensity threshold are no longer detected), the device will move a focus selector based on the movement of the contact on the touch-sensitive surface without performing an operation associated with the light press intensity threshold or the deep press intensity threshold. Generally speaking, unless otherwise stated, these intensity thresholds are consistent between different sets of user interface figures.

[0207] An increase in the contact characteristic intensity from an intensity below the light press intensity threshold to an intensity between the light press intensity threshold and the deep press intensity threshold is sometimes referred to as a "light press" input. An increase in the contact characteristic intensity from an intensity below the deep press intensity threshold to an intensity above the deep press intensity threshold is sometimes referred to as a "deep press" input. An increase in the contact characteristic intensity from an intensity below the contact detection intensity threshold to an intensity between the contact detection intensity threshold and the light press intensity threshold is sometimes referred to as detecting a contact on the touch surface. A decrease in the contact characteristic intensity from an intensity above the contact detection intensity threshold to an intensity below the contact detection intensity threshold is sometimes referred to as detecting a lift-off of the contact from the touch surface. In some embodiments, the contact detection intensity threshold is zero. In some embodiments, the contact detection intensity threshold is greater than zero.

[0208] In some embodiments described herein, one or more operations are performed in response to detecting a gesture that includes a corresponding press input or in response to detecting a corresponding press input performed using a corresponding contact (or contacts), where the corresponding press input is detected at least in part based on the detected intensity of the contact (or contacts) increasing above a press input intensity threshold. In some embodiments, a corresponding operation is performed in response to detecting an increase in the intensity of the corresponding contact above the press input intensity threshold (e.g., the "down stroke" of the corresponding press input). In some embodiments, the press input includes an increase in the intensity of the corresponding contact above the press input intensity threshold and a subsequent decrease in the intensity of the contact below the press input intensity threshold, and a corresponding operation is performed in response to detecting a subsequent decrease in the intensity of the corresponding contact below the press input threshold (e.g., the "up stroke" of the corresponding press input).

[0209] Figures 5E - 5HDetection of a gesture is shown, the gesture comprising contact 562 with an intensity from below Figure 5E The light press intensity threshold in L ”) increases to a strength higher than Figure 5H The deep compression intensity threshold in D ”). On the displayed user interface 570 including application icons 572A-572D displayed in the predefined area 574, when the cursor 576 is displayed above the application icon 572B corresponding to application 2, a gesture performed using contact 562 is detected on the touch-sensitive surface 560. In some embodiments, the gesture is detected on the touch-sensitive display 504. The intensity sensor detects the intensity of the contact on the touch-sensitive surface 560. The device determines whether the intensity of the contact 562 is within the deep press intensity threshold (for example, “IT D ”) reaches a peak above. Contact 562 is maintained on touch-sensitive surface 560. In response to detecting the gesture, and according to the intensity increasing to a deep press intensity threshold (e.g., “IT D ”) above contact 562, displays scaled representations 578A-578C (e.g., thumbnails) of documents recently opened for application 2, such as Figures 5F - 5H In some embodiments, the intensity is a characteristic intensity of the contact compared to one or more intensity thresholds. It should be noted that the intensity map for contact 562 is not part of the displayed user interface, but is included in the Figures 5E - 5H To assist the readers.

[0210] In some embodiments, the display of representations 578A-578C includes animation. For example, representation 578A is initially displayed near application icon 572B, such as Figure 5F As the animation progresses, representation 578A moves upward and representation 578B is displayed near application icon 572B, as shown in FIG. Figure 5G Then, representation 578A moves upward, 578B moves upward toward representation 578A, and representation 578C is displayed near application icon 572B, as shown in FIG. Figure 5H 578A-578C form an array above icon 572B. In some embodiments, the animation progresses according to the intensity of contact 562, such as Figures 5F - 5G , where representations 578A-578C appear and increase as the strength of contact 562 approaches a deep press strength threshold (eg, “IT D ”) increases and moves upward. In some embodiments, the intensity according to which the animation progresses is the characteristic intensity of the contact. The reference may be performed using an electronic device similar to or equivalent to device 100, 300, or 500. Figures 5E to 5H The operation described.

[0211] In some embodiments, the device employs strength hysteresis to avoid accidental inputs sometimes referred to as "jitter", where the device defines or selects a hysteresis strength threshold having a predefined relationship to the press input strength threshold (e.g., the hysteresis strength threshold is X strength units lower than the press input strength threshold, or the hysteresis strength threshold is 75%, 90%, or some reasonable proportion of the press input strength threshold). Thus, in some embodiments, a press input includes the strength of the corresponding contact increasing above the press input strength threshold and the strength of that contact subsequently decreasing below the hysteresis strength threshold corresponding to the press input strength threshold, and a corresponding operation is performed in response to detecting that the strength of the corresponding contact subsequently decreases below the hysteresis strength threshold (e.g., the "upstroke" of the corresponding press input). Similarly, in some embodiments, a press input is detected only when the device detects that the contact strength increases from a strength equal to or lower than the hysteresis strength threshold to a strength equal to or higher than the press input strength threshold and optionally the contact strength subsequently decreases to a strength equal to or lower than the hysteresis strength, and a corresponding operation is performed in response to detecting the press input (e.g., depending on the context, the contact strength increases or the contact strength decreases).

[0212] For ease of explanation, optionally, a description of an operation performed in response to a press input associated with a press input strength threshold or in response to a gesture including a press input is triggered in response to detecting any one of the following various situations: the contact strength increasing above the press input strength threshold, the contact strength increasing from a strength lower than the hysteresis strength threshold to a strength higher than the press input strength threshold, the contact strength decreasing below the press input strength threshold, and / or the contact strength decreasing below the hysteresis strength threshold corresponding to the press input strength threshold. Additionally, in an example where an operation is described as being performed in response to detecting that the strength of the contact decreases below the press input strength threshold, the operation is optionally performed in response to detecting that the strength of the contact decreases below the hysteresis strength threshold corresponding to and less than the press input strength threshold.

[0213] Figure 5I An exemplary electronic device 580 is shown. Device 580 includes a body 580A. In some embodiments, device 580 may include relative to devices 100, 300, and 500 (e.g., Figures 1A to 5B)Some or all of the features described above. In some embodiments, device 580 has one or more speakers 580B (hidden within body 580A), one or more microphones 580C, one or more touch-sensitive surfaces 580D, and one or more displays 580E. Alternatively or in addition to displays and touch-sensitive surface 580D, the device also has a touch-sensitive display (also referred to as a touchscreen). As in the case of devices 100, 300, and 500, in some embodiments, touch-sensitive surface 580D (or touchscreen) optionally includes one or more intensity sensors for detecting the intensity of an applied contact (e.g., touch). The one or more intensity sensors of touch-sensitive surface 580D (or touchscreen) may provide output data representative of the intensity of the touch. The user interface of device 580 may respond to these touches based on the intensity of the touch, meaning that touches of different intensities may invoke different user interface operations on device 580. In some embodiments, the one or more displays 580E are one or more light-emitting diodes (LEDs). For example, the display may be a single LED, an LED cluster (e.g., red, green, and blue LEDs), multiple discrete LEDs, multiple discrete LED clusters, or some other arrangement of one or more LEDs. For example, display 580E may be an array of nine discrete LED clusters arranged in a circular (e.g., annular) pattern. In some examples, the one or more displays include one or more other types of light-emitting elements.

[0214] Figure 5J Depicts an exemplary personal electronic device 580. In some embodiments, device 580 may include some or all of the components described with respect to Figure 1A , Figure 1B , Figure 3 and Figures 5A to 5B above. Device 580 has a bus 592 that operatively couples I / O section 594 to one or more computer processors 596 and memory 598. I / O section 594 may be connected to a display 582, which may have a touch-sensitive component 584 and optionally an intensity sensor 585 (e.g., a contact intensity sensor). In some embodiments, touch-sensitive component 584 is a component separate from display 582. Additionally, I / O section 594 may be connected to a communication unit 590 for receiving application and operating system data using Wi-Fi, Bluetooth, near field communication (NFC), cellular, and / or other wireless communication technologies. Device 580 may include an input mechanism 588. In some examples, input mechanism 588 is optionally a button. In some examples, input mechanism 588 is optionally a microphone. Input mechanism 588 is optionally a plurality of microphones (e.g., a microphone array).

[0215] The electronic device 580 includes a speaker 586 for outputting audio. The device 580 may include an audio circuit (e.g., in the I / O section 594), which receives audio data, converts the audio data into an electrical signal, and transmits the electrical signal to the speaker 586. The speaker 586 converts the electrical signal into sound waves audible to humans. The audio circuit (e.g., in the I / O section 594) also receives the electrical signal converted from sound waves by a microphone (e.g., the input mechanism 588). The audio circuit (e.g., in the I / O section 594) converts the electrical signal into audio data. The audio data is optionally retrieved from and / or transmitted to the memory 598 and / or the RF circuit (e.g., in the communication unit 590) by the I / O section 594.

[0216] The memory 598 of the personal electronic device 580 may include one or more non-transitory computer-readable storage media for storing computer-executable instructions, which when executed by one or more computer processors 596 may cause the computer processors to perform the techniques described below, including processes 700, 800, 1000, and 1200 ( Figure 7 , Figure 8 , Figure 10 and FIG. 12). The computer-readable storage media can be any medium that can tangibly contain or store computer-executable instructions for use by or in connection with an instruction execution system, apparatus, and device. In some examples, the storage media is a transitory computer-readable storage media. In some examples, the storage media is a non-transitory computer-readable storage media. The non-transitory computer-readable storage media may include, but is not limited to, magnetic storage devices, optical storage devices, and / or semiconductor storage devices. Examples of such storage devices include magnetic disks, optical discs based on CD, DVD, or Blu-ray technology, and persistent solid-state memories such as flash memory, solid-state drives, etc. The personal electronic device 580 is not limited to Figure 5J the components and configurations thereof, but may include other components or additional components in various configurations.

[0217] Attention is now turned to embodiments of a user interface (“UI”) implemented on an electronic device (such as the portable multifunctional device 100, device 300, device 500, or device 580) and associated processes.

[0218] Figures 6A to 6X An exemplary user interface for managing a media playback device is shown according to some embodiments. The user interfaces in these figures are used to illustrate the processes described below, including Figure 7 and Figure 8 the processes in

[0219] Figures 6A to 6XShows various embodiments depicting the position, orientation, and / or movement of device 600 relative to device 605, as well as responses at devices 600 and 605 based on the relative position / orientation / movement and various states of devices 600 and 605. The relative position / orientation / movement of these devices is depicted in schematic diagram 610, which shows an outer threshold distance 610-1 from device 605 (also referred to herein as outer threshold 610-1) and an inner threshold distance 610-2 from device 605 (also referred to herein as inner threshold 610-2). To depict the position of device 600 relative to outer threshold 610-1 and inner threshold 610-2, the position of device 600 is represented by edge portion 600-1, which generally corresponds to the apex angle of device 600. In some embodiments, device 600 includes one or more features of device 100, device 300, and / or device 500, and device 605 includes one or more features of device 580. For example, device 600 includes a display 601, and device 605 includes a touch-sensitive surface 605-1 (similar to touch-sensitive surface 580D), one or more displays 605-2 (similar to display 580E), and one or more speakers 605-3 (similar to speaker 580B hidden in body 580A). In Figures 6A to 6X The illustrated embodiments, the display 605-2 is generally distinguished from the touch-sensitive surface 605-1 by the depiction of light (e.g., light 607). However, since the display may not be activated in all figures or the display size of the light (as well as other features such as brightness, intensity, color, pattern, movement, etc.) may vary when activated, the reference numeral 605-2 should be understood to generally refer to the display component of device 605. In some embodiments, different colors of light 607 are represented by different hatching patterns, and the brightness of light 607 is represented by the hue of light 607 depicted in these figures. For example, a darker hue of light 607 may represent a brighter display of the light, and a lighter hue of light 607 may represent a dimmer display of the light.

[0220] In some embodiments, these figures depict indicators 602A, 602B, 604A, 604B, and 634B to indicate different audio outputs at each of these devices. For example, indicator 602A indicates that a first song is being played (output) at device 600, and indicator 602B indicates that the first song is being played at device 605. Similarly, indicator 604A indicates that a second song different from the first song is being played at device 600, and indicator 604B indicates that the second song is being played at device 605. Indicator 634B indicates that communication audio is being played at device 605. These indicators are shown with different sizes to represent the volume at which the corresponding audio is being output. In Figures 6A to 6XIn the embodiments depicted, the volume is in the range of 1 to 5, where 1 is the lowest output volume and 5 is the highest output volume. In some embodiments, volume 5 represents the current volume setting of the corresponding device, and volumes 1 to 4 represent volumes less than the current volume setting. The volume is also indicated by the numerical value of the reference numerals attached to these figures. For example, reference numeral 602A-5 indicates that the first song is being played at volume 5 (e.g., full volume) on device 600, while reference numeral 602A-1 indicates that the first song is being played at volume 1 on device 600. In appropriate cases, similar nomenclature is used in other situations. When Figures 6A to 6X no indicator (e.g., 602A, 602B, 604A, 604B) is shown next to device 600 or device 605 in

[0221] Figures 6A to 6C An embodiment is depicted where device 600 is playing audio while device 605 is not playing audio, and in response to entering external threshold 610-1 and detecting a touch input on display 601, device 600 displays an interface for manually transferring audio playback from device 600 to device 605 (e.g., without automatically transferring the audio for playback at device 605). In the embodiments discussed below, the audio at devices 600 and 605 is music. However, the audio can be other types of audio, such as communication audio (e.g., audio from a phone call, video communication session, recording, etc.) or audio from other types of media playback (e.g., audio from a video game, movie).

[0222] In Figure 6A schematic 610 indicates that device 600 is positioned facing device 605 (device 600 pointing at device 605) and is located outside external threshold 610-1. Device 600 is currently playing the first song at full volume (as indicated by indicator 602A-5) (e.g., via one or more speakers of device 600) and is displaying main interface 603 on display 601. Device 605 is currently not outputting any audio or displaying any light.

[0223] In Figure 6B schematic 610 indicates that device 600 has moved towards device 605 and is now positioned at external threshold 610-1. In response to detecting device 600 at external threshold 610-1, devices 600 and 605 begin to generate feedback to indicate that the song being played at device 600 is transferable (e.g., handover) for playback at device 605.

[0224] Device 600 provides haptic feedback by generating a subtle haptic output 606 and provides visual feedback by displaying a pill interface object 615 and beginning to blur main interface 603 (the subtle blur is represented by the large diamond hatch marks denoted by reference numeral 603-1). Device 600 also provides audio feedback by reducing the volume of the first song (as depicted by indicator 602A-4). Pill interface object 615 (also referred to herein as pill 615) includes text 615-1 that identifies device 605 (identified as "kitchen speaker" in this example) and provides instructions to the user of device 600 to move device 600 closer to device 605 or tap pill 615 to display the controls of device 605. Pill 615 also includes a representation 615-2 of device 605 and a representation 615-3 of the first song being played at device 600 (e.g., an album cover), which song is capable of being transferred to device 605 in this example.

[0225] Device 605 provides visual feedback by displaying light 607 (e.g., via display 605-2) and provides audio feedback by beginning to play the first song (as depicted by indicator 602B-1). The output of the first song at device 605 takes on a low volume and is synchronized with the playback of the first song at device 600 such that devices 600 and 605 play the first song simultaneously but at different volumes. In some embodiments, the audio feedback at device 605 is generated such that the first song as output by device 605 has one or more audio characteristics (e.g., pitch, tone, frequency range) that approximate the audio output by the audio hardware of device 600. For example, compared to the normal audio characteristics (e.g., as relative to Figure 6H as described) when playing the first song that emulates the audio quality generated at device 600 after transfer is complete, the first song may be played at device 605 with audio characteristics that sound thinner (e.g., having less bass, having a higher pitched frequency range). As discussed in more detail below, when the first song is transferred for playback at device 605, the audio at device 605 rings out with a fuller, richer sound (e.g., having more bass, having a wider frequency range).

[0226] Feedback at devices 600 and 605 provides a hint to the user of device 600 that a first song can be transmitted for playback at device 605, and provides an instruction to the user to initiate transmission of the song to device 605 by moving device 600 towards device 605 or by providing further input (e.g., touch input) at device 600. Although the first song is output at device 605 as part of the audio feedback, playback of the first song has not been transmitted to device 605. In some embodiments, this is because device 600 still maintains control (e.g., primary control) of the playback of the song. For example, device 600 controls whether the first song plays, pauses, stops, or whether a different song is selected for playback. Additionally, if device 600 moves outside an external threshold 610-1, the first song stops playing at device 605 and continues to play at device 600 at full volume. In some embodiments, transmission is not complete until device 605 plays back the audio (e.g., the first song), regardless of the relative distance between device 600 and device 605. In some embodiments, transmission is not complete until device 600 no longer outputs the transmitted audio (e.g., no longer outputs audio feedback that includes playback of the audio (e.g., the first song)).

[0227] In some embodiments, when device 600 reaches the external threshold 610-1, device 605 initially displays light 607 in a pulsed manner to be bright and large-sized, and then dims the light slightly and reduces its size to the state depicted in Figure 6B In some embodiments, depending on the type of audio to be transmitted to device 605, device 605 displays light 607 in a specific color. For example, if the audio is communication audio, the light is green, or if the audio is music, the light is white. In some embodiments, when the audio begins to play at device 605, light 607 changes to a color corresponding to the first song. For example, if the album cover (e.g., representation 615-3) includes purple coloring, light 607 changes to purple to correspond to the album cover of the first song. In some embodiments, this transition to a colored light occurs when device 600 moves towards device 605, as discussed in more detail below. In some embodiments, different colors of light 607 are represented by different hatching patterns, and the brightness of light 607 is represented by the hue of light 607 depicted in these figures. For example, a darker hue of light 607 may represent a brighter display of the light, and a lighter hue of light 607 may represent a dimmer display of the light.

[0228] In Figure 6B device 600 detects an input 608 (e.g., a tap input) on capsule 615, and in response, unfolds capsule 615 to display a control interface 612, as shown in Figure 6C shown.

[0229] In Figure 6C , the device 600 remains at the external threshold 610-1. The device 600 continues to play the first song at volume 4 (as depicted by indicator 602A-4), and the device 605 continues to generate audio feedback by playing the first song at volume 1 (as depicted by indicator 602B-1), while continuing to display the light 607. The first song has not been transmitted for playback at the device 605, as discussed in more detail below. Instead, the playback of the first song continues to be performed at the device 600, and a control interface 612 is displayed to provide the user of the device 600 with the option to manually transfer the playback of the first song from the device 600 to the device 605, or to perform a number of other options at the device 605.

[0230] The control interface 612 is a user interface that provides controls that can be used to control various operations performed using the device 605. For example, the control interface 612 includes media playback controls 612-1, which can be selected to control the playback of audio at the device 605. As Figure 6C shown, the device 605 is not currently playing audio (except for the audio feedback represented by indicator 602B-1), and the media playback controls 612-1 include controls for playing or pausing audio, controls for seeking tracks for playback at the device 605, and controls for adjusting the volume settings of the device 605. The control interface 612 also includes a status 612-2 indicating that the device 605 is not playing audio, and a representation 612-3 of recommended songs that can be selected for playback at the device 605. The control interface 612 also includes message controls 612-4 for controlling messaging functions (e.g., composing, sending, and / or reading messages) performed using the device 605.

[0231] The control interface 612 also includes a transfer enablement representation 614, which can be selected to immediately transfer the playback of the first song from the device 600 to the device 605. As Figure 6C shown, the transfer enablement representation 614 includes a representation 614-1 of the song to be transferred to the device 605, text 614-2 identifying the song to be transferred, and text 614-3 indicating that the song is to be transferred from the device 600. In some embodiments, when neither the device 600 nor the device 605 is playing audio, the device 600 displays the control interface 612 without the transfer enablement representation 614.

[0232] Figures 6D to 6I depicts a similar embodiment as Figures 6A to 6C shown. However, instead of tapping the capsule 615 to display the control interface 612, Figures 6D to 6I shows that when the device 600 reaches the internal threshold 610-2, the control interface 612 is automatically displayed and the first song is automatically transferred for playback at the device 605.Figures 6D to 6I Also further shown is the dynamic feedback at devices 600 and 605 in response to moving device 600 towards and away from device 605.

[0233] Figure 6D Similar to Figure 6B , where device 600 is shown to be at outer threshold 610-1, generating the visual feedback, haptic feedback, and audio feedback (including the display of capsule 615) discussed above at device 600, and generating the visual feedback and audio feedback discussed above at device 605.

[0234] At Figure 6E , device 600 moves closer to device 605 (as depicted in schematic diagram 610), but does not reach inner threshold 610-2. In response to device 600 moving towards device 605, devices 600 and 605 change their respective feedbacks to encourage device 600 to continue moving towards device 605, thereby completing the transfer of the playback of the first song from device 600 to device 605.

[0235] Specifically, device 600 changes the haptic feedback by generating a stronger haptic output 613. In some embodiments, the haptic feedback changes based on the distance between device 600 and device 605. For example, when device 600 is closer to device 605, the haptic output becomes stronger, and when device 600 moves away from device 605, the haptic output becomes weaker. In some embodiments, the haptic feedback changes based on the speed and / or direction of device 600 moving towards device 605. For example, if device 600 moves slowly towards or away from device 605, the haptic feedback may include a series of dispersed and optionally slight haptic outputs as device 600 moves towards or away from device 605. Conversely, if device 600 moves quickly towards or away from device 605, the haptic feedback may include a series of rapid and optionally stronger haptic outputs as device 600 moves towards or away from device 605. In some embodiments, when device 600 accelerates towards device 605, the haptic feedback may include a series of haptic outputs with increasing frequency and optionally intensity as device 600 moves towards device 605. In some embodiments, the haptic output has characteristics that mimic the first song. For example, the haptic output has a pattern that mimics the beat of the first song and optionally different magnitudes.

[0236] Device 600 changes the audio feedback by reducing the volume of the first song (as depicted by indicator 602A-3). Device 600 changes the visual feedback by increasing the blur 603-2 of the main interface 603 (the increased blur is represented by the medium diamond hatching indicated by reference numeral 603-2) and increasing the size of the capsule 615 (including increasing the sizes of text 615-1, representation 615-2, and representation 615-3). Additionally, device 600 displays representation 615-3 positioned closer to representation 615-2. Thus, as device 600 moves towards 605, the haptic output is enhanced, the audio of the first song is attenuated, the main interface 603 becomes more blurred, the size of the capsule 615 increases, and the album cover of the first song moves towards the representation of device 605. The foregoing haptic, audio, and visual feedback actions, individually and jointly, provide the user with feedback indicating that the playback of the first song will be transferred from device 600, thereby encouraging the user to continue moving device 600 towards device 605 to transfer the playback of the first song from device 600 to device 605.

[0237] Device 605 changes the audio feedback by increasing the volume of the first song (as depicted by indicator 602B-2), and changes the visual feedback by increasing the size and brightness of light 607 and changing the color of light 607 to purple (as indicated by the hatching pattern of light 607). In some embodiments, as part of the feedback, device 605 displays light 607 in an animated manner while outputting the first song. For example, device 605 causes light 607 to change color, blink in time with the beat of the first song, and / or have an appearance that moves on the display 605-2. The foregoing visual and audio feedback actions, individually and jointly, provide the user with feedback that the first audio will be played at device 605, thereby encouraging the user to continue moving device 600 towards device 605 to transfer the playback of the first song to device 605.

[0238] In Figure 6F Device 600 has moved backward away from device 605 and is no longer facing device 605, while remaining between the external threshold 610-1 and the internal threshold 610-2. In response, device 600 and device 605 change their respective feedbacks to indicate that device 600 is no longer moving in that direction and the transfer of the first song from playing at device 600 to playing at device 605 cannot be achieved. For example, device 600 partially reverses the previous feedback changes by: increasing the volume of the first song (as depicted by indicator 602A-4), reducing the blur of the main interface 603, decreasing the size of the capsule 615 (including text 615-1 and representations 615-2 and 615-3), and moving representation 615-3 away from representation 615-2. Since device 600 slightly exceeds the external threshold 610-1, the capsule 615 is smaller than Figure 6E depicted inFigure 6D the capsule depicted in (when device 600 is at the outer threshold 610-1). Thus, text 615-1 and indicia 615-2 and 615-3 are slightly larger than those depicted in Figure 6D and indicium 615-3 is slightly closer to indicium 615-2 than that depicted in Figure 6D the indicium depicted in

[0239] In Figure 6F device 605 reverses the previous feedback change by: decreasing the volume of the first song (as depicted by indicator 602B-1), and decreasing the size, brightness, and purple tint of light 607.

[0240] In some embodiments, depending on the context of device 600, device 600 does not generate haptic feedback. For example, as Figure 6F shown, since device 600 is not facing device 605, device 600 does not generate a haptic output. In other cases, such as when device 600 is charging or stationary, device 600 may not generate a haptic output.

[0241] Now refer to Figures 6G to 6I , device 600 is again facing device 605 and is now at the inner threshold 610-2, as depicted in schematic 610. As discussed in more detail below, the feedback at device 600 and device 605 continues to change (e.g., while device 600 is between the outer threshold 610-1 and the inner threshold 610-2) until device 600 reaches the inner threshold 610-2, at which point device 600 transfers the playback of the first song to device 605 and devices 600 and 605 stop changing their respective feedback.

[0242] As device 600 moves toward device 605, device 600 generates visual feedback that includes increasing the blur 603-3 of the main interface 603 (the increased blur is represented by the small diamond hatching indicated by reference numeral 603-3), increasing the size of the capsule 615 (including text 615-1 and indicia 615-2 and 615-3), and moving indicium 615-3 toward indicium 615-2, as Figure 6G shown. When device 600 reaches the inner threshold 610-2, device 600 transfers the playback of the first song to device 605 and the display capsule 615 transforms into a control interface 612, as Figure 6H and Figure 6I shown.

[0243] In Figure 6H device 600 displays a control interface in a transient state (represented by reference numeral 612'), at which point it fully expands from the capsule 615 in Figure 6G to Figure 6Ithe control interface 612 therein. The control interface 612' includes playback controls 612-1 for the song being played at device 605, a status 612-2, and an album cover 612-5. In Figure 6H and Figure 6I , the status 612-2 and the album cover 612-5 indicate that the first song "Track 1, Artist 1" is now being played at device 605, and the controls 612-1 include playback controls for controlling the playback of the first song at device 605. In some embodiments, device 600 also generates a haptic output 616 when the capsule 615 is deployed, as Figure 6G and Figure 6H shown.

[0244] In Figure 6I , the control interface 612 is further expanded to include timer controls 612-6, which can be selected to control the function of a timer at device 605. For example, the pause control 612-6a can be selected to pause a timer (e.g., a "laundry" timer) operating at device 605, and the stop control 612-6b can be selected to stop the timer.

[0245] Referring again to Figure 6G , device 605 generates visual feedback by increasing the size, brightness, and purple hue of light 607, and generates audio feedback by increasing the volume of the first song (as depicted by indicator 602B-3). In the embodiment depicted in Figures 6G to 6H , when the audio is transmitted to device 605 for playback, device 605 displays light 607 in a pulsed manner. In Figure 6H , light 607 is shown in a pulsed manner with an increased brightness, size, and purple hue during media transmission. The pulses of light 607 are depicted in Figure 6H (and similar figures) by an outer portion 607-1 and an inner portion 607-2 of light 607, which represents a temporary increase in the size and optionally the brightness of light 607. The increased size is depicted by a larger display area of light 607. The increased brightness is depicted by a darker shading of the inner portion 607-2. The outer portion 607-1 has the same hue as light 607 in Figure 6G , and the inner portion 607-2 is depicted with a darker hue than the outer portion 607-1, which indicates that the inner portion of light 607 is brighter than the outer portion 607-1 (and light 607 in Figure 6G ). In some embodiments, device 605 causes light 607 to blink, as a supplement or alternative to the pulsed light 607. In Figure 6I , light 607 is shown after the pulse and has a normal playback state when device 605 plays the first song.

[0246] As previously discussed, when device 600 moves towards device 605, device 600 decreases the volume of the first song, and device 605 increases the volume of the first song. When reaching the internal threshold 610-2, device 600 transfers the playback of the first song to device 605. As part of this transfer, device 600 continues to decrease the volume of the first song, while device 605 continues to increase the volume of the first song, as depicted by indicators 602A-2 and 602B-3 respectively. Additionally, during this transfer, the audio at device 605 changes from a shrill sound to a full, rich audio sound. These volume changes continue when device 600 transfers the playback of the first song to device 605, as Figures 6G to 6I shown. When the playback of the first song is transferred to device 605, as Figure 6I shown, device 600 no longer plays the first song, and device 605 plays the first song at full volume, as depicted by indicator 602B-5.

[0247] As Figures 6J to 6M depicted, after this audio has been transferred to device 605, device 600 and device 605 no longer change the feedback based on the movement of device 600 relative to device 605. To re-enable this feedback, move device 600 beyond the external threshold 610-1, as Figure 6M depicted.

[0248] In Figure 6J , move device 600 closer to device 605, as depicted in schematic diagram 610. Device 600 continues to display the control interface 612 without generating any feedback based on the movement of device 600. Similarly, device 605 continues to play the first song without generating any feedback based on the movement of device 600. In some embodiments, device 605 animates the display of light 607 as the first song plays back, but this animation of light 607 is not based on the movement of device 600.

[0249] In Figure 6K , device 600 moves away from device 605, as depicted in schematic diagram 610. The device is positioned between the external threshold 610-1 and the internal threshold 610-2. The device continues to display the control interface 612 without generating any feedback based on the movement of device 600. Device 605 continues to play the first song without generating any feedback based on the movement of device 600.

[0250] In Figure 6LIn [scenario], device 600 moves away from device 605, as depicted in schematic diagram 610. Device 600 is positioned outside external threshold 610-1. Device 600 continues to display control interface 612 without generating any feedback based on the movement of device 600. Device 605 continues to play the first song without generating any feedback based on the movement of device 600. In some embodiments, when device 600 moves outside the threshold distance (e.g., internal threshold 610-2 or external threshold 610-1) of device 605, depending on the type of audio, the audio stops playing at device 605 and resumes playing at device 600. For example, in some embodiments, music continues to play at device 605, but communication audio stops playing at device 605 and continues to play at device 600.

[0251] In Figure 6M [scenario], device 600 moves towards device 605 and is now located at external threshold 610-1, as depicted in schematic diagram 610. In response to detecting that device 600 has re-entered external threshold 610-1, device 600 and device 605 begin to change feedback based on the movement of device 600 relative to device 605 and based on the respective states of devices 600 and 605.

[0252] For example, as Figure 6M shown, device 605 is currently playing the first song and device 600 is not playing the first song. When device 600 reaches external threshold 610-1, devices 600 and 605 begin to generate feedback to indicate to the user of device 600 that continued movement of device 600 towards device 605 will cause the audio to be transferred from device 605 to device 600. Thus, device 600 generates audio feedback by playing the first song at a low volume (as depicted by indicator 602A-1), and device 605 generates audio feedback by reducing the volume of the first song (as depicted by indicator 602B-4). Additionally, device 600 generates visual feedback by displaying transfer enabling representation 620. Transfer enabling representation 620 is similar to transfer enabling representation 614, and transfer enabling representation 620 can be selected to immediately transfer the playback of the first song from device 605 to device 600.

[0253] As Figure 6M shown, the transfer enabling representation includes a representation 620-1 of the song to be transferred to device 600, text 620-2 identifying the song to be transferred, and text 620-3 indicating that the song is to be transferred to device 600. In some embodiments, device 605 generates visual feedback by dimming, shrinking, and optionally reducing the purple hue of light 607. In some embodiments, in response to an input on transfer enabling representation 620, device 605 displays light 607 in a pulsed manner and, after the audio is transferred to device 600, fades light 607 to an "off" setting.

[0254] Figures 6N to 6W Depicts an implementation where devices 600 and 605 play different songs simultaneously.

[0255] In Figure 6N Device 605 is playing a first song (as depicted by indicator 602B-5 and light 607), and device 600 exceeds an external threshold 610 and is playing a second song (as depicted by indicator 604A-5 and music interface 625), which is an interface for controlling music playback at device 600. Device 600 detects an input 624 (e.g., a swipe gesture), and in response, cancels music interface 625 to display the main interface 603.

[0256] In Figure 6O The device moves to external threshold 610-1, as depicted by schematic 610. In response, device 600 begins to blur main interface 603-1 and displays capsule 615 with a small size. Since device 605 is currently playing the first song, capsule 615 includes text 615-4 indicating that device 605 ("kitchen speaker") is currently playing the first song. Capsule 615 also includes representations 615-2 and 615-3. Device 605 continues to play the first song without a feedback change based on the movement of device 600.

[0257] In Figure 6P Device 600 moves closer to device 605 (without crossing internal threshold 610-2), and in response, increases the blur 603-2 of main interface 603, increases the size of capsule 615 (including representations 615-2 and 615-3), and moves representation 615-3 towards representation 615-2. Device 600 continues to play the second song, as depicted by indicator 604A-5. Device 605 continues to play the first song, as depicted by indicator 602B-5 and light 607.

[0258] In Figure 6Q Device 600 reaches internal threshold 610-2, and in response, increases the blur 603-3 of main interface 603 and expands capsule 615 into a control interface 612, where Figure 6Q The temporary state of control interface 612' is shown and Figure 6RThe fully expanded state is shown. The control interface 612' includes the playback control 612-1 of device 605, the status 612-2 indicating that device 605 is playing the first song, and the album cover 612-5 representing the first song. Device 605 continues to play the first song, as depicted by indicator 602B-5 and light 607. In some embodiments, in response to detecting device 600 at internal threshold 610-2, device 600 or device 605 adds the first song being played at device 605 to the queue for playback at device 600.

[0259] In Figure 6R , device 600 displays the control interface 612 in its fully expanded state. The control interface 612 includes the playback control 612-1, the status 612-2, and the alarm control 612-7. The alarm control 612-7 is an optional control for controlling the function of one or more alarms at device 605. For example, the new control 612-7a can be selected to start a new alarm at device 605. Since device 600 and device 605 are playing different songs, the control interface 612 also includes a transfer enabling representation 626. The transfer enabling representation 626 is similar to the transfer enabling representation 614, and the transfer enabling representation 626 can be selected to immediately transfer the playback of the second song from device 600 to device 605. As Figure 6R shown, the transfer enabling representation 626 includes a representation 626-1 of the song to be transferred to device 605, the text 626-2 identifying the song to be transferred, and the text 626-3 indicating that the song is to be transferred from device 600. In response to an input on the transfer enabling representation 626, device 605 stops playing the first song and starts playing the second song.

[0260] In Figure 6R , device 600 detects an input 628 on the pause control option 612-1a, and in response, pauses the first song being played at device 605, as Figure 6S shown.

[0261] In Figure 6S , the first song is paused at device 605. Accordingly, device 600 displays the control interface 612 including the playback control 612-1 with a play enabling representation 612-1b, and device 605 changes the light 607 to a dimmer, smaller, and white light to indicate the pause state. Device 600 detects an input 630 on the transfer enabling representation 626, and in response, transfers the playback of the second song from device 600 to device 605, as Figure 6T depicted in

[0262] In Figure 6TIn [description], device 600 depicts a control interface 612 that has been updated to indicate that device 605 is now playing a second song. Accordingly, the control interface 612 no longer includes the transport enabling representation 626, and the status 612-2 and album cover 612-5 have been updated to represent the second song that is now being played at device 605. Device 605 is now playing the second song, as depicted by indicator 604B-5 and light 607, which is shown Figure 6T displayed in a pulsed manner and first appears bright, large, and white during transmission, then shrinks and turns blue corresponding to the album cover of the second song, as Figure 6U shown.

[0263] In Figure 6U and Figure 6V , device 600 detects an input 632 (e.g., a touch and drag gesture), and in response, cancels the control interface 612, shrinking it back to the capsule state, as Figure 6W shown. Device 605 continues to play the second song, as depicted by indicator 604B-5 and light 607.

[0264] In Figure 6W , the capsule 615 is shown to have information corresponding to the second song, including a representation of the second piece of music and text indicating that device 605 is playing the second song (Track 2 - Artist 2).

[0265] As described above, device 605 can play different types of audio and display a light 607 with different colors based on that audio. Figure 6X depicts an embodiment in which device 605 is outputting communication audio for a phone call (as depicted by indicator 634B), and displaying a light 607 with green to indicate that the type of audio being played at device 605 is communication audio. In Figure 6X , in the embodiment, the audio for the phone call is transmitted from device 600 to device 605 in a manner similar to that discussed above for music transmission. Devices 600 and 605 also change the feedback based on the distance between device 600 and device 605, as discussed above. For example, in Figure 6X , device 600 is at the outer threshold 610-1 and displays a capsule 615 with information for the phone call while the phone interface 635 is slightly blurred. The capsule 615 includes text 615-5 indicating that a phone call is being played at device 605 ("Kitchen Speaker"). The capsule 615 also includes a representation 615-2 of device 605 and a representation 615-6 of the phone call audio.

[0266] Figure 7It is a flowchart showing a method for managing a media playback device using an electronic device according to some embodiments. Method 700 is performed at a device (e.g., 100, 300, 500, 600) that communicates with a first external device (e.g., 605). Some operations in method 700 are optionally combined, the order of some operations is optionally changed, and some operations are optionally omitted.

[0267] In some embodiments, the electronic device (e.g., 600) is a computer system (e.g., a smart phone, a smart watch; a smart speaker; a media playback device (e.g., a digital media player)), which communicates with a first external device (e.g., 605) (e.g., a smart speaker; a media playback device (e.g., a digital media player); a smart phone; a smart watch). The computer system optionally communicates (e.g., by wired communication, wireless communication) with a display generation component (e.g., 601). The display generation component is configured to provide a visual output, such as a display via a CRT monitor, a display via an LED monitor, or a display via image projection. In some embodiments, the display generation component is integrated with the computer system. In some embodiments, the display generation component is separate from the computer system. Thus, the computer system can transmit data (e.g., image data or video data) to the integrated or external display generation component via a wired or wireless connection to visually generate content (e.g., using a display device).

[0268] As described below, method 700 provides an intuitive way to manage a media playback device. The method reduces the cognitive burden on the user for managing the media playback device, thus creating a more efficient human-machine interface. For battery-powered computing devices, enabling the user to manage the media playback device faster and more efficiently saves power and increases the time interval between two battery charges.

[0269] In method 700, the computer system (e.g., 600) detects (702) a change in the distance between the computer system and the first external device (e.g., 605). In some embodiments, the change in distance is detected based on a change in the signal strength (e.g., wireless signal strength) exchanged between the system and the first external device. In some embodiments, the change in distance is detected via one or more sensors (e.g., an infrared sensor; an optical sensor). In some embodiments, the change in distance is detected via data transmitted from a Wi-Fi positioning system, from GPS, and / or from the first external device to the system.

[0270] In response (704) to detecting the change in distance, the computer system (e.g., 600) performs steps 706 - 712 of method 700.

[0271] In response to detecting the distance change, based on determining that the current distance of the computer system (e.g., 600) from the first external device (e.g., 605) is less than a first threshold distance (e.g., 610-1) (e.g., a pre-determined threshold distance (e.g., 6 inches, 12 inches, 18 inches); an external threshold distance from the first external device) but greater than a second threshold distance (e.g., 610-2) (e.g., a pre-determined threshold distance less than the first threshold distance (e.g., 4 inches, 8 inches, 12 inches); an internal threshold distance from the first external device), the computer system (e.g., at the computer system and / or at the first external device) generates (706) feedback (e.g., outputs feedback; initiates feedback; initiates a process for generating feedback) (in some embodiments, the first operation is not performed), the feedback indicating that the first operation will be performed when the second threshold distance is reached (e.g., transferring data to the first external device (e.g., data for transferring media from the computer system to the first external device); retrieving media or information about media currently being played on the first external device (e.g., for playback on the computer system)). The feedback changes at least in part based on the distance of the computer system from the first external device (e.g., based on the distance of the computer system from the first external device and the direction of movement of the computer system relative to the first external device) (e.g., generating the feedback includes changing the feedback). Generating feedback that changes at least in part based on the distance of the computer system from the first external device and indicating that the first operation will be performed when the second threshold distance is reached provides the user of the computer system with instructions for the actions required to cause the computer system to perform the first operation without requiring additional input from the user (e.g., input at a touch screen) and provides the user with feedback indicating that continuing to move towards the first external device will cause the computer system to perform the first operation. Providing instructions for causing the computer system to perform an operation without requiring additional input and providing improved feedback reduces the number of inputs at the computer system, enhances the operability of the computer system, and makes the user-system interface more effective (e.g., by helping the user provide appropriate input and reducing user errors when operating the computer system / interacting with the computer system), which in turn reduces power usage and extends the battery life of the computer system by enabling the user to use the computer system more quickly and effectively.

[0272] Generating the feedback includes, based on determining that the distance change includes movement of the computer system (e.g., 600) toward the first external device (e.g., 605) (e.g., the distance change includes a decrease in the distance between the computer system and the first external device (in some embodiments, while remaining between a first threshold distance and a second threshold distance (e.g., the computer system is located at a first distance from the first external device, between the first threshold distance and the second threshold distance))), changing (708) the current value of a feedback parameter of the feedback by the computer system in a first direction (e.g., in a first manner (e.g., increasing; decreasing)) (e.g., increasing the audio volume (e.g., at the first external device); decreasing the audio volume (e.g., at the computer system), increasing the haptic output frequency, increasing the haptic output amplitude, increasing the size of a user interface element, and / or increasing the brightness of a user interface element).

[0273] Generating the feedback includes, based on determining that the distance change includes movement of the computer system (e.g., 600) away from the first external device (e.g., 605) (e.g., the distance change includes an increase in the distance between the computer system and the first external device (in some embodiments, while remaining between a first threshold distance and a second threshold distance (e.g., the computer system is located at a second distance from the first external device, between the first threshold distance and the second threshold distance and greater than the first distance from the first external device))), changing (710) the current value of a feedback parameter of the feedback by the computer system in a second direction different from the first direction (e.g., in a second manner (e.g., decreasing; increasing)) (e.g., decreasing the audio volume (e.g., at the first external device); increasing the audio volume (e.g., at the computer system), decreasing the haptic output frequency, decreasing the haptic output amplitude, decreasing the size of a user interface element, and / or decreasing the brightness of a user interface element).

[0274] In response to detecting the distance change, based on determining that the current distance of the computer system (e.g., 600) from the first external device (e.g., 605) is less than a second threshold distance (e.g., 610-2), the computer system performs (712) a first operation (e.g., transfer data to the first external device (e.g., transfer media from the computer system to the first external device); retrieve media or information about media currently being played on the first external device (e.g., for playback on the computer system) (in some embodiments, perform the first operation and stop changing the current value of a feedback parameter based on the movement of the computer system relative to the first external device (e.g., stop generating feedback; disable changing the current value of a feedback parameter based on the movement of the computer system relative to the first external device)). In some embodiments, based on determining that the current distance of the computer system from the first external device is greater than a first threshold distance (e.g., 610-1) and the second threshold distance (e.g., 610-2), the computer system abandons generating feedback (e.g., at the computer system; at the first external device) and abandons performing the first operation.

[0275] In some embodiments, a computer system (e.g., 600) communicates with a display generation component (e.g., 601) (e.g., a display controller, a touch-sensitive display system). In some embodiments, generating the feedback includes displaying a first visual feedback (e.g., 603-1; 603-2; 603-3; 615; 615-1; 615-2; 615-3) via the display generation component (e.g., at the computer system). In some embodiments, the first visual feedback includes a blurred user interface (e.g., 603) and / or user interface objects. In some embodiments, the first visual feedback includes an indication of displayed content (e.g., 615-3) (e.g., media content). In some embodiments, the first visual feedback includes displaying a user interface object (e.g., 615) (e.g., an affordance) that includes an indication of a first external device (e.g., 605) (e.g., 615-2) and optionally status information of the first external device (e.g., 615-1). In some embodiments, the visual feedback is optionally gradually modified or generated and is based on, for example, movement of the computer system towards or away from the first external device. For example, when the computer system moves towards the first external device, the visual feedback gradually increases (e.g., the degree of blurring gradually increases, the size of the user interface object gradually increases, the user interface object gradually moves towards another user interface object), and when the computer system moves away from the first external device, the visual feedback gradually decreases (e.g., the degree of blurring gradually decreases, the size of the user interface object gradually decreases, the user interface object gradually moves away from another user interface object). Displaying the first visual feedback provides the user of the computer system with instructions for the actions required to cause the computer system to perform a first operation without the need for additional input from the user (e.g., input at a touch screen) and provides the user with feedback indicating that continuing to move towards the first external device will cause the computer system to perform the first operation. Providing instructions for causing the computer system to perform an operation without additional input and providing improved feedback reduces the number of inputs at the computer system, enhances the operability of the computer system, and makes the user-system interface more efficient (e.g., by helping the user provide appropriate input and reducing user errors when operating the computer system / interacting with the computer system), which in turn reduces power usage and extends the battery life of the computer system by enabling the user to use the computer system more quickly and effectively.

[0276] In some embodiments, a computer system (e.g., 600) changes a current value of a feedback parameter of feedback in a first direction, including increasing an amount (e.g., degree) of blurring (e.g., 603-1; 603-2; 603-3) of at least a portion of a user interface (e.g., 603) (e.g., reducing resolution) (e.g., increasing the blurriness of the user interface and / or one or more objects displayed on the user interface). In some embodiments, the feedback parameter is blurriness (e.g., resolution). In some embodiments, changing the current value of the feedback parameter in a second direction includes reducing the amount of blurring of at least a portion of the user interface (e.g., increasing resolution). In some embodiments, increasing the amount of blurring of at least a portion of the user interface includes increasing the blurriness of the background user interface without changing the blurriness of user interface objects (e.g., the blurriness of the background increases while the capsule affordance representation remains unchanged (in terms of blurriness)).

[0277] In some embodiments, a computer system (e.g., 600) changes a current value of a feedback parameter of feedback in a first direction, including increasing the size (e.g., expanding; growing) of a first user interface object (e.g., 615) (e.g., an affordance representation; the "capsule" view representing a media control user interface). In some embodiments, the feedback parameter is size. In some embodiments, changing the current value of the feedback parameter in a second direction includes reducing the size of the first user interface object.

[0278] In some embodiments, when the computer system (e.g., 600) is at a first distance from a first external device (e.g., Figure 6D the distance depicted in the schematic diagram 610), while displaying a first user interface object (e.g., 615) having a first state (e.g., a state in which the first user interface object has the appearance of the "capsule" view; a state in which first information is displayed in the first user interface object and second information is not displayed; a state in which controls of the first external device are not displayed in the first user interface object) and a first size (e.g., Figure 6D the size shown), the computer system detects a second distance change. Based on determining that the current distance of the computer system from the first external device (e.g., 605) (e.g., the current distance after the second distance change) is less than a first threshold distance (e.g., 610-1) but greater than a second threshold distance (e.g., 610-2): Based on determining that the current distance is a second distance from the first external device (e.g., Figure 6F the distance depicted in the schematic diagram 610), where the second distance is less than the first distance, the computer system displays the first user interface object having the first state and a second size that is greater than the first size (e.g., see Figure 6Fin the capsule 615) (e.g., increasing the user interface object from a first size to a second size while maintaining a first state of the user interface object); and based on determining that the current distance is a third distance from the first external device (e.g., Figure 6E the distance depicted in the schematic diagram 610), where the third distance is less than the second distance, displaying a first user interface object having a first state and a third size that is greater than the second size (e.g., see Figure 6E the capsule 615) (e.g., increasing the user interface object from the first size or the second size to the third size while maintaining the first state of the user interface object). Displaying a first user interface object having a first state and a first size, a second size, or a third size based on the current distance from the first external device provides an instruction to the user of the computer system for the action required to cause the computer system to perform a first operation without requiring additional input from the user (e.g., input at a touch screen) and provides feedback to the user indicating that continuing to move toward the first external device will cause the computer system to perform the first operation. Providing an instruction for the computer system to perform an operation without requiring additional input and providing improved feedback reduces the amount of input at the computer system, enhances the operability of the computer system, and makes the user-system interface more effective (e.g., by helping the user provide appropriate input and reducing user errors when operating / interacting with the computer system), which in turn reduces power usage and extends the battery life of the computer system by enabling the user to use the computer system more quickly and effectively.

[0279] Based on determining that the current distance of the computer system (e.g., 600) from the first external device (e.g., 605) (e.g., after a change in the second distance) is less than a second threshold distance (e.g., 610-2), the computer system displays a transition of the first user interface object (e.g., 615) from a first state (e.g., the capsule 615) (e.g., see Figure 6HThe control interface 612' in it is in a second state different from the first state (for example, control interfaces 612 and 612') (for example, the state where the first user interface object no longer has the "capsule" view appearance; the state where the first user interface object has a full-screen or card appearance; the state where the first information and the second information are displayed in the first user interface object; the state where the control of the first external device (for example, 612-1) is displayed in the first user interface object) (for example, the first user interface object increases in size when transitioning to the second state). Displaying the transition of the first user interface object from the first state to the second state when the current distance is less than the second threshold distance provides feedback to the user of the computer system indicating that moving towards the first external device has caused the computer system to perform the first operation. Providing improved feedback reduces the amount of input at the computer system, enhances the operability of the computer system, and makes the user-system interface more effective (for example, by helping the user provide appropriate input and reducing user errors when operating / interacting with the computer system), which in turn reduces power usage and extends the battery life of the computer system by enabling the user to use the system more quickly and effectively.

[0280] In some embodiments, the first user interface object (for example, 615) gradually expands when the computer system (for example, 600) moves between the first threshold distance (for example, 610-1) and the second threshold distance (for example, 610-2) and towards the first external device (for example, 605) (and in some embodiments, gradually contracts when the computer system moves away from the first external device). In some embodiments, when the computer system reaches the second threshold distance, the first user interface object transitions (for example, "pops up") to a card appearance (for example, 612').

[0281] In some embodiments, a computer system (e.g., 600) changes a current value of a feedback parameter in a first direction, including increasing the size (e.g., expanding; enlarging) of a representation (e.g., 615-2) (e.g., image; indication) of a first external device (e.g., 605). Increasing the size of the representation of the first external device provides feedback to a user of the computer system that a first operation is associated with the first external device, provides an instruction to the user of the action required to cause the computer system to perform the first operation without additional input from the user (e.g., input at a touch screen), and provides feedback indicating that continued movement toward the first external device will cause the computer system to perform the first operation. Providing an instruction for causing the computer system to perform an operation without additional input and providing improved feedback reduces the amount of input at the computer system, enhances the operability of the computer system, and makes the user-system interface more efficient (e.g., by helping the user provide appropriate input and reducing user errors when operating / interacting with the computer system), which in turn reduces power usage and extends the battery life of the computer system by enabling the user to use the computer system more quickly and effectively. In some embodiments, the representation of the first external device is included in a first user interface object (e.g., 615) (e.g., capsule affordance representation). In some embodiments, changing the current value of the feedback parameter in a second direction includes decreasing the size of the representation of the first external device.

[0282] In some embodiments, a computer system (e.g., 600) changes a current value of a feedback parameter in a first direction, including moving a representation of media content (e.g., 615-3) (e.g., an image; an indication; text; an album cover; text identifying the media content) toward a representation of a first external device (e.g., 605) (e.g., an image; an indication). Moving the representation of the media content toward the representation of the first external device provides the user of the computer system with feedback that a first operation is associated with playing media at the first external device, provides the user with an instruction for the action required to cause the computer system to perform the first operation without additional input from the user (e.g., input at a touch screen), and provides the user with feedback indicating that continuing to move toward the first external device will cause the computer system to perform the first operation. Providing an instruction for causing the computer system to perform an operation without additional input and providing improved feedback reduces the number of inputs at the computer system, enhances the operability of the computer system, and makes the user-system interface more effective (e.g., by helping the user provide appropriate input and reducing user errors when operating / interacting with the computer system), which in turn reduces power usage and extends the battery life of the computer system by enabling the user to use the computer system more quickly and effectively. In some embodiments, the feedback parameter is a display position of the representation of the media content relative to the representation of the first external device. In some embodiments, changing the current value of the feedback parameter in a second direction includes moving the representation of the media away from the representation of the first external device.

[0283] In some embodiments, a computer system (e.g., 600) generates feedback, including causing a second visual feedback (e.g., 607) to be displayed at a first external device (e.g., 605). Causing the second visual feedback to be displayed at the first external device provides the user of the computer system with feedback that a first operation is associated with the first external device, provides the user with an instruction for the action required to cause the computer system to perform the first operation without additional input from the user (e.g., input at a touch screen), and provides the user with feedback indicating that continuing to move toward the first external device will cause the computer system to perform the first operation. Providing an instruction for causing the computer system to perform an operation without additional input and providing improved feedback reduces the number of inputs at the computer system, enhances the operability of the computer system, and makes the user-system interface more effective (e.g., by helping the user provide appropriate input and reducing user errors when operating / interacting with the computer system), which in turn reduces power usage and extends the battery life of the computer system by enabling the user to use the computer system more quickly and effectively. In some embodiments, the second visual feedback includes displaying or modifying a graphical element (e.g., 605-2) at the first external device.

[0284] In some embodiments, a computer system (e.g., 600) changes a current value of a feedback parameter of feedback in a first direction, including causing an increase in one or more of the following: a) the size of a first set of one or more graphical elements displayed at a first external device (e.g., 605) (e.g., the size of light 607) (e.g., causing an increased number of light elements (e.g., 605-2) to be activated (e.g., glow) at the first external device); and b) the brightness of the first set of one or more graphical elements displayed at the first external device (e.g., increasing the size and / or brightness) (e.g., as the computer system moves towards the first external device, the glow of one or more light elements at the first external device becomes brighter and / or larger). Causing an increase in at least one of the size or brightness of the first set of one or more graphical elements displayed at the first external device provides feedback to the user of the computer system that the first operation is associated with the first external device, provides an instruction to the user for the action required to cause the computer system to perform the first operation without the need for additional input from the user (e.g., input at a touchscreen), and provides feedback indicating that continuing to move towards the first external device will cause the computer system to perform the first operation. Providing an instruction for causing the computer system to perform an operation without additional input and providing improved feedback reduces the amount of input at the computer system, enhances the operability of the computer system, and makes the user-system interface more effective (e.g., by helping the user provide appropriate input and reducing user errors when operating / interacting with the computer system), which in turn reduces power usage and extends the battery life of the computer system by enabling the user to use the computer system more quickly and effectively. In some embodiments, the feedback parameter is the size and / or brightness of the active area of one or more light elements (e.g., LEDs) at the first external device. In some embodiments, changing the current value of the feedback parameter in a second direction includes decreasing the size and / or brightness of the first set of one or more graphical elements at the first external device.

[0285] In some embodiments, a computer system (e.g., 600) changes a current value of a feedback parameter in a first direction, including causing a change in one or more colors of a set (e.g., a first set) of one or more graphical elements (e.g., light 607) displayed at a first external device (e.g., 605) (e.g., when the computer system moves toward the first external device, the glow of one or more light elements at the first external device changes color). In some embodiments, the feedback parameter is a color of an active area of one or more light elements (e.g., LEDs) at the first external device. In some embodiments, changing the current value of the feedback parameter in the first direction includes changing the one or more colors of the set to a first set of one or more colors (e.g., colors corresponding to a media item (e.g., colors matching an album cover associated with a song)). In some embodiments, changing the current value of the feedback parameter in a second direction includes changing the one or more colors of the set to a second set of one or more colors different from the first set of one or more colors.

[0286] In some embodiments, a first operation is associated with a type of media (e.g., playback of music; playback of a communication media (e.g., a phone call)). In some embodiments, a computer system (e.g., 600) causes a change in one or more colors of a set of one or more graphical elements (e.g., light 607) displayed at a first external device (e.g., 605), including: based on determining that the media is a first type (e.g., music), causing the one or more colors of the set to have a first set of one or more colors (e.g., white) (e.g., see light 607 in Figure 6B ); and based on determining that the media is a second type different from the first type (e.g., a phone call), causing the one or more colors of the set to have a second set of one or more colors different from the first set of one or more colors (e.g., green) (e.g., see Figure 6XThe light 607). Depending on whether the medium is of the first type or the second type, the set of one or more colors is made to have a first set or a second set of one or more colors, providing feedback to a user of the computer system that a first operation is associated with the playback of a particular type of medium at a first external device, providing instructions to the user for the actions required to cause the computer system to perform the first operation without additional input from the user (e.g., input at a touch screen), and providing feedback to the user indicating that continuing to move towards the first external device will cause the computer system to perform the first operation. Providing instructions for causing the computer system to perform an operation without additional input and providing improved feedback reduces the number of inputs at the computer system, enhances the operability of the computer system, and makes the user-system interface more effective (e.g., by helping the user provide appropriate input and reducing user errors when operating / interacting with the computer system), which in turn reduces power usage and extends the battery life of the computer system by enabling the user to use the computer system more quickly and effectively.

[0287] In some embodiments, the first operation is associated with the playback of audio content (e.g., 602A; 602B; 604A; 604B). In some embodiments, the computer system (e.g., 600) causes a second visual feedback (e.g., light 607) to be displayed at the first external device (e.g., 605), including causing the visual characteristics (e.g., pulse frequency, brightness, color) of the visual feedback (e.g., 607) to be changed (e.g., modulated) based on audio characteristics (e.g., volume, frequency, beat) of the audio content. Causing the visual characteristics of the visual feedback to be changed based on the audio characteristics of the audio content provides feedback to a user of the computer system that a first operation is associated with the playback of audio content at a first external device, provides instructions to the user for the actions required to cause the computer system to perform the first operation without additional input from the user (e.g., input at a touch screen), and provides feedback to the user indicating that continuing to move towards the first external device will cause the computer system to perform the first operation. Providing instructions for causing the computer system to perform an operation without additional input and providing improved feedback reduces the number of inputs at the computer system, enhances the operability of the computer system, and makes the user-system interface more effective (e.g., by helping the user provide appropriate input and reducing user errors when operating / interacting with the computer system), which in turn reduces power usage and extends the battery life of the computer system by enabling the user to use the computer system more quickly and effectively.

[0288] In some embodiments, a computer system (e.g., 600) communicates with a haptic output generator (e.g., 167) (e.g., a linear actuator; an eccentric rotating mass actuator). In some embodiments, generating feedback includes generating haptic output (e.g., 606; 613; 616) at the computer system via the haptic output generator (audio output is optionally generated in coordination with the haptic output). Generating haptic output at the computer system provides feedback to a user of the computer system that a first operation is associated with a first external device, provides an instruction to the user of the action required to cause the computer system to perform the first operation without additional input from the user (e.g., input at a touch screen), and provides feedback to the user indicating that continuing to move toward the first external device will cause the computer system to perform the first operation. Providing an instruction for the computer system to perform an operation without additional input and providing improved feedback reduces the number of inputs at the computer system, enhances the operability of the computer system, and makes the user-system interface more effective (e.g., by helping the user provide appropriate input and reducing user errors when operating / interacting with the computer system), which in turn reduces power usage and extends the battery life of the computer system by enabling the user to use the computer system more quickly and effectively.

[0289] In some embodiments, a computer system (e.g., 600) changes a current value of a feedback parameter of feedback in a first direction, including increasing at least one of a magnitude, a frequency, and / or a repetition rate of a haptic output (e.g., 606; 613; 616) (e.g., increasing the magnitude and / or frequency of vibration). In some embodiments, the computer system changes the current value of the feedback parameter of the feedback in a second direction, including decreasing at least one of the magnitude, the frequency, and / or the repetition rate of the haptic output (e.g., decreasing the magnitude and / or frequency of vibration). In some embodiments, the feedback parameter is the magnitude, the frequency, and / or the repetition rate of the haptic output. Increasing or decreasing at least one of the magnitude, the frequency, and / or the repetition rate of the haptic output based on whether the change in direction includes movement of the computer system toward or away from a first external device provides feedback to a user of the computer system that a first operation is associated with the first external device, provides an instruction to the user for an action required to cause the computer system to perform the first operation without additional input from the user (e.g., input at a touch screen), and provides feedback to the user that continuing to move toward the first external device will cause the computer system to perform the first operation and continuing to move away from the first external device will cause the computer system not to perform the first operation. Providing an instruction for causing the computer system to perform an operation without additional input and providing improved feedback reduces the number of inputs at the computer system, enhances the operability of the computer system, and makes the user-system interface more efficient (e.g., by helping the user provide appropriate input and reducing user errors when operating / interacting with the computer system), which in turn reduces power usage and extends the battery life of the computer system by enabling the user to use the computer system more quickly and effectively.

[0290] In some embodiments, a computer system (e.g., 600) changes a current value of a feedback parameter of feedback in a first direction, including: based on determining that movement of the computer system toward a first external device (e.g., 605) includes a first movement speed, the computer system changes the current value of the feedback parameter of the feedback in the first direction by a first amount (e.g., see Figure 6B haptic output 606 in / 6D) (e.g., increasing the frequency, magnitude, and / or repetition rate of the haptic output by the first amount); and based on determining that movement of the computer system toward the first external device includes a second movement speed different from the first speed, changing the current value of the feedback parameter of the feedback in the first direction by a second amount different from the first amount (e.g., see Figure 6EThe haptic output in (e.g., increasing the frequency, magnitude, and / or repetition rate of the haptic output by a second amount). Changing the current value of the feedback parameter of the feedback in a first direction by a first amount or a second amount depending on whether the movement of the computer system towards the first external device includes a first movement speed or a second movement speed provides feedback to the user that the first operation is associated with the first external device, provides an instruction to the user for the action required to cause the computer system to perform the first operation without additional input from the user (e.g., input at a touch screen), encourages continued movement of the computer system towards the first external device by associating the haptic output with the movement speed towards the first external device, and provides the user with feedback indicating different levels of the first operation that will be performed by the computer system upon continued movement towards the first external device. Providing an instruction for the computer system to perform an operation without additional input and providing improved feedback reduces the amount of input at the computer system, enhances the operability of the computer system, and makes the user-system interface more effective (e.g., by helping the user provide appropriate input and reducing user errors when operating / interacting with the computer system), which in turn reduces power usage and extends the battery life of the computer system by enabling the user to use the computer system more quickly and effectively. In some embodiments, the first movement speed is greater than the second movement speed, and the first amount is greater than the second amount. Thus, when the movement speed is greater, the feedback parameter (e.g., frequency, repetition rate, and / or magnitude) of the haptic output increases at a greater rate, and when the movement speed is smaller, the feedback parameter of the haptic output increases at a smaller rate.

[0291] In some embodiments, the computer system (e.g., 600) changes the current value of the feedback parameter of the feedback in a first direction (e.g., or a second direction), including: depending on determining that the movement of the computer system towards the first external device (e.g., 605) includes at least a first threshold amount of movement towards the first external device (e.g., or away from the first external device) (e.g., see Figure 6E or Figure 6FIn the schematic diagram 610), the computer system changes the current value of the feedback parameter of the feedback in a first direction (e.g., or a second direction) based on the current distance of the computer system from the first external device (e.g., if the computer system is at a first distance from the first external device, the current value of the feedback parameter of the feedback is changed by a first amount in the first direction, and if the computer system is at a second (different) distance from the first external device, the current value of the feedback parameter of the feedback is changed by a second amount different from the first amount in the first direction). In some embodiments, the computer system changes the current value of the feedback parameter of the feedback in a first direction (e.g., or a second direction), including: based on determining that the movement of the computer system towards the first external device (e.g., or away from the first external device) does not include at least a first threshold movement amount towards the first external device (in some embodiments, movement towards the first external device is detected, but the movement is below the first threshold amount), abandoning changing the current value of the feedback parameter of the feedback in a first direction (e.g., or a second direction) based on the current distance of the computer system from the first external device. Changing the current value of the feedback parameter of the feedback in a first direction based on the current distance of the computer system from the first external device according to whether the movement of the computer system towards the first external device includes at least a first threshold movement amount reduces the number of operations performed at the computer system by reducing or eliminating the feedback operation when the movement of the computer system does not include at least the threshold movement amount. Reducing the number of operations performed at the computer system reduces power consumption, extends battery life, enhances the operability of the computer system, and makes the user-system interface more effective (e.g., by helping the user provide appropriate input and reducing user errors when operating the computer system / interacting with the computer system), which in turn reduces power consumption and extends the battery life of the computer system by enabling the user to use the system more quickly and effectively.

[0292] In some embodiments, the first operation is associated with the playback of an audio signal (e.g., 602A; 602B; 604A; 604B). In some embodiments, a computer system (e.g., 600) generates a haptic output (e.g., 606; 613; 616), including changing (e.g., modulating) the characteristics of the haptic output (e.g., haptic characteristics; frequency, repetition rate, and / or magnitude of the haptic output) based on audio characteristics of the audio signal (e.g., volume, frequency, beat). Changing the characteristics of the haptic output based on the audio characteristics of the audio signal provides feedback to the user of the computer system that the first operation is associated with the playback of the audio signal at a first external device, provides an instruction to the user of the actions required to cause the computer system to perform the first operation without additional input from the user (e.g., input at a touchscreen), and provides feedback to the user indicating that continuing to move toward the first external device will cause the computer system to perform the first operation. Providing an instruction for the computer system to perform an operation without additional input and providing improved feedback reduces the number of inputs at the computer system, enhances the operability of the computer system, and makes the user-system interface more effective (e.g., by helping the user provide appropriate input and reducing user errors when operating / interacting with the computer system), which in turn reduces power usage and extends the battery life of the computer system by enabling the user to use the computer system more quickly and effectively.

[0293] In some embodiments, the computer system (e.g., 600) communicates with an audio output device (e.g., 111) (e.g., an internal or external speaker). In some embodiments, generating the feedback includes generating a first audio feedback (e.g., 602A; 604A) (e.g., adjusting the audio output) at the computer system via the audio output device. Generating the first audio feedback at the computer system provides an instruction to the user of the computer system of the actions required to cause the computer system to perform the first operation without additional input from the user (e.g., input at a touchscreen) and provides feedback to the user indicating that continuing to move toward the first external device will cause the computer system to perform the first operation. Providing an instruction for the computer system to perform an operation without additional input and providing improved feedback reduces the number of inputs at the computer system, enhances the operability of the computer system, and makes the user-system interface more effective (e.g., by helping the user provide appropriate input and reducing user errors when operating / interacting with the computer system), which in turn reduces power usage and extends the battery life of the computer system by enabling the user to use the computer system more quickly and effectively.

[0294] In some embodiments, a computer system (e.g., 600) changes a current value of a feedback parameter of feedback in a first direction, including decreasing an output volume of an audio output (e.g., 602A; 604A) at the computer system (e.g., currently output). Decreasing the output volume of the audio output at the computer system provides feedback to a user of the computer system that a first operation is associated with playback of the audio, provides an instruction to the user of an action required to cause the computer system to perform the first operation without additional input from the user (e.g., input at a touch screen), and provides feedback to the user indicating that continuing to move toward a first external device will cause the computer system to perform the first operation. Providing an instruction for causing the computer system to perform an operation without additional input and providing improved feedback reduces the amount of input at the computer system, enhances the operability of the computer system, and makes the user-system interface more efficient (e.g., by helping the user provide appropriate input and reducing user errors when operating / interacting with the computer system), which in turn reduces power usage and extends the battery life of the computer system by enabling the user to use the computer system more quickly and effectively. In some embodiments, the feedback parameter is the output volume of audio output at the computer system. In some embodiments, changing the current value of the feedback parameter in a second direction includes increasing the output volume of the audio output at the computer system. In some embodiments, when the computer system is currently outputting audio and a current distance of the computer system from a first external device is less than a first threshold distance but greater than a second threshold distance, the computer system decreases the output volume of the audio when the computer system moves toward the first external device and increases the output volume of the audio when the computer system moves away from the first external device.

[0295] In some embodiments, when a first audio feedback (e.g., 602A; 604A) is generated at a computer system (e.g., 600), a second audio feedback (e.g., 602B; 604B) is generated at a first external device (e.g., 605) (e.g., adjusting the audio output) (e.g., in response to an instruction from the first external device; in response to an instruction from the computer system). Generating the second audio feedback at the first external device when the first audio feedback is generated at the computer system provides the user of the computer system with feedback that a first operation is associated with the first external device, provides the user with an instruction for the action required to cause the computer system to perform the first operation without additional input from the user (e.g., input at a touch screen), and provides the user with feedback indicating that continuing to move toward the first external device will cause the computer system to perform the first operation. Providing an instruction for causing the computer system to perform an operation without additional input and providing improved feedback reduces the number of inputs at the computer system, enhances the operability of the computer system, and makes the user-system interface more effective (e.g., by helping the user provide appropriate input and reducing user errors when operating the computer system / interacting with the computer system), which in turn reduces power usage and extends the battery life of the computer system by enabling the user to use the computer system more quickly and effectively.

[0296] In some embodiments, when the computer system (e.g., 600) changes the current value of a feedback parameter of the feedback in a first direction, the output volume of the audio output (e.g., as currently output) (e.g., see 602B-3 in Figure 6G increases at the first external device (e.g., 605) (e.g., in response to an instruction from the first external device; in response to an instruction from the computer system). Increasing the output volume of the audio output at the first external device when changing the current value of the feedback parameter of the feedback in the first direction provides the user of the computer system with feedback that a first operation is associated with audio playback at the first external device, provides the user with an instruction for the action required to cause the computer system to perform the first operation without additional input from the user (e.g., input at a touch screen), and provides the user with feedback indicating that continuing to move toward the first external device will cause the computer system to perform the first operation. Providing an instruction for causing the computer system to perform an operation without additional input and providing improved feedback reduces the number of inputs at the computer system, enhances the operability of the computer system, and makes the user-system interface more effective (e.g., by helping the user provide appropriate input and reducing user errors when operating the computer system / interacting with the computer system), which in turn reduces power usage and extends the battery life of the computer system by enabling the user to use the computer system more quickly and effectively.

[0297] In some embodiments, the feedback parameter is the output volume of the audio (e.g., 602B; 604B) output at the first external device (e.g., 605). In some embodiments, the computer system (e.g., 600) changing the current value of the feedback parameter in a second direction includes decreasing the output volume of the audio output at the first external device. In some embodiments, when the computer system is currently outputting audio and the first external device is not outputting audio, and when the current distance of the computer system from the first external device changes from a distance greater than the first threshold distance and the second threshold distance to a distance less than the first threshold distance but greater than the second threshold distance, the audio starts playing at the first external device (e.g., while continuing to play at the computer system). When the current distance of the computer system from the first external device is less than the first threshold distance but greater than the second threshold distance, the output volume of the audio at the first external device increases when the computer system moves towards the first external device (e.g., while the output volume of the audio at the computer system decreases) and decreases when the computer system moves away from the first external device (e.g., while the output volume of the audio at the computer system increases).

[0298] In some embodiments, when the first external device (e.g., 605) is currently outputting audio (e.g., 602B; 604B) while the current distance of the computer system (e.g., 600) from the first external device is less than the first threshold distance (e.g., 610-1) but greater than the second threshold distance (e.g., 610-2), the output volume of the audio at the first external device decreases when the computer system moves towards the first external device and increases when the computer system moves away from the first external device. In some embodiments, when the first external device is currently outputting audio and the computer system is not outputting audio, and when the current distance of the computer system from the first external device changes from a distance greater than the first threshold distance and the second threshold distance to a distance less than the first threshold distance but greater than the second threshold distance, the audio starts playing at the computer system (e.g., while continuing to play at the first external device). When the current distance of the computer system from the first external device is less than the first threshold distance but greater than the second threshold distance, the output volume of the audio (e.g., 602A; 604A) at the computer system increases when the computer system moves towards the first external device (e.g., while the output volume of the audio at the first external device decreases) and decreases when the computer system moves away from the first external device (e.g., while the output volume of the audio at the first external device increases).

[0299] In some embodiments, when a computer system (e.g., 600) changes a current value of a feedback parameter for feedback in a first direction, an equalization setting (e.g., of a currently output) audio output (e.g., 602B; 604B) at a first external device (e.g., 605) is adjusted (e.g., in response to an instruction from the first external device; in response to an instruction from the computer system). Adjusting the equalization setting of the audio output at the first external device when changing the current value of the feedback parameter for feedback in the first direction provides a user of the computer system with feedback that a first operation is associated with playback of the audio output at the first external device, provides an instruction to the user of the action required to cause the computer system to perform the first operation without additional input from the user (e.g., input at a touch screen), and provides feedback to the user indicating that continuing to move toward the first external device will cause the computer system to perform the first operation. Providing an instruction for causing the computer system to perform an operation without additional input and providing improved feedback reduces the amount of input at the computer system, enhances the operability of the computer system, and makes the user-system interface more effective (e.g., by helping the user provide appropriate input and reducing user errors when operating / interacting with the computer system), which in turn reduces power usage and extends the battery life of the computer system by enabling the user to use the computer system more quickly and effectively. In some embodiments, the feedback parameter is an equalization setting that affects an audio characteristic that determines the fullness of the audio output at the first external device. In some embodiments, changing the current value of the feedback parameter in the first direction includes adjusting the equalization setting in a first manner such that the fullness of the audio output at the first external device increases. In some embodiments, changing the current value of the feedback parameter in a second direction includes adjusting the equalization setting in a second manner such that the fullness of the audio output at the first external device decreases. In some embodiments, when the first external device is currently outputting audio and the current distance of the computer system from the first external device is less than a first threshold distance but greater than a second threshold distance, as the computer system moves toward the first external device, the equalization setting of the audio output at the first external device changes such that the audio characteristic smoothly transitions from having a thin sound (e.g., having an audio characteristic similar to audio generated from a low-power speaker (e.g., a speaker of a smart phone)) to having a full, rich sound. Conversely, as the computer system moves away from the first external device, the equalization setting of the audio output at the first external device changes such that the audio characteristic smoothly transitions from the full, rich sound to the thin sound.

[0300] In some embodiments, a computer system (e.g., 600) communicates with a haptic output generator (e.g., 167) (e.g., a linear actuator; an eccentric rotating mass actuator). In some embodiments, generating feedback includes: generating, via the haptic output generator at the computer system, a first haptic output (e.g., 606; 613) (optionally generating an audio output in coordination with the haptic output) based on determining that a first set of criteria is met; and refraining from generating the first haptic output at the computer system (in some embodiments, generating a non-haptic output, such as an audio output and / or a visual output) based on determining that the first set of criteria is not met (e.g., see Figure 6F ). In some embodiments, haptic output is generated (or not generated) based on the operating state of the computer system. For example, in some embodiments, when the computer system (e.g., the battery of the computer system) is charging, the feedback does not include haptic output. As another example, in some embodiments, when the computer system is stationary (e.g., the computer system is not moved) (e.g., the computer system has been placed on a surface such as a table), the feedback does not include haptic output. As yet another example, in some embodiments, when the computer system is positioned in a particular manner, such as when the computer system is positioned away from a first external device (e.g., as Figure 6F shown), the feedback does not include haptic output.

[0301] In some embodiments, when the computer system (e.g., 600) is in a charging state (e.g., the battery of the computer system is charging), the first set of criteria is not met. In some embodiments, when the computer system has been stationary for a predetermined amount of time (e.g., the computer system is not moved), the first set of criteria is not met. In some embodiments, when a predetermined portion of the computer system (e.g., 600-1) (e.g., the display screen, the top surface, the user-facing surface) is positioned away (backward) from an external device (e.g., the orientation) (e.g., see Figure 6F ), the first set of criteria is not met.

[0302] In some embodiments, in response to detecting the distance change: based on determining that the current distance of the computer system (e.g., 600) from a first external device (e.g., 605) is less than a second threshold distance (e.g., 610-2), the computer system stops changing the current value of a feedback parameter based on the movement of the computer system relative to the first external device (e.g., stops generating feedback; disables changing the current value of the feedback parameter based on the movement of the computer system relative to the first external device) (e.g., see Figures 6J to 6L) When the current distance of the computer system from the first external device is less than the second threshold distance, the current value of the feedback parameter is stopped from being changed based on the movement of the computer system relative to the first external device, and feedback that a first operation has been performed due to the previous movement of the computer system relative to the first external device is provided to the user of the computer system. Providing improved feedback reduces the number of inputs at the computer system, enhances the operability of the computer system, and makes the user-system interface more effective (e.g., by helping the user provide appropriate inputs and reducing user errors when operating / interacting with the computer system), which in turn reduces power usage and extends the battery life of the computer system by enabling the user to use the system more quickly and effectively.

[0303] In some embodiments, after stopping changing the current value of the feedback parameter based on the movement of the computer system (e.g., 600) relative to the first external device (e.g., 605) (e.g., after performing the first operation; after disabling changing the current value of the feedback parameter based on the movement of the computer system relative to the first external device), the computer system detects a third distance change between the computer system and the first external device. In response to detecting the third distance change: Based on determining that the current distance of the computer system from the first external device (e.g., the current distance after detecting the third distance change) is greater than a third threshold distance (e.g., 610-1) (e.g., a pre-determined threshold distance; an external threshold distance; a first threshold distance; the first threshold distance plus a variance (e.g., 45% / 50% / 60% of the first threshold distance)), the current value of the feedback parameter is changed (e.g., re-enabled to be changed) based on the movement of the computer system relative to the first external device (e.g., see Figure 6L and Figure 6M ). In response to detecting the third distance change: Based on determining that the current distance of the computer system from the first external device (e.g., the current distance after detecting the third distance change) is less than the third threshold distance, changing the current value of the feedback parameter based on the movement of the computer system relative to the first external device is abandoned (e.g., continuing to stop changing the current value of the feedback parameter based on the movement of the computer system relative to the first external device) (e.g., see Figure 6J and Figure 6K)。Based on whether the computer system has moved beyond a third threshold distance, selectively enable changing the current value of a feedback parameter based on the movement of the computer system relative to a first external device, preventing the computer system from generating undesired or unnecessary feedback by ensuring that the user of the computer system intentionally desires to re-enable the feedback (as indicated by moving the computer system beyond the third threshold distance). Preventing the computer system from generating undesired or unnecessary feedback saves computing resources, enhances the operability of the computer system, and makes the user-system interface more effective (e.g., by helping the user provide appropriate input and reducing user errors when operating / interacting with the computer system), which in turn reduces power usage and extends the battery life of the computer system by enabling the user to use the system more quickly and effectively.

[0304] In some embodiments, the computer system (e.g., 600) performs a first operation, including: based on determining that a second set of criteria is met, where the second set of criteria includes criteria met when the computer system is currently playing (e.g., outputting audio and / or displaying video) a first media (e.g., 602A) (e.g., audio and / or video media), the computer system initiates playback of the first media at a first external device (e.g., 605), including: reducing a first audio characteristic (e.g., volume, equalization settings) of the first media at the computer system (e.g., see Figures 6D to 6H 602A-4, 602A-3, 602A-2, and / or 602A-1 in Figures 6D to 6I602B-1, 602B-2, 602B-3, 602B-4, and / or 602B-5) (e.g., a fade-over handover of a first media from a computer system to a first external device, which in some embodiments includes gradually decreasing the output volume of the first media at the computer system while gradually increasing the output volume of the first media at the first external device). Causing an increase in a second audio characteristic of the first media at the first external device while decreasing a first audio characteristic of the first media at the computer system provides a user of the computer system with feedback that a first operation is associated with playback of the first media at the first external device and provides feedback that the first operation has been performed, such that the user no longer attempts to perform the first operation (e.g., by providing input on a touch screen or continuing to move the computer system), thereby reducing the number of inputs at the computer system. Providing improved feedback and reducing the number of inputs at the computer system enhances the operability of the computer system and makes the user-system interface more efficient (e.g., by helping the user provide appropriate input and reducing user errors when operating / interacting with the computer system), which in turn reduces power usage and extends the battery life of the computer system by enabling the user to use the system more quickly and effectively.

[0305] In some embodiments, after a computer system (e.g., 600) performs a first operation (e.g., transferring data to a first external device (e.g., data for handing over a media from the computer system to the first external device); retrieving a media or information about a media currently being played on the first external device (e.g., for playback on the computer system)), one or more of the size or brightness of a third set of graphical elements (e.g., light 607; 605-2) displayed at the first external device (e.g., 605) is decreased (e.g., decreasing the size and / or brightness) (e.g., see Figure 6I)(e.g., in response to an instruction from a first external device; in response to an instruction from a computer system) (e.g., after performing a first operation, the glow of one or more light elements at the first external device becomes dimmer and / or smaller in size). Reducing one or more of the size or brightness of a third set of one or more graphical elements displayed at the first external device after performing the first operation provides feedback to a user of the computer system that the first operation is associated with the first external device and provides feedback that the first operation has been performed, such that the user no longer attempts to perform the first operation (e.g., by providing input on a touch screen or continuing to move the computer system), thereby reducing the amount of input at the computer system. Providing improved feedback and reducing the amount of input at the computer system enhances the operability of the computer system and makes the user-system interface more efficient (e.g., by helping the user provide appropriate input and reducing user errors when operating / interacting with the computer system), which in turn reduces power usage and extends the battery life of the computer system by enabling the user to use the system more quickly and effectively. In some embodiments, when the computer system is close to the first external device, the brightness and / or size of the glow of the one or more light elements at the first external device increases until a second threshold distance is reached. In some embodiments, when a first operation is performed (e.g., transferring media from the computer system to the first external device, or from the first external device to the computer system), the one or more graphical elements of the set have high brightness and / or large size, and after performing the first operation, the brightness and / or size of the one or more graphical elements of the set fade (e.g., until a "turned off" setting).

[0306] In some embodiments, after a computer system (e.g., 600) performs a first operation (e.g., transferring data to a first external device (e.g., data for transferring media from the computer system to the first external device); retrieving media or information about media currently being played on the first external device (e.g., for playback on the computer system)), the equalization settings of the audio output (e.g., 602B; 604B) at the first external device (e.g., 605) (e.g., the currently outputted) are adjusted (e.g., in response to an instruction from the first external device; in response to an instruction from the computer system) (e.g., causing the equalization settings of the audio output at the first external device to change such that the audio characteristics smoothly transition from having a shrill sound to having a full, rich sound). Adjusting the equalization settings of the audio output at the first external device after performing the first operation provides the user of the computer system with feedback that the first operation is associated with the playback of the audio at the first external device and provides the user with feedback that the first operation has been performed, such that the user no longer attempts to perform the first operation (e.g., by providing input on a touchscreen or continuing to move the computer system), thereby reducing the amount of input at the computer system. Providing improved feedback and reducing the amount of input at the computer system enhances the operability of the computer system and makes the user-system interface more efficient (e.g., by helping the user provide appropriate input and reducing user errors when operating / interacting with the computer system), which in turn reduces power usage and extends the battery life of the computer system by enabling the user to use the system more quickly and effectively.

[0307] In some embodiments, when a first external device (e.g., 605) is currently playing (e.g., outputting audio and / or displaying video) a second media (e.g., 602B) (e.g., audio and / or video media), a computer system (e.g., 600) detects a fourth distance change between the computer system and the first external device (e.g., see Figure 6Lin the schematic diagram 610). In response to detecting a fourth distance change and based on determining that the current distance of the computer system from the first external device (e.g., the current distance after detecting the fourth distance change) is greater than a fourth threshold distance (e.g., 610-1) (e.g., a pre-determined threshold distance; an external threshold distance; a first threshold distance; the first threshold distance plus a variance (e.g., 45% / 50% / 60% of the first threshold distance)): Based on determining that the second media is of a first type of media (e.g., communication audio (e.g., a phone call, audio from a video communication)), the playback of the second media at the first external device stops (e.g., in response to an instruction from the first external device; in response to an instruction from the computer system) (e.g., initiate a process for the computer system to playback the second media (e.g., transfer the playback of the second media from the first external device to the computer system)); and based on determining that the second media is of a second type of media different from the first type (e.g., music; a podcast; non-communication session audio), the playback of the second media at the first external device continues (e.g., see Figure 6L ). Continuing or stopping the playback of the second media at the first external device when the computer system moves beyond the fourth threshold distance from the first external device automatically performs the operation without the need for additional input from the user of the computer system (e.g., input for continuing or stopping the playback of the second media at the first external device). Performing the operation without the need for additional input enhances the operability of the computer system and makes the user-system interface more efficient (e.g., by helping the user provide appropriate input and reducing user errors when operating the computer system / interacting with the computer system), which in turn reduces power usage and extends the battery life of the computer system by enabling the user to use the system more quickly and effectively. Additionally, stopping the playback of the second media at the first external device when the second media is of the first type of media (e.g., a phone call) protects the privacy of the user of the computer system by ensuring that the first type of media is not played back at the first external device without the user's knowledge.

[0308] It should be noted that the processes described above with respect to method 700 (e.g., Figure 7 ) also apply in a similar manner to the methods described below. For example, methods 800, 1000, and 1200 optionally include one or more features of the various methods described above with reference to method 700. For example, these methods may include providing dynamic feedback based on the movement of the computer system relative to the first external device, as discussed in method 700. For the sake of brevity, these details are not repeated below.

[0309] Figure 8It is a flowchart showing a method for managing a media playback device using an electronic device according to some embodiments. The method 800 is performed at a device (e.g., 100, 300, 500, 600), a display (e.g., 601), and one or more input devices (e.g., 601; 112). Some operations in method 800 are optionally combined, the order of some operations is optionally changed, and some operations are optionally omitted.

[0310] In some embodiments, the electronic device (e.g., 600) includes a computer system. The computer system optionally communicates (e.g., wired communication, wireless communication) with a display generation component (e.g., 601) (e.g., a display controller, a touch-sensitive display system) and one or more input devices (e.g., 601; 112) (e.g., a touch-sensitive surface). The display generation component is configured to provide a visual output, such as a display via a CRT monitor, a display via an LED monitor, or a display via image projection. In some embodiments, the display generation component is integrated with the computer system. In some embodiments, the display generation component is separate from the computer system. One or more input devices are configured to receive input, such as a touch-sensitive surface for receiving user input. In some embodiments, one or more input devices are integrated with the computer system. In some embodiments, one or more input devices are separate from the computer system. Thus, the computer system can send data (e.g., image data or video data) to the integrated or external display generation component via a wired or wireless connection to visually generate content (e.g., using a display device), and can receive input from one or more input devices via a wired or wireless connection.

[0311] As described below, method 800 provides an intuitive way to manage a media playback device. The method reduces the cognitive burden on the user for managing the media playback device, thus creating a more efficient human-machine interface. For battery-powered computing devices, enabling the user to manage the media playback device faster and more efficiently saves power and increases the time interval between two battery charges.

[0312] In method 800, in response to determining (802) that the distance between the computer system (e.g., 600) and a first external device (e.g., 605) (e.g., a smart speaker; a media playback device (e.g., a digital media player); a smart phone; a smart watch) is less than (e.g., now less than; has changed and / or become less than) a first threshold distance (e.g., 610-1; 610-2) (e.g., a pre-determined threshold distance (e.g., 6 inches, 12 inches, 18 inches); an external threshold distance from the first external device; an internal threshold distance from the first external device (e.g., 4 inches, 8 inches, 12 inches)), the computer system performs steps 804-812 of method 800.

[0313] Based on determining that a first set of criteria is met, where the first set of criteria includes criteria that are met when a computer system (e.g., 600) is currently playing (e.g., outputting audio and / or displaying video at the computer system or causing a connected device to output audio and / or display video) a first media (e.g., 604A) (e.g., audio and / or video media) and a first external device (e.g., 605) is playing a second media (e.g., 602B) (e.g., audio and / or video media) (e.g., the computer system and the first external device are outputting different audio simultaneously), the computer system displays (804) a media control user interface (e.g., 612'; 612). The media control interface includes (e.g., simultaneously includes) a first optional graphical user interface object (e.g., 626) (e.g., a "transfer from phone" enabling representation) for initiating playback of the first media (e.g., 604A) on the first external device; and one or more optional user interface objects (e.g., 612-1) (e.g., these objects control playback when selected) for controlling playback of the second media on the first external device. The one or more optional user interface objects include first media control optional graphical user interface objects (e.g., 612-1a; 612-1b) (e.g., play enabling representation, pause enabling representation, next track enabling representation, previous track enabling representation, volume enabling representation, and / or audio scrub bar). Displaying the media control user interface and having the media control user interface include the first optional graphical user interface object for initiating playback of the first media on the first external device and the one or more optional user interface objects (including the first media control optional graphical user interface objects) for controlling playback of the second media on the first external device when the computer system is currently playing the first media and the first external device is playing the second media provides feedback to a user of the computer system of an executable first function of initiating playback of the first media on the first external device and an executable second function of controlling playback of the second media on the first external device, without requiring further input from the user to navigate between different user interfaces to access each of these separate functions. Additionally, when a set of conditions is met, the computer system automatically displays the media control user interface with the first optional graphical user interface object and the one or more optional user interface objects, without requiring further input from the user to access and navigate between different user interfaces to access the first optional graphical user interface object and the one or more optional user interface objects. Providing improved feedback and automatically performing an operation when a set of conditions is met reduces the amount of input at the computer system, enhances the operability of the computer system, and makes the user-system interface more efficient (e.g., by helping the user provide appropriate input and reducing user errors when operating the computer system / interacting with the computer system), which in turn reduces power usage and extends the battery life of the computer system by enabling the user to use the system more quickly and effectively.

[0314] In some embodiments, in response to determining that the distance between the computer system and a first external device (e.g., 605) is less than a first threshold distance (e.g., 610-2) (e.g., when the first threshold distance is the internal threshold distance from the first external device), the computer system (e.g., 600) displays a media control user interface (e.g., 612'; 612). In some embodiments, in response to an input (e.g., 608) on a user interface object (e.g., 615) displayed when the distance between the computer system and the first external device is less than the first threshold distance (e.g., 610-1) and greater than a second threshold distance (e.g., 610-2) (e.g., when the first threshold distance is the external threshold distance from the first external device and the second threshold distance is the internal threshold distance from the first external device), the computer system displays a media control user interface.

[0315] When displaying the media control user interface (e.g., 612), the computer system (e.g., 600) receives (806) input (e.g., 628; 630) (e.g., touch input) via the one or more input devices (e.g., 601).

[0316] In response (808) to receiving the input (e.g., 628; 630), and based on determining that the input (e.g., 630) corresponds to a first selectable graphical user interface object (e.g., 626) (e.g., the input is a selection of the "transfer from phone" enablement), the computer system (e.g., 600) initiates (810) a process for causing the first external device (e.g., 605) to play back a first media (e.g., Figure 6T in which device 605 starts playing music 604B) (e.g., initiates a process for outputting the first media at the first external device (e.g., transferring the playback of the first media from the computer system to the first external device)) (in some embodiments, stops playing back a second media at the first external device) (e.g., adds the first media to a queue for playback at the first external device). In some embodiments, playing back the first media at the first external device includes stopping playing back the first media at the computer system.

[0317] In response (808) to receiving the input (e.g., 628; 630), and based on determining that the input (e.g., 628) corresponds to (e.g., is a selection of) a first media control selectable graphical user interface object (e.g., 612-1a) (e.g., the pause enablement), initiates a process for controlling (e.g., modifying) the playback of a second media (e.g., 602B) by the first external device (e.g., these objects control playback when selected) (e.g., pauses playing back the second media at the first external device (e.g., see Figure 6S))(In some embodiments, the playback of the first media continues at the computer system simultaneously).

[0318] In some embodiments, in response to determining that the distance between the computer system (e.g., 600) and the first external device (e.g., 605) is less than a first threshold distance (e.g., 610-1), and based on determining that a second set of criteria is satisfied, where the second set of criteria includes criteria that are satisfied when the computer system is not playing the first media (e.g., 604A) (e.g., the computer system is not causing the playback of any media) and the first external device is not playing the second media (e.g., 602B) (e.g., the first external device is not causing the playback of any media), the computer system displays, via a display generation component (e.g., 601), one or more representations of a set of pre-determined media content items (e.g., 612-3) (e.g., the media control user interface includes the one or more representations of the set of pre-determined media content items) (e.g., a set of icons or images representing recommended or recently played songs or albums, the set of icons or images being selectable to initiate the playback of the corresponding song or album). Displaying one or more representations of a set of pre-determined media content items when the computer system is not playing the first media and the first external device is not playing the second media provides feedback to the user of the computer system of the functionality available to initiate the playback of the pre-determined media without the need for further input from the user to navigate to a user interface to select the media to be played. Additionally, the computer system automatically displays the one or more representations of the set of pre-determined media content items when a set of conditions is satisfied, without the need for further input from the user to access and navigate between different user interfaces to access the representations of the media content items. Providing improved feedback and automatically performing an operation when a set of conditions is satisfied reduces the amount of input at the computer system, enhances the operability of the computer system and makes the user-system interface more efficient (e.g., by helping the user provide appropriate input and reducing user errors when operating the computer system / interacting with the computer system), which in turn reduces power usage and extends the battery life of the computer system by enabling the user to use the system more quickly and effectively.

[0319] In some embodiments, the method further includes: when displaying the one or more representations of the set of pre-determined media content items (e.g., 612-3), the computer system (e.g., 600) receives, via the one or more input devices (e.g., 601), an input pointing to a first representation of a pre-determined media content item; and in response to receiving the input pointing to the first representation, initiating a process for causing the computer system and / or the first external device (e.g., 605) to play the media corresponding to the first representation.

[0320] In some embodiments, in response to determining that the distance between a computer system (e.g., 600) and a first external device (e.g., 605) is less than a first threshold distance (e.g., 610-1), and based on determining that a third set of criteria is met, where the third set of criteria includes criteria that are met when the computer system is not playing a first media (e.g., 604A) (e.g., the computer system is not causing the playback of any media) and the first external device is currently playing a second media (e.g., 602B) (e.g., see Figure 6M ), the computer system displays, via a display generation component (e.g., 601), a second optional graphical user interface object (e.g., 620) (e.g., the media control user interface includes the second optional graphical user interface object), which, when selected, initiates the playback of the second media at the computer system (e.g., the "transfer to phone" affordance; an affordance for transferring media from the first external device to the computer system). Displaying the second optional graphical user interface object when the computer system is not playing the first media and the first external device is playing the second media, and the second optional graphical user interface object initiating the playback of the second media at the computer system when selected, provides the user of the computer system with actionable feedback for the function of initiating the playback of the second media at the computer system without requiring further input from the user to navigate between different user interfaces to access the control for initiating the playback of the second media at the computer system. Additionally, the computer system automatically displays the second optional graphical user interface object when a set of conditions is met without requiring further input from the user to access and navigate between different user interfaces to access the second optional graphical user interface object. Providing improved feedback and automatically performing an operation when a set of conditions is met reduces the amount of input at the computer system, enhances the operability of the computer system, and makes the user-system interface more efficient (e.g., by helping the user provide appropriate input and reducing user errors when operating / interacting with the computer system), which in turn reduces power usage and extends the battery life of the computer system by enabling the user to use the system more quickly and effectively.

[0321] In some embodiments, the method further includes: when displaying a second optional graphical user interface object (e.g., 620), the computer system (e.g., 600) receiving, via the one or more input devices (e.g., 601), an input pointing to the second optional graphical user interface object; and in response to receiving the input pointing to the second optional graphical user interface object, initiating a process for causing the computer system to play back a second media (e.g., 602B). In some embodiments, when the second media is transmitted to the computer system, the first external device continues to play back the second media. In some embodiments, when the second media is transmitted to the computer system, the first external device stops playing back the second media. In some embodiments, when the first external device hands over the playback of the second media to the computer system, the first external device generates feedback to indicate that the handover process has been initiated. For example, in some embodiments, the first external device includes lights, and these lights are displayed in a pulsed manner and increase in brightness (and optionally increase the pulse frequency) when the handover is initiated, and then these lights fade to the "off" setting when the handover is complete.

[0322] In some embodiments, in response to determining that the distance between the computer system (e.g., 600) and the first external device (e.g., 605) is less than a first threshold distance (e.g., 610-2), and based on determining that a fourth set of criteria is satisfied, where the fourth set of criteria includes criteria satisfied when the computer system is currently playing a first media (e.g., 604A) and the first external device is not playing a second media (e.g., 602B) (e.g., the first external device is not causing the playback of any media), the computer system initiates a process for causing the first external device to play back the first media (e.g., see Figures 6G to 6I )(e.g., initiating a process for outputting the first media at the first external device (e.g., handing over the playback of the first media from the computer system to the first external device), without further input (e.g., touch input) from a user of the computer system). Initiating a process for causing the first external device to play back the first media when the computer system is currently playing the first media and the first external device is not playing the second media allows the computer system to automatically initiate the playback of the first media at the first external device, without further input from the user to initiate the playback of the first media at the first external device. Automatically performing an operation when a set of conditions is met enhances the operability of the computer system and makes the user-system interface more efficient (e.g., by helping the user provide appropriate input and reducing user errors when operating the computer system / interacting with the computer system), which in turn reduces power usage and extends the battery life of the computer system by enabling the user to use the system more quickly and effectively. In some embodiments, playing back the first media at the first external device includes stopping the playback of the first media at the computer system.

[0323] In some embodiments, in response to determining that the distance between a computer system (e.g., 600) and a first external device (e.g., 605) is less than a first threshold distance (e.g., 610-1; 610-2), and based on determining that a fifth set of criteria is met, where the fifth set of criteria includes a first criterion that is met when the computer system is currently playing a first media (e.g., 604A) and the first external device is playing a third media (e.g., 602B) (e.g., a second media) (e.g., the computer system and the first external device are outputting different audio simultaneously), and a second criterion that is met when the first media is different from the third media (e.g., the first media and the third media are different songs), the computer system adds the third media to a queue for playback at the computer system (e.g., when adding the third media to the queue for future playback at the computer system, the computer system continues to cause the playback of the first media). Adding the third media to the queue for playback at the computer system when the computer system is currently playing the first media and the first external device is playing a third media different from the first media allows the computer system to automatically add the third media to the playback queue of the computer system without requiring further input from the user to navigate various user interfaces to locate the third media (e.g., in a library of media items) and add it to the queue. Automatically performing an operation when a set of conditions is met enhances the operability of the computer system and makes the user-system interface more efficient (e.g., by helping the user provide appropriate input and reducing user errors when operating the computer system / interacting with the computer system), which in turn reduces power usage and extends the battery life of the computer system by enabling the user to use the system more quickly and effectively.

[0324] In some embodiments, the media control user interface (e.g., 612) also includes a set of one or more optional user interface objects (e.g., 612-4; 612-6; 612-7) (e.g., timer control; alarm control; message control), the set of one or more optional user interface objects including a first optional user interface object (612-6a; 612-6b; 612-7a) that, when selected, controls an operation at a first external device (e.g., 605) (e.g., an operation associated with a timer at the first external device; an operation associated with an alarm at the first external device; an operation associated with a message at the first external device). Displaying the media control user interface that includes the first optional user interface object and that, when selected, controls an operation at the first external device provides feedback to a user of the computer system of the functionality available to perform the operation at the first external device without the need for further input from the user to navigate between different user interfaces to access the functionality. Further, the computer system automatically displays the media control user interface having the first optional user interface object when a set of conditions is met without the need for further input from the user to access and navigate between different user interfaces to access the first optional user interface object. Providing improved feedback and automatically performing an operation when a set of conditions is met reduces the amount of input at the computer system, enhances the operability of the computer system, and makes the user-system interface more efficient (e.g., by helping the user provide appropriate input and reducing user errors when operating / interacting with the computer system), which in turn reduces power usage and extends the battery life of the computer system by enabling the user to use the system more quickly and effectively.

[0325] In some embodiments, the set of one or more optional user interface objects includes a set of controls selected from the group consisting of: a timer control (e.g., 612-6) (e.g., a control for setting or adjusting a timer using the first external device), an alarm control (e.g., 612-7) (e.g., a control for setting or adjusting an alarm using the first external device), and a message control (e.g., 612-4) (e.g., a control for composing, sending, or reading a message using the first external device).

[0326] In some embodiments, in response to determining that the distance between a computer system (e.g., 600) and a first external device (e.g., 605) is less than (e.g., now less than; has transitioned and / or changed to less than) a second threshold distance (e.g., 610-1) (e.g., a pre-determined threshold distance (e.g., 6 inches, 12 inches, 18 inches); an external threshold distance from the first external device) (in some embodiments, in response to determining that the distance between the computer system and the first external device is less than the second threshold distance and greater than the first threshold distance), the computer system displays, via a display generation component (e.g., 601), a representation (e.g., 615) of a media control user interface (e.g., 612) (e.g., an enabling representation (optional graphical user interface object) representing a "capsule" view), wherein the representation of the media control user interface includes an indication of the first external device (e.g., 615-1; 615-2) (e.g., text and / or an image representing the first external device). Displaying the representation of the media control user interface that includes an indication of the first external device when the distance between the computer system and the first external device is less than the second threshold distance provides feedback to a user of the computer system regarding functions that can be performed relative to the first external device without requiring further input from the user to navigate between different user interfaces to access the functions of the first external device. Additionally, the computer system automatically displays the representation of the media control user interface having an indication of the first external device without requiring further input from the user. Providing improved feedback and automatically performing an operation when a set of conditions is met reduces the amount of input at the computer system, enhances the operability of the computer system, and makes the user-system interface more efficient (e.g., by helping the user provide appropriate input and reducing user errors when operating / interacting with the computer system), which in turn reduces power usage and extends the battery life of the computer system by enabling the user to use the system more quickly and effectively.

[0327] In some embodiments, the indication of the first external device (e.g., 605) includes first status information associated with the first external device (e.g., 615-1) (e.g., text and / or an image indicating the current condition or state of the first external device). In some embodiments, the status information includes an indication of whether media is being played back at the first external device, what media is being played back at the first external device, the type of media being played back at the first external device (e.g., call, music, podcast, voice command, virtual assistant), and / or an indication of whether the first external device is on / off, connected / disconnected, and / or has sufficient power.

[0328] In some embodiments, a computer system (e.g., 600) detects a first distance change between the computer system and a first external device (e.g., 605). In some embodiments, the distance change is detected based on a change in signal strength (e.g., wireless signal strength) exchanged between the system and the first external device. In some embodiments, the distance change is detected via one or more sensors (e.g., infrared sensors; optical sensors). In some embodiments, the distance change is detected via data transmitted to the system from a Wi-Fi positioning system, from GPS, and / or from the first external device. In response to detecting the first distance change and based on determining that the first distance change includes movement of the computer system towards the first external device (e.g., see Figure 6E )(e.g., the distance change includes a decrease in the distance between the computer system and the first external device (in some embodiments, while remaining between a first threshold distance and a second threshold distance (e.g., the computer system is located at a first distance from the first external device, between the first threshold distance and the second threshold distance))), the computer system adjusts (e.g., increases) the display size of a representation of a media control user interface (e.g., 615) (e.g., see Figure 6E ). Adjusting the display size of the representation of the media control user interface when the first distance change includes movement of the computer system towards the first external device provides the user of the computer system with an instruction for the action required to cause the computer system to display the media control user interface and provides the user with feedback indicating that continuing to move towards the first external device will cause the computer system to display the media control user interface. Providing an instruction for the computer system to perform an operation without requiring additional input and providing improved feedback reduces the amount of input at the computer system, enhances the operability of the computer system, and makes the user-system interface more effective (e.g., by helping the user provide appropriate input and reducing user errors when operating / interacting with the computer system), which in turn reduces power usage and extends the battery life of the computer system by enabling the user to use the computer system more quickly and effectively.

[0329] In some embodiments, a computer system (e.g., 600) detects a second change in distance between the computer system and a first external device (e.g., 605). In some embodiments, the change in distance is detected based on a change in signal strength (e.g., wireless signal strength) exchanged between the system and the first external device. In some embodiments, the change in distance is detected via one or more sensors (e.g., infrared sensors; optical sensors). In some embodiments, the change in distance is detected via data transmitted to the system from a Wi-Fi positioning system, from GPS, and / or from the first external device. In response to detecting the second change in distance and based on determining that the second change in distance includes movement of the computer system away from the first external device (e.g., see Figure 6F )(e.g., the second change in distance includes an increase in the distance between the computer system and the first external device (in some embodiments, while remaining between a first threshold distance and a second threshold distance (e.g., the computer system is located at a second distance from the first external device, between the first threshold distance and the second threshold distance and greater than the first distance from the first external device))), the computer system adjusts (e.g., reduces) the display size of a representation of a media control user interface (e.g., 615) (e.g., see Figure 6F ). Adjusting the display size of the representation of the media control user interface when the second change in distance includes movement of the computer system away from the first external device provides feedback to the user of the computer system indicating that continued movement away from the first external device will not cause the computer system to display the media control user interface. Providing improved feedback enhances the operability of the computer system and makes the user-system interface more effective (e.g., by helping the user provide appropriate input and reducing user errors when operating / interacting with the computer system), which in turn reduces power usage and extends the battery life of the computer system by enabling the user to use the system more quickly and effectively.

[0330] In some embodiments, the representation of the media control user interface (e.g., 615) includes a first subgroup of status information (e.g., 615-1) associated with a first external device (e.g., 605) (e.g., text and / or images indicating the current condition or status of the first external device). In some embodiments, when displaying the representation of the media control user interface, the computer system (e.g., 600) receives a second input (e.g., 608) (e.g., a touch input pointing to the representation of the media control user interface; a change in the distance between the computer system and the first external device (e.g., the computer system moves closer to the first external device)). In response to receiving the second input, the computer system displays a representation of the media control user interface in an expanded state (e.g., 612'; 612), which includes a second subgroup of status information (e.g., 612-2; 612-1) associated with the first external device, and the second subgroup of status information is different from the first subgroup of status information associated with the first external device (e.g., text and / or images indicating the current condition or status of the first external device) (e.g., status information not included in the first subgroup of status information). In some embodiments, the second subgroup of status information includes the first subgroup of status information plus additional status information. In some embodiments, displaying the representation of the media control user interface in an expanded state includes displaying an animation of the representation of the media control user interface expanding to display additional status information (e.g., the second subgroup of status information). In some embodiments, displaying the representation of the media control user interface in an expanded state includes displaying the representation of the media control user interface expanding into the media control user interface, where the second subgroup of status information is displayed in the media control user interface. In some embodiments, the expanded state of the representation of the media control user interface is the media control user interface.

[0331] In some embodiments, a computer system (e.g., 600) displays a representation of a media control user interface (e.g., 612') having an expanded state, including based on determining that a sixth set of criteria is met, where the sixth set of criteria includes criteria that are met when the computer system is currently playing a first media (e.g., 604A) and a first external device (e.g., 605) is not playing a second media (e.g., 602B) (e.g., the first external device is not causing playback of any media), the computer system displays a third optional graphical user interface object (e.g., 626) (e.g., a first optional graphical user interface object) (e.g., a "Transfer from phone" enabling representation), which, when selected, initiates playback of the first media on the first external device (e.g., displaying the third optional graphical user interface object without immediately transferring playback of the first media to the first external device). In some embodiments, the method further includes: when displaying the third optional graphical user interface object, receiving an input pointing to the third optional graphical user interface object; and in response to receiving the input pointing to the third optional graphical user interface object, initiating a process for causing the first external device to play the first media (e.g., initiating a process for outputting the first media at the first external device (e.g., transferring playback of the first media from the computer system to the first external device)).

[0332] In some embodiments, in response to determining that the distance between a computer system (e.g., 600) and a first external device (e.g., 605) is less than a first threshold distance (e.g., 610-2) (e.g., an internal threshold distance from the first external device (e.g., 4 inches, 8 inches, 12 inches)), the computer system displays second status information (e.g., 612-2; 612-1) associated with the first external device (e.g., text and / or images indicative of the current condition or status of the first external device). Displaying the second status information associated with the first external device when the distance between the computer system and the first external device is less than the first threshold distance provides feedback to a user of the computer system that the distance between the computer system and the first external device is less than the first threshold distance. Providing improved feedback reduces the number of inputs at the computer system, enhances the operability of the computer system, and makes the user-system interface more effective (e.g., by helping the user provide appropriate inputs and reducing user errors when operating / interacting with the computer system), which in turn reduces power usage and extends the battery life of the computer system by enabling the user to use the system more quickly and effectively. In some embodiments, the status information includes an indication of whether media is being played back at the first external device, an indication of what media is being played back at the first external device, an indication of the type of media being played back at the first external device (e.g., call, music, podcast, voice command, virtual assistant), and / or an indication of whether the first external device is on / off, connected / disconnected, and / or has sufficient power.

[0333] In some embodiments, a computer system (e.g., 600) displays second status information (e.g., 612-2; 612-1) associated with a first external device (e.g., 605), including displaying a second representation of a media control user interface (e.g., 615) (e.g., an enabling representation (optional graphical user interface object) representing a "capsule" view) transitioning from a first state (e.g., Figure 6G 615 in Figures 6G to 6I ) that does not include the second status information (e.g., the "capsule" view) to a second state (e.g., Figure 6H 612' in Figure 6I612) (e.g., the second state of the second representation of the media control user interface is the media control user interface). The display of the second representation of the media control user interface transitioning from a first state that does not include the second state information to a second state that includes the second state information provides feedback to a user of the computer system indicating that the distance between the computer system and a first external device is less than a first threshold distance. Providing improved feedback reduces the number of inputs at the computer system, enhances the operability of the computer system, and makes the user-system interface more effective (e.g., by helping the user provide appropriate inputs and reducing user errors when operating / interacting with the computer system), which in turn reduces power usage and extends the battery life of the computer system by enabling the user to use the system more quickly and effectively. In some embodiments, the second representation of the media control user interface includes little or no state information in the first state and includes the second state information in the second state.

[0334] In some embodiments, in response to receiving the input (e.g., 632), and based on determining that the input corresponds to a predefined gesture (e.g., an upward swipe originating from a location on the media control user interface), the computer system (e.g., 600) stops displaying the one or more alternative user interface objects (e.g., 612-1) for controlling the playback of a second media on a first external device (e.g., 605) (e.g., see Figures 6U to 6W ). In some embodiments, stopping the display of the one or more alternative user interface objects for controlling the playback of a second media on a first external device includes displaying an animation of the media control user interface shrinking to a representation of the media control user interface (e.g., a glyphic representation showing a "capsule" view) (e.g., see Figure 6V ).

[0335] Note that the details of the processes described above with respect to method 800 (e.g., Figure 8 ) also apply in a similar manner to the methods described above and below. For example, methods 700, 1000, and 1200 optionally include one or more features of the various methods described above with reference to method 800. For example, these methods may include displaying a control interface as discussed in method 800. For the sake of brevity, these details are not repeated below.

[0336] Figures 9A to 9R Exemplary embodiments for managing a media playback device according to some embodiments are shown. The embodiments in these figures are used to illustrate the processes described below, including Figure 10 the processes in

[0337] Figures 9A to 9Rdepicts various examples in which, when device 900 is in various operating states, in response to an i...

Claims

1. A computer system configured to communicate with a display generation component and one or more input devices, the computer system comprising: one or more processors; and a memory storing one or more programs configured to be executed by the one or more processors, the one or more programs including instructions for performing the following operations: In response to determining that the distance between the computer system and a first external device is less than a first threshold distance: According to determining that a first set of criteria is met, display a media control user interface via the display generation component, where the first set of criteria includes criteria met when the computer system is currently playing a first media and the first external device is playing a second media, and the media control user interface includes: A first optional graphical user interface object for initiating playback of the first media on the first external device; and One or more optional user interface objects for controlling playback of the second media on the first external device, including a first media control optional graphical user interface object; and Display second status information associated with the first external device, where displaying the second status information associated with the first external device includes displaying a representation of the media control user interface transitioning from a first state that never includes the second status information to a second state that includes the second status information; When displaying the media control user interface, receive input via the one or more input devices; and In response to receiving the input: According to determining that the input corresponds to the first optional graphical user interface object, initiate a process for causing the first external device to play back the first media; and According to determining that the input corresponds to the first media control optional graphical user interface object, initiate a process for controlling playback of the second media by the first external device.

2. The computer system according to claim 1, the one or more programs further including instructions for performing the following operations: In response to determining that the distance between the computer system and the first external device is less than the first threshold distance: According to determining that a second set of criteria is met, display one or more representations of a set of predetermined media content items via the display generation component, where the second set of criteria includes criteria met when the computer system is not playing the first media and the first external device is not playing the second media.

3. The computer system according to claim 1, the one or more programs further including instructions for performing the following operations: In response to determining that the distance between the computer system and the first external device is less than the first threshold distance: According to determining that a third set of criteria is met, display a second optional graphical user interface object via the display generation component, where the second optional graphical user interface object, when selected, initiates playback of the second media at the computer system, and the third set of criteria includes criteria met when the computer system is not playing the first media and the first external device is currently playing the second media.

4. The computer system according to claim 1, wherein the one or more programs further comprise instructions for performing the following operations: In response to determining that the distance between the computer system and the first external device is less than the first threshold distance: Initiate a process for causing the first external device to play back the first media based on determining that a fourth set of criteria is met, wherein the fourth set of criteria includes criteria that are met when the computer system is currently playing the first media and the first external device is not playing the second media.

5. The computer system according to claim 1, wherein the one or more programs further comprise instructions for performing the following operations: In response to determining that the distance between the computer system and the first external device is less than the first threshold distance: Add the third media to a queue for playback at the computer system based on determining that a fifth set of criteria is met, wherein the fifth set of criteria includes a first criterion that is met when the computer system is currently playing the first media and the first external device is playing the third media and a second criterion that is met when the first media is different from the third media.

6. The computer system according to claim 1, wherein the media control user interface further comprises a set of one or more selectable user interface objects, the set of one or more selectable user interface objects including a first selectable user interface object that, when selected, controls operations at the first external device.

7. The computer system according to claim 6, wherein the set of one or more selectable user interface objects includes a set of controls selected from the group consisting of a timer control, an alarm control, and a message control.

8. The computer system according to claim 1, wherein the one or more programs further comprise instructions for performing the following operations: In response to determining that the distance between the computer system and the first external device is less than a second threshold distance: Display a second representation of the media control user interface via the display generation component, wherein the second representation of the media control user interface includes an indication of the first external device.

9. The computer system according to claim 8, wherein the indication of the first external device includes first status information associated with the first external device.

10. The computer system according to claim 8, wherein the one or more programs further comprise instructions for performing the following operations: Detect a first distance change between the computer system and the first external device; and In response to detecting the first distance change: Adjust the display size of the second representation of the media control user interface based on determining that the first distance change includes movement of the computer system towards the first external device.

11. The computer system according to claim 8, wherein the one or more programs further comprise instructions for performing the following operations: Detect a second distance change between the computer system and the first external device; and In response to detecting the second distance change: Adjust a display size of the second representation of the media control user interface based on determining that the second distance change includes movement of the computer system away from the first external device.

12. The computer system of claim 8, wherein the second representation of the media control user interface includes a first subgroup of status information associated with the first external device, and the one or more programs further include instructions for: Receiving a second input while displaying the second representation of the media control user interface; and In response to receiving the second input, displaying the second representation of the media control user interface in an expanded state, the expanded state including a second subgroup of status information associated with the first external device, the second subgroup of status information being different from the first subgroup of status information associated with the first external device.

13. The computer system of claim 12, wherein displaying the second representation of the media control user interface in the expanded state includes: Displaying a third selectable graphical user interface object based on determining that a sixth set of criteria is met, the third selectable graphical user interface object, when selected, initiating playback of the first media on the first external device, wherein the sixth set of criteria includes criteria met when the computer system is currently playing the first media and the first external device is not playing the second media.

14. The computer system of claim 1, the one or more programs further including instructions for: In response to receiving the input: Based on determining that the input corresponds to a predefined gesture, stop displaying the one or more selectable user interface objects for controlling playback of the second media on the first external device.

15. A non-transitory computer-readable storage medium storing one or more programs configured to be executed by one or more processors of a computer system in communication with a display generation component and one or more input devices, the one or more programs including instructions for: In response to determining that a distance between the computer system and a first external device is less than a first threshold distance: Based on determining that a first set of criteria is met, display a media control user interface via the display generation component, wherein the first set of criteria includes criteria met when the computer system is currently playing a first media and the first external device is playing a second media, the media control user interface includes: A first selectable graphical user interface object for initiating playback of the first media on the first external device; and One or more selectable user interface objects for controlling playback of the second media on the first external device, including a first media control selectable graphical user interface object; and Displaying second status information associated with the first external device, wherein, Displaying the second status information associated with the first external device includes displaying a representation of the media control user interface transitioning from a first state that does not include the second status information to a second state that includes the second status information; Receiving input via the one or more input devices while displaying the media control user interface; and In response to receiving the input: Initiating a process for causing the first external device to play back the first media based on determining that the input corresponds to the first optional graphical user interface object; and Initiating a process for controlling the playback of the second media by the first external device based on determining that the input corresponds to the first media control optional graphical user interface object.

16. The non-transitory computer-readable storage medium of claim 15, wherein the one or more programs further include instructions for: In response to determining that the distance between the computer system and the first external device is less than the first threshold distance: Displaying, via the display generating component, one or more representations of a predetermined media content item based on determining that a second set of criteria is met, wherein the second set of criteria includes criteria that are met when the computer system is not playing the first media and the first external device is not playing the second media.

17. The non-transitory computer-readable storage medium of claim 15, wherein the one or more programs further include instructions for: In response to determining that the distance between the computer system and the first external device is less than the first threshold distance: Displaying, via the display generating component, a second optional graphical user interface object that, when selected, initiates playback of the second media at the computer system, wherein the third set of criteria includes criteria that are met when the computer system is not playing the first media and the first external device is currently playing the second media.

18. The non-transitory computer-readable storage medium of claim 15, wherein the one or more programs further include instructions for: In response to determining that the distance between the computer system and the first external device is less than the first threshold distance: Initiating a process for causing the first external device to play back the first media based on determining that a fourth set of criteria is met, wherein the fourth set of criteria includes criteria that are met when the computer system is currently playing the first media and the first external device is not playing the second media.

19. The non-transitory computer-readable storage medium of claim 15, wherein the one or more programs further include instructions for: In response to determining that the distance between the computer system and the first external device is less than the first threshold distance: Based on determining that a fifth set of criteria is met, add the third media to a queue for playback at the computer system, where the fifth set of criteria includes a first criterion that is met when the computer system is currently playing the first media and the first external device is playing the third media, and a second criterion that is met when the first media is different from the third media.

20. The non-transitory computer-readable storage medium according to claim 15, wherein the media control user interface further includes a set of one or more selectable user interface objects, the set of one or more selectable user interface objects including a first selectable user interface object that, when selected, controls operations at the first external device.

21. The non-transitory computer-readable storage medium according to claim 20, wherein the set of one or more selectable user interface objects includes a set of controls selected from the group consisting of a timer control, an alarm control, and a message control.

22. The non-transitory computer-readable storage medium according to claim 15, the one or more programs further including instructions for: In response to determining that the distance between the computer system and the first external device is less than a second threshold distance: Display a second representation of the media control user interface via the display generation component, where the second representation of the media control user interface includes an indication of the first external device.

23. The non-transitory computer-readable storage medium according to claim 22, wherein the indication of the first external device includes first status information associated with the first external device.

24. The non-transitory computer-readable storage medium according to claim 22, the one or more programs further including instructions for: Detect a first distance change between the computer system and the first external device; and In response to detecting the first distance change: Adjust the display size of the second representation of the media control user interface based on determining that the first distance change includes movement of the computer system towards the first external device.

25. The non-transitory computer-readable storage medium according to claim 22, the one or more programs further including instructions for: Detect a second distance change between the computer system and the first external device; and In response to detecting the second distance change: Adjust the display size of the second representation of the media control user interface based on determining that the second distance change includes movement of the computer system away from the first external device.

26. The non-transitory computer-readable storage medium according to claim 22, wherein the second representation of the media control user interface includes a first subgroup of status information associated with the first external device, the one or more programs further including instructions for: Receiving a second input when displaying the second representation of the media control user interface; and In response to receiving the second input, display a second representation of the media control user interface in an expanded state, the expanded state including second subgroup status information associated with the first external device, the second subgroup status information being different from the first subgroup status information associated with the first external device.

27. The non-transitory computer-readable storage medium of claim 26, wherein displaying the second representation of the media control user interface in the expanded state comprises: In accordance with determining that a sixth set of criteria is met, display a third selectable graphical user interface object that, when selected, initiates playback of the first media on the first external device, wherein the sixth set of criteria includes criteria met when the computer system is currently playing the first media and the first external device is not playing the second media.

28. The non-transitory computer-readable storage medium of claim 15, the one or more programs further comprising instructions for: In response to receiving the input: In accordance with determining that the input corresponds to a predefined gesture, stop displaying the one or more selectable user interface objects for controlling playback of the second media on the first external device.

29. A method, comprising: At a computer system in communication with a display generation component and one or more input devices: In response to determining that the distance between the computer system and a first external device is less than a first threshold distance: In accordance with determining that a first set of criteria is met, display, via the display generation component, a media control user interface, wherein the first set of criteria includes criteria met when the computer system is currently playing a first media and the first external device is playing a second media, the media control user interface including: A first selectable graphical user interface object for initiating playback of the first media on the first external device; and One or more selectable user interface objects for controlling playback of the second media on the first external device, including a first media control selectable graphical user interface object; and Display second status information associated with the first external device, wherein displaying the second status information associated with the first external device includes displaying a representation of the media control user interface transitioning from a first state that does not include the second status information to a second state that includes the second status information; When displaying the media control user interface, receive input via the one or more input devices; and In response to receiving the input: In accordance with determining that the input corresponds to the first selectable graphical user interface object, initiate a process for causing the first external device to play back the first media; and In accordance with determining that the input corresponds to the first media control selectable graphical user interface object, initiate a process for controlling playback of the second media by the first external device.

30. The method of claim 29, further comprising: In response to determining that the distance between the computer system and the first external device is less than the first threshold distance: Based on determining that a second set of criteria is met, display, via the display generating component, one or more representations of a predetermined media content item, wherein the second set of criteria includes criteria that are met when the computer system is not playing the first media and the first external device is not playing the second media.

31. The method according to claim 29, further comprising: In response to determining that the distance between the computer system and the first external device is less than the first threshold distance: Based on determining that a third set of criteria is met, display, via the display generating component, a second optional graphical user interface object that, when selected, initiates playback of the second media at the computer system, wherein the third set of criteria includes criteria that are met when the computer system is not playing the first media and the first external device is currently playing the second media.

32. The method according to claim 29, further comprising: In response to determining that the distance between the computer system and the first external device is less than the first threshold distance: Based on determining that a fourth set of criteria is met, initiate a process for causing the first external device to play the first media, wherein the fourth set of criteria includes criteria that are met when the computer system is currently playing the first media and the first external device is not playing the second media.

33. The method according to claim 29, further comprising: In response to determining that the distance between the computer system and the first external device is less than the first threshold distance: Based on determining that a fifth set of criteria is met, add the third media to a queue for playback at the computer system, wherein the fifth set of criteria includes a first criterion that is met when the computer system is currently playing the first media and the first external device is playing the third media and a second criterion that is met when the first media is different from the third media.

34. The method according to claim 29, wherein the media control user interface further comprises a set of one or more optional user interface objects, the set of one or more optional user interface objects including a first optional user interface object that, when selected, controls an operation at the first external device.

35. The method according to claim 34, wherein the set of one or more optional user interface objects includes a set of controls selected from the group consisting of a timer control, an alarm control, and a message control.

36. The method according to claim 29, further comprising: In response to determining that the distance between the computer system and the first external device is less than a second threshold distance: Display, via the display generating component, a second representation of the media control user interface, wherein the second representation of the media control user interface includes an indication of the first external device.

37. The method according to claim 36, wherein the indication of the first external device includes first status information associated with the first external device.

38. The method according to claim 36, further comprising: Detect a first distance change between the computer system and the first external device; And In response to detecting the first distance change: Adjust the display size of the second representation of the media control user interface based on determining that the first distance change includes movement of the computer system towards the first external device.

39. The method according to claim 36, further Comprising: Detect a second distance change between the computer system and the first external device; And In response to detecting the second distance change: Adjust the display size of the second representation of the media control user interface based on determining that the second distance change includes movement of the computer system away from the first external device.

40. The method according to claim 36, wherein the second representation of the media control user interface includes a first subgroup of status information associated with the first external device, and the method further Comprising: Receive a second input while displaying the representation of the media control user interface; And In response to receiving the second input, display the second representation of the media control user interface in an expanded state, the expanded state including a second subgroup of status information associated with the first external device, the second subgroup of status information being different from the first subgroup of status information associated with the first external device.

41. The method according to claim 40, wherein displaying the second representation of the media control user interface in an expanded state Comprises: Display a third optional graphical user interface object based on determining that a sixth set of criteria is met, the third optional graphical user interface object, when selected, initiating playback of the first media on the first external device, wherein the sixth set of criteria includes criteria met when the computer system is currently playing the first media and the first external device is not playing the second media.

42. The method according to claim 29, further Comprising: In response to receiving the input: Stop displaying the one or more optional user interface objects for controlling playback of the second media on the first external device based on determining that the input corresponds to a predefined gesture.

Images