Device, method and user interface for controlling operation of wireless electronic accessory

Abstract

A wearable audio output device includes a first portion configured to be inserted into an ear of a user and a second portion extending from the first portion and including one or more input devices. The wearable audio output device detects an input via the one or more input devices. In response to detecting the input and in accordance with a determination that the input is a swipe gesture along the second portion of the wearable audio output device, the wearable audio output device adjusts an output volume of the wearable audio output device based on movement of the swipe gesture along the second portion of the wearable audio output device.

Description

[0001] Related patent applications

[0002] This application is a continuation of U.S. patent application No. 18 / 241,778 filed on September 1, 2023, which claims priority to U.S. provisional patent application No. 63 / 404,101 filed on September 6, 2022. Technical Field

[0003] The present invention generally relates to electronic accessories, such as wearable audio output devices and accessory charging cases, including but not limited to systems for controlling wearable audio output devices with input devices, electronic accessories with physical tags, and accessory cases with speakers. Background Art

[0004] Electronic accessories including wearable audio output devices such as headphones, earbuds and earphones, as well as charging cases, watches and styluses are widely used to receive input from users and provide output to users. However, traditional methods of controlling and interacting with such devices are cumbersome, inefficient and limited.

[0005] In some cases, inputs provided at a wearable audio output device provide limited control of the audio output; for example, the input may be limited to having control over a single predefined feature of the audio output, such as toggling power or a feature on or off. In some cases, limited control over the audio output affects the user's ability to control the volume of audio content played back by the wearable audio output device and / or control the amount of conversation sounds that the user can hear from the surrounding physical environment while wearing the wearable audio output device. In some cases, a user interface for controlling the wearable audio output device and other accessory devices does not provide enough information to the user to enable the user to quickly distinguish between multiple devices of the same type, such as multiple sets of earbuds or multiple charging cases.

[0006] In some cases, a user interface for controlling audio output settings provides too few controls, such as providing controls for only one audio output device, thereby requiring the user to provide a large amount of input and navigate through different menus or user interfaces to perform a particular action, or provides too many controls, thereby cluttering the user interface and increasing the likelihood that the user will mistakenly interact with the wrong control, particularly for implementations in which the display area is limited.

[0007] Furthermore, conventional methods take longer than necessary to operate the electronic accessory and require more user interaction, thereby wasting energy. This latter consideration is particularly important in battery-driven devices.

[0008] In addition, the accessory box of the electronic accessory is generally configured only to charge and / or store the electronic accessory. Although some electronic accessories include an output mechanism (e.g., a speaker or display), the accessory box traditionally does not include a means to provide output (such as audio feedback) to the user. Instead, feedback (if it is provided at all) is traditionally provided by other devices, such as a smartphone, tablet, or computer that is paired with or wirelessly connected to the accessory box. Therefore, traditional means of providing feedback require multiple devices and communication channels. Summary of the invention

[0009] Therefore, there is a need for electronic accessories (e.g., wearable audio output devices and charging cases) and associated electronic devices with improved methods and interfaces for control and interaction (such as adjusting volume, selecting between different audio output modes, and providing feedback to help users operate such devices). Such methods and interfaces optionally supplement or replace conventional methods for controlling the operation of electronic accessories. Such methods and interfaces reduce the amount, degree, and / or nature of input from the user and produce a more efficient human-computer interface. For battery-powered systems and devices, such methods and interfaces save power and increase the interval between battery charges.

[0010] The computer system and electronic accessories disclosed in the present invention reduce or eliminate the above-mentioned defects and other problems associated with the user interface for electronic devices and accessories. In some embodiments, the computer system includes a desktop computer. In some embodiments, the computer system is portable (e.g., a laptop, a tablet computer or a handheld device). In some embodiments, the computer system includes a personal electronic device (e.g., a wearable electronic device, such as a watch). In some embodiments, the computer system includes a wearable audio output device (e.g., in-ear headphones, earplugs, over-ear headphones, etc.) (and / or communicates with it). In some embodiments, the computer system has a touch-sensitive surface (also referred to as a "touch pad") (and / or communicates with it). In some embodiments, the computer system has a display device, which is a touch-sensitive display (also referred to as a "touch screen" or "touch screen display") (and / or communicates with it) in some embodiments. In some embodiments, the computer system has a graphical user interface (GUI), one or more processors, a memory and one or more modules, a program or instruction set stored in the memory for performing multiple functions. In some embodiments, the user interacts with the GUI mainly through stylus and / or finger contact and gestures on the touch-sensitive surface. In some embodiments, these functions optionally include image editing, drawing, presentation, word processing, spreadsheet creation, playing games, making and receiving calls, video conferencing, sending and receiving emails, instant messaging, fitness support, digital photography, digital video recording, web browsing, audio output device pairing and calibration, digital music / audio playback, note taking and / or digital video playback. Executable instructions for performing these functions are optionally included in a non-transitory computer-readable storage medium or other computer program product configured for execution by one or more processors.

[0011] According to some embodiments, a method is performed at a wearable audio output device, the wearable audio output device including a first portion configured to be inserted into an ear of a user and a second portion extending from the first portion of the wearable audio output device, the second portion including one or more input devices. The method includes detecting an input via the one or more input devices; and in response to detecting the input, adjusting an output volume of the wearable audio output device based on movement of the sliding gesture along the second portion of the wearable audio output device according to determining that the input is a sliding gesture along the second portion of the wearable audio output device.

[0012] According to some embodiments, a method is performed at an electronic device that includes a display generation component or communicates with the display generation component. The method includes detecting the occurrence of a corresponding condition associated with an electronic accessory that is different from the electronic device, and the electronic accessory communicates with the electronic device; and in response to detecting the occurrence of the corresponding condition, causing a user interface corresponding to the corresponding condition to be displayed via the display generation component, the user interface including a representation of the electronic accessory. Causing display of the user interface includes, based on determining that the electronic accessory includes a first physical marker, causing a representation of the first physical marker to be displayed in the user interface; and based on determining that the electronic accessory includes a second physical marker that is different from the first physical marker, causing a representation of the second physical marker to be displayed in the user interface.

[0013] According to some embodiments, a method is performed at an accessory charging box including a speaker. The method includes detecting a first event including a change in an open or closed state of the accessory charging box; and in response to detecting the change in the open or closed state of the accessory charging box, causing the speaker of the accessory charging box to generate an audio notification corresponding to a state of at least one of the accessory charging box and one or more accessories associated with the accessory charging box.

[0014] According to some embodiments, a method is performed at an electronic device that communicates with a display generation component and one or more wearable audio output devices. The method includes causing a user interface to be displayed via the display generation component, the user interface including a volume control element for one or more wearable audio output devices; and detecting an input corresponding to the volume control element. The method also includes adjusting the volume of the audio output of one or more wearable audio output devices in response to detecting the input and according to determining that the input is a gesture of the first type. The method also includes causing a conversation enhancement element for one or more wearable audio output devices to be displayed in response to detecting the input and according to determining that the input is a gesture of the second type, which initiates a process for adjusting the audio output of one or more wearable audio output devices when selected to enhance the conversation audio corresponding to the conversation with audio that can be accessed by one or more wearable audio output devices relative to other audio output by one or more wearable audio output devices.

[0015] According to some embodiments, an electronic device (e.g., a multifunction device, an electronic accessory, or an electronic accessory box) includes one or more processors and a memory storing one or more programs; the one or more programs are configured to be executed by the one or more processors, and the one or more programs include instructions for performing or causing the execution of the operations of any of the methods described herein. According to some embodiments, a computer-readable storage medium has instructions stored therein, which, when executed by an electronic device, cause the device to perform or cause the execution of the operations of any of the methods described herein. According to some embodiments, a graphical user interface on an electronic device having a display, a touch-sensitive surface, a memory, and one or more processors for executing one or more programs stored in the memory includes one or more of the elements displayed in any of the methods described herein, which are updated in response to input, as described in any of the methods described herein. According to some embodiments, an electronic device includes a device for performing or causing the execution of the operations of any of the methods described herein. According to some embodiments, an information processing device for use in an electronic device includes a device for performing or causing the execution of the operations of any of the methods described herein.

[0016] Therefore, electronic devices including or communicating with one or more display devices, one or more input devices, one or more audio output devices, and / or one or more electronic accessories are provided with improved methods and interfaces for controlling the operation of wireless electronic accessories, thereby improving the effectiveness, efficiency, and user satisfaction of such devices. Such methods and interfaces can supplement or replace conventional methods for controlling the operation of wireless electronic accessories. BRIEF DESCRIPTION OF THE DRAWINGS

[0017] For a better understanding of the various described embodiments, reference should be made to the following detailed description taken in conjunction with the following drawings, wherein like reference numerals designate corresponding parts throughout the several views.

[0018] Figure 1A is a block diagram illustrating a portable multifunction device with a touch-sensitive display according to some embodiments.

[0019] Figure 1B is a block diagram illustrating example components for event processing according to some embodiments.

[0020] Figure 2 A portable multifunction device with a touch screen according to some embodiments is shown.

[0021] Figure 3A is a block diagram of an example multifunction device with a display and a touch-sensitive surface according to some embodiments.

[0022] Figure 3BPhysical features of an exemplary wearable audio output device according to some embodiments are shown.

[0023] Figure 3C is a block diagram of an exemplary wearable audio output device according to some embodiments.

[0024] Figure 3D Physical features of an example electronic accessory box are shown according to some embodiments.

[0025] Figure 3E is a block diagram of an exemplary electronic accessory box according to some embodiments.

[0026] Figure 3F Exemplary audio control by a wearable audio output device according to some embodiments is shown.

[0027] Figure 4A An exemplary user interface for an application menu on a portable multifunction device according to some embodiments is shown.

[0028] Figure 4B An exemplary user interface for a multifunction device having a touch-sensitive surface separate from the display is shown according to some embodiments.

[0029] Figure 4C An example interaction between a wearable audio output device and an electronic accessory box according to some embodiments is shown.

[0030] FIG. 5A to FIG. 5D An exemplary user interface for pairing an electronic accessory according to some embodiments is shown.

[0031] FIG. 5E to FIG. 5R Example user interfaces and user interactions for adjusting the audio output of a wearable audio output device according to some embodiments are shown.

[0032] Figure 5S to Figure 5BI Exemplary user interfaces and user interactions for various features associated with an electronic accessory box are shown according to some embodiments.

[0033] Figures 5BJ to 5CB Example user interfaces and user interactions for adjusting the audio output of a wearable audio output device according to some embodiments are shown.

[0034] FIG. 6A to FIG. 6C is a flowchart of a process for adjusting the audio output of one or more wearable audio output devices according to some embodiments.

[0035] 7A to 7C is a flowchart of a process for displaying status information of an electronic attachment according to some embodiments.

[0036] FIG. 8A to FIG. 8D is a flowchart of a process for presenting status information at an accessory charging case according to some embodiments.

[0037] 9A to 9C is a flowchart of a process for adjusting the audio output of a wearable audio output device according to some embodiments. DETAILED DESCRIPTION

[0038] As described above, electronic accessories including wearable audio output devices (such as headphones, earbuds, and earphones) and charging boxes, watches, and styluses are widely used to provide output to users. Many computer systems that include wearable audio output devices or communicate with wearable audio output devices give users only limited control over output in response to input at the wearable audio output device, or provide too few or too many output controls for the user interface. The methods, systems, and user interfaces / interactions described herein improve how to provide output in a variety of ways. For example, the embodiments disclosed herein describe an improved method of controlling audio output using input at a wearable audio output device and providing an improved user interface for controlling audio output settings.

[0039] As described above, an electronic accessory box is typically a passive device for storing and / or charging electronic accessories. Although some electronic accessories include an output mechanism (e.g., a speaker or display), the accessory box traditionally does not include a device for providing output (such as audio feedback) to the user. The methods, systems, and user interfaces / interactions described herein improve the functionality of the electronic accessory box. For example, the embodiments disclosed herein describe an improved way of providing status information and / or feedback to the user at the electronic accessory box.

[0040] The processes described below enhance the operability of the device and make the user-device interface more efficient (e.g., by helping the user provide appropriate input and reducing user errors when operating / interacting with the device) through various techniques, including by providing improved visual, auditory, and / or tactile feedback to the user, reducing the number of inputs required to perform an operation, providing control options without cluttering the user interface with additional displayed controls, performing an operation without further user input when a set of conditions have been met, and / or additional techniques. These techniques also reduce power usage and extend the battery life of the device by enabling the user to use the device more quickly and more efficiently.

[0041] under, Figure 1A to Figure 1B , Figure 2 , FIG. 3A to FIG. 3F , FIG. 4A to FIG. 4C An exemplary device is shown. FIG. 5A to FIG. 5CB Exemplary user interfaces and device interactions for controlling example devices are shown. FIG. 6A to FIG. 6C A flow chart of a process for adjusting the audio output of one or more wearable audio output devices is shown. 7A to 7C A flow chart showing a process for displaying status information for an electronic accessory is shown. FIG. 8A to FIG. 8D A flow chart of a process for presenting status information at an accessory charging case is shown. 9A to 9C A flow chart showing a process for adjusting the audio output of a wearable audio output device is shown. FIG. 5A to FIG. 5CB The user interface and device interaction in FIG. 6A to FIG. 6C , 7A to Figure 7C , 8A to Fig.8D and 9A to Fig. 9C process.

[0042] Exemplary Devices

[0043] Reference will now be made in detail to the embodiments, examples of which are illustrated in the accompanying drawings. Many specific details are shown in the following detailed description in order to provide a full understanding of the various described embodiments. However, it will be apparent to one of ordinary skill in the art that the various described embodiments can be practiced without these specific details. In other cases, well-known methods, processes, components, circuits, and networks are not described in detail, so as not to unnecessarily obscure various aspects of the embodiments.

[0044] It will also be understood that, although in some cases, the terms "first", "second", etc. are used to describe various elements in this article, these elements should not be limited by these terms. These terms are only used to distinguish one element from another element. For example, the first contact can be named as the second contact, and similarly, the second contact can be named as the first contact without departing from the scope of the various described embodiments. The first contact and the second contact are both contacts, but they are not the same contact unless the context clearly indicates otherwise.

[0045] The terms used in the description of various described embodiments herein are only for the purpose of describing specific embodiments, and are not intended to be limiting. As used in the description of various described embodiments and in the appended claims, the singular forms "one" and "the" are intended to also include plural forms, unless the context clearly indicates otherwise. It will also be understood that the term "and / or" used herein refers to and encompasses any and all possible combinations of one or more items in the associated listed items. It will also be understood that the terms "include" and / or "comprising" are used in this specification to specify the presence of stated features, integers, steps, operations, elements and / or parts, but do not exclude the presence or addition of one or more other features, integers, steps, operations, elements, parts and / or their grouping.

[0046] As used herein, the term "if" is optionally interpreted to mean "when" followed by "upon" or "in response to determining" or "in response to detecting," depending on the context. Similarly, the phrases "if it is determined that" or "if [a stated condition or event] is detected" are optionally interpreted to mean "upon determining that" or "in response to determining that" or "upon detecting [a stated condition or event]" or "in response to detecting [a stated condition or event]," depending on the context.

[0047] Embodiments of electronic devices, user interfaces for such devices, and associated processes for using such devices are described. In some embodiments, the device is a portable communication device, such as a mobile phone, that also includes other functions, such as a PDA and / or a music player function. Exemplary embodiments of portable multifunction devices include, but are not limited to, the Apple Watch from Apple Inc., Cupertino, California. and Device. Other portable electronic devices, such as laptop computers or tablet computers with touch-sensitive surfaces (e.g., touch screen displays and / or trackpads) are optionally used. It should also be understood that in some embodiments, the device is not a portable communication device, but a desktop computer with a touch-sensitive surface (e.g., touch screen displays and / or trackpads).

[0048] In the following discussion, an electronic device including a display and a touch-sensitive surface is described. However, it should be understood that the electronic device optionally includes one or more other physical user interface devices, such as a physical keyboard, mouse and / or joystick.

[0049] The device typically supports a variety of applications, such as one or more of the following applications: a note-taking application, a drawing application, a presentation application, a word processing application, a website creation application, a disk editing application, a spreadsheet application, a gaming application, a telephony application, a video conferencing application, a mail application, an instant messaging application, a fitness support application, a photo management application, a digital camera application, a digital video camera application, a web browsing application, a digital music player application, and / or a digital video player application.

[0050] Various applications executed on the device optionally use at least one common physical user interface device, such as a touch-sensitive surface. One or more functions of the touch-sensitive surface and corresponding information displayed on the device are optionally adjusted and / or varied for different applications, and / or adjusted and / or varied within the respective applications. In this way, the common physical architecture of the device (such as a touch-sensitive surface) optionally supports various applications with a user interface that is intuitive and clear to the user.

[0051] Attention is now turned to embodiments of portable devices having touch-sensitive displays. Figure 1A 1 is a block diagram illustrating a portable multifunction device 100 with a touch-sensitive display system 112 according to some embodiments. The touch-sensitive display system 112 is sometimes referred to as a "touch screen" for convenience, and is sometimes simply referred to as a touch-sensitive display. The device 100 includes a memory 102 (which optionally includes one or more computer-readable storage media), a memory controller 122, one or more processing units (CPUs) 120, a peripheral device interface 118, an RF circuit 108, an audio circuit 110, a speaker 111, a microphone 113, an input / output (I / O) subsystem 106, other input, or control devices 116, and an external port 124. The device 100 optionally includes one or more optical sensors 164. The device 100 optionally includes one or more intensity sensors 165 for detecting the intensity of contact on the device 100 (e.g., a touch-sensitive surface, such as the touch-sensitive display system 112 of the device 100). Device 100 optionally includes one or more tactile output generators 167 for generating tactile output on device 100 (e.g., generating tactile output on a touch-sensitive surface such as touch-sensitive display system 112 of device 100 or touch pad 355 of device 300). These components optionally communicate via one or more communication buses or signal lines 103.

[0052] As used in this specification and claims, the term "tactile output" refers to a physical displacement of a device relative to a previous position of the device, a physical displacement of a component of the device (e.g., a touch-sensitive surface) relative to another component of the device (e.g., a housing), or a displacement of a component relative to the center of mass of the device, which will be detected by a user using the user's sense of touch. For example, in the case where a device or a component of the device is in contact with a user's touch-sensitive surface (e.g., a finger, palm, or other part of the user's hand), the tactile output generated by the physical displacement will be interpreted by the user as a tactile sensation corresponding to a perceived change in a physical property of the device or a component of the device. For example, movement of a touch-sensitive surface (e.g., a touch-sensitive display or a touchpad) is optionally interpreted by the user as a "press click" or "release click" to a physical actuation button. In some cases, the user will feel a tactile sensation, such as a "press click" or "release click", even when the physical actuation button associated with the touch-sensitive surface that is physically pressed (e.g., displaced) by the user's movement does not move. As another example, even when the smoothness of the touch-sensitive surface does not change, the movement of the touch-sensitive surface may be optionally interpreted or sensed by the user as the "roughness" of the touch-sensitive surface. Although such interpretation of touch by the user will be limited by the user's individualized sensory perceptions, many sensory perceptions of touch are common to most users. Therefore, when a tactile output is described as corresponding to a specific sensory perception of a user (e.g., "press click", "release click", "roughness"), unless otherwise stated, the generated tactile output corresponds to a physical displacement of the device or its components that will generate the sensory perception of a typical (or ordinary) user. Providing tactile feedback to the user using tactile output enhances the operability of the device and makes the user-device interface more efficient (e.g., by helping the user provide appropriate input and reducing user errors when operating / interacting with the device), which further reduces power usage and extends the battery life of the device by enabling the user to use the device more quickly and efficiently.

[0053] In some embodiments, the tactile output pattern specifies characteristics of the tactile output, such as the amplitude of the tactile output, the shape of the motion waveform of the tactile output, the frequency of the tactile output, and / or the duration of the tactile output.

[0054] When a device (e.g., one or more tactile output generators that generate tactile output via moving a movable mass) generates tactile output with different tactile output patterns, the tactile output can produce different tactile sensations in a user holding or touching the device. Although the user's senses are based on the user's perception of the tactile output, most users will be able to recognize changes in the waveform, frequency, and amplitude of the tactile output generated by the device. Therefore, the waveform, frequency, and amplitude can be adjusted to indicate to the user that different operations have been performed. Therefore, a tactile output with a tactile output pattern designed, selected, and / or arranged to simulate the characteristics (e.g., size, material, weight, stiffness, smoothness, etc.) of an object in a given environment (e.g., a user interface including graphical features and objects, a simulated physical environment with virtual boundaries and virtual objects, a real physical environment with physical boundaries and physical objects, and / or a combination of any of the above); behavior (e.g., oscillation, displacement, acceleration, rotation, extension, etc.); and / or interaction (e.g., collision, adhesion, repulsion, attraction, friction, etc.) will provide helpful feedback to the user in some cases, which reduces input errors and improves the efficiency of the user's operation of the device. In addition, tactile output is optionally generated to correspond to feedback that is independent of simulated physical properties (such as input threshold or object selection). Such tactile output will provide helpful feedback to the user in some cases, which reduces input errors and improves the efficiency of the user's operation of the device.

[0055] In some embodiments, the tactile output with a suitable tactile output mode serves as a prompt for an event of interest in the user interface or behind the screen in the device. Examples of events of interest include activation of affordances (such as real or virtual buttons or toggle switches) provided on the device or in the user interface, the success or failure of the requested operation, reaching or crossing a boundary in the user interface, entering a new state, switching input focus between objects, activating a new mode, reaching or crossing an input threshold, detecting or identifying a type of input or gesture, etc. In some embodiments, a tactile output is provided to serve as a warning or prompt for an upcoming event or result that will occur unless a change in direction or interruption input is detected in time. Tactile output is also used in other contexts to enrich user experience, improve accessibility of devices for users with visual or motor difficulties or other accessibility needs, and / or improve the efficiency and functionality of user interfaces and / or devices. Optionally, the tactile output is compared with audio input and / or visual user interface changes, which further enhances the user's experience when the user interacts with the user interface and / or device, and is conducive to better transmission of information about the state of the user interface and / or device, and this reduces input errors and improves the efficiency of user operations on the device.

[0056] It should be understood that device 100 is merely one example of a portable multifunction device, and that device 100 optionally has more or fewer components than shown, optionally combines two or more components, or optionally has a different configuration or arrangement of the components. Figure 1A The various components shown are implemented in hardware, software, firmware, or any combination thereof, including one or more signal processing circuits and / or application specific integrated circuits.

[0057] The memory 102 optionally includes high-speed random access memory, and optionally also includes non-volatile memory, such as one or more disk storage devices, flash memory devices or other non-volatile solid-state memory devices. Access to the memory 102 by other components of the device 100 (such as the CPU 120 and the peripheral device interface 118) is optionally controlled by a memory controller 122.

[0058] Peripheral interface 118 may be used to couple the device's input and output peripherals to CPU 120 and memory 102. One or more processors 120 run or execute various software programs and / or instruction sets stored in memory 102 to perform various functions of device 100 and process data.

[0059] In some embodiments, peripherals interface 118, CPU 120, and memory controller 122 are optionally implemented on a single chip, such as chip 104. In some other embodiments, they are optionally implemented on separate chips.

[0060] RF (radio frequency) circuit 108 receives and sends RF signals, also referred to as electromagnetic signals. RF circuit 108 converts electrical signals into / from electromagnetic signals and communicates with a communication network and other communication devices via electromagnetic signals. RF circuit 108 optionally includes well-known circuits for performing these functions, including but not limited to an antenna system, an RF transceiver, one or more amplifiers, a tuner, one or more oscillators, a digital signal processor, a codec chipset, a subscriber identity module (SIM) card, memory, and the like. RF circuit 108 optionally communicates with networks and other devices via wireless communications, such as the Internet (also referred to as the World Wide Web (WWW)), an intranet, and / or a wireless network (such as a cellular telephone network, a wireless local area network (LAN), and / or a metropolitan area network (MAN)). The wireless communication optionally uses any of a variety of communication standards, protocols and technologies, including, but not limited to, Global System for Mobile Communications (GSM), Enhanced Data GSM Environment (EDGE), High Speed ​​Downlink Packet Access (HSDPA), High Speed ​​Uplink Packet Access (HSUPA), Evolution-Data-only (EV-DO), HSPA, HSPA+, Dual Cell HSPA (DC-HSPA), Long Term Evolution (LTE), Near Field Communication (NFC), Wideband Code Division Multiple Access (W-CDMA), Code Division Multiple Access (CDMA), Time Division Multiple Access (TDMA), Bluetooth, Wireless Fidelity (Wi-Fi) (e.g., IEEE 802.11a, IEEE 802.11ac, IEEE 802.11ax, IEEE 802.11b, IEEE 802.11d), IEEE 802.11d, IEEE 802.11d, IEEE 802.11d, IEEE 802.11d, IEEE 802.11d, IEEE 802.11d, IEEE 802.11d, IEEE 802.11d, IEEE 802.11d, IEEE 802.11d, IEEE 802.11g and / or IEEE 802.11n), Voice over Internet Protocol (VoIP), Wi-MAX, email protocols (e.g., Internet Message Access Protocol (IMAP) and / or Post Office Protocol (POP)), instant messaging (e.g., Extensible Messaging and Presence Protocol (XMPP), Session Initiation Protocol for Instant Messaging and Presence Utilizing Extensions (SIMPLE), Instant Messaging and Presence Service (IMPS)), and / or Short Message Service (SMS), or any other suitable communication protocol including communication protocols that have not been developed on the date of filing of this document.

[0061] The audio circuit 110, speaker 111, and microphone 113 provide an audio interface between a user and the device 100. The audio circuit 110 receives audio data from the peripheral device interface 118, converts the audio data into electrical signals, and transmits the electrical signals to the speaker 111. The speaker 111 converts the electrical signals into sound waves audible to humans. The audio circuit 110 also receives electrical signals converted from sound waves by the microphone 113. The audio circuit 110 converts the electrical signals into audio data and transmits the audio data to the peripheral device interface 118 for processing. The audio data is optionally retrieved from and / or transmitted to the memory 102 and / or the RF circuit 108 by the peripheral device interface 118. In some embodiments, the audio circuit 110 also includes a headset jack (e.g., Figure 2 The headset jack provides an interface between the audio circuit 110 and a removable audio input / output peripheral device, such as an output-only headset or a headset having both output (e.g., a single or dual-ear headset) and input (e.g., a microphone).

[0062] The I / O subsystem 106 couples input / output peripherals on the device 100, such as a touch-sensitive display system 112 and other input or control devices 116, to a peripheral device interface 118. The I / O subsystem 106 optionally includes a display controller 156, an optical sensor controller 158, an intensity sensor controller 159, a tactile feedback controller 161, and one or more input controllers 160 for other input or control devices. The one or more input controllers 160 receive / send electrical signals from / to other input or control devices 116. Other input control devices 116 optionally include physical buttons (e.g., push buttons, rocker buttons, etc.), dials, slide switches, joysticks, click wheels, etc. In some alternative embodiments, the one or more input controllers 160 are optionally coupled to any (or none) of the following: a keyboard, an infrared port, a USB port, a stylus, and / or a pointer device such as a mouse. One or more buttons (e.g., Figure 2 208) optionally includes an up / down button for volume control of the speaker 111 and / or the microphone 113. The one or more buttons optionally include a push button (e.g., Figure 2 206).

[0063] The touch-sensitive display system 112 provides an input interface and an output interface between the device and the user. The display controller 156 receives electrical signals from the touch-sensitive display system 112 and / or sends electrical signals to the touch-sensitive display system. The touch-sensitive display system 112 displays visual output to the user. The visual output optionally includes graphics, text, icons, videos, and any combination thereof (collectively referred to as "graphics"). In some embodiments, some visual outputs or all of the visual outputs correspond to user interface objects. As used herein, the term "indicator" refers to a user-interactive graphical user interface object (e.g., a graphical user interface object configured to respond to input directed to a graphical user interface object). Examples of user-interactive graphical user interface objects include, but are not limited to, buttons, sliders, icons, selectable menu items, switches, hyperlinks, or other user interface controls.

[0064] The touch-sensitive display system 112 has a touch-sensitive surface, sensor, or sensor group that accepts input from a user based on tactile and / or haptic contact. The touch-sensitive display system 112 and display controller 156 (together with any associated modules and / or instruction sets in memory 102) detect contact (and any movement or interruption of that contact) on the touch-sensitive display system 112 and convert the detected contact into interaction with a user interface object (e.g., one or more soft keys, icons, web pages, or images) displayed on the touch-sensitive display system 112. In some embodiments, the point of contact between the touch-sensitive display system 112 and the user corresponds to the user's finger or stylus.

[0065] The touch-sensitive display system 112 optionally uses LCD (liquid crystal display) technology, LPD (light emitting polymer display) technology, or LED (light emitting diode) technology, although other display technologies are used in other embodiments. The touch-sensitive display system 112 and display controller 156 optionally use any of a variety of touch sensing technologies now known or later developed, including but not limited to capacitive, resistive, infrared, and surface acoustic wave technologies, as well as other proximity sensor arrays or other elements for determining one or more points of contact with the touch-sensitive display system 112 to detect contact and any movement or interruption thereof. In some embodiments, projected mutual capacitance sensing technology is used, such as the . and Technology found in.

[0066] The touch-sensitive display system 112 optionally has a video resolution of more than 100 dpi. In some embodiments, the touch screen video resolution exceeds 400 dpi (e.g., 500 dpi, 800 dpi or greater). The user optionally uses any suitable object or attachment such as a stylus, finger, etc. to contact the touch-sensitive display system 112. In some embodiments, the user interface is designed to work with finger-based contacts and gestures, which may not be as accurate as stylus-based input due to the larger contact area of ​​the finger on the touch screen. In some embodiments, the device converts rough finger-based input into precise pointer / cursor positioning or commands for performing the actions desired by the user.

[0067] In some embodiments, in addition to the touch screen, the device 100 optionally includes a touchpad for activating or deactivating specific functions. In some embodiments, the touchpad is a touch-sensitive area of ​​the device that, unlike the touch screen, does not display visual output. The touchpad is optionally a touch-sensitive surface that is separate from the touch-sensitive display system 112, or an extension of the touch-sensitive surface formed by the touch screen.

[0068] The device 100 also includes a power system 162 for powering the various components. The power system 162 optionally includes a power management system, one or more power sources (e.g., batteries, alternating current (AC)), a recharging system, a power fault detection circuit, a power converter or inverter, a power status indicator (e.g., a light emitting diode (LED)), and any other components associated with the generation, management, and distribution of power in a portable device.

[0069] Device 100 optionally also includes one or more optical sensors 164 (eg, as part of one or more cameras). Figure 1A An optical sensor coupled to an optical sensor controller 158 in the I / O subsystem 106 is shown. One or more optical sensors 164 optionally include a charge coupled device (CCD) or a complementary metal oxide semiconductor (CMOS) phototransistor. One or more optical sensors 164 receive light projected through one or more lenses from the environment and convert the light into data representing an image. In conjunction with an imaging module 143 (also called a camera module), one or more optical sensors 164 optionally capture static images and / or videos. In some embodiments, an optical sensor is located on the rear portion of the device 100 opposite to the touch-sensitive display system 112 on the front of the device, so that the touch screen can be used as a viewfinder for static image and / or video image acquisition. In some embodiments, another optical sensor is located on the front of the device to obtain an image of the user (e.g., for self-portraits, for video conferencing when the user is watching other video conference participants on the touch screen, etc.).

[0070] Device 100 optionally also includes one or more contact intensity sensors 165 . Figure 1A A contact force sensor coupled to a force sensor controller 159 in the I / O subsystem 106 is shown. One or more contact force sensors 165 optionally include one or more piezoresistive strain gauges, capacitive force sensors, electrical force sensors, piezoelectric force sensors, optical force sensors, capacitive touch-sensitive surfaces, or other force sensors (e.g., sensors for measuring the force (or pressure) of contact on a touch-sensitive surface). One or more contact force sensors 165 receive contact force information (e.g., pressure information or a surrogate for pressure information) from the environment. In some embodiments, at least one contact force sensor is juxtaposed or adjacent to a touch-sensitive surface (e.g., touch-sensitive display system 112). In some embodiments, at least one contact force sensor is located on the rear of the device 100 opposite to the touch-sensitive display system 112 located on the front of the device 100.

[0071] Device 100 optionally also includes one or more proximity sensors 166 . Figure 1A A proximity sensor 166 is shown coupled to the peripherals interface 118. Alternatively, the proximity sensor 166 is coupled to the input controller 160 in the I / O subsystem 106. In some embodiments, when the multifunction device is placed near the user's ear (e.g., when the user is on a phone call), the proximity sensor turns off and disables the touch-sensitive display system 112.

[0072] Device 100 optionally also includes one or more tactile output generators 167 . Figure 1AA tactile output generator coupled to a tactile feedback controller 161 in the I / O subsystem 106 is shown. In some embodiments, the tactile output generator 167 includes one or more electroacoustic devices such as a speaker or other audio component; and / or an electromechanical device for converting energy into linear motion such as a motor, solenoid, electroactive polymer, piezoelectric actuator, electrostatic actuator, or other tactile output generating component (e.g., a component for converting an electrical signal into a tactile output on the device). The tactile output generator 167 receives tactile feedback generation instructions from the tactile feedback module 133 and generates tactile output on the device 100 that can be felt by a user of the device 100. In some embodiments, at least one tactile output generator is arranged in juxtaposition or proximity to a touch-sensitive surface (e.g., a touch-sensitive display system 112), and optionally generates tactile output by moving the touch-sensitive surface vertically (e.g., inward / outward of the surface of the device 100) or laterally (e.g., backward and forward in the same plane as the surface of the device 100). In some embodiments, at least one tactile output generator sensor is located on a rear portion of the device 100 opposite the touch-sensitive display system 112 located on the front portion of the device 100 .

[0073] Device 100 optionally also includes one or more accelerometers 168 . Figure 1A An accelerometer 168 is shown coupled to the peripheral device interface 118. Alternatively, the accelerometer 168 is optionally coupled to the input controller 160 in the I / O subsystem 106. In some embodiments, information is displayed in a portrait view or a landscape view on the touch screen display based on an analysis of data received from the one or more accelerometers. The device 100 optionally includes a magnetometer and a GPS (or GLONASS or other global navigation system) receiver in addition to the accelerometer 168 for obtaining information about the position and orientation (e.g., portrait or landscape) of the device 100.

[0074] In some embodiments, the software components stored in the memory 102 include an operating system 126, a communication module (or instruction set) 128, a contact / motion module (or instruction set) 130, a graphics module (or instruction set) 132, a tactile feedback module (or instruction set) 133, a text input module (or instruction set) 134, a global positioning system (GPS) module (or instruction set) 135, and an application (or instruction set) 136. In addition, in some embodiments, the memory 102 stores a device / global internal state 157, as shown in Figures 1A and 3. The device / global internal state 157 includes one or more of the following: an active application state, which indicates which applications (if any) are currently active; a display state, which indicates what applications, views, or other information occupy various areas of the touch-sensitive display system 112; a sensor state, which includes information obtained from various sensors and other input or control devices 116 of the device; and position and / or position information about the position and / or posture of the device.

[0075] The operating system 126 (e.g., iOS, Darwin, RTXC, LINUX, UNIX, OS X, WINDOWS, or an embedded operating system such as VxWorks) includes various software components and / or drivers for controlling and managing general system tasks (e.g., memory management, storage device control, power management, etc.), and facilitates communication between various hardware and software components.

[0076] The communication module 128 facilitates communication with other devices through one or more external ports 124, and also includes various software components for processing data received by the RF circuit 108 and / or the external port 124. The external port 124 (e.g., Universal Serial Bus (USB), FireWire, etc.) is suitable for coupling directly to other devices, or indirectly through a network (e.g., the Internet, wireless LAN, etc.). In some embodiments, the external port is a device that is compatible with some of Apple Inc. (Cupertino, California). and In some embodiments, the external port is a multi-pin (e.g., 30-pin) connector that is the same as or similar to and / or compatible with the 30-pin connector used in the device. In some embodiments, the external port is compatible with some of Apple Inc. (Cupertino, California) and In some embodiments, the external port is a USB Type-C connector that is the same as, similar to, and / or compatible with the Lightning connector used in some electronic devices from Apple Inc. (Cupertino, California).

[0077] The contact / motion module 130 optionally detects contact with the touch-sensitive display system 112 (in conjunction with the display controller 156) and other touch-sensitive devices (e.g., a touchpad or physical click wheel). The contact / motion module 130 includes various software components for performing various operations related to contact detection (e.g., by a finger or stylus), such as determining whether contact has occurred (e.g., detecting a finger press event), determining the strength of the contact (e.g., the force or pressure of the contact, or a substitute for the force or pressure of the contact), determining whether there is movement of the contact and tracking the movement across the touch-sensitive surface (e.g., detecting one or more finger drag events), and determining whether the contact has stopped (e.g., detecting a finger lift event or contact disconnection). The contact / motion module 130 receives contact data from the touch-sensitive surface. Determining the movement of a contact point optionally includes determining a rate (magnitude), velocity (magnitude and direction), and / or acceleration (change in magnitude and / or direction) of the contact point, the movement of which is represented by a series of contact data. These operations are optionally applied to a single point of contact (e.g., a single finger contact or stylus contact) or multiple points of simultaneous contact (e.g., "multi-touch" / multi-finger contact). In some embodiments, contact / motion module 130 and display controller 156 detect contact on a touch pad.

[0078] The contact / motion module 130 optionally detects gesture input by the user. Different gestures on the touch-sensitive surface have different contact patterns (e.g., different motions, timings, and / or intensities of the detected contacts). Therefore, gestures are optionally detected by detecting specific contact patterns. For example, detecting a single-finger tap gesture includes detecting a finger press event, and then detecting a finger lift (lift-off) event at the same location (or substantially the same location) as the finger press event (e.g., at an icon location). As another example, detecting a finger swipe gesture on the touch-sensitive surface includes detecting a finger press event, then detecting one or more finger drag events, and then detecting a finger lift (lift-off) event. Similarly, taps, swipes, drags, and other gestures of the stylus are optionally detected by detecting a specific contact pattern of the stylus.

[0079] In some embodiments, detecting a finger tap gesture depends on detecting the length of time between a finger press event and a finger lift event, but is independent of the strength of the finger contact between the finger press event and the finger lift event. In some embodiments, a tap gesture is detected based on determining that the length of time between the finger press event and the finger lift event is less than a predetermined value (e.g., less than 0.1 seconds, 0.2 seconds, 0.3 seconds, 0.4 seconds, or 0.5 seconds), regardless of whether the strength of the finger contact during the tap reaches a given strength threshold (greater than a nominal contact detection strength threshold), such as a light press or deep press strength threshold. Therefore, a finger tap gesture can meet a specific input criterion that does not require the characteristic strength of the contact to meet a given strength threshold to meet the specific input criterion. For clarity, the finger contact in a tap gesture is generally required to meet a nominal contact detection strength threshold to detect a finger press event, and the contact will not be detected when it is below the nominal contact detection strength threshold. A similar analysis applies to detecting a tap gesture by a stylus or other contact. In the case where the device is capable of detecting contact with a finger or stylus hovering over the touch-sensitive surface, the nominal contact detection intensity threshold optionally does not correspond to physical contact between the finger or stylus and the touch-sensitive surface.

[0080] The same concepts apply in a similar manner to other types of gestures. For example, a swipe gesture, a pinch gesture, an expand gesture, and / or a long press gesture may be optionally detected based on satisfying criteria that are independent of the strength of the contacts included in the gesture or that do not require one or more contacts performing the gesture to reach a strength threshold in order to be recognized. For example, a swipe gesture is detected based on the amount of movement of one or more contacts; a pinch gesture is detected based on the movement of two or more contacts toward each other; an expand gesture is detected based on the movement of two or more contacts away from each other; and a long press gesture is detected based on the duration of a contact on a touch-sensitive surface having less than a threshold amount of movement. Thus, the statement that a particular gesture recognition criterion does not require the strength of the contacts to satisfy a corresponding strength threshold in order to satisfy the particular gesture recognition criterion means that the particular gesture recognition criterion can be satisfied when the contacts in the gesture do not reach the corresponding strength threshold, and can also be satisfied when one or more contacts in the gesture reach or exceed the corresponding strength threshold. In some embodiments, a tap gesture is detected based on determining that a finger down event and a finger up event are detected within a predefined time period, regardless of whether the contact is above or below a corresponding strength threshold during the predefined time period, and a swipe gesture is detected based on determining that the contact moves greater than a predefined amount, even if the contact is above the corresponding strength threshold at the end of the contact movement. Even in specific implementations where detection of gestures is affected by the strength of the contact performing the gesture (e.g., the device detects a long press more quickly when the strength of the contact is above the strength threshold, or the device delays detection of a tap input when the strength of the contact is higher), detection of these gestures does not require the contact to reach a particular strength threshold (e.g., even if the amount of time required to recognize the gesture varies), as long as the criteria for recognizing the gesture can be met without the contact reaching the particular strength threshold.

[0081] In some cases, the contact intensity threshold, duration threshold, and movement threshold are combined in various combinations to create a heuristic algorithm to distinguish between two or more different gestures for the same input element or area, so that multiple different interactions with the same input element can provide a richer set of user interactions and responses. The statement that a particular set of gesture recognition criteria does not require the intensity of one or more contacts to meet the corresponding intensity threshold in order to meet the particular gesture recognition criteria does not exclude the simultaneous evaluation of other intensity-related gesture recognition criteria to identify other gestures with criteria that are met when the gesture includes a contact with an intensity above the corresponding intensity threshold. For example, in some cases, a first gesture recognition criterion for a first gesture (which does not require the intensity of the contact to meet the corresponding intensity threshold to meet the first gesture recognition criterion) competes with a second gesture recognition criterion for a second gesture (which depends on the contact reaching the corresponding intensity threshold). In such a competition, if the second gesture recognition criterion for the second gesture is met first, the gesture is optionally not recognized as satisfying the first gesture recognition criterion for the first gesture. For example, if the contact reaches the corresponding intensity threshold before the contact moves a predefined amount of movement, a deep press gesture is detected instead of a swipe gesture. Conversely, if the contact moves the predefined amount of movement before the contact reaches the corresponding intensity threshold, a swipe gesture is detected instead of a deep press gesture. Even in such cases, the first gesture recognition criteria for the first gesture still does not require the intensity of the contact to satisfy the corresponding intensity threshold to satisfy the first gesture recognition criteria because if the contact remains below the corresponding intensity threshold until the gesture ends (e.g., a swipe gesture with an intensity of the contact that does not increase above the corresponding intensity threshold), the gesture will be recognized as a swipe gesture by the first gesture recognition criteria. Thus, a particular gesture recognition criterion that does not require the intensity of the contact to satisfy the corresponding intensity threshold to satisfy the particular gesture recognition criterion will (A) in some cases ignore the intensity of the contact relative to the intensity threshold (e.g., for a tap gesture) and / or (B) in some cases fail to satisfy the particular gesture recognition criterion (e.g., for a long press gesture) if a set of competing intensity-related gesture recognition criteria (e.g., for a deep press gesture) recognizes the input as corresponding to an intensity-related gesture before the particular gesture recognition criterion recognizes the gesture corresponding to the input, and in this sense still depends on the intensity of the contact relative to the intensity threshold (e.g., for a long press gesture competing with the deep press gesture for recognition).

[0082] Graphics module 132 includes various known software components for rendering and displaying graphics on touch-sensitive display system 112 or other displays, including components for changing the visual impact (e.g., brightness, transparency, saturation, contrast, or other visual attributes) of displayed graphics. As used herein, the term "graphics" includes any object that can be displayed to a user, including, without limitation, text, web pages, icons (such as user interface objects including soft keys), digital images, videos, animations, etc.

[0083] In some embodiments, the graphics module 132 stores data representing graphics to be used. Each graphic is optionally assigned a corresponding code. The graphics module 132 receives one or more codes for specifying the graphics to be displayed from an application or the like, along with coordinate data and other graphics attribute data if necessary, and then generates screen image data to be output to the display controller 156.

[0084] Haptic feedback module 133 includes various software components for generating instructions (e.g., instructions used by haptic feedback controller 161) to generate tactile output at one or more locations on device 100 using tactile output generator 167 in response to user interaction with device 100.

[0085] Text input module 134, optionally as part of graphics module 132, provides a soft keyboard for entering text in various applications (eg, contacts 137, email 140, IM 141, browser 147, and any other application requiring text input).

[0086] The GPS module 135 determines the location of the device and provides this information for use in various applications (e.g., to the phone module 138 for location-based dialing; to the camera 143 as picture / video metadata; and to applications that provide location-based services such as a weather widget, local yellow pages widget, and a map / navigation widget).

[0087] Application 136 optionally includes the following modules (or instruction sets) or a subset or superset thereof:

[0088] Contacts module 137 (sometimes called address book or contact list);

[0089] Telephone module 138;

[0090] Video conferencing module 139;

[0091] Email client module 140;

[0092] Instant messaging (IM) module 141;

[0093] Fitness support module 142;

[0094] A camera module 143 for still images and / or video images;

[0095] Image management module 144;

[0096] Browser module 147;

[0097] Calendar module 148;

[0098] A widget module 149, which optionally includes one or more of the following: a weather widget 149-1, a stock market widget 149-2, a calculator widget 149-3, an alarm widget 149-4, a dictionary widget 149-5, and other widgets acquired by the user, and a user-created widget 149-6;

[0099] A widget creator module 150 for forming a user-created widget 149 - 6 ;

[0100] Search module 151;

[0101] A video and music player module 152, optionally consisting of a video player module and a music player module;

[0102] Note module 153;

[0103] Map module 154; and / or

[0104] Online video module 155.

[0105] Examples of other applications 136 optionally stored in memory 102 include other word processing applications, other image editing applications, drawing applications, rendering applications, JAVA-enabled applications, encryption, digital rights management, voice recognition, and voice replication.

[0106] In conjunction with the touch-sensitive display system 112, display controller 156, contact module 130, graphics module 132, and text input module 134, the contact module 137 includes executable instructions for managing an address book or contact list (e.g., stored in the application internal state 192 of the contact module 137 in memory 102 or memory 370), including: adding names to the address book; deleting names from the address book; associating phone numbers, email addresses, physical addresses, or other information with names; associating images with names; categorizing and classifying names; providing phone numbers and / or email addresses to initiate and / or facilitate communications via the phone module 138, video conferencing 139, email 140, or IM 141; etc.

[0107] In conjunction with RF circuitry 108, audio circuitry 110, speaker 111, microphone 113, touch-sensitive display system 112, display controller 156, contact module 130, graphics module 132, and text input module 134, phone module 138 includes executable instructions for entering a character sequence corresponding to a phone number, accessing one or more phone numbers in address book 137, modifying an entered phone number, dialing a corresponding phone number, conducting a conversation, and disconnecting or hanging up when the conversation is complete. As described above, wireless communications optionally use any of a variety of communication standards, protocols, and technologies.

[0108] In combination with RF circuitry 108, audio circuitry 110, speaker 111, microphone 113, touch-sensitive display system 112, display controller 156, one or more optical sensors 164, optical sensor controller 158, contact module 130, graphics module 132, text input module 134, contact list 137, and telephone module 138, video conferencing module 139 includes executable instructions for initiating, conducting, and terminating a video conference between a user and one or more other participants in accordance with user instructions.

[0109] In conjunction with RF circuit 108, touch-sensitive display system 112, display controller 156, contact module 130, graphics module 132, and text input module 134, email client module 140 includes executable instructions for creating, sending, receiving, and managing emails in response to user instructions. In conjunction with image management module 144, email client module 140 makes it very easy to create and send emails with still images or video images captured by camera module 143.

[0110] In conjunction with the RF circuit 108, the touch-sensitive display system 112, the display controller 156, the contact module 130, the graphics module 132, and the text input module 134, the instant messaging module 141 includes executable instructions for performing the following operations: inputting a character sequence corresponding to an instant message, modifying previously input characters, transmitting the corresponding instant message (e.g., using a short message service (SMS) or multimedia message service (MMS) protocol for phone-based instant messaging or using XMPP, SIMPLE, Apple Push Notification Service (APNs) or IMPS for Internet-based instant messaging), receiving instant messages, and viewing received instant messages. In some embodiments, the transmitted and / or received instant messages optionally include graphics, photos, audio files, video files, and / or other attachments supported in MMS and / or enhanced messaging services (EMS). As used herein, "instant messaging" refers to both phone-based messages (e.g., messages sent using SMS or MMS) and Internet-based messages (e.g., messages sent using XMPP, SIMPLE, APNs, or IMPS).

[0111] In combination with RF circuitry 108, touch-sensitive display system 112, display controller 156, contact module 130, graphics module 132, text input module 134, GPS module 135, map module 154, and video and music player module 152, fitness support module 142 includes executable instructions for creating workouts (e.g., with time, distance, and / or calorie burn goals); communicating with fitness sensors (in sports equipment and smart watches); receiving fitness sensor data; calibrating sensors for monitoring fitness; selecting and playing music for a workout; and displaying, storing, and transmitting fitness data.

[0112] In conjunction with touch-sensitive display system 112, display controller 156, one or more optical sensors 164, optical sensor controller 158, contact module 130, graphics module 132, and image management module 144, camera module 143 includes executable instructions for capturing still images or videos (including video streams) and storing them in memory 102, modifying characteristics of still images or videos, and / or deleting still images or videos from memory 102.

[0113] In conjunction with touch-sensitive display system 112, display controller 156, contact module 130, graphics module 132, text input module 134, and camera module 143, image management module 144 includes executable instructions for arranging, modifying (e.g., editing), or otherwise manipulating, labeling, deleting, displaying (e.g., in a digital slide show or album), and storing still images and / or video images.

[0114] In combination with the RF circuit 108, the touch-sensitive display system 112, the display controller 156, the contact module 130, the graphics module 132 and the text input module 134, the browser module 147 includes executable instructions for browsing the Internet in accordance with user instructions (including searching, linking to, receiving and displaying web pages or portions thereof, as well as attachments and other files linked to web pages).

[0115] In combination with the RF circuit 108, the touch-sensitive display system 112, the display controller 156, the contact module 130, the graphics module 132, the text input module 134, the email client module 140 and the browser module 147, the calendar module 148 includes executable instructions for creating, displaying, modifying and storing calendars and data associated with the calendar (e.g., calendar entries, to-do items, etc.) in accordance with user instructions.

[0116] In conjunction with RF circuit 108, touch-sensitive display system 112, display controller 156, contact module 130, graphics module 132, text input module 134, and browser module 147, widget module 149 is a mini-application that is optionally downloaded and used by a user (e.g., weather widget 149-1, stock market widget 149-2, calculator widget 149-3, alarm widget 149-4, and dictionary widget 149-5) or a mini-application created by a user (e.g., user-created widget 149-6). In some embodiments, a widget includes an HTML (Hypertext Markup Language) file, a CSS (Cascading Style Sheets) file, and a JavaScript file. In some embodiments, a widget includes an XML (Extensible Markup Language) file and a JavaScript file (e.g., Yahoo! widget).

[0117] In conjunction with the RF circuit 108, the touch-sensitive display system 112, the display controller 156, the contact module 130, the graphics module 132, the text input module 134, and the browser module 147, the widget creator module 150 includes executable instructions for creating a widget (e.g., transferring a user-specified portion of a web page into a widget).

[0118] In conjunction with the touch-sensitive display system 112, display controller 156, contact module 130, graphics module 132 and text input module 134, the search module 151 includes executable instructions for searching the memory 102 for text, music, sound, images, videos and / or other files that match one or more search criteria (e.g., one or more user-specified search terms) in accordance with user instructions.

[0119] In conjunction with touch-sensitive display system 112, display controller 156, contact module 130, graphics module 132, audio circuitry 110, speaker 111, RF circuitry 108, and browser module 147, video and music player module 152 includes executable instructions that allow a user to download and play back recorded music and other sound files stored in one or more file formats (such as, MP3 or AAC files), as well as executable instructions for displaying, presenting, or otherwise playing back video (e.g., on touch-sensitive display system 112, or on an external display connected wirelessly or via external port 124). In some embodiments, device 100 optionally includes the functionality of an MP3 player such as an iPod (trademark of Apple Inc.).

[0120] In conjunction with the touch-sensitive display system 112, display controller 156, contact module 130, graphics module 132, and text input module 134, the note module 153 includes executable instructions for creating and managing notes, to-do lists, etc. according to user instructions.

[0121] In combination with RF circuitry 108, touch-sensitive display system 112, display controller 156, contact module 130, graphics module 132, text input module 134, GPS module 135, and browser module 147, map module 154 includes executable instructions for receiving, displaying, modifying, and storing maps and data associated with the maps (e.g., driving directions; data about stores and other points of interest at or near a particular location; and other location-based data) in accordance with user instructions.

[0122] In conjunction with touch-sensitive display system 112, display controller 156, contact module 130, graphics module 132, audio circuit 110, speaker 111, RF circuit 108, text input module 134, email client module 140, and browser module 147, online video module 155 includes executable instructions that allow a user to access, browse, receive (e.g., by streaming and / or downloading), play back (e.g., on touch-sensitive display system 112 or on an external display connected wirelessly or via external port 124), send an email with a link to a particular online video, and otherwise manage online videos in one or more file formats such as H.264. In some embodiments, instant messaging module 141 is used instead of email client module 140 to send a link to a particular online video.

[0123] Each module and application identified above corresponds to a set of executable instructions for performing one or more functions and methods described in the present application (e.g., computer-implemented methods and other information processing methods described herein). These modules (e.g., instruction sets) do not have to be implemented as independent software programs, processes or modules, so various subsets of these modules are optionally combined or otherwise rearranged in various embodiments. In some embodiments, memory 102 optionally stores subsets of the above modules and data structures. In addition, memory 102 optionally stores other modules and data structures not described above.

[0124] In some embodiments, the device 100 is a device where the operation of a predefined set of functions on the device is performed exclusively through a touch screen and / or a touch pad. By using a touch screen and / or a touch pad as the primary input control device for operating the device 100, the number of physical input control devices (e.g., push buttons, dials, etc.) on the device 100 is optionally reduced.

[0125] A predefined set of functions that are performed exclusively through the touch screen and / or touchpad optionally includes navigation between user interfaces. In some embodiments, the touchpad, when touched by the user, navigates the device 100 to a main menu, a home menu, or a root menu from any user interface displayed on the device 100. In such embodiments, a "menu button" is implemented using the touchpad. In some other embodiments, the menu button is a physical push button or other physical input control device, rather than a touchpad.

[0126] Figure 1B 1 is a block diagram illustrating exemplary components for event processing according to some embodiments. In some embodiments, memory 102 ( Figure 1A ) or memory 370 (Figure 3) includes an event classifier 170 (for example, in the operating system 126) and a corresponding application 136-1 (for example, any one of the aforementioned applications 136, 137 to 155, 380 to 390).

[0127] The event classifier 170 receives event information and determines the application 136-1 and the application view 191 of the application 136-1 to which the event information is to be delivered. The event classifier 170 includes an event monitor 171 and an event distributor module 174. In some embodiments, the application 136-1 includes an application internal state 192, which indicates one or more current application views displayed on the touch-sensitive display system 112 when the application is active or executing. In some embodiments, the device / global internal state 157 is used by the event classifier 170 to determine which application(s) is currently active, and the application internal state 192 is used by the event classifier 170 to determine the application view 191 to which the event information is to be delivered.

[0128] In some embodiments, the application internal state 192 includes additional information, such as one or more of the following: resumption information to be used when application 136-1 resumes execution, user interface state information indicating that information is being displayed or is ready to be displayed by application 136-1, a state queue for enabling a user to return to a previous state or view of application 136-1, and a repeat / undo queue of previous actions taken by the user.

[0129] Event monitor 171 receives event information from peripherals interface 118. Event information includes information about sub-events (e.g., a user touch on touch-sensitive display system 112 as part of a multi-touch gesture). Peripherals interface 118 transmits information it receives from I / O subsystem 106 or sensors such as proximity sensor 166, one or more accelerometers 168, and / or microphone 113 (through audio circuit 110). The information received by peripherals interface 118 from I / O subsystem 106 includes information from touch-sensitive display system 112 or a touch-sensitive surface.

[0130] In some embodiments, event monitor 171 sends requests to peripheral device interface 118 at predetermined intervals. In response, peripheral device interface 118 transmits event information. In other embodiments, peripheral device interface 118 transmits event information only when there is a significant event (e.g., receiving an input above a predetermined noise threshold and / or receiving an input for more than a predetermined duration).

[0131] In some embodiments, the event classifier 170 also includes a hit view determination module 172 and / or an active event identifier determination module 173.

[0132] When the touch-sensitive display system 112 displays more than one view, the hit view determination module 172 provides software procedures for determining where within one or more views a sub-event has occurred. A view consists of controls and other elements that a user can see on the display.

[0133] Another aspect of the user interface associated with an application is a set of views, sometimes also referred to herein as application views or user interface windows, in which information is displayed and touch-based gestures occur. The application views (of the respective application) in which a touch is detected optionally correspond to a programmatic level within the programmatic or view hierarchy of the application. For example, the lowest level view in which a touch is detected is optionally referred to as a hit view, and the set of events that are identified as correct input is optionally determined at least in part based on the hit view of the initial touch that started the touch-based gesture.

[0134] Hit view determination module 172 receives information related to sub-events of touch-based gestures. When an application has multiple views organized in a hierarchy, hit view determination module 172 identifies the hit view as the lowest view in the hierarchy where the sub-events should be processed. In most cases, the hit view is the lowest level view in which the initiating sub-event (e.g., the first sub-event in a sequence of sub-events that form an event or potential event) occurs. Once a hit view is identified by the hit view determination module, the hit view typically receives all sub-events related to the same touch or input source for which it was identified as the hit view.

[0135] Active event recognizer determination module 173 determines which view or views within the view hierarchy should receive a particular sequence of sub-events. In some embodiments, active event recognizer determination module 173 determines that only the hit view should receive a particular sequence of sub-events. In other embodiments, active event recognizer determination module 173 determines that all views that include the physical location of the sub-event are actively participating views, and therefore determines that all actively participating views should receive a particular sequence of sub-events. In other embodiments, even if a touch sub-event is completely confined to an area associated with one particular view, higher views in the hierarchy will still remain as actively participating views.

[0136] Event distributor module 174 distributes event information to event recognizers (e.g., event recognizers 180). In embodiments including active event recognizer determination module 173, event distributor module 174 delivers the event information to the event recognizers determined by active event recognizer determination module 173. In some embodiments, event distributor module 174 stores the event information in an event queue, which is retrieved by corresponding event receiver module 182.

[0137] In some embodiments, operating system 126 includes event classifier 170. Alternatively, application 136-1 includes event classifier 170. In yet another embodiment, event classifier 170 is a standalone module or is part of another module stored in memory 102, such as contact / motion module 130.

[0138] In some embodiments, application 136-1 includes multiple event handlers 190 and one or more application views 191, each of which includes instructions for handling touch events occurring within a corresponding view of the user interface of the application. Each application view 191 of application 136-1 includes one or more event identifiers 180. Typically, the corresponding application view 191 includes multiple event identifiers 180. In other embodiments, one or more event identifiers in event identifiers 180 are part of an independent module, which is a higher-level object such as a user interface toolkit or application 136-1 from which methods and other properties are inherited. In some embodiments, the corresponding event handler 190 includes one or more of the following: data updater 176, object updater 177, GUI updater 178 and / or event data 179 received from event classifier 170. Event handler 190 optionally utilizes or calls data updater 176, object updater 177 or GUI updater 178 to update application internal state 192. Alternatively, one or more of the application views in the application view 191 include one or more corresponding event handlers 190. In addition, in some embodiments, one or more of the data updater 176, the object updater 177, and the GUI updater 178 are included in the corresponding application view 191.

[0139] A corresponding event identifier 180 receives event information (e.g., event data 179) from event classifier 170 and identifies an event from the event information. Event identifier 180 includes an event receiver 182 and an event comparator 184. In some embodiments, event identifier 180 also includes metadata 183 and at least a subset of event delivery instructions 188 (which optionally include sub-event delivery instructions).

[0140] Event receiver 182 receives event information from event classifier 170. Event information includes information about sub-events such as touch or touch movement. Depending on the sub-event, the event information also includes additional information, such as the location of the sub-event. When the sub-event involves the movement of the touch, the event information optionally also includes the speed and direction of the sub-event. In some embodiments, the event includes the device rotating from one orientation to another orientation (for example, from a longitudinal orientation to a transverse orientation, or vice versa), and the event information includes corresponding information about the current orientation of the device (also referred to as the device posture).

[0141] Event comparator 184 compares event information with predefined event or sub-event definitions, and determines an event or sub-event based on the comparison, or determines or updates the state of an event or sub-event. In some embodiments, event comparator 184 includes event definition 186. Event definition 186 includes the definition of an event (e.g., a predefined sequence of sub-events), such as event 1 (187-1), event 2 (187-2), and others. In some embodiments, sub-events in event 187 include, for example, touch start, touch end, touch move, touch cancel, and multi-touch. In one example, the definition of event 1 (187-1) is a double-click on a displayed object. For example, a double-click includes a first touch (touch start) of a predetermined duration on a displayed object, a first lift (touch end) of a predetermined duration, a second touch (touch start) of a predetermined duration on a displayed object, and a second lift (touch end) of a predetermined duration. In another example, the definition of event 2 (187-2) is a drag on a displayed object. For example, dragging includes a touch (or contact) of a predetermined duration on a displayed object, movement of the touch on the touch-sensitive display system 112, and lifting of the touch (touch end). In some embodiments, the event also includes information for one or more associated event handlers 190.

[0142] In some embodiments, event definition 187 includes definitions of events for corresponding user interface objects. In some embodiments, event comparator 184 performs a hit test to determine which user interface object is associated with a sub-event. For example, in an application view displaying three user interface objects on touch-sensitive display system 112, when a touch is detected on touch-sensitive display system 112, event comparator 184 performs a hit test to determine which of the three user interface objects is associated with the touch (sub-event). If each displayed object is associated with a corresponding event handler 190, the event comparator uses the result of the hit test to determine which event handler 190 should be activated. For example, event comparator 184 selects an event handler associated with the sub-event and the object that triggered the hit test.

[0143] In some embodiments, the definition of the corresponding event 187 also includes delay actions that delay the delivery of the event information until after it has been determined that the sub-event sequence does or does not correspond to the event type of the event identifier.

[0144] When a corresponding event recognizer 180 determines that a sequence of sub-events does not match any event in event definition 186, the corresponding event recognizer 180 enters an event impossible, event failed, or event ended state, after which subsequent sub-events of the touch-based gesture are ignored. In this case, other event recognizers (if any) that remain active for the hit view continue to track and process sub-events of the ongoing touch-based gesture.

[0145] In some embodiments, the corresponding event recognizers 180 include metadata 183 with configurable properties, flags, and / or lists that indicate how the event delivery system should perform sub-event delivery to actively participating event recognizers. In some embodiments, metadata 183 includes configurable properties, flags, and / or lists that indicate how event recognizers interact or can interact with each other. In some embodiments, metadata 183 includes configurable properties, flags, and / or lists that indicate whether sub-events are delivered to different levels in a view or programmatic hierarchy.

[0146] In some embodiments, when one or more specific sub-events of an event are identified, the corresponding event recognizer 180 activates an event handler 190 associated with the event. In some embodiments, the corresponding event recognizer 180 delivers event information associated with the event to the event handler 190. Activating the event handler 190 is different from sending (and deferred sending) the sub-events to the corresponding hit view. In some embodiments, the event recognizer 180 throws a flag associated with the identified event, and the event handler 190 associated with the flag obtains the flag and executes a predefined process.

[0147] In some embodiments, the event delivery instructions 188 include a sub-event delivery instruction that delivers event information about a sub-event without activating an event handler. Instead, the sub-event delivery instruction delivers the event information to an event handler associated with a sub-event sequence or to an actively participating view. The event handler associated with the sub-event sequence or with an actively participating view receives the event information and executes a predetermined process.

[0148] In some embodiments, data updater 176 creates and updates data used in application 136-1. For example, data updater 176 updates phone numbers used in contact module 137 or stores video files used in video or music player module 152. In some embodiments, object updater 177 creates and updates objects used in application 136-1. For example, object updater 177 creates new user interface objects or updates the positioning of user interface objects. GUI updater 178 updates the GUI. For example, GUI updater 178 prepares display information and sends the display information to graphics module 132 for display on a touch-sensitive display.

[0149] In some embodiments, event handler 190 includes or has access to data updater 176, object updater 177, and GUI updater 178. In some embodiments, data updater 176, object updater 177, and GUI updater 178 are included in a single module of the corresponding application 136-1 or application view 191. In other embodiments, they are included in two or more software modules.

[0150] It should be understood that the above discussion of event processing of user touches on a touch-sensitive display also applies to other forms of user input that utilize input devices to operate the multifunction device 100, and not all user input is initiated on the touch screen. For example, mouse movement and mouse button presses, optionally in conjunction with single or multiple keyboard presses or holddowns; contact movement on a touchpad, such as tapping, dragging, scrolling, etc.; stylus input; movement of the device; verbal commands; detected eye movement; biometric input; and / or any combination thereof are optionally used as input corresponding to sub-events that define the event to be distinguished.

[0151] Figure 2 A device having a touch screen (e.g., Figure 1AThe portable multifunction device 100 of the present invention is a touch-sensitive display system 112 of the present invention. The touch screen optionally displays one or more graphics within the user interface (UI) 200. In these embodiments and in other embodiments described below, the user can select one or more of the graphics by, for example, making gestures on the graphics using one or more fingers 202 (not drawn to scale in the figure) or one or more styluses 203 (not drawn to scale in the figure). In some embodiments, when the user interrupts contact with the one or more graphics, selection of the one or more graphics will occur. In some embodiments, the gesture optionally includes one or more taps, one or more swipes (from left to right, from right to left, up and / or down) and / or rolling of the fingers that have been in contact with the device 100 (from right to left, from left to right, up and / or down). In some specific implementations or in some cases, inadvertent contact with the graphics will not select the graphics. For example, when the gesture corresponding to the selection is a tap, a swipe gesture that sweeps over the application icon optionally does not select the corresponding application.

[0152] The device 100 optionally also includes one or more physical buttons, such as a "home" or menu button 204. As previously described, the menu button 204 is optionally used to navigate to any application 136 in a set of applications that are optionally executed on the device 100. Alternatively, in some embodiments, the menu button is implemented as a soft key in a GUI displayed on the touch screen display.

[0153] In some embodiments, the device 100 includes a touch screen display, a menu button 204 (sometimes referred to as a home button 204), a push button 206 for powering the device on / off and for locking the device, a volume adjustment button 208, a user identity module (SIM) card slot 210, an earphone jack 212, and a docking / charging external port 124. The push button 206 is optionally used to turn the device on / off by pressing the button and keeping the button in a pressed state for a predefined time interval; lock the device by pressing the button and releasing the button before the predefined time interval has passed; and / or unlock the device or initiate an unlocking process. In some embodiments, the device 100 also accepts voice input for activating or deactivating certain functions through a microphone 113. The device 100 also optionally includes one or more contact strength sensors 165 for detecting the strength of contact on the touch-sensitive display system 112, and / or one or more tactile output generators 167 for generating tactile output for a user of the device 100.

[0154] Figure 3A300 is a block diagram of an example multifunction device with a display and a touch-sensitive surface according to some embodiments. Device 300 does not have to be portable. In some embodiments, device 300 is a laptop computer, a desktop computer, a tablet computer, a multimedia player device, a navigation device, an educational device (such as a children's learning toy), a game system, or a control device (e.g., a home controller or an industrial controller). Device 300 typically includes one or more processing units (CPUs) 310, one or more network or other communication interfaces 360, a memory 370, and one or more communication buses 320 for interconnecting these components. The communication bus 320 optionally includes circuits (sometimes referred to as a chipset) that interconnect system components and control communications between system components. Device 300 includes an input / output (I / O) interface 330 with a display 340, which is typically a touch screen display. The I / O interface 330 also optionally includes a keyboard and / or mouse (or other pointing device) 350 and a touch pad 355, a tactile output generator 357 for generating tactile output on the device 300 (e.g., similar to the above reference). Figure 1A The one or more tactile output generators 167 described above), sensors 359 (e.g., optical sensors, acceleration sensors, proximity sensors, touch sensors, and / or sensors similar to those described above) Figure 1A In some embodiments, device 300 includes a wireless interface 311 (e.g., a wireless interface 312) for communicating with one or more wearable audio output devices 301 and / or electronic accessory box 342. Figure 3E ). In some embodiments, device 300 includes a network communication interface 360 ​​for communicating with a remote device (eg, in conjunction with communication module 128).

[0155] Memory 370 includes high-speed random access memory, such as DRAM, SRAM, DDR RAM, or other random access solid-state memory devices; and optionally includes non-volatile memory, such as one or more magnetic disk storage devices, optical disk storage devices, flash memory devices, or other non-volatile solid-state storage devices. Memory 370 optionally includes one or more storage devices located away from CPU 310. In some embodiments, memory 370 stores data related to portable multifunction device 100 ( Figure 1A) or a subset thereof. In addition, memory 370 optionally stores additional programs, modules, and data structures not present in memory 102 of portable multifunction device 100. For example, memory 370 of device 300 optionally stores a drawing module 380, a presentation module 382, ​​a word processing module 384, a website creation module 386, a disk editing module 388, and / or a spreadsheet module 390, while portable multifunction device 100 ( Figure 1A )'s memory 102 optionally does not store these modules.

[0156] Figure 3A Each element in the above-mentioned identified element is optionally stored in one or more memory devices in the previously mentioned memory device. Each module in the above-mentioned identified module corresponds to the instruction set for performing the above-mentioned functions. The above-mentioned identified module or program (that is, instruction set) need not be implemented as a separate software program, process or module, so the various subsets of these modules are optionally combined or otherwise rearranged in various embodiments. In some embodiments, memory 370 optionally stores the subset of the above-mentioned modules and data structures. In addition, memory 370 optionally stores additional modules and data structures not described above.

[0157] Figure 3B 301 according to some embodiments. In some embodiments, the wearable audio output device 301 is one or more in-ear headphones, earbuds, over-ear headphones, etc. Figure 3B In some embodiments, the wearable audio output device 301 includes a head portion 303 and a handle portion 305. In some embodiments, the head portion 303 is configured to be inserted into the ear of the user. In some embodiments, the handle portion 305 physically extends from the head portion 303 (e.g., is an elongated portion extending from the head portion 303). For example, when the head portion 303 is inserted into the ear of the user, the head portion 303 physically extends downward, in front of the user's earlobe, and / or past the user's earlobe.

[0158] In some embodiments, the wearable audio output device 301 includes one or more audio speakers 306 (e.g., in the head portion 303) for providing audio output (e.g., to the user's ears). In some embodiments, the wearable audio output device 301 includes one or more placement sensors 304 (e.g., placement sensors 304-1 and 304-2 in the head portion 303) to detect the positioning or placement of the wearable audio output device 301 relative to the user's ears, such as detecting the placement of the wearable audio output device 301 in the user's ears.

[0159] In some embodiments, the wearable audio output device 301 includes one or more microphones 302 for receiving audio input. In some embodiments, one or more microphones 302 (e.g., microphone 302-1) are included in the head portion 303. In some embodiments, one or more microphones 302 (e.g., microphone 302-2) are included in the handle portion 305. In some embodiments, the microphone 302 detects the voice of the user wearing the wearable audio output device 301 and / or the ambient noise around the wearable audio output device 301. In some embodiments, multiple microphones of the microphone 302 are positioned at different locations on the wearable audio output device 301 to measure the voice and / or ambient noise at different locations around the wearable audio output device 301.

[0160] In some embodiments, the wearable audio output device 301 includes one or more input devices 308 (e.g., in the handle portion 305). In some embodiments, the input device 308 includes a pressure-sensitive (e.g., intensity-sensitive) input device. In some embodiments, the pressure-sensitive input device detects input from the user in response to the user squeezing the input device (e.g., by pinching the handle portion 305 of the wearable audio output device 301 between two fingers). In some embodiments, the input device 308 includes a touch-sensitive surface (e.g., a capacitive sensor) for detecting touch input, an accelerometer and / or a posture sensor (e.g., for determining the posture of the wearable audio output device 301 relative to the physical environment and / or a change in the posture of the device) and / or other input devices through which the user can interact with the wearable audio output device 301 and provide input to the wearable audio output device. In some embodiments, the input device 308 includes one or more capacitive sensors, one or more force sensors, one or more motion sensors, and / or one or more orientation sensors. Figure 3BInput devices 308 are shown at locations in the handle portion 305, however in some embodiments, one or more of the input devices 308 are located at other locations within the wearable audio output device 301 (e.g., other locations within the handle portion 305 and / or the head portion 303). In some embodiments, the wearable audio output device 301 includes a housing having one or more physical distinguishing portions 307 at locations corresponding to the input devices 308 (e.g., to assist the user in locating and / or interacting with the input devices 308). In some embodiments, the physical distinguishing portions 307 include indentations, raised portions, and / or portions with different textures. In some embodiments, the physical distinguishing portions 307 include a single distinguishing portion that spans multiple input devices 308. For example, the input device 308 includes a set of touch sensors configured to detect a sliding gesture, and a single distinguishing portion (e.g., a depression or groove) spans the set of touch sensors. In some embodiments, the physical distinguishing portions 307 include a corresponding distinguishing portion for each input device of the input device 308.

[0161] Figure 3Cis a block diagram of an exemplary wearable audio output device 301 according to some embodiments. In some embodiments, the wearable audio output device 301 is one or more in-ear headphones, earbuds, over-ear headphones, etc. In some examples, the wearable audio output device 301 includes a pair of headphones or earbuds (e.g., one headphone or earbud for each of the user's ears). In some examples, the wearable audio output device 301 includes over-ear headphones (e.g., headphones with two over-ear earmuffs to be placed over the user's ears and optionally connected by a headband). In some embodiments, the wearable audio output device 301 includes one or more audio speakers 306 for providing audio output (e.g., to the user's ears). In some embodiments, the wearable audio output device 301 includes one or more placement sensors 304 to detect the positioning or placement of the wearable audio output device 301 relative to the user's ears, such as detecting the placement of the wearable audio output device 301 in the user's ears. In some embodiments, the wearable audio output device 301 conditionally outputs audio based on whether the wearable audio output device 301 is in the user's ear or near the user's ear (e.g., when the wearable audio output device 301 is not in the user's ear, output audio is abandoned to reduce power usage). In some embodiments where the wearable audio output device 301 includes multiple (e.g., a pair) of wearable audio output components (e.g., headphones, earplugs, or earmuffs), each component includes one or more corresponding placement sensors, and the wearable audio output device 301 conditionally outputs audio based on whether one or both components are in the user's ear or near the user's ear, as described herein. In some embodiments, the wearable audio output device 301 also includes an internal rechargeable battery 309 for providing power to various components of the wearable audio output device 301.

[0162] In some embodiments, the wearable audio output device 301 includes an audio I / O logic component 312 that determines the positioning or placement of the wearable audio output device 301 relative to the user's ear based on information received from the placement sensor 304, and in some embodiments, the audio I / O logic component 312 controls the resulting conditional audio output. In some embodiments, the wearable audio output device 301 includes a device for communicating with one or more multi-function devices such as device 100 ( Figure 1A ) or device 300( Figure 3A ) and electronic accessory box 342 (see Figure 3E ) wireless interface 315 for communicating with a multi-function device such as device 100 ( Figure 1A ) or device 300( Figure 3A) is connected (e.g., via a headphone jack or other audio port). In some embodiments, a user can interact with and provide input to the wearable audio output device 301 via interface 315 (e.g., remotely). In some embodiments, the wearable audio output device 301 communicates with multiple devices (e.g., multiple multi-function devices and / or audio output device housings), and the audio I / O logic component 312 determines which of the multi-function devices to accept instructions for outputting audio.

[0163] In some embodiments, the wearable audio output device 301 includes one or more microphones 302 for receiving audio input. In some embodiments where the wearable audio output device 301 includes multiple (e.g., a pair) wearable audio output components (e.g., headphones or earbuds), each component includes one or more corresponding microphones. In some embodiments, the audio I / O logic component 312 detects or recognizes speech or ambient noise based on information received from the microphone 302.

[0164] In some embodiments, the wearable audio output device 301 includes one or more input devices 308. In some embodiments where the wearable audio output device 301 includes multiple (e.g., a pair of) wearable audio output components (e.g., headphones, earbuds, or earmuffs), each component includes one or more corresponding input devices. In some embodiments, the input device 308 includes one or more volume control hardware elements for (e.g., local) volume control of the wearable audio output device 301 (e.g., an increase / decrease button for volume control, or as described herein with reference to Figure 1A In some embodiments, the input provided via one or more input devices 308 is processed by the audio I / O logic component 312. In some embodiments, the audio I / O logic component 312 is connected to a separate device (e.g., Figure 1A Device 100 or Figure 3A 300) that provides instructions or content for audio output and optionally receives and processes input (or information about input) provided via microphone 302, placement sensor 304, and / or input device 308 or via one or more input devices of a separate device. In some embodiments, audio I / O logic 312 is located on device 100 (e.g., as a Figure 1A 118) or device 300 (e.g., as part of the peripheral device interface 118 of Figure 3A 301), or alternatively is located partially in device 100 and partially in device 301, or is located partially in device 300 and partially in device 301.

[0165] Figure 3D Physical features of an example electronic accessory box 342 according to some embodiments are shown. In some embodiments, the electronic accessory box 342 includes a cover 367 and a container 369. In some embodiments, the electronic accessory box 342 includes one or more sensors to detect whether the cover 367 is opened, closed and / or moved. In some embodiments, the electronic accessory box 342 is configured to accommodate and / or charge one or more electronic accessories, such as headphones, smart watches, electronic styluses, fitness trackers, and / or earbuds. In some embodiments, the electronic accessory box 342 includes one or more audio output devices (e.g., speakers 345) (e.g., to provide status and / or event information to a user). In some embodiments, the electronic accessory box 342 includes one or more input devices.

[0166] Figure 3E 342 is a block diagram showing an electronic accessory box 342 according to some embodiments. In some embodiments, the electronic accessory box 342 is an earphone box (e.g., a wireless earphone box). In some embodiments, the electronic accessory box 342 is an accessory charging box configured to charge one or more accessories when the accessory is positioned (e.g., installed, inserted and / or attached) to the accessory charging box. The electronic accessory box 342 includes a memory 349 (optionally including one or more computer-readable storage media), one or more processing units (CPUs) 343, and a peripheral device interface 344. In some embodiments, the peripheral device interface 344 includes one or more speakers 345, one or more input devices 346 (e.g., one or more buttons, switches, and / or joysticks), and one or more communication components 348 (e.g., wireless interfaces) for communicating with devices such as one or more wearable audio output devices 301 and one or more electronic devices such as smart phones, tablet computers, computers, etc. In some embodiments, the peripheral device interface 344 includes a group of LEDs and / or display elements capable of displaying icons and / or other visual information. In some embodiments, the peripheral device interface 344 includes one or more tactile output generators 347 for generating tactile output (also known as tactile feedback), for example, via an external housing 362 (also known as a shell) of the electronic accessory box 342.

[0167] According to some embodiments, the electronic accessory box 342 includes an internal battery 309 (eg, a battery pack 310 for providing power to the various components of the electronic accessory box 342 and for powering one or more wearable audio output devices 301. Figure 3B) to charge an internal rechargeable battery 363. In some embodiments, the electronic accessory box 342 includes a battery charger 364 for charging the internal battery 363 when the battery charger 364 is connected to an external power source via a power connection port 365. In some embodiments, the internal battery 363 and / or the battery charger 364 are configured to charge the internal battery 309 (e.g., headphones or earbuds) of an audio output device (e.g., headphones or earbuds) when the audio output device is connected to (e.g., properly positioned in) the accessory charger 366. Figure 3B ) for charging. These components optionally communicate via one or more communication buses or signal lines 341.

[0168] In some embodiments, the outer housing 362, when closed (e.g., see Figure 4C ) has a range between 1.5 inches and 3 inches in a first dimension (e.g., width or height), a range between 1 inch and 2.5 inches in a second dimension (e.g., height or width), and a range between 0.5 inches and 1 inch in a third dimension (e.g., depth).

[0169] In some embodiments, the software components stored in memory 349 include an operating system 351 (or BIOS), a communication module (or instruction set) 352, an input module (or instruction set) 353, a graphics module (or instruction set) 354, a tactile feedback module (or instruction set) 356, and a headset control module 358. In addition, in some embodiments, memory 349 stores a device / global internal state 361, which includes one or more of the following: an active application state, which indicates which applications (if any) are currently active; and a sensor state, including information obtained from various sensors and other input devices 346 of the device.

[0170] Figure 3F Exemplary audio control by a wearable audio output device 301 is shown in accordance with some embodiments. Although the following examples are explained with respect to a specific implementation of a wearable audio output device including an earbud with an attached replaceable eartip (sometimes referred to as a silicon eartip or silicon seal), the methods, devices, and user interfaces described herein are equally applicable to specific implementations in which the wearable audio output device does not have an eartip but instead each has a portion of a body shaped for insertion into a user's ear. In some embodiments, when the wearable audio output device with an earbud capable of attaching a replaceable eartip is worn in the user's ear, the earbud and eartip together act as a physical barrier that blocks at least some ambient sound from the surrounding physical environment from reaching the user's ear. For example, in Figure 3F, a user wears the wearable audio output device 301 such that the head portion 303 and the ear tip 314 are in the user's left ear. The ear tip 314 extends at least partially into the user's ear canal. Preferably, when the head portion 303 and the ear tip 314 are inserted into the user's ear, a seal is formed between the ear tip 314 and the user's ear to isolate the user's ear canal from the surrounding physical environment. However, in some embodiments, the head portion 303 and the ear tip 314 together block some but not necessarily all ambient sounds in the surrounding physical environment from reaching the user's ear. Therefore, in some embodiments, a first microphone (or, in some embodiments, a first group of one or more microphones) 302-1 (and an optional third microphone 302-3) are located on the wearable audio output device 301 to detect ambient sounds in an area 316 of the physical environment surrounding the head portion 303 (e.g., outside the earplug) represented by a waveform 322. In some embodiments, (e.g., Figure 3C A second microphone (or, in some embodiments, a second set of one or more microphones) 302-2 of the microphone 302 is located on the wearable audio output device 301 to detect any ambient sound represented by the waveform 324 that is not completely blocked by the head portion 303 and the ear tip 314 and can be heard in the area 318 within the user's ear canal. Therefore, in some cases where the wearable audio output device 301 does not generate a noise cancellation (also known as "inverted") audio signal to cancel (e.g., attenuate) ambient sound from the surrounding physical environment (as indicated by waveform 326-1), the ambient sound waveform 324 can be perceived by the user (as indicated by waveform 328-1). In some cases where the wearable audio output device 301 generates an inverted audio signal to cancel ambient sound (as indicated by waveform 326-2), the ambient sound waveform 324 is not perceptible to the user (as shown by waveform 328-2).

[0171] In some embodiments, the ambient sound waveform 322 is compared to the attenuated ambient sound waveform 324 (e.g., by the wearable audio output device 301 or a component of the wearable audio output device 301 such as the audio I / O logic component 312, or by an electronic device in communication with the wearable audio output device 301) to determine the passive attenuation provided by the wearable audio output device 301. In some embodiments, the amount of passive attenuation provided by the wearable audio output device 301 is taken into account when providing an inverted audio signal to cancel ambient sound from the surrounding physical environment. For example, the inverted audio signal waveform 326-2 is configured to cancel the attenuated ambient sound waveform 324, but not the unattenuated ambient sound waveform 322.

[0172] In some embodiments, the wearable audio output device 301 is configured to operate in one of a plurality of available audio output modes, such as an active noise control audio output mode, an active pass-through audio output mode, and a bypass audio output mode (sometimes also referred to as a noise control off audio output mode). In an active noise control mode (also referred to as "ANC"), the wearable audio output device 301 outputs one or more audio cancellation audio components (e.g., one or more inverted phase audio signals, also referred to as "audio cancellation audio components") to at least partially cancel ambient sound from the surrounding physical environment that would otherwise be perceived by the user. In an active pass-through audio output mode, the wearable audio output device 301 outputs one or more pass-through audio components (e.g., plays at least a portion of ambient sound from outside the user's ear received by, for example, microphone 302-1), so that the user can hear a greater amount of ambient sound from the surrounding physical environment than would otherwise be perceived by the user (e.g., a greater amount of ambient sound than would be heard using passive attenuation of the wearable audio output device 301 placed in the user's ear). In bypass mode, active noise management is turned off so that the wearable audio output device 301 outputs neither any audio cancellation audio component nor any pass-through audio component (e.g., so that any amount of ambient sound perceived by the user is due to the physical attenuation of the wearable audio output device 301).

[0173] Attention is now turned to an embodiment of a user interface (“UI”) that is optionally implemented on portable multifunction device 100 .

[0174] Figure 4A An exemplary user interface of an application menu on portable multifunction device 100 is shown according to some embodiments. A similar user interface is optionally implemented on device 300. In some embodiments, user interface 400 includes the following elements, or a subset or superset thereof:

[0175] One or more signal strength indicators of one or more wireless communications, such as cellular signals and Wi-Fi signals;

[0176] ·time;

[0177] Bluetooth indicator;

[0178] Battery status indicator;

[0179] A tray 408 with icons for commonly used applications, such as:

[0180] o an icon 416 of the phone module 138 labeled “Phone” which optionally includes an indicator 414 of the number of missed calls or voicemails;

[0181] o an icon 418 of the email client module 140 labeled “Mail”, which optionally includes an indicator 410 of the number of unread emails;

[0182] o An icon 420 labeled “Browser” of the browser module 147; and

[0183] o An icon 422 labeled "Music" of the video and music player module 152; and

[0184] Icons for other apps, such as:

[0185] o Icon 424 of IM module 141 labeled “Message”;

[0186] o Icon 426 labeled “Calendar” of calendar module 148;

[0187] o Icon 428 labeled “Photos” of the image management module 144;

[0188] o An icon 430 labeled “Camera” of the camera module 143;

[0189] o Icon 432 labeled “Online Video” of the online video module 155;

[0190] o Icon 434 labeled “Stock Market” of the stock market widget 149-2;

[0191] o an icon 436 labeled “MAP” of the map module 154;

[0192] o Icon 438 labeled “Weather” of the weather widget 149-1;

[0193] o An icon 440 labeled “Clock” of the alarm clock widget 149-4;

[0194] o an icon 442 labeled “Fitness Support” of the fitness support module 142;

[0195] o An icon 444 labeled "Notes" of the note module 153; and

[0196] o An icon 446 for a settings application or module that provides access to settings for the device 100 and its various applications 136.

[0197] It should be noted that Figure 4AThe icon labels shown in are exemplary only. For example, other labels are optionally used for various application icons. In some embodiments, the label of the corresponding application icon includes the name of the application corresponding to the corresponding application icon. In some embodiments, the label of a particular application icon is different from the name of the application corresponding to the particular application icon.

[0198] Figure 4B An exemplary user interface is shown on a device (e.g., device 300 in FIG. 3 ) having a touch-sensitive surface 451 (e.g., tablet or trackpad 355 in FIG. 3 ) that is separate from a display 450. Although many of the examples that follow will be given with reference to input on a touch-sensitive display system 112 (in which the touch-sensitive surface and display are combined), in some embodiments, the device detects input on a touch-sensitive surface that is separate from the display, such as Figure 4B In some embodiments, the touch-sensitive surface (e.g., Figure 4B 451) has a main axis (e.g., Figure 4B 453) corresponding to the main axis (for example, Figure 4B According to these embodiments, the device detects contact with touch-sensitive surface 451 at a location corresponding to a corresponding location on the display (e.g., Figure 4B 460 and 462) (e.g., in Figure 4B 460 corresponds to 468 and 462 corresponds to 470). Thus, on a touch-sensitive surface (e.g., Figure 4B 451) and a display of a multi-function device (e.g., Figure 4B 450 in the figure) is separated, the user input detected by the device on the touch-sensitive surface (e.g., contacts 460 and 462 and their movement) is used by the device to manipulate the user interface on the display. It should be understood that similar methods are optionally used for other user interfaces described herein.

[0199] Additionally, although the following examples are primarily given with reference to finger inputs (e.g., finger contacts, single-finger tap gestures, finger swipe gestures, etc.), it should be understood that in some embodiments, one or more of these finger inputs are replaced by input from another input device (e.g., mouse-based input or stylus input). For example, a swipe gesture is optionally replaced by a mouse click (e.g., instead of contact), followed by movement of the cursor along the path of the swipe (e.g., instead of movement of the contact). As another example, a tap gesture is optionally replaced by a mouse click when the cursor is over the location of the tap gesture (e.g., instead of detecting contact, followed by ceasing to detect contact). Similarly, when multiple user inputs are detected simultaneously, it should be understood that multiple computer mice are optionally used simultaneously, or a mouse and finger contact are optionally used simultaneously.

[0200] In some embodiments, the response of the device to the input detected by the device depends on a criterion based on the contact strength during the input. For example, for some "light press" inputs, the strength of the contact exceeding the first strength threshold during the input triggers a first response. In some embodiments, the response of the device to the input detected by the device depends on a criterion including both the contact strength during the input and a time-based criterion. For example, for some "deep press" inputs, as long as a delay time passes between satisfying the first strength threshold and satisfying the second strength threshold, the strength of the contact exceeding the second strength threshold greater than the first strength threshold of the light press during the input triggers a second response. The duration of the delay time is typically less than 200ms (milliseconds) (e.g., 40ms, 100ms, or 120ms, depending on the magnitude of the second strength threshold, where the delay time increases as the second strength threshold increases). The delay time helps avoid accidentally identifying a deep press input. As another example, for some "deep press" inputs, a period of reduced sensitivity will occur after reaching the first strength threshold. During this period of reduced sensitivity, the second strength threshold increases. This temporary increase in the second intensity threshold also helps avoid accidental deep press inputs.For other deep press inputs, the response to detecting the deep press input does not depend on time-based criteria.

[0201] In some embodiments, one or more of the input intensity thresholds and / or corresponding outputs vary based on one or more factors such as user settings, contact motion, input timing, application running, rate at which intensity is applied, number of simultaneous inputs, user history, environmental factors (e.g., ambient noise), focus selector position, etc. Example factors are described in U.S. patent applications 14 / 399,606 and 14 / 624,296, which are incorporated herein by reference in their entirety.

[0202] Figure 4C An example wireless accessory case 480 (eg, an electronic accessory case such as a wireless accessory case) is shown that includes physical indicia 482 (eg, engraved, embossed, and / or printed, painted, or otherwise applied indicia). Figure 3E The physical characteristics of the electronic accessory box 342). Figure 3D and Figure 3E The description provided is applicable to the wireless accessory box 480 described herein. The wireless accessory box 480 wirelessly communicates (e.g., pairs) with the wearable audio output devices 301-1 and 301-2, the audio source, and / or the display device (e.g., the multifunction device 100). According to some embodiments, Figure 4CIn some embodiments, the wearable audio output device 301 includes a physical marker 484 (e.g., physical marker 484-1 on wearable audio output device 301-1 and physical marker 484-2 on wearable audio output device 301-2). In some embodiments, the wireless accessory box 480 is configured to charge the wearable audio output device 301 (e.g., charge its internal battery) when the wearable audio output device 301 is positioned inside the wireless accessory box 480. In some embodiments, the wireless accessory box 480 includes a battery (e.g., battery 363, Figure 3E ), for supplying power to an internal battery of the wearable audio output device 301 (e.g., battery 309, Figure 3C ) and is used to power the functions of wireless accessory box 480 when wireless accessory box 480 is not connected to an external power source. In some embodiments, Figure 4C As shown in , wireless accessory case 480 has a hinged cover 486 to enclose wearable audio output devices 301 while they are inside wireless accessory case 480 and / or charging. According to some embodiments, the front of accessory case 480 includes holes for speaker 345, input device 346, physical indicia 482, and an indentation 488 for facilitating opening and closing of hinged cover 486. In some embodiments, one or more of speaker 345, input device 346, physical indicia 482 are located on different portions of wireless accessory case 480 (e.g., on the back, top, and / or bottom). In addition, although Figure 4C The wearable audio output device 301 is shown positioned within the wireless accessory box 480 with the corresponding ear tips facing away from each other (e.g., facing outward), but in some embodiments, the wearable audio output device 301 is positioned (e.g., mounted and / or coupled) differently within the wireless accessory box 480 (e.g., with the ear tips facing each other). For example, the wireless accessory box 480 optionally only charges the wearable audio output device 301 when the wearable audio output device 301 is positioned within the wireless accessory box 480 in a particular orientation.

[0203] User interface and associated processes

[0204] Attention is now turned to embodiments of a user interface ("UI") and associated processes that may be implemented on an electronic device (such as portable multifunction device 100, device 300, wearable audio output device 301, electronic accessory box 342, and / or wireless accessory box 480).

[0205] FIG. 5A to FIG. 5D An exemplary user interface for pairing an electronic accessory according to some embodiments is shown. FIG. 5E to FIG. 5RExample user interfaces and user interactions for adjusting the audio output of a wearable audio output device according to some embodiments are shown. Figure 5S to Figure 5BI Exemplary user interfaces and user interactions for various features associated with an electronic accessory box are shown according to some embodiments. Figures 5BJ to 5CB Exemplary user interfaces and user interactions for adjusting the audio output of a wearable audio output device according to some embodiments are shown. The user interfaces and device interactions in these figures are used to illustrate the processes described below, including FIG. 6A to FIG. 6C , 7A to 7C , FIG. 8A to FIG. 8D and 9A to 9C . For ease of explanation, some embodiments in the implementation scheme will be discussed with reference to operations performed on a device having a touch-sensitive display system 112. In such embodiments, the focus selector is optionally: a corresponding finger or stylus contact, a representative point corresponding to the finger or stylus contact (e.g., the center of gravity of the corresponding contact or a point associated with the corresponding contact), or the center of gravity of two or more contacts detected on the touch-sensitive display system 112. However, in response to detecting a contact on the touch-sensitive surface 451 when the user interface shown in the figure is displayed on the display 450 together with the focus selector, similar operations are optionally performed on a device having a display 450 and a separate touch-sensitive surface 451. In addition, similar operations are optionally performed on a device that communicates with a display generation component that is separate from the device (e.g., a wireless display device).

[0206] FIG. 5A to FIG. 5D An exemplary user interface for pairing an electronic accessory according to some embodiments is shown.

[0207] Figure 5A 4 shows a user interface 400 on a touch-sensitive display system 112 of device 100. In some embodiments, (e.g., while displaying user interface 400) device 100 periodically and repeatedly listens for wireless broadcast signals (e.g., pairing requests) from one or more peripheral devices (e.g., wearable audio output devices 301-1 and 301-2 and wireless accessory box 480) for pairing the peripheral devices with device 100. In some embodiments, as FIG. 5A to FIG. 5D As shown in , device 100 is able to detect a pairing request from a peripheral device when the peripheral device is within a threshold distance 502 of device 100, and is unable to detect a pairing request from the peripheral device when the peripheral device is outside the threshold distance 502. Figure 5A At the bottom of Figure 5A1 shows an exemplary spatial relationship (e.g., physical distance) between device 100 and wearable audio output devices 301-1 and 301-2 and wireless accessory box 480, where wearable audio output devices 301-1 and 301-2 and wireless accessory box 480 are outside of threshold distance 502 of device 100. In contrast, Figure 5B Wearable audio output devices 301-1 and 301-2 and wireless accessory case 480 (shown and hereinafter collectively referred to as earbud set 503) are shown within a threshold distance 502 of device 100, wherein the device is able to detect pairing requests from these peripheral devices.

[0208] Figure 5B Shown in Figure 5A An exemplary user interface 504 (e.g., window) for initiating pairing of the device 100 with the peripheral device (e.g., wearable audio output device 301-1) or the group of peripheral devices (e.g., earbud group 503) is displayed after the user interface 400 in and in some embodiments in response to detecting movement of the peripheral device (e.g., wearable audio output device 301-1) or the group of peripheral devices (e.g., earbud group 503) from outside the threshold distance 502 to within the threshold distance 502. Figure 5B , the device 100 detects a signal from a peripheral device (e.g., Figure 5A The wearable audio output device 301-1 and Figure 5B In some embodiments, in response to detecting a pairing request from the wearable audio output device 301-1, the device 100 determines whether the wearable audio output device 301-1 meets the coupling criteria. Figure 5B In the example shown, the coupling criteria are met when the earbud (e.g., wearable audio output device 301-1) is placed in an earbud box (e.g., wireless accessory box 480) and / or is electrically coupled to the earbud box (e.g., forming earbud set 503). After the device 100 determines that the wearable audio output device 301-1 meets the coupling criteria (e.g., in response to the device 100 determining that the wearable audio output device 301-1 meets the coupling criteria), the device 100 displays the window 504-1 overlying the Figure 5A Window 504-1 includes a representation 505 of the earbud set 503 and a button 507 (labeled "Connect") that, when activated by user input, initiates a connection between the device 100 and a peripheral device (e.g., Figure 5AWindow 504-1 also includes a representation 506 of physical indicia 482 on wireless accessory box 480. In some embodiments, the user interface shown in window 504-1 is instead displayed on the entirety (or substantially all, e.g., greater than 95%, 96%, 97%, 98%, or 99%) of touch-sensitive display system 112. Device 100 also displays an exit button 508 that, when activated by user input such as a tap gesture, causes window 504-1 to stop being displayed so that the user can perform other operations on device 100. In some embodiments, where exit button 508 is accompanied by another user interface described herein (e.g., a user interface that is part of a usage tutorial), exit button 508 causes the user interface to stop being displayed when activated by user input.

[0209] FIG. 5C to FIG. 5D Shows from Figure 5B Specifically, Figure 5C An input 510 (e.g., a tap gesture) on button 507 in window 504-1 is shown. In response to detecting input 510, device 100 initiates pairing of device 100 with the peripheral device of earbud set 503. Figure 5D , after the device 100 has been paired with the peripheral device of the earbud set 503, the device 100 displays an indication 512 (labeled "Connected") in the window 504-2 to indicate that the device 100 is paired with (e.g., communicatively connected to) the earbud set 503. In some embodiments, the device 100 displays a button in the window 504-2 that, when activated, causes the device 100 to proceed from the pairing process to a usage tutorial for the wearable audio output device 301.

[0210] FIG. 5E to FIG. 5R Example user interfaces and user interactions for adjusting the audio output of a wearable audio output device according to some embodiments are shown. Figure 5E and Fig. 5F An exemplary user interface 514 is shown illustrating available user interactions of the wearable audio output device 301. Specifically, Figure 5E User interface 514-1 is shown having a representation 513 of the wearable audio output device and a user gesture 517 for decreasing the volume of the audio output at the wearable audio output device 301 (e.g., sliding along the handle portion 305 away from the head portion 303, see Figure 3B ) icon. Fig. 5FUser interface 514-2 is shown having a representation 513 of the wearable audio output device and an illustration of a user gesture 519 (e.g., sliding along handle portion 305 toward head portion 303) for increasing the volume of the audio output at wearable audio output device 301. Figure 5E and Fig. 5F In the example of , the representation 513 of the wearable audio output device includes a physical marker 484 (e.g., Figure 4C ) indicates 515.

[0211] Figure 5G to Figure 5R An exemplary user interaction with a wearable audio output device 301 for controlling audio output is shown according to some embodiments. Figure 5G Wearable audio output devices 301-1 and 301-2 are shown inserted into respective ears 516-1 and 516-2 of a user and having respective output volume levels 518-1 and 518-2. For example, wearable audio output device 301 is configured to output audio via respective speakers 306 (e.g., Figure 3B ) plays back audio content at an output volume level 518.

[0212] In some embodiments, each wearable audio output device 301 includes a handle portion 305 (eg, referring to FIG. 1 ) that a user can use to provide input to the wearable audio output device. Figure 3B In some embodiments, handle portion 305 is or includes an input device (e.g., input device 308) that responds to user input applied to handle portion 305. In some embodiments, the input device includes a touch input (such as a Figure 5H In some embodiments, the input device includes a pressure-sensitive input device that responds to a pressure input applied to the handle portion 305 when the handle portion 305 is held between two fingers and squeezed, such as Fig.5O As shown. Figure 5H Only one wearable audio output device is shown in the figure, but a person of ordinary skill in the art will recognize that the wearable audio output device 301-1 may have a similar structure with a corresponding handle, and the same functionality described herein with reference to the wearable audio output device 301-2 may also be obtained using the wearable audio output device 301-1 and its corresponding handle.

[0213] FIG. 5H to FIG. 5IAn input 520 received at the handle portion 305 of the wearable audio output device 301-2 is shown. The input 520 has an initial position 520-a and an end position 520-b. For example, the input 520 is a sliding gesture toward the head portion 303 detected based on determining that the user's finger contact movement is greater than a predefined amplitude. In some embodiments, the handle portion 305 includes a set of capacitive sensors that are arranged to detect the movement of the contact along the length of the handle portion 305. In some embodiments, the handle portion 305 includes surgery, and the housing has one or more physically distinguished portions at positions corresponding to the set of capacitive sensors (e.g., to guide the user's fingers during movement). In some embodiments, a user's finger contact movement that is less than a predefined amplitude does not change the volume of the audio output; for example, if the amount of the user's finger contact movement is less than the predefined amplitude, the user's finger contact movement is ignored.

[0214] Figure 5J In response to input 520, Figure 5G In response to input 520 (e.g., and based on determining that input 520 is a sliding gesture moving toward head portion 303), wearable audio output device 301 adjusts the volume of the audio output to corresponding output levels 522-1 and 522-2. In some embodiments, when the volume of the audio output is adjusted, audio feedback 524 is provided at each wearable audio output device 301 (e.g., an audible tone is output to indicate an increase in the volume level). In some embodiments, audio feedback 524 is adjusted based on one or more characteristics of input 520 (e.g., the speed of the sliding gesture and / or the distance of the sliding gesture). In some embodiments, audio feedback 524 includes a tone amount corresponding to the amount of volume change due to input 520 (e.g., a tone for each increment of volume level change). In some embodiments, audio feedback (e.g., the same or different from audio feedback 524) is provided to indicate to the user that the output volume is at a maximum or minimum level (e.g., as defined in the software of the wearable audio output device 301). In some embodiments, wearable audio output device 301 includes one or more tactile output generators, optionally located in handle portion 305. In some such embodiments, the output activates a tactile output to indicate that input 520 is detected.

[0215] Figure 5K to Figure 5L An input 526 received at the handle portion 305 of the wearable audio output device 301-1 is shown. The input 526 has an initial position 526-a and an end position 526-b. For example, the input 526 is a sliding gesture away from the head portion 303 detected based on determining that the user's finger contact movement is greater than a predefined amplitude.

[0216] Figure 5M In response to input 526, Figure 5J In response to input 526 (e.g., and based on determining that input 526 is a sliding gesture moving away from head portion 303), wearable audio output device 301 adjusts the volume of the audio output to corresponding output levels 528-1 and 528-2. In some embodiments, audio feedback 530 is provided at each wearable audio output device 301 (e.g., an audible tone is output to indicate a decrease in volume level). In some embodiments, audio feedback 530 includes an amount of tone corresponding to the amount of volume change due to input 526 (e.g., a tone for each increment of volume level change). In some embodiments, audio feedback 530 is different from audio feedback 524 (e.g., so that the user can distinguish between volume increase and volume decrease).

[0217] Figure 5N Wearable audio output devices 301 - 1 and 301 - 2 are shown inserted into respective ears 516 - 1 and 516 - 2 of a user. For example, wearable audio output device 301 is configured to play back audio content via respective speakers 306 . Figure 5N Also shown is an exemplary user interface 532 that includes a representation of an album 531 (e.g., an album with audio content) and audio playback controls, such as a previous button for moving to the previous track or rewinding the audio being played, a play / pause button 533 for toggling audio playback on and off, and a next button for moving to the next track or fast-forwarding through the audio being played. According to some embodiments, volume controls are also displayed simultaneously with (e.g., below) the audio playback controls. Figure 5N , playback of media content from album 531 is paused, as indicated by the display of play button 533. In some embodiments, user interface 532 is presented at an electronic device (e.g., multifunction device 100 or device 300) that is communicatively coupled to wearable audio output device 301. In some embodiments, functionality associated with user interface 532 is available to the user via input and / or gestures at wearable audio output device 301 (e.g., whether or not user interface 532 is presented to the user).

[0218] Fig.5O Input 534 is shown received at handle portion 305 of wearable audio output device 301-1. Input 534 is a different type of input than input 526, for example, a non-slide gesture such as a tap (e.g., an input with a contact duration less than a threshold duration), a press (e.g., an input with a contact intensity less than a threshold intensity), and / or a squeeze gesture. Figure 5P In response to input 534, Figure 5NIn response to input 534 (e.g., and based on determining that input 534 is a single squeeze gesture), playback of media content from album 531 is active (e.g., unpaused and playing), as indicated by Figure 5P A pause button 535 is displayed instead of a play button 533 ( Figure 5N ) indicated. In some embodiments, audio feedback 536 is provided at wearable audio output device 301-1. For example, audio feedback 536 is provided at the wearable audio output device that detects input 534, and is not provided at another wearable audio output device. In some embodiments, audio feedback 536 includes one or more words (e.g., the terms "unpause" or "play"). In some embodiments, audio feedback 536 includes one or more tones and / or beeps. In some embodiments, audio feedback 536 is different from audio feedback 530 and audio feedback 524 (e.g., so that the user can distinguish volume changes from playback changes).

[0219] Figure 5Q Input 538 is shown received at handle portion 305 of wearable audio output device 301-1. Input 538 is a different type of input than input 534, such as a long press input (e.g., an input with a contact duration greater than a threshold duration), a deep press input (e.g., an input with a contact intensity greater than a threshold intensity), and / or a long (and / or deep) squeeze input (e.g., a squeeze gesture that includes maintaining a squeeze of handle portion 305 for at least a threshold amount of time).

[0220] Figure 5R In response to input 538, Figure 5P In response to input 538 (e.g., and based on determining that input 538 is a long press and / or long squeeze gesture), the wearable audio output device 301 enables (e.g., switches to or activates) an active pass-through mode (sometimes also referred to as a transparent mode). In the active pass-through audio output mode, the wearable audio output device 301 outputs one or more pass-through audio components (e.g., plays at least a portion of the ambient sound from outside the user's ear received by, for example, microphone 302-1), so that the user can hear a greater amount of ambient sound from the surrounding physical environment than would otherwise be perceived by the user (e.g., a greater amount of ambient sound than would be heard by passive attenuation of the wearable audio output device 301 placed in the user's ear). In some embodiments, a squeeze gesture is a gesture involving pressing something (e.g., handle portion 305) between two or more fingers. In some embodiments, the squeeze is maintained for less than a threshold amount of time (e.g., 0.5 seconds, 1 second, 1.5 seconds, or 2 seconds). In some embodiments, a long squeeze gesture is a squeeze gesture that is maintained for at least a threshold amount of time.

[0221] In some embodiments, in conjunction with changing the output mode, the wearable audio output device 301-1 outputs an audible tone and / or one or more words (e.g., audio feedback 540) to indicate that the audio output mode has changed. In some embodiments, the wearable audio output device 301 transitions from a bypass mode or an ANC (active noise cancellation) mode to an active pass-through mode in response to input 538. In some embodiments, the wearable audio output device 301 transitions between modes in a predefined order to the next audio output mode, which in this example is an active pass-through mode, as indicated by audio feedback 540. In some embodiments, the predefined order of the audio output modes is configurable using a settings menu.

[0222] In some embodiments, the wearable audio output device 301 includes one or more tactile output generators, optionally located in the handle portion 305. In some such embodiments, a tactile output is output to indicate detection of a user input and / or activation of a function of the wearable audio output device 301, e.g., in addition to or in lieu of providing audio feedback. In some embodiments, the tactile outputs for different functions and / or user inputs have different tactile output amplitudes, frequencies, and / or patterns (e.g., so that a user can distinguish between detection of different user inputs and / or activation of different functions).

[0223] Figure 5S to Figure 5BI Exemplary user interfaces and user interactions for various features associated with an electronic accessory box are shown according to some embodiments.

[0224] Figure 5S An exemplary spatial relationship (e.g., physical distance) between device 100 and wireless accessory boxes 480-1, 480-2, and 480-3 is shown, where wireless accessory boxes 480-1, 480-2, and 480-3 are located within a threshold distance 502 of device 100, e.g., where device 100 is able to detect pairing requests from peripherals and other devices. Figure 5S In the example, wireless accessory box 480-1 includes physical indicia 482-1, wireless accessory box 480-2 includes physical indicia 482-2 that is different from physical indicia 482-1, and wireless accessory box 480-3 does not include physical indicia (e.g., personalized physical indicia, such as digital engraving and / or embossing).

[0225] Figure 5T For example, in Figure 5A An exemplary user interface is shown after user interface 400 in FIG. 1 and in some embodiments in response to detecting a pairing request from wireless accessory box 480-1 to initiate pairing of device 100 with wireless accessory box 480-1. Figure 5T, device 100 detects a pairing request from wireless accessory box 480-1 when within threshold distance 502. Device 100 displays an overlay on Figure 5A 400 . Window 504-1 includes a representation 542-1 of wireless accessory box 480-1 and a button 507 (labeled "Connect"). Window 504-1 also includes a representation 544-1 of a physical marker 482-1 on wireless accessory box 480-1. In some embodiments, representation 542-1 is a three-dimensional representation of wireless accessory box 480-1. In some embodiments, representation 542-1 includes one or more animated movements (e.g., rotation, shifting, and / or lateral movement) as indicated by arrow 543. In some embodiments, representation 542-1 is capable of being moved by a user (e.g., in response to detecting a slide or drag gesture at window 504-1).

[0226] Figure 5U For example, in Figure 5A An exemplary user interface is shown after user interface 400 in FIG. 1 and in some embodiments in response to detecting a pairing request from wireless accessory box 480-2 to initiate pairing of device 100 with wireless accessory box 480-2. Figure 5U , device 100 detects a pairing request from wireless accessory box 480-2 when within threshold distance 502. Device 100 displays an overlay on Figure 5A 400. Window 504-1 includes a representation 542-2 of wireless accessory box 480-2 and button 507. Window 504-1 also includes a representation 544-2 of physical marking 482-2 on wireless accessory box 480-2. In this way, representations 544-1 and 544-2 enable or help the user to distinguish between wireless accessory box 480-1 and wireless accessory box 480-2.

[0227] Figure 5V For example, in Figure 5A An exemplary user interface is shown after user interface 400 in FIG. 1 and in some embodiments in response to detecting a pairing request from wireless accessory box 480-3 to initiate pairing of device 100 with wireless accessory box 480-3. Figure 5V , device 100 detects a pairing request from wireless accessory box 480-3 when within threshold distance 502. Device 100 displays an overlay on Figure 5A Window 504-1 on user interface 400 of FIG. Window 504-1 includes representation 542-3 of wireless accessory box 480-3 and button 507. Wireless accessory box 480-3 does not include physical marker 482, and therefore, window 504-1 does not include representation 544 of the physical marker.

[0228] Figure 5W An exemplary user interface 550 for adding a physical tag to an electronic accessory (e.g., wireless accessory box 480) is shown. In some embodiments, the electronic accessory is a set of headphones, a smart watch, a discoverable electronic device, a stylus, or an accessory box. In some embodiments, the physical tag is or includes a tag that is engraved, embossed, and / or printed, painted, or otherwise applied. In some embodiments, the user interface 550 is presented to the user as part of the purchase (or update) process of the electronic accessory. The user interface 550 includes a representation 552 of the electronic accessory, which includes a preview 554 of the physical tag selected (e.g., entered or accepted) by the user. User interface 550 also includes: an input portion 556 for accepting user input, such as input 558 (e.g., text and / or selections from portion 560 (e.g., emoticons and / or symbols)); a button 562 (labeled "Save"), which saves and / or confirms input 558 as a physical indicia of the electronic attachment when activated by user input; and a button 564 (labeled "Cancel"), which removes input 558 and / or closes user interface 550 (e.g., returns to a previous user interface or advances to a new or next user interface) when activated by user input. In some embodiments, user interface 550 includes an option (e.g., a button or other affordance) to change the font of text input when activated by the user. In some embodiments, user interface 550 includes an option (e.g., a button or other affordance) that allows the user to enter handwritten input (e.g., a signature, handwritten text, and / or a drawing) when activated by the user.

[0229] Figure 5X Wireless accessory box 480 and associated wearable audio output device 301 are shown within a threshold distance of device 100 . Figure 5X The wireless accessory box 480 in includes the speaker 345 (e.g., and associated holes) and the physical indicia 574. The device 100 includes a user interface 570 (e.g., a lock and / or login screen). Figure 5X , wireless accessory box 480 is open (eg, lid 367 is facing upward), and wearable audio output device 301 is inserted into box 480.

[0230] Figure 5Y 480 in response to the occurrence of a condition associated with the wireless accessory box 480 (e.g., the closure of the cover 367). Figure 5XIn response to closing of cover 367, wearable audio output device 301 begins charging, audio feedback 585 is optionally provided via speaker 345 to indicate to the user that wearable audio output device 301 is charging, and user interface 576 is presented on device 100 (e.g., optionally displayed on a portion of another user interface (such as user interface 570)). In some embodiments, wearable audio output device 301 begins charging in response to being inserted (e.g., installed and / or secured) within wireless accessory box 480. In some embodiments, audio feedback 585 includes one or more tones and / or one or more spoken terms. User interface 576 includes a representation 578 of wireless accessory box 480 (including a representation 579 of physical indicia 574) and a representation 580 of wearable audio output device 301. User interface 576 also includes an indication 582 of the charging status of wearable audio output device 301. Figure 5Y In the example shown, the charge level of the wearable audio output device 301 is 20%. The user interface 576 also includes an indication 584 of the charging status of the case 480. Figure 5Y In the example shown, the charge level of cartridge 480 is 50%.

[0231] In addition, Figure 5Y In the example shown, optimization of charging of the wearable audio output device 301 is enabled, as indicated by an indication 586 (e.g., text “Charging Optimization”) below the representation 580 of the wearable audio output device 301. In some embodiments, charging of the wearable audio output device 301 via the case 480 is performed under the control of the device 100 (e.g., when the device 100 is in communication with the case 480 and / or the wearable audio output device 301). For example, the device 100 sends an instruction to the case 480 and / or the wearable audio output device 301 to initiate charging of the wearable audio output device 301 via the case 480, and optionally limits charging to a threshold charge level in accordance with enabled optimized charging, or alternatively allows full charging (e.g., to the full storage capacity of the wearable audio output device 301) in accordance with disabled optimized charging. The user interface 576 also includes an optimized charging override button 588 (e.g., labeled “Fully Charge Now”) that, when activated, disables optimization of charging of the wearable audio output device 301 and initiates charging of the wearable audio output device 301 to a fully charged state if other charging criteria are met. Figure 5Y In the example shown, optimized charging for case 480 is not enabled (e.g., unavailable or disabled), and therefore neither an optimized charging indication nor any optimized charging overlay button is displayed for case 480 (as compared to optimized charging for wearable audio output device 301).

[0232] Figure 5Z 4 shows a wireless accessory box 480 and an associated wearable audio output device 301-1 within a threshold distance of the device 100. Figure 5Z , the wireless accessory box 480 is open (eg, the lid 367 is facing upward), and one wearable audio output device 301 (wearable audio output device 301 - 1 ) is inserted into the box 480 .

[0233] Figure 5AA 480 in response to the occurrence of a condition associated with the wireless accessory box 480 (e.g., the closure of the cover 367). Figure 5Z In response to the closing of the lid 367, audio feedback 587 is provided via the speaker 345, thereby indicating to the user that only one wearable audio output device 301 is within the case 480, and a user interface 590 is presented on the device 100 (e.g., optionally displayed on a portion of another user interface (such as user interface 570) (see Figure 5X )). In some embodiments, audio feedback 587 includes one or more tones and / or one or more spoken terms. In some embodiments, audio feedback 587 is different from audio feedback 585 (e.g., includes different tones, words, and / or frequencies) so that the user can distinguish between these conditions. User interface 590 includes a representation 592 of wireless accessory box 480 (including a representation 594 of physical mark 574) and a representation 596 of wearable audio output device 301-1. User interface 576 also includes a notification 598 that box 480 only includes one wearable audio output device 301.

[0234] Figure 5AB A wireless accessory box 480 and an associated wearable audio output device 301 are shown within a threshold distance of the device 100. Figure 5AB , wireless accessory case 480 is closed (e.g., lid 367 is down), and wearable audio output device 301 is inserted into case 480. Figure 5AB In the example of , wearable audio output device 301 includes physical tag 575 and wireless accessory box 480 includes physical tag 574.

[0235] Figure 5AC 480 in response to the occurrence of a condition associated with the wireless accessory box 480 (e.g., the opening of the cover 367). Figure 5ABIn response to opening the lid 367, audio feedback 5001 is provided via the speaker 345, thereby indicating to the user the charging status of the wearable audio output device 301, and the user interface 5002 is presented on the device 100 (e.g., optionally displayed on a portion of another user interface (such as the user interface 570)). In some embodiments, the audio feedback 5001 includes one or more tones and / or one or more spoken terms. In some embodiments, the audio feedback 5001 is different from at least one of the audio feedbacks 585 and 587 (e.g., includes different tones, words, and / or frequencies) so that the user can distinguish between these conditions. The user interface 5002 includes a representation 5012 of the wireless accessory box 480 (including a representation 5014 of the physical mark 575) and a representation 5006 of the wearable audio output device 301 (including a representation 5008 of the physical mark 574). The user interface 5002 also includes an indication 5004 of the charging status of the wearable audio output device 301. In Figure 5AC In the example shown, the charge level of the wearable audio output device 301 is 40%. The user interface 5002 also includes an indication 5010 of the charging status of the case 480. Figure 5AC In the example shown, the charge level of cartridge 480 is 10%.

[0236] Figure 5AD Transitions are shown that occur in response to the occurrence of a condition associated with the wireless accessory box 480 (e.g., the opening of the cover 367). Figure 5AD In the example of , the wireless accessory box 480 is empty (e.g., does not contain any wearable audio output device). In response to opening the lid 367, audio feedback 5018 is provided via the speaker 345, thereby indicating the charging state of the wireless accessory box 480 to the user (e.g., 15% power). For example, when the box 480 is open and the wearable audio output device is inside, audio feedback indicating the charging state of the wearable audio output device is provided. In this example, when the box 480 is open but empty (e.g., there is no wearable audio output device inside), audio feedback indicating the charging state of the box is provided. In some embodiments, the audio feedback 5018 includes one or more tones and / or one or more spoken terms (e.g., recorded and / or simulated sound output). In some embodiments, the audio feedback 5018 is different from at least one of the audio feedback 585, 587, and 5001 (e.g., including different tones, words, and / or frequencies) so that the user can distinguish between these conditions.

[0237] Figure 5AEShows a transition in response to the occurrence of a condition associated with the wireless accessory case 480 (e.g., insertion of the wearable audio output device 301-1). In response to the insertion of the wearable audio output device 301-1, audio feedback 5020 is provided via the speaker 345 to indicate to the user that the wearable audio output device 301-1 has been correctly inserted (e.g., electrically coupled to the wireless accessory case 480). In some embodiments, the audio feedback 5020 includes one or more tones and / or one or more verbal terms. In some embodiments, the audio feedback 5020 is different from at least one of the audio feedbacks 585, 587, 5001, and 5018 (e.g., includes different tones, words, and / or frequencies) such that the user can distinguish between these conditions.

[0238] Figure 5AF Shows a wireless accessory case 480 including a speaker 345 (e.g., and associated holes), an input device 346, and a physical marker 574. Figure 5AF Also shows a user input 5024 (e.g., a tap or press input) at the input device 346. Figure 5AG Shows a transition from Figure 5AF in response to detecting the user input 5024. In response to detecting the user input 5024, audio feedback 5026 is provided via the speaker 345 to indicate to the user that the wireless accessory case 480 (and optionally the wearable audio output device inserted into the case 480) is pairing with an electronic device (e.g., device 100).

[0239] Figure 5AG Also shows audio feedback 5028 provided via the speaker 345 to indicate to the user that the wireless accessory case 480 (and optionally the wearable audio output device inserted into the case 480) has completed pairing with the electronic device (e.g., in response to the user activating Figure 5B the button 507 in). In some embodiments, the audio feedback 5026 and / or 5028 includes one or more tones and / or one or more verbal terms. In some embodiments, the audio feedback 5028 is different from 5026 (e.g., includes different tones, words, and / or frequencies) such that the user can distinguish between these conditions.

[0240] Figure 5AHAudio feedback 5029 provided via speaker 345 is shown indicating to the user that wireless accessory box 480 has failed to pair with the electronic device (e.g., due to device mismatch, permission settings, and / or connection issues). In some embodiments, audio feedback 5029 includes one or more tones and / or one or more spoken terms. In some embodiments, audio feedback 5029 is different from at least one of audio feedback 5026 and 5028 (e.g., includes a different tone, word, and / or frequency) so that the user can distinguish between these conditions.

[0241] Figure 5AI Wireless accessory box 480 is shown including speaker 345 (eg, and associated aperture), input device 346 , and physical indicia 574 . Figure 5AI Also shown is user input 5030 (e.g., a long and / or deep press input) at input device 346. In some embodiments, Figure 5AF User input 5024 in is a first type of input, and user input 5030 is a second type of input different from the first type. Figure 5AI Also shown is the process of resetting the system from the factory in response to detecting user input 5030 (e.g., initiation of a factory reset). Figure 5AF In response to detecting user input 5030, audio feedback 5032 is provided via speaker 345, thereby indicating to the user that wireless accessory box 480 (and optionally a wearable audio output device inserted into box 480) is initiating a factory reset. In some embodiments, wireless accessory box 480 provides additional audio feedback (e.g., different from audio feedback 5032) based on the completion of the factory reset.

[0242] Figure 5AJ Device 100 and wireless accessory box 480 are shown according to some embodiments. Device 100 is shown, for example, in Figure 5A 400 and in some embodiments in response to activation of an accessory location user interface element (e.g., an icon or button). User interface 5035 corresponds to wireless accessory box 480 and includes label 5036 ("Max's Charging Case") and button 5038, which, when activated by the user, causes a sound to be output at wireless accessory box 480.

[0243] Figure 5AKA user input 5040 detected at button 5038 and a corresponding audio output 5042 at wireless accessory box 480 are shown. In some embodiments, in response to detecting user input 5040 at a location corresponding to button 5038, wireless accessory box 480 provides audio output 5042 via speaker 345. In some embodiments, audio output 5042 includes one or more tones and / or one or more spoken terms. In some embodiments, wireless accessory box 480 generates audio output 5042 multiple times. For example, activation of button 5038 toggles audio output 5042, and the process repeats until the user activates button 5038 again (or the user activates another affordance to disable audio output 5042, or another predefined user input is detected at wireless accessory box 480, such as a button press or lid movement). In some embodiments, wireless accessory box 480 generates audio output 5042 a preset number of times (e.g., 5, 10, or 20) in response to activation of button 5038.

[0244] Figure 5AL Wireless accessory box 480 is shown with wearable audio output devices 5046 and 5050 inserted therein. Figure 5AL The wireless accessory box 480 in FIG. 4 includes a speaker 345 (e.g., and associated holes), an input device 346, and a physical marker 574. A wearable audio output device 5046 includes a physical marker 5048 (e.g., the same as or similar to physical marker 574), and a wearable audio output device 5050 includes a physical marker 5052 that is different from physical marker 5048. Figure 5AL , wireless accessory box 480 is open (eg, lid 367 is upward).

[0245] Figure 5AM 480 in response to the occurrence of a condition associated with the wireless accessory box 480 (e.g., the closure of the cover 367). Figure 5ALIn response to the closing of the cover 367, one or more warning alerts are generated, such as providing audio feedback 5054 via the speaker 345, thereby indicating to the user that the wearable audio output device 301 does not match, and / or a user interface 5056 is presented on the device 100 (e.g., optionally displayed on a portion of another user interface (such as the user interface 570)). In some embodiments, the audio feedback 5054 includes one or more tones and / or one or more verbal terms. In some embodiments, the audio feedback 5054 includes information about the type of mismatch (e.g., different owners and / or different versions) and / or information about which wearable audio output device is different. The user interface 5056 includes a representation 5058 of the wireless accessory box 480 (including a representation 5060 of the physical mark 5048), a representation 5062 of the wearable audio output device 5046 (including a representation 5064 of the physical mark 574), and a representation 5063 of the wearable audio output device 5050 (including a representation 5065 of the physical mark 5052). User interface 5056 also includes notification 5057 that wearable audio output device 5046 has a different owner (e.g., as indicated by physical indicia 5052) than wearable audio output device 5050 and / or wireless accessory case 480. In some embodiments, the owner of the device is based on the account to which the device is linked or associated (e.g., devices linked to the same account are considered to have the same owner). In some embodiments, the owner of the device is based on the identity of the person who purchased the device.

[0246] Figure 5AN and Figure 5AO Similar to Figure 5AL and Figure 5AM , the difference is Figure 5AN and Figure 5AO In some embodiments, wearable audio output devices 5046 and 5050 do not include physical markings (e.g., physical markings 5048 and 5052 are not included) to distinguish them from each other. In some embodiments, wearable audio output devices 5046 and 5050 do not include personalized physical markings (e.g., markings set, selected, and / or accepted by a user). In some embodiments, user interface 5056 includes an indication 5086 as to which wearable audio output device is associated with an owner other than wireless accessory box 480. In some embodiments, notification 5057 indicates which wearable audio output device is associated with an owner other than wireless accessory box 480.

[0247] Figure 5AP Wireless accessory box 480 is shown with wearable audio output devices 5046 and 5070 inserted therein. Figure 5APThe wireless accessory box 480 in FIG. 4 includes a speaker 345 (e.g., and associated holes), an input device 346, and a physical marker 574. The wearable audio output device 5046 includes a physical marker 5048 (e.g., the same as or similar to the physical marker 574), and the wearable audio output device 5070 includes a physical marker 5072 (e.g., the same as the physical marker 5048). Figure 5AP , wireless accessory box 480 is open (eg, lid 367 is upward).

[0248] Figure 5AQ 480 in response to the occurrence of a condition associated with the wireless accessory box 480 (e.g., the closure of the cover 367). Figure 5AP In response to the closing of the cover 367, audio feedback 5074 is provided via the speaker 345, thereby indicating to the user that the wearable audio output device 301 does not match, and the user interface 5076 is presented on the device 100 (e.g., optionally displayed on a portion of another user interface (such as the user interface 570)). In some embodiments, the audio feedback 5074 includes one or more tones and / or one or more spoken terms. In some embodiments, the audio feedback 5074 includes information about the type of mismatch (e.g., different owners and / or different versions) and / or information about which wearable audio output device is different. The user interface 5076 includes a representation 5078 of the wireless accessory box 480 (including a representation 5080 of the physical mark 5048), a representation 5082 of the wearable audio output device 5046 (including a representation 5084 of the physical mark 574), and a representation 5083 of the wearable audio output device 5070 (including a representation 5085 of the physical mark 5072). User interface 5056 also includes notification 5077 that wearable audio output device 5046 has a different version (e.g., a different hardware and / or software version) than wearable audio output device 5070 and / or wireless accessory box 480. In some embodiments, user interface 5056 includes an indication 5087 of the version associated with one or both of wearable audio output devices 5046 and 5070 in wireless accessory box 480. In some embodiments, the wearable audio output devices having different versions are due to the wearable audio output devices being different generations of devices.

[0249] Figure 5AR Device 100 and wireless accessory box 480 are shown according to some embodiments. Device 100 is shown, for example, in Figure 5A400 in the example embodiment and in some embodiments, in response to activation of an accessory user interface element (e.g., an icon or button). User interface 5090 corresponds to wireless accessory case 480 (labeled “Max’s Charging Case”) and includes volume control element 5091 that adjusts the volume of the audio output of speaker 345 upon user interaction. Wireless accessory device 480 is within a threshold communication distance of device 100 and has a communication signal provided by Figure 5AR The volume level indicated by volume level 5094 in the user interface 5090, where volume level 5094 corresponds to volume level indicator 5092 in the user interface 5090. Figure 5AS User input 5095 is shown detected at volume control element 5091. Input 5095 is as follows: Figure 5AS . The swipe gesture indicated by the downward arrow in the

[0250] Figure 5AT shows that in response to input 5095 from Figure 5AR In response to input 5095 (e.g., and based on determining that input 5095 is a sliding gesture moving in a direction toward a lower volume (e.g., a downward slide)), wireless accessory box 480 adjusts the volume of the audio output to volume level 5097 (e.g., a volume level lower than volume level 5094), which corresponds to volume level indicator 5096 in user interface 5090. Figure 5AU User input 5098 is shown detected at volume control element 5091. In some embodiments, input 5098 is a tap or press input.

[0251] Figure 5AV shows that in response to input 5098 from Figure 5AT In response to input 5098 (e.g., and based on determining that input 5098 is a tap gesture at a location corresponding to a zero volume level on volume control element 5091), wireless accessory box 480 disables audio output of speaker 345, as indicated by volume indicator 5100 corresponding to volume level indicator 5099 of user interface 5090. In some embodiments, input 5098 (e.g., a tap or press gesture) causes wireless accessory box 480 to switch audio output of speaker 345 (e.g., regardless of the location of input 5098 on volume control element 5091). In some embodiments, input 5098 is a press gesture, and the volume level of wireless accessory box 480 is adjusted based on the location and / or duration of the press gesture.

[0252] Figure 5AW Device 100 is shown including volume buttons 5104 (eg, volume up button 5104 - 1 and volume down button 5104 - 2 ) and ring switch 5102 . Figure 5AW Also shown is a wireless accessory device 480 that is within a threshold communication distance of device 100 . Figure 5AW Also shown are an indicator 5106 of the ring status of device 100 and an indicator 5108 of the volume level of wireless accessory device 480.

[0253] Figure 5AX Shows from Figure 5AW Specifically, Figure 5AX Device 100 is shown with a user's hand providing input 5110 at volume down button 5104-2 (e.g., to disable the ringer of device 100). Figure 5AX Input 5110 is shown provided at volume down button 5104-2, but input 5110 may similarly be provided at ringtone switch 5102 (eg, to toggle the state of the ringtone between enabled and disabled).

[0254] Figure 5AY Shows from Figure 5AX Specifically, Figure 5AY It is shown that in response to input 5110 at volume down button 5104 - 2 , the ringer of device 100 is disabled (eg, device 100 is set to a silent state), as shown by ringer state indicator 5112 . Figure 5AY Also shown is that the audio output of wireless accessory box 480 is disabled (eg, the volume level of speaker 345 is set to zero), as indicated by volume indicator 5114 .

[0255] Figure 5AZ Device 100 and wireless accessory box 480 are shown according to some embodiments. Figure 5AZ The wireless accessory box 480 in is beyond the communication threshold distance 5119 (e.g., not actively communicating with the device 100) and has a non-zero volume level, as indicated by the volume level indicator 5108.

[0256] Figure 5AZ A setup user interface 5117 is shown, for example, Figure 5A In some embodiments, the entire user interface shown in (or substantially all, such as greater than 95%, 96%, 97%, 98%, or 99%) is displayed (e.g., in response to detecting a sliding gesture or activation of a button or icon). Figure 5A The user interface 400 is at least partially obscured or blurred behind the settings user interface 5117, so that Figure 5A The different features of the user interface 400 of the device 100 are not identifiable. The settings user interface 5117 includes a number of controls for various features of the device 100. Notably, the settings user interface 5117 includes a focus mode control 5118.

[0257] Figure 5BA Input 5120 at focus mode control 5118 is shown (e.g., a press gesture that satisfies an intensity threshold that is above a nominal contact detection intensity threshold, or a long press gesture that is maintained on touch-sensitive display system 112 for at least a threshold amount of time).

[0258] Figure 5BB Shows from Figure 5BA Specifically, Figure 5BB Focus mode user interface 5121 is shown displayed in response to input 5120 (e.g., replacing user interface 5117 or overlapping the user interface). Focus mode user interface 5121 includes controls for two or more focus modes, such as a do not disturb control 5126, a personal control 5128, and a sleep control 5130. The do not disturb control 5126 mutes at least a subset of incoming calls and / or notifications at device 100 when activated by the user. In some embodiments, the do not disturb control is customizable by the user (e.g., the user can set which types of incoming calls and / or notifications are muted). The personal control 5128 mutes at least a subset of incoming calls and / or notifications at device 100 when activated by the user (e.g., the same or different subset as the do not disturb control 5126). The sleep control 5130 mutes at least a subset of incoming calls and / or notifications at device 100 when activated by the user (e.g., the same or different subset as the do not disturb control 5126 and / or the personal control 5128). For example, the personal control 5128 sets notification and ringtone settings during the user's personal time, and the sleep control 5130 sets notification and ringtone settings during the user's sleep time.

[0259] Figure 5BC Input 5132 at the do not disturb control 5126 is shown (e.g., a press gesture that satisfies an intensity threshold that is higher than the nominal contact detection intensity threshold, or a long press gesture that is maintained on the touch-sensitive display system 112 for at least a threshold amount of time).

[0260] Figure 5BD Shows from Figure 5BC Specifically, Figure 5BD Do not disturb mode is shown enabled in response to input 5132 as shown by indicator 5136. Figure 5BD Also shown is a wireless accessory device 480 that is beyond the threshold distance 5119 and has a non-zero volume level as indicated by the volume level indicator 5108 (eg, the wireless accessory device 480 is not affected by the do not disturb mode enabled at the device 100).

[0261] Figure 5BE Shows from Figure 5BD Specifically, Figure 5BEThe wireless accessory device 480 is shown within a threshold distance 5119, and the audio output of the wireless accessory box 480 is disabled (e.g., the volume level of the speaker 345 is set to zero), as indicated by the volume indicator 5138. In some embodiments, based on moving within the threshold distance 5119, the wireless accessory box 480 establishes a communication connection with the device 100. In some embodiments, after establishing the communication connection, the wireless accessory box 480 receives information about the do not disturb mode enabled at the device 100, and disables the audio output in response to the received information.

[0262] Fig. 5BF Shows from Figure 5BE Specifically, Fig. 5BF The wireless accessory device 480 is shown beyond the threshold distance 5119, and the audio output of the wireless accessory box 480 is disabled (e.g., the volume level of the speaker 345 is set to zero), as indicated by the volume indicator 5138. In some embodiments, based on the movement beyond the threshold distance 5119, the wireless accessory box 480 maintains the audio settings (e.g., does not adjust the volume of the audio output). In some embodiments, based on the movement beyond the threshold distance 5119, the wireless accessory box 480 maintains the audio settings established when the wireless accessory box 480 communicated with the device 100.

[0263] Figure 5BG Shows from Figure 5BE Specifically, Figure 5BG The wireless accessory device 480 is shown beyond the threshold distance 5119, and the audio output of the wireless accessory box 480 is enabled (e.g., the volume level of the speaker 345 is set to a non-zero value), as indicated by the volume level indicator 5108. In some embodiments, based on the movement beyond the threshold distance 5119, the wireless accessory box 480 enables the audio output (e.g., enables the audio output at a volume level established before the audio output was disabled). In some embodiments, the wireless accessory box 480 enables the audio output based on a user setting (e.g., a user preference as to whether to maintain a silent setting when not communicating with the electronic device).

[0264] Figure 5BH Shows from Figure 5BC Specifically, Figure 5BH Do not disturb mode is shown enabled in response to input 5132 as shown by indicator 5136. Figure 5BH Also shown are wireless accessory device 480 and wearable audio output device 5142 communicating with each other and beyond threshold distance 5119. Figure 5BHAlso shown is a wireless accessory device 480 having a non-zero volume level as indicated by volume level indicator 5108 (eg, wireless accessory device 480 is not affected by the do not disturb mode enabled at device 100 ).

[0265] Figure 5BI Shows from Figure 5BH Specifically, Figure 5BI Wearable audio output device 5142 is shown within threshold distance 5119 while communicating with wireless accessory box 480 that is beyond threshold distance 5119. Figure 5BI Also shown is that the audio output of the wireless accessory box 480 is disabled (e.g., the volume level of the speaker 345 is set to zero), as indicated by the volume indicator 5150. In some embodiments, based on the wearable audio output device 5142 moving within the threshold distance 5119, the wearable audio output device 5142 establishes a communication connection with the device 100. In some embodiments, after the communication connection is established, the wearable audio output device 5142 receives information about the do not disturb mode enabled at the device 100. In some embodiments, the wearable audio output device 5142 transmits the information about the do not disturb mode to the wireless accessory box 480 after receiving the information about the do not disturb mode. In some embodiments, in response to the wireless accessory box 480 receiving the information about the do not disturb mode enabled at the device 100, the wireless accessory box 480 disables the audio output. Thus, Figure 5AR to Figure 5BI Various ways of adjusting the volume of the audio output at the wireless accessory box 480 (eg, increasing the volume, decreasing the volume, disabling the audio output, and / or enabling the audio output) are shown.

[0266] Figures 5BJ to 5CB Example user interfaces and user interactions for adjusting the audio output of a wearable audio output device according to some embodiments are shown.

[0267] Figure 5BJ An exemplary user interface 5158 is shown, which is similar to the reference Figure 4A shown and described and also Figure 5A In addition, Figure 5BJ A slide gesture 5160 is shown starting from an initial position in the upper right corner of the touch-sensitive display system 112 and moving downward across the touch-sensitive display system 112. Figure 5BK shows the response from Figure 5BJ The initial position in Figure 5BK By performing a first portion of a swipe gesture 5160 in a second position in the display, device 100 displays a first portion of a settings user interface 5164 (also sometimes referred to as a control panel user interface) over at least a portion of user interface 5158.

[0268] Figure 5BL Settings user interface 5164 is shown displayed over the entirety (or substantially all, e.g., greater than 95%, 96%, 97%, 98%, or 99%) of user interface 5158 (e.g., in response to ceasing to detect swipe gesture 5160, optionally after swipe gesture 5160 moves further downward across touch-sensitive display system 112). In some embodiments, in response to the user activating a settings icon (e.g., Figure 4A 446 shown in ). In some embodiments, the user interface 5158 is at least partially obscured or blurred behind the settings user interface 5164, so that different features of the user interface 5158 are not recognizable. The settings user interface 5164 includes a plurality of controls for various features of the device 100. Notably, the settings user interface 5164 includes a volume control 5166. Upward and downward swipe inputs on the volume control 5166 may be provided to increase or decrease the volume of the audio output from the device 100 (e.g., via the wearable audio output device 301), respectively.

[0269] Figure 5BM User input 5168 is shown detected at volume control 5166. Input 5168 is as follows: Figure 5BM . The swipe gesture indicated by the upward arrow in the Figure 5BN shows that in response to input 5168 from Figure 5BM In response to input 5168 (e.g., and based on determining that input 5168 is a sliding gesture moving in a direction toward a higher volume (e.g., sliding upward)), the volume of the audio output at wearable audio output device 301 increases to volume level 5180. Figure 5B O shows user input 5182 (e.g., a different type of input than input 5168) detected at volume control 5166. In some embodiments, input 5182 is a tap, press, long press, and / or deep press input.

[0270] Figure 5BP Shows from Figure 5B O. Specifically, Figure 5BP An audio control user interface 5184 is shown displayed in response to input 5182 (e.g., in place of or overlapping user interface 5164). Audio control user interface 5184 includes volume control 5196, which is an enlarged version of volume control 5166 ( Figure 5BN ), and allows finer (e.g., more granular) volume control. User interface 5164 also includes noise controls 5194, spatial audio controls 5192, and dialogue enhancement controls 5190. Figure 5BPThe wearable audio output device 301 is shown operating with the spatial audio mode disabled and the conversation mode disabled, as indicated by indicator 5191. Figure 5BP As indicated by indicator 5195 in FIG. 1 , the wearable audio output device 301 operates in a transparent (e.g., active pass-through) audio output mode, wherein one or more pass-through audio components are output so that the user can hear a greater amount of ambient sound from the surrounding physical environment than would otherwise be perceived by the user (e.g., as described herein with reference to FIG. 1 ). Figure 3F described above).

[0271] Figure 5BQ User input 5198 is shown detected at conversation enhancement control 5190. In some embodiments, input 5198 is a tap, press, long press, and / or deep press input. Figure 5BR Shows from Figure 5BQ Specifically, Figure 5BR An audio control user interface 5200 is shown in which display of noise control 5194, spatial audio control 5192, and dialogue enhancement control 5190 is replaced by display of dialogue enhancement adjustment control 5206 and enhancement level indicator 5204. In response to input 5198 (e.g., and based on a determination that input 5198 is a tap or press gesture at dialogue enhancement control 5190 or otherwise satisfies predefined input activation criteria), noise control 5194, spatial audio control 5192, and dialogue enhancement control 5190 cease to be displayed, and dialogue enhancement adjustment control 5206 and enhancement level indicator 5204 are displayed. In some embodiments, in response to input 5198, dialogue enhancement adjustment control 5206 and enhancement level indicator 5204 are displayed simultaneously with noise control 5194 and / or spatial audio control 5192. In some embodiments, conversation enhancement adjustment control 5206, when adjusted by a user (e.g., by performing a drag gesture relative to enhancement level indicator 5204), adjusts the enhancement level (e.g., amplifies) of conversation audio picked up by one or more microphones of a wearable audio output device (e.g., microphone 302), conversation audio picked up by one or more microphones of an electronic device (e.g., microphone 113), or conversation audio picked up by one or more external microphones.

[0272] Figure 5BS A user input 5210 is shown detected at the noise control 5194 in the audio control user interface 5184. In some embodiments, the input 5210 is a tap, press, long press, and / or deep press input. Figure 5BS The wearable audio output device 301 is also shown operating with conversation enhancement enabled, as shown by indicator 5209 in the user interface 5184. Figure 5BT Shows from Figure 5BSSpecifically, Figure 5BT An audio control user interface 5201 is shown in which the display of noise controls 5194, spatial audio controls 5192, and dialogue enhancement controls 5190 is replaced by the display of an extended noise management control 5211, which includes a representation of a plurality of available audio output modes (e.g., three available audio output modes) for the wearable audio output device 301, each available audio output mode being associated with a different audio output mode available for the wearable audio output device 301. Specifically, the extended noise management control 5211 includes a pass-through icon 5216, a bypass icon 5214, and an active noise control icon 5212. The active noise control icon 5212 represents an active noise control (“ANC”) audio output mode in which one or more audio cancellation audio components are output to at least partially cancel ambient sounds from the surrounding physical environment that would otherwise be perceived by the user. Bypass icon 5214 represents a bypass audio output mode in which neither an audio cancellation audio component nor a pass-through audio component is provided (e.g., any amount of ambient sound perceived by the user is due to physical attenuation of the wearable audio output device 301 (and any attached ear tips) in the user's ears). A selection indicator 5217 displayed above pass-through icon 5216 (e.g., and not displayed above bypass icon 5214 or active noise control icon 5212) indicates that the audio pass-through mode represented by pass-through icon 5216 is the mode in which the wearable audio output device 301 is currently operating. In response to input 5210 (e.g., and based on determining Figure 5BS Input 5210 is shown as a tap or press gesture at noise control 5194), noise control 5194, spatial audio control 5192, and conversation enhancement control 5190 stop being displayed, and extended noise management control 5211 is displayed. In some embodiments, in response to input 5210, extended noise management control 5211 is displayed simultaneously with spatial audio control 5192 and / or conversation enhancement control 5190.

[0273] Figure 5BU A user input 5218 is shown detected at the active noise control icon 5212 in the audio control user interface 5201. In some embodiments, the input 5218 is a tap, press, long press, and / or deep press input. Figure 5BV Shows from Figure 5BU Specifically, Figure 5BV An audio control user interface 5184 is shown displayed in response to input 5218. Figure 5BV , noise control 5194 is set to ANC (e.g., based on detecting user input 5218 at active noise reduction icon 5212). Figure 5BVAlso shown is spatial audio being disabled as indicated by spatial audio control 5192 and conversation enhancement mode being enabled (but inactive) as indicated by conversation enhancement control 5190 and indicator 5219. In some embodiments, conversation enhancement mode is disabled when ANC is active. In some embodiments, conversation enhancement mode is enabled only when pass-through mode is enabled.

[0274] Figure 5BW A settings user interface 5164 is shown that includes a hearing control 5222 and a user input 5224 detected at the hearing control 5222. In some embodiments, the input 5224 is a tap, press, long press, and / or deep press input. Figure 5BX Shows from Figure 5BW Specifically, Figure 5BX A hearing user interface 5230 is shown that includes a plurality of activatable control options for the wearable audio output device 301, such as the following options or a subset or superset thereof:

[0275] Background sound control 5232, which, when activated, initiates a process for producing background sound at the wearable audio output device 301;

[0276] A live listening control 5234 which, when activated, initiates a process for providing audio data at the wearable audio output device 301 , wherein the audio data is captured via a microphone at the device 100 ;

[0277] • Decrease loud control 5235, which, when activated, initiates a process for decreasing the volume of sound that meets one or more criteria;

[0278] An ambient noise control 5236 for setting an audio output mode available for the wearable audio output device 301 (e.g., active noise cancellation mode, bypass mode, and / or pass-through mode);

[0279] Conversation enhancement control 5242, which, when activated, initiates a process for adjusting the audio output of wearable audio output device 301 to enhance conversation audio;

[0280] A real-time listening control 5244, which is used to switch the real-time listening mode on and off;

[0281] Background sound control 5246, which is used to switch the background sound mode on and off; and

[0282] Dialogue enhancement control 5248, which is used to toggle dialogue enhancement mode on and off.

[0283] exist Figure 5BXIn the example of , the wearable audio output device 301 operates in pass-through mode, as indicated by the ambient noise control 5236. In some embodiments, selecting an option to activate a control option in the settings user interface 5164 assigns the selected type of operation to the operation of both wearable audio output devices 301.

[0284] Figure 5BY User input 5250 is shown detected at conversation enhancement icon 5248. In some embodiments, input 5250 is a tap, press, long press, and / or deep press input. Figure 5BZ Shows from Figure 5BY Specifically, Figure 5BZ Hearing user interface 5252 is shown with background sound control 5232 stopped being displayed, conversation enhancement mode enabled, as indicated by conversation enhancement control 5242 and conversation enhancement icon 5248, and conversation enhancement adjustment control 5256 displayed. In response to input 5250 (e.g., and based on determining that input 5250 is a tap or press gesture at conversation enhancement icon 5248), background sound control 5232 stops being displayed (e.g., to provide space to display conversation enhancement adjustment control 5256) and conversation enhancement adjustment control 5256 is displayed. In some embodiments, in response to input 5250, conversation enhancement adjustment control 5256 is displayed simultaneously with background sound control 5232 (e.g., stopping displaying different controls from hearing user interface 5230 and / or adjusting the size / spacing of controls to display conversation enhancement adjustment control 5256 simultaneously with controls of user interface 5230).

[0285] Figure 5CA A user input 5260 is shown detected at the reduce loud control 5235. In some embodiments, the input 5260 is a tap, press, long press, and / or deep press input. Figure 5CB Shows from Figure 5CA Specifically, Figure 5CBHearing user interface 5262 is shown, in which conversation enhancement control 5242 (and conversation enhancement adjustment control 5256) have ceased to be displayed (e.g., but conversation enhancement mode is still enabled, as shown by conversation enhancement icon 5248), reduced loudness mode is enabled, as shown by reduced loudness control 5235, and reduced loudness adjustment control 5268 and associated information 5266 are displayed. In response to input 5260 (e.g., and based on determining that input 5260 is a tap or press gesture at reduced loudness control 5235), conversation enhancement control 5242 ceases to be displayed (e.g., to provide space to display reduced loudness adjustment control 5268), and reduced loudness adjustment control 5268 is displayed. In some embodiments, reduced loudness adjustment control 5268 adjusts the maximum audio output level (e.g., maximum output decibel level) of wearable audio output device 301 when adjusted by the user (e.g., by performing a drag gesture). For example, when reduced loudness mode is enabled, wearable audio output device 301 reduces any sound that would otherwise be above the maximum audio output level.

[0286] FIG. 6A to FIG. 6C 6 is a flow chart illustrating a method 600 for adjusting the audio output of one or more wearable audio output devices according to some embodiments. The method 600 includes adjusting the audio output of one or more wearable audio output devices (e.g., FIG. 3B to FIG. 3C The method 600 is performed at a wearable audio output device 301, the wearable audio output device comprising a first portion (e.g., head portion 303) configured to be inserted into the ear of a user of the wearable audio output device and a second portion (e.g., handle portion 305) extending from the first portion and comprising one or more input devices (e.g., input device 308). In some embodiments, the first portion comprises a speaker (e.g., speaker 306) or other audio output device and optionally one or more elements to enable the speaker to be positioned in a corresponding physical arrangement relative to the ear of the person using the wearable audio output device. In some embodiments, the second portion comprises a handle or other elongated portion extending from the first portion. In some embodiments, the wearable audio output device comprises a housing having one or more physically distinguished portions. In some embodiments, the wearable audio output device comprises one or more audio output devices (e.g., speaker 306). In some embodiments, the wearable audio output device comprises one or more placement sensors (e.g., sensor 304). Some operations in method 600 are optionally combined, and / or the order of some operations is optionally changed.

[0287] As described below, method 600 provides an improved interface for controlling audio output by changing the output volume of an audio output device (such as a wearable device) in response to a specific type of gesture. Providing additional control options for controlling audio output (such as changing the audio output mode, interacting with a digital assistant, or adjusting audio playback) reduces power usage and extends battery life (e.g., by alleviating the need to power a display or power a communication circuit to communicate with a remote display), and allows users to not have to switch between multiple devices to interact with the audio output device (e.g., the user does not need to find / switch to other electronic devices (e.g., smart phones or tablets) to control audio output), and reduces the number of inputs required for the user to control the audio output, and enhances the operability of the audio output device and makes the user device interface more effective (e.g., by helping the user achieve the desired results and reducing user errors when operating / interacting with the audio output device), in addition, this reduces power usage and extends the battery life of the audio output device by enabling the user to use the audio output device more quickly and efficiently.

[0288] The wearable audio output device detects (602) input via one or more input devices (e.g., input device 308). In some embodiments, the one or more input devices include one or more capacitive sensors, one or more force sensors, one or more motion sensors, and / or one or more device orientation sensors.

[0289] In some embodiments, the one or more input devices include (604) a series of capacitive sensors arranged to detect user gestures. In some embodiments, the series of capacitive sensors are arranged in columns or rows along the length of the second portion. In some cases, the capacitive sensors consume less power and / or provide improved detection of user touch gestures compared to other types of sensors (e.g., force or pressure sensors).

[0290] In some embodiments, the wearable audio output device includes (606) one or more physically distinct (e.g., recessed, raised, and / or differently textured) portions (e.g., physically distinct portion 307, such as Figure 3BIn some embodiments, the one or more physical distinctions include a single groove across the series of capacitive sensors, a corresponding groove for each capacitive sensor, and / or other configurations of grooves across the capacitive sensor locations. Providing physical distinctions at locations corresponding to the capacitive sensors allows the user to quickly and efficiently locate and interact with the sensors (e.g., without requiring the user to visually locate the sensors), which enhances the operability of the device and makes the user-device interface more efficient (e.g., by helping the user achieve expected results and reducing user errors when operating / interacting with the device), thereby further reducing power usage and extending the battery life of the device by enabling the user to use the device more quickly and efficiently.

[0291] In response to detecting the input, in accordance with determining that the input is a sliding gesture along the second portion of the wearable audio output device, the wearable audio output device adjusts (608) an output volume of the wearable audio output device based on movement of the sliding gesture along the second portion of the wearable audio output device. For example, FIG. 5H to FIG. 5I A sliding gesture along the handle portion 305 is shown, and Figure 5J The corresponding change in the volume of the audio output is shown. In some embodiments, the sliding gesture includes movement of one or more fingers, or pinching for stability and then sliding to adjust, or another finger input. In some embodiments, the sliding gesture is a pinch-slide gesture that includes two fingers that are simultaneously in contact with a second portion of the wearable audio output device (e.g., the two fingers are the thumb and a second finger that is different from the thumb). For example, the user's thumb contacts the wearable audio output device to maintain stability while the user's second finger performs a sliding gesture (e.g., as shown in FIG. 1 ). Figure 5H In some embodiments, the output volume of the wearable audio output device is adjusted in response to detecting the input and based on the following determination: (i) the input is a sliding gesture along the second portion of the wearable audio output device, and (ii) the first portion of the wearable audio output device is inserted into the user's ear (e.g., based on data from the placement sensor 304).

[0292] In some embodiments, the second portion is (610) a handle of the wearable audio output device (e.g., handle portion 305), and the sliding gesture includes movement of one or more fingers along the length of the handle (e.g., as shown in FIG. FIG. 5H to FIG. 5I and Figure 5K to Figure 5L Providing the elongated handle portion with a sensor for detecting user input allows the user to quickly and efficiently locate and interact with the sensor (e.g., without requiring the user to visually locate the sensor), which enhances the operability of the device and makes the user-device interface more efficient.

[0293] In some embodiments, the first portion of the wearable audio output device includes (612) an audio output device (e.g., speaker 306) configured to be inserted into the user's ear and one or more positioning elements (e.g., Figure 3F The earplug 314 shown in FIG. 1 is an earplug 314, and the second portion of the wearable audio output device is an elongated portion (e.g., handle portion 305) extending from the first portion. In some embodiments, when the first portion is inserted into the user's ear, the second portion extends in a downward direction. In some embodiments, when the first portion is inserted into the user's ear, the second portion extends in front of (e.g., past) the user's earlobe (e.g., as shown in FIG. 1 ). Figure 5G ). Improving the fit of the wearable audio output device via the positioning element improves the seal between the wearable audio output device and the user's ear, which enables audio to be played at a lower volume to produce the same effective audio volume as perceived by the user (e.g., relative to when the wearable audio output device is not properly fitted, in which case hearing some ambient noise may cause the user to increase the audio output volume), thereby further reducing power usage and extending the battery life of the device. In some cases, positioning the sensor in the elongated portion extending from the first portion improves the user device interface by allowing the user to stabilize the device with a pinch gesture when performing an input gesture and allowing the user to perform gestures away from the portion of the device that is inserted into the user's ear (e.g., to avoid interfering with the fit between the wearable audio output device and the user's ear).

[0294] In some embodiments, the wearable audio output device (614) communicates with a second wearable audio output device (e.g., the wearable audio output device 301-1 communicates with the wearable audio output device 301-2) to form a pair of wearable audio output devices, and adjusting the output volume of the wearable audio output device includes adjusting the output volume of both the wearable audio output device and the second wearable audio output device (e.g., as Figure 5G The corresponding output volume levels 518-1 and 518-2 and Figure 5J Adjusting the output volume of two wearable audio output devices in response to a single gesture reduces the number of inputs required, which enhances the operability of the device and makes the user-device interface more efficient (e.g., by helping the user achieve intended results and reducing user errors when operating / interacting with the device), which further reduces power usage and extends the battery life of the device by enabling the user to use the device more quickly and efficiently.

[0295] In some embodiments, the wearable audio output device detects (616) a second input via an input device of the second wearable audio output device, and in response to detecting the second input, based on determining that the second input is a sliding gesture along a second portion of the second wearable audio output device, the wearable audio output device adjusts the output volume of both the wearable audio output device and the second wearable audio output device. For example, FIG. 5H to FIG. 5I A slide gesture at the wearable audio output device 301-2 is shown, and Figure 5J The corresponding changes in volume at each of the wearable audio output devices 301-1 and 301-2 are shown. In addition, Figure 5K to Figure 5L A slide gesture at the wearable audio output device 301-1 is shown, and Figure 5M The corresponding changes in volume at each of the wearable audio output devices 301-1 and 301-2 are shown. Adjusting the output volume of both wearable audio output devices in response to a single gesture at either of the wearable audio output devices enhances the operability of the devices and makes the user-device interface more efficient (e.g., by helping the user achieve the intended results and reducing user errors when operating / interacting with the devices), which further reduces power usage and extends the battery life of the devices by enabling the user to use the devices more quickly and efficiently.

[0296] In some embodiments, in conjunction with adjusting the volume of the audio output of the wearable audio output device, the wearable audio output device provides (618) audio feedback (e.g., audio feedback 530) of the volume adjustment to the user via the audio output device of the wearable audio output device (e.g., speaker 306). In some embodiments, the feedback is provided via a speaker in the first portion of the wearable audio output device and / or in the second portion of the wearable audio output device. Providing audio feedback to the user enhances the operability of the device and makes the user-device interface more efficient (e.g., by helping the user achieve expected results and reducing user errors when operating / interacting with the device), which further reduces power usage and extends the battery life of the device by enabling the user to use the device more quickly and efficiently.

[0297] In some embodiments, providing audio feedback for volume adjustment includes (620) providing audio feedback for volume adjustment at both the wearable audio output device and the second wearable audio output device (e.g., audio feedback 530-1 and 530-2). In some embodiments, the audio feedback corresponds to an increase or decrease in volume, and / or the volume reaching a maximum or minimum endpoint. Providing audio feedback to the user at each wearable audio output device enhances the operability of the device and makes the user-device interface more efficient (e.g., by helping the user achieve the desired results and reducing user errors when operating the device / interacting with the device), which further reduces power usage and extends the battery life of the device by enabling the user to use the device more quickly and efficiently.

[0298] In some embodiments, in response to detecting the input, based on determining that the input is a non-slide gesture, the wearable audio output device activates (622) a function of the wearable audio output device, where the function is different than adjusting the output volume. For example, Fig.5O A non-swipe gesture is shown, while Figure 5P The corresponding activation of the playback function is shown. In some embodiments, the non-slide gesture is a tap gesture, a double-click gesture, a squeeze gesture, or other finger input. In some embodiments, the input satisfies a second gesture criterion, such as a single squeeze gesture criterion, which requires that after the intensity applied by the input to the input device satisfies an intensity threshold (e.g., a predefined intensity threshold), the intensity applied by the input to the input device decreases below the intensity threshold within a threshold amount of time since the input intensity satisfies the intensity threshold or, alternatively, since the input was first detected via the input device (e.g., due to the input ceasing to maintain contact with the input device). In some embodiments, the first wearable audio output device and the second wearable audio device have different behaviors. For example, a first wearable audio output device has a different set of assignments between types of input gestures and operations performed in response than a second wearable audio output device (e.g., a long squeeze gesture via the first wearable audio output device changes the audio output mode of the or both wearable audio output devices, while a different gesture, such as a short squeeze (e.g., a single squeeze) gesture via the second wearable audio output device changes the audio output mode of the or both wearable audio output devices, and / or a different operation is performed via the long squeeze gesture via the second wearable audio output device, such as toggling playback of media content rather than changing the audio output mode).

[0299] Detecting and responding to different types of gestures in different ways enhances the operability of the device (e.g., providing flexibility without requiring a graphical user interface and / or cluttering the graphical user interface with additional display controls, and reducing the number of inputs required to access that flexibility) and makes the user device interface more efficient.

[0300] In some embodiments, the function of the wearable audio output device that is activated in response to detecting the input is (624) an audio playback function (e.g., a play, pause, or skip function). In some embodiments, the audio playback function switches playback of the corresponding media audio component (e.g., independent of ambient sounds from the physical environment and based on media content from or obtained by the electronic device). For example, if the corresponding media audio component is being played when the audio playback function is activated, playback of the corresponding media audio component is paused; if the corresponding media audio component is paused when the audio playback function is activated, playback of the corresponding media audio component is resumed (e.g., Figure 5P As shown). In some embodiments, the media audio component is combined with one or more pass-through audio components (e.g., where the device is operating in a transparent mode) or one or more cancellation audio components (e.g., where the device is operating in a noise cancellation mode). In some embodiments, activation of the audio playback function skips any remaining portion of the corresponding media audio component and instead plays a different corresponding audio component (e.g., the second, next audio track from the electronic device). Adjusting the audio playback function in response to a gesture at the wearable audio output device enhances the operability of the device (e.g., providing flexibility without requiring a graphical user interface and / or cluttering the user interface with additional display controls, and reducing the number of inputs required to access the flexibility) and makes the user device interface more efficient.

[0301] In some embodiments, the function of the wearable audio output device activated in response to detecting the input is (626) an ambient noise adjustment function (e.g., active noise cancellation that adjusts ambient noise, transparency of ambient noise, and / or other ambient sound functions). For example, Figure 5Q to Figure 5RA transparent mode is shown enabled in response to user input at the handle portion 305 of the wearable audio output device 301-1. In some embodiments, when ambient sound from the physical environment is actively passing through (e.g., the first ambient sound audio level is non-zero), noise cancellation is disabled (e.g., the audio cancellation audio level is zero). In some embodiments, the ambient noise adjustment function activates a pass-through mode (or transparent mode or non-noise cancellation mode) that allows the user to hear unassisted audio (e.g., normal speech) from the user's environment. In some embodiments, when noise cancellation is enabled (e.g., the audio cancellation audio level is non-zero), no ambient sound from the physical environment is actively passing through (e.g., the first ambient sound audio level is zero). In some embodiments, the ambient noise adjustment function activates an active noise control mode (ANC), and the wearable audio output device outputs one or more audio cancellation audio components (e.g., one or more inverted audio signals, also referred to as "audio cancellation audio components") to at least partially cancel ambient sound from the surrounding physical environment, which would otherwise be perceived by the user. In some embodiments, an ambient sound waveform is detected by one or more microphones of a wearable audio output device, and an inverted (or partially inverted) audio signal waveform is generated by the wearable audio output device to at least partially cancel the ambient sound waveform.

[0302] Adjusting the ambient noise control in response to a gesture at the wearable audio output device enhances the operability of the device (e.g., providing flexibility without requiring a graphical user interface and / or cluttering the user interface with additional display controls, and reducing the number of inputs required to access the flexibility) and makes the user device interface more efficient. In addition, using different levels of pass-through audio components and elimination of audio components in different audio output modes provides the user with flexibility between different levels of audio immersion (via ambient audio elimination) or audio transparency (via ambient audio pass-through) that can be achieved with a gesture (e.g., a gesture detected at an input device of one of the wearable audio output devices).

[0303] In some embodiments, the function of the wearable audio output device that is activated in response to detecting an input is (628) a digital assistant function (e.g., invoking a digital assistant, interacting with a digital assistant, or turning off a digital assistant). In some embodiments, the digital assistant includes a function for performing operations on the device in response to user input (e.g., audio and / or text input, such as verbal or typed commands). In some embodiments, invoking the digital assistant causes the digital assistant to respond to user input (gestures, phrases, and / or commands). In some embodiments, turning off (and / or disabling) the digital assistant causes the digital assistant to not respond to user input. In some embodiments, the function causes a digital assistant invocation command to be sent to a network-connected device (e.g., device 100), and the network-connected device invokes the digital assistant and provides corresponding audio to the wearable audio output device, for example, via wireless communication.

[0304] Invoking, interacting with, and / or closing a digital assistant in response to gestures at a wearable audio output device enhances the operability of the device (e.g., providing flexibility without requiring a graphical user interface and / or cluttering the user interface with additional display controls, and reducing the number of inputs required to access that flexibility) and makes the user-device interface more efficient.

[0305] In some embodiments, the wearable audio output device provides (630) audio feedback (e.g., audio feedback 540) activating the function of the wearable audio output device in conjunction with activating (622) the function of the wearable audio output device, via the audio output device (e.g., in the first portion and / or the second portion), and forgoes providing audio feedback at the second wearable audio output device in the pair of wearable audio output devices. For example, Figure 5R It is shown that audio feedback 540 is provided at the wearable audio output device 301-1 and audio feedback is not provided at the wearable audio output device 301-2. Providing audio feedback to the user enhances the operability of the device and makes the user-device interface more efficient (e.g., by helping the user achieve the desired results and reducing user errors when operating / interacting with the device), which further reduces power usage and extends the battery life of the device by enabling the user to use the device more quickly and efficiently.

[0306] In some embodiments, the wearable audio output device detects (632) a third input via one or more input devices, and in response to detecting the third input: (i) based on determining that the third input is a sliding gesture along the second portion of the wearable audio output device and determining that the first portion of the wearable audio output device is inserted into the user's ear, the wearable audio output device adjusts the output volume of the wearable audio output device; and (ii) based on determining that the third input is a sliding gesture along the second portion of the wearable audio output device and determining that the first portion of the wearable audio output device is not inserted into the user's ear, the wearable audio output device forgoes adjusting the output volume of the wearable audio output device. In some embodiments, the wearable audio output device 301 is configured to adjust the volume level in response to the user sliding input only when the wearable audio output device 301 is inserted into the user's ear (e.g., determined based on data from the placement sensor 304). Forgoing adjusting the volume when the wearable audio output device is not plugged into the user's ear enhances the operability of the device and makes the user-device interface more efficient (e.g., by helping the user achieve intended results and reducing user errors when operating / interacting with the device), which further reduces power usage and extends the battery life of the device by enabling the user to use the device more quickly and efficiently.

[0307] In some embodiments, one or more input devices include (634) a first type of sensor (e.g., a touch sensor) and a second type of sensor (e.g., a force sensor), the input is detected via the first type of sensor, the device detects a fourth input via the second type of sensor, and in response to detecting the fourth input, the wearable audio output device activates a function of the wearable audio output device other than adjusting the output volume (e.g., sensor types may include capacitive sensors, force sensors, motion sensors (e.g., accelerometers), and orientation sensors). In some embodiments, one or more input devices include pressure-sensitive (sometimes also referred to as "intensity-sensitive") input devices. For example, the input device responds to a squeeze input (e.g., an input that applies intensity (also referred to as pressure) to the input device when held between two fingers and squeezed) that meets an intensity threshold, which in some embodiments is greater than a nominal contact detection intensity threshold that would be used for touch input. In some embodiments, one or more input devices include a touch-sensitive input device (e.g., the input device responds to a touch input, such as an input by a finger or stylus that meets a nominal contact detection intensity threshold). Including multiple types of sensors in a device expands the number and / or types of gestures that can be detected at the device. Expanding the number and / or types of detectable gestures enhances device operability (e.g., providing flexibility without requiring a graphical user interface and / or cluttering the user interface with additional display controls, and reducing the number of inputs required to access that flexibility) and makes the user device interface more efficient.

[0308] In some embodiments, the wearable audio output device establishes (636) a connection between the electronic device and the wearable audio output device (e.g., pairing the device, or adding the wearable audio output device to a user account associated with the electronic device), and after the connection is established (e.g., in response to establishing the connection), the electronic device causes a user interface (e.g., user interface 514-1 and / or 514-2) to be displayed, the user interface showing a simulated sliding gesture and a corresponding output volume adjustment. For example, the user interface is displayed as part of a usage tutorial that is shown in conjunction with pairing the wearable audio output device, adding the wearable audio output device to a user account (e.g., via a QR code), or activating the wearable audio output device for the first time when connected to an electronic device.

[0309] Displaying simulated gestures and corresponding functions and / or adjustments provides visual feedback to the user by indicating the operation and status of the device. Providing improved feedback to the user enhances the operability of the device and makes the user-device interface more efficient (e.g., by helping the user achieve intended results and reducing user errors when operating / interacting with the device), which further reduces power usage and extends the battery life of the device by enabling the user to use the device more quickly and efficiently.

[0310] It should be understood that FIG. 6A to FIG. 6C The specific order in which the operations in the description are described is merely an example and is not intended to indicate that the order is the only order in which the operations may be performed. A person of ordinary skill in the art will recognize many ways to reorder the operations described herein. In addition, it should be noted that the details of other processes described herein in conjunction with other methods described herein (e.g., methods 700, 800, and 900) are also applicable in a similar manner to the details of the processes described above in conjunction with Figures 6A-6C The method 600 described herein. For example, the inputs, gestures, functions, and feedback described above with reference to the method 600 optionally have one or more of the features of the inputs, gestures, functions, and feedback described herein with reference to other methods described herein (e.g., methods 700, 800, and 900). For the sake of brevity, these details are not repeated here.

[0311] 7A to 7C is a flowchart illustrating a method 700 for displaying status information of an electronic accessory according to some embodiments. Method 700 is performed on an electronic device (e.g., device 300 of FIG. 3 , or Figure 1A The method 700 is performed at a portable multifunction device 100. In some embodiments, the display generation component is a touch screen display. In some embodiments, the display is separate from the touch-sensitive surface. Some operations in method 700 are optionally combined, and / or the order of some operations is optionally changed.

[0312] As described below, method 700 provides an improved interface for presenting information about an electronic accessory (e.g., a headset or earbud case) at an electronic device in communication with the electronic accessory in response to detecting the occurrence of a corresponding condition associated with the electronic accessory, the information being presented together with a representation of the electronic accessory, the representation including a representation of a physical marker on the electronic accessory. Providing a user with a representation of an electronic accessory with a representation of the physical marker enhances recognizability (e.g., distinguishing between multiple electronic accessories of the same type) and security (e.g., distinguishing between electronic accessories owned by a user and electronic accessories owned by other users) and makes the user device interface more efficient (e.g., by helping the user interact with the desired electronic accessory), and further, this reduces power usage and extends the battery life of the device by enabling the user to control the device more quickly and efficiently.

[0313] The electronic device detects (702) an occurrence of a corresponding condition associated with an electronic accessory (e.g., wireless accessory box 480) that is different from the electronic device, and the electronic accessory communicates with the electronic device (e.g., wired or wireless communication). In some embodiments, the electronic device is a smart phone or tablet. In some embodiments, the electronic accessory is a set of headphones, a smart watch, a discoverable electronic device, a stylus, or an earbud box.

[0314] In some embodiments, the occurrence of the corresponding condition includes (704) a wireless coupling event (e.g., pairing and / or handshake) between the electronic device and the electronic accessory. FIG. 5A to FIG. 5D A pairing event between the device 100 and the earplug group 503 is shown. In some embodiments, the wireless coupling event includes detecting a pairing request from an electronic accessory. In some embodiments, the wireless coupling event includes detecting a broadcast signal from an electronic accessory and / or sending a pairing request to an electronic accessory. In some embodiments, the wireless coupling event includes completing a pairing process between an electronic device and an electronic accessory (e.g., establishing a communication channel between the electronic device and the electronic accessory and / or storing connection information to facilitate future connection with the electronic accessory). In some embodiments, the wireless coupling event includes detecting the presence of a previously paired electronic accessory. In some embodiments, the wireless coupling event includes a disconnection and / or separation between an electronic device and an electronic accessory (e.g., in response to a "forget this device" command). The representation of an electronic accessory with a representation of a physical marker provided in response to a wireless coupling event provides improved security and privacy by distinguishing multiple electronic accessories that would otherwise be indistinguishable or more difficult to distinguish in the user interface of the wireless coupling event, particularly in the case where the electronic accessories are associated with different users and / or user accounts.

[0315] In some embodiments, the occurrence of the corresponding condition includes (706) proximity-based communication between the electronic device and the electronic accessory. For example, Figure 5TProximity-based communication between wireless accessory box 480-1 and device 100 is shown. In some embodiments, the occurrence of a corresponding condition includes the electronic device and the electronic accessory satisfying one or more proximity criteria (e.g., close enough to communicate wirelessly with each other, and / or within a predefined physical distance of each other). In some embodiments, one or more proximity criteria include one or more communication quality criteria (e.g., signal strength and / or stability requirements). In some embodiments, proximity-based communication includes wireless coupling communication (e.g., advertising, pairing, and / or handshake communication). Providing a representation of an electronic accessory with a physically marked representation in response to proximity-based communication provides improved security and privacy by distinguishing multiple electronic accessories that would otherwise be indistinguishable or more difficult to distinguish in a user interface for proximity-based communication, particularly where the electronic accessories are associated with different users and / or user accounts.

[0316] In some embodiments, the occurrence of the corresponding condition includes (708) a state change event at the electronic accessory, and the user interface corresponding to the corresponding condition includes state information corresponding to the state change event. Figure 5D The earbud set 503 is shown communicatively connected to the device 100 and the user interface 504-2 includes an indication of the connection 512. Providing a representation of an electronic accessory with a physically marked representation in response to a state change event provides improved security and privacy by distinguishing multiple electronic accessories that would otherwise be indistinguishable or more difficult to distinguish in the user interface of the state change event, particularly where the electronic accessories are associated with different users and / or user accounts.

[0317] In some embodiments, the state change event includes (710) a change in the open or closed state of the electronic accessory. For example, Figure 5X to Figure 5Y The lid 367 of the wireless accessory box 480 is shown closed and the corresponding user interface 576 is displayed on the device 100. In some embodiments, the electronic accessory is a charging box, and the state change event involves the user opening and / or closing the charging box. For example, in response to the user closing the charging box, the user interface shows a representation of the charging box and information about the current charge level of the charging box (e.g., such as Figure 5AC As another example, in response to a user opening a charging box, the user interface shows a representation of the charging box (e.g., representation 5012) and a representation of one or more accessories within the charging box (e.g., representation 5006) (e.g., with information about the current charge level of the one or more accessories within the charging box). Providing a representation of an electronic accessory with a physically marked representation in response to a change in the open or closed state of the electronic accessory provides improved security and privacy by distinguishing multiple electronic accessories that would otherwise be indistinguishable or more difficult to distinguish in a user interface of a state change event, and provides enhanced feedback about the state of the electronic accessory.

[0318] In some embodiments, the state change event includes (712) a charging event at the electronic accessory (e.g., Figure 5Y or Figure 5AC For example, a charging event involves a user connecting an electronic accessory to a power source (e.g., an outlet, a charging station, and / or a charging case), and in response, the user interface displays a representation of the electronic accessory and information indicating that it is currently charging (e.g., Figure 5AC In another example, the charging event involves the user disconnecting the electronic accessory from the power source, and in response, the user interface shows a representation of the electronic accessory and information indicating the current charge level of the electronic accessory. Providing a representation of the electronic accessory with a physically marked representation in response to a charging event provides improved security and privacy by distinguishing multiple electronic accessories that would otherwise be indistinguishable or more difficult to distinguish in the user interface of the charging event, and provides enhanced feedback about the status of the electronic accessory.

[0319] In some embodiments, the occurrence of the corresponding condition includes (714) an error event (e.g., Figure 5AM 5057). In some embodiments, the error event involves the failure of the electronic accessory to establish a connection with the electronic device (e.g., a Bluetooth and / or Wi-Fi connection), and the error information includes information about the failure (e.g., and information about how to correct the failure). For example, the electronic accessory is a wearable audio output device, and the error event is a failure to pair with the electronic device. In this example, the error information includes instructions to reset the wearable audio output device. In some embodiments, the error event involves the failure of the electronic accessory to charge when connected to a power source, and the error information includes a notification of the failure (e.g., and information about how to correct the failure). In some embodiments, the error event involves a software error, such as a failure of firmware, an operating system, and / or an application to execute. The representation of the electronic accessory with a physically marked representation provided in response to the error event provides improved security and privacy by distinguishing multiple electronic accessories that would otherwise be indistinguishable or more difficult to distinguish in the user interface of the error event, particularly where the electronic accessories are associated with different users and / or user accounts.

[0320] In response to detecting the occurrence of a corresponding condition, the electronic device causes (716) a user interface (e.g., user interface 5056) corresponding to the corresponding condition to be displayed via a display generating component (e.g., touch-sensitive display system 112), the user interface including a representation of the electronic accessory (e.g., representation 5058 of wireless accessory box 480).

[0321] Causing display of a user interface to include (718): (i) based on determining that the electronic accessory includes a first physical mark (e.g., an engraved, embossed and / or printed, painted or otherwise applied mark), causing a representation of the first physical mark (e.g., representation 544-1 of physical mark 482-1) to be displayed in the user interface (e.g., without including a representation of another second physical mark included in a different electronic accessory); and (ii) based on determining that the electronic accessory includes a second physical mark that is different from the first physical mark, causing a representation of the second physical mark to be displayed in the user interface (e.g., representation 544-2 of physical mark 482-2), for example, without including a representation of the first physical mark.

[0322] In some embodiments, the first physical token is provided by the user when purchasing the electronic accessory (e.g., via Figure 5W The first physical tag is specified or selected (720) by the user through the user interface 550 shown in FIG. 1 . For example, the first physical tag is a personalized tag accepted by the user, a tag selected from a set of tags, or a tag suggested by a computer system (such as an electronic device). Providing the user with a physical tag specified or selected by the user provides improved security and privacy by distinguishing multiple electronic accessories that would otherwise be indistinguishable or more difficult to distinguish, particularly where the electronic accessories are associated with different users and / or user accounts.

[0323] In some embodiments, based on determining that the electronic accessory does not include the first physical marker, the electronic device causes (722) a user interface including a representation of the electronic accessory to be displayed without the representation of the first physical marker. For example, wireless accessory box 480-3 ( Figure 5S ) does not include physical marker 482, and user interface 504-1 displays a representation 542-3 of wireless accessory box 480-3 without any representation 544 of physical marker 482, such as Figure 5V Providing a representation of an electronic accessory without a physical marker distinguishes the electronic accessory from other electronic accessories that include a physical marker. Distinguishing between multiple electronic accessories when interacting with one of the multiple electronic accessories via a user interface improves the security and privacy of the interaction.

[0324] In some embodiments, the representation of the electronic accessory is (724) a three-dimensional representation of the electronic accessory. For example, the electronic accessory is a wireless accessory box, and the representation is a three-dimensional model of the wireless accessory box. Providing a three-dimensional representation of the electronic accessory improves security and privacy by distinguishing between multiple electronic accessories that would be indistinguishable or more difficult to distinguish using a two-dimensional representation.

[0325] In some embodiments, the user interface includes (726) one or more animated movements (e.g., rotation, shifting, and / or lateral movement) of a representation of the electronic accessory. For example, Figure 5TArrow 543 in user interface 504-1 is shown indicating movement of representation 542-1 of wireless accessory box 480-1. Providing representations of electronic accessories with animated movement improves security and privacy by distinguishing multiple electronic accessories that would be indistinguishable or more difficult to distinguish using static representations (e.g., representations of physical markers that are not fully visible in the static representation).

[0326] In some embodiments, the electronic device detects (728) the occurrence of a corresponding condition associated with a second electronic accessory (e.g., wireless accessory box 480-2) that is different from the electronic device (e.g., device 100) and the electronic accessory (e.g., wireless accessory box 480-1), the second electronic accessory communicates with the electronic device and has the same device type as the electronic accessory (e.g., wireless accessory box), and in response to detecting the occurrence of the corresponding condition associated with the second electronic accessory, based on determining that the second electronic accessory does not include the first physical mark, the electronic device causes a second user interface corresponding to the corresponding condition to be displayed via a display generation component, wherein the second user interface includes a representation of the second electronic accessory without a representation of the first physical mark. For example, if the second electronic accessory includes a third physical mark, the second user interface includes a representation of the second electronic accessory with a representation of the third physical mark; if the second electronic accessory does not include a personalized physical mark, the second user interface includes a representation of the second electronic accessory without a representation of the personalized physical mark. According to some embodiments, the user interface previously described with respect to the electronic accessory is displayed in response to the occurrence of the corresponding condition associated with the second electronic accessory, and the user interface includes a representation of the second electronic accessory (e.g., in addition to or as a substitute for the representation of the electronic accessory). Providing a representation of the electronic accessory without a representation of the physical marker distinguishes the electronic accessory from other electronic accessories that include the physical marker. Distinguishing between multiple electronic accessories when interacting with one of the multiple electronic accessories via a user interface improves the security and privacy of the interaction.

[0327] In some embodiments, the second electronic accessory includes (730) a third physical marker that is different from the first physical marker, and the second user interface includes a representation of the second electronic accessory having a representation of the third physical marker. In some embodiments, the occurrence of a corresponding condition associated with the second electronic accessory is also associated with the electronic accessory, and the user interface includes a representation of the electronic accessory having a representation of the first physical marker and a representation of the second electronic accessory having a representation of the third physical marker. For example, Figure 5AMA user interface 5056 is shown with a representation 5062 of a wearable audio output device 5050 including a representation 5064 of a physical marker 5052 and a representation 5063 of a wearable audio output device 5046 including a representation 5065 of a physical marker 5048. Providing a representation of a second electronic accessory with a representation of a third physical marker distinguishes the second electronic accessory from other electronic accessories (e.g., a first electronic device with a first physical marker). Distinguishing between multiple electronic accessories when interacting with one of the multiple electronic accessories via the user interface improves the security and privacy of the interaction.

[0328] In some embodiments, while the user interface is being displayed, the electronic device detects (732) a user input corresponding to a user interface element on the user interface, wherein the user interface element corresponds to a function of the electronic accessory, and in response to the user input, the electronic device activates the function of the electronic accessory. For example, the occurrence of the corresponding condition includes a pairing request from the electronic accessory, and the user interface element includes a selectable connection element (e.g., button 507, such as FIG. 5B to FIG. 5C As shown), which corresponds to a pairing function for initiating (or continuing, or confirming) pairing between an electronic device and an electronic accessory. In this example, the user input corresponds to a selectable connection element and activates the pairing function. As another example, the occurrence of the corresponding condition is an error event, and the user interface includes a selectable fault diagnosis element corresponding to the fault diagnosis function. In this example, the user input corresponds to a selectable fault diagnosis element and activates the fault diagnosis function. Providing a representation of a second electronic accessory with a representation of a third physical mark distinguishes the second electronic accessory from other electronic accessories (e.g., a first electronic device with a first physical mark). Distinguishing between multiple electronic accessories when interacting with one of the multiple electronic accessories via the user interface improves the security and privacy of the interaction. In addition, providing a distinguishing feature for a user interface element reduces the number of inputs required to identify / verify the electronic accessory before interaction (e.g., via activating a function corresponding to the user interface element).

[0329] It should be understood that 7A to 7C The specific order in which the operations in the description are described is merely exemplary and is not intended to indicate that the order is the only order in which the operations may be performed. A person of ordinary skill in the art will recognize a variety of ways to reorder the operations described herein. In addition, it should be noted that the details of other processes described herein in conjunction with other methods described herein (e.g., methods 600, 800, and 900) are also applicable in a similar manner to the details of the processes described above in conjunction with 7A to 7CThe method 700 described herein. For example, the inputs, gestures, functions, and feedback described above with reference to the method 700 optionally have one or more of the features of the inputs, gestures, functions, and feedback described herein with reference to other methods described herein (e.g., methods 600, 800, and 900). For the sake of brevity, these details are not repeated here.

[0330] FIG. 8A to FIG. 8D 800 is a flowchart illustrating a method 800 for presenting status information at an accessory charging case according to some embodiments. The method 800 is performed in an accessory charging case (e.g., electronic accessory case 342, FIG. 3D to FIG. 3E ). In some embodiments, the accessory charging box includes a cover (e.g., cover 367 or hinged cover 486). In some embodiments, the accessory charging box includes one or more input devices (e.g., input device 346). In some embodiments, the accessory charging box is a charging box for a wireless accessory to another device, the wireless accessory including one or more of a smart watch, one or more earbuds, wireless headphones, a stylus, or a fitness tracker. Some operations in method 800 are optionally combined, and / or the order of some operations is optionally changed.

[0331] As described below, method 800 provides an improved interface for presenting status notifications at an accessory charging case. Providing audio notifications at the charging case reduces power usage and extends battery life (e.g., by alleviating the need to power a display or power a communication circuit to communicate with a remote display), and allows a user to not have to switch between multiple devices to interact with the charging case and / or associated accessories (e.g., the user does not need to find / switch to other electronic devices (e.g., smart phones or tablets) to receive status notifications), and reduces the number of inputs required for the user to receive notifications, and enhances the operability of the charging case and makes the user device interface more efficient (e.g., by helping the user achieve the desired results and reducing user errors when operating / interacting with the charging case), and further, this reduces power usage and extends the battery life of the charging case by enabling the user to use the charging case more quickly and efficiently.

[0332] The accessory charging case detects (802) a first event including a change in the open or closed state of the accessory charging case. For example, Figure 5X to Figure 5Y A closing event (eg, lid closure) of the wireless accessory device 480 is shown. As another example, Figures 5AB to 5AC An opening event (eg, lid open) of the wireless accessory device 480 is shown.

[0333] In response to detecting a change in the open or closed state of the accessory charging case, the case causes (804) a speaker (e.g., speaker 345) of the accessory charging case to generate an audio notification (e.g., audio feedback 5001) corresponding to a state of the accessory charging case and at least one of one or more accessories associated with the accessory charging case (e.g., communicatively coupled to the accessory charging case and / or linked to the same user account as the accessory charging case). In some embodiments, the speaker of the accessory charging case generates an audio notification corresponding to the state of the accessory charging case and an audio notification corresponding to the state of one or more accessories associated with the accessory charging case. In some embodiments, the speaker of the accessory charging case generates an audio notification corresponding to the state of the accessory charging case without generating an audio notification corresponding to the state of one or more accessories. In some embodiments, the speaker of the accessory charging case generates an audio notification corresponding to the state of the one or more accessories without generating an audio notification corresponding to the state of the accessory charging case.

[0334] In some embodiments, the audio notification includes (806) one or more words describing the status of at least one of the accessory charging case and one or more accessories associated with the accessory charging case. For example, Figure 5AO Audio feedback 5054 including the words "Alert, earbuds do not match" is shown. In some embodiments, the audio notification includes one or more sounds (e.g., tones and / or beeps) and does not include any words.

[0335] Providing audio notifications with words describing status provides improved audio feedback to the user by indicating relevant status of the system, which enhances the operability of the device and makes the user-device interface more efficient (e.g., by helping the user achieve intended results and reducing user errors when operating / interacting with the device), thereby further reducing power usage and extending the battery life of the device by enabling the user to use the device more quickly and efficiently (e.g., without requiring a display device and / or graphical user interface).

[0336] In some embodiments, the status corresponds to (808) a charging status (e.g., currently charging, charging completed, or charging terminated) of at least one of the one or more accessories associated with the accessory charging case. Figure 5ACAudio feedback 5001 including information about the charging state of the wearable audio output device 301 is shown. In some embodiments, the audio notification for each state of one or more accessories is different (e.g., so the user can distinguish between different states). For example, the audio notification of the charging initiation state includes a beep having a first tone, and the audio notification of the charging completion state includes a beep having a second tone different from the first tone. As another example, the audio notification of the charging initiation state includes a first number of beeps, and the audio notification of the charging completion state includes a second number of beeps different from the first number of beeps. As another example, each audio notification includes one or more words describing the corresponding charging state (e.g., one or more words that distinguish the charging state). Providing audio information about the charging state of at least one of the one or more accessories associated with the accessory charging box improves feedback to the user by indicating the relevant state of the system, which enhances the operability of the device and makes the user device interface more efficient.

[0337] In some embodiments, the status includes (810) a state of communicative coupling between the accessory charging case and at least one of the one or more accessories associated with the accessory charging case (e.g., pairing initiated, in progress, completed, or failed). In some embodiments, the audio notification is different for each state of communicative coupling between the accessory charging case and at least one of the one or more accessories associated with the accessory charging case (e.g., so a user can distinguish between different states). Providing audio information about the state of communicative coupling improves feedback to the user by indicating the relevant state of the system, which enhances the operability of the device and makes the user device interface more efficient.

[0338] In some embodiments, the accessory charging case is configured (812) to simultaneously accommodate multiple accessories (e.g., wearable audio output devices 301-1 and 301-2), the first event includes closing of the accessory charging case, and the state corresponds to determining that the accessory charging case contains only a subset of the multiple accessories. For example, Figure 5Z to Figure 5AA A closed wireless accessory case 480 is shown with only wearable audio output device 301-1 inside and corresponding audio feedback 587. Providing audio information about a charging case that includes only a subset of accessories improves feedback to the user by indicating relevant status of the system, which enhances device operability and makes the user-device interface more efficient.

[0339] In some embodiments, the state corresponds to (814) a reset event (e.g., a soft reset, a hard reset, and / or a factory reset event) of the accessory charging case. Figure 5AIAn input 5030 at the input device 346 that causes a factory reset to be initiated and corresponding audio feedback 5032 are shown. Examples of soft reset events include closing an executing application, clearing data in volatile memory, and / or turning off power to the accessory charging case. Examples of hard reset events include clearing memory associated with the hardware of the accessory charging case and / or updating the driver for the hardware (e.g., updating with a stable driver from the hardware manufacturer). Examples of factory reset include restoring and / or restoring the settings, firmware, and / or software of the accessory charging case to the same state as when the accessory charging case was shipped from the factory. Examples of factory reset include removing user data, settings applied by the user, and / or applications installed by the user. For example, a factory reset event includes resetting (e.g., deleting and / or removing) wireless connection information (e.g., pairing information and / or Wi-Fi network information). Providing audio information about a reset event improves feedback to the user by indicating the relevant state of the system, which enhances the operability of the device and makes the user-device interface more efficient.

[0340] In some embodiments, the status includes (815) that the charging state of the accessory charging case does not meet one or more preset criteria (e.g., determining that the charging state of the accessory charging case is insufficient to fully charge the accessories associated with the charging case, or the charging state is below a preset threshold (e.g., below 50%, 30%, or 20%)). For example, Figure 5AD Audio feedback 5018 is shown indicating that the wireless accessory box 480 has only 15% of a charge. In some embodiments, one or more preset criteria are static criteria and correspond to the amount of charge required to fully charge one or more accessories associated with the accessory charging box from any charging state (e.g., the amount of charge required to fully charge one or more accessories from a completely depleted state). In some embodiments, one or more preset criteria are dynamic criteria and correspond to the amount of charge required to fully charge one or more accessories associated with the accessory charging box from a current charging state. For example, one or more accessories are wearable audio output devices that are currently at a charging state of 40% of a full charge, and the one or more preset criteria correspond to the amount of charge required to fully charge the wearable audio output device from a 40% charging state. Providing audio information about the charging state of the accessory charging box improves feedback to the user by indicating the relevant state of the system, which enhances the operability of the device and makes the user device interface more efficient.

[0341] In some embodiments, the state corresponds to (818) determining that the accessory charging case contains a plurality of accessory devices and determining that the plurality of accessory devices do not match. For example, Figure 5AL to Figure 5AMA closed wireless accessory case 480 is shown with unmatched wearable audio output devices 5046 and 5050 inside and corresponding audio feedback 5054. Providing audio information about unmatched accessory devices improves feedback to the user by indicating the relevant status of the system, which enhances the operability of the device and makes the user-device interface more efficient.

[0342] In some embodiments, the first event includes (820) opening the accessory charging case. For example, Figure 5AD Shown is an opened wireless accessory box 480 and corresponding audio feedback 5018. Providing audio information when the wireless accessory box is opened improves feedback to the user by indicating the relevant status of the system, which enhances the operability of the device and makes the user-device interface more efficient.

[0343] In some embodiments, the accessory charging case (822) communicates with the display generation component, and the case causes a user interface to be displayed via the display generation component, the user interface including the mismatch notification. For example, Figure 5AM A closed wireless accessory case 480 is shown with unmatched wearable audio output devices 5046 and 5050 inside and a corresponding user interface 5056 with a notification 5057. Providing visual information about unmatched accessory devices improves feedback to the user by indicating the relevant status of the system, which enhances device operability and makes the user-device interface more efficient.

[0344] In some embodiments, the user interface also includes (824) a representation of the accessory charging box (e.g., representation 5058) and corresponding representations of multiple accessory devices (e.g., representations 5062 and 5063, such as Figure 5AM Providing visual representations of accessory devices and accessory charging cases improves feedback to the user by indicating relevant status of the system, which enhances device operability and makes the user-device interface more efficient.

[0345] In some embodiments, determining that the plurality of accessory devices are not matched includes (826) determining that each of the plurality of accessory devices has a different owner (e.g., is linked to or associated with a different user account), and the user interface also includes ownership information of the plurality of accessory devices (e.g., Figure 5AM ). For example, the ownership information includes the name or identifier of each accessory owner and / or an indication of which accessories have ownership that is different from the ownership of the accessory charging box. Providing audio information about unmatched ownership of accessory devices improves feedback to the user by indicating the relevant status of the system, which enhances the operability of the device and makes the user device interface more efficient. In addition, providing audio information about unmatched ownership improves security / privacy by identifying devices associated with other users and / or user accounts.

[0346] In some embodiments, determining that the plurality of accessory devices do not match includes (828) determining that each of the plurality of accessory devices has a different hardware and / or software version, and the user interface also includes version information for the plurality of accessory devices (e.g., the version information includes a version number or identifier for each of the plurality of accessory devices). For example, Figure 5AP to Figure 5AQ A closed wireless accessory case 480 is shown with unmatched wearable audio output devices 5046 and 5070 inside and a corresponding display indication 5087 of the versions associated with the wearable audio output devices 5046 and 5070 in the wireless accessory case 480. Providing version information regarding unmatched versions of accessory devices improves feedback to the user by indicating the relevant status of the system, which enhances the operability of the device and makes the user-device interface more efficient.

[0347] In some embodiments, the case detects (830) a second event that includes a change in the charging state of at least one of the accessory charging case and one or more accessories associated with the accessory charging case, and in response to detecting the second event, the case causes the speaker to generate a second audio notification that is different from the audio notification and corresponds to the change in charging state. For example, a second audio notification may be generated via the speaker in response to detecting a change in the charging state of the wearable audio output device 301 or the accessory charging case 480. Figure 5AC 345 in the speaker 346. Providing audio information about changes in the charging status of at least one of the accessory charging box and one or more accessories associated with the accessory charging box improves feedback to the user by indicating the relevant status of the system, which enhances the operability of the device and makes the user device interface more efficient.

[0348] In some embodiments, the change in charging state includes (832) initiation or termination of charging of at least one of the one or more accessories associated with the accessory charging case. For example, Figure 5X to Figure 5AY A closed wireless accessory case 480 is shown, as well as initiating charging of a wearable audio output device 301 and corresponding audio feedback 585. Providing audio information regarding the initiation or termination of charging of at least one of one or more accessories associated with the accessory charging case improves feedback to the user by indicating the relevant status of the system, which enhances the operability of the device and makes the user-device interface more efficient.

[0349] In some embodiments, based on a user request to locate the accessory charging case (e.g., or an accessory associated with the charging case), the case causes (834) the speaker to generate a third audio notification corresponding to the user request, wherein the third audio notification is different from the audio notification (e.g., of operation 804) (e.g., and optionally has an audio waveform different from the audio waveform of the audio notification). For example, Figures 5AJ to 5AK User input 5040 is shown detected at button 5038, which, when activated by the user, causes audio output 5042 to be output at wireless accessory case 480. In some embodiments, the user request is to locate an accessory device other than the accessory charging case (e.g., an accessory device that is inside, paired with, or associated with the charging case), and in response, the accessory device generates an audio notification (e.g., based on determining that the accessory is inside or in communication with the charging case). Providing an audio notification in response to a user request to locate an accessory charging case or an accessory device inside a charging case improves security / privacy by helping a user quickly locate a lost or stolen accessory charging case and / or accessory device.

[0350] In some embodiments, the case detects (836) a third event including a change in state of the accessory charging case, and in response to detecting the third event: (i) based on determining that the sound setting of the accessory charging case is in an enabled state, the case causes the speaker to generate a fourth audio notification; and (ii) based on determining that the sound setting of the accessory charging case is in a disabled state, the case forgoes causing the generation of the fourth audio notification. For example, Figure 5AV A wireless accessory box 480 is shown with a disabled audio output (e.g., as shown by volume indicator 5100). In some embodiments, in response to an event when the wireless accessory box 480 has disabled the audio output, the wireless accessory box 480 forgoes generating an audio notification. In some embodiments, a user input is detected at the accessory charging box (e.g., via a hardware or software button), and in response to the user input, the sound setting is set to a disabled state (or off). Forgoing providing audio notifications based on the sound setting in a disabled state improves safety / privacy by preventing unwanted audio notifications (e.g., when the user is in a crowded / public place). In addition, forgoing unwanted audio notifications reduces power usage and extends the battery life of the device.

[0351] In some embodiments, an electronic device other than the accessory charging box (e.g., electronic device 100) causes (838) displaying a user interface (e.g., user interface 5090) via a display generation component, the user interface including a control element for a sound setting of the accessory charging box (e.g., volume control element 5091), detecting an input corresponding to the control element (e.g., user input 5098), and in response to detecting the input, causing the sound setting of the accessory charging box to be set to a disabled state (e.g., as Figure 5AV5099 in the figure). In some embodiments, in response to detecting an input, the electronic device switches the sound setting of the accessory charging box from a previous state to a new state. For example, when the sound setting is in a disabled state, the accessory charging box abandons generating an audio notification (e.g., abandons generating an audio notification in response to detecting an event occurring at the accessory charging box and / or an event involving the accessory charging box). In some embodiments, the condition for generating an audio notification via the speaker is that the sound setting is set to an enabled state. In some embodiments, the accessory charging box includes a tactile output device, and in response to an event occurring at the accessory charging box and / or an event involving the accessory charging box, the tactile output device generates tactile feedback (e.g., in addition to or in lieu of generating an audio notification). Displaying a user interface with control elements for sound settings reduces the number of inputs required to set the sound setting of the accessory charging box to a disabled state.

[0352] In some embodiments, after setting the sound setting of the accessory charging case to a disabled state, the case detects (840) a fourth event including a change in the open or closed state of the accessory charging case, and in response to detecting the fourth event and based on the sound setting being in the disabled state, the case forgoes causing the speaker to generate an audio notification associated with the state of the accessory charging case and / or one or more accessories associated with the accessory charging case (e.g., forgoes generating audio feedback 5018 and / or 5020). In some embodiments, causing the speaker to generate an audio notification associated with the state of at least one of the accessory charging case and one or more accessories associated with the accessory charging case is based on determining that the sound setting is set to an enabled state. Forgoing providing audio notifications based on the sound setting being in the disabled state improves safety / privacy by preventing unwanted audio notifications (e.g., when the user is in a crowded / public place). In addition, forgoing unwanted audio notifications reduces power usage and extends the battery life of the device.

[0353] In some embodiments, the case sets (842) the sound setting to a disabled state (e.g., as shown in FIG. 1 ) based on an audio output mute setting (e.g., a ring mute setting and / or an audio notification mute setting) enabled at an electronic device communicatively coupled to the accessory charging case. Figure 5AX to Figure 5AY). In some embodiments, a user input corresponding to a ring mute setting is detected at a companion device (e.g., at an electronic device 100, e.g., via hardware or software affordance); and in response to the user input, the ring mute setting is enabled (or turned on). In some embodiments, when the audio output mute setting is enabled, the electronic device abandons generating an audio notification in response to an incoming call, text message, voicemail, email, and / or calendar event. In some embodiments, the electronic device includes a hardware switch configured to switch the audio output mute setting between an enabled state and a disabled state. In some embodiments, the electronic device includes a hardware volume button, and a first type of user input at the hardware volume button enables the audio output mute setting. In some embodiments, the electronic device causes an audio control user interface to be displayed, and the audio control user interface includes a selectable mute element that, when selected, enables the audio output mute setting. Alternatively, the audio control user interface of the electronic device includes a volume control element that enables the user to set the audio output volume to zero. Configuring the sound settings of the accessory box based on the audio output mute setting or volume control setting of the electronic device avoids requiring the user to separately configure the sound settings of the device and the accessory box, which reduces the number of inputs required to perform operations.

[0354] In some embodiments, the case sets (844) the sound setting to a disabled state based on a focus mode activated at an electronic device communicatively coupled to the accessory charging case. For example, Figure 5BB to Figure 5BE Activation of a focus mode (e.g., Do Not Disturb mode) is shown, and the corresponding muting of the wireless accessory device 480 as shown by the volume indicator 5138. Configuring the sound settings of the accessory box based on the focus mode of the device avoids requiring the user to separately configure the sound settings of the device and the accessory box, which reduces the number of inputs required to perform operations.

[0355] In some embodiments, the sound setting of the accessory charging case is set (846) to a disabled state based on the electronic device being communicatively coupled to at least one of the one or more accessories associated with the accessory charging case. For example, Figure 5BH to Figure 5BIA wearable audio output device 5142 is shown moving within a threshold distance 5119 while communicating with an electronic device 100 and a wireless accessory case 480, and a corresponding muting of the wireless accessory device 480 as shown by a volume indicator 5150. Configuring the sound settings of the accessory case based on the settings of a device that communicates with one or more accessories associated with the accessory charging case avoids requiring a user to separately configure the sound settings of the device and the accessory case, which reduces the number of inputs required to perform an operation. Additionally, configuring the sound settings of the accessory case based on the settings of a device that communicates with one or more accessories associated with the accessory charging case avoids requiring a user to directly connect the accessory charging case and the device, which reduces the number of inputs / user interactions required to perform an operation.

[0356] In some embodiments, the enabled state (848) of the sound setting is stored at the accessory charging box (e.g., stored in memory 349). In some embodiments, the setting state is synchronized with the electronic device (or a server system or other device associated with the same user account) based on a communication coupling established between the electronic device and the accessory charging device. For example, based on the charging state of the accessory paired or connected to a first user device (e.g., a phone, laptop, or other electronic device), the accessory charging box obtains sound setting information (e.g., based on the mute setting of the first user device) from the first user device, in which case the sound setting information causes the sound setting to be set to an enabled state. In addition, the setting is maintained internally by the accessory charging box until the first user device or another user device changes the setting. Continuing with the example, the accessory charging box is subsequently paired or connected to a second user device and obtains second sound setting information from the second user device. In this example, the second sound setting information causes the sound setting to be set to a disabled state (e.g., based on the second user device enabling the audio output mute setting). Saving the enabled state of the sound setting and reusing the same enabled state avoids requiring the user to configure the enabled state of the sound setting again when subsequently interacting with the accessory box, which reduces the number of inputs required to perform the operation.

[0357] It should be understood that FIG. 8A to FIG. 8D The specific order in which the operations in the description are described is merely an example and is not intended to indicate that the order is the only order in which the operations may be performed. A person of ordinary skill in the art will recognize many ways to reorder the operations described herein. In addition, it should be noted that the details of other processes described herein in conjunction with other methods described herein (e.g., methods 600, 700, and 900) are also applicable in a similar manner to the details of the processes described above in conjunction with FIG. 8A to FIG. 8DThe method 800 is described. For example, the inputs, gestures, functions, and feedback described above with reference to the method 800 optionally have one or more of the features of the inputs, gestures, functions, and feedback described herein with reference to other methods described herein (e.g., methods 600, 700, and 900). For the sake of brevity, these details are not repeated here.

[0358] 9A to 9C 1 is a flow chart illustrating a method 900 for adjusting the audio output of a wearable audio output device according to some embodiments. The method 900 is performed on an electronic device (e.g., device 300 of FIG. 3 , or device 300 of FIG. 3 ) that includes a display generation component and an optional touch-sensitive surface or communicates with the display generation component and the optional touch-sensitive surface. Figure 1A The method 900 is performed at a portable multifunction device 100 of the present invention. In some embodiments, the electronic device is a desktop computer, a laptop computer, a tablet computer, a smart phone, a smart watch, or other computing device. In some embodiments, the display generating component is a touch screen display. In some embodiments, the display is separate from the touch-sensitive surface. Some operations in method 900 are optionally combined, and / or the order of some operations is optionally changed.

[0359] As described below, method 900 provides an improved interface for controlling audio output by changing the audio output mode of an audio output device (such as a wearable device) between audio pass-through and conversation enhancement in response to a particular type of gesture. Providing additional control options for controlling audio output (such as changing the audio output mode in response to a particular gesture) reduces clutter on the user interface, reduces the number of inputs required to execute control options, enhances the operability of the electronic device, and makes the user-device interface more efficient (e.g., by helping the user achieve the desired results and reducing user errors when operating / interacting with the electronic device), thereby further reducing power usage and extending the battery life of the electronic device by enabling the user to use the electronic device more quickly and efficiently.

[0360] The electronic device causes (902) display of a user interface (e.g., user interface 5164) that includes volume control elements (e.g., Figure 5BL to Figure 5B O volume control 5166).

[0361] The electronic device detects (904) an input corresponding to a volume control element (eg, via a touch screen, a motion sensor, a rotatable input element, a button, etc.).

[0362] In response to detecting an input: (i) based on determining that the input is a first type of gesture (e.g., the input satisfies a first gesture criterion, such as a slide gesture criterion requiring application of touch input and movement of the touch input), the electronic device adjusts (906) the volume of an audio output of one or more wearable audio output devices; and (ii) based on determining that the input is a second type of gesture (e.g., a tap, double tap, or long press), the electronic device causes display of a conversation enhancement element for the one or more wearable audio output devices, the conversation enhancement element initiating a process for adjusting the audio output of the one or more wearable audio output devices when selected to enhance conversation audio corresponding to a conversation having audio accessible by the one or more wearable audio output devices relative to other audio output by the one or more wearable audio output devices. For example, Figure 5BM User input 5168 (e.g., a swipe or drag gesture) is shown, and Figure 5BN The corresponding change in volume of the audio output is shown. To further illustrate this example, Figure 5B O shows user input 5182 (e.g., a tap or press gesture), and Figure 5BP A corresponding user interface 5184 with a conversation enhancement control 5190 is shown. In some embodiments, the electronic device simultaneously displays a volume control element and a conversation enhancement element (e.g., as shown in user interface 5184, as shown in FIG. Figure 5BP ). In some embodiments, the first type of gesture is a slide, drag, rotate and / or air gesture. In some embodiments, the conversation audio includes conversation audio picked up by one or more microphones of the wearable audio output device, conversation audio picked up by one or more microphones of the electronic device, and / or conversation audio picked up by one or more external microphones. In some embodiments, the second type of gesture is a double-click gesture that meets one or more gesture criteria, which requires two single-click gestures to be performed within a threshold amount of time and a threshold distance from each other. In some embodiments, in response to activating a volume control element (e.g., by pressing hard or long pressing an input device (touch-sensitive surface or mechanical button)), the electronic device updates the user interface (or replaces the display of the (e.g., first) user interface with the display of the second user interface) to include a conversation enhancement element. In some embodiments, the conversation enhancement element is conditionally displayed (at least in part) based on determining that one or more wearable audio output devices are communicating with the electronic device and the one or more wearable audio output devices are being used (e.g., by playing audio or being inserted into the user's ears). In some embodiments, when one or more wearable audio output devices are not communicating with the electronic device and / or are not in use, the conversation enhancement element is not displayed.

[0363] In some embodiments, selection of the conversation enhancement element initiates (908) a process for adjusting the audio output of one or more wearable audio output devices to enhance the conversation audio while disabling active noise cancellation for ambient noise at the one or more wearable audio output devices. For example, when in noise cancellation mode (e.g., such as Figure 5BV In some embodiments, selection of the conversation enhancement element initiates a process for adjusting the audio output of one or more wearable audio output devices to enhance conversation audio while enabling transparency of ambient sound (e.g., greater than zero or another preset threshold) at the one or more wearable audio output devices. The audio output is adjusted to enhance the operability of the conversation audio enhancement device and reduce power usage and extend the battery life of the device only when ANC is disabled.

[0364] In some embodiments, the first type of gesture is (910) a sliding gesture at a location corresponding to a volume control element, and the volume is adjusted according to the movement of the sliding gesture (e.g., as Figure 5BM to Figure 5BN ), and the second type of gesture is a press gesture at a location corresponding to the volume control element (e.g., as Figure 5B O). Detecting and responding to different types of gestures in different ways enhances the operability of the device (e.g., providing flexibility without cluttering the user interface with additional display controls, and reducing the number of inputs required to access that flexibility) and makes the user-device interface more efficient.

[0365] In some embodiments, in response to detecting the input, based on determining that the input is a third type of gesture, the electronic device activates (912) an audio function other than the display of the volume adjustment and conversation enhancement elements (e.g., the function changes the audio setting or mode of the wearable audio output device). For example, the third type of gesture is a long press and / or a deep press, and the audio function changes the audio mode (e.g., a noise control mode). Detecting and responding to different types of gestures in different ways enhances the operability of the device (e.g., providing flexibility without cluttering the user interface with additional display controls, and reducing the number of inputs required to access the flexibility) and makes the user device interface more efficient.

[0366] In some embodiments, based on determining that the input is a gesture of the second type, the electronic device causes (914) display of an audio control user interface (eg, Figure 5BP5184), the audio control user interface including multiple elements for operation of one or more wearable audio output devices (e.g., noise control 5194, spatial audio control 5192, and conversation enhancement control 5190), wherein the multiple elements include a conversation enhancement element (e.g., conversation enhancement control 5190). Displaying the audio control user interface in response to specific types of gestures enhances the operability of the electronic device (e.g., providing flexibility without cluttering the user interface with additional displayed controls, and reducing the number of inputs required to access the flexibility) and makes the user device interface more efficient.

[0367] In some embodiments, the plurality of elements include (916) an ambient noise control element (e.g., a noise control 5194) and one or more spatial audio control elements (e.g., a spatial audio control 5192). For example, the spatial audio control settings include a balance setting, a stereo setting, and / or an amplification setting. In some embodiments, the ambient noise control element causes activation of an ambient noise adjustment function when selected. In some embodiments, the ambient noise control element adjusts active noise cancellation of ambient noise, transparency of ambient sound, and / or other ambient sound functions when selected. For example, increasing the transparency of ambient sound includes capturing audio using an external microphone at one or more wearable audio output devices and playing the audio via one or more speakers at one or more wearable audio output devices. In some embodiments, the electronic device or one or more wearable audio output devices include one or more pass-through audio components (e.g., active when the device or one or more wearable audio output devices are operating in a transparent mode) and one or more cancellation audio components (e.g., active when the device or one or more wearable audio output devices are operating in a noise cancellation mode). Presenting the ambient noise control element and the dialogue enhancement element enhances the operability of the device (e.g., provides flexibility by reducing the number of required inputs) and makes the user device interface more efficient.

[0368] In some embodiments, the plurality of elements include (920) a real-time listening element (e.g., Figure 5BX), the real-time listening element, when selected, initiates a process for providing audio data at one or more wearable audio output devices, wherein the audio data is captured via a microphone at an electronic device. In some embodiments, the selection of the real-time listening element enables the real-time listening mode (e.g., the selection of the real-time listening element switches the real-time listening mode). In some embodiments, when the real-time listening mode is enabled, the audio data is captured via one or more microphones at the electronic device and transmitted to a remote audio output device (e.g., an earphone, an earplug, or a device including a speaker component) for playback to the user. For example, the audio data captured via one or more microphones is transmitted to a paired earphone (or one or more wearable audio output devices) worn by the user, so that the user is provided with playback of the sounds occurring around the electronic device. Presenting real-time listening elements and dialogue enhancement elements enhances the operability of the device (e.g., providing flexibility by reducing the number of required inputs) and makes the user device interface more efficient.

[0369] In some embodiments, the plurality of elements includes (922) a background sound element (e.g., Figure 5BX 5232), which, when selected, initiates a process for generating background sounds at one or more wearable audio output devices (e.g., generating white noise, water sounds (e.g., ocean or rain sounds), or other sounds intended to mask ambient noise). Presenting background sound elements and conversation enhancement elements enhances device operability (e.g., provides flexibility by reducing the number of required inputs) and makes the user device interface more efficient.

[0370] In some embodiments, the plurality of elements include (924) an element (e.g., a threshold value) that, when selected, initiates a process of reducing the volume of sounds that meet one or more criteria (e.g., the one or more criteria include a maximum decibel threshold set by the electronic device and / or a user). Figure 5BX In some embodiments, the maximum decibel slider is displayed with (or in response to selection of) an element for reducing loudness, such as a Figure 5CB Presenting the loudness reduction element and the conversation enhancement element enhances the operability of the device (e.g., provides flexibility by reducing the number of required inputs) and makes the user device interface more efficient.

[0371] In some embodiments, the electronic device detects (926) a second input corresponding to the volume control element and, in response to the second input: (i) based on a determination that the second input is a gesture of the second type and at least one of the one or more wearable audio output devices is operating in transparent mode (e.g., as shown in FIG. 1 ), Figure 5BQIn some embodiments, based on the active ANC mode, conversation enhancement control 5190 is not displayed in user interface 5184. Forgoing displaying the conversation enhancement element when the device is not operating in transparent mode enhances the operability of the device and makes the user-device interface more efficient (e.g., by helping the user achieve expected results and reducing user errors when operating / interacting with the device), which further reduces power usage and extends the battery life of the device by enabling the user to use the device more quickly and efficiently.

[0372] In some embodiments, when a conversation enhancement element is displayed, the electronic device detects (928) a third input corresponding to the conversation enhancement element (e.g., a tap, double-click, or long press gesture), and in response to detecting the third input, the electronic device causes the conversation enhancement adjustment control to be displayed, for example, Figure 5BR to Figure 5BQ In addition, when the dialogue enhancement adjustment control is displayed, the electronic device detects a fourth input corresponding to the dialogue enhancement adjustment control, and in response to detecting the fourth input, the electronic device adjusts the adjustment amount applied to the dialogue audio according to the fourth input. For example, Figure 5BQ Input 5198 at conversation enhancement control 5190 is shown, and Figure 5BRDisplay of a conversation enhancement adjustment control 5206 in response to input 5198 is shown. For example, the fourth input is a slide, drag, rotation, or air gesture, and the adjustment is based on the movement and / or direction of the gesture. In some embodiments, the display of the conversation enhancement slider replaces the display of the conversation enhancement element. In some embodiments, the conversation enhancement slider is displayed adjacent to the conversation enhancement element (e.g., the conversation enhancement slider replaces one or more other elements in the user interface, such as control elements for transparency and / or spatial audio). Alternatively, in some embodiments, in response to detecting the first input, or in response to detecting the first input and meeting additional criteria (e.g., at least a predefined amount of time has passed while continuing to display the (settings) user interface), the conversation enhancement slider is (automatically) displayed. In some embodiments, the adjustment amount and / or adjustment direction (e.g., increase or decrease) corresponds to the movement, direction, position, duration, force and / or pressure of the fourth input. In some embodiments, the fourth input is a specific type of input (e.g., a tap), and the adjustment amount is preset for the specific type of input (e.g., each tap increases by 5%, 10%, 20%, 25%, 40%, or 50% or 5, 10, 25, 50, or 100 units (e.g., dB)). Displaying the conversation enhancement adjustment control and adjusting the adjustment amount applied to the conversation audio based on the input at the conversation enhancement adjustment control enhances the operability of the device (e.g., providing flexibility without cluttering the user interface with additional displayed controls, and reducing the number of inputs required to access that flexibility) and makes the user device interface more efficient.

[0373] In some embodiments, electronic device detection (930) includes communicating with an accessibility user interface element (e.g., Figure 5BW The electronic device detects a series of one or more inputs corresponding to a fifth input (e.g., a tap, a double tap, or a long press gesture) of the hearing control 5222), and in response to detecting the fifth input, causes the accessibility user interface (e.g., Figure 5BX5230), the accessibility user interface including a conversation enhancement element (e.g., conversation enhancement control 5242). For example, the accessibility user interface element is displayed in a control center UI or settings menu of one or more wearable audio output devices. In some embodiments, the series of one or more inputs includes one or more of the following: an input corresponding to an accessibility element in the settings user interface (e.g., causing the accessibility user interface to be displayed when selected), an input corresponding to an audio element in the accessibility user interface (e.g., causing the audio accessibility user interface to be displayed when selected), and an input corresponding to a wearable audio output device accommodation element in the audio accessibility user interface (e.g., causing the wearable audio output device accommodation user interface to be displayed when selected). In some embodiments, the series of one or more inputs includes an input corresponding to a control center element in the settings user interface (e.g., causing the control center user interface to be displayed when selected), and / or an input corresponding to a hearing element in the control center user interface (e.g., causing the hearing user interface to be displayed when selected). In some embodiments, the series of one or more inputs includes one or more of the following: an input corresponding to an audio control center element in the control center interface (e.g., causing the audio control center user interface to be displayed when selected), an input corresponding to a wearable audio output device housing element in the audio control center user interface (e.g., causing the wearable audio output device housing user interface to be displayed when selected), and an input corresponding to an ambient noise control element in the wearable audio output device housing user interface. Displaying an accessibility user interface in response to the series of one or more inputs enhances the operability of the device (e.g., providing flexibility without cluttering the user interface with additional display controls) and makes the user device interface more efficient.

[0374] It should be understood that 9A to 9C The specific order in which the operations have been described herein is merely exemplary and is not intended to indicate that the order is the only order in which the operations may be performed. A person of ordinary skill in the art will recognize a variety of ways to reorder the operations described herein. In addition, it should be noted that the details of other processes described herein in conjunction with other methods described herein (e.g., methods 600, 700, and 800) are also applicable in a similar manner to the details of the processes described above in conjunction with Figures 9A-9C The method 900 described herein. For example, the inputs, gestures, functions, and feedback described above with reference to the method 900 optionally have one or more of the features of the inputs, gestures, functions, and feedback described herein with reference to other methods described herein (e.g., methods 600, 700, and 800). For the sake of brevity, these details are not repeated here.

[0375] References FIG. 6A to FIG. 6C , 7A to 7C , FIG. 8A to FIG. 8D as well as 9A to 9C The described operations are optionally performed by Figure 1A to Figure 1B , Figure 3C and Figure 3E The components depicted are implemented. For example, the detection operation 904, the adjustment operation 906, and the activation operation 912 are optionally implemented by the event classifier 170, the event identifier 180, and the event handler 190. The event monitor 171 in the event classifier 170 detects the contact on the touch-sensitive display system 112, and the event distributor module 174 delivers the event information to the application 136-1. The corresponding event identifier 180 of the application 136-1 compares the event information with the corresponding event definition 186, and determines whether the first contact at the first position on the touch-sensitive surface (or whether the rotation of the device) corresponds to a predefined event or sub-event, such as the selection of an object on the user interface, or the rotation of the device from one orientation to another orientation. When the corresponding predefined event or sub-event is detected, the event identifier 180 activates the event handler 190 associated with the detection of the event or sub-event. The event handler 190 optionally uses or calls the data updater 176 or the object updater 177 to update the application internal state 192. In some embodiments, the event handler 190 accesses the corresponding GUI updater 178 to update the content displayed by the application. Similarly, those skilled in the art will clearly know that based on Figure 1A to Figure 1B , Figure 3C and Figure 3E How the components depicted in the figure can implement other processes.

[0376] In addition, in the method described herein where one or more steps depend on one or more conditions being met, it should be understood that the method can be repeated in multiple repetitions so that in the process of repetition, all conditions for determining the steps in the method have been met in different repetitions of the method. For example, if the method needs to perform the first step (if the condition is met), and perform the second step (if the condition is not met), then the ordinary technician will know that the steps stated are repeated until both the condition is met and the condition is not met (in no particular order). Therefore, the method described as having one or more steps depending on one or more conditions being met can be rewritten as a method of repeating until each condition described in the method is met. However, this does not require the system or computer-readable medium to declare that the system or computer-readable medium contains instructions for performing a contingent operation based on the satisfaction of the corresponding one or more conditions, and is therefore able to determine whether the possible situation has been met without explicitly repeating the steps of the method until all conditions for determining the steps in the method have been met. It will also be understood by ordinary technicians in the art that, similar to the method with the contingent step, the system or computer-readable storage medium can repeat the steps of the method as many times as needed to ensure that all the contingent steps have been performed.

[0377] For the purpose of explanation, the foregoing description is described by reference to specific embodiments. However, the above exemplary discussion is not intended to be exhaustive or to limit the invention to the disclosed precise form. According to the above teachings, many modifications and variations are possible. The embodiments are selected and described in order to best illustrate the principles of the invention and its practical application, so that other persons skilled in the art can best use the invention and the various described embodiments with various modifications suitable for the specific purposes contemplated.

Claims

1. A method, the method include: At a wearable audio output device, the wearable audio output device comprising a first portion configured to be inserted into an ear of a user and a second portion extending from the first portion of the wearable audio output device, the second portion comprising one or more input devices: detecting input via the one or more input devices; as well as In response to detecting the input, in accordance with determining that the input is a swipe gesture along the second portion of the wearable audio output device, adjusting an output volume of the wearable audio output device based on movement of the swipe gesture along the second portion of the wearable audio output device.

2. The method according to claim 1, in: The second portion comprises a handle of the wearable audio output device; and The slide gesture includes movement of one or more fingers along the length of the handle.

3. The method according to claim 1, in: The first portion includes an audio output device configured to be inserted into an ear of the user and one or more positioning elements configured to retain the audio output device in the ear of the user after insertion; as well as The second portion of the wearable audio output device includes an elongated portion extending from the first portion.

4. A method according to any one of claims 1 to 3, wherein the one or more input devices comprise a series of capacitive sensors arranged to detect user gestures.

5. The method of claim 4, wherein the second portion of the wearable audio output device comprises a housing having one or more physically distinct portions at locations corresponding to the series of capacitive sensors.

6. The method according to any one of claims 1 to 5, in: The wearable audio output device communicates with a second wearable audio output device to form a pair of wearable audio output devices; and Adjusting the output volume of the wearable audio output device includes adjusting the output volume of both the wearable audio output device and the second wearable audio output device.

7. The method according to claim 6, further comprising: include: detecting a second input via an input device of the second wearable audio output device; as well as In response to detecting the second input, adjusting output volumes of both the wearable audio output device and the second wearable audio output device based on determining that the second input is a slide gesture along a second portion of the second wearable audio output device.

8. The method according to any one of claims 6 to 7, further comprising providing audio feedback of the volume adjustment to a user of the wearable audio output device via an audio output device of the wearable audio output device in conjunction with adjusting the output volume of the wearable audio output device.

9. The method of claim 8, wherein providing the audio feedback of volume adjustment comprises providing the audio feedback of volume adjustment at both the wearable audio output device and the second wearable audio output device.

10. The method of any one of claims 8 to 9, further comprising, in response to detecting the input, activating a function of the wearable audio output device based on determining that the input is a non-slide gesture, wherein the function is different from adjusting the output volume.

11. The method of claim 10, further comprising, in conjunction with activating the function of the wearable audio output device, providing audio feedback of the activation of the function via the audio output device, and forgoing providing the audio feedback at the second wearable audio output device in the pair of wearable audio output devices.

12. The method of any one of claims 10 to 11, wherein the functionality of the wearable audio output device comprises an audio playback functionality.

13. The method according to any one of claims 10 to 11, wherein the functionality of the wearable audio output device comprises an ambient noise adjustment functionality.

14. The method of any one of claims 10 to 11, wherein the functionality of the wearable audio output device comprises a digital assistant functionality.

15. The method according to any one of claims 1 to 14, further comprising: include: detecting a third input via the one or more input devices; as well as In response to detecting the third input: adjusting the output volume of the wearable audio output device based on determining that the third input is a sliding gesture along the second portion of the wearable audio output device and determining that the first portion of the wearable audio output device is inserted into an ear of a user of the wearable audio output device; as well as Based on determining that the third input is the sliding gesture along the second portion of the wearable audio output device and determining that the first portion of the wearable audio output device is not inserted into an ear of the user of the wearable audio output device, forgoing adjusting the output volume of the wearable audio output device.

16. The method of any one of claims 1 to 15, wherein the one or more input devices include a first type of sensor and a second type of sensor; wherein the input is detected via a sensor of the first type; as well as The method further comprises: detecting a fourth input via the sensor of the second type; as well as In response to detecting the fourth input, activating a function of the wearable audio output device other than adjusting the output volume.

17. The method according to any one of claims 1 to 16, further comprising: include: At an electronic device distinct from the wearable audio output device, the electronic device communicates with a display generating component: establishing a connection between the electronic device and the wearable audio output device; as well as After establishing the connection, a user interface is caused to be displayed via the display generating component, the user interface showing a simulated sliding gesture and a corresponding output volume adjustment.

18. A wearable audio output device, the wearable audio output device include: a first portion configured to be inserted into an ear of a user; a second portion extending from the first portion and comprising one or more input devices; one or more processors; as well as A memory storing one or more programs, wherein the one or more programs are configured to be executed by the one or more processors, the one or more programs comprising instructions for performing the following operations: detecting input via the one or more input devices; as well as In response to detecting the input, in accordance with determining that the input is a swipe gesture along the second portion of the wearable audio output device, adjusting an output volume of the wearable audio output device based on movement of the swipe gesture along the second portion of the wearable audio output device.

19. A computer-readable storage medium storing one or more programs, the one or more programs comprising instructions that, when executed by a wearable audio output device comprising a first portion configured to be inserted into an ear of a user and a second portion extending from the first portion and comprising one or more input devices, cause the wearable audio output device to: detecting input via the one or more input devices; and In response to detecting the input, in accordance with determining that the input is a swipe gesture along the second portion of the wearable audio output device, adjusting an output volume of the wearable audio output device based on movement of the swipe gesture along the second portion of the wearable audio output device.

20. A wearable audio output device, the wearable audio output device include: a first portion configured to be inserted into an ear of a user; a second portion extending from the first portion and comprising one or more input devices; means for detecting input via the one or more input devices; as well as Responsive to detecting the input and based on determining that the input is a sliding gesture along the second portion of the wearable audio output device, means is enabled for adjusting an output volume of the wearable audio output device based on movement of the sliding gesture along the second portion of the wearable audio output device.

21. An information processing apparatus for use in a wearable audio output device, the wearable audio output device comprising a first portion configured to be inserted into an ear of a user and a second portion extending from the first portion and comprising one or more input devices, the information processing apparatus include: means for detecting input via the one or more input devices; as well as Responsive to detecting the input and based on determining that the input is a sliding gesture along the second portion of the wearable audio output device, means is enabled for adjusting an output volume of the wearable audio output device based on movement of the sliding gesture along the second portion of the wearable audio output device.

22. A wearable audio output device, the wearable audio output device include: a first portion configured to be inserted into an ear of a user; a second portion extending from the first portion and comprising one or more input devices; one or more processors; as well as A memory storing one or more programs, wherein the one or more programs are configured to be executed by the one or more processors, the one or more programs comprising instructions for executing any one of the methods according to claims 1 to 17.

23. A computer-readable storage medium storing one or more programs, the one or more programs comprising instructions that, when executed by an electronic device having a wearable audio output device comprising a first portion configured to be inserted into an ear of a user and a second portion extending from the first portion and comprising one or more input devices, cause the wearable audio output device to perform any one of the methods of claims 1 to 17.

24. A graphical user interface on an electronic device that communicates with a wearable audio output device, the electronic device comprising a display, a touch-sensitive surface, a memory, and one or more processors for executing one or more programs stored in the memory, the graphical user interface comprising a user interface displayed according to any one of the methods of claims 1 to 17.

25. A wearable audio output device, the wearable audio output device include: a first portion configured to be inserted into an ear of a user; a second portion extending from the first portion and comprising one or more input devices; as well as Apparatus for carrying out any of the methods according to claims 1 to 17.

26. An information processing apparatus for use in a wearable audio output device, the wearable audio output device comprising a first portion configured to be inserted into an ear of a user and a second portion extending from the first portion and comprising one or more input devices, the information processing apparatus include: Apparatus for carrying out any of the methods according to claims 1 to 17.

27. A method, the method comprising: include: At an electronic device including or in communication with a display generating component: detecting an occurrence of a corresponding condition associated with an electronic accessory other than the electronic device, the electronic accessory being in communication with the electronic device; as well as In response to detecting the occurrence of the corresponding condition, causing a user interface corresponding to the corresponding condition to be displayed via the display generation component, the user interface including a representation of the electronic accessory, wherein causing the user interface to be displayed includes: Based on determining that the electronic accessory includes a first physical marker, causing a representation of the first physical marker to be displayed in the user interface; as well as Based on determining that the electronic accessory includes a second physical marker that is different from the first physical marker, a representation of the second physical marker is displayed in the user interface.

28. The method of claim 27, wherein the first physical marker is specified or selected by a user when purchasing the electronic accessory.

29. The method according to any one of claims 27 to 28, wherein the occurrence of the corresponding condition comprises a wireless coupling event between the electronic device and the electronic accessory.

30. The method of any one of claims 27-28, wherein the occurrence of the corresponding condition comprises proximity-based communication between the electronic device and the electronic accessory.

31. The method according to any one of claims 27 to 28, in: The occurrence of the corresponding condition includes a state change event at the electronic accessory; and The user interface corresponding to the corresponding condition includes state information corresponding to the state change event.

32. The method of claim 31, wherein the state change event comprises a change in an open or closed state of the electronic accessory.

33. The method of claim 31, wherein the state change event comprises a charging event at the electronic accessory.

34. The method according to any one of claims 27 to 28, in: The occurrence of the corresponding condition includes an error event; and The user interface corresponding to the corresponding condition includes error information corresponding to the error event.

35. The method according to any one of claims 27 to 34 further comprises, based on determining that the electronic accessory does not include the first physical mark, causing the user interface including a representation of the electronic accessory to be displayed without the representation of the first physical mark.

36. The method of any one of claims 27 to 35, wherein the representation of the electronic accessory comprises a three-dimensional representation of the electronic accessory.

37. The method of any one of claims 27 to 36, wherein the user interface comprises one or more animated movements of a representation of the electronic accessory.

38. The method according to any one of claims 27 to 37, further comprising: include: detecting an occurrence of a corresponding condition associated with a second electronic accessory different from the electronic device and the electronic accessory, the second electronic accessory being in communication with the electronic device and being of the same device type as the electronic accessory; as well as In response to detecting an occurrence of the corresponding condition associated with the second electronic accessory: Based on determining that the second electronic accessory does not include the first physical mark, a second user interface corresponding to the corresponding condition is displayed via the display generation component, wherein the second user interface includes a representation of the second electronic accessory without a representation of the first physical mark.

39. The method according to claim 38, in: The second electronic accessory includes a third physical marker different from the first physical marker; and The second user interface includes a representation of the second electronic accessory with a representation of the third physical indicia.

40. The method according to any one of claims 27 to 39, further comprising: include: detecting, while the user interface is displayed, a user input corresponding to a user interface element on the user interface, wherein the user interface element corresponds to a function of the electronic accessory; as well as In response to the user input, the function of the electronic accessory is activated.

41. An electronic device, the electronic device include: one or more processors; as well as A memory storing one or more programs, wherein the one or more programs are configured to be executed by the one or more processors, the one or more programs comprising instructions for performing the following operations: detecting an occurrence of a corresponding condition associated with an electronic accessory other than the electronic device, the electronic accessory being in communication with the electronic device; as well as In response to detecting the occurrence of the corresponding condition, causing a user interface corresponding to the corresponding condition to be displayed via a display generation component, the user interface including a representation of the electronic accessory, wherein causing the user interface to be displayed includes: Based on determining that the electronic accessory includes a first physical marker, causing a representation of the first physical marker to be displayed in the user interface; as well as Based on determining that the electronic accessory includes a second physical marker that is different from the first physical marker, a representation of the second physical marker is displayed in the user interface.

42. A computer-readable storage medium storing one or more programs, the one or more programs comprising instructions that, when executed by an electronic device, cause the electronic device to: detecting an occurrence of a corresponding condition associated with an electronic accessory other than the electronic device, the electronic accessory communicating with the electronic device ； as well as In response to detecting the occurrence of the corresponding condition, causing a user interface corresponding to the corresponding condition to be displayed via a display generation component, the user interface including a representation of the electronic accessory, wherein causing the user interface to be displayed includes: Based on determining that the electronic accessory includes a first physical marker, causing a representation of the first physical marker to be displayed in the user interface; as well as Based on determining that the electronic accessory includes a second physical marker that is different from the first physical marker, a representation of the second physical marker is displayed in the user interface.

43. An electronic device, the electronic device include: means for detecting the occurrence of a corresponding condition associated with an electronic accessory other than the electronic device, the electronic accessory being in communication with the electronic device; means enabled in response to detecting an occurrence of the corresponding condition for causing a user interface corresponding to the corresponding condition to be displayed, the user interface including a representation of the electronic accessory; means for causing a representation of a first physical indicia to be displayed in the user interface, enabled in response to determining that the electronic accessory includes a first physical indicia; as well as Means for causing a representation of a second physical indicia different from the first physical indicia to be displayed in the user interface are enabled based on a determination that the electronic accessory includes a second physical indicia different from the first physical indicia.

44. An information processing device used in an electronic device, the information processing device include: means for detecting the occurrence of a corresponding condition associated with an electronic accessory other than the electronic device, the electronic accessory being in communication with the electronic device; means enabled in response to detecting an occurrence of the corresponding condition for causing a user interface corresponding to the corresponding condition to be displayed via a display generation component, the user interface including a representation of the electronic accessory; means for causing a representation of a first physical indicia to be displayed in the user interface, enabled in response to determining that the electronic accessory includes a first physical indicia; as well as Means for causing a representation of a second physical indicia different from the first physical indicia to be displayed in the user interface are enabled based on a determination that the electronic accessory includes a second physical indicia different from the first physical indicia.

45. An electronic device, the electronic device include: one or more processors; as well as A memory storing one or more programs, wherein the one or more programs are configured to be executed by the one or more processors, and the one or more programs include instructions for executing any one of the methods according to claims 27 to 40.

46. ​​A computer-readable storage medium storing one or more programs, the one or more programs comprising instructions, which when executed by an electronic device cause the electronic device to perform any one of the methods according to claims 27 to 40.

47. A graphical user interface on an electronic device, the electronic device having a memory and one or more processors executing one or more programs stored in the memory, the graphical user interface comprising a user interface displayed according to any one of the methods described in claims 27 to 40.

48. An electronic device, the electronic device include: Apparatus for carrying out any of the methods according to claims 27 to 40.

49. An information processing device used in an electronic device, the information processing device include: Apparatus for performing any of the methods according to claims 27 to 40.

50. A method, the method comprising: include: At the accessory charging case that includes the speaker: detecting a first event comprising a change in an open or closed state of the accessory charging case; as well as In response to detecting the change in the open or closed state of the accessory charging case, causing the speaker to generate an audio notification corresponding to a state of at least one of the accessory charging case and one or more accessories associated with the accessory charging case.

51. The method of claim 50, wherein the audio notification includes one or more words describing the status of the accessory charging case and at least one of the one or more accessories associated with the accessory charging case.

52. The method of any one of claims 50 to 51, wherein the status comprises a charging status of the accessory charging case not satisfying one or more preset criteria.

53. The method of any one of claims 50 to 51, wherein the status corresponds to a charging status of at least one of the one or more accessories associated with the accessory charging case.

54. The method of any one of claims 50 to 51, wherein the state comprises a state of being communicatively coupled between the accessory charging case and at least one of the one or more accessories associated with the accessory charging case.

55. The method according to any one of claims 50 to 51, in: The accessory charging box is configured to accommodate multiple accessories simultaneously; The first event comprises closing of the accessory charging case; and The state corresponds to a determination that the accessory charging case contains only a subset of the plurality of accessories.

56. The method of any one of claims 50 to 51, wherein the state corresponds to a reset event of the accessory charging case.

57. The method of any one of claims 50 to 51, wherein the state corresponds to determining that the accessory charging case contains a plurality of accessory devices and determining that the plurality of accessory devices do not match.

58. The method of claim 57, wherein the first event comprises opening of the accessory charging case.

59. The method of any one of claims 57 to 58, wherein the accessory charging box communicates with a display generating component, and The method also includes causing a user interface to be displayed via the display generation component, the user interface including a mismatch notification.

60. The method of claim 59, wherein the user interface further comprises a representation of the accessory charging case and corresponding representations of the plurality of accessory devices.

61. The method according to any one of claims 59 to 60, in: Determining that the plurality of accessory devices do not match includes determining that respective accessories of the plurality of accessory devices have different owners; and The user interface also includes ownership information for the plurality of accessory devices.

62. The method according to any one of claims 59 to 60, in: Determining that the plurality of accessory devices do not match includes determining that respective accessories of the plurality of accessory devices have different hardware and / or software versions; and The user interface also includes version information of the plurality of accessory devices.

63. The method according to any one of claims 50 to 62, further comprising: include: detecting a second event comprising a change in a charging state of at least one of the accessory charging case and the one or more accessories associated with the accessory charging case; as well as In response to detecting the second event, the speaker is caused to generate a second audio notification, different from the audio notification, corresponding to the change in charging status.

64. The method of claim 63, wherein the change in charging status comprises initiation or termination of charging of at least one of the one or more accessories associated with the accessory charging case.

65. The method according to any one of claims 50 to 64, further comprising: include: Based on a user request to locate the accessory charging box, the speaker generates a third audio notification corresponding to the user request, wherein the third audio notification is different from the audio notification.

66. The method according to any one of claims 50 to 65, further comprising: include: detecting a third event comprising a change in a state of the accessory charging case; as well as In response to detecting the third event: causing the speaker to generate a fourth audio notification based on determining that a sound setting of the accessory charging box is enabled; as well as According to determining that the sound setting of the accessory charging box is in a disabled state, Abandoning causes the fourth audio notification to be generated.

67. The method of claim 66, further comprising: include: At an electronic device other than the accessory charging case, the electronic device communicates with a display generating component: causing a user interface to be displayed via the display generating component, the user interface including control elements for the sound settings of the accessory charging case; detecting an input corresponding to the control element; as well as In response to detecting the input, the sound setting of the accessory charging case is set to the disabled state.

68. The method of claim 67, further comprising: include: after setting the sound setting of the accessory charging case to the disabled state, detecting a fourth event including a change in an open or closed state of the accessory charging case; as well as In response to detecting the fourth event and in accordance with the sound setting being in the disabled state, abandoning causing the speaker to generate an audio notification corresponding to a status of the accessory charging case and / or one or more accessories associated with the accessory charging case.

69. The method of any one of claims 66 to 67, further comprising setting the sound setting to the disabled state based on an audio output mute setting enabled at an electronic device communicatively coupled to the accessory charging case.

70. The method of any one of claims 66 to 69, further comprising setting the sound setting to the disabled state based on a focus mode active at an electronic device communicatively coupled to the accessory charging case.

71. A method according to any one of claims 67 to 70, wherein the sound setting of the accessory charging box is set to the disabled state based on the electronic device being communicatively coupled to at least one of the one or more accessories associated with the accessory charging box.

72. The method of any one of claims 66 to 70, wherein the enabled state of the sound setting is stored at the accessory charging case.

73. An accessory charging box, the accessory charging box include: speaker; one or more processors; as well as A memory storing one or more programs, wherein the one or more programs are configured to be executed by the one or more processors, the one or more programs comprising instructions for performing the following operations: detecting a first event comprising a change in an open or closed state of the accessory charging case; as well as In response to detecting the change in the open or closed state of the accessory charging case, causing the speaker to generate an audio notification corresponding to a state of at least one of the accessory charging case and one or more accessories associated with the accessory charging case.

74. A computer-readable storage medium storing one or more programs, the one or more programs comprising instructions that, when executed by an accessory charging case having a speaker, cause the accessory charging case to: detecting a first event comprising a change in an open or closed state of the accessory charging case; and In response to detecting the change in the open or closed state of the accessory charging case, causing the speaker to generate an audio notification corresponding to a state of at least one of the accessory charging case and one or more accessories associated with the accessory charging case.

75. An accessory charging box, the accessory charging box include: speaker; means for detecting a first event comprising a change in an open or closed state of the accessory charging case; as well as In response to detecting the change in the open or closed state of the accessory charging case, means is enabled for causing the speaker to generate an audio notification corresponding to a state of at least one of the accessory charging case and one or more accessories associated with the accessory charging case.

76. An information processing device used in an accessory charging box having a speaker, the information processing device include: means for detecting a first event comprising a change in an open or closed state of the accessory charging case; as well as In response to detecting the change in the open or closed state of the accessory charging case, means is enabled for causing the speaker to generate an audio notification corresponding to a state of at least one of the accessory charging case and one or more accessories associated with the accessory charging case.

77. An accessory charging box, the accessory charging box include: speaker; one or more processors; as well as A memory storing one or more programs, wherein the one or more programs are configured to be executed by the one or more processors, and the one or more programs include instructions for executing any one of the methods according to claims 50 to 72.

78. A computer-readable storage medium storing one or more programs, wherein the one or more programs include instructions that, when executed by an accessory charging box having a speaker, cause the accessory charging box to perform any of the methods described in claims 50 to 72.

79. A graphical user interface on an electronic device, the electronic device having a memory and one or more processors executing one or more programs stored in the memory, the graphical user interface comprising a user interface displayed according to any one of the methods described in claims 50 to 72.

80. An accessory charging box, the accessory charging box include: speaker; as well as Apparatus for performing any of the methods according to claims 50 to 72.

81. An information processing device used in an accessory charging box having a speaker, the information processing device include: Apparatus for performing any of the methods according to claims 50 to 72.

82. A method, the method comprising: include: At an electronic device in communication with a display generating component and one or more wearable audio output devices: causing a user interface to be displayed via the display generating component, the user interface including a volume control element for the one or more wearable audio output devices; detecting an input corresponding to the volume control element; as well as In response to detecting the input: adjusting a volume of an audio output of the one or more wearable audio output devices based on determining that the input is a first type of gesture; as well as Based on determining that the input is a gesture of the second type, causing display of a conversation enhancement element for the one or more wearable audio output devices, the conversation enhancement element, when selected, initiating a process for adjusting audio output of the one or more wearable audio output devices to enhance conversation audio corresponding to a conversation having audio accessible by the one or more wearable audio output devices relative to other audio output by the one or more wearable audio output devices.

83. The method of claim 82, further comprising, based on determining that the input is the second type of gesture, displaying an audio control user interface comprising a plurality of elements for operation of the one or more wearable audio output devices, wherein the plurality of elements includes the conversation enhancement element.

84. The method of claim 83, wherein the plurality of elements comprises an ambient noise control element and one or more spatial audio control elements.

85. A method according to any one of claims 83 to 84, wherein the plurality of elements includes a real-time listening element, which, when selected, initiates a process for providing audio data at the one or more wearable audio output devices, wherein the audio data is captured via a microphone at the electronic device.

86. The method of any one of claims 83 to 85, wherein the plurality of elements includes an ambient sound element that, when selected, initiates a process for producing ambient sound at the one or more wearable audio output devices.

87. A method according to any one of claims 83 to 86, wherein the plurality of elements includes an element that, when selected, initiates a process of reducing the volume of sounds that meet one or more criteria.

88. The method according to any one of claims 82 to 87, further comprising: include: detecting a second input corresponding to the volume control element; as well as In response to the second input: causing display of the conversation enhancement element based on determining that the second input is the second type of gesture and at least one of the one or more wearable audio output devices is operating in a transparent mode; as well as Based on determining that the second input is the second type of gesture and the one or more wearable audio output devices are not operating in the transparent mode, forgoing causing the conversation enhancement element to be displayed.

89. A method according to any one of claims 82 to 88, wherein selection of the conversation enhancement element initiates a process for adjusting the audio output of the one or more wearable audio output devices to enhance conversation audio while active noise cancellation for ambient noise is disabled at the one or more wearable audio output devices.

90. The method according to any one of claims 82 to 89, further comprising: include: while the conversation enhancement element is displayed, detecting a third input corresponding to the conversation enhancement element; as well as in response to detecting the third input, causing a dialogue enhancement adjustment control to be displayed; When the conversation enhancement adjustment control is displayed, detecting a fourth input corresponding to the conversation enhancement adjustment control; as well as In response to detecting the fourth input, an adjustment amount applied to the conversation audio is adjusted based on the fourth input.

91. The method according to any one of claims 82 to 90, in: The first type of gesture includes a sliding gesture at a position corresponding to the volume control element, and the volume is adjusted according to movement of the sliding gesture; as well as The second type of gesture includes a press gesture at the location corresponding to the volume control element.

92. The method of any one of claims 82 to 91, further comprising, in response to detecting the input, activating an audio function of the display other than the volume adjustment and the dialogue enhancement element based on determining that the input is a third type of gesture.

93. The method according to any one of claims 82 to 92, further comprising: include: detecting a sequence of one or more inputs including a fifth input corresponding to an accessibility user interface element; as well as In response to detecting the fifth input, an accessibility user interface is caused to be displayed, the accessibility user interface including the conversation enhancement element.

94. An electronic device, the electronic device include: one or more processors; as well as A memory storing one or more programs, wherein the one or more programs are configured to be executed by the one or more processors, the one or more programs comprising instructions for performing the following operations: causing a user interface to be displayed via a display generation component, the user interface including a volume control element for one or more wearable audio output devices; detecting an input corresponding to the volume control element; as well as In response to detecting the input: adjusting a volume of an audio output of the one or more wearable audio output devices based on determining that the input is a first type of gesture; as well as Based on determining that the input is a gesture of the second type, causing display of a conversation enhancement element for the one or more wearable audio output devices, the conversation enhancement element, when selected, initiating a process for adjusting audio output of the one or more wearable audio output devices to enhance conversation audio corresponding to a conversation having audio accessible by the one or more wearable audio output devices relative to other audio output by the one or more wearable audio output devices.

95. A computer-readable storage medium storing one or more programs, the one or more programs comprising instructions that, when executed by an electronic device, cause the electronic device to: causing a user interface to be displayed via a display generation component, the user interface including a volume control element for one or more wearable audio output devices; Detects input corresponding to the volume control element ； as well as In response to detecting the input: adjusting a volume of an audio output of the one or more wearable audio output devices based on determining that the input is a first type of gesture; as well as Based on determining that the input is a gesture of the second type, causing display of a conversation enhancement element for the one or more wearable audio output devices, the conversation enhancement element, when selected, initiating a process for adjusting audio output of the one or more wearable audio output devices to enhance conversation audio corresponding to a conversation having audio accessible by the one or more wearable audio output devices relative to other audio output by the one or more wearable audio output devices.

96. An electronic device, the electronic device include: means for causing a user interface to be displayed via the display generation component, the user interface comprising a volume control element for one or more wearable audio output devices; means for detecting an input corresponding to said volume control element; as well as means for adjusting a volume of an audio output of the one or more wearable audio output devices enabled in response to detecting the input and based on determining that the input is a gesture of the first type; as well as Means for causing display of a conversation enhancement element for the one or more wearable audio output devices, enabled in response to detecting the input and based on determining that the input is a gesture of the second type, the conversation enhancement element, when selected, initiating a process for adjusting audio output of the one or more wearable audio output devices to enhance conversation audio corresponding to a conversation having audio accessible by the one or more wearable audio output devices relative to other audio output by the one or more wearable audio output devices.

97. An information processing device used in an electronic device, the information processing device include: means for causing a user interface to be displayed via the display generation component, the user interface comprising a volume control element for one or more wearable audio output devices; means for detecting an input corresponding to said volume control element; as well as means for adjusting a volume of an audio output of the one or more wearable audio output devices enabled in response to detecting the input and based on determining that the input is a gesture of the first type; as well as Means for causing display of a conversation enhancement element for the one or more wearable audio output devices, enabled in response to detecting the input and based on determining that the input is a gesture of the second type, the conversation enhancement element, when selected, initiating a process for adjusting audio output of the one or more wearable audio output devices to enhance conversation audio corresponding to a conversation having audio accessible by the one or more wearable audio output devices relative to other audio output by the one or more wearable audio output devices.

98. An electronic device, the electronic device include: one or more processors; as well as A memory storing one or more programs, wherein the one or more programs are configured to be executed by the one or more processors, and the one or more programs include instructions for executing any one of the methods according to claims 82 to 93.

99. A computer-readable storage medium storing one or more programs, wherein the one or more programs include instructions that, when executed by an electronic device, cause the electronic device to perform any one of the methods according to claims 82 to 93.

100. A graphical user interface on an electronic device, the electronic device having a memory and one or more processors executing one or more programs stored in the memory, the graphical user interface comprising a user interface displayed according to any one of the methods described in claims 82 to 93.

101. An electronic device, the electronic device include: Apparatus for performing any of the methods of claims 82 to 93.

102. An information processing device used in an electronic device, the information processing device include: Apparatus for performing any of the methods of claims 82 to 93.

Images