Hearing health user interface

Abstract

This disclosure relates throughout to user interfaces for hearing health. In some embodiments, the computer system prompts the user to initiate a hearing test. In some embodiments, different audio characteristics are used to modify different types of audio. In some embodiments, a visual indication of the current ambient noise level is displayed. In some embodiments, the computer system detects user input indicating the faintest volume at which the user can hear the test audio.

Description

Cross-reference to related applications

[0001] This application claims priority to U.S. Patent Application No. 18 / 963,199, filed November 27, 2024, entitled "HEARING HEALTH USER INTERFACES"; U.S. Provisional Patent Application No. 63 / 724,238, filed November 22, 2024, entitled "HEARING HEALTH USER INTERFACES"; U.S. Provisional Patent Application No. 63 / 691,213, filed September 5, 2024, entitled "HEARING HEALTH USER INTERFACES"; and U.S. Provisional Patent Application No. 63 / 606,046, filed December 4, 2023, entitled "HEARING HEALTH USER INTERFACES". The entire contents of each of these patent applications are incorporated herein by reference. Technical Field

[0002] This disclosure relates generally to computer user interfaces, and more specifically to techniques for testing and / or adjusting hearing loss. Background Technology

[0003] Some individuals experience varying degrees of hearing loss in one or both ears. Individuals can participate in hearing tests that measure their hearing. Many hearing tests involve wearing headphones that play short tones at different volumes and pitches, typically one tone at a time. The pitch is used to test whether an individual can hear high or low frequencies, as well as soft or loud sounds. Test results indicate the presence of hearing loss, which is often categorized as mild, moderate, severe, and profound hearing loss. Summary of the Invention

[0004] However, some technologies used to manage hearing health using electronic devices are often cumbersome and inefficient. For example, some existing technologies use complex and time-consuming user interfaces that may include multiple buttons or keystrokes. These technologies require more time than necessary, resulting in wasted user time and device power. This latter consideration is particularly important in battery-powered devices.

[0005] Therefore, the present invention provides electronic devices with faster and more efficient methods and interfaces for managing hearing health. Such methods and interfaces optionally complement or replace other methods for managing hearing health. These methods and interfaces reduce the cognitive burden on users and result in more efficient human-computer interfaces. For battery-powered computing devices, such methods and interfaces save power and increase the time interval between battery charging sessions.

[0006] In some implementations, a method is described. The method includes: at a computer system communicating with one or more input devices: detecting a request to pair the first audio device with the computer system via the one or more input devices when not paired with a first audio device; and in response to detecting the request to pair the first audio device with the computer system, initiating a process to pair the first audio device with the computer system, wherein the process to pair the first audio device with the computer system includes: pairing the first audio device with the computer system; providing an option to perform a hearing test using the first audio device based on determining that the first audio device is a first type of audio device; and abandoning the option to perform a hearing test using the first audio device based on determining that the first audio device is a second type of audio device different from the first type of audio device.

[0007] In some embodiments, a non-transitory computer-readable storage medium is described. This non-transitory computer-readable storage medium stores one or more programs configured to be executed by one or more processors of a computer system communicating with one or more input devices. The one or more programs include instructions for: detecting a request to pair the first audio device with the computer system via one or more input devices when not paired with the first audio device; and in response to detecting the request to pair the first audio device with the computer system, initiating a process for pairing the first audio device with the computer system, wherein the process for pairing the first audio device with the computer system includes: pairing the first audio device with the computer system; providing an option to perform a hearing test using the first audio device based on determining that the first audio device is a first type of audio device; and abandoning the option to perform a hearing test using the first audio device based on determining that the first audio device is a second type of audio device different from the first type of audio device.

[0008] In some embodiments, a transient computer-readable storage medium is described. This transient computer-readable storage medium stores one or more programs configured to be executed by one or more processors of a computer system communicating with one or more input devices. The one or more programs include instructions for: detecting a request to pair the first audio device with the computer system via one or more input devices when not paired with the first audio device; and in response to detecting the request to pair the first audio device with the computer system, initiating a process for pairing the first audio device with the computer system, wherein the process for pairing the first audio device with the computer system includes: pairing the first audio device with the computer system; providing an option to perform a hearing test using the first audio device based on determining that the first audio device is a first type of audio device; and abandoning the option to perform a hearing test using the first audio device based on determining that the first audio device is a second type of audio device different from the first type of audio device.

[0009] In some embodiments, a computer system is described. The computer system is configured to communicate with one or more input devices. The computer system includes: one or more processors; and a memory storing one or more programs configured to be executed by the one or more processors, the one or more programs including instructions for: detecting a request to pair the first audio device with the computer system via one or more input devices when not paired with the first audio device; and in response to detecting the request to pair the first audio device with the computer system, initiating a process for pairing the first audio device with the computer system, wherein the process for pairing the first audio device with the computer system includes: pairing the first audio device with the computer system; providing an option to perform a hearing test using the first audio device based on determining that the first audio device is a first type of audio device; and abandoning the option to perform a hearing test using the first audio device based on determining that the first audio device is a second type of audio device different from the first type of audio device.

[0010] In some embodiments, a computer system is described. The computer system is configured to communicate with one or more input devices. The computer system includes: components for detecting a request to pair the first audio device with the computer system via the one or more input devices when not paired with the first audio device; and components for initiating a process of pairing the first audio device with the computer system in response to detecting the request to pair the first audio device with the computer system, wherein the process of pairing the first audio device with the computer system includes: pairing the first audio device with the computer system; providing an option to perform a hearing test using the first audio device based on determining that the first audio device is a first type of audio device; and abandoning the option to perform a hearing test using the first audio device based on determining that the first audio device is a second type of audio device different from the first type of audio device.

[0011] In some embodiments, a computer program product is described. This computer program product includes one or more programs configured to be executed by one or more processors of a computer system communicating with one or more input devices. The one or more programs include instructions for: detecting a request to pair the first audio device with the computer system via one or more input devices when not paired with the first audio device; and in response to detecting the request to pair the first audio device with the computer system, initiating a process for pairing the first audio device with the computer system, wherein the process for pairing the first audio device with the computer system includes: pairing the first audio device with the computer system; providing an option to perform a hearing test using the first audio device based on determining that the first audio device is a first type of audio device; and abandoning the option to perform a hearing test using the first audio device based on determining that the first audio device is a second type of audio device different from the first type of audio device.

[0012] In some implementations, a method is performed. The method includes, at a computer system including a first audio device having one or more speakers: accessing a first set of audio characteristics based on a hearing test; accessing a second set of audio characteristics different from the first set of audio characteristics and based on the hearing test; receiving a first audio; and in response to receiving the first audio: based on determining that the first audio is audio of a first type, outputting a first modified audio of the first audio, modified based on the first set of audio characteristics, via one or more speakers of the first audio device; and based on determining that the first audio is audio of a second type different from the first type of audio, outputting a second modified audio of the first audio, modified based on the second set of audio characteristics, via one or more speakers of the first audio device.

[0013] In some embodiments, a non-transitory computer-readable storage medium is described. This non-transitory computer-readable storage medium stores one or more programs configured to be executed by one or more processors of a computer system including a first audio device having one or more speakers. The one or more programs include instructions for: accessing a first set of audio characteristics based on a hearing test; accessing a second set of audio characteristics different from the first set of audio characteristics and based on the hearing test; receiving a first audio; and in response to receiving the first audio: based on determining that the first audio is a first type of audio, outputting a first modified audio of the first audio, modified based on the first set of audio characteristics, via one or more speakers of the first audio device; and based on determining that the first audio is a second type of audio, different from the first type of audio, outputting a second modified audio of the first audio, modified based on the second set of audio characteristics, via one or more speakers of the first audio device.

[0014] In some embodiments, a transient computer-readable storage medium is described. This transient computer-readable storage medium stores one or more programs configured to be executed by one or more processors of a computer system including a first audio device having one or more speakers. The one or more programs include instructions for: accessing a first set of audio characteristics based on a hearing test; accessing a second set of audio characteristics different from the first set of audio characteristics and based on the hearing test; receiving a first audio; and in response to receiving the first audio: based on determining that the first audio is a first type of audio, outputting a first modified audio of the first audio, modified based on the first set of audio characteristics, via one or more speakers of the first audio device; and based on determining that the first audio is a second type of audio, different from the first type of audio, outputting a second modified audio of the first audio, modified based on the second set of audio characteristics, via one or more speakers of the first audio device.

[0015] In some embodiments, a computer system is described. The computer system includes a first audio device having one or more speakers and includes: one or more processors; and a memory storing one or more programs configured to be executed by the one or more processors, the one or more programs including instructions for: accessing a first set of audio characteristics based on a hearing test; accessing a second set of audio characteristics different from the first set of audio characteristics and based on the hearing test; receiving first audio; and in response to receiving the first audio: based on determining that the first audio is audio of a first type, outputting a first modified audio of the first audio, modified based on the first set of audio characteristics, via one or more speakers of the first audio device; and based on determining that the first audio is audio of a second type different from the first type of audio, outputting a second modified audio of the first audio, modified based on the second set of audio characteristics, via one or more speakers of the first audio device.

[0016] In some embodiments, a computer system is described. The computer system includes a first audio device having one or more speakers, and includes: components for accessing a first set of audio characteristics based on a hearing test; components for accessing a second set of audio characteristics different from the first set of audio characteristics and based on a hearing test; components for receiving first audio; and components for, in response to receiving the first audio, to: output a first modified audio, modified based on the first set of audio characteristics, via one or more speakers of the first audio device, based on determining that the first audio is a first type of audio; and output a second modified audio, modified based on the second set of audio characteristics, via one or more speakers of the first audio device, based on determining that the first audio is a second type of audio different from the first type of audio.

[0017] In some embodiments, a computer program product is described. The computer program product includes one or more programs configured to execute by one or more processors of a computer system including a first audio device having one or more speakers, the one or more programs including instructions for: accessing a first set of audio characteristics based on a hearing test; accessing a second set of audio characteristics different from the first set of audio characteristics and based on the hearing test; receiving first audio; and in response to receiving the first audio: based on determining that the first audio is a first type of audio, outputting a first modified audio of the first audio, modified based on the first set of audio characteristics, via one or more speakers of the first audio device; and based on determining that the first audio is a second type of audio, different from the first type of audio, outputting a second modified audio of the first audio, modified based on the second set of audio characteristics, via one or more speakers of the first audio device.

[0018] In some implementations, a method is described. The method includes: at a computer system communicating with a display generation component and one or more audio devices: during the execution of a hearing test: displaying a visual indication of a current ambient noise level via the display generation component, wherein the visual indication visually changes as the current ambient noise level changes; detecting a change in the current ambient noise level via one or more audio devices while displaying the visual indication of the current ambient noise level; and updating the display of the visual indication of the current ambient noise level via the display generation component to correspond to the current ambient noise level in response to detecting the change in the current ambient noise level.

[0019] In some embodiments, a non-transitory computer-readable storage medium is described. This non-transitory computer-readable storage medium stores one or more programs configured to be executed by one or more processors of a computer system communicating with a display generation component and one or more audio devices. The one or more programs include instructions for: during the execution of a hearing test; displaying a visual indication of a current ambient noise level via the display generation component, wherein the visual indication visually changes as the current ambient noise level changes; detecting a change in the current ambient noise level via one or more audio devices while displaying the visual indication of the current ambient noise level; and updating the display of the visual indication of the current ambient noise level via the display generation component to correspond to the current ambient noise level in response to detecting the change in the current ambient noise level.

[0020] In some embodiments, a transient computer-readable storage medium is described. This transient computer-readable storage medium stores one or more programs configured to be executed by one or more processors of a computer system communicating with a display generation component and one or more audio devices. The one or more programs include instructions for: during the execution of a hearing test: displaying a visual indication of a current ambient noise level via the display generation component, wherein the visual indication visually changes as the current ambient noise level changes; detecting a change in the current ambient noise level via one or more audio devices while displaying the visual indication of the current ambient noise level; and updating the display of the visual indication of the current ambient noise level via the display generation component to correspond to the current ambient noise level in response to detecting the change in the current ambient noise level.

[0021] In some embodiments, a computer system is described. The computer system is configured to communicate with a display generation component and one or more audio devices. The computer system includes: one or more processors; and a memory storing one or more programs configured to be executed by the one or more processors, the one or more programs including instructions for: during the execution of a hearing test: displaying a visual indication of a current ambient noise level via the display generation component, wherein the visual indication visually changes as the current ambient noise level changes; detecting a change in the current ambient noise level via one or more audio devices while displaying the visual indication of the current ambient noise level; and updating the display of the visual indication of the current ambient noise level via the display generation component to correspond to the current ambient noise level in response to detecting the change in the current ambient noise level.

[0022] In some embodiments, a computer system is described. The computer system is configured to communicate with a display generation component and one or more audio devices. The computer system includes components for performing the following during a hearing test: displaying a visual indication of a current ambient noise level via the display generation component, wherein the visual indication visually changes as the current ambient noise level changes; detecting a change in the current ambient noise level via one or more audio devices while displaying the visual indication of the current ambient noise level; and updating the display of the visual indication of the current ambient noise level via the display generation component to correspond to the current ambient noise level in response to detecting the change in the current ambient noise level.

[0023] In some embodiments, a computer program product is described. This computer program product includes one or more programs configured to execute by one or more processors of a computer system communicating with a display generation component and one or more audio devices. The one or more programs include instructions for: during the execution of a hearing test: displaying a visual indication of a current ambient noise level via the display generation component, wherein the visual indication visually changes as the current ambient noise level changes; detecting a change in the current ambient noise level via one or more audio devices while displaying the visual indication of the current ambient noise level; and updating the display of the visual indication of the current ambient noise level via the display generation component to correspond to the current ambient noise level in response to detecting the change in the current ambient noise level.

[0024] A method is described based on some implementation schemes. The method includes: at a computer system communicating with one or more display generation components, one or more input devices, and one or more audio devices: during the execution of a hearing test: displaying a user interface via one or more display generation components, the user interface including a plurality of discrete volume indicators and a visual indication of the current volume of audio output during the hearing test, wherein the plurality of discrete volume indicators includes: a volume indicator corresponding to a minimum volume of audio output during the hearing test, a volume indicator corresponding to a maximum volume of audio output during the hearing test, and a volume indicator corresponding to the current volume of audio output during the hearing test; while displaying the user interface including the plurality of discrete volume indicators and the visual indication of the current volume of audio output during the hearing test, outputting a first audio at a first volume via a first speaker of one or more audio devices; while outputting the first audio via the first speaker of one or more audio devices, detecting user input directed to the user interface via one or more input devices; and in response to detecting user input directed to the user interface: changing the volume of the first audio from a first volume to a second volume different from the first volume based on the user input; and updating the user interface via one or more display generation components to indicate that the current volume of audio output during the hearing test is the second volume.

[0025] According to some embodiments, a non-transitory computer-readable storage medium is described. This non-transitory computer-readable storage medium stores one or more programs configured to be executed by one or more processors of a computer system communicating with one or more display generation components, one or more input devices, and one or more audio devices. The one or more programs include instructions for: during the execution of a hearing test; displaying a user interface via one or more display generation components, the user interface including a plurality of discrete volume indicators and a visual indication of the current volume of audio output during the hearing test, wherein the plurality of discrete volume indicators include: a volume indicator corresponding to the minimum volume of audio output during the hearing test, a volume indicator corresponding to the maximum volume of audio output during the hearing test, and a volume indicator corresponding to the maximum volume of audio output during the hearing test. The system includes: a volume indicator corresponding to the current volume of the audio output during the hearing test; outputting a first audio at a first volume via a first speaker of one or more audio devices while displaying a user interface including multiple discrete volume indicators and a visual indication of the current volume of the audio output during the hearing test; detecting user input directed to the user interface via one or more input devices while the first audio is output via the first speaker of one or more audio devices; and in response to detecting user input directed to the user interface: changing the volume of the first audio from a first volume to a second volume different from the first volume based on the user input; and updating the user interface via one or more display generation components to indicate that the current volume of the audio output during the hearing test is the second volume.

[0026] According to some embodiments, a transient computer-readable storage medium is described. This transient computer-readable storage medium stores one or more programs configured to be executed by one or more processors of a computer system communicating with one or more display generation components, one or more input devices, and one or more audio devices. The one or more programs include instructions for: during the execution of a hearing test; displaying a user interface via one or more display generation components, the user interface including a plurality of discrete volume indicators and a visual indication of the current volume of audio output during the hearing test, wherein the plurality of discrete volume indicators include: a volume indicator corresponding to the minimum volume of audio output during the hearing test, a volume indicator corresponding to the maximum volume of audio output during the hearing test, and a volume indicator corresponding to the maximum volume of audio output during the hearing test. The system includes: a volume indicator corresponding to the current volume of the audio output during the hearing test; outputting a first audio at a first volume via a first speaker of one or more audio devices while displaying a user interface including multiple discrete volume indicators and a visual indication of the current volume of the audio output during the hearing test; detecting user input directed to the user interface via one or more input devices while outputting the first audio via the first speaker of one or more audio devices; and in response to detecting user input directed to the user interface: changing the volume of the first audio from a first volume to a second volume different from the first volume based on the user input; and updating the user interface via one or more display generation components to indicate that the current volume of the audio output during the hearing test is the second volume.

[0027] According to some embodiments, a computer system is described. The computer system is configured to communicate with one or more display generation components, one or more input devices, and one or more audio devices, and includes: one or more processors; and a memory storing one or more programs configured to be executed by the one or more processors, the one or more programs including instructions for: during the execution of a hearing test: displaying a user interface via the one or more display generation components, the user interface including a plurality of discrete volume indicators and a visual indication of the current volume of audio output during the hearing test, wherein the plurality of discrete volume indicators include: a volume indicator corresponding to the minimum volume of audio output during the hearing test, a volume indicator corresponding to the maximum volume of audio output during the hearing test, and... A volume indicator corresponding to the current volume of audio output during a hearing test; when displaying a user interface including multiple discrete volume indicators and a visual indication of the current volume of audio output during a hearing test, outputting a first audio at a first volume via a first speaker of one or more audio devices; and when outputting the first audio via the first speaker of one or more audio devices, detecting user input directed to the user interface via one or more input devices; and in response to detecting user input directed to the user interface: changing the volume of the first audio from a first volume to a second volume different from the first volume based on the user input; and updating the user interface via one or more display generation components to indicate that the current volume of audio output during a hearing test is the second volume.

[0028] According to some embodiments, a computer system is described. The computer system is configured to communicate with one or more display generation components, one or more input devices, and one or more audio devices, and includes: during the execution of a hearing test: components for displaying a user interface via the one or more display generation components, the user interface including a plurality of discrete volume indicators and a visual indication of the current volume of audio output during the hearing test, wherein the plurality of discrete volume indicators includes: a volume indicator corresponding to a minimum volume for outputting audio during the hearing test, a volume indicator corresponding to a maximum volume for outputting audio during the hearing test, and a volume indicator corresponding to the current volume of audio output during the hearing test; and components for displaying a user interface via the one or more display generation components. The user interface includes a volume indicator and a visual indication of the current volume of audio output during a hearing test; a component for outputting a first audio at a first volume via a first speaker of one or more audio devices; a component for detecting user input directed to the user interface via one or more input devices when the first audio is output via the first speaker of one or more audio devices; and a component for changing the volume of the first audio from a first volume to a second volume different from the first volume based on the detected user input; and updating the user interface via one or more display generation components to indicate that the current volume for outputting audio during a hearing test is the second volume.

[0029] According to some embodiments, a computer program product is described. The computer program product includes one or more programs configured to be executed by one or more processors of a computer system communicating with one or more display generation components, one or more input devices, and one or more audio devices. The one or more programs include instructions for: during the execution of a hearing test; displaying a user interface via one or more display generation components, the user interface including a plurality of discrete volume indicators and a visual indication of the current volume of audio output during the hearing test, wherein the plurality of discrete volume indicators include: a volume indicator corresponding to the minimum volume of audio output during the hearing test, a volume indicator corresponding to the maximum volume of audio output during the hearing test, and a volume indicator corresponding to the maximum volume of audio output during the hearing test. The system outputs a volume indicator corresponding to the current volume of the audio; outputs a first audio at a first volume via a first speaker of one or more audio devices while displaying a user interface including multiple discrete volume indicators and a visual indication of the current volume of the audio output during a hearing test; detects user input directed to the user interface via one or more input devices while outputting the first audio via the first speaker of one or more audio devices; and in response to detecting user input directed to the user interface: changes the volume of the first audio from a first volume to a second volume different from the first volume based on the user input; and updates the user interface via one or more display generation components to indicate that the current volume of the audio output during a hearing test is the second volume.

[0030] Executable instructions for performing these functions are optionally included in a non-transitory computer-readable storage medium or other computer program product configured for execution by one or more processors.

[0031] Therefore, devices are provided with faster and more efficient methods and interfaces for managing hearing health, thereby improving the efficiency, effectiveness, and user satisfaction of such devices. These methods and interfaces can complement or replace other methods used for managing hearing health. Attached Figure Description

[0032] To better understand the various described embodiments, reference should be made to the following detailed description in conjunction with the accompanying drawings, wherein similar reference numerals in all the drawings indicate corresponding parts.

[0033] Figure 1A This is a block diagram illustrating a portable multi-functional device with a touch-sensitive display according to some implementation schemes.

[0034] Figure 1BThis is a block diagram illustrating exemplary components for event handling according to some implementation schemes.

[0035] Figure 2 Examples of portable multi-functional devices with touchscreens according to some implementation schemes are shown.

[0036] Figure 3A This is a block diagram of an exemplary multifunctional device having a display and a touch-sensitive surface according to some implementation schemes.

[0037] Figures 3B to 3G This example demonstrates how to perform an operation using an Application Programming Interface (API).

[0038] Figure 4A An exemplary user interface for an application menu on a portable multifunction device according to some implementations is shown.

[0039] Figure 4B An exemplary user interface of a multifunctional device having a touch-sensitive surface separate from the display is illustrated according to some embodiments.

[0040] Figure 5A Examples of personal electronic devices according to some implementation schemes are shown.

[0041] Figure 5B This is a block diagram illustrating a personal electronic device according to some implementation schemes.

[0042] Figures 6A to 6BH Exemplary devices and user interfaces for managing hearing health are illustrated according to some implementation schemes.

[0043] Figure 7 This is a flowchart illustrating how a user initiates a hearing test based on prompts from some implementation schemes.

[0044] Figure 8 This is a flowchart illustrating methods for modifying the audio characteristics of different types of audio according to some implementation schemes.

[0045] Figures 9A to 9D An example user interface for displaying a visual indication of the current ambient noise level, according to some implementation schemes, is shown.

[0046] Figure 10 This is a flowchart illustrating a method for displaying a visual indication of the current ambient noise level according to some implementation schemes.

[0047] Figures 11A to 11N Example user interfaces for performing hearing tests are shown according to some implementation schemes.

[0048] Figures 12A to 12B This is a flowchart illustrating a method for performing a hearing test according to some implementation schemes. Detailed Implementation

[0049] The following description illustrates exemplary methods, parameters, etc. However, it should be understood that such description is not intended to limit the scope of this disclosure, but is provided as a description of exemplary embodiments.

[0050] There is a need for electronic devices that provide efficient methods and interfaces for managing hearing health. For example, providing a hearing test to a user during the pairing process of headphones with a computer system enables the computer system to quickly and efficiently initiate a hearing test using the headphones. Similarly, allowing the computer system to adjust different types of audio (e.g., ambient audio, telephone call audio, and / or application audio) based on user requests enables the computer system to provide audio more tailored to the user. Such technologies can reduce the cognitive burden on users who wish to manage their hearing health, thereby increasing productivity. Furthermore, such technologies can reduce processor power and battery power that would otherwise be wasted on redundant user input.

[0051] under Figures 1A to 1B , Figure 2 , Figure 3A , Figures 4A to 4B and Figures 5A to 5B A description of an exemplary device for performing management event notifications is provided. Figures 6A to 6BH An exemplary user interface for managing hearing health is shown. Figure 7 This is a flowchart illustrating a method for prompting a user to initiate a hearing test in some implementation schemes. Figure 8 This is a flowchart illustrating methods for modifying the audio characteristics of different types of audio in some implementation schemes. Figures 6A to 6BH The user interface in the document is used to illustrate the processes described below, including Figures 7 to 8 The process in. Figures 9A to 9D An example user interface for displaying a visual indication of the current ambient noise level, according to some implementation schemes, is shown. Figure 10 This is a flowchart illustrating a method for displaying a visual indication of the current ambient noise level according to some implementation schemes. Figures 6A to 6BH and Figures 9A to 9D The user interface in the document is used to illustrate the processes described below, including Figure 10 The process in. Figures 11A to 11N Example user interfaces for performing hearing tests are shown according to some implementation schemes. Figures 12A to 12B This is a flowchart illustrating a method for performing a hearing test according to some implementation schemes. Figures 11A to 11N The user interface in the document is used to illustrate the processes described below, including Figures 12A to 12B The process in.

[0052] The processes described below enhance device operability and make the user-device interface more efficient through various technologies (e.g., by helping users provide appropriate input and reducing user errors when operating / interacting with the device), including providing improved visual feedback to users, reducing the amount of input required to perform operations, providing additional control options without cluttering the user interface with additional displayed controls, performing operations without requiring further user input when a set of conditions are met, and / or additional technologies. These technologies also reduce power consumption and extend device battery life by enabling users to use the device more quickly and efficiently.

[0053] Furthermore, in a method described herein where one or more steps depend on the satisfaction of one or more conditions, it should be understood that the described method can be repeated in multiple repetitions such that, during the repetitions, all conditions determining the steps in the method are satisfied in different repetitions of the method. For example, if the method requires performing a first step (if the conditions are satisfied) and a second step (if the conditions are not satisfied), those skilled in the art will know that the stated steps are repeated until both conditions are satisfied and not satisfied (in no particular order). Thus, a method described as having one or more steps depending on the satisfaction of one or more conditions can be rewritten as a method that repeats until each condition described in the method is satisfied. However, this does not require the system or computer-readable medium to declare that the system or computer-readable medium contains instructions for performing discretionary operations based on the satisfaction of the corresponding one or more conditions, and thus to determine whether possible conditions have been satisfied without explicitly repeating the steps of the method until all conditions determining the steps in the method are satisfied. Those skilled in the art will also understand that, similar to a method having discretionary steps, a system or computer-readable storage medium can repeat the steps of the method multiple times as needed to ensure that all discretionary steps have been performed.

[0054] Although the following description uses the terms "first," "second," etc., to describe various elements, these elements should not be limited by the terms. In some embodiments, these terms are used to distinguish one element from another. For example, a first touch may be referred to as a second touch, and similarly, a second touch may be referred to as a first touch, without departing from the scope of the various described embodiments. In some embodiments, a first touch and a second touch are two separate references to the same touch. In some embodiments, both a first touch and a second touch are touches, but they are not the same touch.

[0055] The terminology used in the description of the various described embodiments herein is for the purpose of describing particular embodiments only and is not intended to be limiting. As used in the description of the various described embodiments and in the appended claims, the singular forms “a” and “the” are intended to include the plural forms as well, unless the context clearly indicates otherwise. It will also be understood that the term “and / or” as used herein refers to and covers any and all possible combinations of one or more of the associated listed items. It will also be understood that the terms “comprising” and / or “including” as used in this specification specify the presence of the stated features, integers, steps, operations, elements, and / or components, but do not exclude the presence or addition of one or more other features, integers, steps, operations, elements, components, and / or groups thereof.

[0056] Depending on the context, the term "if" may optionally be interpreted as meaning "when," "in response to," or "in response to detection." Similarly, depending on the context, the phrases "if it is determined..." or "if [the stated condition or event] is detected" may optionally be interpreted as meaning "in response to determining..." or "in response to detecting [the stated condition or event]."

[0057] This document describes implementations of electronic devices, user interfaces for such devices, and associated processes for using such devices. In some implementations, the device is a portable communication device, such as a mobile phone, that also includes other functionalities such as PDA and / or music player functionality. Exemplary implementations of portable multi-functional devices include, but are not limited to, the iPhone from Apple Inc. of Cupertino, California. ® Devices, iPod Touch ® Devices and iPads ®Device. Optionally, other portable electronic devices may be used, such as laptop computers or tablet computers with touch-sensitive surfaces (e.g., touchscreen displays and / or touchpads). It should also be understood that in some embodiments, the device is not a portable communication device, but a desktop computer with touch-sensitive surfaces (e.g., touchscreen displays and / or touchpads). In some embodiments, the electronic device is a computer system that communicates with a display generating component (e.g., via wireless or wired communication). The display generating component is configured to provide visual output, such as display via a CRT display, via an LED display, or via image projection. In some embodiments, the display generating component is integrated with the computer system. In some embodiments, the display generating component is separate from the computer system. As used herein, “display” content includes displaying content (e.g., video data rendered or decoded by display controller 156) by sending data (e.g., image data or video data) to an integrated or external display generating component via a wired or wireless connection to visually generate content.

[0058] In the following discussion, an electronic device including a display and a touch-sensitive surface is described. However, it should be understood that the electronic device may optionally include one or more other physical user interface devices, such as a physical keyboard, mouse, and / or joystick.

[0059] The device typically supports a variety of applications, such as one or more of the following: drawing applications, presentation applications, word processing applications, website creation applications, disk editing applications, spreadsheet applications, game applications, phone applications, video conferencing applications, email applications, instant messaging applications, fitness support applications, photo management applications, digital camera applications, digital video camera applications, web browsing applications, digital music player applications, and / or digital video player applications.

[0060] Various applications running on the device may optionally use at least one common physical user interface device, such as a touch-sensitive surface. One or more functions of the touch-sensitive surface and the corresponding information displayed on the device may optionally be adjusted and / or changed for different applications, and / or within the respective applications. In this way, the device's common physical architecture (such as the touch-sensitive surface) may optionally utilize a user interface that is intuitive and clear to the user to support various applications.

[0061] Now let’s turn our attention to implementation schemes for portable devices with touch-sensitive displays. Figure 1AThis is a block diagram illustrating a portable multi-functional device 100 with a touch-sensitive display system 112 according to some embodiments. The touch-sensitive display 112 is sometimes referred to as a “touchscreen” for convenience, and is sometimes referred to as or called a “touch-sensitive display system.” Device 100 includes a memory 102 (which optionally includes one or more computer-readable storage media), a memory controller 122, one or more processing units (CPUs) 120, a peripheral interface 118, RF circuitry 108, audio circuitry 110, a speaker 111, a microphone 113, an input / output (I / O) subsystem 106, other input control devices 116, and an external port 124. Device 100 optionally includes one or more optical sensors 164. Device 100 optionally includes one or more contact strength sensors 165 for detecting the intensity of contact on device 100 (e.g., a touch-sensitive surface, such as the touch-sensitive display system 112 of device 100). Device 100 optionally includes one or more haptic output generators 167 for generating haptic outputs on device 100 (e.g., generating haptic outputs on a touch-sensitive surface such as the touch-sensitive display system 112 of device 100 or the touchpad 355 of device 300). These components optionally communicate via one or more communication buses or signal lines 103.

[0062] As used in this specification and claims, the term "intensity" of contact on a tactile surface refers to the force or pressure (force per unit area) of a contact (e.g., finger contact) on a tactile surface, or to a substitute (alternative) for the force or pressure of a contact on a tactile surface. The intensity of contact has a range of values ​​that includes at least four different values ​​and more typically hundreds of different values ​​(e.g., at least 256). The intensity of contact is optionally determined (or measured) using various methods and various sensors or combinations of sensors. For example, one or more force sensors below or adjacent to the tactile surface are optionally used to measure the force at different points on the tactile surface. In some embodiments, force measurements from multiple force sensors are combined (e.g., weighted average) to determine the estimated contact force. Similarly, the pressure-sensitive tip of a stylus is optionally used to determine the pressure of the stylus on the tactile surface. Alternatively, the size and / or change of the contact area detected on the touch-sensitive surface, the capacitance and / or change of the touch-sensitive surface adjacent to the contact, and / or the resistance and / or change of the touch-sensitive surface adjacent to the contact are optionally used as substitutes for the force or pressure of the contact on the touch-sensitive surface. In some embodiments, the substitute measurement of the contact force or pressure is used directly to determine whether an intensity threshold has been exceeded (e.g., the intensity threshold is described in units corresponding to the substitute measurement). In some embodiments, the substitute measurement of the contact force or pressure is converted into an estimated force or pressure, and the estimated force or pressure is used to determine whether an intensity threshold has been exceeded (e.g., the intensity threshold is a pressure threshold measured in units of pressure). Using the intensity of the contact as an attribute of user input allows users to access additional device functionality that would otherwise be inaccessible to the user on a space-constrained, scaled-down device used (e.g., on a touch-sensitive display) to display an indication and / or receive user input (e.g., via a touch-sensitive display, touch-sensitive surface, or physical / mechanical controls, such as knobs or buttons).

[0063] As used in this specification and claims, the term "haptic output" refers to a physical displacement of the device relative to a previous position of the device, a physical displacement of a component of the device (e.g., a touch-sensitive surface) relative to another component of the device (e.g., the housing), or a displacement of a component relative to the center of mass of the device, which is detected by the user using the user's tactile sense. For example, when the device or a component of the device comes into contact with a touch-sensitive surface (e.g., a finger, palm, or other part of the user's hand), the haptic output generated by the physical displacement will be interpreted by the user as a tactile sensation corresponding to a perceived change in the physical characteristics of the device or a component of the device. For example, movement of a touch-sensitive surface (e.g., a touch-sensitive display or touchpad) may optionally be interpreted by the user as a "press-click" or "release-click" on a physically actuated button. In some cases, the user will feel a tactile sensation, such as a "press-click" or "release-click," even when a physically actuated button associated with the touch-sensitive surface, which has been physically pressed (e.g., displaced) by the user's movement, does not move. As another example, even when the smoothness of the tactile surface remains unchanged, the movement of the tactile surface can optionally be interpreted or perceived by the user as the "roughness" of the tactile surface. While such interpretations of touch by users will be limited by the individualized sensory perceptions of the user, many sensory perceptions of touch are common to most users. Therefore, when a tactile output is described as corresponding to a specific sensory perception of the user (e.g., "release click", "press click", "roughness"), unless otherwise stated, the generated tactile output corresponds to a physical displacement of the device or its components that will generate the sensory perception described by a typical (or common) user.

[0064] It should be understood that device 100 is merely an example of a portable multifunctional device, and device 100 may optionally have more or fewer components than those shown, may optionally combine two or more components, or may optionally have different configurations or arrangements of these components. Figure 1A The various components shown are implemented in hardware, software, or a combination of both, including one or more signal processing and / or application-specific integrated circuits.

[0065] Memory 102 optionally includes high-speed random access memory, and also optionally includes non-volatile memory, such as one or more disk storage devices, flash memory devices, or other non-volatile solid-state memory devices. Memory controller 122 optionally controls access to memory 102 by other components of device 100.

[0066] Peripheral interface 118 can be used to couple input and output peripherals of the device to CPU 120 and memory 102. The one or more processors 120 run or execute various software programs (such as computer programs (e.g., including instructions)) and / or instruction sets stored in memory 102 to perform various functions of device 100 and process data. In some embodiments, peripheral interface 118, CPU 120, and memory controller 122 are optionally implemented on a single chip, such as chip 104. In some other embodiments, they are optionally implemented on separate chips.

[0067] RF (Radio Frequency) circuit 108 receives and transmits RF signals, also known as electromagnetic signals. RF circuit 108 converts electrical signals into electromagnetic signals / converts electromagnetic signals into electrical signals, and communicates with communication networks and other communication devices via electromagnetic signals. RF circuit 108 optionally includes well-known circuitry for performing these functions, including but not limited to antenna systems, RF transceivers, one or more amplifiers, tuners, one or more oscillators, digital signal processors, codec chipsets, subscriber identity module (SIM) cards, memory, etc. RF circuit 108 optionally communicates wirelessly with networks (such as the Internet (also known as the World Wide Web (WWW)), intranets, and / or wireless networks (such as cellular telephone networks, wireless local area networks (LANs), and / or metropolitan area networks (MANs))) and other devices. RF circuit 108 optionally includes well-known circuitry for detecting near-field communication (NFC) fields, such as via short-range communication radio components. Wireless communication may optionally employ any of a variety of communication standards, protocols, and technologies, including but not limited to Global System for Mobile Communications (GSM), Enhanced Data GSM Environment (EDGE), High-Speed ​​Downlink Packet Access (HSDPA), High-Speed ​​Uplink Packet Access (HSUPA), Evolution, Pure Data (EV-DO), HSPA, HSPA+, Dual-Unit HSPA (DC-HSPDA), Long Term Evolution (LTE), Near Field Communication (NFC), Wideband Code Division Multiple Access (W-CDMA), Code Division Multiple Access (CDMA), Time Division Multiple Access (TDMA), Bluetooth, Bluetooth Low Energy (BTLE), and Wi-Fi (e.g., IEEE 802.11a, IEEE 802.11b, IEEE 802.11g, IEEE 802.11n and / or IEEE 802.11ac), Voice over Internet Protocol (VoIP), Wi-MAX, email protocols (e.g., Internet Messaging Access Protocol (IMAP) and / or Post Office Protocol (POP)), instant messaging (e.g., Extensible Messaging and Presence Protocol (XMPP), Session Initiation Protocol for Instant Messaging and Presence with Extended Utility (SIMPLE), Instant Messaging and Presence Service (IMPS)) and / or Short Message Service (SMS), or any other suitable communication protocol that has not been developed as of the date of this document submission.

[0068] Audio circuitry 110, speaker 111, and microphone 113 provide an audio interface between the user and device 100. Audio circuitry 110 receives audio data from peripheral interface 118, converts the audio data into electrical signals, and sends the electrical signals to speaker 111. Speaker 111 converts the electrical signals into sound waves that are audible to humans. Audio circuitry 110 also receives electrical signals converted from sound waves by microphone 113. Audio circuitry 110 converts the electrical signals into audio data and sends the audio data to peripheral interface 118 for processing. Audio data is optionally retrieved by peripheral interface 118 from memory 102 and / or RF circuitry 108 and / or sent to that memory and / or RF circuitry. In some embodiments, audio circuitry 110 also includes a headset jack (e.g., ...). Figure 2 (212 in the text). The headset jack provides an interface between the audio circuitry 110 and a removable audio input / output peripheral device, such as an output-only headset or a headset with both outputs (e.g., a mono-ear headset or a binaural headset) and inputs (e.g., a microphone).

[0069] I / O subsystem 106 couples input / output peripherals (such as touchscreen 112 and other input control devices 116) on device 100 to peripheral interface 118. I / O subsystem 106 optionally includes display controller 156, optical sensor controller 158, depth camera controller 169, intensity sensor controller 159, haptic feedback controller 161, and one or more input controllers 160 for other input or control devices. The one or more input controllers 160 receive electrical signals from / transmit electrical signals to the other input control device 116. Other input control devices 116 optionally include physical buttons (e.g., push-buttons, rocker buttons, etc.), dials, slide switches, joysticks, click dials, etc. In some embodiments, input controller 160 is optionally coupled to (or not coupled to) any of the following: keyboard, infrared port, USB port, and pointing device such as mouse. One or more buttons (e.g., ... Figure 2 Optionally, 208) includes an increase / decrease button for volume control of speaker 111 and / or microphone 113. The one or more buttons optionally include a push-button (e.g., Figure 2(Ref. 206 in the original text). In some embodiments, the electronic device is a computer system that communicates with one or more input devices (e.g., via wireless communication, via wired communication). In some embodiments, the one or more input devices include a touch-sensitive surface (e.g., a touchpad, as part of a touch-sensitive display). In some embodiments, the one or more input devices include one or more camera sensors (e.g., one or more optical sensors 164 and / or one or more depth camera sensors 175), such as for tracking user gestures (e.g., hand gestures and / or air gestures) as input. In some embodiments, the one or more input devices are integrated with the computer system. In some embodiments, the one or more input devices are separate from the computer system. In some implementations, air gestures are gestures detected without the user touching an input element that is part of the device (or independently of an input element that is part of the device) and based on the detected movement of a part of the user's body through the air (including movement of the user's body relative to an absolute reference (e.g., the angle of the user's arm relative to the ground or the distance of the user's hand relative to the ground), movement relative to another part of the user's body (e.g., movement of the user's hand relative to the user's shoulder, movement of one of the user's hands relative to the user's other hand, and / or movement of the user's fingers relative to another of the user's fingers or a part of the user's hand), and / or absolute movement of a part of the user's body (e.g., a tapping gesture that includes the hand moving a predetermined amount and / or speed in a predetermined pose, or a shaking gesture that includes a predetermined speed or amount of rotation of a part of the user's body)).

[0070] A quick press of a push button optionally disengages the touchscreen 112 from its lock or optionally initiates a process of unlocking the device using gestures on the touchscreen, as described in U.S. Patent Application 11 / 322,549 (i.e., U.S. Patent No. 7,657,849), filed December 23, 2005, entitled "Unlocking a Device by Performing Gestures on an Unlock Image," the entire contents of which are incorporated herein by reference. A long press of a push button (e.g., 206) optionally powers the device 100 on or off. The functionality of one or more of these buttons is optionally user-customizable. The touchscreen 112 is used to implement virtual buttons or soft buttons and one or more soft keyboards.

[0071] The touch-sensitive display 112 provides input and output interfaces between the device and the user. The display controller 156 receives electrical signals from and / or transmits electrical signals to the touchscreen 112. The touchscreen 112 displays visual output to the user. The visual output optionally includes graphics, text, icons, video, and any combination thereof (collectively, "graphics"). In some embodiments, some or all of the visual output optionally corresponds to user interface objects.

[0072] Touchscreen 112 has a touch-sensitive surface, sensor, or sensor array that accepts input from a user based on tactile and / or haptic contact. Touchscreen 112 and display controller 156 (along with any associated modules and / or instruction set in memory 102) detect contact on touchscreen 112 (and any movement or interruption of that contact) and translate the detected contact into interaction with user interface objects (e.g., one or more soft keys, icons, web pages, or images) displayed on touchscreen 112. In an exemplary embodiment, the contact point between touchscreen 112 and the user corresponds to the user's finger.

[0073] Touchscreen 112 optionally employs LCD (Liquid Crystal Display) technology, LPD (Light Emitting Polymer Display) technology, or LED (Light Emitting Diode) technology, but other display technologies are used in other embodiments. Touchscreen 112 and display controller 156 optionally employ any of a variety of touch sensing technologies now known or to be developed thereafter, along with other proximity sensor arrays or other elements for determining one or more points of contact with touchscreen 112, to detect contact and any movement or interruption thereof. These various touch sensing technologies include, but are not limited to, capacitive, resistive, infrared, and surface acoustic wave technologies. In an exemplary embodiment, projected mutual capacitance sensing technology is used, such as in the iPhone from Apple Inc. (Cupertino, California). ® and iPod Touch ® The technology used.

[0074] In some embodiments of the touchscreen 112, the touch-sensitive display optionally resembles a multi-touch-sensitive touchpad described in the following U.S. patents: 6,323,846 (Westerman et al.), 6,570,557 (Westerman et al.), and / or 6,677,932 (Westerman) and / or U.S. Patent Publication 2002 / 0015024A1, each of which is incorporated herein by reference in its entirety. However, the touchscreen 112 displays visual output from the device 100, while the touch-sensitive touchpad does not provide visual output.

[0075] The touch-sensitive display in some embodiments of the touchscreen 112 is described in the following applications: (1) U.S. Patent Application No. 11 / 381,313, filed May 2, 2006, “Multipoint Touch Surface Controller”; (2) U.S. Patent Application No. 10 / 840,862, filed May 6, 2004, “Multipoint Touchscreen”; (3) U.S. Patent Application No. 10 / 903,964, filed July 30, 2004, “Gestures For Touch Sensitive Input Devices”; (4) U.S. Patent Application No. 11 / 048,264, filed January 31, 2005, “Gestures For Touch Sensitive Input Devices”; and (5) U.S. Patent Application No. 11 / 038,590, filed January 18, 2005, “Mode-Based Graphical User Interfaces For Touch Sensitive Input”. (6) U.S. Patent Application No. 11 / 228,758, filed September 16, 2005, “Virtual Input Device Placement On A Touch Screen User Interface”; (7) U.S. Patent Application No. 11 / 228,700, filed September 16, 2005, “Operation Of A Computer With A Touch Screen Interface”; (8) U.S. Patent Application No. 11 / 228,737, filed September 16, 2005, “Activating Virtual Keys Of ATouch-Screen Virtual Keyboard”; and (9) U.S. Patent Application No. 11 / 367,749, filed March 3, 2006, “Multi-Functional Hand-Held Device”. The full text of all these applications is incorporated herein by reference.

[0076] Touchscreen 112 optionally has a video resolution exceeding 100 dpi. In some embodiments, the touchscreen has a video resolution of approximately 160 dpi. Users optionally use any suitable object or accessory such as a stylus, finger, etc., to interact with touchscreen 112. In some embodiments, the user interface is designed to operate primarily through finger-based touch and gestures, which may be less precise than stylus-based input due to the larger contact area of ​​a finger on the touchscreen. In some embodiments, the device translates coarse finger-based input into precise pointer / cursor positioning or commands for performing the user-desired actions.

[0077] In some embodiments, in addition to the touchscreen, device 100 optionally includes a touchpad for activating or deactivating specific functions. In some embodiments, the touchpad is a touch-sensitive area of ​​the device that, unlike the touchscreen, does not display visual output. Optionally, the touchpad is a touch-sensitive surface separate from the touchscreen 112, or an extension of the touch-sensitive surface formed by the touchscreen.

[0078] The device 100 also includes a power system 162 for supplying power to various components. The power system 162 optionally includes a power management system, one or more power sources (e.g., batteries, alternating current (AC)), a recharging system, power fault detection circuitry, a power converter or inverter, a power status indicator (e.g., light-emitting diodes (LEDs)), and any other components associated with the generation, management, and distribution of power in the portable device.

[0079] Device 100 optionally also includes a secure element 163 for securely storing information. In some embodiments, secure element 163 is a hardware component (e.g., a secure microcontroller chip) configured to securely store data or algorithms. In some embodiments, secure element 163 provides (e.g., publishes) security information (e.g., payment information (e.g., account number and / or transaction-specific dynamic security code), identification information (e.g., credentials for nationally approved digital identifiers), and / or authentication information (e.g., data generated using a cryptographic engine and / or by performing asymmetric cryptographic operations)). In some embodiments, secure element 163 provides (or publishes) security information in response to device 100 receiving authorization, such authorization being user authentication (e.g., fingerprint authentication; password authentication; detection of double pressing of a hardware button when device 100 is in an unlocked state, and optionally when device 100 has remained on the user's wrist since being unlocked by providing authentication credentials to device 100), wherein the continued presence of device 100 on the user's wrist is determined by periodically checking the contact between the device and the user's skin. For example, device 100 detects a fingerprint at its fingerprint sensor (e.g., a fingerprint sensor integrated into a button). Device 100 determines whether the detected fingerprint matches a registered fingerprint. Based on the determination that the fingerprint matches a registered fingerprint, security element 163 provides (e.g., publishes) security information. Based on the determination that the fingerprint does not match a registered fingerprint, security element 163 abandons providing (e.g., publishing) security information.

[0080] The device 100 may optionally also include one or more optical sensors 164. Figure 1A An optical sensor 164 coupled to an optical sensor controller 158 in I / O subsystem 106 is shown. The optical sensor 164 optionally includes a charge-coupled device (CCD) or a complementary metal-oxide-semiconductor (CMOS) phototransistor. The optical sensor 164 receives light projected through one or more lenses from the environment and converts the light into data representing an image. In conjunction with an imaging module 143 (also referred to as a camera module), the optical sensor 164 optionally captures still images or video. In some embodiments, the optical sensor is located on the rear of device 100, facing away from a touchscreen display 112 on the front of the device, allowing the touchscreen display to be used as a viewfinder for still image and / or video image acquisition. In some embodiments, the optical sensor is located on the front of the device, allowing images of the user to be optionally acquired for video conferencing while the user views other video conferencing participants on the touchscreen display. In some embodiments, the positioning of the optical sensor 164 can be changed by the user (e.g., by rotating the lenses and sensors within the device housing), allowing a single optical sensor 164 to be used in conjunction with the touchscreen display for both video conferencing and still image and / or video image acquisition.

[0081] The device 100 optionally also includes one or more depth camera sensors 175. Figure 1A A depth camera sensor is shown coupled to a depth camera controller 169 in I / O subsystem 106. Depth camera sensor 175 receives data from the environment to create a 3D model of an object (e.g., a face) within the scene from a viewpoint (e.g., the depth camera sensor). In some embodiments, in conjunction with imaging module 143 (also referred to as camera module), depth camera sensor 175 is optionally used to determine depth maps of different portions of an image captured by imaging module 143. In some embodiments, the depth camera sensor is located at the front of device 100, such that user images with depth information are optionally acquired for video conferencing while a user views other video conferencing participants on a touchscreen display, and selfies with depth map data are captured. In some embodiments, depth camera sensor 175 is located at the rear of the device, or both the rear and front of device 100. In some embodiments, the positioning of depth camera sensor 175 can be changed by the user (e.g., by rotating a lens and sensor within the device housing), such that depth camera sensor 175 is used in conjunction with a touchscreen display for both video conferencing and still image and / or video image acquisition.

[0082] The device 100 may optionally also include one or more contact strength sensors 165. Figure 1A A contact strength sensor is shown coupled to a strength sensor controller 159 in I / O subsystem 106. The contact strength sensor 165 optionally includes one or more piezoresistive strain gauges, capacitive force sensors, electro-force sensors, piezoelectric sensors, optical force sensors, capacitive touch-sensitive surfaces, or other strength sensors (e.g., sensors for measuring the force (or pressure) of contact on a touch-sensitive surface). The contact strength sensor 165 receives contact strength information (e.g., pressure information or a substitute for pressure information) from the environment. In some embodiments, at least one contact strength sensor is arranged juxtaposed with or adjacent to a touch-sensitive surface (e.g., touch-sensitive display system 112). In some embodiments, at least one contact strength sensor is located on the rear of device 100, opposite to the touchscreen display 112 located on the front of device 100.

[0083] The device 100 optionally also includes one or more proximity sensors 166. Figure 1AA proximity sensor 166 coupled to a peripheral device interface 118 is shown. Alternatively, the proximity sensor 166 may optionally be coupled to an input controller 160 in an I / O subsystem 106. The proximity sensor 166 may optionally be configured as described in the following U.S. patent applications: 11 / 241,839, entitled "Proximity Detector In Handheld Device"; 11 / 240,788, entitled "Proximity Detector In Handheld Device"; 11 / 620,702, entitled "Using Ambient Light Sensor To Augment Proximity Sensor Output"; 11 / 586,862, entitled "Automated Response To And Sensing Of User Activity In Portable Devices"; and 11 / 638,251, entitled "Methods And Systems For Automatic Configuration Of Peripherals", the entire contents of which are incorporated herein by reference. In some implementations, when the multifunction device is placed near the user's ear (e.g., when the user is making a phone call), the proximity sensor is turned off and the touchscreen 112 is disabled.

[0084] The device 100 may optionally also include one or more tactile output generators 167. Figure 1A A haptic output generator coupled to a haptic feedback controller 161 in I / O subsystem 106 is shown. The haptic output generator 167 optionally includes one or more electroacoustic devices, such as speakers or other audio components, and / or electromechanical devices that convert energy into linear motion, such as motors, solenoids, electroactive polymers, piezoelectric actuators, electrostatic actuators, or other haptic output generating components (e.g., components that convert electrical signals into haptic outputs on the device). A contact intensity sensor 165 receives haptic feedback generation instructions from a haptic feedback module 133 and generates a haptic output on device 100 that can be felt by a user of device 100. In some embodiments, at least one haptic output generator is juxtaposed or adjacent to a haptic surface (e.g., haptic display system 112) and optionally generates the haptic output by moving the haptic surface vertically (e.g., in / outward from the surface of device 100) or laterally (e.g., back and forth in the same plane as the surface of device 100). In some embodiments, at least one haptic output generator sensor is located on the rear of the device 100, opposite to the touch screen display 112 located on the front of the device 100.

[0085] The device 100 may optionally also include one or more accelerometers 168. Figure 1A An accelerometer 168 coupled to a peripheral device interface 118 is shown. Alternatively, the accelerometer 168 may optionally be coupled to an input controller 160 in an I / O subsystem 106. The accelerometer 168 may optionally be configured as described in the following U.S. Patent Publications: 20050190059, entitled "Acceleration-based Theft Detection System for Portable Electronic Devices" and 20060017692, entitled "Methods And Apparatuses For Operating A Portable DeviceBased On An Accelerometer," both of which are incorporated herein by reference in their entirety. In some embodiments, information is displayed on a touchscreen display in portrait or landscape view based on analysis of data received from one or more accelerometers. Device 100 may optionally include, in addition to the accelerometer 168, a magnetometer and a GPS (or GLONASS or other global navigation system) receiver for acquiring information about the location and orientation (e.g., portrait or landscape) of device 100.

[0086] In some embodiments, the software components stored in memory 102 include an operating system 126, a biometric module 109, a communication module (or instruction set) 128, a contact / motion module (or instruction set) 130, a graphics module (or instruction set) 132, a text input module (or instruction set) 134, a Global Positioning System (GPS) module (or instruction set) 135, an authentication module 105, and an application program (or instruction set) 136. Furthermore, in some embodiments, memory 102 ( Figure 1A ) or 370 ( Figure 3A Storage device / global internal state 157, such as Figure 1A and Figure 3A As shown in the figure. Device / global internal state 157 includes one or more of the following: active application state, which indicates which applications (if any) are currently active; display state, indicating what applications, views or other information occupy various areas of the touch screen display 112; sensor state, including information obtained from various sensors and input control devices 116 of the device; and position information relating to the device's position and / or orientation.

[0087] The operating system 126 (e.g., Darwin, RTXC, LINUX, UNIX, OS X, iOS, WINDOWS, or embedded operating systems such as VxWorks) includes various software components and / or drivers for controlling and managing general system tasks (e.g., memory management, storage device control, power management, etc.) and facilitates communication between various hardware and software components.

[0088] The communication module 128 facilitates communication with other devices via one or more external ports 124 and includes various software components for processing data received by the RF circuitry 108 and / or the external ports 124. The external ports 124 (e.g., Universal Serial Bus (USB), FireWire, etc.) are adapted to be directly coupled to other devices or indirectly coupled via a network (e.g., the Internet, Wireless LAN, etc.). In some embodiments, the external port is for use with an iPod. ® (Trademark of Apple Inc.) The same or similar and / or compatible multi-pin (e.g., 30-pin) connectors used in Apple Inc. devices.

[0089] The biometric module 109 optionally stores information about one or more registered biometric features (e.g., fingerprint features, facial recognition features, eye and / or iris features) for verifying whether received biometric information matches the registered biometric features. In some embodiments, the stored information about one or more registered biometric features includes data that enables comparison between the stored information and the received biometric information, but does not include sufficient information to reproduce the registered biometric features. In some embodiments, the biometric module 109 stores information about registered biometric features in association with a user account of device 100. In some embodiments, the biometric module 109 compares the received biometric information with the registered biometric features to determine whether the received biometric information matches the registered biometric features.

[0090] The contact / motion module 130 optionally detects contact with the touchscreen 112 (in conjunction with the display controller 156) and other touch-sensitive devices (e.g., touchpads or physical click-based rotary dials). The contact / motion module 130 includes various software components for performing various operations related to contact detection, such as determining whether a contact has occurred (e.g., detecting a finger press event), determining the contact intensity (e.g., the force or pressure of the contact, or an alternative to force or pressure), determining whether there is movement of the contact and tracking movement on the touch-sensitive surface (e.g., detecting one or more finger drag events), and determining whether the contact has stopped (e.g., detecting a finger lift event or a contact break). The contact / motion module 130 receives contact data from the touch-sensitive surface. Determining the movement of the contact point optionally includes determining the rate (magnitude), velocity (magnitude and direction), and / or acceleration (change in magnitude and / or direction) of the contact point, the movement of which is represented by a series of contact data. These operations are optionally applied to single-point contact (e.g., single-finger contact) or multi-point simultaneous contact (e.g., "multi-touch" / multiple-finger contact). In some implementations, the contact / motion module 130 and the display controller 156 detect contact on the touchpad.

[0091] In some implementations, the contact / motion module 130 uses a set of one or more intensity thresholds to determine whether an operation has been performed by the user (e.g., determining whether the user has “clicked” an icon). In some implementations, at least a subset of the intensity thresholds is determined based on software parameters (e.g., the intensity thresholds are not determined by the activation threshold of a specific physical actuator and can be adjusted without changing the physical hardware of device 100). For example, the mouse “click” threshold of a touchpad or touchscreen can be set to any threshold in a wide range of predefined thresholds without changing the touchpad or touchscreen display hardware. Additionally, in some specific implementations, the user of the device is provided with software settings for adjusting one or more intensity thresholds in a set of intensity thresholds (e.g., by adjusting the individual intensity thresholds and / or by adjusting multiple intensity thresholds at once using system-level clicks on the “intensity” parameter).

[0092] The touch / motion module 130 optionally detects gesture input performed by the user. Different gestures on a touch-sensitive surface have different contact patterns (e.g., different movements, timings, and / or intensities of the detected contact). Therefore, gestures are optionally detected by detecting specific contact patterns. For example, detecting a finger tap gesture includes: detecting a finger press event, and then detecting a finger lift-off (lift-away) event at the same (or substantially the same) location as the finger press event (e.g., at the location of an icon). As another example, detecting a finger swipe gesture on a touch-sensitive surface includes: detecting a finger press event, then detecting one or more finger drag events, and subsequently detecting a finger lift-off (lift-away) event.

[0093] The graphics module 132 includes various known software components for rendering and displaying graphics on the touchscreen 112 or other displays, including components for altering the visual impact of the displayed graphics (e.g., brightness, transparency, saturation, contrast, or other visual properties). As used herein, the term "graphics" includes any object that can be displayed to a user, including but not limited to text, web pages, icons (such as user interface objects including soft keys), digital images, videos, animations, etc.

[0094] In some implementations, the graphics module 132 stores data representing the graphics to be used. Each graphic is optionally assigned a corresponding code. The graphics module 132 receives one or more codes from applications, etc., specifying the graphics to be displayed, and also receives coordinate data and other graphic attribute data if necessary, and then generates screen image data for output to the display controller 156.

[0095] The haptic feedback module 133 includes various software components for generating instructions which are used by the haptic output generator 167 to generate haptic output at one or more locations on the device 100 in response to user interaction with the device 100.

[0096] Optionally, the text input module 134, a component of the graphics module 132, provides a soft keyboard for entering text in various applications, such as the contact module 137, email client module 140, IM module 141, browser module 147, and any other application that requires text input.

[0097] GPS module 135 determines the location of the device and provides that information for use in various applications (e.g., to telephone module 138 for use in location-based dialing; to camera module 143 as image / video metadata; and to applications that provide location-based services, such as weather widgets, local yellow pages widgets, and map / navigation widgets).

[0098] Authentication module 105 determines whether a requested operation (e.g., requested by an application in application 136) is authorized to be performed. In some embodiments, authentication module 105 receives an operation to be performed that optionally requires authentication. Authentication module 105 determines whether the operation is authorized to be performed based on a range of factors, including the locked state of device 100, the location of device 100, whether a security delay has occurred, whether the received biometric information matches a registered biometric feature, and / or other factors. Once authentication module 105 determines that the operation is authorized to be performed, authentication module 105 triggers the execution of the operation.

[0099] Application 136 optionally includes the following modules (or instruction sets) or subsets or supersets thereof: • Contacts module 137 (sometimes called address book or contact list); • Telephone module 138; • Video conferencing module 139; • Email client module 140; • Instant Messaging (IM) module 141; • Fitness support module 142; • Camera module 143 for still images and / or video images; • Image management module 144; • Video player module; • Music player module; • Browser module 147; • Calendar module 148; • Widget module 149, which optionally includes one or more of the following: weather widget 149-1, stock market widget 149-2, calculator widget 149-3, alarm clock widget 149-4, dictionary widget 149-5 and other widgets acquired by the user, as well as user-created widget 149-6; • Widget creator module 150 for creating user-created widgets 149-6; • Search module 151; • Video and music player module 152, which combines a video player module and a music player module; • Notepad module 153; • Map module 154; and / or • Online video module 155.

[0100] Examples of other applications 136 that may be optionally stored in memory 102 include other word processing applications, other image editing applications, drawing applications, rendering applications, Java-enabled applications, encryption, digital rights management, speech recognition, and speech duplication.

[0101] In conjunction with the touchscreen 112, display controller 156, touch / motion module 130, graphics module 132, and text input module 134, the contact module 137 is optionally used to manage an address book or contact list (e.g., in the application internal state 192 of the contact module 137 stored in memory 102 or memory 370), including: adding one or more names to the address book; deleting names from the address book; associating phone numbers, email addresses, physical addresses, or other information with names; associating images with names; categorizing and classifying names; providing phone numbers or email addresses to initiate and / or facilitate communications via the telephone module 138, video conferencing module 139, email client module 140, or IM module 141; and so on.

[0102] Combining RF circuitry 108, audio circuitry 110, speaker 111, microphone 113, touchscreen 112, display controller 156, contact / motion module 130, graphics module 132, and text input module 134, telephone module 138 is optionally used to input character sequences corresponding to telephone numbers, access one or more telephone numbers in contact module 137, modify input telephone numbers, dial corresponding telephone numbers, initiate conversations, and disconnect or hang up when a conversation is completed. As noted above, wireless communication optionally employs any of a variety of communication standards, protocols, and technologies.

[0103] Combining RF circuitry 108, audio circuitry 110, speaker 111, microphone 113, touchscreen 112, display controller 156, optical sensor 164, optical sensor controller 158, contact / motion module 130, graphics module 132, text input module 134, contact module 137, and telephone module 138, video conferencing module 139 includes executable instructions to initiate, conduct, and terminate video conferences between the user and one or more other participants based on user instructions.

[0104] Incorporating RF circuitry 108, touchscreen 112, display controller 156, touch / motion module 130, graphics module 132, and text input module 134, email client module 140 includes executable instructions for creating, sending, receiving, and managing emails in response to user commands. Combined with image management module 144, email client module 140 makes it very easy to create and send emails containing still images or video images captured by camera module 143.

[0105] In conjunction with RF circuitry 108, touchscreen 112, display controller 156, touch / motion module 130, graphics module 132, and text input module 134, the instant messaging module 141 includes executable instructions for performing the following operations: entering a character sequence corresponding to an instant message, modifying previously entered characters, sending a corresponding instant message (e.g., using Short Message Service (SMS) or Multimedia Messaging Service (MMS) protocols for telephone-based instant messaging or using XMPP, SIMPLE, or IMPS for internet-based instant messaging), receiving an instant message, and viewing received instant messages. In some embodiments, the sent and / or received instant messages optionally include graphics, photographs, audio files, video files, and / or other attachments supported by MMS and / or Enhanced Messaging Services (EMS). As used herein, "instant message" refers to both telephone-based messages (e.g., messages delivered using SMS or MMS) and internet-based messages (e.g., messages delivered using XMPP, SIMPLE, or IMPS).

[0106] Incorporating RF circuitry 108, touchscreen 112, display controller 156, touch / motion module 130, graphics module 132, text input module 134, GPS module 135, map module 154, and music player module, fitness support module 142 includes executable instructions for performing the following operations: creating fitness activities (e.g., with time, distance, and / or calorie burning goals); communicating with fitness sensors (exercise equipment); receiving fitness sensor data; calibrating sensors used to monitor fitness; selecting and playing music for fitness activities; and displaying, storing, and transmitting fitness data.

[0107] In conjunction with the touchscreen 112, display controller 156, optical sensor 164, optical sensor controller 158, contact / motion module 130, graphics module 132, and image management module 144, the camera module 143 includes executable instructions for performing the following operations: capturing still images or videos (including video streams) and storing them in memory 102, modifying the characteristics of still images or videos, or deleting still images or videos from memory 102.

[0108] Incorporating the touchscreen 112, display controller 156, touch / motion module 130, graphics module 132, text input module 134, and camera module 143, the image management module 144 includes executable instructions for performing operations such as arranging, modifying (e.g., editing) or otherwise manipulating, marking, deleting, presenting (e.g., in a digital slideshow or album), and storing still images and / or video images.

[0109] Incorporating RF circuitry 108, touchscreen 112, display controller 156, touch / motion module 130, graphics module 132, and text input module 134, browser module 147 includes executable instructions for performing the following operations: browsing the Internet according to user instructions, including searching, linking to, receiving, and displaying web pages or portions thereof, as well as links to attachments and other files on web pages.

[0110] Combining RF circuitry 108, touchscreen 112, display controller 156, touch / motion module 130, graphics module 132, text input module 134, email client module 140, and browser module 147, calendar module 148 includes executable instructions to create, display, modify, and store calendars and associated data (e.g., calendar entries, to-dos, etc.) according to user instructions.

[0111] In conjunction with RF circuitry 108, touchscreen 112, display controller 156, touch / motion module 130, graphics module 132, text input module 134, and browser module 147, widget module 149 is optionally a microapplication downloaded and used by a user (e.g., weather widget 149-1, stock market widget 149-2, calculator widget 149-3, alarm clock widget 149-4, and dictionary widget 149-5) or a user-created microapplication (e.g., user-created widget 149-6). In some embodiments, the widget includes HTML (Hypertext Markup Language) files, CSS (Cascading Style Sheets) files, and JavaScript files. In some embodiments, the widget includes XML (Extensible Markup Language) files and JavaScript files (e.g., Yahoo! widgets).

[0112] Incorporating RF circuitry 108, touchscreen 112, display controller 156, touch / motion module 130, graphics module 132, text input module 134, and browser module 147, widget creator module 150 is optionally used by the user to create widgets (e.g., turning user-specified portions of a webpage into widgets).

[0113] In conjunction with the touchscreen 112, display controller 156, touch / motion module 130, graphics module 132, and text input module 134, the search module 151 includes executable instructions for performing the following operations: searching the memory 102 for text, music, sound, images, videos, and / or other files that match one or more search criteria (e.g., one or more user-specified search terms) according to user instructions.

[0114] Combining touchscreen 112, display controller 156, touch / motion module 130, graphics module 132, audio circuitry 110, speaker 111, RF circuitry 108, and browser module 147, video and music player module 152 includes executable instructions allowing users to download and play recorded music and other sound files stored in one or more file formats such as MP3 or AAC files, as well as executable instructions for displaying, presenting, or otherwise playing back video (e.g., on touchscreen 112 or on an external display connected via external port 124). In some embodiments, device 100 optionally includes the functionality of an MP3 player such as an iPod (a trademark of Apple Inc.).

[0115] Combining the touchscreen 112, display controller 156, touch / motion module 130, graphics module 132, and text input module 134, the notepad module 153 includes executable instructions for creating and managing notes, to-do items, etc., according to user instructions.

[0116] Combining RF circuit 108, touch screen 112, display controller 156, contact / motion module 130, graphics module 132, text input module 134, GPS module 135 and browser module 147, map module 154 is optionally used to receive, display, modify and store maps and data associated with the maps (e.g., driving directions, data related to shops and other points of interest at or near a specific location, and other location-based data) according to user instructions.

[0117] Incorporating touchscreen 112, display controller 156, touch / motion module 130, graphics module 132, audio circuitry 110, speaker 111, RF circuitry 108, text input module 134, email client module 140, and browser module 147, the online video module 155 includes instructions for performing the following operations: allowing users to access, browse, receive (e.g., via streaming and / or downloading), play back (e.g., on the touchscreen or on an external display connected via external port 124), send emails with links to specific online videos, and otherwise manage online videos in one or more file formats such as H.264. In some embodiments, an instant messaging module 141 is used instead of the email client module 140 to send links to specific online videos. Additional descriptions of the online video application can be found in U.S. Provisional Patent Application No. 60 / 936,562, filed June 20, 2007, entitled “Portable Multifunction Device, Method, and Graphical User Interface for Playing Online Videos,” and U.S. Patent Application No. 11 / 968,067, filed December 31, 2007, entitled “Portable Multifunction Device, Method, and Graphical User Interface for Playing Online Videos,” the contents of which are incorporated herein by reference in their entirety.

[0118] Each of the modules and applications described above corresponds to an executable set of instructions for performing one or more functions described above and the methods described in this patent application (e.g., computer-implemented methods and other information processing methods described herein). These modules (e.g., instruction sets) need not be implemented as separate software programs (such as computer programs (e.g., including instructions)), processes, or modules; therefore, various subsets of these modules may optionally be combined or otherwise rearranged in various embodiments. For example, a video player module may optionally be combined with a music player module into a single module (e.g., Figure 1A (e.g., video and music player module 152). In some embodiments, memory 102 optionally stores a subset of the above-described modules and data structures. Additionally, memory 102 optionally stores additional modules and data structures not described above.

[0119] In some implementations, device 100 is a device whose operation of a predefined set of functions is performed solely via a touchscreen and / or touchpad. By using a touchscreen and / or touchpad as the primary input control device for operating device 100, the number of physical input control devices (such as push-buttons and dial pads) on device 100 is optionally reduced.

[0120] A predefined set of functions uniquely performed via a touchscreen and / or touchpad may optionally include navigation between user interfaces. In some embodiments, the touchpad, when touched by a user, navigates device 100 from any user interface displayed on device 100 to a main menu, main desktop menu, or root menu. In such embodiments, a "menu button" is implemented using a touchpad. In some other embodiments, the menu button is a physical push-button or other physical input control device, rather than a touchpad.

[0121] Figure 1B This is a block diagram illustrating exemplary components for event handling according to some embodiments. In some embodiments, memory 102 ( Figure 1A ) or memory 370 ( Figure 3A This includes an event classifier 170 (e.g., in operating system 126) and a corresponding application 136-1 (e.g., any one of the aforementioned applications 137 to 151, 155, 380 to 390).

[0122] Event classifier 170 receives event information and determines the application 136-1 and application view 191 of application 136-1 to which the event information should be delivered. Event classifier 170 includes event monitor 171 and event dispatcher module 174. In some embodiments, application 136-1 includes application internal state 192, which indicates one or more current application views displayed on touch-sensitive display 112 when the application is active or executing. In some embodiments, device / global internal state 157 is used by event classifier 170 to determine which application(s) is currently active, and application internal state 192 is used by event classifier 170 to determine the application view 191 to which the event information should be delivered.

[0123] In some implementations, the application internal state 192 includes additional information such as one or more of the following: recovery information to be used when the application 136-1 resumes execution, user interface state information indicating that information is being displayed or ready to be displayed by the application 136-1, a state queue for enabling the user to return to the previous state or view of the application 136-1, and a repeat / undo queue for the user's previous actions.

[0124] Event monitor 171 receives event information from peripheral interface 118. The event information includes information about sub-events, such as a user touch on touch-sensitive display 112 as part of a multi-touch gesture. Peripheral interface 118 transmits information it receives from I / O subsystem 106 or sensors such as proximity sensor 166, accelerometer 168, and / or microphone 113 (via audio circuitry 110). The information received by peripheral interface 118 from I / O subsystem 106 includes information from touch-sensitive display 112 or touch-sensitive surfaces.

[0125] In some implementations, the event monitor 171 sends requests to the peripheral device interface 118 at predetermined intervals. In response, the peripheral device interface 118 sends event information. In other implementations, the peripheral device interface 118 sends event information only when a significant event occurs (e.g., receiving input above a predetermined noise threshold and / or receiving input for a predetermined duration).

[0126] In some implementations, the event classifier 170 also includes a hit view determination module 172 and / or an activity event recognizer determination module 173.

[0127] When the touch-sensitive display 112 displays more than one view, the hit view determination module 172 provides a software process for determining where a sub-event has occurred within one or more views. A view consists of controls and other elements that the user can see on the display.

[0128] Another aspect of the user interface associated with an application is a collection of views, sometimes referred to herein as application views or user interface windows, in which information is displayed and touch-based gestures occur. The application view (of the corresponding application) in which a touch is detected optionally corresponds to a procedural level within the application's procedural or view hierarchy. For example, the lowest-level view in which a touch is detected is optionally referred to as the hit view, and the set of events identified as correct input is optionally determined, at least in part, based on the hit view of the initial touch that initiates the touch-based gesture.

[0129] The hit view determination module 172 receives information related to sub-events of touch-based gestures. When an application has multiple views organized in a hierarchical structure, the hit view determination module 172 identifies the hit view as the lowest-level view in the hierarchical structure from which the sub-events should be processed. In most cases, the hit view is the lowest-level view in which the initiating sub-event (e.g., the first sub-event in a sequence of sub-events forming an event or potential event) occurs. Once the hit view is identified by the hit view determination module 172, the hit view typically receives all sub-events related to the same touch or input source to which it was identified as the hit view.

[0130] The activity event recognizer determination module 173 determines which views(s) within the view hierarchy should receive a specific sub-event sequence. In some embodiments, the activity event recognizer determination module 173 determines that only the hit view should receive the specific sub-event sequence. In other embodiments, the activity event recognizer determination module 173 determines that all views including the physical location of the sub-event are actively participating views, and therefore determines that all actively participating views should receive the specific sub-event sequence. In other embodiments, even if the touch sub-event is entirely confined to the area associated with a particular view, higher views in the hierarchy will still remain actively participating views.

[0131] Event assigner module 174 assigns event information to event identifiers (e.g., event identifier 180). In embodiments that include active event identifier determination module 173, event assigner module 174 delivers event information to the event identifier determined by active event identifier determination module 173. In some embodiments, event assigner module 174 stores event information in an event queue, which is retrieved by the corresponding event receiver 182.

[0132] In some embodiments, operating system 126 includes event classifier 170. Alternatively, application 136-1 includes event classifier 170. In yet another embodiment, event classifier 170 is a separate module or part of another module (such as contact / motion module 130) stored in memory 102.

[0133] In some implementations, application 136-1 includes a plurality of event handlers 190 and one or more application views 191, each of which includes instructions for handling touch events occurring within a corresponding view of the application's user interface. Each application view 191 of application 136-1 includes one or more event recognizers 180. Typically, a corresponding application view 191 includes a plurality of event recognizers 180. In other implementations, one or more of the event recognizers 180 are part of a separate module, such as a user interface toolkit or a higher-level object from which application 136-1 inherits methods and other properties. In some implementations, a corresponding event handler 190 includes one or more of the following: a data updater 176, an object updater 177, a GUI updater 178, and / or event data 179 received from an event classifier 170. Event handlers 190 optionally utilize or invoke the data updater 176, the object updater 177, or the GUI updater 178 to update the application's internal state 192. Alternatively, one or more application views in application view 191 include one or more corresponding event handlers 190. Additionally, in some embodiments, one or more of data updater 176, object updater 177, and GUI updater 178 are included in the corresponding application view 191.

[0134] The corresponding event identifier 180 receives event information (e.g., event data 179) from the event classifier 170 and identifies the event based on the event information. The event identifier 180 includes an event receiver 182 and an event comparator 184. In some embodiments, the event identifier 180 also includes at least one subset of metadata 183 and event delivery instructions 188 (which optionally include sub-event delivery instructions).

[0135] Event receiver 182 receives event information from event classifier 170. The event information includes information about sub-events, such as touch or touch movement. Depending on the sub-event, the event information also includes additional information, such as the location of the sub-event. When the sub-event involves touch movement, the event information optionally also includes the rate and direction of the sub-event. In some embodiments, the event includes the device rotating from one orientation to another (e.g., from a longitudinal orientation to a lateral orientation, or vice versa), and the event information includes corresponding information about the device's current orientation (also referred to as device orientation).

[0136] Event comparator 184 compares event information with predefined event or sub-event definitions and determines the event or sub-event based on the comparison, or determines or updates the state of the event or sub-event. In some embodiments, event comparator 184 includes event definition 186. Event definition 186 contains definitions of events (e.g., predefined sequences of sub-events), such as event 1 (187-1), event 2 (187-2), and others. In some embodiments, sub-events in events (e.g., 187-1 and / or 187-2) include, for example, touch start, touch end, touch move, touch cancel, and multi-touch. In one example, event 1 (187-1) is defined as a double-click on a displayed object. For example, a double-click includes a first touch (touch start) of a predetermined duration on the displayed object, a first lift-off of a predetermined duration (touch end), a second touch (touch start) of a predetermined duration on the displayed object, and a second lift-off of a predetermined duration (touch end). In another example, event 2 (187-2) is defined as a drag on a displayed object. For example, dragging includes a touch (or contact) of a predetermined duration on the displayed object, movement of the touch on the touch-sensitive display 112, and lifting the touch (end of touch). In some embodiments, the event also includes information for one or more associated event handlers 190.

[0137] In some implementations, event definition 186 includes definitions of events for corresponding user interface objects. In some implementations, event comparator 184 performs a hit test to determine which user interface object is associated with the sub-event. For example, in an application view displaying three user interface objects on touch-sensitive display 112, when a touch is detected on touch-sensitive display 112, event comparator 184 performs a hit test to determine which of the three user interface objects is associated with the touch (sub-event). If each displayed object is associated with a corresponding event handler 190, the event comparator uses the result of the hit test to determine which event handler 190 should be activated. For example, event comparator 184 selects the event handler associated with the sub-event and the object that triggered the hit test.

[0138] In some implementations, the definition of the corresponding event (187) also includes a delay action that delays the delivery of event information until it has been determined whether the sub-event sequence actually corresponds to or does not correspond to the event type of the event recognizer.

[0139] When the corresponding event recognizer 180 determines that the sub-event sequence does not match any event in event definition 186, the corresponding event recognizer 180 enters an event impossible, event failed, or event ended state, after which subsequent sub-events based on touch gestures are ignored. In this case, other event recognizers (if any) that remain active in the hit view continue to track and process the ongoing sub-events based on touch gestures.

[0140] In some embodiments, the corresponding event recognizer 180 includes metadata 183 having configurable attributes, flags, and / or lists instructing how the event delivery system should perform sub-event delivery to actively participating event recognizers. In some embodiments, the metadata 183 includes configurable attributes, flags, and / or lists instructing how or how event recognizers can interact with each other. In some embodiments, the metadata 183 includes configurable attributes, flags, and / or lists instructing whether sub-events are delivered to different levels in a view or programmatic hierarchy.

[0141] In some implementations, when one or more specific sub-events of an event are identified, the corresponding event recognizer 180 activates the event handler 190 associated with the event. In some implementations, the corresponding event recognizer 180 delivers event information associated with the event to the event handler 190. Activating the event handler 190 is different from delivering (and deferred delivering) the sub-events to the corresponding hit view. In some implementations, the event recognizer 180 throws a flag associated with the identified event, and the event handler 190 associated with the flag retrieves the flag and performs a predefined process.

[0142] In some implementations, event delivery instruction 188 includes a sub-event delivery instruction that delivers event information about a sub-event without activating an event handler. Instead, the sub-event delivery instruction delivers the event information to an event handler associated with the sub-event sequence or to an actively participating view. The event handler associated with the sub-event sequence or the actively participating view receives the event information and performs a predetermined process.

[0143] In some implementations, data updater 176 creates and updates data used in application 136-1. For example, data updater 176 updates phone numbers used in contact module 137 or stores video files used in video player module. In some implementations, object updater 177 creates and updates objects used in application 136-1. For example, object updater 177 creates new user interface objects or updates the positioning of user interface objects. GUI updater 178 updates the GUI. For example, GUI updater 178 prepares display information and transmits that display information to graphics module 132 for display on a touch-sensitive display.

[0144] In some implementations, event handler 190 includes, or has access to, a data updater 176, an object updater 177, and a GUI updater 178. In some implementations, data updater 176, object updater 177, and GUI updater 178 are included in a single module of the corresponding application 136-1 or application view 191. In other implementations, they are included in two or more software modules.

[0145] It should be understood that the above discussion regarding event handling for user touch on a touch-sensitive display also applies to other forms of user input used to operate the multifunction device 100 using an input device, and not all user input is initiated on the touchscreen. For example, mouse movement and mouse button presses optionally in conjunction with single or multiple keyboard presses or holds; touch movements on the touchpad, such as taps, drags, scrolls, etc.; stylus input; device movement; verbal commands; detected eye movements; biometric input; and / or any combination thereof may optionally be used as input corresponding to sub-events that define the event to be identified.

[0146] Figure 2A portable multifunction device 100 with a touchscreen 112 is illustrated according to some embodiments. The touchscreen optionally displays one or more graphics within a user interface (UI) 200. In this embodiment and other embodiments described below, a user can select one or more graphics by gesturing over the graphics, for example, using one or more fingers 202 (not drawn to scale in the figure) or one or more styluses 203 (not drawn to scale in the figure). In some embodiments, selection of one or more graphics occurs when the user breaks contact with one or more graphics. In some embodiments, gestures optionally include one or more taps, one or more swipes (from left to right, from right to left, up and / or down), and / or scrolling (from right to left, from left to right, up and / or down) of a finger that has been in contact with the device 100. In some specific embodiments or in some cases, unintentional contact with a graphic does not select the graphic. For example, a swipe gesture over an application icon optionally does not select the corresponding application when the gesture corresponding to selection is a tap.

[0147] Device 100 optionally also includes one or more physical buttons, such as a "main desktop" or menu button 204. As previously described, menu button 204 is optionally used to navigate to any application 136 of a set of applications optionally executed on device 100. Alternatively, in some embodiments, the menu button is implemented as a soft key in a GUI displayed on touchscreen 112.

[0148] In some embodiments, device 100 includes a touchscreen 112, a menu button 204, a push-button 206 for powering on / off and locking the device, one or more volume control buttons 208, a SIM card slot 210, a headphone jack 212, and a docking / charging external port 124. The push-button 206 is optionally used to: power on / off the device by pressing the button and holding it in the pressed state for a predefined time interval; lock the device by pressing the button and releasing it before the predefined time interval has elapsed; and / or unlock the device or initiate an unlocking process. In another embodiment, device 100 also accepts voice input via microphone 113 for activating or deactivating certain functions. Device 100 also optionally includes one or more contact strength sensors 165 for detecting the intensity of contact on the touchscreen 112, and / or one or more haptic output generators 167 for generating haptic outputs for a user of device 100.

[0149] Figure 3AThis is a block diagram of an exemplary multi-functional device with a display and a touch-sensitive surface according to some embodiments. Device 300 need not be portable. In some embodiments, device 300 is a laptop computer, desktop computer, tablet computer, multimedia player device, navigation device, educational device (such as a children's learning toy), gaming system, or control device (e.g., a home controller or industrial controller). Device 300 typically includes one or more processing units (CPUs) 310, one or more network or other communication interfaces 360, memory 370, and one or more communication buses 320 for interconnecting these components. The communication bus 320 optionally includes circuitry (sometimes referred to as a chipset) that interconnects system components and controls communication between system components. Device 300 includes an input / output (I / O) interface 330 with a display 340, which is typically a touchscreen display. The I / O interface 330 also optionally includes a keyboard and / or mouse (or other pointing device) 350 and a touchpad 355, and a haptic output generator 357 for generating haptic output on device 300 (e.g., similar to the reference above). Figure 1A The described tactile output generator 167), sensor 359 (e.g., optical sensor, accelerometer, proximity sensor, touch sensor and / or contact intensity sensor (similar to the one described above)) Figure 1A The described contact strength sensor 165). Memory 370 includes high-speed random access memory, such as DRAM, SRAM, DDR RAM, or other random access solid-state memory devices; and optionally includes non-volatile memory, such as one or more disk storage devices, optical disk storage devices, flash memory devices, or other non-volatile solid-state storage devices. Memory 370 optionally includes one or more storage devices located remotely from CPU 310. In some embodiments, memory 370 stores information related to portable multifunction device 100. Figure 1A The memory 370 stores programs, modules, and data structures similar to those in the memory 102 of the portable multifunction device 100, or subsets thereof. Additionally, the memory 370 optionally stores additional programs, modules, and data structures not present in the memory 102 of the portable multifunction device 100. For example, the memory 370 of the device 300 optionally stores a drawing module 380, a rendering module 382, ​​a word processing module 384, a website creation module 386, a disk editing module 388, and / or a spreadsheet module 390, while the portable multifunction device 100 (… Figure 1A The memory 102 may optionally not store these modules.

[0150] Figure 3AEach of the elements described above is optionally stored in one or more memory devices of the previously mentioned memory devices. Each module described above corresponds to a set of instructions for performing the functions described above. The modules or computer programs described above (e.g., instruction sets or including instructions) need not be implemented as separate software programs (such as computer programs (e.g., including instructions)), processes, or modules, and therefore various subsets of these modules are optionally combined or otherwise rearranged in various embodiments. In some embodiments, memory 370 optionally stores a subset of the modules and data structures described above. In addition, memory 370 optionally stores additional modules and data structures not described above.

[0151] Specific embodiments within the scope of this disclosure may be implemented, in whole or in part, using a tangible computer-readable storage medium (or a plurality of tangible computer-readable storage media of one or more types) that encodes one or more computer-readable instructions. It should be understood that computer-readable instructions may be organized in any format, including applications, widgets, processes, software, and / or components.

[0152] Specific embodiments within the scope of this disclosure include computer-readable storage media encoding instructions organized as an application (e.g., application 3160) that, when executed by one or more processing units, control the execution of an electronic device (e.g., device 3150). Figure 3B Methods Figure 3C The methods and / or one or more other processes and / or methods described herein.

[0153] It should be recognized that application 3160 ( Figure 3D The application 3160 (as shown in the diagram) can be any suitable type of application, including one or more of the following: browser applications, applications used as execution environments for plugins, widgets, or other applications, fitness applications, health applications, digital payment applications, media applications, social networking applications, messaging applications, and / or map applications. In some embodiments, application 3160 is an application pre-installed on device 3150 at the time of purchase (e.g., a first-party application). In some embodiments, application 3160 is an application provided to device 3150 via operating system update files (e.g., a first-party or second-party application). In some embodiments, application 3160 is an application provided via an app store. In some embodiments, the app store can be an app store pre-installed on device 3150 at the time of purchase (e.g., a first-party app store). In some embodiments, the app store is a third-party app store (e.g., an app store provided by another app store, downloaded via a network, and / or read from a storage device).

[0154] refer to Figure 3B and Figure 3F Application 3160 obtains information (e.g., 3010). In some embodiments, at 3010, information is obtained from at least one hardware component of device 3150. In some embodiments, at 3010, information is obtained from at least one software module of device 3150. In some embodiments, at 3010, information is obtained from at least one hardware component external to device 3150 (e.g., peripheral devices, accessory devices, and / or servers). In some embodiments, the information obtained at 3010 includes location information, time information, notification information, user information, environmental information, electronic device status information, weather information, media information, historical information, event information, hardware information, and / or motion information. In some embodiments, in response to obtaining information at 3010 and / or thereafter, application 3160 provides the information to the system (e.g., 3020).

[0155] In some implementations, the system (e.g., Figure 3E The system shown as 3110 is the operating system hosted on device 3150. In some implementations, the system (e.g., Figure 3E 3110 shown in the figure is an external device (e.g., a server, peripheral device, accessory and / or personal computing device) that includes an operating system.

[0156] refer to Figure 3C and Figure 3G Application 3160 obtains information (e.g., 3030). In some embodiments, the information obtained at 3030 includes location information, time information, notification information, user information, environmental information, electronic device status information, weather information, media information, historical information, event information, hardware information, and / or motion information. In response to obtaining information at 3030 and / or thereafter, application 3160 performs an operation on the information (e.g., 3040). In some embodiments, the operation performed at 3040 includes: providing notifications based on the information, sending messages based on the information, displaying information, controlling the user interface of a fitness application based on the information, controlling the user interface of a health application based on the information, controlling focus mode based on the information, setting reminders based on the information, adding calendar entries based on the information, and / or calling the API of system 3110 based on the information.

[0157] In some implementations, execution is performed in response to a trigger. Figure 3B Methods and / or Figure 3C The method involves one or more steps. In some implementations, triggering includes event detection, notifications received from system 3110, user input, and / or responses to calls to APIs provided by system 3110.

[0158] In some implementations, when instructions from application 3160 are executed, control device 3150 executes them by invoking an application programming interface (API) (e.g., API 3190) provided by system 3110. Figure 3B Methods and / or Figure 3C The method. In some implementations, application 3160 executes without calling API 3190. Figure 3B Methods and / or Figure 3C At least a part of the method.

[0159] In some implementation schemes, Figure 3B Methods and / or Figure 3C One or more steps of the method involve calling the API (e.g., API 3190) using one or more parameters defined by the API. In some implementations, one or more parameters include constants, keys, data structures, objects, object classes, variables, data types, pointers, arrays, lists, or pointers to functions or methods and / or references to data or other items to be passed via the API in another way.

[0160] refer to Figure 3D Example 3150 is shown. In some embodiments, device 3150 is a personal computing device, smartphone, smartwatch, fitness tracker, head-mounted display (HMD) device, media device, public utility, speaker, television, and / or tablet computer. Figure 3D As illustrated, device 3150 includes application 3160 and operating system (e.g., Figure 3E The system 3110 shown is an example. Application 3160 includes application implementation module 3170 and API call module 3180. System 3110 includes API 3190 and implementation module 3100. It should be understood that device 3150, application 3160, and / or system 3110 may include components related to… Figure 3D and Figure 3E The examples illustrate more, fewer, and / or different components.

[0161] In some implementations, application implementation module 3170 includes a set of one or more instructions corresponding to one or more operations performed by application 3160. For example, when application 3160 is a messaging application, application implementation module 3170 may include operations for receiving and sending messages. In some implementations, application implementation module 3170 communicates with API calling module 3180 via API 3190 (in... Figure 3E (As shown in the figure) communicates with system 3110.

[0162] In some implementations, API 3190 is a software module (e.g., a set of computer-readable instructions) that provides an interface that allows different modules (e.g., API calling module 3180) to access and / or use one or more functions, methods, procedures, data structures, classes, and / or other services provided by implementation module 3100 of system 3110. For example, API calling module 3180 can access features of implementation module 3100 through one or more API calls or enablements (e.g., embodied by function or method calls) exposed by API 3190 (e.g., software and / or hardware modules capable of receiving, responding to, and / or transmitting API calls), and can pass data and / or control information via API calls or enablements using one or more parameters. In some implementations, API 3190 allows application 3160 to use services provided by a software development kit (SDK) library. In some implementations, application 3160 combines calls to functions or methods provided by the SDK library and API 3190, or uses data types or objects defined in the SDK library and provided by API 3190. In some implementations, API calling module 3180 makes API calls via API 3190 to access and use features of implementation module 3100 specified by API 3190. In such implementations, implementation module 3100 may return a value to API calling module 3180 via API 3190 in response to an API call. This value may report to application 3160 the capabilities or status of hardware components of device 3150, including those capabilities or statuses related to aspects such as input capabilities and status, output capabilities and status, processing capabilities, power status, storage capacity and status, and / or communication capabilities. In some implementations, API 3190 is implemented in part by firmware, microcode, or other low-level logic executed in part on hardware components.

[0163] In some implementations, API 3190 allows the developer of API calling module 3180 (which may be a third-party developer) to utilize features provided by implementation module 3100. In such implementations, one or more API calling modules (e.g., including API calling module 3180) may exist that communicate with implementation module 3100. In some implementations, API 3190 allows multiple API calling modules written in different programming languages ​​to communicate with implementation module 3100 (e.g., API 3190 may include features for translating calls and returns between implementation module 3100 and API calling module 3180), and API 3190 is implemented in a specific programming language. In some implementations, API calling module 3180 calls APIs from different providers, such as one set of APIs from an OS provider, another set of APIs from a plugin provider, and / or another set of APIs from another provider (e.g., a software library provider) or the creator of another set of APIs.

[0164] Examples of API 3190 may include one or more of the following: pairing API (e.g., for establishing a secure connection, such as with an accessory), device detection API (e.g., for locating nearby devices, such as media devices and / or smartphones), payment API, UIKit API (e.g., for generating user interfaces), location detection API, locator API, map API, health sensor API, sensor API, messaging API, push notification API, streaming API, collaboration API, video conferencing API, app store API, advertising service API, web browser API (e.g., WebKit API), transportation API, networking API, WiFi API, Bluetooth API, NFC API, UWB API, fitness API, smart home API, contact transfer API, photo API, camera API, and / or image processing API. In some implementations, a sensor API is an API for accessing data associated with sensors of device 3150. For example, a sensor API may provide access to raw sensor data. Alternatively, a sensor API may provide data derived (and / or generated) from raw sensor data. In some implementations, sensor data includes temperature data, image data, video data, audio data, heart rate data, IMU (Inertial Measurement Unit) data, LiDAR data, location data, GPS data, and / or camera data. In some implementations, sensors include one or more of accelerometers, temperature sensors, infrared sensors, optical sensors, heart rate sensors, barometers, gyroscopes, proximity sensors, and / or biometric sensors.

[0165] In some embodiments, implementation module 3100 is a system (e.g., an operating system and / or server system) software module (e.g., a set of computer-readable instructions) configured to perform operations in response to receiving an API call via API 3190. In some embodiments, implementation module 3100 is configured to provide an API response (via API 3190) as a result of processing the API call. For example, implementation module 3100 and API call module 3180 can each be any of an operating system, library, device driver, API, application, or other module. It should be understood that implementation module 3100 and API call module 3180 can be the same or different types of modules. In some embodiments, implementation module 3100 is at least partially embodied in firmware, microcode, or hardware logic.

[0166] In some implementations, implementation module 3100 returns a value via API 3190 in response to an API call from API calling module 3180. While API 3190 defines the syntax and results of the API call (e.g., how to enable the API call and what the API call does), API 3190 may not reveal how implementation module 3100 performs the functionality specified by the API call. Various API calls are transmitted via one or more application programming interfaces between API calling module 3180 and implementation module 3100. Transmitting API calls may include issuing, initiating, referencing, calling, receiving, returning, and / or responding to function calls or messages. In other words, transmissions may describe the actions of API calling module 3180 or implementation module 3100. In some implementations, function calls or other references to API 3190 transmit and / or receive one or more parameters via parameter lists or other structures.

[0167] In some implementations, implementation module 3100 provides more than one API, each API providing a different view or aspect of the functionality implemented by implementation module 3100. For example, one API of implementation module 3100 may provide a first set of functions and be exposed to third-party developers, while another API of implementation module 3100 may be hidden (e.g., not exposed) and provide a subset of the first set of functions, and also provide another set of functions, such as test or debug functions not in the first set of functions. In some implementations, implementation module 3100 calls one or more other components via lower-level APIs, thus acting as both an API calling module and an implementation module. It should be recognized that implementation module 3100 may include additional functions, methods, classes, data structures, and / or other features not specified through API 3190 and not available to API calling module 3180. It should also be recognized that API calling module 3180 may be on the same system as implementation module 3100, or may be remotely located and accessed via a network using API 3190. In some implementations, implementation module 3100, API 3190, and / or API calling module 3180 are stored in a machine-readable medium, which includes any means for storing information in a machine-readable (e.g., computer or other data processing system) form. For example, a machine-readable medium may include a magnetic disk, optical disk, random access memory, read-only memory, and / or flash memory devices.

[0168] An Application Programming Interface (API) is an interface between a first software process and a second software process, specifying the format for communication between the two processes. Limited APIs (e.g., private or partner APIs) are APIs accessible to a limited set of software processes (e.g., only software processes within the operating system or only software processes authorized to access the limited API). Public APIs are accessible to a broader set of software processes. Some APIs enable a software process to communicate or set the state of one or more input devices (e.g., one or more touch sensors, proximity sensors, vision sensors, motion / or orientation sensors, pressure sensors, intensity sensors, sound sensors, wireless proximity sensors, biometric sensors, buttons, switches, rotatable elements, and / or external controllers). Some APIs enable a software process to communicate and / or set the state of one or more output generation components (e.g., one or more audio output generation components, one or more display generation components, and / or one or more haptic output generation components). Some APIs enable specific capabilities (e.g., scrolling, handwriting, text input, image editing, and / or image creation) to be accessed, executed, and / or used by a software process (e.g., generating output for use by the software process based on input from the software process). Some APIs enable content from software processes to be inserted into templates and displayed in user interfaces with layouts and / or behaviors specified by the templates.

[0169] Many software platforms include a set of frameworks that provide core objects and behaviors that software developers need to build software applications that can be used on the platform. Software developers use these objects to display content on a screen, interact with that content, and manage interactions with the software platform. The basic behavior of a software application depends on this set of frameworks, and these frameworks provide software developers with numerous ways to customize the application's behavior to match the specific needs of the software application. Many of these core objects and behaviors are accessed via APIs. APIs typically specify the format for communication between software processes, including specifying and grouping available variables, functions, and protocols. API calls (sometimes called API requests) are typically passed from a sending software process to a receiving software process as a way to achieve one or more of the following: the sending software process requests information from the receiving software process (e.g., for the sending software process to take an action); the sending software process provides information to the receiving software process (e.g., for the receiving software process to take an action); the sending software process requests an action from the receiving software process; or the sending software process provides information to the receiving software process about the action taken by the sending software process. In some cases, interaction with a device (e.g., using a user interface) will involve transmitting and / or receiving one or more API calls (e.g., multiple API calls) between multiple different software processes (e.g., different parts of an operating system, applications and operating systems, or different applications) via one or more APIs (e.g., via multiple different APIs). For example, when input is detected, direct sensor data is frequently processed into one or more input events, which are provided (e.g., via an API) to a receiving software process, which makes some determinations based on the input events and then (e.g., via an API) transmits information to the software process to perform an operation (e.g., change the device state and / or the user interface) based on the determinations. While the determinations and the operations performed in response can be made by the same software process, alternatively, the determinations can be made in a first software process and relayed (e.g., via an API) to a second software process different from the first software process, allowing the operation to be performed by the second software process. Alternatively, the second software process can relay instructions (e.g., via an API) to a third software process different from the first and / or second software processes to perform the operation. It should be understood that some or all user interactions with a computer system may involve one or more API calls within the steps of interacting with the computer system (e.g., between different software components of the computer system or between software components of the computer system and software components of one or more remote computer systems).It should be understood that some or all user interactions with a computer system may involve one or more API calls between steps of interaction with the computer system (e.g., between different software components of the computer system or between software components of the computer system and software components of one or more remote computer systems).

[0170] In some implementations, the application can be any suitable type of application, including one or more of the following: browser applications, applications used as the execution environment for plugins, widgets or other applications, fitness applications, health applications, digital payment applications, media applications, social networking applications, messaging applications and / or map applications.

[0171] In some embodiments, the application is an application pre-installed on the first computer system at the time of purchase (e.g., a first-party application). In some embodiments, the application is an application provided to the first computer system via an operating system update file (e.g., a first-party application). In some embodiments, the application is an application provided via an app store. In some embodiments, the app store is pre-installed on the first computer system at the time of purchase (e.g., a first-party app store) and allows the download of one or more applications. In some embodiments, the app store is a third-party app store (e.g., an app store provided by another device, downloaded via a network, and / or read from a storage device). In some embodiments, the application is a third-party application (e.g., an application provided by an app store, downloaded via a network, and / or read from a storage device). In some embodiments, the application controls the first computer system to execute methods 700, 800, and / or 1000 by calling an application programming interface (API) provided by a system process using one or more parameters. Figure 7 , Figure 8 and / or Figure 10 ).

[0172] In some implementations, exemplary APIs provided by system processes include one or more of the following: pairing API (e.g., for establishing a secure connection, such as with an accessory), device detection API (e.g., for locating nearby devices, such as media devices and / or smartphones), payment API, UIKit API (e.g., for generating user interfaces), location detection API, locator API, map API, health sensor API, sensor API, messaging API, push notification API, streaming API, collaboration API, video conferencing API, app store API, advertising service API, web browser API (e.g., WebKit API), transportation API, networking API, WiFi API, Bluetooth API, NFC API, UWB API, fitness API, smart home API, contact transfer API, photo API, camera API, and / or image processing API.

[0173] In some embodiments, at least one API is a software module (e.g., a set of computer-readable instructions) that provides an interface allowing different modules (e.g., an API calling module) to access and use one or more functions, methods, procedures, data structures, classes, and / or other services provided by an implementation module of a system process. The API may define one or more parameters passed between the API calling module and the implementation module. In some embodiments, API 3190 defines a first API call that can be provided by API calling module 3180. An implementation module is a system software module (e.g., a set of computer-readable instructions) configured to perform operations in response to receiving an API call via the API. In some embodiments, the implementation module is configured to provide an API response (via the API) as a result of processing the API call. In some embodiments, the implementation module is included in a device (e.g., 3150) running an application. In some embodiments, the implementation module is included in an electronic device separate from the device running the application.

[0174] Now let’s turn our attention to the implementation of the user interface, which is optionally implemented on, for example, a portable multifunction device 100.

[0175] Figure 4A An exemplary user interface for an application menu on a portable multifunction device 100 according to some embodiments is illustrated. A similar user interface is optionally implemented on device 300. In some embodiments, user interface 400 includes the following elements or a subset or superset thereof: • Signal strength indicator 402 for wireless communications such as cellular signals and Wi-Fi signals; • Time 404; • Bluetooth indicator 405; • Battery status indicator 406; • Tray 408 with icons of commonly used applications, such as: o The telephone module 138 has an icon 416 labeled "telephone", which optionally includes an indicator 414 indicating the number of missed calls or voicemail messages; o An icon 418 labeled "Mail" in the email client module 140, which optionally includes an indicator 410 for the number of unread emails; o The browser module 147 has an icon 420 labeled "Browser"; and o The video and music player module 152 (also known as the iPod (Apple Inc. trademark) module 152) with an icon 422 labeled "iPod"; and • Icons of other applications, such as: o IM module 141's icon 424 labeled "Message"; o Calendar module 148 has an icon 426 labeled "Calendar"; o Image management module 144 icon 428 labeled "Photo"; o The icon 430 of the camera module 143 is labeled "camera"; o The icon 432 of the online video module 155 is labeled "Online Video"; o The icon 434 labeled "Stock Market" in the Stock Market widget 149-2; o Map module 154's icon 436 labeled "map"; o Weather widget 149-1 with icon 438 labeled "Weather"; o Alarm clock widget 149-4 with icon 440 labeled "Clock"; o The icon 442 of the fitness support module 142 is labeled "fitness support"; o The notepad module 153 has an icon 444 labeled "Notepad"; and o The icon 446, labeled "Settings," is used to set up applications or modules that provide access to settings for device 100 and its various applications 136.

[0176] It should be pointed out that, Figure 4AThe illustrated icon labels are merely exemplary. For example, icon 422 of video and music player module 152 is labeled "Music" or "Music Player". Other labels are optionally used for various application icons. In some embodiments, the label of a particular application icon includes the name of the application corresponding to that particular application icon. In some embodiments, the label of a particular application icon is different from the name of the application corresponding to that particular application icon.

[0177] Figure 4B An example is illustrated having a touch-sensitive surface 451 (e.g., separate from the display 450 (e.g., touchscreen display 112)). Figure 3A Devices such as tablets or touchpads (e.g., 355) Figure 3A An exemplary user interface on the device 300. The device 300 also optionally includes one or more contact intensity sensors (e.g., one or more of the sensors 359) for detecting the intensity of contact on the tactile surface 451 and / or one or more tactile output generators 357 for generating tactile outputs for the user of the device 300.

[0178] While some examples of input on a touchscreen display 112 (which combines a touch-sensitive surface and a display) are given below, in some implementations the device detects input on a touch-sensitive surface separate from the display, such as... Figure 4B As shown in the diagram. In some embodiments, the touch-sensitive surface (e.g., Figure 4B 451) has a spindle (e.g., on the display (e.g., 450) corresponding to the main axis on the display (e.g., Figure 4B The main shaft of 453 in the middle (e.g., Figure 4B (452 in the example). According to these embodiments, the device detects the position corresponding to a specific location on the display (e.g., in...). Figure 4B In the diagram, 460 corresponds to 468 and 462 corresponds to 470) is in contact with the touch-sensitive surface 451 (e.g., Figure 4B (460 and 462 in the text). Thus, when the touch-sensitive surface (e.g., ...) Figure 4B 451 in the middle) and the display of a multi-functional device (e.g., Figure 4B When 450 is separated from the touch-sensitive surface, user input detected by the device on that touch-sensitive surface (e.g., touches 460 and 462 and their movement) is used by the device to manipulate the user interface on the display. It should be understood that similar methods may be optionally used for other user interfaces described herein.

[0179] Additionally, while the examples below are given primarily with reference to finger input (e.g., finger touch, finger tap, finger swipe), it should be understood that in some implementations, one or more of these finger inputs may be replaced by input from another input device (e.g., mouse-based input or stylus input). For example, a swipe gesture may optionally be replaced by a mouse click (e.g., instead of a touch), followed by movement of the cursor along the path of the swipe (e.g., instead of movement of the touch). Similarly, a tap gesture may optionally be replaced by a mouse click while the cursor is over the location of the tap gesture (e.g., instead of detection of touch, followed by cessation of touch detection). Likewise, when multiple user inputs are detected simultaneously, it should be understood that multiple computer mice may optionally be used simultaneously, or mouse and finger touch may optionally be used simultaneously.

[0180] Figure 5A An exemplary personal electronic device 500 is illustrated. Device 500 includes a body 502. In some embodiments, device 500 may include components relative to devices 100 and 300 (e.g., Figures 1A to 4B The device 500 may include some or all of the features described herein. In some embodiments, the device 500 has a touch-sensitive display 504, referred to below as a touchscreen 504. Alternatively, or in addition to the touchscreen 504, the device 500 may also have a display and a touch-sensitive surface. Similar to the cases of devices 100 and 300, in some embodiments, the touchscreen 504 (or touch-sensitive surface) optionally includes one or more intensity sensors for detecting the intensity of an applied contact (e.g., a touch). The one or more intensity sensors of the touchscreen 504 (or touch-sensitive surface) may provide output data representing the intensity of the touch. The user interface of the device 500 may respond to touches based on the intensity of the touch, meaning that touches of different intensities may invoke different user interface operations on the device 500.

[0181] Exemplary techniques for detecting and processing touch intensity are found, for example, in the following related applications: International Patent Application Serial No. PCT / US2013 / 040061, filed May 8, 2013, entitled “Device, Method, and Graphical User Interface for Displaying UserInterface Objects Corresponding to an Application,” published as WIPO Publication No. WO / 2013 / 169849; and International Patent Application Serial No. PCT / US2013 / 069483, filed November 11, 2013, entitled “Device, Method, and Graphical User Interface for Transitioning Between TouchInput to Display Output Relationships,” published as WIPO Publication No. WO / 2014 / 105276, each of which is incorporated herein by reference in its entirety.

[0182] In some embodiments, device 500 has one or more input mechanisms 506 and 508. Input mechanisms 506 and 508, if included, can be physical. Examples of physical input mechanisms include push-buttons and rotatable mechanisms. In some embodiments, device 500 has one or more attachment mechanisms. Such attachment mechanisms, if included, allow device 500 to be attached to, for example, hats, glasses, earrings, necklaces, shirts, jackets, bracelets, watch straps, bangles, trousers, belts, shoes, wallets, backpacks, etc. These attachment mechanisms allow a user to wear device 500.

[0183] Figure 5B An exemplary personal electronic device 500 is depicted. In some embodiments, device 500 may include information about... Figure 1A , Figure 1B and Figure 3ASome or all of the components described. Device 500 has a bus 512 that operatively couples I / O portion 514 to one or more computer processors 516 and memory 518. I / O portion 514 may be connected to display 504, which may have touch-sensitive component 522 and optionally have intensity sensor 524 (e.g., contact intensity sensor). Furthermore, I / O portion 514 may be connected to communication unit 530 for receiving application and operating system data using Wi-Fi, Bluetooth, near field communication (NFC), cellular and / or other wireless communication technologies. Device 500 may include input mechanisms 506 and / or 508. For example, input mechanism 506 may optionally be a rotatable input device or a pressable input device and a rotatable input device. In some examples, input mechanism 508 may optionally be a button.

[0184] In some examples, the input mechanism 508 is optionally a microphone. The personal electronic device 500 optionally includes various sensors, such as a GPS sensor 532, an accelerometer 534, an orientation sensor 540 (e.g., a compass), a gyroscope 536, a motion sensor 538, and / or combinations thereof, all of which are operatively connected to the I / O section 514.

[0185] The memory 518 of the personal electronic device 500 may include one or more non-transitory computer-readable storage media for storing computer-executable instructions, which, when executed by one or more computer processors 516, may cause the computer processors to perform the techniques described below, including processes 700-800 and 1000. Figures 7 to 8 and Figure 10 A computer-readable storage medium can be any medium that can tangibly contain or store computer-executable instructions for use by or in connection with an instruction execution system, apparatus, or device. In some examples, the storage medium is a transient computer-readable storage medium. In some examples, the storage medium is a non-transitory computer-readable storage medium. Non-transitory computer-readable storage media can include, but are not limited to, magnetic storage devices, optical storage devices, and / or semiconductor storage devices. Examples of such storage devices include magnetic disks, optical discs based on CD, DVD, or Blu-ray technology, and persistent solid-state storage such as flash memory, solid-state drives, etc. Personal electronic devices are not limited to... Figure 5B It can be the components and configurations, or it can include other components or additional components in a variety of configurations.

[0186] As used herein, the term "power indication" refers optionally to the power indication in devices 100, 300, and / or 500 ( Figure 1A , Figure 3A and Figures 5A to 5BA user-interactive graphical user interface object displayed on a screen. For example, images (e.g., icons), buttons, and text (e.g., hyperlinks) optionally each constitute a functional representation.

[0187] As used herein, the term "focus selector" refers to an input element used to indicate the current portion of a user interface with which a user is interacting. In some specific implementations that include a cursor or other position marker, the cursor acts as a "focus selector," such that when the cursor is over a particular user interface element (e.g., a button, window, slider, or other user interface element), the cursor is positioned on a touch-sensitive surface (e.g., a...). Figure 3A The touchpad 355 or Figure 4B When an input (e.g., a press input) is detected on the touch-sensitive surface 451 of the display, the specific user interface element is adjusted according to the detected input. This applies to touchscreen displays (e.g., those capable of direct interaction with user interface elements on a touchscreen display) that enable direct interaction with user interface elements on the touchscreen display. Figure 1A The touch-sensitive display system 112 or Figure 4A In some embodiments of the touchscreen 112, a touch detected on the touchscreen acts as a "focus selector," such that when input (e.g., a press input by touch) is detected at the location of a particular user interface element (e.g., a button, window, slider, or other user interface element) on the touchscreen display, that particular user interface element is adjusted according to the detected input. In some embodiments, focus moves from one area of ​​the user interface to another without corresponding movement of the cursor or movement of a touch on the touchscreen display (e.g., moving focus from one button to another using tab keys or arrow keys); in these embodiments, the focus selector moves according to the movement of focus between different areas of the user interface. Regardless of the specific form the focus selector takes, the focus selector is typically a user-controlled user interface element (or a touch on the touchscreen display) that conveys the user's expected interaction with the user interface (e.g., by indicating to the device the elements of the user interface that the user expects to interact with). For example, when a press input is detected on a touch-sensitive surface (e.g., a touchpad or touchscreen), the position of the focus selector (e.g., a cursor, touch, or selection box) above the corresponding button will indicate to the user that they expect to activate the corresponding button (rather than other user interface elements shown on the device's display).

[0188] As used in the specification and claims, the term "characteristic strength" of a contact refers to a characteristic of the contact based on one or more intensities of the contact. In some embodiments, the characteristic strength is based on multiple intensity samples. The characteristic strength is optionally based on a predefined number of intensity samples or a set of intensity samples collected over a predetermined time period (e.g., 0.05 seconds, 0.1 seconds, 0.2 seconds, 0.5 seconds, 1 second, 2 seconds, 5 seconds, 10 seconds) relative to a predefined event (e.g., after contact is detected, before contact is detected to be lifted off, before or after contact begins to move, before contact ends, before or after contact intensity is detected to increase, and / or before or after contact intensity decreases). The characteristic strength of the contact is optionally based on one or more of the following: the maximum value of the contact intensity, the mean value of the contact intensity, the average value of the contact intensity, the value at the top 10% of the contact intensity, the half maximum value of the contact intensity, or the 90% maximum value of the contact intensity, etc. In some embodiments, the duration of the contact is used when determining the characteristic strength (e.g., when the characteristic strength is the average value of the contact intensity over time). In some implementations, the characteristic intensity is compared to a set of one or more intensity thresholds to determine whether a user has performed an action. For example, the set of one or more intensity thresholds may optionally include a first intensity threshold and a second intensity threshold. In this example, contact with a characteristic intensity not exceeding the first threshold results in a first action, contact with a characteristic intensity exceeding the first intensity threshold but not exceeding the second intensity threshold results in a second action, and contact with a characteristic intensity exceeding the second threshold results in a third action. In some implementations, a comparison between the characteristic intensity and one or more thresholds is used to determine whether one or more actions should be performed (e.g., whether to perform the corresponding action or abandon performing the corresponding action) rather than to determine whether to perform the first action or the second action.

[0189] Now let’s turn our attention to the implementation of user interfaces (“UIs”) on electronic devices, such as portable multifunction devices 100, 300 or 500, and the associated processes.

[0190] Figures 6A to 6BH Exemplary user interfaces for managing hearing health, according to some implementation schemes, are illustrated. The user interfaces in these figures are used to illustrate the processes described below, including... Figure 7 and Figure 8 The process in.

[0191] Figure 6A An example is a computer system 600, which includes a display 602 and hardware (e.g., wireless (such as Bluetooth) and / or wired) for connecting to headphones (e.g., headsets, earphones, and / or earbuds). Figure 6AAt this point, computer system 600 displays a system settings user interface 604 via display 602, which includes a list 604A of paired devices. It is worth noting that earbuds 610 and 620 are not currently paired with computer system 600 (e.g., using short-range communication protocols and / or different protocols), as indicated by the indication that list 604A does not include earbuds 610 or 620.

[0192] exist Figure 6B At this point, computer system 600 detects that earbud 610 is ready to pair with computer system 600, and in response, computer system 600 displays pairing form 606A on main screen 606. Computer system 600 detects input 650A pointing to connection option 606B of pairing form 606A (e.g., tap input and / or tap and hold input), and in response, computer system 600 initiates (e.g., using short-range communication protocol and / or different protocol) a pairing process for earbud 610 with computer system 600. Earbud 610 includes left earbud 610A and right earbud 610B. Earbud 610 is configured to be placed and / or stored in case 612. Computer system 600 determines that earbud 610 is a type (e.g., second type) audio device (e.g., earbud 610 does not have active noise cancellation, does not include a microphone, and / or is not configured to form a seal with the user's ear (e.g., the user's ear canal and / or the user's outer ear)). Based on the determination that earbud 610 is a second-type audio device, computer system 600 continues (as part of the process of pairing earbud 610 with computer system 600) to pair earbud 610 with computer system 600 without providing an option to perform a hearing test. After pairing earbud 610 with computer system 600 (and without providing an option to perform a hearing test and without performing a hearing test), computer system 600 updates form 606A to indicate that earbud 610 has been paired with computer system 600, as shown below. Figure 6C As shown. Therefore, during the process of pairing the earpiece 610 with the computer system 600, the computer system 600 does not provide an option to perform a hearing test using the earpiece 610, because the earpiece 610 cannot provide sufficiently accurate results for the hearing test.

[0193] exist Figure 6DAt this point, computer system 600 detects that earbud 620 is ready to pair with computer system 600, and in response, computer system 600 displays pairing form 608 on main screen 606. Computer system 600 detects input 650B pointing to connection option 608A of pairing form 608 (e.g., tapping input and / or tapping and holding input), and in response, computer system 600 initiates a process to pair earbud 620 with computer system 600. Earbud 620 includes a left earbud 620A and a right earbud 620B. Earbud 620 is configured to be placed and / or stored in case 622. Computer system 600 determines (e.g., in response to input 650B) that earbud 620 is a type (e.g., first type) audio device (e.g., earbud 620 does have active noise cancellation, does include a microphone, and / or is configured to form a seal with the user's ear (e.g., the user's ear canal and / or the user's outer ear)). Based on the determination that earbud 620 is a first-type audio device, computer system 600 continues (as part of the process of pairing earbud 620 with computer system 600) to pair earbud 620 with computer system 600 and provides the user with option 608B for performing a hearing test, such as Figure 6E As shown.

[0194] exist Figure 6E At this point, computer system 600 displays option 608B for performing a hearing test and option 608C for continuing the process of pairing earpiece 620 with computer system 600 without performing a hearing test. Figure 6E At this point, computer system 600 receives user input. In response to receiving user input and determining that the user input (e.g., tapping the input and / or tapping and holding the input 650C) points to an option 608C for skipping the hearing test, computer system 600 continues the process of pairing earpiece 620 with computer system 600 without performing the hearing test, such as by updating form 608 to indicate that earpiece 620 has been paired with computer system 600 (e.g., similar to...). Figure 6C In response to receiving user input and determining, based on the user input (e.g., tapping input and / or tapping and holding input 650D) pointing to option 608B for performing the hearing test, computer system 600 continues the process of performing the hearing test, as follows. Figures 6F to 6AH As shown.

[0195] exist Figure 6F At this point, the computer system 600 displays a hearing test user interface 630, which has an option 630A for continuing and an option 630B for importing hearing test results from a previous hearing test. Figure 6FAt this point, computer system 600 receives user input. In response to receiving user input and determining that the user input (e.g., tapping input and / or tapping and holding input 650E) points to option 630A for continuing the hearing test, computer system 600 continues to... Figure 6G The user interface is shown. In response to receiving user input and determining that the user input (e.g., tapping input or tapping and holding input 650F) points to an option 630B for importing test results, the computer system 600 initiates a process that enables the user to import test results from a previous hearing test. In some embodiments, in response to detecting activation of option 630B, the computer system 600 provides an option to select the results of one or more previously performed hearing tests and configures the earpiece 620 as a hearing aid based on the selected results. In some embodiments, the computer system 600 excludes options for incomplete and / or incompatible results of previously performed hearing tests with the computer system 600 and / or the earpiece 620, while displaying options for complete and / or compatible results of previously performed hearing tests with the computer system 600 and / or the earpiece 620. Therefore, the computer system 600 optionally reduces the available options for the results of previously performed hearing tests that can be imported for configuring the earpiece 620 as a hearing aid.

[0196] exist Figure 6G At this point, computer system 600 updates hearing test user interface 630 to instruct computer system 600 to check the performance of earplug 620 (e.g., if the performance of earplug 620 has not been checked recently (e.g., within the last month, six months, or a year), thereby providing the user with visual feedback on the process the computer system will perform. In response to detecting user input pointing to option 630C (e.g., tapping input and / or tapping and holding input 650F), computer system 600 initiates the process of checking the performance of earplug 620, as follows: Figures 6H to 6K As shown. During the process of checking the performance of earbud 620, computer system 600 determines whether earbud 620 is placed in its case 622 and whether the lid of case 622 is closed. If earbud 620 is not in its case 622 and the lid of case 622 is not closed, computer system 600 displays alarm 630D, as shown. Figure 6H As shown, the user is instructed to place the earbuds 620 into their case 622 (and optionally, close the lid) (for example, next step option 630E is disabled). Figure 6I As shown, once the computer system 600 detects that the earbud 620 is in its case 622 and the lid of case 622 is closed, the computer system 600 provides a next step option 630F, which, when activated via input (e.g., tapping an input and / or tapping and holding an input 650G), causes the computer system 600 to initiate a test of the earbud 620, as... Figure 6J As shown. In Figure 6J At this point, computer system 600 (e.g., via instruction 630G) instructs that a performance test of earbud 620 is being performed. During the performance test, one or more speakers of earbud 620 output audio, and one or more microphones of earbud 620 detect / record audio. (e.g., by computer system 600 and / or by earbud 620) The detected / recorded audio is analyzed to determine whether the audio is within a threshold performance range. For example, the performance test may optionally test one or both earbuds 620 (e.g., individually and / or concurrently) for one or more of the following: the volume of the recorded audio, the frequency of the recorded audio, and / or the volume of various frequencies of the recorded audio. If there are no problems with the speakers and microphones, the recorded audio falls within the threshold performance range (e.g., for one or more tests), and computer system 600 (e.g., via display 602) provides instruction 630H regarding the suitability of earbud 620 for hearing testing, such as... Figure 6K As shown. In Figure 6K At this point, computer system 600 detects input pointing to the next option 630I (e.g., tapping input and / or tapping and holding input 650H) and continues to... Figure 6M The user interface 630. If there is a problem with the speaker and / or microphone, the recorded audio may fall outside the threshold performance, and the computer system 600 (e.g., via display 602) provides an indication 630J that the earpiece 620 is not suitable for hearing tests, such as... Figure 6L As shown. In Figure 6L At this point, the computer system 600 also provides a next step option 630K to continue (e.g., when activated by user input (e.g., tapping the input key and / or tapping and holding the input key 650I)) and / or to complete the pairing process (e.g., by displaying a similar...). Figure 6C (User interface). Figure 6LAt this point, computer system 600 provides import option 630L to display options for importing (e.g., when activated by user input (e.g., tapping input and / or tapping and holding input 650J)) audiogram data (e.g., information indicating the user's hearing at multiple frequencies (such as for one or both ears of the user)), such as from an application of computer system 600 and / or from a server. In some embodiments, in response to detecting activation of import option 630L, computer system 600 provides options for selecting the results of one or more previously performed hearing tests and configuring earplug 620 as a hearing aid based on the selected results. In some embodiments, computer system 600 excludes options for incomplete and / or incompatible results of previously performed hearing tests, while displaying options for complete and / or compatible results of previously performed hearing tests. Therefore, the computer system 600 optionally reduces the options for the results of previously performed hearing tests, which can be imported for configuring the earpiece 620 as a hearing aid. In some embodiments, the computer system 600 does not prompt during the pairing process (e.g., Figure 6G (630 and 630C) Check the performance of earplug 620 and / or do not check (e.g., Figures 6J to 6K The performance of the 620 earbuds.

[0197] exist Figure 6M At this point, computer system 600 displays information about how the hearing test works, thus providing the user with details about the hearing test procedure to be performed. In response to detecting activation of the next option 630M (e.g., tapping to enter and / or tapping and holding to enter 650K), computer system 600 continues to update user interface 630, such as... Figure 6N As shown. In Figure 6N At this point, computer system 600 collects information about the user and earpiece 620 of computer system 600. Computer system 600 prompts 630N whether the user is 21 years of age or older, prompts 630 whether the user is currently experiencing any symptoms, and prompts 630P whether the user has been in a noisy environment in the past 24 hours (and / or other time periods). Computer system 600 detects inputs 650L-650N corresponding to prompts 630N-630P, then detects user input pointing to the continue option 630Q (e.g., tapping the input and / or tapping and holding the input 650O), and in response, continues to update user interface 630, such as... Figure 6O As shown. In some implementations, the answer to prompt 630N-630P determines whether computer system 600 continues the hearing test (e.g., if the user indicates that they have recently been in a noisy environment, computer system 600 does not continue the hearing test).

[0198] exist Figure 6O At this point, computer system 600 prompts user 630R to find a quiet place to perform the hearing test. In response to detecting the activation of the next option 630S (e.g., tapping input and / or tapping and holding input 650P), computer system 600 continues to update user interface 630, such as... Figure 6P As shown. In Figure 6P At this point, computer system 600 prompts user 630T to place the left and right earbuds of earbud 620 into the user's ears. In response to detecting activation of the next option 630U (e.g., tapping input and / or tapping and holding input 650Q) (and / or in response to detecting that earbud 620 has been placed into the user's ears), computer system 600 continues to update user interface 630, such as... Figure 6Q As shown.

[0199] exist Figure 6Q At this point, computer system 600 displays information regarding the performance of a fit check (checking whether the earplug 620 fits correctly in the user's ear) and a background noise check (ensuring the user's physical environment is sufficiently quiet). In some implementations, the fit check and background noise check are performed concurrently because some processes of the two tests overlap. In some implementations, the fit check and background noise check are performed continuously. Figure 6Q In response to detecting the activation of the start option 630V (e.g., tapping the input and / or tapping and holding the input 650R), the computer system 600 continues to initiate fit checks and background noise checks and updates the user interface 630, such as Figure 6R As shown.

[0200] In some implementation schemes, Figure 6R During fit checks and background noise checks, earbuds 620 (e.g., individually or together) output audio via their speakers, and earbuds 620's microphones are used to concurrently record and / or analyze the detected audio. In some embodiments, when the microphone of earbuds 620 detects audio output via the speakers of earbuds 620 exceeding a threshold level, computer system 600 determines that the fit of earbuds 620 is incorrect (e.g., earbuds 620 have not formed a sufficient seal with the user's ear to block some / all of the audio output by the speakers of earbuds 620), and prompts the user to adjust earbuds 620, such as... Figure 6SAs shown. When the microphone using earbud 620 does not detect audio output via the speaker of earbud 620 or detects that the audio is below a threshold level, computer system 600 determines that the earbud 620 fits correctly (e.g., earbud 620 has formed a sufficient seal with the user's ear to block most / all of the audio output by the speaker of earbud 620), and indicates to the user that the earbud 620 fits well, such as... Figure 6T As shown.

[0201] The computer system 600 also determines, via background noise checks, whether the physical environment in which the user (and therefore the earpiece 620) is located is quiet enough to perform a hearing test. Figures 6U1 to 6V2 As shown, computer system 600 displays an ambient noise indicator 630X representing the level (e.g., loudness) (and optionally, frequency) of the audio detected by earplug 620. The ambient noise indicator 630X changes in conjunction with the audio detected by earplug 620 (e.g., in height, shape, and / or color) to provide the user with real-time or near-real-time visual feedback regarding the ambient noise level. This allows the user to change their environment (e.g., move to a different room, turn off a television or other device, and / or close a door) and observe how that change affects the ambient noise level detected by earplug 620. The visual feedback provided by the ambient noise indicator 630X is particularly useful for individuals with some hearing loss who are unable to accurately measure the loudness of their environment themselves. The visual feedback provided by the ambient noise indicator 630X is also particularly useful because earplug 620 (e.g., optionally) actively suppresses ambient noise (e.g., via ANC and / or by physically blocking the user's ear canal), thus limiting the user's ability to measure the loudness of the environment in other ways. When the ambient noise level detected by the microphone of earbud 620 exceeds a noise threshold, computer system 600 determines that the environment is too noisy to perform a hearing test while the user is wearing earbud 620. Figure 6U1 As shown. In Figure 6U1 At this location, the ambient noise indicator 630X is displayed with a first characteristic (e.g., with a first color (e.g., yellow and / or red) and / or with a first emphasis) to indicate that the environment is too noisy, and the height of the bars (e.g., the height of the highest bar and / or the average height of the bars) optionally corresponds to the current ambient noise level. In some embodiments, option 632A is displayed, allowing the user to (via activation of option 632A, e.g., tapping the input or tapping and holding the input 650S)) recheck the ambient noise level. In some embodiments, when the user changes their environment, the computer system 600 continuously and / or repeatedly updates the ambient noise indicator 630X based on the currently detected ambient noise (and optionally, option 632A is not displayed).

[0202] Figures 6U2 to 6U4An additional example is shown of an ambient noise indicator 630X displayed as part of a user interface 630 during preparation for a hearing test. In some implementations, the computer system 600 responds to the detection of... Figure 6Q The activation of the start option 630V at the location (e.g., tapping the input and / or tapping and holding the input 650R) (e.g., when the computer system 600 determines that the earphone 620 fits correctly and therefore does not display) Figure 6S When the user interface is accessed and / or in response to Figure 6S The option 630Z is displayed for further review (e.g., after the user has adjusted the ear tips 620 for a proper fit). Figures 6U2 to 6U4 User interface 630. In Figures 6U2 to 6U4 At this location, the 630X ambient noise indicator provides visual feedback (e.g., real-time or near real-time) on the current ambient noise level. Figures 6U2 to 6U4 As shown, the ambient noise indicator 630X visually changes as (e.g., in conjunction with) changes in the current ambient noise. Figure 6U2 The ambient noise indicator 630X includes multiple vertical bars, including bars 630X1-630X3. In some embodiments, the shape of the bars (e.g., width and / or height) changes based on changes in the current ambient noise. In some embodiments, the corresponding bars of the ambient noise indicator 630X correspond to corresponding frequency ranges of ambient noise, and the corresponding bars visually change (e.g., shape, color, and / or height) when the ambient noise in the corresponding frequency range changes. For example, bar 630X1 corresponds to a frequency range centered at 20 Hz, bar 630X2 corresponds to a frequency range centered at 32 Hz, bar 630X3 corresponds to a frequency range centered at 64 Hz, and other bars correspond to frequency ranges centered at 125 Hz, 250 Hz, 500 Hz, 1 kHz, 2 kHz, etc. For example, the height of bar 630X1 changes with the ambient noise level at (or near) 20Hz (e.g., bar 630X1 becomes taller as noise increases, and / or bar 630X1 becomes shorter as noise decreases), such as Figures 6U2 to 6U4 As can be seen. For example, the height of bar 630X2 changes with the ambient noise level at (or near) 32Hz (e.g., bar 630X2 becomes taller as noise increases, and / or bar 630X2 becomes shorter as noise decreases). In Figures 6U2 to 6U4In the process, the ambient noise indicator 630X is displayed with a first characteristic (e.g., with a first color (e.g., yellow and / or red) and / or a first emphasis level) to indicate that the ambient noise level is higher than a noise threshold and therefore too noisy to begin the hearing test. When the ambient noise level detected by the microphone of the earpiece 620 is higher than the noise threshold, the computer system 600 optionally continues to display the message 630AA indicating that the ambient noise level is higher than the noise threshold. In some embodiments, when the ambient noise level detected by the microphone of the earpiece 620 is higher than the noise threshold, the computer system 600 grays out and / or disables the next step option 630Y, such as... Figures 6U2 to 6U4 As shown, this indicates that the process cannot continue until the ambient noise level drops below the noise threshold.

[0203] In some implementations, computer system 600 determines whether the ambient noise level is above or below a noise threshold based on whether the average ambient audio level across various frequencies is above or below a threshold level. In some implementations, computer system 600 determines whether the ambient noise level is above or below a noise threshold based on whether the highest ambient audio level across various frequencies is above or below a threshold level.

[0204] exist Figures 6V1 to 6V2 In this configuration, the ambient noise indicator 630X is displayed with a second characteristic (e.g., a second color (e.g., green and / or blue) and / or a second emphasis) that differs from the first characteristic (e.g., a first color and / or a first emphasis) to indicate that the ambient noise level is below a noise threshold and therefore the environment is quiet enough for the process to continue. Figures 6V1 to 6V2 As shown, the ambient noise indicator 630X visually changes as (e.g., in conjunction with) the current ambient noise level. The height of the bars in the ambient noise indicator 630X (e.g., the height of the highest bar and / or the average height of the bars) optionally corresponds to the current ambient noise level and changes as the current ambient noise level changes. Figures 6V1 to 6V2 As shown, computer system 600 also optionally displays a message 630AB indicating that the ambient noise level is acceptable and / or below a noise threshold. In some embodiments, when computer system 600 displays message 630AB indicating that the ambient noise level is below a noise threshold, the computer system detects that the ambient noise level has increased to above the noise threshold (e.g., and remained above the noise threshold for a threshold duration), and in response, computer system 600 switches back to a level relative to the noise threshold. Figures 6U2 to 6U4 The illustrated user interface includes displaying an ambient noise indicator 630X with a first characteristic (e.g., with a first color (e.g., red and / or yellow) and / or with a first emphasis). Figure 6V2When the ambient noise level is below a noise threshold, the computer system 600 detects input pointing to the next option 632A (e.g., tapping the input and / or tapping and holding the input 650T), and in response, updates the user interface 630, such as... Figure 6W As shown.

[0205] exist Figure 6W At this point, computer system 600 provides the user with instructions 632B for providing input for a hearing test. In some embodiments, the computer system designates a specific area (e.g., a portion of the touch-sensitive surface and / or a portion of an area in 3D space) for user activation to indicate that the user has heard a tone during the hearing test. In some embodiments, the user can provide input anywhere on the entire touch-sensitive surface (e.g., 602) to indicate that the user has heard a tone during the hearing test. Figure 6W At this point, computer system 600 detects input pointing to the next option 632C (e.g., tapping input and / or tapping and holding input 650U) and updates user interface 630, such as... Figure 6X As shown.

[0206] exist Figure 6X At this point, computer system 600 displays a progress indicator 636, which indicates the progress of completing the hearing test (e.g., the progress of completing the test for one ear and / or both ears). Figure 6X At the same time, earpiece 620A also outputs audio 634A indicating that the hearing test is about to begin (e.g., computer-generated speech and / or recorded speech) and / or instructions for performing the hearing test (e.g., audio 634A output by computer system 600 via earpiece 620). Audio 634A provides instructions to the user when the user is not looking at display 602 and / or the user has closed their eyes to focus on listening to the tone of the hearing test. The computer system automatically continues to user interface 630, as... Figure 6Y As shown.

[0207] During a hearing test (e.g., as Figures 6Y to 6Z and Figures 6AC to 6AD As shown, computer system 600 outputs different tones at different frequencies / pitches and volumes, pausing after each tone to check if computer system 600 has detected user input indicating that the user has heard that tone (e.g., tapping input 650V). As the hearing test continues, computer system 600 updates progress indicator 636 to display the progress of the hearing test. For example, in Figure 6Y At that point, the earbud 620A outputs tone 634B at the first frequency / tone, and... Figure 6Z At this point, the computer system 600 detects and instructs the user to hear tone 634B and tap input 650V.

[0208] In some implementations, ambient noise (e.g., noise in the user's room) increases during the hearing test. When the ambient noise level detected by the microphone of earpiece 620 exceeds a noise threshold, computer system 600 determines that the environment is too noisy to continue the hearing test and suspends (or terminates) the hearing test. Figures 6AA1 to 6AA4 As shown. As described in more detail above, the ambient noise indicator 630X changes (e.g., in height, shape, and / or color) in conjunction with the ambient audio detected by the earpiece 620, thereby providing the user with real-time or near-real-time visual feedback on the ambient noise level. This indicator suggests or encourages the user to change their environment (e.g., move to a different room, turn off the television or other devices, and / or close doors) and observe (in real-time or near-real-time) how this change affects the ambient noise level detected by the earpiece 620. Figures 6AA1 to 6AA4 As shown, the ambient noise indicator 630X visually changes as (e.g., in conjunction with) the current ambient noise level. The ambient noise indicator 630X includes multiple vertical bars, including bars 630X1-630X3, as shown relative to... Figures 6U2 to 6U4 Described in more detail. In some embodiments, the shape of the bars (e.g., width and / or height) changes based on changes in the current ambient noise. In some embodiments, the corresponding bars of the ambient noise indication 630X correspond to a corresponding frequency range of ambient noise, and the corresponding bars visually change (e.g., shape, color, and / or height) as the ambient noise in the corresponding frequency range changes. For example, bar 630X1 corresponds to a frequency range centered at 20 Hz, bar 630X2 corresponds to a frequency range centered at 32 Hz, bar 630X3 corresponds to a frequency range centered at 64 Hz, and other bars correspond to frequency ranges centered at 125 Hz, 250 Hz, 500 Hz, 1 kHz, 2 kHz, etc. For example, the height of bar 630X1 changes with the ambient noise level at (or near) 20 Hz (e.g., bar 630X1 becomes taller as the noise increases, and / or bar 630X1 becomes shorter as the noise decreases), such as... Figures 6AA1 to 6AA4 As can be seen. For example, the height of bar 630X2 changes with the ambient noise level at (or near) 32Hz (e.g., bar 630X2 becomes taller as noise increases, and / or bar 630X2 becomes shorter as noise decreases). In Figures 6AA1 to 6AA2 In the 630X, the ambient noise indicator uses a first characteristic (e.g., a first color (e.g., yellow and / or red) and / or a first emphasis level) to indicate that the ambient noise level is above a noise threshold and is therefore too noisy to continue the hearing test. Figures 6AA1 to 6AA2 In the middle, the Continue option 632E is optionally disabled (e.g. Figures 6AA1 to 6AA2The ambient noise level (indicated by grayscale) indicates that the hearing test cannot continue until the ambient noise level drops below a noise threshold. The visual feedback provided by the Ambient Noise Indicator 630X is particularly useful for individuals with some hearing loss who are unable to accurately measure the loudness of their environment on their own. The visual feedback provided by the Ambient Noise Indicator 630X is also particularly useful because the earplugs 620 (optionally, for example) actively suppress ambient noise (e.g., via ANC and / or by physically blocking the user's ears), thus limiting the user's ability to measure the loudness of their environment in other ways. Figure 6AA1 In this configuration, the computer system 600 may optionally (e.g., in response to detecting that the ambient noise level exceeds a noise threshold) output audio (e.g., speech) indicating excessive ambient noise via earpiece 620. Figures 6AA1 to 6AA4 As shown, the ambient noise indicator 630X changes in conjunction with changes in ambient noise (e.g., in height, shape, and / or color). Figure 6AA3 At a certain point, the ambient noise drops below a noise threshold (e.g., within a zero or non-zero threshold time period), and in response, the ambient noise indicator 630X changes its characteristics (e.g., from a first characteristic to a second characteristic) to indicate that the hearing test can continue. Figures 6AA3 to 6AA4 When the ambient noise level does not exceed a noise threshold, the computer system 600 continues to update the shape (e.g., width and / or height) and / or color of the bar based on changes in the current ambient noise. Figures 6AA3 to 6AA4 In some implementations, when the ambient noise level does not exceed a noise threshold, the continue option 632E is enabled and can be activated by the user to continue the hearing test. In some implementations, when the computer system 600 displays a message 630AB indicating that the ambient noise level is below a noise threshold, the computer system detects that the ambient noise level has increased to above the noise threshold (e.g., and remained above the noise threshold for the duration indicated by the threshold), and in response, the computer system 600 switches back to the relative noise level. Figures 6AA1 to 6AA2 The illustrated user interface includes displaying an ambient noise indicator 630X with a first characteristic (e.g., with a first color (e.g., red and / or yellow) and / or with a first emphasis level). Figure 6AA4 At this point, computer system 600 detects input. In response to detecting the input and determining that the input (e.g., tapping the input and / or tapping and holding the input 650W) points to the continue option 632E, computer system 600 continues the hearing test, as follows. Figure 6AC As shown. In response to detecting the input and determining that the input (e.g., tapping the input and / or tapping and holding the input 650W2) points to the end option 632E, the computer system 600 ends the listening test (e.g., without continuing the listening test).

[0209] In some implementations, one or both earplugs 620 are removed from the user's ear during a hearing test. In response to detecting the removal of one or both earplugs 620 from the user's ear, the computer system 600 suspends the hearing test, such as... Figure 6AB As shown. In some implementations, the computer system 600 terminates the hearing test and can restart the test from the beginning. In some implementations, such as Figure 6AB As shown, computer system 600 detects input pointing to the continue option 632F (e.g., tapping the input and / or tapping and holding the input 650X), and in response, continues the listening test, as... Figure 6AC As shown.

[0210] As the listening test continues, the computer system 600 updates the progress indicator 636 to display the progress of completing the listening test. For example, in Figure 6AC At that point, the earbud 620A outputs tone 634C at a second frequency / tone different from the first frequency / tone, and... Figure 6AD At this point, computer system 600 detects a tap input 650Y instructing the user to hear tone 634C. In some implementations, earpiece 620A outputs many (e.g., 5, 10, 15, or 20) tones, and computer system 600 monitors to detect user input instructing the user to hear each tone. Figure 6AE At this point, the user's left ear hearing test has been completed. The computer system 600 outputs audio 634D (e.g., computer-generated speech and / or recorded speech) indicating the completion of the left ear test via earpiece 620. Audio 634D is particularly useful when the user has closed their eyes and is still focused on listening to the tone of the hearing test. Subsequently, the computer system 600 performs the corresponding test on the user's other ear using earpiece 620B. Figure 6AG At the point (after outputting numerous tones and monitoring corresponding user input), the computer system 600 outputs audio 634E (e.g., speech) indicating the completion of the test to the right ear via earpiece 620, and continues to the user interface 630, such as... Figure 6AH As shown.

[0211] exist Figure 6AH At this point, computer system 600 outputs audio 634F (e.g., voice) indicating the completion of the test via earpiece 620. Figure 6AH At this point, computer system 600 detects input pointing to result option 632G (e.g., tapping input and / or tapping and holding input 650Z), and in response, displays the results of the hearing test, such as Figure 6AI and Figure 6AJ As shown. Figure 6AI and Figure 6AJ Two exemplary test results, 660, are shown. Figure 6AIAt this point, computer system 600 indicates the amount of hearing loss in the left 660A ear and the right 660B ear, provides options for viewing detailed results, and offers a primary option 660D to not set the earpiece 620 as a hearing aid (e.g., based on the user having only mild hearing loss). Figure 6AI At this point, computer system 600 detects input. In response to the input (e.g., 652A) pointing to option 660D, computer system 600 continues the process of pairing earpiece 620 with computer system 600 without configuring earpiece 620 as a hearing aid using the results of a hearing test. In response to the input (e.g., 652B) pointing to a secondary option 660E, computer system 600 continues the process of pairing earpiece 620 with computer system 600, including configuring earpiece 620 as a hearing aid using the results of a hearing test, and continues to user interface 630, such as... Figure 6AK As shown. In Figure 6AJ At this point, computer system 600 indicates that the user has moderate hearing loss in both ears, and therefore provides a primary option 660E to (e.g., in response to input 652B) configure earplug 620 to operate as a hearing aid using the results of a hearing test, and continues to display user interface 630, as... Figure 6AK As shown.

[0212] exist Figures 6AK to 6AL At that location, computer system 600 continued to... Figure 6AM The user interface 630 previously provided additional information to the user. Figure 6AM At this point, computer system 600 instructs that earplug 620 has been configured to operate as a hearing aid using the results of a hearing test, and provides option 632J for activating the hearing aid operation. In some embodiments, computer system 600 provides earplug 620 with audiographic data (e.g., individual audiographic data for each ear), which earplug 620 can use to modify audio to suit the user's hearing loss. Figure 6AM In response to the detection of input 652E (e.g., tap input and / or tap and hold input), computer system 600 sends data to earpiece 620 to activate hearing aid features using the results of a hearing test, and continues to display user interface 630, as... Figure 6AN As shown. In Figure 6AN At this point, computer system 600 indicates that the pairing process and hearing test are complete, and the hearing aid features of earplug 620 have been activated.

[0213] exist Figure 6AOAt this location, earbud 620 uses one or more microphones of earbud 620 to detect ambient audio 642A (e.g., people speaking in the same room as the user), and outputs a modified version 640A of the ambient audio 642A via one or more speakers of earbud 620. The modified version 640A of the audio is based on the results of a hearing test (e.g., based on audiogram data generated using the results of a hearing test and sent to earbud 620 by computer system 600). In some embodiments, earbud 620 modifies (e.g., using audiogram data) the audio independently of computer system 600 (e.g., even when computer system 600 is off or unavailable), such as... Figure 6AO As shown. For example, earbud 620 stores and uses audiogram data to modify detected audio, and then outputs the modified audio without relying on computer system 600. In some implementations, earbud 620 uses a first set of audio characteristics based on hearing test results to modify ambient audio.

[0214] exist Figure 6AP At this point, computer system 600 is participating in a call (e.g., an audio call via a telephone application), as shown in user interface 662A. Computer system 600 sends audio received as part of the call (e.g., via Bluetooth and / or Short Range Protocol) to earpiece 620 for output via one or more speakers of earpiece 620. Earpiece 620 receives the audio. For example, earpiece 620 stores and uses audiogram data to modify the received audio, and then outputs the modified audio 640B via one or more speakers of earpiece 620. In some embodiments, earpiece 620 uses a second set of audio characteristics (different from the first set of audio characteristics) based on test results to modify the audio received via Bluetooth and / or Short Range Protocol (e.g., based on audio identified as a call (e.g., an audio call and / or video call)). In some embodiments, computer system 600 uses the second set of audio characteristics to modify the audio before sending the audio to earpiece 620.

[0215] exist Figure 6AQAt this location, computer system 600 is playing media (e.g., music played via a music player application), as shown in user interface 662B. Computer system 600 (e.g., via Bluetooth and / or Short Range Communication Protocol) sends the audio of the media to earbud 620 for output via one or more speakers of earbud 620. Earbud 620 receives the audio. For example, earbud 620 stores and uses audiogram data to modify the received audio, and then outputs the modified audio 640C via one or more speakers of earbud 620. In some embodiments, earbud 620 uses a third set of audio characteristics (different from the first and second sets of audio characteristics) based on test results to modify the audio received via Bluetooth and / or Short Range Communication Protocol (e.g., audio identified as media application (e.g., music player and / or video player)). In some embodiments, computer system 600 uses the third set of audio characteristics to modify the audio before sending the audio to earbud 620.

[0216] Figure 6AR An example of a settings user interface 670 for modifying the settings of earbud 620 is shown. Option 670A enables and disables the ability to change the volume of earbud 620 using the volume buttons of computer system 600. Activation of hearing aid option 670B (e.g., via input 652G) causes computer system 600 to display hearing aid user interface 672, as... Figure 6AS As shown. Activating test result option 670C (e.g., via input 652H) causes computer system 600 to display the hearing test results, as shown. Figure 6BC exemplified.

[0217] exist Figure 6AS At this point, computer system 600 displays a hearing aid user interface 672, which includes option 672A to enable and disable (e.g., via input 652I) hearing aid options (e.g., to enable / disable earplug 620 from modifying audio using hearing test results (e.g., for ambient audio, for calls, and for media playback)). Option 672E, when activated (e.g., via input 652M), initiates another hearing test (e.g., as...). Figures 6M to 6AH (In the middle), thus allowing the user to retake (or perform) the hearing test as needed. When activated (e.g., via input 652J), the ambient audio option 672B causes the display of the ambient audio adjustment user interface 674, such as... Figure 6AT As shown. When the media audio option 672C is activated (e.g., via input 652K), it causes the media audio adjustment user interface 676 to be displayed, as shown. Figure 6AV As shown. When the audio option 672D is activated (e.g., via input 652L), it causes the media audio adjustment user interface 678 to be displayed, as shown. Figure 6AXAs shown. Option 672F enables / disables volume control via swipe input, as relative to... Figures 6BE to 6BF As described. Option 672G enables / disables charging reminders, as relative to... Figure 6BH As described.

[0218] exist Figure 6AT At this point, computer system 600 displays an ambient audio adjustment user interface 674, which includes option 674G to enable and disable (e.g., via tap and / or swipe input) hearing aid options for ambient audio (e.g., audio detected via one or more microphones of earpiece 620) (e.g., to enable / disable earpiece 620 from modifying audio using hearing test results) (e.g., without enabling / disabling hearing aid options for calling and for media playback). Adjustments 674A-674C enable the user to adjust the characteristics (in the first set of audio characteristics) of the audio used to modify ambient audio (e.g., characteristics that do not affect those used for calling and for media playback). For example, computer system 600 detects a swipe input 652N directed at amplification adjustment 674A and, in response, modifies the amplification of the ambient audio (e.g., increasing amplification based on the magnitude and direction of the input). For example, computer system 600 detects a swivel input 652O pointing to pitch adjustment 674B and, in response, modifies the pitch of the ambient audio (e.g., raising the pitch based on the magnitude and direction of the input). Similarly, computer system 600 detects a swivel input 652P pointing to balance adjustment 674C and, in response, modifies the balance of the ambient audio (e.g., shifting it left based on the magnitude and direction of the input). In some embodiments, when computer system 600 detects a requested change (e.g., 652N-652P) for modifying the characteristics of the ambient audio, computer system 600 sends data (e.g., updated audiogram data) to earpiece 620 based on the requested change, enabling earpiece 620 to modify the ambient audio (in light of the requested change). Figure 6AU The example shows the result of inputting 652N-652P. For example... Figure 6AU As shown, the computer system 600 displays an indication (e.g., 674D-674F) of the last position (and therefore value) of each adjustment (e.g., 674A-674C), allowing the user to easily and accurately recover the adjustment changes.

[0219] Similarly, in Figure 6AVAt this point, computer system 600 displays a media audio adjustment user interface 676, which includes option 676G to enable and disable (e.g., via tap and / or swipe input) hearing aid options for media audio (e.g., audio output by a media application of computer system 600 and sent to earpiece 620) (e.g., to enable / disable earpiece 620 from modifying audio using hearing test results) (e.g., without enabling / disabling hearing aid options for calls and for ambient audio). Adjustments 676A-676C allow the user to adjust the characteristics of the audio used to modify the media audio (e.g., without affecting the characteristics used for calls and for ambient audio). For example, computer system 600 detects a swipe input 652Q directed at amplification adjustment 676A and, in response, modifies the amplification of the media audio (e.g., reducing amplification based on the magnitude and direction of the input). For example, computer system 600 detects a swivel input 652R pointing to pitch adjustment 676B and, in response, modifies the pitch of the media audio (e.g., raising the pitch based on the magnitude and direction of the input). Similarly, computer system 600 detects a swivel input 652S pointing to balance adjustment 676C and, in response, modifies the balance of the media audio (e.g., shifting it to the right based on the magnitude and direction of the input). In some embodiments, when computer system 600 detects a requested change (e.g., 652Q-652S) for modifying the characteristics of the media audio, computer system 600 sends data (e.g., updated audiogram data) to earpiece 620 based on the requested change, enabling earpiece 620 to modify the media audio (in light of the requested change). Figure 6AW The example shows the result of inputting 652Q-652S. For example... Figure 6AW As shown, the computer system 600 displays an indication (e.g., 676D-676F) of the last position (and therefore value) of each adjustment (e.g., 676A-676C), allowing the user to easily and accurately recover the adjustment changes.

[0220] Similarly, in Figure 6AXAt this point, computer system 600 displays a call audio adjustment user interface 678, which includes option 678G to enable and disable (e.g., via tap and / or swipe input) hearing aid options for call audio (e.g., audio output by computer system 600's audio call or video call application and sent to earpiece 620) (e.g., to enable / disable earpiece 620 from modifying audio using hearing test results) (e.g., without enabling / disabling hearing aid options for media playback and ambient audio). Adjustments 678A-678C allow the user to adjust the characteristics of the audio used to modify the call audio (e.g., without affecting the characteristics used for media playback and ambient audio). For example, computer system 600 detects a swipe input 652T directed at amplification adjustment 678A and, in response, modifies the amplification of the call audio (e.g., increasing amplification based on the magnitude and direction of the input). For example, computer system 600 detects a swivel input 652U pointing to tone adjustment 678B and, in response, modifies the pitch of the call audio (e.g., lowers the pitch based on the magnitude and direction of the input). Similarly, computer system 600 detects a swivel input 652V pointing to balance adjustment 678C and, in response, modifies the balance of the call audio (e.g., shifts it to the left based on the magnitude and direction of the input). In some embodiments, when computer system 600 detects a requested change (e.g., 652T-652V) for modifying the characteristics of the call audio, computer system 600 sends data (e.g., updated audiogram data) to earpiece 620 based on the requested change, such that earpiece 620 can modify the call audio (in light of the requested change). Figure 6AY The example shows the result of inputting 652T-652V. For example... Figure 6AY As shown, the computer system 600 displays an indication (e.g., 678D-678F) of the last position (and therefore value) of each adjustment (e.g., 678A-678C), allowing the user to easily and accurately recover the adjustment changes.

[0221] In some implementations, hearing loss compensation (HLC) is a hearing loss compensation algorithm. Users can fine-tune the settings (e.g., ...). Figure 6AT to Figure 6AY(As shown) HLC gain can be adjusted within a limited range. These fine-tuning settings include amplification (e.g., 674A, 676A, and / or 678A), tone (e.g., 674B, 676B, and / or 678B), and balance (e.g., 674C, 676C, and / or 678C) sliders. The user can adjust the amplification slider (e.g., 674A, 676A, and / or 678A) to add gain in the range of -6dB to +6dB. When the slider moves to the right, the balance slider (e.g., 674C, 676C, and / or 678C) simultaneously adds up to 3dB of amplification to the right earpiece and up to -3dB of amplification to the left earpiece (and vice versa). This results in a maximum inter-ear level difference of 6dB. The tone slider (e.g., 674B, 676B, and / or 678B) is adjusted equally and in opposite directions above and below 1500Hz. Pushing the tone slider to the right (e.g., 674B, 676B, and / or 678B) increases gain above 1500Hz and decreases gain by an equal amount below 1500Hz (and vice versa), with a maximum change of 4.5dB. HLC gain provides a maximum of approximately 25dB and a minimum of 0dB.

[0222] Figures 6AZ to 6BB Examples are shown in Figure 6AT to Figure 6AY The audio has been adjusted and modified for use with earphones 620. Figure 6AZ At this point, the earbud 620 uses a first set of adjusted audio characteristics (e.g., based on...). Figure 6AT The user adjusts the ambient audio (received from computer system 600) to modify the ambient audio. Earplug 620 uses one or more microphones of earplug 620 to detect ambient audio 642B (e.g., people speaking in the same room as the user) and outputs a modified version 640D of the ambient audio 642B via one or more speakers of earplug 620. The modified version 640B of the audio is based on the results of a hearing test. In some implementations, earplug 620 modifies the audio independently of computer system 600 (e.g., even when computer system 600 is off or unavailable), such as... Figure 6AZ As shown. For example, earbud 620 stores and uses audiogram data to modify the detected audio 642B, and then outputs the modified audio 640D, without relying on computer system 600. In some embodiments, earbud 620 uses a first set of adjusted audio characteristics based on test results to modify ambient audio 642B. Similarly, in Figure 6BA At this point, the earbud 620 uses a modified second set of audio characteristics (e.g., based on...). Figure 6AX The user adjusts the call audio (received from computer system 600) to modify the call audio 640E. Similarly, in Figure 6BB At this point, the earbud 620 uses a modified third set of audio characteristics (e.g., based on...). Figure 6AWThe user adjusts the media audio 640F (e.g., for media audio received from the video application 662C) to modify the media audio 640F.

[0223] Figure 6BC An exemplary hearing test result 664 is illustrated, including audiogram data 664A for the left ear and audiogram data 664B for the right ear, as well as details 664C based on a specific frequency of the input 652W. Figure 6BD An exemplary settings user interface 668 is illustrated, which includes options 668A for enabling / disabling noise cancellation and enabling / disabling audio transparency, option 668B for performing (or re-performing) a hearing test, option 668C for turning on / off and modifying various types of hearing enhancement, option 668D for turning on / off hearing protection (e.g., reducing loud ambient noise), and option 668E for turning on / off dialogue enhancement (e.g., making ambient speech louder when it is directed at the user). In some embodiments, computer system 600 detects input directed to option 668B (e.g., tapping input and / or tapping and holding input 652X) and initiates a hearing test (e.g., as...). Figures 6W to 6AH (As shown). In some embodiments, earbud 620 may operate as a hearing aid while continuing to provide one or more (or all) of the following features: audio transparency (e.g., detecting ambient audio and outputting audio via the speaker of earbud 620), ANC (active noise cancellation), adaptive audio (e.g., including conversation awareness, conversation enhancement, and personalized volume), loudness reduction (e.g., using a transparency mode), and optionally, additional features of earbud 620 (e.g., audio and non-audio).

[0224] Figures 6BE to 6BF Features enabling earbud 620 to modify the volume of various types of audio are illustrated. Earbud 620 detects a swipe input, such as a swipe along a lever of earbud 620A (e.g., swipe 652Y). In response to detecting the swipe input and determining that earbud 620 is currently outputting non-ambient audio (e.g., call audio, media audio, and / or audio other than ambient audio) (e.g., with or without ambient audio), earbud 620 adjusts the volume of the non-ambient audio it is currently outputting (based on the direction and / or magnitude of the swipe input) without adjusting the volume of any ambient audio. In response to detecting the swipe input and determining that earbud 620 is currently outputting ambient audio but not non-ambient audio, earbud 620 adjusts the volume of the ambient audio it is currently outputting (based on the direction / magnitude of the swipe input) without modifying the volume of any non-ambient audio. For example, in Figure 6BEAt this point, input 652Y to adjust the ambient audio volume, because when input 652Y is detected, the earphone 620A only outputs 640G ambient audio 642C. Figure 6BF The increased volume is shown in the figure (e.g., for 642D it is output as 640H).

[0225] Figure 6BG An example is shown of the main screen 606 of the computer system 600 when the earpiece 620 is connected and configured to operate as a hearing aid. The main screen 606 includes a widget 606C that includes a visual indication 606D of the volume settings for the earpiece 620 and an option 606E that, when activated, causes the computer system 600 to display a settings user interface for modifying the magnification of the earpiece 620 (e.g., ...). Figures 6AR to 6AY Any one or more user interfaces shown in the diagram.

[0226] Figure 6BH An example is illustrated where earbud 620 automatically outputs audio 640I (e.g., computer-generated speech and / or recorded speech) including battery power information via one or more speakers of earbud 620. In some embodiments, in response to reaching (e.g., dropping to or below) a threshold battery power value (e.g., 50%, 25%, and / or 5% battery power remaining), earbud 620 outputs audio including power information (e.g., the amount of remaining power (e.g., percentage and / or time (e.g., in minutes and / or hours)) based on a determination that earbud 620 is operating as a hearing aid, and earbud 620 abandons the output of audio including power information based on a determination that earbud 620 is not operating as a hearing aid. Therefore, additional information about the battery power level of earbud 620 during its use is provided to the user using earbud 620 as a hearing aid.

[0227] Figure 7 This is a flowchart illustrating a method for prompting a user to initiate a hearing test in some embodiments. Method 700 is performed at a computer system (e.g., 100, 300, 500, and / or 600) (e.g., smartphones, smartwatches, tablets, laptops, desktop computers, wearable devices, wrist-worn devices, and / or head-mounted devices) that communicates with one or more input devices (e.g., touch-sensitive surfaces, touch-sensitive displays 602, buttons, rotatable input mechanisms, pressable and rotatable input mechanisms, cameras, and / or accelerometers) (and optionally, with display generating components (e.g., displays, touch-sensitive displays, and / or display controllers)). Some operations in method 700 are optionally combined, some operations are optionally changed in order, and some operations are optionally omitted.

[0228] As described below, Method 700 provides an intuitive way to initiate a hearing test. This method reduces the cognitive burden on users initiating a hearing test, thereby creating a more efficient human-computer interface. For battery-powered computing devices, it enables users to initiate hearing tests faster and more efficiently, saving power and reducing time between battery charging sessions.

[0229] When not paired with a first audio device (e.g., headphones, headsets, case for headphones and / or headsets), a request (e.g., 650A and / or 650B) to pair the first audio device (e.g., 610 and / or 620) with a computer system (e.g., 600) is detected (702) via one or more input devices (e.g., 602).

[0230] In response to the detection of a request to pair the first audio device with the computer system (e.g., 650A and / or 650B), a process of pairing the first audio device (e.g., 610 and / or 620) with the computer system (e.g., 600) is initiated (704).

[0231] The process of pairing a first audio device (e.g., 610 and / or 620) with a computer system (e.g., 600) includes pairing the first audio device (e.g., 610 and / or 620) with the computer system (e.g., 600) (706) (e.g., pairing via Bluetooth, by registering information about the first audio device with the computer system and registering information about the computer system with the first audio device, and / or by configuring the computer system and the first audio device to automatically connect using a wireless protocol); in some embodiments, (e.g., when the first audio device is paired with the computer system and / or before pairing the first audio device with the computer system), the computer system determines whether the first audio device is a first type of audio device or a second type of audio device.

[0232] The process of pairing a first audio device (e.g., 610 and / or 620) with a computer system (e.g., 600) includes, based on determining that the first audio device is a first type of audio device (e.g., 620) (e.g., an audio device suitable for hearing tests and / or in-ear headphones with active noise cancellation (also known as active noise control), providing (708) (e.g., displayed via a display generation component) an option (e.g., 608) for performing hearing tests (e.g., audiometry tests, pure-tone audiometry tests, and / or word recognition tests) using the first audio device (e.g., 620) (and optionally, using the computer system).

[0233] The process of pairing a first audio device (e.g., 610 and / or 620) with a computer system (e.g., 600) includes, based on determining that the first audio device is a second type of audio device (e.g., 610) different from a first type of audio device (e.g., 620) (e.g., an audio device suitable for hearing tests and / or in-ear headphones with active noise cancellation (also known as active noise control), abandoning (710) providing options for performing a hearing test using the first audio device (e.g., 608B). Displaying options for performing a hearing test when the first audio device is a suitable audio device provides feedback to the user regarding the availability of a hearing test. Providing options for performing a hearing test during the initial pairing process of the first audio device allows the computer system to provide a hearing test at an early opportunity (e.g., before the user uses the first audio device in another way). In some implementations, in response to detecting a request to pair the first audio device with the computer system, the computer system initiates a process of pairing the first audio device with the computer system, wherein the process includes: pairing the first audio device with the computer system and providing options for performing hearing tests (e.g., audiometry tests, pure tone audiometry tests, and / or word recognition tests) using the first audio device (e.g., without determining whether the first audio device is a first type of audio device or a second type of audio device, and / or displaying options for performing hearing tests without relying on such determination).

[0234] According to some embodiments, the process of pairing a first audio device (e.g., 620) with a computer system (e.g., 600) includes, based on determining that the first audio device is a first type of audio device (e.g., 620) (e.g., an audio device suitable for hearing tests and / or in-ear headphones with active noise cancellation (also known as active noise control), providing (e.g., displayed via a display generation component) an option (e.g., 608C) for not performing a hearing test. In some embodiments, the computer system (e.g., when providing an option to perform a hearing test using the first audio device (e.g., an audiometry test, a pure-tone audiometry test, and / or a word recognition test)) selects user input via one or more input devices (e.g., 650C and / or 650D) (e.g., selection of an option to perform a hearing test or an option to not perform a hearing test). In response to the detection of user input for option selection (e.g., 650C and / or 650D): if the user input for option selection (e.g., 650D) points to an option for performing a hearing test (e.g., 608B), the process of performing the hearing test continues; and if the user input for option selection (e.g., 650C) points to an option for not performing a hearing test (e.g., 608C), the process of performing the hearing test is abandoned (and optionally, the process of pairing the first audio device with the computer system continues, such as by displaying information indicating that the first audio device has been paired with the computer system). Continuing the process of performing the hearing test based on user input allows the computer system to adapt to the user's preferences, such as by not spending time performing the hearing test when the user already knows that they do not need a hearing aid, thereby reducing the amount of time required to complete the pairing process and reducing the power consumption of the computer system during the pairing process, which is particularly useful for battery-powered computer systems.

[0235] According to some embodiments, the computer system generates audiogram data (e.g., for displaying audiograms 664A-664B) based on the execution of a hearing test (e.g., information indicating a user's hearing at multiple frequencies (such as for one or both ears of the user). In some embodiments, audiogram data is used to generate the audiogram. In some embodiments, the hearing test generates the audiogram. In some embodiments, hearing information is used to generate the audiogram. In some embodiments, during the hearing test, the computer system determines a first audible threshold at a first frequency and a second audible threshold at a second frequency (different from the first audible threshold). In some embodiments, the hearing test generates a first set of audio characteristics including a first hearing level (e.g., a first audio hearing level at a first audio frequency (e.g., in dB)) and a second hearing level (e.g., a second audio hearing level at a second audio frequency (different from the first audio frequency (e.g., in dB)). In some implementations, the hearing test generates (e.g., in addition to the first set of audio characteristics) a second set of audio characteristics, which includes a third hearing level (e.g., a third audio hearing level for the first audio frequency (e.g., in dB)) and a fourth hearing level (e.g., a fourth audio hearing level for the second audio frequency (different from the first audio frequency (different from the third hearing level (e.g., in dB))) (e.g., where the second set of audio characteristics differs from the first set of audio characteristics). The hearing test generates audiogram data, enabling the computer to use the audiogram data to display an audiogram to the user, thereby allowing the user to see the results of the hearing test, and / or to use the audiogram data to adjust / configure hearing aids (such as a first audio device), thereby improving the computer system's ability to output audio tailored to the user's hearing needs.

[0236] In some implementations, a hearing test is performed using the first audio device (e.g., 620) after it has been paired with a computer system (e.g., 600). In some implementations, the computer system pairs the first audio device with itself before providing options for performing a hearing test using the first audio device (e.g., an audiometry test, a pure-tone audiometry test, and / or a word recognition test). Pairing the first audio device with the computer system before performing the hearing test (e.g., before presenting options for performing the hearing test) enables the computer system to establish a communication channel (e.g., Bluetooth and / or WiFi) with the first audio device and use that same communication channel for the hearing test, thus eliminating the need for a temporary communication channel for the hearing test and improving the efficiency of the computer system.

[0237] In some implementations, the computer system (e.g., 600) is configured to communicate with one or more display generation components (e.g., 602). After performing a process of pairing a first audio device (e.g., 620) with the computer system (e.g., 600) (e.g., in the case of performing or not performing a hearing test) (e.g., when the first audio device is paired with the computer system), the computer system (e.g., 600) (e.g., in response to detecting a user request) displays a settings user interface (e.g., ...) via one or more display generation components (e.g., ... Figure 6AS 672 in Figure 6AT to Figure 6AY 674-678 and / or Figure 6BD (668 in the example), the settings user interface includes options (e.g., 672E, 620) for performing hearing tests using a first audio device (e.g., 620). Figure 6AT to Figure 6AY The computer system detects input (e.g., 652M and / or 652X) via one or more input devices, pointing to an option for performing a hearing test using a first audio device (e.g., 620). In response to detecting input pointing to an option for performing a hearing test using the first audio device, the computer system (e.g., 600) continues the process of performing the hearing test (e.g., as in "Update Hearing Test" and / or 668B). Figures 6M to 6AH (As shown). After the pairing process, a settings user interface is displayed with options for performing a hearing test using the first audio device (e.g., the same test provided during the pairing process), allowing the user to perform (and / or re-perform) the hearing test at a later time without unpairing and re-pairing the first audio device, thus improving the human-computer interface.

[0238] In some implementations, the first audio device (e.g., 620) (e.g., headphones and / or headsets) includes one or more speakers (e.g., integrated into the first audio device) and one or more microphones (e.g., integrated into the first audio device). Prior to performing a hearing test, a computer system (e.g., 600) initiates an evaluation of the audio input and audio output of the first audio device using one or more speakers and one or more microphones (e.g., as...). Figures 6G to 6L The process (e.g., checking to confirm that the speakers and microphones of the first audio device are functioning correctly). After performing the audio input and audio output evaluation of the first audio device (e.g., in response to performing the audio input and audio output evaluation of the first audio device): based on determining that the volume of the audio output by the first audio device through the audio input and audio output evaluation (e.g., the volume of the audio output by one or more speakers and detected by one or more microphones is within the threshold volume range, within the threshold pitch range, and / or exceeds the threshold quality), continues (e.g.) Figure 6MThe process of performing a hearing test using a first audio device; and the process of abandoning the performance of the hearing test if it is determined that the first audio device has failed the audio input and audio output evaluation (and optionally, displaying a notification about the first audio device failing the audio input and audio output evaluation (e.g., as shown)). Figure 6L (As shown). Performing an evaluation of the audio input and output of the first audio device and continuing when the first audio device passes the evaluation helps ensure that the hearing test is performed using properly calibrated hardware that produces valid hearing test results. This improves the functionality of the computer system and avoids performing hearing tests that produce invalid results, thereby saving power and preventing invalid results from being used on hearing aids.

[0239] In some implementations, the first audio device (e.g., 620) (e.g., headphones and / or headsets) includes one or more microphones (e.g., integrated into the first audio device). During a hearing test, a computer system (e.g., 600) detects the level of ambient noise (e.g., noise in the user's room) via one or more microphones of the first audio device (e.g., 620). In response to detecting an ambient noise level: based on determining that the ambient noise level is greater than a threshold level (e.g., greater than a certain dB), the hearing test is interrupted (e.g., paused and / or ended). Figures 6AA1 to 6AA3 The system allows users to interrupt hearing tests when ambient noise levels exceed a threshold level (e.g., less than a certain dB), and to abandon interrupted hearing tests (e.g., continue hearing tests) if the ambient noise level is determined to be less than a threshold level. Interrupting hearing tests when ambient noise exceeds a threshold level (e.g., by pausing or ending the test) allows the computer system to give users time / opportunity to reduce ambient noise (e.g., by moving to a different room and / or turning off noise sources (e.g., television or radio)), thus ensuring that the hearing test produces valid results (without invalid results), thereby improving the testing process and human-computer interface.

[0240] In response to detecting an ambient noise level and determining that the ambient noise level is greater than a threshold level (e.g., greater than a certain dB), an option is provided (e.g., displayed via one or more display generation components) for (e.g., after the ambient noise level drops below the threshold level) to continue the hearing test (e.g., 632E). In some embodiments, in response to detecting an ambient noise level and determining that the ambient noise level is greater than the threshold level, the computer system (e.g., via a display and / or via audio output (such as by using a first audio device)) instructs the user to move to a quiet location. In some embodiments, the computer system detects activation of the option to continue the hearing test, and in response, the computer system continues the hearing test. Providing the user with the option to continue the hearing test enables the user to reduce ambient noise and then complete the hearing test (e.g., by continuing and / or restarting the hearing test where it was interrupted), and reduces the need for the user to search in the settings to restart the hearing test, thereby reducing the amount of input required to continue the hearing test.

[0241] In some implementations, the first audio device (e.g., headphones and / or headsets) includes one or more speakers (e.g., integrated into the first audio device) and one or more microphones (e.g., integrated into the first audio device). After a hearing test is completed, a computer system (e.g., 600) outputs first audio (e.g., 640B-640C) via one or more speakers of the first audio device (e.g., 620) using a volume setting based on (e.g., equal to) a volume selected by the user. By using the audio output from the hearing test results to use the first audio device as a hearing aid, the computer system allows the user to mitigate hearing loss, thereby allowing the user to hear sound better. Using the audio output from the hearing test results provides the user with audio feedback regarding the results of the hearing test (allowing the user to hear whether the sound is better / clearer).

[0242] In some implementations, the first audio device (e.g., 620) (e.g., headphones and / or headsets) includes one or more speakers (e.g., integrated into the first audio device). During the hearing test, the computer system (e.g., 600) detects volume change user input (e.g., volume buttons (e.g., up and / or down) and / or input on a displayed object) via one or more input devices. During the hearing test, in response to detecting the volume change user input, the computer system (e.g., 600) changes the volume setting (e.g., system volume setting, headphone volume setting, audio playback volume setting) from a first value to a second value different from the first value based on the volume change user input. During the hearing test, when the volume setting is at the second value, audio is output via one or more speakers that is not based on the second value of the volume setting. The volume of the audio output during the hearing test (e.g., audio used to determine whether the user can hear certain sounds at certain volumes) is not modified when the user changes the system volume setting, allowing the computer system to control the volume of the audio for the hearing test to produce valid hearing test results.

[0243] In some implementations, the computer system (e.g., 600) (e.g., during a hearing test) changes the volume setting (e.g., system volume setting, headphone volume setting, audio playback volume setting) from a user-selected volume to a system-selected volume (e.g., a predefined volume, an ambient noise-based volume, and / or a volume based on the type (e.g., brand and / or model) of a first audio device). During the hearing test (e.g., throughout the entire hearing test), the computer system (e.g., 600) maintains the volume setting at the system-selected volume. In some implementations, the computer system detects user input that the volume has changed, and in response to detecting such user input: if it is determined that the hearing test is not in progress (e.g., has not yet started, is paused, and / or has ended), the computer system changes the volume setting based on the user input that the volume has changed; and if it is determined that the hearing test is in progress, the computer system abandons changing the volume setting based on the user input that the volume has changed. The volume of the audio output during the hearing test (e.g., audio used to determine whether a user can hear certain sounds at certain volumes) is not modified when the user changes the system volume settings, allowing the computer system to control the volume of the audio for the hearing test to produce valid hearing test results.

[0244] In some implementations, the first audio device (e.g., 620) (e.g., headphones and / or headsets) includes one or more speakers (e.g., integrated into the first audio device). During a hearing test, a computer system (e.g., 600) outputs audio (e.g., 634B) (e.g., a first test tone) with a first volume independent of the system volume setting, and audio (e.g., 634C) (e.g., a second test tone) with a second volume different from the first volume, independent of the system volume setting. Outputting audio with a volume independent of the computer system's volume setting (e.g., the test tone) allows the computer system to control the volume of the audio used for the hearing test to produce valid hearing test results.

[0245] In some embodiments, a first audio device (e.g., 620) (e.g., headphones and / or headsets) includes one or more speakers (e.g., integrated into the first audio device) and one or more microphones (e.g., integrated into the first audio device). A computer system (e.g., 600) performs a hearing test by outputting test audio (e.g., 634B-634C) via one or more speakers of the first audio device (e.g., 620) to generate a set of audio characteristics using audiogram data (e.g., information indicating a user's hearing at multiple frequencies, such as for one or both ears of the user). In some embodiments, audiogram data is used to generate an audiogram. In some embodiments, the hearing test generates an audiogram. The computer system (e.g., 600) receives audio via one or more microphones of the first audio device. The computer system (e.g., 600) outputs modified audio of the received audio via one or more speakers of the first audio device, wherein the modified audio has been adjusted based on the set of audio characteristics. In some implementations, the computer system (e.g., 600) sends the set of audio characteristics to a first audio device (e.g., 620), and the first audio device detects the audio via one or more microphones, modifies the audio using the set of audio characteristics, and outputs the modified audio via one or more speakers. Using the first audio device to perform a hearing test and using the first audio device as a hearing aid configured / tuned based on the results of the hearing test allows the computer system to provide audio feedback to the user using the results of the hearing test, allowing the user to understand whether the hearing test was successful and whether the user's ability to hear sounds has improved.

[0246] In some embodiments, a first audio device (e.g., 620) (e.g., headphones and / or headsets) includes one or more speakers (e.g., integrated into the first audio device). During a hearing test (e.g., as part of a hearing test), a computer system (e.g., 600) outputs a first audio (e.g., a first tone at a first frequency and a first volume) via one or more speakers of the first audio device (e.g., 620). During the hearing test (e.g., as part of a hearing test) and after outputting the first audio (e.g., 634B and / or 634C), the computer system (e.g., 600) monitors user input (e.g., 650V and / or 650Y) instructing the user of the computer system (e.g., 600) to hear the first audio (e.g., tap input on a touch-sensitive surface of the computer system, activation of a physical button on the computer system, and / or activation of an object displayed by the computer system). In some embodiments, the computer system subsequently outputs a second audio by changing the tone and / or volume and monitors second user input instructing the user to hear the second audio. In some implementations, the computer system identifies that the user has heard the first audio when it detects user input within a threshold duration following the output of the first audio, and identifies that the user has not heard the first audio when it does not detect user input within the threshold duration following the output of the first audio. Outputting audio and monitoring user confirmation of hearing it enables the computer system to measure the user's ability to hear different sounds (e.g., at different frequencies and / or at different volumes) and uses this information to generate audiogram data and / or an audiogram.

[0247] It should be noted that the above text regarding method 700 (for example, Figure 7 The details of the process described herein also apply in a similar manner to the methods described below. For example, method 700 optionally includes one or more characteristics of the various methods described with reference to methods 800, 1000, and / or 1200. For example, the computer system of method 700 (e.g., 600) is the same as or similar to the remote computer system of method 800 and / or the computer systems of 1000 and / or 1200. As another example, the audio device of method 700 (e.g., 620) is the same as or similar to the audio device of methods 800, 1000, and 1200 (e.g., 620A). For the sake of brevity, these details will not be repeated below.

[0248] Figure 8This is a flowchart illustrating methods for modifying the audio characteristics of different types of audio in some embodiments. Method 800 is performed at a computer system (e.g., 100, 300, 500, 620, and / or 600) including a first audio device (e.g., headphones and / or headsets) having one or more speakers (e.g., integrated into a first audio device) (and optionally, one or more microphones (e.g., integrated into the first audio device)). In some embodiments, the computer system also communicates with display generation components (e.g., a display, a touch-sensitive display, and / or a display controller).

[0249] A computer system (e.g., 620) accesses (802) a first set of audio characteristics (e.g., generated using audiogram data (e.g., information indicating a user's hearing at multiple frequencies, such as for one or both ears of the user)), which is based on a hearing test (e.g., performed using the computer system and / or imported into the computer system) (e.g., as in...). Figures 6F to 6AH (e.g., the results of a hearing test). In some implementations, the first set of audio characteristics includes a first hearing level (e.g., a first audio hearing level for a first audio frequency (e.g., in dB)) and a second hearing level (e.g., a second audio hearing level for a second audio frequency (different from the first audio frequency (e.g., in dB)).

[0250] A computer system (e.g., 620) accesses (804) a second set of audio characteristics (e.g., generated using audiogram data (e.g., information indicating a user's hearing at multiple frequencies, such as for one or both ears of the user)), which differs from the first set of audio characteristics and is based on a hearing test (e.g., performed using a computer system and / or imported into the computer system) (e.g., as in...). Figures 6F to 6AH (e.g., the results of a hearing test). In some implementations, the second set of audio characteristics includes a third hearing level (e.g., a third audio hearing level for the first audio frequency (e.g., in dB)) and a fourth hearing level (e.g., a fourth audio hearing level for the second audio frequency (different from the first audio frequency (different from the third hearing level (e.g., in dB))).

[0251] The computer system (e.g., 620) (e.g., after accessing the first set of audio characteristics and the second set of audio characteristics) receives (806) (e.g., by detecting via one or more microphones of the first audio device (e.g., when the first audio device is worn by a user of the computer system) and / or by receiving from a first application (e.g., a media player application, such as a music player) running on a remote device (e.g., remote computer system 600)) the first audio (e.g., audio of someone (other than the user of the computer system) speaking, audio of a conversation, and / or audio of a television broadcast).

[0252] In response to receiving the first audio at (808) and determining that the first audio is audio of a first type (e.g., speech and ambient audio detected via a microphone of the first audio device), a first modified audio (e.g., 640A and / or 640D) of the first audio, which has been modified based on a first set of audio characteristics (and optionally, not yet modified based on a second set of audio characteristics and not yet modified based on a third set of audio characteristics), is output (810) via one or more speakers of the first audio device. In some embodiments, a remote computer system (e.g., 600) modifies the first audio to produce the first modified audio. In some embodiments, the first audio device (e.g., 620 and / or 620A) modifies the first audio to produce the first modified audio.

[0253] In response to (808) receiving the first audio and determining that the first audio is a second type of audio (e.g., audio generated by an application running on a remote device (e.g., a telephone) and / or computer system (e.g., a media application, such as a music player application and / or a video player application)) different from the first type of audio, (812) outputting a second modified audio (e.g., 640C and / or 640F) of the first audio that has been modified based on a second set of audio characteristics (and optionally, not modified based on a first set of audio characteristics and not modified based on a third set of audio characteristics). In some embodiments, the remote computer system (e.g., 600) modifies the first audio to produce the second modified audio. In some embodiments, the first audio device (e.g., 620 and / or 620A) modifies the first audio to produce the second modified audio. The second modified audio is different from the first modified audio. Modifying audio using different groups (e.g., first and second) of characteristics based on the type (e.g., source) of the audio allows the computer system to modify different types of audio in different ways, thereby enabling users to hear various types of audio better and / or improving the quality of each type of audio based on the type of audio, thus providing an improved human-computer interface.

[0254] In some implementations, the computer system (e.g., 620) accesses a third set of audio characteristics (e.g., generated using audiogram data (e.g., information indicating a user's hearing at multiple frequencies, such as for one or both ears)), which differs from the first and second sets of audio characteristics and is based on a hearing test (e.g., performed using the computer system and / or imported into the computer system) (e.g., the results of the hearing test). In some implementations, the third set of audio characteristics includes a fifth hearing level (e.g., a fifth audio hearing level for a first audio frequency (e.g., in dB)) and a sixth hearing level (e.g., a sixth audio hearing level for a second audio frequency (different from the first audio frequency, different from the fifth hearing level (e.g., in dB)). In response to receiving a first audio signal and determining that the first audio signal is a third type of audio (e.g., audio generated by an audio communication application (e.g., a telephone application, video conferencing application, and / or voice communication application) running on a computer system), a computer system (e.g., 620) outputs a third modified audio signal (e.g., 640B and / or 640E) via one or more speakers of the first audio device. This third modified audio signal has been modified based on a third set of audio characteristics (and optionally, has not been adjusted based on a first set of audio characteristics and has not been adjusted based on a second set of audio characteristics). In some embodiments, a remote computer system (e.g., 600) modifies the first audio signal to produce the third modified audio signal. In some embodiments, the first audio device (e.g., 620 and / or 620A) modifies the first audio signal to produce the third modified audio signal. The third modified audio signal is different from the first modified audio signal and the second modified audio signal. Modifying audio using different groups of characteristics (e.g., first, second, and third) based on the type of audio (e.g., source) enables computer systems to modify different types of audio in different ways, thereby allowing users to better hear various types of audio and / or improve the quality of each type of audio based on the type of audio, thus providing an improved human-computer interface.

[0255] In some implementations, a computer system (e.g., 620 and / or 620A) (or a remote computer system 600) detects (e.g., received from a remote device (e.g., 600) such as a mobile phone) inputs that modify the corresponding type of audio (e.g., based on touch input and / or non-touch input at the remote device) (e.g., based on input received from the remote computer system 600 on 674G, 676G and / or 678G). In response to the detection of input for disabling modification of the corresponding type of audio: Based on the determination that the corresponding type is a first type of audio, the computer system (e.g., 620 and / or 620A) disables the modification of the received first type of audio using a first set of audio characteristics (e.g., 640D), and continues to modify the received second type of audio using a second set of audio characteristics (e.g., 640F); and based on the determination that the corresponding type is a second type of audio, the computer system (e.g., 620 and / or 620A) disables the modification of the received second type of audio using a second set of audio characteristics (e.g., 640F), and continues to modify the received first type of audio using the first set of audio characteristics (e.g., 640D). In some embodiments, the user can prevent the computer system from automatically modifying the first type of audio and / or the second type of audio. Providing the user with options to disable (and / or enable) the automatic modification of the first type and / or second type of audio allows the user to choose when / whether the type of audio should be modified based on the results of a hearing test, thereby improving the user's ability to hear audio and improving the human-computer interface.

[0256] In some implementations, a first set of audio characteristics identifies a first amplification value for a first plurality of frequencies (e.g., a value for one frequency, another value for another frequency, and yet another value for an additional frequency), and a second set of audio characteristics identifies a second amplification value for a second plurality of frequencies (e.g., the same as or different from the first amplification value) (e.g., a value for one frequency, another value for another frequency, and yet another value for an additional frequency). The first and second sets of audio characteristics each identify amplification values ​​for various frequencies, allowing the computer system to modify different types of data using different characteristics (using different sound profiles), thereby improving the quality of audio output for the user.

[0257] In some embodiments, the first amplification value for the first plurality of frequencies includes an amplification value corresponding to a first ear (e.g., the user's right ear) (e.g., for 620B) and an amplification value corresponding to a second ear different from the first ear (e.g., the user's left ear) (e.g., for 620A). Therefore, in some embodiments, each set of audio characteristics includes different amplification data for the user's different ears. In some embodiments, the second amplification value for the second plurality of frequencies includes an amplification value corresponding to a first ear (e.g., the user's right ear) and an amplification value corresponding to a second ear (e.g., the user's left ear). Including different amplification values ​​for different ears allows the computer system to adapt to different types of hearing impairment in the user's different ears, thereby improving the user's hearing.

[0258] In some implementations, the first set of audio characteristics includes a first tone profile (e.g., via...). Figure 6AT to Figure 6AU (modified at 674B), and the second set of audio characteristics includes a second tone profile that is different from the first tone profile (e.g., via...). Figures 6AV to 6AW (Modified from 676B). Includes different tone profiles for different groups of audio characteristics, enabling computer systems to modify different types of audio (e.g., from different sources) using different tone profiles, thereby improving the user's hearing.

[0259] In some implementations, the first tone profile includes tone information for a first ear (e.g., the user's right ear) and tone information for a second ear (e.g., the user's left ear), which is different from the first ear. Therefore, in some implementations, each set of audio characteristics includes tone information for the user's different ears. In some implementations, the second tone profile includes tone information for the first ear (e.g., the user's right ear) and tone information for the second ear (e.g., the user's left ear). Including different tone information for different ears allows the computer system to adapt to different types of hearing impairment in the user's different ears, thereby improving the user's hearing.

[0260] In some implementations, the first set of audio characteristics includes first audio balance (e.g., left-right balance) information (e.g., via...). Figure 6AT to Figure 6AU (modified at 674C), and the second set of audio characteristics includes second audio balance (e.g., left-right balance) information that differs from the first audio balance information (e.g., via...). Figures 6AV to 6AW (Modified from 676C). In some implementations, different groups of audio characteristics include different audio balances between the user's right and left ears. Including balance information in the audio characteristic groups allows the computer system to adapt to different balance settings for different types of audio, thereby improving the user's ability to hear those types of audio.

[0261] In some embodiments, a computer system (e.g., 620 and / or 620A) detects (e.g., received from a remote device (e.g., 600), such as a mobile phone) input involving adjustment (e.g., modification or alteration) of a first set of characteristics (e.g., receiving data from a remote computer system 600 based on inputs 652N-652P). In response to detecting input involving adjustment of the first set of characteristics, the computer system (e.g., 620 and / or 620A) adjusts the first set of characteristics (e.g., changing the volume, tone, or balance of the first set of characteristics). After adjusting the first set of characteristics, the computer system (e.g., 620 and / or 620A) outputs audio modified using the adjusted first set of characteristics (e.g., 640D) via one or more speakers of a first audio device. In some embodiments, the computer system enables a user to independently adjust both the first and second sets of characteristics. In some embodiments, the input determines how a set of characteristics should be adjusted (e.g., the degree to which volume, tone, or balance should be adjusted). This allows users to modify the first set of features and / or the second set of features, enabling them to manually change the computer system's modifications to the audio, thus allowing users to fine-tune the audio according to their preferences and hearing improvements.

[0262] In some implementations, the first audio is audio received using one or more microphones of a first audio device (e.g., ...). Figure 6AO and Figure 6AZ (In the context of audio). Based on a first set of audio characteristics, the audio received by the microphone of a first audio device is modified so that the computer system can receive the audio and provide the user with a live (e.g., real-time or near-real-time) modified version of the audio that sounds better to the user.

[0263] In some implementations, the first audio is audio received from an application (e.g., a media application, a music player, a telephone application, and / or an audio communication application) running on a remote device (e.g., computer system 600). Figures 6AP to 6AQ and Figures 6BA to 6BB (In the middle). Based on the first set of audio characteristics, the audio received from the application is modified so that the computer system can provide the user with a live (e.g., real-time or near real-time) modified version of the audio that sounds better to the user.

[0264] It should be noted that the above is relative to method 800 (e.g., Figure 8The details of the processes described also apply in a similar manner to the methods described above and below. For example, method 800 optionally includes one or more characteristics of the various methods described with reference to methods 700, 1000, and 1200. For example, the computer system of method 700 (e.g., 600) is the same as or similar to the remote computer system of method 800 and / or the computer system of method 1000. As another example, the audio device of method 700 (e.g., 620) is the same as or similar to the audio device of method 800 and / or method 1000 (e.g., 620A). As another example, the hearing test in different processes is the same hearing test. For the sake of brevity, these details will not be repeated below.

[0265] Figures 9A to 9D Example user interfaces for displaying visual indications of current ambient noise levels are illustrated according to some implementation schemes. These user interfaces are used to illustrate the processes described below, including... Figure 10 The process in.

[0266] Figures 9A to 9D Examples of ambient noise indicators and corresponding user interfaces are illustrated, shown as ambient noise indicator 632X as part of user interface 630. In these examples, ambient noise indicator 632X is displayed during a hearing test (e.g., in the middle of the hearing test and / or after the start of the hearing test and before the end of the hearing test), but ambient noise indicator 632X may also be displayed before the start of the hearing test (e.g., as relative to...). Figures 6U1 to 6U4 (As described). In some implementations, the computer system 600 displays a message in response to detecting that the ambient noise level is higher than a threshold level. Figure 9A User interface 630. In Figures 9A to 9D At this location, the 632X ambient noise indicator provides visual feedback (e.g., real-time or near real-time) on the current ambient noise level. Figures 9A to 9D As shown, the ambient noise indicator 632X visually changes as (e.g., in conjunction with) changes in the current ambient noise level. In some embodiments, the shape and / or size of the ambient noise indicator 632X changes based on the current ambient noise level. In some embodiments, the size of the ambient noise indicator 632X is based on the current ambient noise level. In some embodiments, based on determining that the ambient noise level is above a threshold level, the computer system 600 displays the ambient noise indicator 632X with a first characteristic (e.g., with a first color (e.g., red and / or yellow) and / or a first emphasis level), such as... Figures 9A to 9B As shown. In some embodiments, based on the determination that the ambient noise level is below a threshold level, the computer system 600 displays an ambient noise indication 632X with a second characteristic different from the first characteristic (e.g., with a second color (e.g., green and / or blue) and / or a second emphasis level), such as... Figures 9C to 9D As shown.

[0267] like Figures 9A to 9B As shown, computer system 600 updates the display of ambient noise indicator 632X based on the current ambient noise level, and the continue option 632E is optionally disabled (e.g., Figures 9A to 9B (The gray level is indicated by a gray indicator) to indicate that the hearing test cannot continue until the ambient noise level drops below the noise threshold. Figure 9B At the point where a message 630AA indicating that the ambient noise level is above a noise threshold is displayed, the computer system 600 detects that the ambient noise level has dropped below the threshold level (e.g., within the threshold duration), and in response, displays... Figure 9C The user interface. Figure 9C In addition to updating the size and / or shape of the ambient noise indicator 632X, the computer system 600 also updates the ambient noise indicator 632X to use the second feature. Figure 9C In response to detecting that the ambient noise level is below a threshold level, the computer system 600 displays a message 630AB indicating that the ambient noise level is acceptable and / or below the noise threshold, and the continue option 632E is enabled and can be activated by the user to continue the hearing test.

[0268] exist Figure 9D At this point, computer system 600 detects input. In response to detecting the input and determining that the input (e.g., tapping the input and / or tapping and holding the input 650W3) points to the continue option 632E, computer system 600 continues the hearing test, as (e.g.) Figure 6AC As shown. In response to detecting the input and determining that the input (e.g., tapping the input and / or tapping and holding the input 650W4) points to the end option 632E2, the computer system 600 ends the listening test (e.g., without continuing the listening test).

[0269] Figure 10 This is a flowchart illustrating a method for displaying a visual indication of the current ambient noise level according to some embodiments. Method 1000 is performed at a computer system (e.g., 100, 300, 500, and / or 600) (e.g., smartphone, smartwatch, tablet, laptop, desktop computer, wearable device, wrist-worn device, and / or head-mounted device) communicating with a display generating component (e.g., 602) and one or more audio devices (e.g., 620) (e.g., headphones, headsets, and / or microphones and / or audio analyzers for computer systems and / or remote devices). Some operations in method 1000 may be combined, the order of some operations may be changed, and some operations may be omitted.

[0270] As described below, Method 1000 provides an intuitive way to display visual indications of the current ambient noise level. This method reduces the cognitive burden on users to determine the current ambient noise level, thereby creating a more efficient human-computer interface. For battery-powered computing devices, it enables users to access ambient noise levels faster and more efficiently, saving power and increasing the time between battery charging sessions.

[0271] During the process of performing a hearing test (e.g., using a computer system) (1002), the computer system (e.g., 600) displays (1004) a visual indication of the current ambient noise level (e.g., ...) via a display generation component (e.g., 602). Figures 6U1 to 6U4 , Figures 6AA1 to 6AA4 630X and / or Figures 9A to 9D (632X), where the visual indication changes visually as (e.g., in conjunction with) the current ambient noise level.

[0272] During the process of performing a hearing test (e.g., using a computer system) (1002), a visual indication (e.g., loudness) of the current level of ambient noise (e.g., noise in the physical environment where the user and / or computer system is located) is displayed (1004). Figures 6U1 to 6U4 , Figures 6AA1 to 6AA4 630X and / or Figures 9A to 9D When the computer system (e.g., 600) detects (1006) a change in the current ambient noise level via one or more audio devices (e.g., 620), the computer system receives information (e.g., audio information, loudness information, and / or audio) about the current ambient noise (e.g., including and / or indicating the level of the current ambient noise) via one or more audio devices, and updates the visual indication based on that information.

[0273] During the process of performing a hearing test (1002) (e.g., using a computer system), in response to detecting a change in the current ambient noise level, the computer system (e.g., 600) updates (1009) the visual indication of the current ambient noise level (e.g., ...) via a display generation component (e.g., 602). Figures 6U1 to 6U4 , Figures 6AA1 to 6AA4 630X and / or Figures 9A to 9D The display at 632X (e.g., visually changing its size, shape, position, and / or color) corresponds to the current ambient noise level (e.g., as shown in the image). Figures 6U1 to 6U4 , Figures 6AA1 to 6AA4 and Figures 9A to 9D(As shown). The visual indication changes based on the loudness of the user's physical environment, providing visual feedback on the amount of noise detected and informing the user whether the loudness of the physical environment will negatively affect the user's ability to correctly participate in the hearing test, thus providing improved visual feedback. The visual indication may also optionally prompt the user to take action, such as moving to a quieter environment or reducing the noise in the current environment.

[0274] In some implementations, the visual indication of the current ambient noise level is updated (e.g., Figures 6U1 to 6U4 , Figures 6AA1 to 6AA4 630X and / or Figures 9A to 9D The display at 632X includes the shape of a visual indicator that changes the current ambient noise level (e.g., over time and / or in conjunction with changes in ambient noise) (e.g., as shown in Figure 632X). Figures 6U1 to 6U4 , Figures 6AA1 to 6AA4 and Figures 9A to 9D (As shown). The display shows a visual indication that changes shape based on the loudness of the user's physical environment, providing visual feedback to the user on the amount of noise detected, and informing the user whether the loudness of the physical environment will negatively affect the user's ability to participate correctly in the hearing test, thus providing improved visual feedback.

[0275] In some implementations, a visual indication of the current ambient noise level (e.g., Figures 6U1 to 6U4 and / or Figures 6AA1 to 6AA4 The 630X section includes multiple bars arranged in parallel (e.g., bars 630X1 to 630X3) (e.g., 5 bars, 15 bars, 17 bars, or 20 bars) (e.g., vertical bars placed adjacent to each other). The display includes visual indications of multiple bars that change based on the loudness of the user's physical environment, providing visual feedback to the user on the amount of noise detected and informing the user whether the loudness of the physical environment will negatively affect the user's ability to correctly participate in the hearing test, thus providing improved visual feedback.

[0276] In some implementations, the visual indication of the current ambient noise level is updated (e.g., Figures 6U1 to 6U4 and / or Figures 6AA1 to 6AA4The display at location 630X includes changing the height of one or more (e.g., one, two, five, or all) of a plurality of bars (e.g., bars 630X1-630X3) based on changes in the current ambient noise level. In some embodiments, a first bar of the plurality of bars corresponds to a first frequency or a first frequency range of the ambient noise, and a second bar of the plurality of bars corresponds to a second frequency or a second frequency range of the ambient noise (different from the first frequency or second frequency range). In some embodiments, the height of the respective bar corresponds to the audio volume in the environment at the corresponding frequency or frequency range. Changing the height of the different bars of the visual indication provides the user with visual feedback on the loudness of different frequencies, thereby allowing the user to more easily identify sounds and sound sources in the user's environment and providing improved visual feedback.

[0277] In some implementations, the visual indication of the current ambient noise level is updated (e.g., Figures 6U1 to 6U4 and / or Figures 6AA1 to 6AA4 The display at 630X includes visual indicators that change the current ambient noise level (e.g., Figures 6U1 to 6U4 and / or Figures 6AA1 to 6AA4 The height of the bar (e.g., at 630X) is adjusted (e.g., changing over time and / or in conjunction with changes in ambient noise). In some embodiments, as the ambient volume increases (e.g., for a specific frequency or frequency range), the height of one of the bars (e.g., corresponding to that specific frequency or frequency range) increases. In some embodiments, as the ambient volume decreases (e.g., for a specific frequency or frequency range), the height of one of the bars (e.g., corresponding to that specific frequency or frequency range) decreases. In some embodiments, the height of the corresponding bar indicates the volume level of ambient noise at the corresponding frequency or frequency range. Displaying a visual indication of the height changing based on the loudness of the user's physical environment provides visual feedback to the user on the amount of noise detected and informs the user whether the loudness of the physical environment will negatively affect the user's ability to correctly participate in the hearing test, thus providing improved visual feedback.

[0278] In some implementations, the visual indication of the current ambient noise level is updated (e.g., Figures 6U1 to 6U4 and / or Figures 6AA1 to 6AA4 The display at 630X includes features that visually indicate changes in the current ambient noise level (e.g., over time and / or in conjunction with changes in ambient noise) (e.g., from...). Figure 6U4 The first color at the location changes to Figure 6V1 The second color at the location; from Figure 6AA2 The first color at the location changes to Figure 6AA3 The second color at the location; and / or from Figure 9B The first color at the location changes to Figure 9C(The second color at the location). It displays visual indicators that change characteristics based on the loudness of the user's physical environment, provides visual feedback to the user on the amount of noise detected, and informs the user whether the loudness of the physical environment will negatively affect the user's ability to participate correctly in the hearing test, thus providing improved visual feedback.

[0279] In some implementations, visual indicators of changing the current ambient noise level (e.g., Figures 6U1 to 6U4 and / or Figures 6AA1 to 6AA4 The features of 630X include: based on determining that the current ambient noise level is higher than a threshold noise level (e.g., a change in the noise level causes the noise level to rise above the threshold noise level), displaying a visual indication of the current ambient noise level in a first color (e.g., yellow or red) via a display generation component (e.g., 602) Figures 6U1 to 6U4 , Figures 6AA1 to 6AA2 and / or Figures 9A to 9B (in the middle); and based on determining that the current ambient noise level is below a threshold noise level (e.g., a change in the noise level causes the noise level to drop below the threshold noise level), a visual indication of the current ambient noise level is displayed via a display generation component (e.g., 602) in a second color (e.g., green or blue) different from the first color (e.g., as shown in the middle); and based on determining that the current ambient noise level is below a threshold noise level (e.g., a change in the noise level causes the noise level to drop below the threshold noise level), a visual indication of the current ambient noise level is displayed via a display generation component (e.g., 602) in a second color different from the first color (e.g., green or blue). Figures 6V1 to 6V2 , Figures 6AA3 to 6AA4 and / or Figures 9C to 9D (In the context of the test). By displaying visual indicators with a first or second color based on the loudness of the user's physical environment, the test provides visual feedback to the user on the amount of noise detected and informs the user whether the loudness of the physical environment will negatively affect the user's ability to correctly participate in the hearing test, thus providing improved visual feedback.

[0280] In some implementations, in response to a change in the current ambient noise level detected via one or more audio devices that causes the current ambient noise level to exceed a threshold noise level, a visual indication of the current ambient noise level is displayed (e.g., which visually changes as the current ambient noise level changes) (e.g., such as...). Figure 6AA1 and / or Figure 9A (In the middle). When the ambient noise level exceeds a threshold noise level, a visual indication of the current ambient noise level is displayed, providing the user with visual feedback that the threshold noise level has been exceeded, thus providing improved visual feedback.

[0281] In some implementations, visual indicators of the current ambient noise level are not displayed (e.g., in...). Figure 6Z When a computer system (e.g., 600) detects a change in the current ambient noise level via one or more audio devices (e.g., 620), the computer system (e.g., 600) detects a change in the current ambient noise level (e.g., in the context of...). Figure 6ZIn response to detecting a change in the current ambient noise level: based on determining that the current ambient noise level exceeds (e.g., for a duration of zero or non-zero threshold) a threshold noise level, the computer system (e.g., 600) displays a visual indication of the current ambient noise level (e.g., ) via a display generation component (e.g., 602). Figure 6AA1 At 630X (and optionally, interrupt the ongoing hearing test); and based on determining that the current ambient noise level does not exceed (e.g., within a zero or non-zero threshold duration) a threshold noise level, the computer system (e.g., 600) abandons displaying a visual indication of the current ambient noise level (and optionally, abandons interrupting the ongoing hearing test) (e.g., as...). Figure 6AC (In the middle). When the ambient noise level exceeds a threshold noise level, a visual indication of the current ambient noise level is displayed, providing the user with visual feedback that the threshold noise level has been exceeded, thus providing improved visual feedback.

[0282] In some implementations, a visual indication of the current ambient noise level (e.g., 630X and / or 632X) is displayed during the hearing test (e.g., which visually changes as the current ambient noise level changes) (e.g., by stopping or pausing the hearing test and displaying the visual indication and / or by displaying the visual indication while the hearing test continues) (e.g., as... Figures 6AA1 to 6AA4 and / or Figures 9A to 9C (In Chinese). It displays a visual indication of the current ambient noise level during hearing tests, providing users with improved visual feedback on ambient noise when monitoring it is important.

[0283] In some implementations, a visual indication of the current ambient noise level (e.g., 630X and / or 632X) is displayed based on (e.g., in response to) determining that the current ambient noise level exceeds (e.g., for a duration of zero or non-zero threshold noise) a threshold noise level (e.g., which visually changes as the current ambient noise level changes). Figure 6AA1 and / or Figure 9AIn some implementations, during a hearing test: based on (and optionally, in response to) determining that the current ambient noise level exceeds (e.g., for a duration of zero or non-zero threshold noise), the computer system (e.g., 600) interrupts (e.g., pauses and / or terminates) the hearing test; and based on (and optionally, in response to) determining that the current ambient noise level does not exceed (e.g., for a duration of zero or non-zero threshold noise), the computer system (e.g., 600) abandons the interruption (e.g., pauses and / or terminates) of the hearing test. Automatically interrupting the hearing test when ambient noise exceeds the threshold noise level prevents users from performing the hearing test under unwanted noise conditions (which could produce invalid test results) and gives users the opportunity to correct noise conditions without affecting test results (e.g., users do not miss the test tones they would otherwise hear), thereby improving the human-computer interface and reducing the amount of user input required to interrupt the hearing test when necessary.

[0284] In some implementations, when the hearing test is interrupted (e.g., paused or stopped), the computer system (e.g., 600) detects a change in the current ambient noise level via one or more audio devices (e.g., 620). In response to detecting the change in the current ambient noise level: based on determining that the current ambient noise level does not exceed (e.g., within a zero or non-zero threshold duration) a threshold noise level, options for continuing (e.g., continuing and / or restarting) the hearing test are displayed via a display generation component (e.g., 602) (e.g., concurrently with a visual indication of the current ambient noise level). These options include displaying new user interface elements and / or updating existing user interface elements to indicate that the user interface elements are now selectable. Figures 6AA3 to 6AA4 and / or Figures 9C to 9D (632E at the location); and based on determining that the current ambient noise level exceeds (e.g., for a duration of zero or non-zero threshold noise level) a threshold noise level, the computer system abandons (or optionally, stops displaying) the option to continue the hearing test (e.g., in 632E). Figures 6AA1 to 6AA2 and / or Figures 9A to 9B (At this point, 632E turns gray). In some implementations, the computer system detects activation of the option to continue the hearing test and, in response, continues the hearing test (e.g., ending the pause of the hearing test and / or continuing the hearing test according to the progress level based on the amount of progress made before the hearing test was interrupted). Providing the user with the option to continue the hearing test when the ambient noise no longer exceeds the threshold noise level, and providing the user with visual feedback that the loudness of the detected ambient noise has decreased and the test can continue, thus providing improved visual feedback.

[0285] In some implementations, when the hearing test is interrupted (e.g., paused or stopped), the computer system (e.g., 600) (e.g., when the current ambient noise level exceeds a threshold noise level or independently of the current ambient noise level) displays options for ending the hearing test via a display generation component (e.g., 602). Figures 6AA1 to 6AA4 and / or Figures 9A to 9D (Refer to 632E2). In some implementations, the computer system detects the activation of an option to end the hearing test and, in response, ends the hearing test (e.g., the computer system no longer provides an option to continue the same hearing test and / or perform the hearing test, and should begin a new hearing test). Providing the user with an option to end the hearing test (e.g., when ambient noise exceeds a threshold noise level) provides the user with quick and easy access to end the test under adverse environmental conditions without requiring the user to provide multiple inputs or navigate complex menus, thereby reducing the amount of input required to end the hearing test.

[0286] In some implementations, when the hearing test is interrupted (e.g., paused or stopped) and based on (e.g., in response to) determining that the interruption of the hearing test exceeds a threshold duration (e.g., 30 seconds, 3 minutes, 10 minutes, or 15 minutes) (e.g., the user cannot reach a quiet space and / or the computer system does not detect a selection of an option to continue the hearing test), the computer system (e.g., 600) terminates the hearing test (e.g., automatically and without requiring additional user input). In some implementations, based on determining that the interruption of the hearing test has not yet exceeded the threshold duration, the computer system abandons the automatic termination of the hearing test. Automatically terminating the hearing test when the interruption exceeds the threshold duration reduces the amount of input required from the user and prevents the test from continuing and producing potentially invalid test results, thereby improving the human-computer interface.

[0287] In some implementations, a visual indication of the current ambient noise level (e.g., 630X) is displayed before the hearing test begins (e.g., in response to a computer system detecting that the current ambient noise level exceeds a threshold noise level). This indication visually changes as the current ambient noise level changes. Figures 6U1 to 6U4 (Location). Displays visual indications that change based on the loudness of the user's physical environment, providing visual feedback to the user on the amount of noise detected before the user begins the test, and informing the user whether the loudness of the physical environment is suitable for starting the test, thus providing improved visual feedback.

[0288] In some implementations, while displaying a visual indication of the current ambient noise level (e.g., 630X), a computer system (e.g., 600) detects a change in the current ambient noise level via one or more audio devices (e.g., 620). In response to detecting a change in the current ambient noise level: based on determining that the current ambient noise level does not exceed (e.g., within a zero or non-zero threshold duration) a threshold noise level, the computer system (e.g., 600) displays options for continuing (e.g., starting) the hearing test via a display generation component (e.g., 602). Figures 6V1 to 6V2 (e.g., displaying new user interface elements and / or updating existing user interface elements to indicate that user interface elements are now selectable); and based on determining that the current ambient noise level exceeds (e.g., for a duration of zero or non-zero threshold noise level) a threshold noise level, the computer system abandons (or optionally stops displaying) the option to continue the hearing test (e.g., and instead displays as...). Figure 6U1 Option 632A and / or such as Figures 6U2 to 6U4 (The grayed-out option 630Y). In some implementations, the computer system detects activation of the option to continue the hearing test and, in response, continues (e.g., starts) the hearing test. Providing the user with the option to continue the hearing test once the current ambient noise level drops below a threshold noise level provides visual feedback to the user that the ambient noise level is quiet enough to continue the hearing test, thus providing improved visual feedback.

[0289] In some implementations, in response to detecting a change in the current ambient noise level: based on determining that the current ambient noise level is below a threshold noise level (e.g., the change in noise level causes the noise level to drop below the threshold noise level), a computer system (e.g., 600) concurrently displays text indicating that the current ambient noise level is sufficiently quiet (e.g., to continue the hearing test) via a display generation component (e.g., 602) and a visual indication of the current ambient noise level (e.g., 630X). Figures 6V1 to 6V2 and / or Figures 9C to 9D (e.g., at 630AB); and based on determining that the current ambient noise level is higher than a threshold noise level (e.g., a change in the noise level causes the noise level to rise above the threshold noise level), the computer system (e.g., 600) displays text indicating that the current ambient noise level is too noisy via a display generation component (e.g., 602). Figures 6U1 to 6U4 and / or Figures 9A to 9B (630AA at the location). Alongside visual cues, textual information indicating whether the ambient noise is too loud or quiet enough is displayed, providing the user with visual feedback on the ambient noise level, thus offering improved visual feedback.

[0290] In some embodiments, a first audio device (e.g., 620A) in one or more audio devices (e.g., headphones, headsets, and / or microphones and / or audio analyzers for computer systems and / or remote devices) includes one or more microphones and one or more speakers. In some embodiments, a change in the current ambient noise level is detected using one or more microphones. In some embodiments, during a hearing test, the computer system (e.g., 600) outputs, via one or more speakers of the first audio device (e.g., 620A), audio with a first volume (e.g., independent of system volume settings) (e.g., a first test tone) and audio with a second volume (e.g., independent of system volume settings) different from the first volume (e.g., a second test tone). In some embodiments, the computer system uses the computer system's microphone (e.g., as an alternative to and / or as a supplement to the use of one or more microphones of the first audio device) to detect the current ambient noise level (e.g., a change in the current ambient noise level). In some embodiments, the computer system uses one or more speakers of the first audio device to output the test tone to obtain user feedback on whether the user has heard the test tone. During the hearing test, the microphone of the first audio device is used to detect the ambient noise level, and the speaker of the same first audio device is used to output the test tone. This allows the computer system to use the same audio device to monitor ambient noise and perform the hearing test, thereby improving the human-computer interface.

[0291] It should be noted that the above is relative to method 1000 (e.g., Figure 10 The details of the process described herein also apply in a similar manner to the methods described above. For example, method 1000 optionally includes one or more characteristics of the various methods described with reference to methods 700, 800, and 1200. For example, the computer system of method 1000 (e.g., 600) is the same as or similar to the computer system of method 700 and / or method 800. Similarly, the audio device of method 1000 (e.g., 620) is the same as or similar to the audio device of methods 700, 800, and 1200. Furthermore, the hearing test in different processes is the same hearing test. For the sake of brevity, these details will not be repeated below.

[0292] Figures 11A to 11N Examples of user interfaces for performing hearing tests are illustrated according to some implementation schemes. These user interfaces are used to illustrate the processes described below, including... Figures 12A to 12B The process in.

[0293] Figures 11A to 11NAn example user interface is illustrated for performing hearing tests on one or more of a user's ears (e.g., by testing one ear at a time). Computer system 600 provides a user interface that allows the user to adjust the volume of various audio frequencies (e.g., including one or more tones at one or more frequencies), and allows the user to identify the faintest / quietest audio frequency they can hear in each of the various audio frequencies. (Relative to...) Figures 11A to 11N The described user interface can be combined with relative Figures 6A to 6BH and Figures 9A to 9D This is achieved through the described user interface. In some implementations, Figures 11A to 11N The user interface was replaced Figures 6A to 6BH One or more user interfaces in the user interface.

[0294] In some implementations, computer system 600 performs relative to Figures 6A to 6V2 The described process, and the detection pointing to Figure 6V2 The next step option 632A input (for example, Figure 6V2 Tap to input and / or tap and hold input (650T), and in response, display user interface 11A.

[0295] exist Figure 11A At this point, computer system 600 displays user interface 1130, which includes instructions 1130A for providing input for a hearing test. In some embodiments, instructions 1130A instruct that during the hearing test, the user can provide input to change the volume of the test audio, thereby adjusting it to the weakest volume of audio that the user can hear. Figure 11A At this point, computer system 600 detects selection input pointing to the next option 1132A (e.g., tapping and holding input and / or tapping input 1150A), and in response, displays as follows: Figure 11B The user interface shown is 1110.

[0296] exist Figure 11BAt this location, the user interface 1110 includes instructions 1110A, volume indicators 1140, volume objects 1112A-1112B, next step options 1132B, and test details 1110B. Instructions 1110A instruct the user to adjust the volume of various test audios to the lowest audible volume for the user before continuing the test. Volume indicators 1140 include multiple discrete indicators, each corresponding to a different audio volume. Volume indicators 1140A correspond to the lowest volume (e.g., -10dB, 0dB, or 5dB (or dB HL)), volume indicators 1140B correspond to the highest volume (e.g., 80dB or 90dB (or dB HL)), and volume indicators 1140C correspond to the current volume of the test audio (e.g., indicated by the higher shape and different color of volume indicators 1140C compared to volume indicators corresponding to louder volumes) (e.g., 40dB or 42dB)). Volume object 1112A decreases the audio volume (e.g., decreases by one pitch level and / or one level) when activated, and volume object 1112B increases the audio volume (e.g., increases by one pitch level and / or one level) when activated. In some embodiments, each pitch level of volume increase / decrease is determined based on the lowest volume (e.g., the volume corresponding to volume indicator 1140A), the highest volume (e.g., the volume corresponding to volume indicator 1140B), and the number of discrete indicators in volume indicator 1140. For example, when there are 17 discrete volume indicators in volume indicator 1140 and the volume range is 0 dB (e.g., lowest volume) to 80 dB (e.g., highest volume), each pitch level corresponds to a 5 dB change in volume (e.g., increase or decrease by 5 dB). In some embodiments, computer system 600 includes 17 discrete volume indicators, such as... Figures 11B to 11K and Figure 11M As shown. In some embodiments, the computer system 600 includes fewer or more than 17 discrete volume indicators (e.g., 14, 15, 20, 21, or 25). In some embodiments, each change in volume and / or each discrete volume indicator corresponds to a 1dB, 2dB, 2.7dB, or 3dB change in volume (e.g., increase or decrease). Figure 11B In this case, the next option 1132B is optionally not activated (e.g., as shown below). Figure 11B (As indicated by the grayscale), because the computer system 600 has not yet received any user input requesting to change the volume of the first test audio 1134.

[0297] exist Figure 11BAt this point, computer system 600 is outputting a first test audio 1134 to a user's first ear (e.g., left ear) via a first speaker of a headset, earphone, and / or earbud (such as left earbud 620A), without outputting any audio to a second ear (e.g., via a second speaker or earbud). In some embodiments, the first test audio 1134 includes audio at a first frequency (e.g., the frequency currently being tested) (e.g., a first tone), as indicated by test details 1110B. In some embodiments, the first test audio 1134 does not include audio at a second frequency (e.g., a frequency different from the first frequency and / or not currently being tested) (e.g., a second tone different from the first tone). In some embodiments, the first test audio 1134 includes one or more repetitive audio tones (e.g., the tone of a repetitive pulse). In some embodiments, the first test audio 1134 is a continuous tone without any audio interruptions. Figure 11B Before the computer system 600 detects an input to change the volume of the first test audio 1134, the computer system 600 outputs the first test audio 1134 at a volume independent of the system volume setting (e.g., corresponding to volume indicator 1140C). (E.g., the computer system uses a volume level independent of the system volume of the computer system 600 to start the hearing test and / or to start the test of the first test audio 1134 on the first ear). In some embodiments, Figure 11B The volume of the first test audio 1134 is between the lowest and highest volume (e.g., 1140A corresponds to 0dB, 1140B corresponds to 80dB, and 1140C corresponds to 40dB; in Figure 11B At this point, computer system 600 outputs the first test audio 1134 at 40dB.

[0298] exist Figure 11BAt the point where the computer system 600 outputs the first test audio 1134 to the user's first ear via the first speaker, the computer system 600 detects an input requesting an increase in the volume of the first test audio 1134 (e.g., 1150B and / or 1150C) (e.g., because the user cannot hear the first test audio 1134). In some embodiments, the input requesting an increase in volume is an input 1150B pointing to the volume indicator 1140 (e.g., a swipe input, a touch input, and / or an air gesture), which includes movement (e.g., moving away from the volume indicator 1140A and towards the volume indicator 1140B), and the volume changes based on the magnitude of the movement of the input 1150B (e.g., distance, speed, and / or acceleration) (e.g., a larger magnitude causes a larger change in volume, and a smaller magnitude causes a smaller change in volume). In some implementations, the input requesting a higher volume is an input 1150C pointing to the volume indicator 1140D (e.g., a tap input, a touch input, and / or an air gesture), and the volume changes based on the position of the input 1150C (e.g., pointing to the volume indicator 1140D).

[0299] exist Figure 11C In response to Figure 11B Upon detecting an input requesting an increase in the volume of the first test audio 1134 (e.g., 1150B and / or 1150C), the computer system 600 visually updates the volume indicator 1140 and increases the volume of the first test audio 1134 to a volume corresponding to the volume indicator 1140D (e.g., to 75 dB or dB HL), while continuing to output the first test audio 1134 to the user's first ear via the first speaker. The computer system 600 has visually altered the volume indicator 1140D (e.g., changed its shape (e.g., increased its height) and / or changed its color) to indicate that the current volume is at the level corresponding to the volume indicator 1140D. The height of the volume indicator 1140C has been lowered to indicate that the current volume does not correspond to the volume indicator 1140C. Figure 11C At this point, the next option 1132B is active (e.g., as indicated by not being grayed out). In some implementations, the computer system 600 in Figures 11B to 11G The first test audio, 1134, is continuously output.

[0300] exist Figure 11CAt the location where the first test audio 1134 is output at a volume corresponding to volume indicator 1140D, computer system 600 detects an input requesting a reduction in the volume of the first test audio 1134 (e.g., 1150D and / or 1150D) (e.g., because the user can hear the first test audio 1134). In some embodiments, the input requesting a reduction in volume is an input 1150D pointing towards volume indicator 1140 (e.g., a swipe input, a touch input, and / or an air gesture), which includes movement (e.g., moving towards volume indicator 1140A and away from volume indicator 1140B), and the volume changes based on the magnitude of the movement of input 1150D (e.g., distance, speed, and / or acceleration) (e.g., a larger magnitude causes a larger change in volume, and a smaller magnitude causes a smaller change in volume). In some implementations, the input requesting a decrease in volume is an input 1150E pointing to the volume indicator 1140E (e.g., a tap input, a touch input, and / or an air gesture), and the volume changes based on the location of the input 1150E (e.g., pointing to the volume indicator 1140E).

[0301] exist Figure 11D In response to Figure 11C Upon detecting an input requesting a reduction in the volume of the first test audio 1134 (e.g., 1150D and / or 1150E), the computer system 600 visually updates the volume indicator 1140 and reduces the volume of the first test audio 1134 to a level corresponding to the volume indicator 1140E (e.g., to 60 dB or dB HL), while continuing to output the first test audio 1134. The computer system 600 has visually altered the volume indicator 1140E (e.g., changed its shape (e.g., increased its height) and / or changed its color) to indicate that the current volume is at the level corresponding to the volume indicator 1140E. The height of the volume indicator 1140D has been reduced to indicate that the current volume does not correspond to the volume indicator 1140D.

[0302] exist Figure 11DAt the location where the first test audio 1134 is output at a volume corresponding to volume indicator 1140E, computer system 600 detects an input requesting a reduction in the volume of the first test audio 1134 (e.g., 1150F) (e.g., because the user can hear the first test audio 1134). In response to detecting the input requesting a reduction in volume, computer system 600 reduces the volume of the first test audio 1134 by one tone while continuing to output the first test audio 1134 to the user's first ear via the first speaker. In some embodiments, the input requesting a reduction in volume is an input directed at volume indicator 1140 (e.g., a swipe input, a touch input, and / or an air gesture), which includes movement (e.g., moving towards and away from volume indicator 1140A and volume indicator 1140B), and the volume changes based on the magnitude of the movement of the input (e.g., distance, speed, and / or acceleration) (e.g., a larger magnitude causes a larger change in volume, and a smaller magnitude causes a smaller change in volume). In some embodiments, the input requesting a volume reduction is a gesture pointing to the volume indicator 1140F (e.g., a tap, touch, and / or air gesture), and the volume changes based on the input's location (e.g., pointing to the volume indicator 1140F). In some embodiments, the input requesting a volume reduction is a gesture pointing to the volume object 1112A (e.g., a tap, touch, and / or air gesture), and the volume decreases by one tone level (e.g., a 5 dB or dB HL decrease), such as... Figure 11E As shown.

[0303] exist Figure 11E In response to Figure 11D Upon detecting an input requesting a reduction in the volume of the first test audio 1134 by one tone (e.g., 1150F), the computer system 600 visually updates the volume indicator 1140 and reduces the volume of the first test audio 1134 by one tone to a volume corresponding to the volume indicator 1140F (e.g., reduced to 55 dB or dBHL), while continuing to output the first test audio 1134. The computer system 600 has visually altered the volume indicator 1140F (e.g., changed its shape (e.g., increased its height) and / or changed its color) to indicate that the current volume is at the level corresponding to the volume indicator 1140F. The height of the volume indicator 1140E has been reduced to indicate that the current volume does not correspond to the volume indicator 1140E.

[0304] exist Figure 11EAt the location where the first test audio 1134 is output at a volume corresponding to volume indicator 1140F, computer system 600 detects an input requesting a reduction in the volume of the first test audio 1134 (e.g., 1150G) (e.g., because the user can hear the first test audio 1134). In response to detecting the input requesting a reduction in volume, computer system 600 reduces the volume of the first test audio 1134 by one tone level while continuing to output the first test audio 1134 to the user's first ear via the first speaker. In some embodiments, the input requesting a reduction in volume is an input directed at volume indicator 1140 (e.g., a swipe input, a touch input, and / or an air gesture), which includes movement (e.g., moving towards and away from volume indicator 1140B), and the volume changes based on the magnitude of the movement of the input (e.g., distance, speed, and / or acceleration) (e.g., a larger magnitude causes a larger change in volume, and a smaller magnitude causes a smaller change in volume). In some embodiments, the input requesting a volume reduction is a gesture pointing to the volume indicator 1140G (e.g., a tap, touch, and / or air gesture), and the volume changes based on the input's location (e.g., pointing to the volume indicator 1140G). In some embodiments, the input requesting a volume reduction is a gesture pointing to the volume object 1112A (e.g., a tap, touch, and / or air gesture), and the volume decreases by one tone level (e.g., a...

Claims

1. A method, the method comprising: At a computer system that communicates with one or more input devices: When not paired with a first audio device, a request to pair the first audio device with the computer system is detected via the one or more input devices; as well as In response to detecting the request to pair the first audio device with the computer system, a process for pairing the first audio device with the computer system is initiated, wherein the process for pairing the first audio device with the computer system includes: Pair the first audio device with the computer system; Based on the determination that the first audio device is a first type of audio device, options are provided for performing a hearing test using the first audio device; and Based on the determination that the first audio device is a second type of audio device different from the first type of audio device, the option to perform the hearing test using the first audio device is abandoned.

2. The method according to claim 1, wherein: The process of pairing the first audio device with the computer system includes: Based on the determination that the first audio device is a first type of audio device, an option is provided for not performing the hearing test; and The method further includes: User input is selected via the selection of options through one or more input devices; and In response to the detection of the selected option, user input: Based on the determined option, the user input points to the option used to perform the hearing test, and the process of performing the hearing test continues; and If the user selects the option indicated by the selected option to not perform the hearing test, the process of continuing to perform the hearing test is abandoned.

3. The method according to any one of claims 1 to 2, further comprising: Audiogram data is generated based on the execution of the hearing test.

4. The method according to any one of claims 1 to 3, further comprising: After pairing the first audio device with the computer system, the hearing test is performed using the first audio device.

5. The method according to any one of claims 1 to 4, wherein the computer system is configured to communicate with one or more display generation components, the method further comprising: After performing the process of pairing the first audio device with the computer system, a settings user interface is displayed via the one or more display generation components, the settings user interface including options for performing a hearing test using the first audio device; Input pointing to the option for performing the hearing test using the first audio device is detected via the one or more input devices; as well as In response to detecting the input pointing to the option for performing the hearing test using the first audio device, the process of performing the hearing test continues.

6. The method according to any one of claims 1 to 5, wherein the first audio device comprises one or more speakers and one or more microphones, the method further comprising: Before performing the hearing test: Initiate a process of evaluating the audio input and audio output of the first audio device using the one or more speakers and one or more microphones of the first audio device; as well as After performing the audio input and audio output evaluation of the first audio device: Based on the determination that the first audio device has passed the evaluation through the audio input and audio output, the process of performing the hearing test using the first audio device continues; as well as Based on the determination that the first audio device failed the audio input and audio output evaluation, the process of continuing to perform the hearing test is abandoned.

7. The method according to any one of claims 1 to 6, wherein the first audio device comprises one or more microphones, and the method further comprises: During the hearing test, the ambient noise level is detected via one or more microphones of the first audio device; as well as In response to the detection of the ambient noise level: The hearing test is interrupted if the ambient noise level is determined to be greater than a threshold level; and If the ambient noise level is determined to be less than the threshold level, the hearing test is abandoned.

8. The method according to claim 7, further comprising: In response to the detection of the ambient noise level: If the ambient noise level is determined to be greater than the threshold level, an option is provided to continue the hearing test.

9. The method according to any one of claims 1 to 8, wherein the first audio device comprises one or more speakers and one or more microphones, the method further comprising: After the hearing test is completed, the first audio is output via one or more speakers of the first audio device using a volume setting based on a user-selected volume.

10. The method according to any one of claims 1 to 9, wherein the first audio device comprises one or more speakers, and the method further comprises: During the hearing test: The user input is detected via volume changes through one or more of the input devices; In response to detecting user input that the volume has changed, the volume setting is changed from a first value to a second value that is different from the first value based on the user input that the volume has changed; as well as When the volume setting is at the second value, audio that is not based on the second value of the volume setting is output via the one or more speakers.

11. The method according to any one of claims 1 to 9, the method further comprising: Change the volume setting from the user-selected volume to the system-selected volume; as well as During the hearing test, the volume setting is maintained at the volume selected by the system.

12. The method of claim 11, wherein the first audio device comprises one or more speakers, the method further comprising: During the hearing test, the following output is made via the one or more speakers of the first audio device: It has a first volume of audio that is independent of the system volume setting; as well as An audio signal with a second volume that is independent of the system volume setting and is different from the first volume.

13. The method according to any one of claims 1 to 12, wherein the first audio device comprises one or more speakers and one or more microphones, the method further comprising: The hearing test is performed by outputting test audio via one or more speakers of the first audio device to generate a set of audio characteristics using audiogram data; Audio is received via one or more microphones of the first audio device; as well as Modified audio of received audio output via one or more speakers of the first audio device, wherein the modified audio has been adjusted based on the set of audio characteristics.

14. The method according to any one of claims 1 to 13, wherein the first audio device comprises one or more speakers, and the method further comprises: During the hearing test: The first audio signal is output via one or more speakers of the first audio device; as well as After the first audio is output, the monitoring system instructs the user to hear the first audio.

15. A non-transitory computer-readable storage medium storing one or more programs configured to be executed by one or more processors of a computer system communicating with one or more input devices, the one or more programs including instructions for performing the method according to any one of claims 1 to 14.

16. A computer system configured to communicate with one or more input devices, the computer system comprising: One or more processors; as well as A memory storing one or more programs configured to be executed by the one or more processors, the one or more programs including instructions for performing the method according to any one of claims 1 to 14.

17. A computer system configured to communicate with one or more input devices, the computer system comprising: Components for performing the method according to any one of claims 1 to 14.

18. A computer program product comprising one or more programs configured to be executed by one or more processors of a computer system in communication with one or more input devices, the one or more programs comprising instructions for performing the method according to any one of claims 1 to 14.

19. A non-transitory computer-readable storage medium storing one or more programs configured to be executed by one or more processors of a computer system communicating with one or more input devices, the one or more programs including instructions for: detect, via the one or more input devices, a request to pair the first audio device with the computer system while not paired with the first audio device; as well as In response to detecting the request to pair the first audio device with the computer system, a process for pairing the first audio device with the computer system is initiated, wherein the process for pairing the first audio device with the computer system includes: Pair the first audio device with the computer system; Based on the determination that the first audio device is a first type of audio device, options are provided for performing a hearing test using the first audio device; and Based on the determination that the first audio device is a second type of audio device different from the first type of audio device, the option to perform the hearing test using the first audio device is abandoned.

20. A computer system configured to communicate with one or more input devices, the computer system comprising: One or more processors; as well as The memory stores one or more programs configured to be executed by the one or more processors, the one or more programs including instructions for the following operations: When not paired with a first audio device, a request to pair the first audio device with the computer system is detected via the one or more input devices; as well as In response to detecting the request to pair the first audio device with the computer system, a process for pairing the first audio device with the computer system is initiated, wherein the process for pairing the first audio device with the computer system includes: Pair the first audio device with the computer system; Based on the determination that the first audio device is a first type of audio device, options are provided for performing a hearing test using the first audio device; and Based on the determination that the first audio device is a second type of audio device different from the first type of audio device, the option to perform the hearing test using the first audio device is abandoned.

21. A computer system configured to communicate with one or more input devices, the computer system comprising: A component for detecting a request to pair the first audio device with the computer system via the one or more input devices when not paired with the first audio device; as well as Components for initiating a process of pairing the first audio device with the computer system in response to detecting a request to pair the first audio device with the computer system, wherein the process of pairing the first audio device with the computer system includes: Pair the first audio device with the computer system; Based on the determination that the first audio device is a first type of audio device, options are provided for performing a hearing test using the first audio device; and Based on the determination that the first audio device is a second type of audio device different from the first type of audio device, the option to perform the hearing test using the first audio device is abandoned.

22. A computer program product comprising one or more programs configured to execute by one or more processors of a computer system communicating with one or more input devices, the one or more programs comprising instructions for: detect, via the one or more input devices, a request to pair the first audio device with the computer system while not paired with the first audio device; as well as In response to detecting the request to pair the first audio device with the computer system, a process for pairing the first audio device with the computer system is initiated, wherein the process for pairing the first audio device with the computer system includes: Pair the first audio device with the computer system; Based on the determination that the first audio device is a first type of audio device, options are provided for performing a hearing test using the first audio device; and Based on the determination that the first audio device is a second type of audio device different from the first type of audio device, the option to perform the hearing test using the first audio device is abandoned.

23. A method, the method comprising: In a computer system that includes a first audio device having one or more speakers: Access the first set of audio features based on the hearing test; Access a second set of audio characteristics that differ from the first set of audio characteristics and are based on the hearing test; Receive the first audio; as well as In response to receiving the first audio: Based on the determination that the first audio is a first type of audio, a first modified audio, which has been modified based on the first set of audio characteristics, is output via the one or more speakers of the first audio device; as well as Based on the determination that the first audio is a second type of audio different from the first type of audio, a second modified audio, which has been modified based on the second set of audio characteristics, is output via the one or more speakers of the first audio device.

24. The method of claim 23, further comprising: Access a third set of audio characteristics that differs from the first set of audio characteristics and the second set of audio characteristics and is based on the hearing test; as well as In response to receiving the first audio: Based on the determination that the first audio is a third type of audio, a third modified audio, which has been modified based on the third set of audio characteristics, is output via the one or more speakers of the first audio device.

25. The method according to any one of claims 23 to 24, further comprising: Detects inputs used to disable modifications to the corresponding audio type; as well as In response to the detection of the input used to disable modification of the corresponding type of audio: Based on the determination that the corresponding type is the first type of audio, the modification of the received first type of audio using the first set of audio characteristics is disabled, and the modification of the received second type of audio using the second set of audio characteristics continues; as well as Based on the determination that the corresponding type is the second type of audio, the modification of the received second type of audio using the second set of audio characteristics is disabled, and the modification of the received first type of audio using the first set of audio characteristics continues.

26. The method according to any one of claims 23 to 25, wherein: The first set of audio characteristics identifies the first amplification value of the first plurality of frequencies; and The second set of audio characteristics identifies the second amplification value of the second plurality of frequencies.

27. The method of claim 26, wherein the first amplification value of the first plurality of frequencies includes an amplification value corresponding to a first ear and an amplification value corresponding to a second ear different from the first ear.

28. The method according to any one of claims 23 to 27, wherein: The first set of audio characteristics includes a first tone profile; and The second set of audio characteristics includes a second tone profile that is different from the first tone profile.

29. The method of claim 28, wherein the first tone profile includes tone information for a first ear and tone information for a second ear different from the first ear.

30. The method according to any one of claims 23 to 27, wherein: The first set of audio characteristics includes first audio balance information; and The second set of audio characteristics includes second audio balance information that is different from the first audio balance information.

31. The method according to any one of claims 23 to 30, further comprising: The detection involves adjusting the input of the first set of characteristics; In response to detecting the input involving adjusting the first set of characteristics, the first set of characteristics is adjusted; as well as After adjusting the first set of characteristics, the audio modified using the adjusted first set of characteristics is output via the one or more speakers of the first audio device.

32. The method according to any one of claims 23 to 31, wherein the first audio is audio received using one or more microphones of the first audio device.

33. The method according to any one of claims 23 to 32, wherein the first audio is audio received from an application running on a remote device.

34. A non-transitory computer-readable storage medium storing one or more programs configured to be executed by one or more processors of a computer system including a first audio device having one or more speakers, the one or more programs including instructions for performing the method according to any one of claims 23 to 33.

35. A computer system including a first audio device having one or more speakers, the computer system comprising: One or more processors; as well as A memory storing one or more programs configured to be executed by the one or more processors, the one or more programs including instructions for performing the method according to any one of claims 23 to 33.

36. A computer system including a first audio device having one or more speakers, the computer system comprising: Components for performing the method according to any one of claims 23 to 33.

37. A computer program product comprising one or more programs configured to be executed by one or more processors of a computer system including a first audio device having one or more speakers, the one or more programs comprising instructions for performing the method according to any one of claims 23 to 33.

38. A non-transitory computer-readable storage medium storing one or more programs configured to be executed by one or more processors of a computer system including a first audio device having one or more speakers, the one or more programs including instructions for: Access the first set of audio features based on the hearing test; Access a second set of audio characteristics that differ from the first set of audio characteristics and are based on the hearing test; receiving a first audio; as well as In response to receiving the first audio: Based on the determination that the first audio is a first type of audio, a first modified audio, which has been modified based on the first set of audio characteristics, is output via the one or more speakers of the first audio device; as well as Based on the determination that the first audio is a second type of audio different from the first type of audio, a second modified audio, which has been modified based on the second set of audio characteristics, is output via the one or more speakers of the first audio device.

39. A computer system including a first audio device having one or more speakers, the computer system comprising: One or more processors; as well as The memory stores one or more programs configured to be executed by the one or more processors, the one or more programs including instructions for the following operations: Access the first set of audio features based on the hearing test; Access a second set of audio characteristics that differ from the first set of audio characteristics and are based on the hearing test; Receive the first audio; as well as In response to receiving the first audio: Based on the determination that the first audio is a first type of audio, a first modified audio, which has been modified based on the first set of audio characteristics, is output via the one or more speakers of the first audio device; as well as Based on the determination that the first audio is a second type of audio different from the first type of audio, a second modified audio, which has been modified based on the second set of audio characteristics, is output via the one or more speakers of the first audio device.

40. A computer system including a first audio device having one or more speakers, the computer system comprising: Components used to access the first set of audio characteristics based on hearing tests; A component for accessing a second set of audio characteristics that differ from the first set of audio characteristics and are based on the hearing test; Components used to receive the first audio signal; as well as Components for performing the following operations in response to receiving the first audio: Based on the determination that the first audio is a first type of audio, a first modified audio, which has been modified based on the first set of audio characteristics, is output via the one or more speakers of the first audio device; as well as Based on the determination that the first audio is a second type of audio different from the first type of audio, a second modified audio, which has been modified based on the second set of audio characteristics, is output via the one or more speakers of the first audio device.

41. A computer program product comprising one or more programs configured to be executed by one or more processors of a computer system including a first audio device having one or more speakers, the one or more programs comprising instructions for: Access the first set of audio features based on the hearing test; Access a second set of audio characteristics that differ from the first set of audio characteristics and are based on the hearing test; receiving a first audio; as well as In response to receiving the first audio: Based on the determination that the first audio is a first type of audio, a first modified audio, which has been modified based on the first set of audio characteristics, is output via the one or more speakers of the first audio device; as well as Based on the determination that the first audio is a second type of audio different from the first type of audio, a second modified audio, which has been modified based on the second set of audio characteristics, is output via the one or more speakers of the first audio device.

42. A method, the method comprising: At the computer system that communicates with the display generation components and one or more audio devices: During the hearing test: The display generation component displays a visual indication of the current ambient noise level, wherein the visual indication changes visually as the current ambient noise level changes; While displaying the visual indication of the current ambient noise level, changes in the current ambient noise level are detected via the one or more audio devices; as well as In response to detecting a change in the current ambient noise level, the display of the visual indication of the current ambient noise level is updated via the display generation component to correspond to the current ambient noise level.

43. The method of claim 42, wherein updating the display of the visual indicator of the current ambient noise level includes changing the shape of the visual indicator of the current ambient noise level.

44. The method according to any one of claims 42 to 43, wherein the visual indication of the current ambient noise level comprises a plurality of bars arranged in parallel.

45. The method of claim 44, wherein updating the display of the visual indication of the current ambient noise level includes changing the height of one or more of the plurality of bars based on the change in the current ambient noise level.

46. ​​The method of any one of claims 42 to 45, wherein updating the display of the visual indicator of the current ambient noise level includes changing the height of the visual indicator of the current ambient noise level.

47. The method of any one of claims 42 to 46, wherein updating the display of the visual indication of the current ambient noise level includes changing the characteristics of the visual indication of the current ambient noise level.

48. The method of claim 47, wherein the characteristic of the visual indication that changes the current ambient noise level includes: Based on the determination that the current ambient noise level is higher than a threshold noise level, the visual indication of the current ambient noise level is displayed in a first color via the display generation component. as well as Based on the determination that the current ambient noise level is lower than the threshold noise level, the visual indication of the current ambient noise level is displayed via the display generation component in a second color different from the first color.

49. The method of any one of claims 42 to 48, wherein the visual indication of the current ambient noise level is displayed in response to detecting, via the one or more audio devices, a change in the current ambient noise level causing the current ambient noise level to exceed a threshold noise level.

50. The method according to any one of claims 42 to 49, the method further comprising: When the visual indication of the current ambient noise level is not displayed, changes in the current ambient noise level are detected via the one or more audio devices; as well as In response to the detection of a change in the current ambient noise level: Based on the determination that the current ambient noise level exceeds a threshold noise level, the visual indication of the current ambient noise level is displayed via the display generation component; as well as If it is determined that the current ambient noise level does not exceed the threshold noise level, the visual indication of the current ambient noise level is abandoned.

51. The method according to any one of claims 42 to 50, wherein the visual indication of the current ambient noise level is displayed during the hearing test.

52. The method according to claim 51: The visual indication of the current ambient noise level is displayed based on the determination that the current ambient noise level exceeds a threshold noise level; and The method further includes: During the hearing test: The hearing test is interrupted if the current ambient noise level is determined to exceed the threshold noise level. as well as If the current ambient noise level is determined not to exceed the threshold noise level, the hearing test is abandoned.

53. The method according to claim 52, further comprising: When the hearing test is interrupted, the change in the current ambient noise level is detected via the one or more audio devices; as well as In response to the detection of a change in the current ambient noise level: Based on the determination that the current ambient noise level does not exceed the threshold noise level, an option to continue the hearing test is displayed via the display generation component; and If the current ambient noise level is determined to exceed the threshold noise level, the option to continue the hearing test is abandoned.

54. The method according to any one of claims 52 to 53, further comprising: When the hearing test is interrupted, an option to end the hearing test is displayed via the display generation component.

55. The method according to any one of claims 52 to 54, the method further comprising: When the hearing test is interrupted: The hearing test is terminated if the interruption during the hearing test exceeds a threshold duration.

56. The method according to any one of claims 42 to 50, wherein the visual indication of the current ambient noise level is displayed before the hearing test begins.

57. The method of claim 56, further comprising: While displaying the visual indication of the current ambient noise level, changes in the current ambient noise level are detected via the one or more audio devices; as well as In response to the detection of a change in the current ambient noise level: Based on the determination that the current ambient noise level does not exceed the threshold noise level, an option to continue the hearing test is displayed via the display generation component; and If the current ambient noise level is determined to exceed the threshold noise level, the option to continue the hearing test is abandoned.

58. The method according to any one of claims 42 to 57, further comprising: In response to the detection of the change in the current ambient noise level: Based on the determination that the current ambient noise level is below a threshold noise level, text indicating that the current ambient noise level is sufficiently quiet is displayed concurrently with the visual indication of the current ambient noise level via the display generation component; as well as Based on the determination that the current ambient noise level is higher than the threshold noise level, the display generation component displays text indicating that the current ambient noise level is too noisy.

59. The method according to any one of claims 42 to 58, wherein: The first audio device in the one or more audio devices includes one or more microphones and one or more speakers; The change in the current ambient noise level was detected using the one or more microphones; and The method further includes: During the hearing test, the following output is made via the one or more speakers of the first audio device: Audio with a first volume; as well as An audio signal with a second volume that is different from the first volume.

60. A non-transitory computer-readable storage medium storing one or more programs configured to be executed by one or more processors of a computer system in communication with a display generation component and one or more audio devices, the one or more programs including instructions for performing the method according to any one of claims 42 to 59.

61. A computer system configured to communicate with a display generation component and one or more audio devices, the computer system comprising: One or more processors; as well as A memory storing one or more programs configured to be executed by the one or more processors, the one or more programs including instructions for performing the method according to any one of claims 42 to 59.

62. A computer system configured to communicate with a display generation component and one or more audio devices, the computer system comprising: Components for performing the method according to any one of claims 42 to 59.

63. A computer program product comprising one or more programs configured to be executed by one or more processors of a computer system in communication with a display generation component and one or more audio devices, the one or more programs comprising instructions for performing the method according to any one of claims 42 to 59.

64. A non-transitory computer-readable storage medium storing one or more programs configured to be executed by one or more processors of a computer system in communication with a display generation component and one or more audio devices, the one or more programs including instructions for: During the hearing test: The display generation component displays a visual indication of the current ambient noise level, wherein the visual indication changes visually as the current ambient noise level changes; While displaying the visual indication of the current ambient noise level, changes in the current ambient noise level are detected via the one or more audio devices; and In response to detecting a change in the current ambient noise level, the display of the visual indication of the current ambient noise level is updated via the display generation component to correspond to the current ambient noise level.

65. A computer system configured to communicate with a display generation component and one or more audio devices, the computer system comprising: One or more processors; as well as The memory stores one or more programs configured to be executed by the one or more processors, the one or more programs including instructions for the following operations: During the hearing test: The display generation component displays a visual indication of the current ambient noise level, wherein the visual indication changes visually as the current ambient noise level changes; While displaying the visual indication of the current ambient noise level, changes in the current ambient noise level are detected via the one or more audio devices; as well as In response to detecting a change in the current ambient noise level, the display of the visual indication of the current ambient noise level is updated via the display generation component to correspond to the current ambient noise level.

66. A computer system configured to communicate with a display generation component and one or more audio devices, the computer system comprising: Components used to perform the following operations during the hearing test: The display generation component displays a visual indication of the current ambient noise level, wherein the visual indication changes visually as the current ambient noise level changes; While displaying the visual indication of the current ambient noise level, changes in the current ambient noise level are detected via the one or more audio devices; as well as In response to detecting a change in the current ambient noise level, the display of the visual indication of the current ambient noise level is updated via the display generation component to correspond to the current ambient noise level.

67. A computer program product comprising one or more programs configured to be executed by one or more processors of a computer system in communication with a display generation component and one or more audio devices, the one or more programs comprising instructions for performing the following operations: During the hearing test: The display generation component displays a visual indication of the current ambient noise level, wherein the visual indication changes visually as the current ambient noise level changes; While displaying the visual indication of the current ambient noise level, changes in the current ambient noise level are detected via the one or more audio devices; and In response to detecting a change in the current ambient noise level, the display of the visual indication of the current ambient noise level is updated via the display generation component to correspond to the current ambient noise level.

68. A method comprising: At a computer system that communicates with one or more display generation components, one or more input devices, and one or more audio devices: During the hearing test: A user interface is displayed via the one or more display generation components, the user interface including a plurality of discrete volume indicators and a visual indication of the current volume of the audio output during the hearing test, wherein the plurality of discrete volume indicators include: A volume indicator corresponding to the minimum volume used to output audio during the hearing test. A volume indicator corresponding to the maximum volume of the audio output during the hearing test, and A volume indicator corresponding to the current volume used to output audio during the hearing test; When the user interface is displayed, including the plurality of discrete volume indicators and the visual indication for outputting audio during the hearing test, a first audio with a first volume is output via a first speaker of the one or more audio devices; When the first audio is output via the first speaker of the one or more audio devices, user input directed to the user interface is detected via the one or more input devices; and In response to detecting user input directed to the user interface: Based on the user input, the volume of the first audio is changed from the first volume to a second volume different from the first volume; and The user interface is updated via the one or more display generation components to indicate that the current volume used to output audio during the hearing test is the second volume.

69. The method of claim 68, wherein the computer system continuously outputs the first audio as the volume of the first audio is changed from the first volume to the second volume.

70. The method according to any one of claims 68 to 69, wherein the first audio comprises audio at a first frequency continuously output when the volume of the first audio is changed from the first volume to the second volume.

71. The method according to any one of claims 68 to 70, wherein detecting the user input directed toward the user interface includes detecting directional movement of the user input.

72. The method of any one of claims 68 to 71, wherein changing the volume of the first audio from the first volume to the second volume based on the user input comprises changing the volume from the first volume to the second volume in discrete steps.

73. The method according to any one of claims 68 to 72, wherein the user input points to a corresponding user interface object of the user interface.

74. The method according to any one of claims 68 to 73, the method further comprising: As part of the user interface, and concurrently with the plurality of discrete volume indicators and the visual indicator of the current volume, the increase volume user interface object and the decrease volume user interface object are displayed. and Changing the volume of the first audio from the first volume to the second volume based on the user input includes: Based on the determination that the user input points to the volume-increasing user interface object, the volume is increased from the first volume to the second volume; as well as Based on the determination that the user input points to the volume-down user interface object, the volume is reduced from the first volume to the second volume.

75. The method according to any one of claims 68 to 74, wherein: Changing the volume of the first audio from the first volume to the second volume based on the user input includes performing multiple discrete volume changes; and The magnitude of the first discrete volume change among the plurality of discrete volume changes is based on the minimum volume used to output audio during the hearing test, the maximum volume used to output audio during the hearing test, and the number of discrete volume levels between the minimum volume and the maximum volume.

76. The method of claim 75, wherein each discrete change in volume level between the minimum volume and the maximum volume is the same amount.

77. The method of any one of claims 68 to 76, wherein the visual indication for displaying the current volume of the audio output during the hearing test comprises visually distinguishing a corresponding discrete volume indicator of the plurality of discrete volume indicators that corresponds to the current volume from a corresponding discrete volume indicator of the plurality of discrete volume indicators that does not correspond to the current volume.

78. The method according to any one of claims 68 to 77, the method further comprising: As part of the user interface, the confirmation user interface options are displayed concurrently with the visual indication of the plurality of discrete volume indicators and the current volume; as well as When the first audio is output via the first speaker, input pointing to the confirmation user interface option is detected via the one or more input devices; as well as In response to detecting the input pointing to the confirmation user interface option: Based on the determination that the current volume is the first corresponding volume, the first corresponding volume is identified as the weakest volume at which the user can hear the first audio. as well as Based on the determination that the current volume is a second corresponding volume that is different from the first corresponding volume, the second corresponding volume is identified as the weakest volume at which the user can hear the first audio.

79. The method according to claim 78, further comprising: After the input pointing to the confirmation user interface option is detected when the first audio is output via the first speaker: The plurality of discrete volume indicators are displayed via the one or more display generation components, and a second audio, different from the first audio, is output concurrently via the first speaker of the one or more audio devices.

80. A non-transitory computer-readable storage medium storing one or more programs configured to be executed by one or more processors of a computer system in communication with one or more display generation components, one or more input devices, and one or more audio devices, the one or more programs including instructions for performing the method according to any one of claims 68 to 79.

81. A computer system configured to communicate with one or more display generation components, one or more input devices, and one or more audio devices, the computer system comprising: One or more processors; as well as A memory storing one or more programs configured to be executed by the one or more processors, the one or more programs including instructions for performing the method according to any one of claims 68 to 79.

82. A computer system configured to communicate with one or more display generation components, one or more input devices, and one or more audio devices, the computer system comprising: Components for performing the method according to any one of claims 68 to 79.

83. A computer program product comprising one or more programs configured to be executed by one or more processors of a computer system in communication with one or more display generation components, one or more input devices and one or more audio devices, the one or more programs comprising instructions for performing the method according to any one of claims 68 to 79.

84. A non-transitory computer-readable storage medium storing one or more programs configured to be executed by one or more processors of a computer system in communication with one or more display generation components, one or more input devices, and one or more audio devices, the one or more programs including instructions for: During the hearing test: A user interface is displayed via the one or more display generation components, the user interface including a plurality of discrete volume indicators and a visual indication of the current volume of the audio output during the hearing test, wherein the plurality of discrete volume indicators include: A volume indicator corresponding to the minimum volume used to output audio during the hearing test. A volume indicator corresponding to the maximum volume of the audio output during the hearing test, and A volume indicator corresponding to the current volume used to output audio during the hearing test; When the user interface is displayed, including the plurality of discrete volume indicators and the visual indication for outputting audio during the hearing test, a first audio with a first volume is output via a first speaker of the one or more audio devices; When the first audio is output via the first speaker of the one or more audio devices, user input directed to the user interface is detected via the one or more input devices; as well as In response to detecting user input directed to the user interface: Based on the user input, the volume of the first audio is changed from the first volume to a second volume that is different from the first volume; as well as The user interface is updated via the one or more display generation components to indicate that the current volume used to output audio during the hearing test is the second volume.

85. A computer system configured to communicate with one or more display generation components, one or more input devices, and one or more audio devices, the computer system comprising: One or more processors; as well as The memory stores one or more programs configured to be executed by the one or more processors, the one or more programs including instructions for the following operations: During the hearing test: A user interface is displayed via the one or more display generation components, the user interface including a plurality of discrete volume indicators and a visual indication of the current volume of the audio output during the hearing test, wherein the plurality of discrete volume indicators include: A volume indicator corresponding to the minimum volume used to output audio during the hearing test. A volume indicator corresponding to the maximum volume of the audio output during the hearing test, and A volume indicator corresponding to the current volume used to output audio during the hearing test; When the user interface is displayed, including the plurality of discrete volume indicators and the visual indication for outputting audio during the hearing test, a first audio with a first volume is output via a first speaker of the one or more audio devices; When the first audio is output via the first speaker of the one or more audio devices, user input directed to the user interface is detected via the one or more input devices; and In response to detecting user input directed to the user interface: Based on the user input, the volume of the first audio is changed from the first volume to a second volume different from the first volume; and The user interface is updated via the one or more display generation components to indicate that the current volume used to output audio during the hearing test is the second volume.

86. A computer system configured to communicate with one or more display generation components, one or more input devices, and one or more audio devices, the computer system comprising: During the hearing test: Components for displaying a user interface via the one or more display generation components, the user interface including a plurality of discrete volume indicators and a visual indication of the current volume of audio output during the hearing test, wherein the plurality of discrete volume indicators include: A volume indicator corresponding to the minimum volume used to output audio during the hearing test. A volume indicator corresponding to the maximum volume of the audio output during the hearing test, and A volume indicator corresponding to the current volume used to output audio during the hearing test; A component for outputting a first audio with a first volume via a first speaker of the one or more audio devices when displaying the user interface including the plurality of discrete volume indicators and the visual indication for outputting audio at the current volume during the hearing test; A component for detecting user input directed to the user interface via the one or more input devices when the first audio is output via the first speaker of the one or more audio devices; and Components for performing the following operations in response to detecting user input directed to the user interface: Based on the user input, the volume of the first audio is changed from the first volume to a second volume different from the first volume; and The user interface is updated via the one or more display generation components to indicate that the current volume used to output audio during the hearing test is the second volume.

87. A computer program product comprising one or more programs configured to execute by one or more processors of a computer system in communication with one or more display generation components, one or more input devices, and one or more audio devices, the one or more programs comprising instructions for performing the following operations: During the hearing test: A user interface is displayed via the one or more display generation components, the user interface including a plurality of discrete volume indicators and a visual indication of the current volume of the audio output during the hearing test, wherein the plurality of discrete volume indicators include: A volume indicator corresponding to the minimum volume used to output audio during the hearing test. A volume indicator corresponding to the maximum volume of the audio output during the hearing test, and A volume indicator corresponding to the current volume used to output audio during the hearing test; When the user interface is displayed, including the plurality of discrete volume indicators and the visual indication for outputting audio during the hearing test, a first audio with a first volume is output via a first speaker of the one or more audio devices; When the first audio is output via the first speaker of the one or more audio devices, user input directed to the user interface is detected via the one or more input devices; as well as In response to detecting user input directed to the user interface: Based on the user input, the volume of the first audio is changed from the first volume to a second volume that is different from the first volume; as well as The user interface is updated via the one or more display generation components to indicate that the current volume used to output audio during the hearing test is the second volume.

Images