User interface for managing media

Abstract

The invention relates to a user interface for managing media. The present disclosure relates generally to a user interface for managing exposure compensation, displaying a representation of a media (image, video), and displaying a status indicator (e.g., indicating that the media is being captured and / or that the media has been captured) when capturing the media (e.g., image, video).

Description

[0001] This application is a divisional application of the invention patent application with the application date of May 26, 2021, application number 202210849316.2, and name “User Interface for Managing Media”.

[0002] CROSS-REFERENCE TO RELATED APPLICATIONS

[0003] This application claims priority to the following patent applications: U.S. Provisional Application No. 63 / 032,871, filed on June 1, 2020, entitled “USER INTERFACES FOR MANAGING MEDIA,” U.S. Patent Application No. 17 / 027,317, filed on September 21, 2020, entitled “USER INTERFACES FOR MANAGING MEDIA,” U.S. Patent Application No. 17 / 027,484, filed on September 21, 2020, and Danish Patent Application No. PA2020 70611, filed on September 21, 2020, entitled “USER INTERFACES FOR MANAGING MEDIA,” the entire contents of which are hereby incorporated by reference. Technical Field

[0004] The present disclosure relates generally to computer user interfaces and, more particularly, to techniques for managing media. Background Art

[0005] Users of smartphones and other personal electronic devices frequently capture, store, and edit media for preserving memories and sharing with friends. Some existing technologies allow users to capture media, such as images, audio, and / or video. Users can manage such media by, for example, capturing, storing, and editing media. Summary of the invention

[0006] However, some user interfaces for managing media using electronic devices are often cumbersome and inefficient. For example, some prior art techniques use complex and time-consuming user interfaces that may include multiple keystrokes or keystrokes. Prior art techniques require more time than necessary, which results in wasted user time and device energy. This latter consideration is particularly important in battery-powered devices.

[0007] Thus, the present technology provides faster, more efficient methods and interfaces for managing media for electronic devices. Such methods and interfaces optionally supplement or replace other methods for managing media. Such methods and interfaces reduce the cognitive burden imposed on users and produce more efficient human-computer interfaces. For battery-driven computing systems, such methods and interfaces save power and increase the time interval between battery charges.

[0008] In some examples, the present technology enables a user of a computer system to capture and display media in a time-efficient and input-efficient manner, thereby reducing the amount of processing that the device needs to do. In some examples, the present technology manages the brightness of various areas of the user interface, thereby extending battery life.

[0009] According to some embodiments, a method is described. The method is performed at a computer system having one or more cameras, wherein the computer system communicates with a display generation component and one or more input devices. The method includes: receiving a request to display a camera user interface; and in response to receiving a request to display a camera user interface and when the one or more cameras are configured to capture an image based on a first exposure compensation value, displaying the camera user interface via a display generation component, the display includes: displaying a first representation of the field of view of the one or more cameras via a display generation component; and based on determining that a set of exposure compensation criteria are met, wherein the set of exposure compensation criteria includes criteria that are met when an exposure compensation mode is enabled, an exposure compensation indicator is displayed simultaneously with a representation of the field of view of the one or more cameras, the exposure compensation indicator including: a representation of a first exposure compensation value; and a visual indication indicating that the computer system has determined that a predicted clip occurs in response to receiving a request to capture a representation of the field of view of the one or more cameras.

[0010] According to some embodiments, a non-transitory computer-readable storage medium is described. The non-transitory computer-readable storage medium stores one or more programs configured to be executed by one or more processors of a computer system having one or more cameras, wherein the computer system communicates with a display generation component and one or more input devices, and the one or more programs include instructions for the following operations: receiving a request to display a camera user interface; and in response to receiving the request to display the camera user interface and when the one or more cameras are configured to capture images based on a first exposure compensation value, displaying the camera user interface via the display generation component, the display including: displaying a first representation of the field of view of the one or more cameras via the display generation component; and based on determining that a set of exposure compensation criteria are met, wherein the set of exposure compensation criteria include criteria met when an exposure compensation mode is enabled, displaying an exposure compensation indicator simultaneously with a representation of the field of view of the one or more cameras, the exposure compensation indicator including: a representation of the first exposure compensation value; and a visual indication indicating that the computer system has determined that a predicted clip occurs in response to receiving a request to capture a representation of the field of view of the one or more cameras.

[0011] According to some embodiments, a transient computer-readable storage medium is described. The transient computer-readable storage medium stores one or more programs configured to be executed by one or more processors of a computer system having one or more cameras, wherein the computer system communicates with a display generation component and one or more input devices, and the one or more programs include instructions for the following operations: receiving a request to display a camera user interface; and in response to receiving the request to display the camera user interface and when the one or more cameras are configured to capture images based on a first exposure compensation value, displaying the camera user interface via the display generation component, the display including: displaying a first representation of the field of view of the one or more cameras via the display generation component; and based on determining that a set of exposure compensation criteria are met, wherein the set of exposure compensation criteria include criteria met when an exposure compensation mode is enabled, displaying an exposure compensation indicator simultaneously with a representation of the field of view of the one or more cameras, the exposure compensation indicator including: a representation of the first exposure compensation value; and a visual indication indicating that the computer system has determined that a predicted clip occurs in response to receiving a request to capture media corresponding to a representation of the field of view of the one or more cameras.

[0012] According to some embodiments, a computer system is described. The computer system includes: one or more cameras; one or more processors, wherein the computer system communicates with a display generation component and one or more input devices; and a memory, the memory storing one or more programs configured to be executed by the one or more processors, the one or more programs including instructions for performing the following operations: receiving a request to display a camera user interface; and in response to receiving the request to display the camera user interface and when the one or more cameras are configured to capture images based on a first exposure compensation value, displaying the camera user interface via the display generation component, the display including: displaying a first representation of the field of view of the one or more cameras via the display generation component; and based on determining that a set of exposure compensation criteria are met, wherein the set of exposure compensation criteria include criteria met when an exposure compensation mode is enabled, displaying an exposure compensation indicator simultaneously with a representation of the field of view of the one or more cameras, the exposure compensation indicator including: a representation of the first exposure compensation value; and a visual indication indicating that the computer system has determined that the predicted clipping occurs in response to receiving a request to capture media corresponding to the representation of the field of view of the one or more cameras.

[0013] According to some embodiments, a computer system is described. The computer system includes: a device for receiving a request to display a camera user interface; and in response to receiving the request to display the camera user interface and when the one or more cameras are configured to capture images based on a first exposure compensation value, a device for displaying the camera user interface via a display generation component, the camera user interface including: a device for displaying a first representation of the field of view of the one or more cameras via the display generation component; and based on determining that a set of exposure compensation criteria are satisfied, wherein the set of exposure compensation criteria include criteria satisfied when an exposure compensation mode is enabled, a device for displaying an exposure compensation indicator simultaneously with the representation of the field of view of the one or more cameras, the exposure compensation indicator including: a representation of the first exposure compensation value; and a visual indication indicating that the computer system has determined that a predicted clip occurs in response to receiving a request to capture media corresponding to the representation of the field of view of the one or more cameras.

[0014] According to some embodiments, a method is described. The method is performed at a computer system in communication with a display generation component and one or more input devices. The method includes: displaying a media viewer user interface via the display generation component, the media viewer user interface including: a first portion, the first portion including a representation of a first previously captured media item; and a second portion, the second portion having a first visual appearance and different from the first portion of the media viewer user interface; while displaying the media viewer user interface including the second portion of the media viewer user interface having the first visual appearance via the display generation component, receiving a request to display a representation of a second previously captured media item different from the first previously captured media item; and in response to receiving a request to display a representation of the second previously captured media item: based on determining that a first set of criteria are met, wherein the first set of criteria include criteria that are met when the representation of the second previously captured media item is a high dynamic range (HDR) media item: displaying a representation of the second previously captured media item; and updating the second portion of the media viewer user interface to have a second visual appearance different from the first visual appearance.

[0015] According to some embodiments, a non-transitory computer-readable storage medium is described. The non-transitory computer-readable storage medium stores one or more programs configured to be executed by one or more processors of a computer system, wherein the computer system communicates with a display generation component and one or more input devices, and the one or more programs include instructions for the following operations: displaying a media viewer user interface via the display generation component, the media viewer user interface including: a first portion, the first portion including a representation of a first previously captured media item; and a second portion, the second portion having a first visual appearance and different from the first portion of the media viewer user interface; while displaying the media viewer user interface including the second portion of the media viewer user interface having the first visual appearance via the display generation component, receiving a request to display a representation of a second previously captured media item different from the first previously captured media item; and in response to receiving the request to display the representation of the second previously captured media item: based on determining that a first set of criteria are met, wherein the first set of criteria include criteria that are met when the representation of the second previously captured media item is a high dynamic range (HDR) media item: displaying the representation of the second previously captured media item; and updating the second portion of the media viewer user interface to have a second visual appearance different from the first visual appearance.

[0016] According to some embodiments, a transient computer-readable storage medium is described. The transient computer-readable storage medium stores one or more programs configured to be executed by one or more processors of a computer system, wherein the computer system communicates with a display generation component and one or more input devices, the one or more programs including instructions for the following operations: displaying a media viewer user interface via the display generation component, the media viewer user interface including: a first portion, the first portion including a representation of a first previously captured media item; and a second portion, the second portion having a first visual appearance and different from the first portion of the media viewer user interface; while displaying the media viewer user interface including the second portion of the media viewer user interface having the first visual appearance via the display generation component, receiving a request to display a representation of a second previously captured media item different from the first previously captured media item; and in response to receiving the request to display the representation of the second previously captured media item: based on determining that a first set of criteria are satisfied, wherein the first set of criteria include criteria satisfied when the representation of the second previously captured media item is a high dynamic range (HDR) media item: displaying the representation of the second previously captured media item; and updating the second portion of the media viewer user interface to have a second visual appearance different from the first visual appearance.

[0017] According to some embodiments, a computer system is described. The computer system includes: one or more processors, wherein the computer system communicates with a display generation component and one or more input devices; and a memory, the memory storing one or more programs configured to be executed by the one or more processors, the one or more programs including instructions for the following operations: displaying a media viewer user interface via the display generation component, the media viewer user interface including: a first portion, the first portion including a representation of a first previously captured media item; and a second portion, the second portion having a first visual appearance and different from the first portion of the media viewer user interface; while displaying the media viewer user interface including the second portion of the media viewer user interface having the first visual appearance via the display generation component, receiving a request to display a representation of a second previously captured media item different from the first previously captured media item; and in response to receiving the request to display the representation of the second previously captured media item: based on determining that a first set of criteria are met, wherein the first set of criteria include criteria that are met when the representation of the second previously captured media item is a high dynamic range (HDR) media item: displaying the representation of the second previously captured media item; and updating the second portion of the media viewer user interface to have a second visual appearance different from the first visual appearance.

[0018] According to some embodiments, a computer system is described. The computer system includes: means for displaying a media viewer user interface via a display generation component, the media viewer user interface including: a first portion, the first portion including a representation of a first previously captured media item; and a second portion, the second portion having a first visual appearance and being different from the first portion of the media viewer user interface; while displaying the media viewer user interface including the second portion of the media viewer user interface having the first visual appearance via the display generation component, means for receiving a request to display a representation of a second previously captured media item different from the first previously captured media item; and in response to receiving the request to display the representation of the second previously captured media item: based on determining that a first set of criteria is satisfied, wherein the first set of criteria includes criteria that are satisfied when the representation of the second previously captured media item is a high dynamic range (HDR) media item, means for the following operations: displaying the representation of the second previously captured media item; and updating the second portion of the media viewer user interface to have a second visual appearance different from the first visual appearance.

[0019] According to some embodiments, a method is described. The method is performed at a computer system having a first media capture device, wherein the computer system is in communication with a display generation component and one or more input devices. The method includes: receiving an indication that the first media capture device has been activated; and in response to receiving the indication that the first media capture device has been activated: based on determining that the first media capture device recorded a first type of data when activated, displaying a graphical indicator indicating the activation of the first media capture device via the display generation component; and based on determining that the first media capture device recorded a second type of data and did not record the first type of data when activated, forgoing displaying the graphical indicator indicating the activation of the first media capture device.

[0020] According to some embodiments, a non-transitory computer-readable storage medium is described. The non-transitory computer-readable storage medium stores one or more programs configured to be executed by one or more processors of a computer system having a first media capture device, wherein the computer system communicates with a display generation component and one or more input devices, and the one or more programs include instructions for the following operations: receiving an indication that the first media capture device has been activated; and in response to receiving the indication that the first media capture device has been activated: based on determining that the first media capture device recorded a first type of data when activated, displaying a graphical indicator indicating the activation of the first media capture device via the display generation component; and based on determining that the first media capture device recorded a second type of data when activated and did not record the first type of data, abandoning the display of the graphical indicator indicating the activation of the first media capture device.

[0021] According to some embodiments, a transient computer-readable storage medium is described. The transient computer-readable storage medium stores one or more programs configured to be executed by one or more processors of a computer system having a first media capture device, wherein the computer system communicates with a display generation component and one or more input devices, and the one or more programs include instructions for the following operations: receiving an indication that the first media capture device has been activated; and in response to receiving the indication that the first media capture device has been activated: based on determining that the first media capture device recorded a first type of data when activated, displaying a graphical indicator indicating the activation of the first media capture device via the display generation component; and based on determining that the first media capture device recorded a second type of data when activated and did not record the first type of data, abandoning the display of the graphical indicator indicating the activation of the first media capture device.

[0022] According to some embodiments, a computer system is described. The computer system includes: a first media capture device, wherein the computer system communicates with a display generation component and one or more input devices; one or more processors; a memory storing one or more programs configured to be executed by the one or more processors, the one or more programs including instructions for the following operations: receiving an indication that the first media capture device has been activated; and in response to receiving the indication that the first media capture device has been activated: based on determining that the first media capture device recorded a first type of data when activated, displaying a graphical indicator indicating the activation of the first media capture device via the display generation component; and based on determining that the first media capture device recorded a second type of data when activated and did not record the first type of data, forgoing displaying the graphical indicator indicating the activation of the first media capture device.

[0023] According to some embodiments, a computer system is described. The computer system includes: a first media capture device, means for receiving an indication that the first media capture device has been activated; and in response to receiving the indication that the first media capture device has been activated, means for: displaying a graphical indicator indicating activation of the first media capture device via a display generation component based on a determination that the first media capture device recorded a first type of data when activated; and forgoing displaying the graphical indicator indicating activation of the first media capture device based on a determination that the first media capture device recorded a second type of data and did not record the first type of data when activated.

[0024] Executable instructions for performing these functions are optionally included in a non-transitory computer-readable storage medium or other computer program product configured for execution by one or more processors. Executable instructions for performing these functions are optionally included in a transient computer-readable storage medium or other computer program product configured for execution by one or more processors.

[0025] Thus, devices are provided with faster, more efficient methods and interfaces for managing media, thereby increasing the effectiveness, efficiency, and user satisfaction of such devices.Such methods and interfaces may supplement or replace other methods for managing media. BRIEF DESCRIPTION OF THE DRAWINGS

[0026] For a better understanding of the various described embodiments, reference should be made to the following detailed description taken in conjunction with the following drawings, wherein like reference numerals designate corresponding parts throughout the several views.

[0027] Figure 1A is a block diagram showing a portable multifunction device with a touch-sensitive display according to some embodiments.

[0028] Figure 1B is a block diagram illustrating example components for event processing according to some embodiments.

[0029] Figure 2 A portable multifunction device with a touch screen according to some embodiments is shown.

[0030] Figure 3 is a block diagram of an exemplary multifunction device with a display and a touch-sensitive surface according to some embodiments.

[0031] Figure 4A An exemplary user interface for a menu of applications on a portable multifunction device is shown according to some embodiments.

[0032] Figure 4B An exemplary user interface is shown for a multifunction device having a touch-sensitive surface that is separate from the display according to some embodiments.

[0033] Figure 5A A personal electronic device according to some embodiments is shown.

[0034] Figure 5B is a block diagram illustrating a personal electronic device according to some embodiments.

[0035] Figures 6A to 6V An exemplary user interface for managing exposure compensation is shown according to some embodiments.

[0036] Figure 7is a flow chart illustrating an exemplary method for managing exposure compensation according to some embodiments.

[0037] FIG. 8A to FIG. 8L An exemplary user interface for displaying media according to some embodiments is shown.

[0038] Fig. 9 is a flowchart illustrating an exemplary method for displaying media according to some embodiments.

[0039] FIG. 10A to FIG. 10AC An exemplary user interface for displaying status indicators according to some embodiments is shown.

[0040] Fig.11 is a flowchart illustrating an exemplary method for displaying a status indicator according to some embodiments. DETAILED DESCRIPTION

[0041] The following description sets forth exemplary methods, parameters, etc. However, it should be appreciated that such description is not intended to limit the scope of the present disclosure, but is provided as a description of exemplary embodiments.

[0042] There is a need for electronic devices that provide efficient methods and interfaces for managing media, such as the methods described herein for capturing media, displaying media, and displaying indicators of media status using exposure compensation. Such techniques can reduce the cognitive burden on users managing media, thereby increasing productivity. In addition, such techniques can reduce processor power and battery power that would otherwise be wasted on redundant user input.

[0043] under Figure 1A to Figure 1B , Figure 2 , Figure 3 , FIG. 4A to FIG. 4B and FIG. 5A to FIG. 5B A description of an exemplary device for performing techniques for managing media is provided.

[0044] Figures 6A to 6V An exemplary user interface for managing exposure compensation is shown according to some embodiments. Figure 7 is a flow chart illustrating an exemplary method for managing exposure compensation according to some embodiments. Figures 6A to 6V The user interface in is used to show the following description including Figure 7 The process of the process.

[0045] FIG. 8A to FIG. 8L An exemplary user interface for displaying media according to some embodiments is shown. Fig. 9 is a flowchart illustrating an exemplary method for displaying media according to some embodiments. FIG. 8A to FIG. 8L The user interface in is used to show the following description including Fig. 9 The process of the process.

[0046] FIG. 10A to FIG. 10AC An exemplary user interface for displaying status indicators according to some embodiments is shown. Fig.11 is a flowchart illustrating an exemplary method for displaying a status indicator according to some embodiments. FIG. 10A to FIG. 10AC The user interface in is used to show the following description including Fig.11 The process of the process.

[0047] In addition, in the method described herein where one or more steps depend on one or more conditions being met, it should be understood that the method can be repeated in multiple repetitions so that in the process of repetition, all conditions for determining the steps in the method have been met in different repetitions of the method. For example, if the method needs to perform the first step (if the condition is met), and perform the second step (if the condition is not met), then the ordinary technician will know that the steps stated are repeated until both the condition is met and the condition is not met (in no particular order). Therefore, the method described as having one or more steps depending on one or more conditions being met can be rewritten as a method of repeating until each condition described in the method is met. However, this does not require the system or computer-readable medium to declare that the system or computer-readable medium contains instructions for performing a contingent operation based on the satisfaction of the corresponding one or more conditions, and is therefore able to determine whether the possible situation has been met without explicitly repeating the steps of the method until all conditions for determining the steps in the method have been met. It will also be understood by ordinary technicians in the art that, similar to the method with the contingent step, the system or computer-readable storage medium can repeat the steps of the method as many times as needed to ensure that all the contingent steps have been performed.

[0048] Although the following description uses the terms "first", "second", etc. to describe various elements, these elements should not be limited by the terms. These terms are only used to distinguish one element from another element. For example, a first touch can be named a second touch and similarly a second touch can be named a first touch without departing from the scope of the various described embodiments. Both the first touch and the second touch are touches, but they are not the same touch.

[0049] The terms used in the description of various described embodiments herein are only for the purpose of describing specific embodiments, and are not intended to be limited. As used in the description of various described embodiments and in the appended claims, the singular forms "one" and "the" are intended to also include plural forms, unless the context clearly indicates otherwise. It will also be understood that the term "and / or" used herein refers to and encompasses any and all possible combinations of one or more items in the associated listed items. It will also be understood that the term "includes", "including", "comprises" and / or "comprising" when used in this specification specifies the presence of stated features, integers, steps, operations, elements and / or parts, but does not exclude the presence or addition of one or more other features, integers, steps, operations, elements, parts and / or their grouping.

[0050] The term "if" is optionally interpreted to mean "when," "upon," or "in response to determining," or "in response to detecting," depending on the context. Similarly, the phrases "if it is determined that ..." or "if [a stated condition or event] is detected" are optionally interpreted to mean "upon determining that ..." or "in response to determining that ..." or "upon detecting [a stated condition or event]," or "in response to detecting [a stated condition or event]," depending on the context.

[0051] Embodiments of electronic devices, user interfaces for such devices, and associated processes for using such devices are described herein. In some embodiments, the device is a portable communication device, such as a mobile phone, that also includes other functions, such as a PDA and / or a music player function. Exemplary embodiments of portable multifunction devices include, but are not limited to, the Apple iPod from Apple Inc. (Cupertino, California). Devices, iPod Equipment, and Device. Optionally use other portable electronic devices, such as laptops or tablet computers with touch-sensitive surfaces (e.g., touch screen displays and / or touch pads). It should also be understood that in some embodiments, the device is not a portable communication device, but a desktop computer with a touch-sensitive surface (e.g., touch screen displays and / or touch pads). In some embodiments, the electronic device is a computer system that communicates with the display generation component (e.g., via wireless communication, via wired communication). The display generation component is configured to provide visual output, such as display via a CRT display, display via an LED display, or display via image projection. In some embodiments, the display generation component is integrated with the computer system. In some embodiments, the display generation component is separated from the computer system. As used herein, "display" content includes transmitting data (e.g., image data or video data) to an integrated or external display generation component via a wired or wireless connection to visually generate content to display content (e.g., video data rendered or decoded by display controller 156).

[0052] In the following discussion, an electronic device including a display and a touch-sensitive surface is described. However, it should be understood that the electronic device optionally includes one or more other physical user interface devices, such as a physical keyboard, mouse and / or joystick.

[0053] The device typically supports a variety of applications, such as one or more of the following: a drawing application, a presentation application, a word processing application, a website creation application, a disk editing application, a spreadsheet application, a gaming application, a telephony application, a video conferencing application, an email application, an instant messaging application, a fitness support application, a photo management application, a digital camera application, a digital video camera application, a web browsing application, a digital music player application, and / or a digital video player application.

[0054] Various applications executed on the device optionally use at least one common physical user interface device, such as a touch-sensitive surface. One or more functions of the touch-sensitive surface and corresponding information displayed on the device are optionally adjusted and / or varied for different applications, and / or adjusted and / or varied within the respective applications. In this way, the common physical architecture of the device (such as a touch-sensitive surface) optionally supports a variety of applications with a user interface that is intuitive and clear to the user.

[0055] Attention is now turned to embodiments of portable devices having touch-sensitive displays. Figure 1Ais a block diagram showing a portable multifunction device 100 with a touch-sensitive display system 112 according to some embodiments. The touch-sensitive display 112 is sometimes referred to as a "touch screen" for convenience, and is sometimes referred to as or referred to as a "touch-sensitive display system." The device 100 includes a memory 102 (which optionally includes one or more computer-readable storage media), a memory controller 122, one or more processing units (CPUs) 120, a peripheral device interface 118, an RF circuit 108, an audio circuit 110, a speaker 111, a microphone 113, an input / output (I / O) subsystem 106, other input control devices 116, and an external port 124. The device 100 optionally includes one or more optical sensors 164. The device 100 optionally includes one or more contact force sensors 165 for detecting the intensity of contact on the device 100 (e.g., a touch-sensitive surface, such as the touch-sensitive display system 112 of the device 100). Device 100 optionally includes one or more tactile output generators 167 for generating tactile output on device 100 (e.g., generating tactile output on a touch-sensitive surface such as touch-sensitive display system 112 of device 100 or touch pad 355 of device 300). These components optionally communicate via one or more communication buses or signal lines 103.

[0056] As used in this specification and claims, the term "intensity" of a contact on a touch-sensitive surface refers to the force or pressure (force per unit area) of a contact (e.g., a finger contact) on the touch-sensitive surface, or to a surrogate (surrogate) of the force or pressure of a contact on the touch-sensitive surface. The intensity of a contact has a range of values ​​that includes at least four different values ​​and more typically includes hundreds of different values ​​(e.g., at least 256). The intensity of a contact is optionally determined (or measured) using various methods and various sensors or combinations of sensors. For example, one or more force sensors below or adjacent to the touch-sensitive surface are optionally used to measure the force at different points on the touch-sensitive surface. In some implementations, force measurements from multiple force sensors are combined (e.g., weighted averaged) to determine an estimated contact force. Similarly, the pressure-sensitive tip of a stylus is optionally used to determine the pressure of the stylus on the touch-sensitive surface. Alternatively, the size of the contact area detected on the touch-sensitive surface and / or its change, the capacitance of the touch-sensitive surface near the contact and / or its change, and / or the resistance of the touch-sensitive surface near the contact and / or its change are optionally used as a substitute for the force or pressure of the contact on the touch-sensitive surface. In some embodiments, the substitute measurement of the contact force or pressure is used directly to determine whether the intensity threshold has been exceeded (e.g., the intensity threshold is described in units corresponding to the substitute measurement). In some embodiments, the substitute measurement of the contact force or pressure is converted into an estimated force or pressure, and the estimated force or pressure is used to determine whether the intensity threshold has been exceeded (e.g., the intensity threshold is a pressure threshold measured in units of pressure). Using the intensity of the contact as an attribute of the user input allows the user to access additional device functions that would otherwise be inaccessible to the user on a smaller device with limited real estate, which is used to display an enable indication (e.g., on a touch-sensitive display) and / or receive user input (e.g., via a touch-sensitive display, a touch-sensitive surface, or a physical control / mechanical control, such as a knob or button).

[0057] As used in this specification and claims, the term "tactile output" refers to a physical displacement of a device relative to a previous position of the device, a physical displacement of a component of the device (e.g., a touch-sensitive surface) relative to another component of the device (e.g., a housing), or a displacement of a component relative to the center of mass of the device, which will be detected by a user using the user's sense of touch. For example, in the case where a device or a component of the device is in contact with a user's touch-sensitive surface (e.g., a finger, palm, or other part of the user's hand), the tactile output generated by the physical displacement will be interpreted by the user as a tactile sensation corresponding to a perceived change in a physical characteristic of the device or component of the device. For example, movement of a touch-sensitive surface (e.g., a touch-sensitive display or trackpad) is optionally interpreted by the user as a "press click" or "release click" to a physical actuation button. In some cases, the user will feel a tactile sensation, such as a "press click" or "release click", even when the physical actuation button associated with the touch-sensitive surface that is physically pressed (e.g., displaced) by the user's movement does not move. As another example, even when there is no change in the smoothness of the touch-sensitive surface, movement of the touch-sensitive surface may optionally be interpreted or sensed by the user as "roughness" of the touch-sensitive surface. Although such a user's interpretation of touch will be limited by the user's individualized sensory perceptions, many sensory perceptions of touch are common to most users. Thus, when a tactile output is described as corresponding to a particular sensory perception of a user (e.g., "press click," "release click," "roughness"), unless otherwise stated, the generated tactile output corresponds to a physical displacement of the device or a component thereof that would generate that sensory perception for a typical (or average) user.

[0058] It should be understood that device 100 is merely one example of a portable multifunction device, and that device 100 optionally has more or fewer components than shown, optionally combines two or more components, or optionally has a different configuration or arrangement of the components. Figure 1A The various components shown in the EMBODIMENTS 2000 are implemented in hardware, software, or a combination of hardware and software, including one or more signal processing and / or application specific integrated circuits.

[0059] Memory 102 optionally includes high-speed random access memory, and optionally also includes non-volatile memory, such as one or more disk storage devices, flash memory devices, or other non-volatile solid-state memory devices. Memory controller 122 optionally controls other components of device 100 to access memory 102.

[0060] The peripheral device interface 118 can be used to couple the input peripheral devices and output peripheral devices of the device to the CPU 120 and the memory 102. The one or more processors 120 run or execute various software programs (such as computer programs (e.g., including instructions)) and / or instruction sets stored in the memory 102 to perform various functions of the device 100 and process data. In some embodiments, the peripheral device interface 118, the CPU 120, and the memory controller 122 are optionally implemented on a single chip such as the chip 104. In some other embodiments, they are optionally implemented on separate chips.

[0061] RF (radio frequency) circuit 108 receives and sends RF signals, also referred to as electromagnetic signals. RF circuit 108 converts electrical signals into / converts electromagnetic signals into electrical signals, and communicates with communication networks and other communication devices via electromagnetic signals. RF circuit 108 optionally includes well-known circuits for performing these functions, including but not limited to antenna systems, RF transceivers, one or more amplifiers, tuners, one or more oscillators, digital signal processors, codec chipsets, user identity modules (SIM) cards, memories, and the like. RF circuit 108 optionally communicates with networks and other devices via wireless communications, such as the Internet (also referred to as the World Wide Web (WWW)), intranets, and / or wireless networks (such as cellular telephone networks, wireless local area networks (LANs), and / or metropolitan area networks (MANs)). RF circuit 108 optionally includes well-known circuits for detecting near field communications (NFC) fields, such as through short-range communications radio components. Wireless communication optionally uses any of a variety of communication standards, protocols and technologies, including, but not limited to, Global System for Mobile Communications (GSM), Enhanced Data GSM Environment (EDGE), High Speed ​​Downlink Packet Access (HSDPA), High Speed ​​Uplink Packet Access (HSUPA), Evolution, Data-Only (EV-DO), HSPA, HSPA+, Dual Cell HSPA (DC-HSPDA), Long Term Evolution (LTE), Near Field Communication (NFC), Wideband Code Division Multiple Access (W-CDMA), Code Division Multiple Access (CDMA), Time Division Multiple Access (TDMA), Bluetooth, Bluetooth Low Energy (BTLE), Wireless Fidelity (Wi-Fi) (e.g., IEEE 802.11a, IEEE 802.11b, IEEE 802.11g, IEEE 802.11d), IEEE 802.11e, IEEE 802.11f, IEEE 802.11g, IEEE 802.11g). 802.11n and / or IEEE 802.11ac), Voice over Internet Protocol (VoIP), Wi-MAX, email protocols (e.g., Internet Message Access Protocol (IMAP) and / or Post Office Protocol (POP)), instant messaging (e.g., Extensible Messaging and Presence Protocol (XMPP), Session Initiation Protocol for Instant Messaging and Presence Utilizing Extensions (SIMPLE), Instant Messaging and Presence Service (IMPS)), and / or Short Message Service (SMS), or any other suitable communication protocol including communication protocols that have not been developed as of the filing date of this document.

[0062] The audio circuit 110, speaker 111, and microphone 113 provide an audio interface between a user and the device 100. The audio circuit 110 receives audio data from the peripheral device interface 118, converts the audio data into electrical signals, and transmits the electrical signals to the speaker 111. The speaker 111 converts the electrical signals into sound waves audible to humans. The audio circuit 110 also receives electrical signals converted from sound waves by the microphone 113. The audio circuit 110 converts the electrical signals into audio data and transmits the audio data to the peripheral device interface 118 for processing. The audio data is optionally retrieved from and / or transmitted to the memory 102 and / or the RF circuit 108 by the peripheral device interface 118. In some embodiments, the audio circuit 110 also includes a headset jack (e.g., Figure 2 The headset jack provides an interface between the audio circuit 110 and a removable audio input / output peripheral device, such as an output-only headset or a headset having both output (e.g., a single or dual-ear headset) and input (e.g., a microphone).

[0063] The I / O subsystem 106 couples input / output peripherals on the device 100, such as a touch screen 112 and other input control devices 116, to a peripheral device interface 118. The I / O subsystem 106 optionally includes a display controller 156, an optical sensor controller 158, a depth camera controller 169, an intensity sensor controller 159, a tactile feedback controller 161, and one or more input controllers 160 for other input or control devices. The one or more input controllers 160 receive / send electrical signals from other input control devices 116. The other input control devices 116 optionally include physical buttons (e.g., push buttons, rocker buttons, etc.), dials, slide switches, joysticks, click wheels, etc. In some embodiments, the input controller 160 is optionally coupled to any of the following (or none of the following): a keyboard, an infrared port, a USB port, and a pointing device such as a mouse. One or more buttons (e.g., Figure 2 208) optionally includes an increase / decrease button for volume control of the speaker 111 and / or the microphone 113. The one or more buttons optionally include a push button (e.g., Figure 2206 in). In some embodiments, the electronic device is a computer system that communicates with one or more input devices (e.g., via wireless communication, via wired communication). In some embodiments, the one or more input devices include a touch-sensitive surface (e.g., a touchpad as part of a touch-sensitive display). In some embodiments, the one or more input devices include one or more camera sensors (e.g., one or more optical sensors 164 and / or one or more depth camera sensors 175), such as for tracking a user's gestures (e.g., hand gestures) as input. In some embodiments, the one or more input devices are integrated with the computer system. In some embodiments, the one or more input devices are separate from the computer system.

[0064] A quick press of the push button optionally disengages the lock of the touch screen 112 or optionally begins the process of unlocking the device using gestures on the touch screen, as described in U.S. Patent Application 11 / 322,549, filed on December 23, 2005, entitled "Unlocking a Device by Performing Gestures on an Unlock Image" (i.e., U.S. Patent No. 7,657,849), which is hereby incorporated by reference in its entirety. A long press of the push button (e.g., 206) optionally turns the device 100 on or off. The functions of one or more buttons are optionally user-customizable. The touch screen 112 is used to implement virtual buttons or soft buttons and one or more soft keyboards.

[0065] The touch-sensitive display 112 provides an input interface and an output interface between the device and the user. The display controller 156 receives electrical signals from the touch screen 112 and / or sends electrical signals to the touch screen 112. The touch screen 112 displays visual output to the user. The visual output optionally includes graphics, text, icons, videos, and any combination thereof (collectively referred to as "graphics"). In some embodiments, some or all of the visual output optionally corresponds to user interface objects.

[0066] The touch screen 112 has a touch-sensitive surface, sensor, or sensor group that accepts input from a user based on tactile and / or haptic contact. The touch screen 112 and display controller 156 (together with any associated modules and / or instruction sets in memory 102) detect contact on the touch screen 112 (and any movement or interruption of the contact) and convert the detected contact into interaction with a user interface object (e.g., one or more soft keys, icons, web pages, or images) displayed on the touch screen 112. In an exemplary embodiment, the point of contact between the touch screen 112 and the user corresponds to a finger of the user.

[0067] The touch screen 112 optionally uses LCD (liquid crystal display) technology, LPD (light emitting polymer display) technology, or LED (light emitting diode) technology, although other display technologies are used in other embodiments. The touch screen 112 and display controller 156 optionally use any of a variety of touch sensing technologies now known or later developed, including but not limited to capacitive, resistive, infrared, and surface acoustic wave technologies, as well as other proximity sensor arrays or other elements for determining one or more points of contact with the touch screen 112 to detect contact and any movement or interruption thereof. In an exemplary embodiment, projected mutual capacitance sensing technology is used, such as in the Apple ® from Apple Inc. (Cupertino, California). and iPod The technology used in.

[0068] The touch-sensitive display in some embodiments of the touch screen 112 is optionally similar to the multi-touch-sensitive touch pad described in the following U.S. Patents: 6,323,846 (Westerman et al.), 6,570,557 (Westerman et al.), and / or 6,677,932 (Westerman et al.), and / or U.S. Patent Publication 2002 / 0015024A1, each of which is hereby incorporated by reference in its entirety. However, the touch screen 112 displays visual output from the device 100, while the touch-sensitive touch pad does not provide visual output.

[0069] In some embodiments, the touch-sensitive display of the touch screen 112 is as described in the following patent applications: (1) U.S. patent application No. 11 / 381,313, entitled “Multipoint Touch Surface Controller,” filed on May 2, 2006; (2) U.S. patent application No. 10 / 840,862, entitled “Multipoint Touchscreen,” filed on May 6, 2004; (3) U.S. patent application No. 10 / 903,964, entitled “Gestures For Touch Sensitive Input Devices,” filed on July 30, 2004; (4) U.S. patent application No. 11 / 048,264, entitled “Gestures For Touch Sensitive Input Devices,” filed on January 31, 2005; (5) U.S. patent application No. 11 / 086,874, entitled “Mode-Based Graphical User Interfaces For Touch Sensitive Input Devices,” filed on January 18, 2005 and (9) U.S. patent application No. 11 / 367,749, filed on March 3, 2006, entitled “Multi-Functional Hand-Held Device.” All of these applications are hereby incorporated by reference in their entirety.

[0070] The touch screen 112 optionally has a video resolution of more than 100 dpi. In some embodiments, the touch screen has a video resolution of about 160 dpi. The user optionally uses any suitable object or attachment such as a stylus, finger, etc. to contact the touch screen 112. In some embodiments, the user interface is designed to work primarily through finger-based contacts and gestures, which may not be as precise as stylus-based input due to the larger contact area of ​​the finger on the touch screen. In some embodiments, the device converts rough finger-based input into precise pointer / cursor positions or commands for performing the actions desired by the user.

[0071] In some embodiments, in addition to the touch screen, the device 100 optionally includes a touchpad for activating or deactivating specific functions. In some embodiments, the touchpad is a touch-sensitive area of ​​the device that, unlike the touch screen, does not display visual output. The touchpad is optionally a touch-sensitive surface that is separate from the touch screen 112 or an extension of the touch-sensitive surface formed by the touch screen.

[0072] The device 100 also includes a power system 162 for powering the various components. The power system 162 optionally includes a power management system, one or more power sources (e.g., batteries, alternating current (AC)), a recharging system, a power fault detection circuit, a power converter or inverter, a power status indicator (e.g., a light emitting diode (LED)), and any other components associated with the generation, management, and distribution of power in a portable device.

[0073] Device 100 optionally also includes one or more optical sensors 164 . Figure 1AAn optical sensor coupled to an optical sensor controller 158 in the I / O subsystem 106 is shown. The optical sensor 164 optionally includes a charge coupled device (CCD) or a complementary metal oxide semiconductor (CMOS) phototransistor. The optical sensor 164 receives light projected through one or more lenses from the environment and converts the light into data representing an image. In conjunction with the imaging module 143 (also called a camera module), the optical sensor 164 optionally captures a static image or video. In some embodiments, the optical sensor is located on the rear of the device 100, opposite to the touch screen display 112 on the front of the device, so that the touch screen display can be used as a viewfinder for static images and / or video image acquisition. In some embodiments, the optical sensor is located on the front of the device so that the user's image is optionally obtained for video conferencing while the user views other video conference participants on the touch screen display. In some embodiments, the position of the optical sensor 164 can be changed by the user (e.g., by rotating the lens and sensor in the device housing) so that a single optical sensor 164 is used with the touch screen display for both video conferencing and static image and / or video image acquisition.

[0074] Device 100 optionally also includes one or more depth camera sensors 175 . Figure 1A A depth camera sensor coupled to a depth camera controller 169 in the I / O subsystem 106 is shown. The depth camera sensor 175 receives data from the environment to create a three-dimensional model of an object (e.g., a face) within the scene from a viewpoint (e.g., a depth camera sensor). In some embodiments, in conjunction with the imaging module 143 (also referred to as a camera module), the depth camera sensor 175 is optionally used to determine a depth map of different portions of an image captured by the imaging module 143. In some embodiments, the depth camera sensor is located at the front of the device 100, so that an image of the user with depth information is optionally obtained for video conferencing while the user is viewing other video conference participants on the touch screen display, and a selfie with depth map data is captured. In some embodiments, the depth camera sensor 175 is located at the rear of the device, or at both the rear and front of the device 100. In some embodiments, the position of the depth camera sensor 175 can be changed by the user (e.g., by rotating the lens and sensor in the device housing) so that the depth camera sensor 175 is used with the touch screen display for both video conferencing and still image and / or video image acquisition.

[0075] In some embodiments, a depth map (e.g., a depth map image) contains information (e.g., values) related to the distance of an object in a scene from a viewpoint (e.g., a camera, an optical sensor, a depth camera sensor). In one embodiment of a depth map, each depth pixel defines the position of its corresponding two-dimensional pixel in the Z axis of the viewpoint. In some embodiments, a depth map consists of pixels, each of which is defined by a value (e.g., 0 to 255). For example, a "0" value represents a pixel located farthest from a viewpoint (e.g., a camera, an optical sensor, a depth camera sensor) in a "three-dimensional" scene, and a "255" value represents a pixel located closest to the viewpoint in a "three-dimensional" scene. In other embodiments, a depth map represents the distance between an object in a scene and the plane of the viewpoint. In some embodiments, a depth map includes information about the relative depths of various features of an object of interest in the field of view of a depth camera (e.g., the relative depths of the eyes, nose, mouth, and ears of a user's face). In some embodiments, a depth map includes information that enables a device to determine the contour of an object of interest in the z direction.

[0076] Device 100 optionally also includes one or more contact intensity sensors 165 . Figure 1A A contact force sensor is shown coupled to a force sensor controller 159 in the I / O subsystem 106. Contact force sensor 165 optionally includes one or more piezoresistive strain gauges, capacitive force sensors, electrical force sensors, piezoelectric force sensors, optical force sensors, capacitive touch-sensitive surfaces, or other force sensors (e.g., sensors for measuring the force (or pressure) of contact on a touch-sensitive surface). Contact force sensor 165 receives contact force information (e.g., pressure information or a surrogate for pressure information) from the environment. In some embodiments, at least one contact force sensor is juxtaposed or adjacent to a touch-sensitive surface (e.g., touch-sensitive display system 112). In some embodiments, at least one contact force sensor is located on the back of device 100, opposite to touch screen display 112 located on the front of device 100.

[0077] Device 100 optionally also includes one or more proximity sensors 166 . Figure 1AA proximity sensor 166 is shown coupled to the peripherals interface 118. Alternatively, the proximity sensor 166 is optionally coupled to the input controller 160 in the I / O subsystem 106. The proximity sensor 166 is optionally implemented as described in the following U.S. patent applications: No. 11 / 241,839, entitled "Proximity Detector In Handheld Device"; No. 11 / 240,788, entitled "Proximity Detector In Handheld Device"; No. 11 / 620,702, entitled "Using Ambient Light Sensor To Augment Proximity Sensor Output"; No. 11 / 586,862, entitled "Automated Response To And Sensing Of "User Activity In Portable Devices"; and No. 11 / 638,251, entitled "Methods And Systems For Automatic Configuration Of Peripherals", which are hereby incorporated by reference in their entirety. In some embodiments, when the multifunction device is placed near the user's ear (e.g., when the user is making a phone call), the proximity sensor is turned off and the touch screen 112 is disabled.

[0078] Device 100 optionally also includes one or more tactile output generators 167 . Figure 1AA tactile output generator is shown coupled to a tactile feedback controller 161 in the I / O subsystem 106. The tactile output generator 167 optionally includes one or more electroacoustic devices such as a speaker or other audio component; and / or an electromechanical device for converting energy into linear motion such as a motor, solenoid, electroactive polymer, piezoelectric actuator, electrostatic actuator, or other tactile output generating component (e.g., a component for converting an electrical signal into a tactile output on the device). The contact force sensor 165 receives tactile feedback generation instructions from the tactile feedback module 133 and generates a tactile output on the device 100 that can be felt by a user of the device 100. In some embodiments, at least one tactile output generator is arranged in parallel or adjacent to a touch-sensitive surface (e.g., a touch-sensitive display system 112) and optionally generates a tactile output by moving the touch-sensitive surface vertically (e.g., inward / outward of the surface of the device 100) or laterally (e.g., backward and forward in the same plane as the surface of the device 100). In some embodiments, at least one tactile output generator sensor is located on the back of the device 100, opposite the touch screen display 112 located on the front of the device 100.

[0079] Device 100 optionally also includes one or more accelerometers 168 . Figure 1A An accelerometer 168 coupled to the peripheral device interface 118 is shown. Alternatively, the accelerometer 168 is optionally coupled to the input controller 160 in the I / O subsystem 106. The accelerometer 168 is optionally implemented as described in the following U.S. patent publications: U.S. Patent Publication No. 20050190059, entitled "Acceleration-based Theft Detection System for Portable Electronic Devices" and U.S. Patent Publication No. 20060017692, entitled "Methods And Apparatuses For Operating A Portable Device Based On An Accelerometer", both of which are incorporated herein by reference in their entirety. In some embodiments, information is displayed in a portrait view or a landscape view on a touch screen display based on analysis of data received from one or more accelerometers. The device 100 optionally includes a magnetometer and a GPS (or GLONASS or other global navigation system) receiver in addition to the accelerometer 168 for obtaining information about the position and orientation (e.g., portrait or landscape) of the device 100.

[0080] In some embodiments, the software components stored in memory 102 include an operating system 126, a communication module (or instruction set) 128, a contact / motion module (or instruction set) 130, a graphics module (or instruction set) 132, a text input module (or instruction set) 134, a global positioning system (GPS) module (or instruction set) 135, and an application (or instruction set) 136. In addition, in some embodiments, memory 102 ( Figure 1A ) or 370( Figure 3 ) storage device / global internal state 157, such as Figure 1A and Figure 3 . The device / global internal state 157 includes one or more of the following: an active application state, which indicates which applications (if any) are currently active; a display state, which indicates what applications, views, or other information occupy various areas of the touch screen display 112; a sensor state, including information obtained from the device's various sensors and input control devices 116; and position information about the device's position and / or posture.

[0081] The operating system 126 (e.g., Darwin, RTXC, LINUX, UNIX, OS X, iOS, WINDOWS, or an embedded operating system such as VxWorks) includes various software components and / or drivers for controlling and managing general system tasks (e.g., memory management, storage device control, power management, etc.), and facilitating communication between various hardware components and software components.

[0082] The communication module 128 facilitates communication with other devices through one or more external ports 124, and also includes various software components for processing data received by the RF circuit 108 and / or the external port 124. The external port 124 (e.g., Universal Serial Bus (USB), FireWire, etc.) is suitable for coupling directly to other devices, or indirectly through a network (e.g., the Internet, wireless LAN, etc.). In some embodiments, the external port is connected to (trademark of Apple Inc.) devices.

[0083] The contact / motion module 130 optionally detects contact with the touch screen 112 (in conjunction with the display controller 156) and other touch-sensitive devices (e.g., a touchpad or physical click wheel). The contact / motion module 130 includes various software components for performing various operations related to contact detection, such as determining whether contact has occurred (e.g., detecting a finger press event), determining the contact strength (e.g., the force or pressure of the contact, or a substitute for the force or pressure of the contact), determining whether there is movement of the contact and tracking the movement on the touch-sensitive surface (e.g., detecting one or more finger drag events), and determining whether the contact has stopped (e.g., detecting a finger lift event or contact disconnection). The contact / motion module 130 receives contact data from the touch-sensitive surface. Determining the movement of the contact point optionally includes determining the rate (magnitude), velocity (magnitude and direction), and / or acceleration (change in magnitude and / or direction) of the contact point, the movement of the contact point being represented by a series of contact data. These operations are optionally applied to a single point of contact (e.g., a single finger contact) or multiple points of simultaneous contact (e.g., "multi-touch" / multiple finger contacts). In some embodiments, the contact / motion module 130 and display controller 156 detect contact on a touch pad.

[0084] In some embodiments, the contact / motion module 130 uses a set of one or more intensity thresholds to determine whether an operation has been performed by a user (e.g., to determine whether a user has "clicked" an icon). In some embodiments, at least a subset of the intensity thresholds are determined based on software parameters (e.g., the intensity thresholds are not determined by the activation thresholds of specific physical actuators and can be adjusted without changing the physical hardware of the device 100). For example, without changing the touchpad or touchscreen display hardware, the mouse "click" threshold of a touchpad or touchscreen can be set to any one of a large range of predefined thresholds. In addition, in some specific implementations, a software setting is provided to the user of the device for adjusting one or more intensity thresholds in a set of intensity thresholds (e.g., by adjusting individual intensity thresholds and / or by utilizing a system-level click on an "intensity" parameter to adjust multiple intensity thresholds at once).

[0085] The contact / motion module 130 optionally detects gesture input by the user. Different gestures on the touch-sensitive surface have different contact patterns (e.g., different motions, timings, and / or intensities of the detected contacts). Therefore, gestures are optionally detected by detecting specific contact patterns. For example, detecting a finger tap gesture includes detecting a finger press event, and then detecting a finger lift (lift-off) event at the same location (or substantially the same location) as the finger press event (e.g., at the location of an icon). As another example, detecting a finger swipe gesture on the touch-sensitive surface includes detecting a finger press event, then detecting one or more finger drag events, and then detecting a finger lift (lift-off) event.

[0086] The graphics module 132 includes various known software components for rendering and displaying graphics on the touch screen 112 or other display, including components for changing the visual impact (e.g., brightness, transparency, saturation, contrast, or other visual attributes) of the displayed graphics. As used herein, the term "graphics" includes any object that can be displayed to a user, including, but not limited to, text, web pages, icons (such as user interface objects including soft keys), digital images, videos, animations, etc.

[0087] In some embodiments, the graphics module 132 stores data representing graphics to be used. Each graphic is optionally assigned a corresponding code. The graphics module 132 receives one or more codes for specifying the graphics to be displayed from an application program, etc., and also receives coordinate data and other graphic attribute data together if necessary, and then generates screen image data to be output to the display controller 156.

[0088] Haptic feedback module 133 includes various software components for generating instructions used by tactile output generator 167 to produce tactile output at one or more locations on device 100 in response to user interaction with device 100 .

[0089] Text input module 134, which is optionally a component of graphics module 132, provides a soft keyboard for entering text in various applications (e.g., contacts 137, email 140, IM 141, browser 147, and any other application requiring text input).

[0090] The GPS module 135 determines the location of the device and provides this information for use in various applications (e.g., to the phone 138 for use in location-based dialing; to the camera 143 as picture / video metadata; and to applications that provide location-based services, such as the Weather widget, the Local Pages widget, and the Maps / Navigation widget).

[0091] The application 136 optionally includes the following modules (or instruction sets) or a subset or superset thereof:

[0092] Contacts module 137 (sometimes called address book or contact list);

[0093] Telephone module 138;

[0094] Video conferencing module 139;

[0095] Email client module 140;

[0096] Instant messaging (IM) module 141;

[0097] Fitness support module 142;

[0098] A camera module 143 for still images and / or video images;

[0099] Image management module 144;

[0100] Video player module;

[0101] Music player module;

[0102] Browser module 147;

[0103] Calendar module 148;

[0104] A widget module 149, which optionally includes one or more of the following: a weather widget 149-1, a stock widget 149-2, a calculator widget 149-3, an alarm widget 149-4, a dictionary widget 149-5, and other widgets obtained by the user, and a user-created widget 149-6;

[0105] A widget creator module 150 for forming a user-created widget 149-6;

[0106] Search module 151;

[0107] Video and music player module 152, which combines the video player module and the music player module;

[0108] Memo module 153;

[0109] Map module 154; and / or

[0110] Online video module 155.

[0111] Examples of other applications 136 optionally stored in memory 102 include other word processing applications, other image editing applications, drawing applications, rendering applications, JAVA-enabled applications, encryption, digital rights management, voice recognition, and voice replication.

[0112] In conjunction with the touch screen 112, display controller 156, touch / motion module 130, graphics module 132, and text input module 134, the contact module 137 is optionally used to manage an address book or contact list (e.g., stored in the application internal state 192 of the contact module 137 in memory 102 or memory 370), including: adding one or more names to the address book; deleting names from the address book; associating phone numbers, email addresses, physical addresses, or other information with names; associating images with names; categorizing and classifying names; providing phone numbers or email addresses to initiate and / or facilitate communications via telephone 138, video conferencing module 139, email 140, or IM 141; and the like.

[0113] In conjunction with RF circuitry 108, audio circuitry 110, speaker 111, microphone 113, touch screen 112, display controller 156, contact / motion module 130, graphics module 132, and text input module 134, phone module 138 is optionally used to enter a sequence of characters corresponding to a phone number, access one or more phone numbers in contact module 137, modify an entered phone number, dial a corresponding phone number, conduct a conversation, and disconnect or hang up when the conversation is complete. As described above, wireless communication optionally uses any of a variety of communication standards, protocols, and technologies.

[0114] In combination with the RF circuit 108, the audio circuit 110, the speaker 111, the microphone 113, the touch screen 112, the display controller 156, the optical sensor 164, the optical sensor controller 158, the contact / motion module 130, the graphics module 132, the text input module 134, the contact module 137 and the telephone module 138, the video conferencing module 139 includes executable instructions for initiating, conducting and terminating a video conference between a user and one or more other participants in accordance with user instructions.

[0115] In conjunction with RF circuit 108, touch screen 112, display controller 156, contact / motion module 130, graphics module 132, and text input module 134, email client module 140 includes executable instructions for creating, sending, receiving, and managing emails in response to user instructions. In conjunction with image management module 144, email client module 140 makes it very easy to create and send emails with still images or video images captured by camera module 143.

[0116] In conjunction with RF circuit 108, touch screen 112, display controller 156, contact / motion module 130, graphics module 132, and text input module 134, instant messaging module 141 includes executable instructions for the following operations: inputting a character sequence corresponding to an instant message, modifying previously input characters, transmitting a corresponding instant message (e.g., using a short message service (SMS) or multimedia message service (MMS) protocol for phone-based instant messaging or using XMPP, SIMPLE, or IMPS for Internet-based instant messaging), receiving instant messages, and viewing received instant messages. In some embodiments, the transmitted and / or received instant messages optionally include graphics, photos, audio files, video files, and / or other attachments supported in MMS and / or enhanced messaging services (EMS). As used herein, "instant messaging" refers to both phone-based messages (e.g., messages sent using SMS or MMS) and Internet-based messages (e.g., messages sent using XMPP, SIMPLE, or IMPS).

[0117] In combination with the RF circuit 108, the touch screen 112, the display controller 156, the contact / motion module 130, the graphics module 132, the text input module 134, the GPS module 135, the map module 154 and the music player module, the fitness support module 142 includes executable instructions for creating a fitness (e.g., with time, distance and / or calorie burn goals); communicating with fitness sensors (sports equipment); receiving fitness sensor data; calibrating sensors for monitoring fitness; selecting and playing music for fitness; and displaying, storing and transmitting fitness data.

[0118] In conjunction with the touch screen 112, display controller 156, optical sensor 164, optical sensor controller 158, contact / motion module 130, graphics module 132 and image management module 144, the camera module 143 includes executable instructions for the following operations: capturing still images or videos (including video streams) and storing them in the memory 102, modifying the characteristics of the still images or videos, or deleting the still images or videos from the memory 102.

[0119] In conjunction with touch screen 112, display controller 156, touch / motion module 130, graphics module 132, text input module 134, and camera module 143, image management module 144 includes executable instructions for arranging, modifying (e.g., editing), or otherwise manipulating, labeling, deleting, presenting (e.g., in a digital slideshow or album), and storing still images and / or video images.

[0120] In combination with the RF circuit 108, the touch screen 112, the display controller 156, the touch / motion module 130, the graphics module 132 and the text input module 134, the browser module 147 includes executable instructions for browsing the Internet in accordance with user instructions, including searching, linking to, receiving and displaying web pages or portions thereof, as well as attachments and other files linked to web pages.

[0121] In combination with the RF circuit 108, the touch screen 112, the display controller 156, the touch / motion module 130, the graphics module 132, the text input module 134, the email client module 140 and the browser module 147, the calendar module 148 includes executable instructions for creating, displaying, modifying and storing calendars and data associated with the calendar (e.g., calendar entries, to-do items, etc.) in accordance with user instructions.

[0122] In conjunction with the RF circuit 108, the touch screen 112, the display controller 156, the contact / motion module 130, the graphics module 132, the text input module 134, and the browser module 147, the desktop widget module 149 is a mini-application that is optionally downloaded and used by the user (e.g., the weather desktop widget 149-1, the stock desktop widget 149-2, the calculator desktop widget 149-3, the alarm desktop widget 149-4, and the dictionary desktop widget 149-5) or a mini-application created by the user (e.g., the user-created desktop widget 149-6). In some embodiments, the desktop widget includes an HTML (Hypertext Markup Language) file, a CSS (Cascading Style Sheets) file, and a JavaScript file. In some embodiments, the desktop widget includes an XML (Extensible Markup Language) file and a JavaScript file (e.g., the Yahoo! desktop widget).

[0123] In combination with the RF circuit 108, touch screen 112, display controller 156, touch / motion module 130, graphics module 132, text input module 134 and browser module 147, the desktop widget creator module 150 is optionally used by a user to create a desktop widget (e.g., converting a user-specified portion of a web page into a desktop widget).

[0124] In combination with the touch screen 112, display controller 156, contact / motion module 130, graphics module 132 and text input module 134, the search module 151 includes executable instructions for searching the memory 102 for text, music, sound, images, videos and / or other files that match one or more search criteria (e.g., one or more user-specified search terms) in accordance with user instructions.

[0125] In conjunction with touch screen 112, display controller 156, contact / motion module 130, graphics module 132, audio circuitry 110, speaker 111, RF circuitry 108, and browser module 147, video and music player module 152 includes executable instructions that allow a user to download and play back recorded music and other sound files stored in one or more file formats, such as MP3 or AAC files, and executable instructions for displaying, presenting, or otherwise playing back video (e.g., on touch screen 112 or on an external display connected via external port 124). In some embodiments, device 100 optionally includes the functionality of an MP3 player, such as an iPod (trademark of Apple Inc.).

[0126] In conjunction with the touch screen 112, the display controller 156, the contact / motion module 130, the graphic module 132, and the text input module 134, the memo module 153 includes executable instructions for creating and managing memos, to-do items, etc. according to user instructions.

[0127] In combination with the RF circuit 108, the touch screen 112, the display controller 156, the touch / motion module 130, the graphics module 132, the text input module 134, the GPS module 135 and the browser module 147, the map module 154 is optionally used to receive, display, modify and store maps and data associated with the maps (e.g., driving directions, data relating to stores and other points of interest at or near a particular location, and other location-based data) in accordance with user instructions.

[0128] In conjunction with touch screen 112, display controller 156, contact / motion module 130, graphics module 132, audio circuit 110, speaker 111, RF circuit 108, text input module 134, email client module 140, and browser module 147, online video module 155 includes instructions for performing the following operations: allowing a user to access, browse, receive (e.g., by streaming and / or downloading), playback (e.g., on the touch screen or on an external display connected via external port 124), send an email with a link to a specific online video, and otherwise manage online videos in one or more file formats such as H.264. In some embodiments, instant messaging module 141 is used instead of email client module 140 to send a link to a specific online video. Additional descriptions of online video applications can be found in U.S. Provisional Patent Application No. 60 / 936,562, filed on June 20, 2007, entitled “Portable Multifunction Device, Method, and Graphical User Interface for Playing Online Videos,” and U.S. Patent Application No. 11 / 968,067, filed on December 31, 2007, entitled “Portable Multifunction Device, Method, and Graphical User Interface for Playing Online Videos,” the contents of which are hereby incorporated by reference in their entirety.

[0129] Each of the modules and applications described above corresponds to an executable instruction set for performing one or more of the functions described above and the methods described in this patent application (e.g., the computer-implemented methods and other information processing methods described herein). These modules (e.g., instruction sets) do not have to be implemented as independent software programs (such as computer programs (e.g., including instructions)), processes, or modules, so various subsets of these modules are optionally combined or otherwise rearranged in various embodiments. For example, a video player module is optionally combined with a music player module into a single module (e.g., Figure 1A In some embodiments, the memory 102 optionally stores a subset of the above modules and data structures. In addition, the memory 102 optionally stores additional modules and data structures not described above.

[0130] In some embodiments, the device 100 is a device where the operation of a predefined set of functions on the device is performed exclusively through a touch screen and / or a touch pad. By using a touch screen and / or a touch pad as the primary input control device for operating the device 100, the number of physical input control devices (e.g., push buttons, dials, etc.) on the device 100 is optionally reduced.

[0131] A predefined set of functions that are performed exclusively through the touch screen and / or trackpad optionally includes navigation between user interfaces. In some embodiments, the touchpad, when touched by the user, navigates the device 100 to a main menu, a home menu, or a root menu from any user interface displayed on the device 100. In such embodiments, a "menu button" is implemented using a trackpad. In some other embodiments, the menu button is a physical push button or other physical input control device, rather than a trackpad.

[0132] Figure 1B 1 is a block diagram illustrating exemplary components for event processing according to some embodiments. In some embodiments, memory 102 ( Figure 1A ) or memory 370( Figure 3 ) includes an event classifier 170 (e.g., in the operating system 126) and a corresponding application 136-1 (e.g., any one of the aforementioned applications 137 to 151, 155, 380 to 390).

[0133] Event classifier 170 receives event information and determines the application 136-1 and the application view 191 of application 136-1 to which the event information is to be delivered. Event classifier 170 includes event monitor 171 and event distributor module 174. In some embodiments, application 136-1 includes application internal state 192, which indicates one or more current application views displayed on touch-sensitive display 112 when the application is active or executing. In some embodiments, device / global internal state 157 is used by event classifier 170 to determine which application(s) is currently active, and application internal state 192 is used by event classifier 170 to determine the application view 191 to which the event information is to be delivered.

[0134] In some embodiments, the application internal state 192 includes additional information, such as one or more of the following: resumption information to be used when the application 136-1 resumes execution, user interface state information indicating that information is being displayed or is ready to be displayed by the application 136-1, a state queue for enabling a user to return to a previous state or view of the application 136-1, and a repeat / undo queue of previous actions taken by the user.

[0135] Event monitor 171 receives event information from peripherals interface 118. Event information includes information about sub-events (e.g., user touches on touch-sensitive display 112 as part of a multi-touch gesture). Peripherals interface 118 transmits information it receives from I / O subsystem 106 or sensors such as proximity sensor 166, one or more accelerometers 168, and / or microphone 113 (through audio circuit 110). The information that peripherals interface 118 receives from I / O subsystem 106 includes information from touch-sensitive display 112 or a touch-sensitive surface.

[0136] In some embodiments, event monitor 171 sends requests to peripheral device interface 118 at predetermined intervals. In response, peripheral device interface 118 transmits event information. In other embodiments, peripheral device interface 118 transmits event information only when there is a significant event (e.g., receiving an input above a predetermined noise threshold and / or receiving an input for more than a predetermined duration).

[0137] In some embodiments, the event classifier 170 also includes a hit view determination module 172 and / or an active event identifier determination module 173.

[0138] When the touch-sensitive display 112 displays more than one view, the hit view determination module 172 provides software procedures for determining where within one or more views a sub-event has occurred. A view consists of controls and other elements that a user can see on the display.

[0139] Another aspect of the user interface associated with an application is a set of views, sometimes also referred to herein as application views or user interface windows, in which information is displayed and touch-based gestures occur. The application views (of the respective application) in which a touch is detected optionally correspond to a programmatic level within the programmatic or view hierarchy of the application. For example, the lowest level view in which a touch is detected is optionally referred to as a hit view, and the set of events recognized as correct input is optionally determined at least in part based on the hit view of the initial touch that started the touch-based gesture.

[0140] Hit view determination module 172 receives information related to sub-events of touch-based gestures. When an application has multiple views organized in a hierarchy, hit view determination module 172 identifies the hit view as the lowest view in the hierarchy where the sub-events should be processed. In most cases, the hit view is the lowest level view in which the initiating sub-event (e.g., the first sub-event in a sequence of sub-events that form an event or potential event) occurs. Once a hit view is identified by hit view determination module 172, the hit view typically receives all sub-events related to the same touch or input source for which it was identified as the hit view.

[0141] Active event recognizer determination module 173 determines which view or views within the view hierarchy should receive a particular sequence of sub-events. In some embodiments, active event recognizer determination module 173 determines that only the hit view should receive a particular sequence of sub-events. In other embodiments, active event recognizer determination module 173 determines that all views that include the physical location of the sub-event are actively participating views, and therefore determines that all actively participating views should receive a particular sequence of sub-events. In other embodiments, even if a touch sub-event is completely confined to an area associated with one particular view, higher views in the hierarchy will still remain as actively participating views.

[0142] Event distributor module 174 distributes event information to event recognizers (e.g., event recognizers 180). In embodiments including active event recognizer determination module 173, event distributor module 174 delivers the event information to the event recognizers determined by active event recognizer determination module 173. In some embodiments, event distributor module 174 stores the event information in an event queue, which is retrieved by corresponding event receivers 182.

[0143] In some embodiments, operating system 126 includes event classifier 170. Alternatively, application 136-1 includes event classifier 170. In yet another embodiment, event classifier 170 is a standalone module or is part of another module stored in memory 102, such as contact / motion module 130.

[0144] In some embodiments, application 136-1 includes multiple event handlers 190 and one or more application views 191, each of which includes instructions for handling touch events occurring within a corresponding view of the user interface of the application. Each application view 191 of application 136-1 includes one or more event recognizers 180. Typically, the corresponding application view 191 includes multiple event recognizers 180. In other embodiments, one or more event recognizers in event recognizers 180 are part of an independent module, which is a higher-level object such as a user interface toolkit or application 136-1 from which methods and other properties are inherited. In some embodiments, the corresponding event handler 190 includes one or more of the following: data updater 176, object updater 177, GUI updater 178, and / or event data 179 received from event classifier 170. Event handler 190 optionally utilizes or calls data updater 176, object updater 177, or GUI updater 178 to update application internal state 192. Alternatively, one or more of the application views in application view 191 include one or more corresponding event handlers 190. In addition, in some embodiments, one or more of data updater 176, object updater 177, and GUI updater 178 are included in the corresponding application view 191.

[0145] The corresponding event identifier 180 receives event information (e.g., event data 179) from the event classifier 170 and identifies the event based on the event information. The event identifier 180 includes an event receiver 182 and an event comparator 184. In some embodiments, the event identifier 180 also includes metadata 183 and at least a subset of event delivery instructions 188 (which optionally include sub-event delivery instructions).

[0146] Event receiver 182 receives event information from event classifier 170. Event information includes information about sub-events such as touch or touch movement. Depending on the sub-event, the event information also includes additional information, such as the location of the sub-event. When the sub-event involves the movement of the touch, the event information optionally also includes the speed and direction of the sub-event. In some embodiments, the event includes the device rotating from one orientation to another orientation (for example, from a longitudinal orientation to a transverse orientation, or vice versa), and the event information includes corresponding information about the current orientation of the device (also referred to as the device posture).

[0147] Event comparator 184 compares event information with predefined event or sub-event definitions, and determines an event or sub-event based on the comparison, or determines or updates the state of an event or sub-event. In some embodiments, event comparator 184 includes event definition 186. Event definition 186 includes the definition of an event (e.g., a predefined sequence of sub-events), such as event 1 (187-1), event 2 (187-2), and others. In some embodiments, sub-events in event (187) include, for example, touch start, touch end, touch move, touch cancel, and multi-touch. In one example, the definition of event 1 (187-1) is a double-click on a displayed object. For example, a double-click includes a first touch (touch start) of a predetermined duration on a displayed object, a first lift-off (touch end) of a predetermined duration, a second touch (touch start) of a predetermined duration on a displayed object, and a second lift-off (touch end) of a predetermined duration. In another example, the definition of event 2 (187-2) is a drag on a displayed object. For example, dragging includes a touch (or contact) of a predetermined duration on a displayed object, movement of the touch on the touch-sensitive display 112, and lifting of the touch (touch end). In some embodiments, the event also includes information for one or more associated event handlers 190.

[0148] In some embodiments, event definition 187 includes definitions of events for corresponding user interface objects. In some embodiments, event comparator 184 performs a hit test to determine which user interface object is associated with a sub-event. For example, in an application view displaying three user interface objects on touch-sensitive display 112, when a touch is detected on touch-sensitive display 112, event comparator 184 performs a hit test to determine which of the three user interface objects is associated with the touch (sub-event). If each displayed object is associated with a corresponding event handler 190, the event comparator uses the result of the hit test to determine which event handler 190 should be activated. For example, event comparator 184 selects an event handler associated with a sub-event and the object that triggered the hit test.

[0149] In some embodiments, the definition of the corresponding event (187) also includes a delay action that delays the delivery of the event information until it has been determined that the sub-event sequence does or does not correspond to the event type of the event identifier.

[0150] When a corresponding event recognizer 180 determines that a sequence of sub-events does not match any event in event definition 186, the corresponding event recognizer 180 enters an event impossible, event failed, or event ended state, after which subsequent sub-events of the touch-based gesture are ignored. In this case, other event recognizers (if any) that remain active for the hit view continue to track and process sub-events of the ongoing touch-based gesture.

[0151] In some embodiments, the corresponding event recognizers 180 include metadata 183 with configurable properties, flags, and / or lists that indicate how the event delivery system should perform sub-event delivery to actively participating event recognizers. In some embodiments, metadata 183 includes configurable properties, flags, and / or lists that indicate how event recognizers interact or can interact with each other. In some embodiments, metadata 183 includes configurable properties, flags, and / or lists that indicate whether sub-events are delivered to different levels in a view or programmatic hierarchy.

[0152] In some embodiments, when one or more specific sub-events of an event are identified, the corresponding event recognizer 180 activates an event handler 190 associated with the event. In some embodiments, the corresponding event recognizer 180 delivers event information associated with the event to the event handler 190. Activating the event handler 190 is different from sending (and deferred sending) the sub-events to the corresponding hit view. In some embodiments, the event recognizer 180 throws a tag associated with the identified event, and the event handler 190 associated with the tag obtains the tag and performs a predefined process.

[0153] In some embodiments, the event delivery instructions 188 include a sub-event delivery instruction that delivers event information about a sub-event without activating an event handler. Instead, the sub-event delivery instruction delivers the event information to an event handler associated with a sub-event sequence or to an actively participating view. The event handler associated with the sub-event sequence or with an actively participating view receives the event information and performs a predetermined process.

[0154] In some embodiments, data updater 176 creates and updates data used in application 136-1. For example, data updater 176 updates phone numbers used in contact module 137 or stores video files used in video player module. In some embodiments, object updater 177 creates and updates objects used in application 136-1. For example, object updater 177 creates new user interface objects or updates the position of user interface objects. GUI updater 178 updates the GUI. For example, GUI updater 178 prepares display information and sends the display information to graphics module 132 for display on a touch-sensitive display.

[0155] In some embodiments, event handler 190 includes or has access to data updater 176, object updater 177, and GUI updater 178. In some embodiments, data updater 176, object updater 177, and GUI updater 178 are included in a single module of the corresponding application 136-1 or application view 191. In other embodiments, they are included in two or more software modules.

[0156] It should be understood that the above discussion of event processing of user touches on a touch-sensitive display also applies to other forms of user input that utilize input devices to operate the multifunction device 100, and not all user input is initiated on the touch screen. For example, mouse movement and mouse button presses, optionally in conjunction with single or multiple keyboard presses or hold; contact movement on a touch pad, such as tapping, dragging, scrolling, etc.; stylus input; movement of the device; verbal commands; detected eye movement; biometric input; and / or any combination thereof are optionally used as input corresponding to sub-events defining the event to be recognized.

[0157] Figure 2A portable multifunction device 100 with a touch screen 112 according to some embodiments is shown. The touch screen optionally displays one or more graphics within a user interface (UI) 200. In this embodiment and other embodiments described below, a user can select one or more of these graphics by, for example, making gestures on the graphics using one or more fingers 202 (not drawn to scale in the figure) or one or more styluses 203 (not drawn to scale in the figure). In some embodiments, selection of one or more graphics will occur when the user interrupts contact with the one or more graphics. In some embodiments, gestures optionally include one or more taps, one or more swipes (from left to right, from right to left, up and / or down) and / or rolling of fingers that have been in contact with the device 100 (from right to left, from left to right, up and / or down). In some specific implementations or in some cases, inadvertent contact with a graphic will not select the graphic. For example, when the gesture corresponding to the selection is a tap, a swipe gesture that sweeps over an application icon optionally does not select the corresponding application.

[0158] The device 100 optionally also includes one or more physical buttons, such as a "home" or menu button 204. As previously described, the menu button 204 is optionally used to navigate to any application 136 in a set of applications that are optionally executed on the device 100. Alternatively, in some embodiments, the menu button is implemented as a soft key in a GUI displayed on the touch screen 112.

[0159] In some embodiments, the device 100 includes a touch screen 112, a menu button 204, a push button 206 for turning the device on / off and for locking the device, one or more volume adjustment buttons 208, a user identity module (SIM) card slot 210, an earphone jack 212, and a docking / charging external port 124. The push button 206 is optionally used to turn the device on / off by pressing the button and keeping the button in a pressed state for a predefined time interval; lock the device by pressing the button and releasing the button before the predefined time interval passes; and / or unlock the device or initiate an unlocking process. In an alternative embodiment, the device 100 also accepts voice input for activating or deactivating certain functions through a microphone 113. The device 100 also optionally includes one or more contact strength sensors 165 for detecting the strength of contact on the touch screen 112, and / or one or more tactile output generators 167 for generating tactile output for a user of the device 100.

[0160] Figure 3300 is a block diagram of an exemplary multifunction device with a display and a touch-sensitive surface according to some embodiments. The device 300 does not have to be portable. In some embodiments, the device 300 is a laptop, a desktop computer, a tablet computer, a multimedia player device, a navigation device, an educational device (such as a children's learning toy), a game system, or a control device (e.g., a home controller or an industrial controller). The device 300 typically includes one or more processing units (CPUs) 310, one or more network or other communication interfaces 360, a memory 370, and one or more communication buses 320 for interconnecting these components. The communication bus 320 optionally includes circuits (sometimes referred to as a chipset) that interconnect system components and control communications between system components. The device 300 includes an input / output (I / O) interface 330 with a display 340, which is typically a touch screen display. The I / O interface 330 also optionally includes a keyboard and / or a mouse (or other pointing device) 350 and a touchpad 355, a tactile output generator 357 for generating tactile output on the device 300 (e.g., similar to the above reference Figure 1A The tactile output generator 167 described above), sensor 359 (e.g., optical sensor, acceleration sensor, proximity sensor, touch sensor and / or contact intensity sensor (similar to the above reference Figure 1A The memory 370 may include a high-speed random access memory, such as DRAM, SRAM, DDR RAM, or other random access solid-state memory devices; and may optionally include a non-volatile memory, such as one or more magnetic disk storage devices, optical disk storage devices, flash memory devices, or other non-volatile solid-state storage devices. The memory 370 may optionally include one or more storage devices located away from the CPU 310. In some embodiments, the memory 370 stores data related to the portable multifunction device 100 ( Figure 1A ) or a subset thereof. In addition, memory 370 optionally stores additional programs, modules, and data structures not present in memory 102 of portable multifunction device 100. For example, memory 370 of device 300 optionally stores a drawing module 380, a presentation module 382, ​​a word processing module 384, a website creation module 386, a disk editing module 388, and / or a spreadsheet module 390, while portable multifunction device 100 ( Figure 1A )'s memory 102 optionally does not store these modules.

[0161] Figure 3Each element in the above-mentioned elements in is optionally stored in one or more memory devices of the previously mentioned memory device. Each module in the above-mentioned modules corresponds to an instruction set for performing the above-mentioned functions. The above-mentioned modules or computer programs (for example, instruction sets or including instructions) do not have to be implemented with separate software programs (such as computer programs (for example, including instructions)), processes or modules, and therefore the various subsets of these modules are optionally combined or otherwise rearranged in various embodiments. In some embodiments, memory 370 optionally stores a subset of the above-mentioned modules and data structures. In addition, memory 370 optionally stores additional modules and data structures not described above.

[0162] Attention is now turned to an embodiment of a user interface that is optionally implemented on, for example, portable multifunction device 100.

[0163] Figure 4A An exemplary user interface of an application menu on portable multifunction device 100 according to some embodiments is shown. A similar user interface is optionally implemented on device 300. In some embodiments, user interface 400 includes the following elements, or a subset or superset thereof:

[0164] One or more signal strength indicators 402 of one or more wireless communications (e.g., cellular signals and Wi-Fi signals);

[0165] Time 404;

[0166] Bluetooth indicator 405;

[0167] Battery status indicator 406;

[0168] A tray 408 with common application icons, such as:

[0169] o An icon 416 of the phone module 138 labeled "Phone," the icon 416 optionally including an indicator 414 of the number of missed calls or voice messages;

[0170] o an icon 418 of the email client module 140 labeled “Mail”, the icon 418 optionally including an indicator 410 of the number of unread emails;

[0171] o An icon 420 labeled "Browser" of the browser module 147; and

[0172] ○ Video and music player module 152 (also known as iPod (trademark of Apple Inc.)

[0173] module 152) and an icon 422 labeled "iPod"; and

[0174] Icons of other applications, such as:

[0175] o Icon 424 labeled "Message" of IM module 141;

[0176] o An icon 426 labeled “Calendar” of the calendar module 148;

[0177] o Icon 428 labeled “Photos” of the image management module 144;

[0178] o An icon 430 labeled “Camera” of the camera module 143;

[0179] ○ Icon 432 labeled “Online Video” of the online video module 155;

[0180] ○ Icon 434 labeled “Stock Market” of the Stock Market Desktop Applet 149-2;

[0181] o An icon 436 labeled “Map” of the map module 154;

[0182] ○ Icon 438 labeled “Weather” of the Weather widget 149-1;

[0183] ○ Icon 440 labeled as “Clock” of the alarm clock desktop applet 149-4;

[0184] o An icon 442 labeled “Fitness Support” of the fitness support module 142;

[0185] o An icon 444 labeled "Memo" of the memo module 153; and

[0186] o An icon 446 labeled “Settings” for a settings application or module that provides access to settings for the device 100 and its various applications 136 .

[0187] It should be noted that Figure 4A The icon labels shown in are exemplary only. For example, icon 422 of video and music player module 152 is labeled "Music" or "Music Player". Other labels are optionally used for various application icons. In some embodiments, the label of a corresponding application icon includes the name of the application corresponding to the corresponding application icon. In some embodiments, the label of a particular application icon is different from the name of the application corresponding to the particular application icon.

[0188] Figure 4B A touch-sensitive surface 451 (eg, touch screen display 112) is shown having a touch-sensitive surface 451 (eg, Figure 3tablet computer or touch pad 355) device (e.g., Figure 3 Device 300 also optionally includes one or more contact intensity sensors (e.g., one or more of sensors 359) for detecting intensity of contacts on touch-sensitive surface 451 and / or one or more tactile output generators 357 for generating tactile output for a user of device 300.

[0189] Although some of the examples below are given with reference to input on a touch screen display 112 (where a touch-sensitive surface and a display are combined), in some embodiments, the device detects input on a touch-sensitive surface that is separate from the display, such as Figure 4B In some embodiments, the touch-sensitive surface (e.g., Figure 4B 451) has a main axis (e.g., Figure 4B 453) corresponding to the principal axis (for example, Figure 4B According to these embodiments, the device detects a position corresponding to a corresponding position on the display (e.g., Figure 4B 460 corresponds to 468 and 462 corresponds to 470) in contact with touch-sensitive surface 451 (e.g., Figure 4B Thus, when the touch-sensitive surface (e.g., Figure 4B 451) and a display of a multi-function device (e.g., Figure 4B When the user input detected by the device on the touch-sensitive surface (e.g., contacts 460 and 462 and their movement) is separated, the device is used to manipulate the user interface on the display. It should be understood that similar methods are optionally used for other user interfaces described herein.

[0190] In addition, although the following examples are primarily given with reference to finger inputs (e.g., finger contacts, single-finger tap gestures, finger swipe gestures), it should be understood that in some embodiments, one or more of these finger inputs are replaced by input from another input device (e.g., mouse-based input or stylus input). For example, a swipe gesture is optionally replaced by a mouse click (e.g., instead of contact), followed by movement of the cursor along the path of the swipe (e.g., instead of movement of the contact). As another example, a tap gesture is optionally replaced by a mouse click when the cursor is over the location of the tap gesture (e.g., instead of detecting contact, followed by ceasing to detect contact). Similarly, when multiple user inputs are detected simultaneously, it should be understood that multiple computer mice are optionally used simultaneously, or a mouse and finger contact are optionally used simultaneously.

[0191] Figure 5AAn exemplary personal electronic device 500 is shown. Device 500 includes a body 502. In some embodiments, device 500 may include a body 502 relative to devices 100 and 300 (e.g., Figures 1A to 4B ) some or all of the features described in the foregoing. In some embodiments, device 500 has a touch-sensitive display screen 504, referred to hereinafter as touch screen 504. As an alternative or in addition to touch screen 504, device 500 has a display and a touch-sensitive surface. As with devices 100 and 300, in some embodiments, touch screen 504 (or touch-sensitive surface) optionally includes one or more strength sensors for detecting the intensity of contact (e.g., touch) applied. One or more strength sensors of touch screen 504 (or touch-sensitive surface) can provide output data representing the intensity of touch. The user interface of device 500 can respond to touch based on the intensity of the touch, which means that touches of different intensities can invoke different user interface operations on device 500.

[0192] Exemplary techniques for detecting and processing touch intensity are found, for example, in the following related patent applications: International Patent Application Serial No. PCT / US2013 / 040061, filed on May 8, 2013, entitled “Device, Method, and Graphical User Interface for Displaying User Interface Objects Corresponding to an Application,” published as WIPO Patent Publication No. WO / 2013 / 169849; and International Patent Application Serial No. PCT / US2013 / 069483, filed on November 11, 2013, entitled “Device, Method, and Graphical User Interface for Transitioning Between Touch Input to Display Output Relationships,” published as WIPO Patent Publication No. WO / 2014 / 105276, each of which is hereby incorporated by reference in its entirety.

[0193] In some embodiments, the device 500 has one or more input mechanisms 506 and 508. The input mechanisms 506 and 508 (if included) can be physical. Examples of physical input mechanisms include push buttons and rotatable mechanisms. In some embodiments, the device 500 has one or more attachment mechanisms. Such attachment mechanisms (if included) can allow the device 500 to be attached to, for example, hats, glasses, earrings, necklaces, shirts, jackets, bracelets, watchbands, bracelets, pants, belts, shoes, wallets, backpacks, etc. These attachment mechanisms allow the user to wear the device 500.

[0194] Figure 5B An exemplary personal electronic device 500 is shown. In some embodiments, the device 500 may include a reference Figure 1A , Figure 1B and Figure 3 Some or all of the components described. Device 500 has a bus 512 that operatively couples an I / O portion 514 to one or more computer processors 516 and a memory 518. I / O portion 514 may be connected to a display 504, which may have a touch-sensitive component 522 and optionally a strength sensor 524 (e.g., a contact strength sensor). In addition, I / O portion 514 may be connected to a communication unit 530 for receiving application and operating system data using Wi-Fi, Bluetooth, near field communication (NFC), cellular and / or other wireless communication technologies. Device 500 may include input mechanisms 506 and / or 508. For example, input mechanism 506 is optionally a rotatable input device or a depressible input device and a rotatable input device. In some examples, input mechanism 508 is optionally a button.

[0195] In some examples, input mechanism 508 is optionally a microphone. Personal electronic device 500 optionally includes various sensors, such as GPS sensor 532, accelerometer 534, orientation sensor 540 (e.g., compass), gyroscope 536, motion sensor 538, and / or combinations thereof, all of which are operably connected to I / O portion 514.

[0196] The memory 518 of the personal electronic device 500 may include one or more non-transitory computer-readable storage media for storing computer-executable instructions that, when executed by one or more computer processors 516, may, for example, cause the computer processors to perform the techniques described below, including processes 700, 900, and 1100 ( Figure 7 , Fig. 9 and Fig.11). Computer-readable storage media can be any medium that can tangibly contain or store computer-executable instructions for use by or in conjunction with instruction execution systems, devices, and apparatuses. In some examples, the storage medium is a transient computer-readable storage medium. In some examples, the storage medium is a non-transitory computer-readable storage medium. Non-transitory computer-readable storage media may include, but are not limited to, magnetic storage devices, optical storage devices, and / or semiconductor storage devices. Examples of such storage devices include magnetic disks, optical disks based on CD, DVD, or Blu-ray technology, and persistent solid-state memories such as flash memory, solid-state drives, and the like. Personal electronic device 500 is not limited to Figure 5B components and configurations, but may include other components or additional components in a variety of configurations.

[0197] As used herein, the term "indicative representation" refers to an optional feature of the apparatus 100, 300, and / or 500 ( Figure 1A , Figure 3 and FIG. 5A to FIG. 5B ) is a user-interactive graphical user interface object displayed on a display screen of a computer. For example, an image (e.g., an icon), a button, and text (e.g., a hyperlink) optionally each constitute an affordance.

[0198] As used herein, the term "focus selector" refers to an input element used to indicate the current portion of a user interface with which a user is interacting. In some implementations that include a cursor or other position marker, the cursor acts as a "focus selector" such that when the cursor is over a particular user interface element (e.g., a button, window, slider, or other user interface element), a focus selector is displayed on a touch-sensitive surface (e.g., Figure 3 Touchpad 355 or Figure 4B In the event that an input (e.g., a press input) is detected on the touch-sensitive surface 451 in the display, the particular user interface element is adjusted according to the detected input. In the case that a touch-screen display (e.g., Figure 1A A touch-sensitive display system 112 or Figure 4AIn some implementations of the touch screen 112 in FIG. 1 , a contact detected on the touch screen acts as a “focus selector” such that when an input (e.g., a press input by the contact) is detected at the location of a particular user interface element (e.g., a button, window, slider, or other user interface element) on the touch screen display, the particular user interface element is adjusted in accordance with the detected input. In some implementations, the focus moves from one area of ​​the user interface to another area of ​​the user interface without corresponding movement of a cursor or movement of a contact on the touch screen display (e.g., by using a tab key or arrow keys to move the focus from one button to another); in these implementations, the focus selector moves in accordance with the movement of the focus between different areas of the user interface. Regardless of the specific form the focus selector takes, the focus selector is typically a user interface element (or contact on the touch screen display) that is controlled by the user to deliver the user's intended interaction with the user interface (e.g., by indicating to the device the element of the user interface with which the user desires to interact). For example, when a press input is detected on a touch-sensitive surface (e.g., a trackpad or touch screen), the position of a focus selector (e.g., a cursor, contact, or selection box) over a corresponding button will indicate that the user intends to activate the corresponding button (rather than other user interface elements shown on the device display).

[0199] As used in the specification and claims, the term "characteristic intensity" of a contact refers to a characteristic of a contact based on one or more intensities of the contact. In some embodiments, the characteristic intensity is based on multiple intensity samples. The characteristic intensity is optionally based on a predefined number of intensity samples or a set of intensity samples collected during a predetermined time period (e.g., 0.05 seconds, 0.1 seconds, 0.2 seconds, 0.5 seconds, 1 second, 2 seconds, 5 seconds, 10 seconds) relative to a predefined event (e.g., after contact is detected, before contact is detected to be lifted off, before or after contact starts to move, before contact ends, before or after contact intensity is detected to increase, and / or before or after contact intensity is detected to decrease). The characteristic intensity of a contact is optionally based on one or more of the following: the maximum value of the intensity of the contact, the mean value of the intensity of the contact, the average value of the intensity of the contact, the value at the top 10% of the intensity of the contact, the half-maximum value of the intensity of the contact, the 90% maximum value of the intensity of the contact, etc. In some embodiments, the duration of the contact is used when determining the characteristic intensity (e.g., when the characteristic intensity is the average value of the intensity of the contact over time). In some embodiments, the feature strength is compared to a set of one or more strength thresholds to determine whether the user has performed an operation. For example, the set of one or more strength thresholds optionally includes a first strength threshold and a second strength threshold. In this example, a contact whose feature strength does not exceed the first threshold results in a first operation, a contact whose feature strength exceeds the first strength threshold but does not exceed the second strength threshold results in a second operation, and a contact whose feature strength exceeds the second threshold results in a third operation. In some embodiments, a comparison between the feature strength and one or more thresholds is used to determine whether to perform one or more operations (e.g., whether to perform the corresponding operation or to abandon the corresponding operation) rather than to determine whether to perform the first operation or the second operation.

[0200] In some embodiments, a portion of a gesture is identified for determining characteristic strength. For example, the touch-sensitive surface optionally receives a continuous swipe contact that transitions from a starting position and reaches an end position, where the contact strength increases. In this example, the characteristic strength of the contact at the end position is optionally based only on a portion of the continuous swipe contact, rather than the entire swipe contact (e.g., only the portion of the swipe contact at the end position). In some embodiments, a smoothing algorithm is optionally applied to the strength of the swipe contact before determining the characteristic strength of the contact. For example, a smoothing algorithm optionally includes one or more of the following: an unweighted sliding average smoothing algorithm, a triangular smoothing algorithm, a median filter smoothing algorithm, and / or an exponential smoothing algorithm. In some cases, these smoothing algorithms eliminate narrow peaks or depressions in the strength of the swipe contact to achieve the purpose of determining the characteristic strength.

[0201] The intensity of contact on the touch-sensitive surface is optionally characterized relative to one or more intensity thresholds such as a contact detection intensity threshold, a light press intensity threshold, a deep press intensity threshold, and / or one or more other intensity thresholds. In some embodiments, the light press intensity threshold corresponds to an intensity at which the device will perform an operation typically associated with clicking a button of a physical mouse or touchpad. In some embodiments, the deep press intensity threshold corresponds to an intensity at which the device will perform an operation different from the operation typically associated with clicking a button of a physical mouse or touchpad. In some embodiments, when a contact having a characteristic intensity lower than the light press intensity threshold (e.g., and higher than a nominal contact detection intensity threshold, contacts lower than the nominal contact detection intensity threshold are no longer detected) is detected, the device will move the focus selector according to the movement of the contact on the touch-sensitive surface without performing an operation associated with the light press intensity threshold or the deep press intensity threshold. Generally speaking, unless otherwise stated, these intensity thresholds are consistent between different groups of user interface illustrations.

[0202] An increase in contact feature intensity from an intensity below a light press intensity threshold to an intensity between the light press intensity threshold and the deep press intensity threshold is sometimes referred to as a "light press" input. An increase in contact feature intensity from an intensity below a deep press intensity threshold to an intensity above the deep press intensity threshold is sometimes referred to as a "deep press" input. An increase in contact feature intensity from an intensity below a contact detection intensity threshold to an intensity between the contact detection intensity threshold and the light press intensity threshold is sometimes referred to as detecting contact on the touch surface. A decrease in contact feature intensity from an intensity above the contact detection intensity threshold to an intensity below the contact detection intensity threshold is sometimes referred to as detecting contact lifted from the touch surface. In some embodiments, the contact detection intensity threshold is zero. In some embodiments, the contact detection intensity threshold is greater than zero.

[0203] In some embodiments described herein, one or more operations are performed in response to detecting a gesture that includes a corresponding press input or in response to detecting a corresponding press input performed using a corresponding contact (or multiple contacts), wherein the corresponding press input is detected at least in part based on detecting that the strength of the contact (or multiple contacts) increases to above a press input strength threshold. In some embodiments, the corresponding operation is performed in response to detecting that the strength of the corresponding contact increases to above the press input strength threshold (e.g., a "down stroke" of the corresponding press input). In some embodiments, the press input includes an increase in the strength of the corresponding contact to above the press input strength threshold and the strength of the contact subsequently decreases to below the press input strength threshold, and the corresponding operation is performed in response to detecting that the strength of the corresponding contact subsequently decreases to below the press input threshold (e.g., an "up stroke" of the corresponding press input).

[0204] In some embodiments, the device employs intensity hysteresis to avoid unexpected inputs sometimes referred to as "jitter," where the device defines or selects a hysteresis intensity threshold that has a predefined relationship to a press input intensity threshold (e.g., the hysteresis intensity threshold is X intensity units lower than the press input intensity threshold, or the hysteresis intensity threshold is 75%, 90%, or some reasonable proportion of the press input intensity threshold). Thus, in some embodiments, a press input includes an increase in the intensity of the corresponding contact to above the press input intensity threshold and a subsequent decrease in the intensity of the contact to below the hysteresis intensity threshold corresponding to the press input intensity threshold, and a corresponding operation is performed in response to detecting that the intensity of the corresponding contact subsequently decreases to below the hysteresis intensity threshold (e.g., an "upward stroke" of the corresponding press input). Similarly, in some embodiments, a press input is detected only when the device detects that the contact intensity increases from an intensity equal to or below the hysteresis intensity threshold to an intensity equal to or above the press input intensity threshold and, optionally, that the contact intensity subsequently decreases to an intensity equal to or below the hysteresis intensity, and a corresponding operation is performed in response to detecting the press input (e.g., an increase in contact intensity or a decrease in contact intensity, depending on the circumstances).

[0205] For ease of explanation, optionally, a description of an operation performed in response to a press input associated with a press input intensity threshold or in response to a gesture including a press input is triggered in response to detecting any of the following: contact intensity increasing to above the press input intensity threshold, contact intensity increasing from an intensity below a hysteresis intensity threshold to an intensity above the press input intensity threshold, contact intensity decreasing to below the press input intensity threshold, and / or contact intensity decreasing to below a hysteresis intensity threshold corresponding to the press input intensity threshold. Additionally, in examples where an operation is described as being performed in response to detecting that the intensity of the contact decreases below the press input intensity threshold, the operation is optionally performed in response to detecting that the intensity of the contact decreases below a hysteresis intensity threshold that corresponds to and is less than the press input intensity threshold.

[0206] As used herein, an "installed application" refers to a software application that has been downloaded to an electronic device (e.g., device 100, 300, and / or 500) and is ready to be launched (e.g., become open) on the device. In some embodiments, a downloaded application becomes an installed application using an installer that extracts program portions from a downloaded software package and integrates the extracted portions with the operating system of a computer system.

[0207] As used herein, the term "open application" or "executing application" refers to a software application that has retained state information (e.g., as part of device / global internal state 157 and / or application internal state 192). An open or executing application is optionally any of the following types of applications:

[0208] The active application, which is currently displayed on the display of the device on which the application is being used;

[0209] Background applications (or background processes) that are not currently displayed but whose processes are being processed by one or more processors; and

[0210] - A suspended or dormant application that is not running but has state information stored in memory (volatile and non-volatile respectively) that can be used to resume execution of the application.

[0211] As used herein, the term "closed application" refers to a software application that does not have retained state information (e.g., the state information of a closed application is not stored in the memory of the device). Therefore, closing an application includes stopping and / or removing the application process of the application and removing the state information of the application from the memory of the device. Generally speaking, when in a first application, opening a second application does not close the first application. When the second application is displayed and the first application stops being displayed, the first application becomes a background application.

[0212] Attention is now turned to embodiments of a user interface ("UI") and associated processes implemented on an electronic device, such as portable multifunction device 100, device 300, or device 500.

[0213] Figures 6A to 6V An exemplary user interface for managing exposure compensation using an electronic device according to some embodiments is shown. The user interface in these figures is used to illustrate the following description including Figure 7 The process of the process.

[0214] Fig. 6A An electronic device 600 is shown displaying a camera user interface including a live preview 630 that optionally extends from the top of the display to the bottom of the display. Device 600 optionally includes one or more features of device 100, device 300, or device 500.

[0215] Live preview 630 shows a particular scene in the field of view of one or more cameras (e.g., Fig. 6A The real-time preview 630 is a representation of a (e.g., a portion of) a field of view (“FOV”) of one or more cameras of the device 600. The real-time preview 630 is based on an image detected in the FOV. In some embodiments, the device 600 captures images using multiple camera sensors and combines them to display the real-time preview 630. In some embodiments, the device 600 captures images using a single camera sensor to display the real-time preview 630.

[0216] Fig. 6AThe camera user interface of includes an indicator area 602 and a control area 606. The indicator area 602 and the control area 606 are overlaid on the real-time preview 630 so that the indicator and the controls can be displayed simultaneously with the real-time preview 630. The camera display area 604 is sandwiched between the indicator area 602 and the control area 606 and does not substantially overlap with the indicator or the controls.

[0217] like Fig. 6A As shown, the indicator area 602 includes indicators such as a flash indicator 602a and an animated image indicator 602b. The flash indicator 602a indicates whether the flash is on, off, or in another mode (e.g., automatic mode). Fig. 6A , the flash indicator 602a indicates to the user that the flash is off. Additionally, the animated image indicator 602b indicates whether the camera is configured to capture a single image or multiple images (e.g., in response to detecting a request to capture media). In some embodiments, the indicator area 602 is overlaid on the live preview 630 and optionally includes a colored (e.g., gray; translucent) overlay.

[0218] like Fig. 6A As shown, camera display area 604 includes real-time preview 630 and zoom-enabled representation 622. Here, the "1x" zoom-enabled representation is selected, indicating that real-time preview 630 is displayed at a 1x zoom level.

[0219] like Fig. 6A As shown, the control area 606 includes a shutter enable representation 610, a camera switcher enable representation 614, a representation of a media collection 612, and a camera setting enable representation 626. The shutter enable representation 610, when activated, causes the device 600 to capture media (e.g., photos) using one or more camera sensors based on the current state of the live preview 630 and the current state of the camera application. The captured media is stored locally at the electronic device 600 and / or transmitted to a remote server for storage. The camera switcher enable representation 614, when activated, causes the device 600 to switch to displaying the field of view of a different camera in the live preview 630, such as by switching between a rear-facing camera sensor and a front-facing camera sensor. Fig. 6A The representation of the media collection 612 shown in FIG. 6 is a representation of the media (images, videos) most recently captured by the device 600. In some embodiments, in response to detecting a gesture on the media collection 612, the device 600 displays a video clip associated with the media collection 612. Fig. 8A A user interface similar to the user interface shown in (discussed below). Fig. 6AAs shown, the camera setting enable indication 626 includes a flash setting enable indication 626a, an animated image capture setting enable indication 626b, an aspect ratio setting enable indication 626c, an exposure compensation setting enable indication 626d, a timer setting enable indication 626e, and a filter setting enable indication 626f. The camera setting enable indication 626, when selected (e.g., via a gesture detected on a particular camera setting enable indication), causes the device 600 to change (or initiate a process of changing) camera settings associated with a particular camera mode. For example, the flash setting enable indication 626a, when activated, causes the device 600 to turn on / off the flash mode, and the timer enable indication 626d, when selected, causes the device to initiate a process for setting a self-delay timer. In some embodiments, the control area 606 is overlaid on the live preview 630, and optionally includes a colored (e.g., gray; translucent) overlay. In Fig. 6A , device 600 detects a tap gesture 650a on exposure compensation setting enable indication 626d (e.g., at a location corresponding to the enable indication).

[0220] like Figure 6B As shown, in response to detecting the tap gesture 650a, the device 600 displays the exposure compensation indicator 602d in the indicator area 602 simultaneously with the real-time preview 630. In some embodiments, the device 600 displays the exposure compensation indicator 602d in the indicator area 602 because the device 600 activates the exposure compensation mode in response to detecting the tap gesture 650a.

[0221] The exposure compensation indicator 602d includes an exposure compensation value representation 602d1 and a clipping indication 602d2. Each of the exposure compensation value representation 602d1 and the clipping indication 602d2 is displayed outside the camera display area 604. In some embodiments, when the real-time preview 630 extends into the indicator area 602 and / or the control area 606 and in response to receiving a request to display a captured media representing the real-time preview 630, the device 600 displays a representation of the portion of the real-time preview 630 shown in the camera display area 604, and does not display a representation of the portion of the real-time preview 630 in the indicator area 602 and the control area 606. Therefore, in some embodiments, the exposure compensation value representation 602d1 and the clipping indication 602d2 are displayed outside the camera display area 604, so that the portion of the real-time preview 630 (e.g., the portion in the camera display area 604) displayed in response to receiving a request to display the captured media representing the real-time preview 630 is not blocked.

[0222] like Figure 6BAs shown, exposure compensation value representation 602d1 is a numerical value indicating the exposure level that device 600 will use to capture media in response to receiving a request to capture media (e.g., in response to detecting a gesture on shutter enable representation 610). Figure 6B In some embodiments, the exposure level indicated by exposure compensation value representation 602d1 may be combined with one or more other exposure compensation values ​​(e.g., exposure compensation offset values). In some embodiments, device 600 will be configured to capture media using a total compensation value (e.g., a combination of the exposure compensation level indicated by exposure compensation value representation 602d1 and the other exposure compensation values) in response to receiving a request to capture media, as described below (e.g., in FIG. 6F to FIG. 6I middle).

[0223] exist Figure 6B , clip indication 602d2 indicates the magnitude and type of predicted clip that is predicted to occur in response to detecting a request to capture current media. As used herein, "current media" is (1) media that represents real-time preview 630, and (2) media that is captured (or to be captured) in response to detecting a request to capture media when device 600 is configured to capture media at an exposure level and / or total exposure compensation level indicated by exposure compensation value indication 602d1. As described in further detail below, the magnitude of the predicted clip is indicated by the size (e.g., length, width), boldness, and / or opacity of clip indication 602d2. In addition, the type of predicted clip is indicated by the position of clip indication 602d2. As shown Figure 6B and Figure 6J As shown, the clipping indication 602d2 can indicate the predicted occurrence of two types of clipping, namely, bright area clipping and dark area clipping. In some embodiments, when a set of luminance intensity values ​​within the FOV (or current media) is determined to be higher than a range of luminance intensity values ​​(e.g., a non-zero range) that can be accurately captured and / or represented in the current media, it is predicted that bright area clipping will occur. In other words, the set of luminance intensity values ​​is too bright and cannot be accurately captured and / or represented by the device 600 (e.g., in the current media). In some embodiments, when the luminance intensity values ​​of the FOV (or current media) are determined to be lower than a range of luminance intensity values ​​that can be accurately captured and / or represented in the current media, it is predicted that dark area clipping will occur. In other words, the set of luminance intensity values ​​is too dark and cannot be accurately captured and / or represented by the device 600 (e.g., in the current media). Figure 6B , the clipping indicator 602d2 indicates that highlight clipping is predicted to occur because the clipping indicator 602d2 is positioned as the rightmost tick mark of the exposure compensation indicator 602d. Figure 6JThe clipping indication 602d2 indicates that dark area clipping is predicted to occur because the clipping indication 602d2 is positioned at Figure 6J The leftmost scale line of the exposure compensation indicator 602d in (or Fig. 6A 602d2 is shown on the opposite side of the position of the clip indication 602d2).

[0224] like Figure 6B As shown, in response to detecting the tap gesture 650a, the device 600 also replaces the camera settings indicator 626 with an exposure compensation control 636 in the control area 606. The exposure compensation control 636 is a slider bar that is displayed with a value indication 636a positioned at a tick mark on the slider bar. The positioning of the value indication 636a represents a value (e.g., 0) of the current level of exposure compensation, which matches the exposure compensation value indicated by the exposure compensation value indication 602d1. Figure 6B and Figure 6C During the transition between, the environment becomes brighter and device 600 detects a change in FOV, which indicates that the environment of the scene in the FOV is brighter.

[0225] exist Figure 6C In response to detecting a change in FOV, it is determined that a second amount (or level) of highlight clipping is predicted to occur. Figure 6C The second amount of bright area clipping predicted to occur is greater than Figure 6B The amount of highlight clipping that is predicted to occur in . Figure 6C The second quantity is greater than Figure 6B The amount of bright area clipping that is predicted to occur in , because of the brightness level in the environment (e.g., as in the comparison FIG. 6B to FIG. 6C 630) has been increased and the current level of exposure compensation has remained unchanged (e.g., as shown in exposure compensation value representation 602d1). Figure 6C In the device 600 Figure 6B Device 600 is detecting more brightness intensity values ​​above the brightness intensity value range than is being detected (eg, to display live preview 630).

[0226] like Figure 6C As shown, in response to detecting a change in FOV and because it is determined that a second amount of bright area clipping is predicted to occur, device 600 increases the size of clipping indicator 602d2, which indicates that the second amount of bright area clipping is predicted to occur. Figure 6C The predicted bright area clipping in Figure 6B More bright area clipping is predicted to occur in . Figure 6C In the example, the clipping indication 602d2 indicates the type and amount of clipping that is predicted to occur. Specifically, Figure 6C The clipping instructions 602d2 than Figure 6B The clipping instructions 602d2 are longer and wider. Figure 6Cand Fig.6D During the transition between, the environment becomes brighter and device 600 detects more changes in the FOV, which indicates that the environment of the scene in the FOV is brighter.

[0227] exist Fig.6D In , it is determined that a third amount of highlight clipping is predicted to occur. Fig.6D The third amount of bright area clipping predicted to occur is greater than Figure 6C Here, the third amount of bright area clipping is greater than the second amount of bright area clipping because the brightness level in the environment (e.g., as in the comparison FIG. 6C to FIG. 6D 630) has been increased and the current level of exposure compensation has remained unchanged (e.g., as shown in exposure compensation value representation 602d1). Fig.6D , use the same method as above with respect to Figure 6C One or more similar techniques are described to determine that a third amount of highlight clipping is predicted to occur.

[0228] like Fig.6D As shown, in response to detecting a change in FOV (e.g., Figure 6C ) and because it is determined that a third amount of highlight clipping is predicted to occur, device 600 increases the size of clipping indication 602d2, which indicates that the third amount of highlight clipping is predicted to occur is greater than Figure 6C The second amount of highlight clipping that will occur is predicted in Figure 6C One or more similar techniques described above). Therefore, in Fig.6D In some embodiments, the size of the clipping indicator 602d2 displayed by the device 600 ranges from Figure 6B The size of the clipping indication 602d2 increases to Fig.6D The clip indicates the animation of the size of 602d2. Fig.6D , device 600 detects a right swipe gesture 650d on exposure compensation control 636.

[0229] like Fig. 6E As shown, in response to detecting the right swipe gesture 650d, the device 600 updates the exposure compensation control 636 so that the value indication 636a is positioned at a value representing the updated exposure compensation level (e.g., -0.2). In addition, the device 600 also updates the exposure compensation value indication 602d1 to reflect the value representing the updated exposure compensation level (e.g., -0.2). Fig.6D compared to, Fig. 6E The value of the exposure compensation level updated in becomes smaller.

[0230] exist Fig. 6EIn , because the current level of exposure compensation has changed (e.g., from 0 to -0.2), it is determined that a fourth amount of highlight clipping is predicted to occur. Fig. 6E The fourth amount of bright area clipping predicted to occur is less than Fig.6D The third amount of highlight clipping that will occur is predicted in . Fig. 6E , the fourth amount is less than the third amount because the level of exposure compensation that device 600 used to capture the current media has been reduced (e.g., from 0 to -0.2). When device 600 uses a lower exposure compensation value to capture the current media, device 600 is configured to capture lower brightness intensity values ​​(e.g., less white) in response to receiving a request to capture media. Capturing lower brightness values ​​actually causes device 600 to capture fewer brightness intensity values ​​above the brightness value range. Fig. 6E As shown, because it is determined that the fourth amount of clipping is predicted to occur, the device 600 reduces the size of the clipping indication 602d2, which indicates that the fourth amount of clipping predicted to occur is less than the third amount of clipping predicted to occur. Fig. 6E In FIG. 6 , the clipping indication 602d2 indicates the type and amount of clipping that is predicted to occur.

[0231] like Fig. 6E As shown, device 600 also dims live preview 630 to reflect the media that will be captured based on the updated exposure compensation level. Here, live preview 630 is darker (with Fig.6D ), because device 600 is configured to capture lower brightness intensity values ​​(e.g., based on a lower exposure compensation value) in response to receiving a request to capture media. Fig. 6E , the device 600 detects a downward swipe gesture 650e in the camera display area 604.

[0232] like Fig. 6F As shown, in response to detecting the downward swipe gesture 650e, the device 600 replaces the exposure compensation control 636 with the camera mode enable representation 620 in the control area 606. The camera mode enable representation 620 indicates which camera mode is currently selected and enables the user to change the camera mode. Fig. 6F , camera mode enable indications 620a-620e are displayed. Camera mode enable indication 620 indicates that the photo camera mode is active, as indicated by photo camera mode enable indication 620c and the word “photo” displayed in bold. Fig. 6F As shown, device 600 also continues to display exposure compensation indicator 602d, even though exposure compensation control 636 has ceased to be displayed. Fig. 6F , continuing to display the exposure compensation indicator 602d includes maintaining the exposure compensation value representation 602d1 at the same exposure compensation value (e.g., -0.2) and maintaining the clipping indication 602d2 at the same value as they were in Fig. 6E The same dimensions as shown in the Fig. 6F , ceasing to display compensation control 636 has no effect on the current value of exposure compensation (e.g., as indicated by exposure compensation value indication 602d1) or the determination of predicted clipping (e.g., as indicated by clip indication 602d2). Fig. 6F , the device 600 detects a press and hold gesture 650f in the camera display area 604 (eg, at a location corresponding to the area).

[0233] like Figure 6G As shown, in response to detecting the press and hold gesture 650f, the device 600 locks the autofocus setting on the device 600 so that the device 600 focuses one or more of its cameras at a specific focus distance (e.g., position) in the FOV. Figure 6G , this position corresponds to the area of ​​the box of the compensation bias control 644, which is located in Figure 6G 64A is displayed in camera display area 604. Compensation offset control 644 is displayed with a value indication 644A positioned on compensation offset control 644 corresponding to the current exposure compensation offset value that device 600 is currently configured to use to capture current media (e.g., in response to receiving a request to capture media).

[0234] exist Figure 6G , the device 600 detects a downward swipe gesture 650g in the camera display area 604. FIG. 6H to FIG. 6I An alternative user interface is shown that may be displayed in response to detecting the downward swipe gesture 650g.

[0235] like Figure 6H As shown, in response to detecting the downward swipe gesture 650g, the device 600 updates the compensation offset control 644 so that the value indication 644a is displayed at a new position on the compensation offset control 644 to indicate that the updated exposure compensation offset value has been updated. Figure 6H The updated exposure compensation offset value is lower than Figure 6G Therefore, if Figure 6H As shown, the real-time preview 630 is dimmed due to the lower compensation bias value. Figure 6H , device 600 is configured to capture media based on a total compensation value (e.g., the sum of the exposure compensation value represented by exposure compensation value representation 602d1 and the updated exposure compensation offset value). Figure 6H As shown, device 600 does not update exposure compensation indicator 602d to reflect the change in total exposure compensation. Figure 6H, device 600 displays a representation of the total exposure compensation simultaneously with exposure compensation indicator 602d (e.g., because the compensation indicator is displayed with the same exposure compensation value representation (e.g., -0.2) and clipping indicator 602d2 has the same size). In some embodiments, the representation of the total exposure compensation is displayed in camera display area 604 while exposure compensation indicator 602d remains displayed in indicator area 602.

[0236] As Figure 6H Alternatives, such as Fig.6I As shown, in response to detecting the downward gesture 650G, the device 600 uses the same method as described above. Figure 6H The compensation bias control 644 and the real-time preview 630 are updated using techniques similar to those described in Fig.6I In the embodiment, the device 600 updates the exposure compensation indicator 602d (e.g., in Figure 6H 602d1 to reflect the change in total exposure compensation. For example, device 600 updates exposure compensation value representation 602d1 to reflect that the total exposure compensation is -0.3 in response to a request to capture current media, and updates clipping indication 602d2 to reflect that less predicted clipping is predicted to occur (e.g., due to a lower total exposure compensation value using the techniques described above). Figure 6H or Fig.6I , device 600 detects changes in FOV.

[0237] exist Figure 6J In response to detecting a change in FOV (e.g., Figure 6H or Fig.6I ), confirm that the scene in the FOV has changed. Figure 6J As shown, the real-time preview 630 shows a pair of shoes on a dark ground, while Fig.6I The real-time preview 630 shows the sky. Fig.6I When compared to the real-time preview of 630, Figure 6J The live preview of the 630 is noticeably darker because the scene in the FOV is noticeably darker.

[0238] exist Figure 6J At , because it is determined that the scene in the FOV has changed, the device 600 resets the exposure compensation offset value to the default exposure compensation offset value (e.g., after detecting that Fig. 6F Gestures in 650f or Figure 6G The compensation offset value set before the gesture 650g in the example Figure 6J As shown, due to the scene change determination, the device 600 also stops displaying the compensation offset indicator 644. Figure 6J , the device 600 remains configured via Fig. 6FThe exposure compensation value indication 602d2 indicates the exposure compensation level (e.g., -0.2) indicated to capture the current media (e.g., before displaying and / or adjusting the compensation offset value (e.g., before FIG. 6F to FIG. 6G Thus, when the scene in the FOV changes, the set compensation offset value disappears (e.g., is set back to a default value), but the set exposure compensation value is maintained (e.g., via exposure compensation control 636) regardless of the determination that the scene in the FOV has changed.

[0239] exist Figure 6J 602d1). In particular, it is determined that dark area clipping is predicted to occur because the set of luminance intensity values ​​(e.g., black values ​​or dark areas of an image (e.g., to be captured) in the FOV (or current media) is determined to be below a range of luminance intensity values ​​that can be accurately represented or captured. The determination that dark area clipping is predicted to occur is based on the luminance level in the environment and the current level of exposure compensation (e.g., -0.2, as shown in exposure compensation value representation 602d1).

[0240] like Figure 6J As shown, because it is determined that dark area clipping is predicted to occur, the device 600 displays the clipping indication 602d2 as the leftmost tick mark of the exposure compensation indicator 602d (e.g., instead of at Fig. 6F When highlight clipping is predicted to occur, it is displayed as the rightmost scale line of the exposure compensation indicator 602. Figure 6J , the size of the clipping indication 602d2 has also changed to reflect the magnitude (e.g., amount or level) of dark area clipping that is predicted to occur when the device 600 is configured to capture media at the current exposure compensation level (e.g., -0.2). Figure 6J , device 600 detects changes in FOV.

[0241] exist Figure 6K In response to detecting a change in the FOV, it is determined that the scene in the FOV has changed. Figure 6J When compared to the real-time preview of 630, Figure 6J The real-time preview of 630 is noticeably darker because Figure 6K The scene in the FOV is noticeably darker. Figure 6K In, one or more of the techniques described above are also used (e.g., in FIG. 6B to FIG. 6J ) determines that a second amount of dark region clipping is predicted to occur. Figure 6K The second amount of dark area clipping is greater than Figure 6J The amount of dark area clipping that is predicted to occur because a darker scene is in the FOV of one or more cameras and the current level of exposure compensation remains unchanged.

[0242] like Figure 6K As shown, because it is determined that a second amount of dark area clipping is predicted to occur, the device 600 increases the size of the clipping indicator 602d2 while maintaining the display of the clipping indicator 602d2 on the left side of the exposure compensation indicator 602d. Figure 6K In the example, the clipping indication 602d2 indicates the type and amount of clipping that is predicted to occur. In addition, the real-time preview 630 is updated to show the new scene. Figure 6K , device 600 detects a tap gesture 650k on exposure compensation indicator 602d.

[0243] like Figure 6L As shown, in response to detecting tap gesture 650k, device 600 replaces display of camera affordance 620 with display of exposure compensation control 636 including value indication 636a. Figure 6L , device 600 detects a left swipe gesture 6501 on exposure compensation control 636.

[0244] like Figure 6M As shown, in response to detecting the left swipe gesture 6501, the device 600 updates the exposure compensation level, which is indicated via a new value (e.g., 1.0) represented by the exposure compensation value indication 602d1 and is also displayed above the value indication 636a on the exposure compensation control 636. The new exposure compensation level (e.g., Figure 6M 1.0 in ) is higher than the previous exposure compensation level (e.g. Figure 6L -0.2 in ).

[0245] exist Figure 6M In the example, one or more techniques similar to those described above are used to determine that a minimum amount of clipping (or no clipping) is predicted to occur (or that less than a (e.g., non-zero) threshold level of clipping is predicted to occur). Thus, in other words, it is determined that the device 600 will be able to accurately represent or capture the current media using an amount of clipping that is less than a (e.g., non-zero) threshold amount of clipping. Figure 6M As shown, because it is determined that a minimal amount of clipping or no clipping is predicted to occur (e.g., or clipping is predicted to occur less than a (e.g., non-zero) threshold level), the device 600 ceases to display the clipping indication 602d2. Figure 6M , device 600 detects a left swipe gesture 650m on exposure compensation control 636a.

[0246] like Figure 6N As shown, in response to detecting the left swipe gesture 650m, the device 600 updates the exposure compensation level, which is indicated via a new value (e.g., 1.5) represented by the exposure compensation value indication 602d1 and displayed above the value indication 636a on the exposure compensation control 636. The new exposure compensation level (e.g., Figure 6M1.5 in ) is higher than the previous exposure compensation level (e.g. Figure 6L 1.0 in ). Figure 6N In one embodiment, one or more similar techniques discussed above are used to determine that a fifth amount of highlight clipping is predicted to occur (e.g., the exposure compensation level has been adjusted far enough that highlight clipping is predicted to occur). Figure 6N As shown, because it is determined that a fifth amount of bright area (rather than dark area) clipping will occur, the device 600 displays a clipping indication 602d2 to the right of the exposure compensation indicator 602d. Figure 6N In , the clipping indication 602d2 indicates the type and amount of clipping that is predicted to occur. Figure 6N , device 600 detects an upward swipe gesture 650n from the bottom of control area 606.

[0247] exist Fig.6O In response to detecting an upward swipe gesture 650n, it is determined that a session associated with use of a camera application (e.g., an application corresponding to a camera user interface) has ended because, for example, the device 600 has stopped displaying the camera application (or closed the camera application). In some embodiments, the session associated with use of the camera application ends when the device 600 has stopped displaying or closed the camera application for a predetermined period of time. In some embodiments, the session associated with use of the camera application ends when it is determined that the camera application has stopped running on the device 600. In some embodiments, the session associated with use of the camera application ends at a particular time (e.g., at the end of the day (a particular time of the day), when the camera application is not being used, or when the camera application is interacting with a user). In some embodiments, the session associated with use of the camera application ends after the device 600 has been in a locked state for a predetermined period of time. In addition, as Fig.6O As shown, device 600 stops displaying the camera user interface and displays a user interface with application icons 690. Application icons 690 include application icons, such as camera application icon 690a. Fig.6O , the device 600 detects a tap gesture 650o on the camera application icon 690a.

[0248] like Figure 6P As shown, in response to detecting the tap gesture 650o, the device 600 stops displaying the user interface with the application icon and displays the camera user interface. Figure 6P As shown, the exposure compensation indicator 602d is in the same position as it is in the Figure 6N The same state as when it is displayed in . For example, Figure 6P In FIG. 6 , the exposure compensation value 602d1 indicates the current exposure level 1.5, which is Figure 6NThe exposure level last displayed in the camera UI is the same as the exposure level last displayed in the camera UI. Figure 6P , device 600 detects a left swipe gesture 650p from the bottom of control area 606.

[0249] like Figure 6Q As shown, in response to detecting the left swipe gesture 650p, the device 600 displays a camera user interface including settings 692 (such as exposure control settings 692a). Figure 6Q , exposure control setting 692a is set to on, indicating that the current exposure level will be maintained and will not automatically reset. Additionally, exposure control setting 692a indicates that exposure compensation indicator 602d will continue to be displayed (e.g., after exposure compensation is initially set via exposure compensation control 644). In some embodiments, control setting 692a indicates that exposure compensation indicator 602d will always be displayed (e.g., regardless of whether exposure compensation is initially set). Figure 6N to Figure 6P , device 600 in Figure 6P Exposure compensation indicator 602d is maintained in the same state (e.g., after determining that the session associated with use of the camera application has ended) because control setting 692a is set to on. Figure 6Q , the device 600 detects a tap gesture 650q on the exposure control setting 692a.

[0250] like Figure 6R As shown, in response to detecting the tap gesture 650q, the device 600 switches the exposure control setting 692a from the on state to the off state. Figure 6R , device 600 detects an upward swipe gesture 650r at the bottom of control area 606.

[0251] like Figure 6S As shown, in response to detecting the upward swipe gesture 650r, the device 600 redisplays the user interface with the camera application icon 690a. Figure 6S In response to detecting the upward swipe gesture 650r, using the above relative Fig.6O Techniques similar to those described above are used to determine that a session associated with use of the camera application has ended. Figure 6S , the device 600 detects a tap gesture 650s on the camera application icon 690a.

[0252] like Figure 6T As shown, in response to detecting the tap gesture 650s, the device 600 displays a camera user interface without the exposure compensation indicator 602d because the exposure control setting 692a is set to on (as opposed to displaying the exposure compensation indicator 602d when the exposure control setting 692a is set to off, as described above).

[0253] Figure 6U 6 shows a camera user interface with an exposure compensation indicator 602d displayed when the device 600 is operating in a video mode. Figure 6U As indicated by the video camera mode indicator 602b and the bold "Video".

[0254] Figure 6V 6 shows a camera user interface with an exposure compensation indicator 602d displayed when the device 600 is operating in portrait mode. Figure 6V As indicated by the portrait camera mode indicator 602e and the bold “PORTRAIT”.

[0255] Figure 7 700 is a flowchart showing a method for managing exposure compensation using a computer system according to some embodiments. Method 700 is performed at a computer system (e.g., 100, 300, 500, 600). The computer has one or more cameras (e.g., one or more cameras (e.g., dual cameras, triple cameras, quad cameras, etc.) on the same side or different sides (e.g., front camera, rear camera) of the computer system) and communicates with a display generation component (e.g., a display controller, a touch-sensitive display system) and one or more input devices (e.g., a touch-sensitive surface). Some operations in method 700 are optionally combined, the order of some operations is optionally changed, and some operations are optionally omitted.

[0256] As described below, method 700 provides an intuitive way to manage exposure compensation. The method reduces the cognitive burden of managing exposure compensation for the user, thereby creating a more efficient human-computer interface. For battery-powered computing systems, enabling users to manage exposure compensation faster and more efficiently saves power and increases the time between battery charges.

[0257] The computer system receives (702) a display of a camera user interface (e.g., Figure 6B A request to display a camera application or to switch to a media capture mode within a camera application) may be received by the user (e.g., a request to display a camera application or a request to switch to a media capture mode within a camera application).

[0258] In response to receiving the request to display a camera user interface and when the one or more cameras are configured to capture media (e.g., video, photo) based on a first exposure compensation value (e.g., as shown at 602d1) (e.g., a value representing an exposure amount to be used to capture the media corresponding to the field of view of the one or more cameras), the computer system displays (704) the camera user interface (e.g., Figure 6B in the user interface).

[0259] As part of displaying the camera user interface via the display generation component, the computer system displays (706) via the display generation component a first representation (e.g., 630) of the field of view of the one or more cameras (e.g., the open observable area visible to the camera, the horizontal (or vertical or diagonal) length of the image at a given distance from the camera lens) (e.g., a time-varying representation, a real-time preview feed of data from the camera). In some embodiments, this value is a default exposure compensation value for capturing media, regardless of whether an exposure compensation mode is enabled. In some embodiments, the representation of the field of view of the one or more cameras is displayed in the camera display area.

[0260] As part of displaying the camera user and in accordance with (708) determining that a set of exposure compensation criteria are satisfied, wherein the set of exposure compensation criteria includes when an exposure compensation mode is enabled (e.g., Figure 6QIn response to receiving a request (e.g., receiving input at 610) to capture media corresponding to the representation of the field of view of the one or more cameras (e.g., 630), the computer system displays (710) an exposure compensation indicator (e.g., 602d) simultaneously with the representation of the field of view of the one or more cameras (e.g., 630), the exposure compensation indicator comprising: a representation of a first exposure compensation value (e.g., as shown at 602d1) (e.g., a numerical representation (e.g., 1.5, -1.5), a sign re-transition); and a visual indication (e.g., 602d2) that the computer system has determined that a predicted clip (e.g., one or more areas of the captured media that have lost detail due to the exposure compensation setting) occurred. In some embodiments, when one or more cameras are configured to capture an image based on a first exposure compensation value, a representation of the first exposure compensation value is (or alternatively, not) displayed (e.g., displayed simultaneously with, adjacent to, and / or on a representation of the field of view of one or more cameras). In some embodiments, an exposure compensation mode is enabled when the computer system is configured to retain exposure adjustments when displaying different representations of the field of view of one or more cameras (e.g., representations captured over time or representations of different scenes) and / or when the computer system is configured to show an exposure adjustment indicator. In some embodiments, an exposure compensation mode is enabled when the exposure compensation indicator is selected and / or when a new exposure compensation is set (e.g., via an exposure adjustment control). In some embodiments, when clipping occurs, the clipping area may be represented by a minimum brightness or a maximum brightness in the representation of the captured media. In some embodiments, the clipping area in the representation of the captured media has a different brightness, bright areas, dark areas, and / or a different level of detail (e.g., less detail) than an area corresponding to the clipping area in the representation of the field of view of one or more cameras. In some embodiments, a representation of exposure compensation and a visual indication (e.g., the computer system has determined that a clip is predicted to occur) are displayed simultaneously. In some embodiments, the exposure compensation indicator is displayed in the camera indicator area. In some embodiments, the camera indicator area includes a plurality of indicators (e.g., enable representations, optional user interface objects) that configure the computer system to capture media based on one or more camera settings (e.g., exposure settings, flash settings, low light mode settings, timer settings, etc.). In some embodiments, the exposure compensation value is represented above the visual indication. In some embodiments, based on a determination that the set of exposure compensation standards is not met, the computer system abandons displaying the exposure compensation indicator. In some embodiments, based on a determination that the set of exposure compensation standards is not met, a first representation is displayed with a default exposure compensation value (e.g., a zero value), wherein the computer system is configured to capture media using the default exposure compensation value when the exposure compensation mode is not enabled.In some embodiments, the computer system determines that a predictive clip will occur in response to receiving a request to capture media corresponding to a field of view of one or more cameras by receiving one or more indications or based on a determination made by one or more external devices that a predictive clip will occur in response to receiving a request to capture media corresponding to a field of view of one or more cameras. Displaying an exposure compensation indicator including an exposure compensation value and an indicator of a predictive clip provides feedback to the user about the relationship between the current exposure compensation value, the current scene in the field of view of the system's camera, and the predictive clip that may occur when capturing media corresponding to the current scene. Thus, displaying the exposure compensation indicator allows the user to visually determine how adjustments to the current exposure compensation value and / or scene changes in the field of view of at least one camera will affect the predictive clip. Providing improved visual feedback to the user enhances the operability of the system and makes the user-system interface more efficient (e.g., by helping the user provide appropriate input and reducing user errors when operating / interacting with the system), which in turn reduces power usage and extends the battery life of the system by enabling the user to use the system more quickly and efficiently. Displaying an exposure compensation indicator including an exposure compensation value and an indicator of predicted clipping provides feedback to the user regarding the relationship between the current exposure compensation value, the current scene in the field of view of the system's camera, and the predicted clipping that may occur when capturing media corresponding to the current scene, which reduces the number of times media needs to be captured to obtain images with reduced (e.g., or few) clipping. Reducing the number of operations that need to be performed enhances the operability of the system and makes the user-system interface more efficient (e.g., by helping the user provide appropriate input and reducing user errors when operating / interacting with the system), which in turn reduces power usage and extends the battery life of the system by enabling the user to use the system more quickly and efficiently.

[0261] In some embodiments, while the exposure compensation indicator (e.g., 602d) is displayed and based on determining that the clip that is predicted to occur is a first type of clip, at a first position (e.g., Figure 6B In some embodiments, when the exposure compensation indicator is displayed and based on determining that the clip that is predicted to occur is a second type of clip that is different from the first type of clip, at a second location different from the first location (e.g., Figure 6JIn some embodiments, a first type of clip is a clip (e.g., a clip that is predicted to occur in response to receiving a request to capture media (e.g., when a higher portion of a scene is captured) based on a value of a parameter of the media (e.g., brightness intensity) being above a range of values ​​for the parameter (e.g., brightness intensity values ​​(e.g., clipping of bright areas, clipping of brighter / white areas)), a captureable range (e.g., a range of brightness intensity values ​​that can be captured by a computer system), a representable range (e.g., a range of brightness intensity values ​​that can be represented by a computer system)). In some embodiments, the second type of clipping is based on a clipping (e.g., predicting that a clip will occur in response to receiving a request to capture media (e.g., displaying a clip (e.g., when a darker area (e.g., a black area) is represented in less detail than other areas of the scene)). In some embodiments, the second type of clipping is based on a clipping (e.g., predicting that a clip will occur in response to receiving a request to capture media (e.g., when a darker area (e.g., a black area) is represented in less detail than other areas of the scene)). In some embodiments, while displaying the visual indication displayed at the first location and based on determining that a second (e.g., new, subsequent) clip is predicted to occur in response to receiving a request to capture media corresponding to a field of view of the one or more cameras, and the second clip is a clip of the first type, the computer system displays the visual indication at the first location; and while displaying the visual indication at the first location and based on determining that a second (e.g., new, subsequent) clip is predicted to occur in response to receiving a request to capture media corresponding to a field of view of the one or more cameras, and the second clip is a clip of the second type In some embodiments, the visual indication moves from a first position to a second position, or vice versa. In some embodiments, the first position is on one side of the exposure compensation indicator (e.g., right side / left side / top side / bottom side), and the second position is on the side opposite to the side where the first position is located (e.g., left side / right side / bottom side / top side). Indicators of predicted clips are displayed at different positions on the exposure compensation indicator, where each position corresponds to a type of clip that is predicted to occur, providing feedback to the user on how to adjust the current exposure compensation value and / or scene changes in the camera field of view to affect (e.g., reduce) the predicted clips.Providing improved visual feedback to the user enhances the operability of the system and makes the user-system interface more efficient (e.g., by helping the user provide appropriate inputs and reducing user errors when operating / interacting with the system), which in turn reduces power usage and extends the battery life of the system by enabling the user to use the system more quickly and efficiently. Displaying an indicator of predicted clipping at a location when light area clipping is predicted to occur and when dark area clipping is predicted to occur provides the user with feedback on how to adjust the current exposure compensation value and / or scene changes in the camera's field of view to affect (e.g., reduce) predicted clipping. Providing improved visual feedback to the user enhances the operability of the system and makes the user-system interface more efficient (e.g., by helping the user provide appropriate inputs and reducing user errors when operating / interacting with the system), which in turn reduces power usage and extends the battery life of the system by enabling the user to use the system more quickly and efficiently.

[0262] In some embodiments, prior to a first time (e.g., when an exposure compensation indicator is displayed), a visual indication is displayed having a first visual appearance (e.g., Figure 6B In some embodiments, at the first time when the exposure compensation indicator is displayed and based on determining that the predicted clipping has changed (e.g., the amount of clipping has changed, the type of clipping has changed), the computer system displays a visual indication (e.g., Figure 6C 602d2) is displayed as having a different visual appearance than the first visual appearance (e.g., Figure 6BIn some embodiments, based on determining that the predicted clipping has increased (or alternatively, decreased), the visual indicator has an appearance (e.g., a second appearance) that is thicker (e.g., thicker, higher opacity) (e.g., in width) and / or longer (e.g., in height) (or alternatively, thinner (e.g., in width) and / or shorter (e.g., in height)) than the appearance that the visual indicator previously had (e.g., the first appearance). In some embodiments, displaying the visual indication as having a second appearance different from the first visual appearance includes animating (e.g., gradually animating) a change in the visual indication from the first visual appearance to the second visual appearance (e.g., thickening or thinning). In some embodiments, the determination regarding the predicted clipping changes when the field of view of one or more cameras and / or an object in the field of view of one or more cameras changes. In some embodiments, the predicted clipping changes in response to a change in the first compensation value to a second exposure compensation value (e.g., via an optional exposure compensation control (e.g., a slider)). In some embodiments, the predicted clipping changes in response to a change in the field of view of one or more cameras (e.g., a change in the scene of the field of view of one or more cameras). Displaying an indicator of the predicted clipping based on the magnitude of the predicted clipping provides feedback to the user on how to adjust the current exposure compensation value and / or scene changes in the camera field of view to affect (e.g., reduce) the predicted clipping. Providing improved visual feedback to the user enhances the operability of the system and makes the user-system interface more efficient (e.g., by helping the user provide appropriate input and reducing user errors when operating / interacting with the system), which in turn reduces power usage and extends the battery life of the system by enabling the user to use the system more quickly and efficiently.

[0263] In some embodiments, a visual indication (e.g., 602d2) is displayed via a display generation component at a location outside the first representation (e.g., away from the first representation, not on the first representation, not overlapping the first representation). In some embodiments, the exposure compensation indicator is located at a location outside the first representation. Displaying an indicator of a predicted clip of a representation away from the scene provides feedback to the user about the relationship between the current exposure compensation value, the current scene in the field of view of the system's camera, and the predicted clip that may occur when capturing media corresponding to the current scene, while allowing viewing of a representation of the scene in the field of view of at least one camera of the computer system with fewer visual elements overlaid on the representation of the scene, which can reduce the number of times required to capture the expected scene. Reducing the number of inputs required to perform an operation enhances the operability of the system and makes the user-system interface more efficient (e.g., by helping the user provide appropriate inputs and reducing user errors when operating / interacting with the system), which in turn reduces power usage and extends the battery life of the system by enabling the user to use the system more quickly and efficiently.

[0264] In some embodiments, when displaying a representation including a first exposure compensation value (e.g., Figure 6B In some embodiments, in response to detecting the change in the field of view of one or more cameras, the computer system continues to display the first exposure compensation value (e.g., as shown in 602d1 in FIG. 1 ). Figure 6C In some embodiments, based on determining that the change in the field of view of one or more cameras is above a threshold value (e.g., a non-zero threshold value) (a threshold value indicating an amount of change in the field of view or an amount of change in the scene), the computer system continues to display the exposure compensation indicator including the first exposure compensation value. In some embodiments, based on determining that the change in the field of view of one or more cameras is above a threshold value, the computer system continues to display the exposure compensation indicator including the first exposure compensation value. Maintaining the exposure compensation value as the scene changes reduces the number of inputs required to reset the compensation value (or eliminates the input) each time the scene changes, and also reduces the number of times the exposure compensation is reset when the scene in the field of view of one or more cameras temporarily changes. Reducing the number of inputs required to perform an operation enhances the operability of the system and makes the user-system interface more efficient (e.g., by helping the user provide appropriate inputs and reducing user errors when operating / interacting with the system), which in turn reduces power usage and extends the battery life of the system by enabling the user to use the system more quickly and efficiently.

[0265] In some embodiments, one or more cameras are configured to capture an image based on a cumulative exposure compensation value based on a first exposure compensation value (e.g., as shown in 602d1) and a compensation offset value (e.g., Figure 6H The sum of 644a).

[0266] In some embodiments, based on determining that the set of exposure compensation criteria is satisfied, the computer system accumulates an indication of the exposure compensation value (e.g., Fig.6I In some embodiments, while displaying the exposure compensation indicator (e.g., including a representation of the first exposure compensation value), the computer system receives one or more user inputs (e.g., a tap input followed by a drag input), and, in response to receiving the one or more user inputs, the computer system displays the cumulative exposure compensation value simultaneously with the exposure compensation indicator including the representation of the first compensation value. Displaying the indication of the cumulative exposure compensation value provides feedback to the user about how the exposure compensation value and the bias compensation value affect the exchangeable exposure amount that will be used to capture media in response to a request to capture media. Providing improved visual feedback enhances the operability of the system and makes the user-system interface more efficient (e.g., by helping the user provide appropriate input and reducing user errors when operating / interacting with the system), which in turn reduces power usage and extends the battery life of the system by enabling the user to use the system more quickly and efficiently.

[0267] In some embodiments, when displaying a representation including a first exposure compensation value (e.g., Figure 6G When an exposure compensation indicator (e.g., 602d) is displayed on the display (e.g., 602d1 in FIG), the computer system detects one or more user inputs (e.g., 650f, 650g, 650h) via one or more input devices (e.g., a tap input followed by a drag input, such as on a viewfinder of a field of view of one or more cameras). In some embodiments, in response to detecting the one or more inputs, the computer system changes the compensation offset value from a default compensation offset value (e.g., Figure 6G 644a) (eg, a default compensation value (eg, a zero value)) is changed to a new compensation offset value (eg, Figure 6H644a in (e.g., a non-zero value, a new compensation value). In some embodiments, the computer system is configured to capture an image based on a cumulative compensation that is based on the sum of the first exposure compensation value and the bias compensation value, and continue to display a representation of the first exposure compensation value. In some embodiments, while displaying an exposure compensation indicator that includes a representation of the first exposure compensation value and the compensation bias value is changed to a new compensation value, the computer system detects a change in the field of view of one or more cameras (e.g., a scene change). In some embodiments, in response to detecting a change in the field of view of one or more cameras and based on determining that the change in the field of view of one or more cameras is above a threshold (e.g., a non-zero threshold) (a threshold indicating an amount of change in the field of view or an amount of change in the scene), the computer system updates (e.g., resets) the compensation bias value to a default compensation bias value and continues to display a representation of the first exposure compensation value (e.g., Figure 6J 602d2 in). In some embodiments, in response to detecting a change in the field of view of one or more cameras and based on determining that the change in the field of view of one or more cameras is above a threshold, the computer system continues to display the exposure compensation indicator including an indication of the first exposure compensation value (e.g., the exposure compensation value does not change), and abandons updating (e.g., resetting) the compensation value to a default bias compensation value and / or maintains the bias compensation value (e.g., the bias compensation value does not change). Maintaining the exposure compensation value and updating the bias value when the scene changes reduces the number of inputs required to reset the compensation value each time the scene changes, and also reduces the number of times the exposure compensation is reset when the scene in the field of view of one or more cameras temporarily changes. Reducing the number of inputs required to perform operations enhances the operability of the system and makes the user-system interface more efficient (e.g., by helping the user provide appropriate inputs and reducing user errors when operating / interacting with the system), which in turn reduces power usage and extends the battery life of the system by enabling the user to use the system more quickly and efficiently.

[0268] In some embodiments, based on determining that a set of reset criteria are met, the computer system sets the first exposure compensation value to a default compensation value (e.g., Figure 6T In some embodiments, the set of reset criteria includes a first criterion that is satisfied when the media capture session ends and a second criterion that is satisfied when the exposure compensation hold mode is not enabled (e.g., Figure 6R In some embodiments, based on determining that the set of reset criteria is not met, the computer system abandons setting the first exposure compensation value to a first (e.g., default) compensation value (e.g., Figure 6P In some embodiments, the computer system maintains the first exposure compensation value as the value of the first exposure compensation value before the media capture session ends.

[0269] In some embodiments, the set of exposure compensation criteria includes when the exposure compensation hold mode is enabled (e.g., Figure 6Q 692a in ). In some embodiments, the set of exposure compensation criteria includes criteria that are satisfied when the first exposure compensation value is not equal to the default compensation value. In some embodiments, the set of exposure compensation criteria includes criteria that are satisfied when the exposure compensation hold mode is enabled and the exposure compensation is a default value. In some embodiments, the set of exposure compensation criteria includes criteria that are satisfied when the first exposure compensation value is not equal to the default compensation value and the exposure compensation hold mode is enabled and the exposure compensation is a default value. Automatically displaying the exposure compensation indicator only when specified conditions are met allows the indicator to be displayed without requiring additional user input. Performing operations when a set of conditions have been met without requiring further user input enhances the operability of the system and makes the user-system interface more efficient (e.g., by helping the user provide appropriate input and reducing user errors when operating / interacting with the system), which in turn reduces power usage and extends the battery life of the system by enabling the user to use the system more quickly and efficiently.

[0270] In some embodiments, based on determining that the set of exposure compensation criteria is not met, the computer system forgoes displaying the exposure compensation indicator (e.g., Figure 6M 602 in). In some embodiments, after displaying the exposure compensation indication, the computer system receives one or more inputs for deactivating the exposure compensation mode (e.g., receiving input on a selectable user interface object for configuring the exposure compensation mode), and in response to receiving the one or more inputs, the computer system stops displaying the exposure compensation indicator (e.g., the previously displayed exposure compensation indicator). Automatically displaying the exposure compensation indicator when specified conditions are met allows the indicator to be displayed without requiring additional user input. Performing operations when a set of conditions have been met without requiring further user input enhances the operability of the system and makes the user-system interface more efficient (e.g., by helping the user provide appropriate input and reducing user errors when operating / interacting with the system), which in turn reduces power usage and extends the battery life of the system by enabling the user to use the system more quickly and efficiently.

[0271] In some embodiments, at a second time when the exposure compensation indicator is displayed and based on determining that the predicted clip has changed, the computer system displays an animation (e.g., a transition of the exposure compensation indicator from a first visual state (e.g., a first position and / or visual appearance (e.g., thickness, size, color, boldness, opacity) of the indicator, a visual state of a first compensation value) to a second visual state different from the first visual state (e.g., a first position and / or visual appearance (e.g., thickness, size, color, boldness, opacity) of the indicator, a visual state of a second compensation value). FIG. 6B to FIG. 6D 602 in). In some embodiments, the animation includes moving the visual indication at different locations, thinning / thickening the visual indication, and / or displaying a change from a first compensation value to a second compensation value. Animating the exposure compensation indicator change when the predicted clip changes that occur provides feedback to the user that adjustments to the current exposure compensation value and / or scene changes in the field of view of at least one camera have affected (e.g., reduced) the predicted clip. Providing improved visual feedback to the user enhances the operability of the system and makes the user-system interface more efficient (e.g., by helping the user provide appropriate input and reducing user errors when operating / interacting with the system), which in turn reduces power usage and extends the battery life of the system by enabling the user to use the system more quickly and efficiently.

[0272] In some embodiments, while displaying the exposure compensation indicator (e.g., 602d), the computer system receives a selection (e.g., 650k) of the exposure compensation indicator (e.g., 602d) (e.g., a selectable user interface object) (e.g., a tap on the exposure compensation indicator). In some embodiments, in response to receiving the selection of the exposure compensation indicator (e.g., 650k), the computer system displays a control (e.g., 636) (e.g., an adjustable control, a slider) for adjusting exposure compensation, which, when selected (e.g., 650l), causes the exposure compensation indicator (e.g., as shown in FIG. 6A ) to be adjusted. Figure 6M602d1 in ). In some embodiments, the adjustable control includes scale marks, where each scale mark represents a value on the adjustable control. In some embodiments, when a control for adjusting exposure compensation is displayed, the computer system displays a first indication of a current exposure compensation value (e.g., a number, a slider knob (e.g., a bar) on a slider track); and in response to receiving a request to adjust the control for adjusting exposure compensation (e.g., a drag gesture (e.g., dragging an indication (e.g., a slider bar) from one corresponding position (e.g., a scale line) on the adjustable control to another corresponding position on the adjustable control)) (and when the control for adjusting exposure compensation is displayed), the computer system replaces display of a first indication of a first exposure compensation value with display of a second indication of a second exposure compensation value and / or captures media based on the second exposure compensation value (e.g., does not capture media based on the first exposure compensation value). In some embodiments, updating the exposure compensation indicator includes displaying a representation of a second exposure compensation value that is different from a representation of the first exposure compensation value (and ceasing to display the representation of the first exposure compensation value). In some embodiments, updating the exposure compensation indicator includes displaying a visual indication (e.g., of a predicted clip) with a different visual appearance and / or at a different location.

[0273] In some embodiments, while the exposure compensation indicator is displayed (e.g., 602d) and based on determining that the predicted clip will not occur (e.g., is unlikely to occur) in response to receiving a request to capture media corresponding to a representation of the field of view of the one or more cameras, the computer system ceases to display the visual indication (e.g., Figure 6M In some embodiments, after the first compensation value has been changed to the second compensation value, clipping is predicted not to occur. In some embodiments, after a change in the field of view of one or more cameras is detected (e.g., after the scene in the field of view of one or more cameras has changed), clipping is predicted not to occur. In some embodiments, while the exposure compensation indicator is displayed and based on determining that the predicted clipping occurs in response to receiving a request to capture media corresponding to the representation of the field of view of one or more cameras, the computer system continues to display the visual indication. Ceasing to display the indication of the predicted clip when the specified condition is met provides feedback to the user that the adjustment of the current exposure compensation value and / or the scene change in the field of view of at least one camera has affected (e.g., reduced) the predicted clipping. Providing improved visual feedback to the user enhances the operability of the system and makes the user-system interface more efficient (e.g., by helping the user provide appropriate input and reducing user errors when operating / interacting with the system), which in turn reduces power usage and extends the battery life of the system by enabling the user to use the system more quickly and efficiently.

[0274] It should be noted that the process described above with respect to method 700 (eg Figure 7 ) also apply in a similar manner to the methods described below. For example, method 900 optionally includes one or more of the characteristics of the various methods described above with reference to method 700. For example, the above method 700 can be used to configure a computer system to capture media with corresponding exposure compensation amounts, which media can be displayed using the methods described below with respect to method 900. For the sake of brevity, these details are not repeated below.

[0275] FIG. 8A to FIG. 8L An exemplary user interface for displaying media using an electronic device according to some embodiments is shown. The user interface in these figures is used to illustrate the following description including Fig. 9 The process of the process.

[0276] Fig. 8A The electronic device 600 is shown displaying a media library user interface 810 including thumbnail media representations 812. The thumbnail media representations 812 include thumbnail media representations 812a-812g, wherein each of the thumbnail media representations 812a-812g represents a different media item (e.g., a media item captured at a different time instance). Fig. 8A In , media representations 812 include thumbnail media representations representing at least two types of media items. For example, thumbnail media representations 812a, 812b, and 812g represent media items that do not include high dynamic range ("HDR") content, and thumbnail media representations 812c-812h represent media items that include HDR content. Fig. 8A , thumbnail media representations 812c-812h are displayed as having no HDR content in the media library user interface 810, even though they represent media items that include HDR content.

[0277] like Fig. 8A As shown, the thumbnail media representations 812a-812g are each displayed with a "non-HDR" label or an "HDR" label. It should be understood that the inclusion of the "non-HDR" label and the "HDR" label is intended to facilitate readers of the subject matter of this document to quickly identify whether a particular thumbnail media representation represents a media item that does not include HDR content (a "non-HDR media item") or a media item that includes HDR content (an "HDR media item"). Therefore, the "non-HDR" label and the "HDR" label should not be considered to be displayed as part of the user interface, the thumbnail media representations 812a-812g, and / or as part of the particular media item represented by a particular thumbnail media representation. Fig. 8A , device 600 detects a tap gesture 850a on thumbnail media representation 812a.

[0278] like Figure 8B As shown, in response to detecting the tap gesture 850a, the device 600 displays the media viewer user interface 820 and stops displaying the media library user interface 810. The media viewer user interface 820 includes a media viewer area 824 located between the application control area 822 and the application control area 826. The media viewer area 824 includes an enlarged media representation 824a, which represents the same media item as the thumbnail media representation 812a. Therefore, the enlarged media representation 824a represents a non-HDR media item, which is represented by Figure 8B . Media viewer user interface 820 is substantially free of controls, while application control area 822 and application control area 826 are substantially covered with controls.

[0279] Application controls area 822 optionally includes the current time (e.g., Figure 8B ) indicator, the current date ( Figure 8B 18, 2019)), a cellular signal status indicator 820a indicating the cellular signal status, and a battery charge status indicator 820b indicating the remaining battery life status of the device 600. The application control area 822 also includes a return enable representation 822a (e.g., when it is selected, it causes the device 600 to redisplay the media library user interface 810) and an edit enable representation 824b (e.g., when it is selected, it causes the device 600 to display a media editing user interface that includes one or more controls for editing a representation of a media item represented by the currently displayed enlarged media representation).

[0280] Application control area 826 includes some of thumbnail media representations 812 (e.g., 812a-812f) displayed in a single row. Because enlarged media representation 824a is displayed, thumbnail media representation 812a is displayed as being selected. Specifically, thumbnail media representation 812a is displayed as being the only thumbnail media representation displayed with spacing (e.g., space between thumbnail media representation 812a and thumbnail media representation 812b). Figure 8B In addition, application control area 826 includes a send enable indication 826b (e.g., when selected, causing device 600 to initiate a process for transmitting the media item represented by the enlarged media representation), a favorites enable indication 826c (e.g., when selected, causing device 600 to mark / unmark the media item represented by the enlarged representation as favorite media), and a recycle bin enable indication 826d (e.g., when selected, causing device 600 to delete (or initiate a deletion process) the media item represented by the enlarged media representation).

[0281] like Figure 8BAs shown, application control area 822 and application control area 826 ("application control areas") are background portions of the area of ​​media viewer user interface 820. Figure 8B 8, the application controls are located at the edge of the media viewer user interface 820. The application control area 822 is the header of the media viewer user interface, and the application control area 826 is the footer of the media viewer user interface 820.

[0282] like Figure 8B As shown, the application control area includes a light-colored (e.g., light gray, bright color) overlay. The light-colored overlay indicates that the device 600 is not operating in dark mode. In some embodiments, when the device 600 is operating in dark mode, the application control area includes a dark-colored overlay (e.g., dark gray, black), as described below with respect to Figures 8K to 8L For illustrative purposes, the application control region includes shading lines that indicate the degree to which the application control region is shaded. For example, an application control region that is shown with a higher line density (e.g., lines that are closer to each other) has a darker visual appearance than an application control region that is shown with a lower line density (e.g., lines that are less close to each other). FIG. 8B to FIG. 8K The shading shown in the application control area in indicates the darkness / lightness or color of the corresponding portion of media viewer user interface 820.

[0283] like Figure 8B As shown, the application control area is displayed with a default color (e.g., a shade level of color), such as Figure 8B Indicated by the hatching shown in . Figure 8B , device 600 displays the application control area with a default color (and / or a default brightness level) because the enlarged media representation 824a represents a non-HDR media item. Figure 8B , device 600 detects a left swipe gesture 850b in media viewer area 824.

[0284] like Figure 8C As shown, in response to detecting the left swipe gesture 850b, device 600 replaces enlarged media representation 824a with enlarged media representation 824b. Enlarged media representation 824b represents the same media item as thumbnail media representation 812b. Thus, enlarged media representation 812b represents a non-HDR media item (e.g., as described above with respect to Fig. 8A The thumbnail media representation 812b discussed in Figure 8CIn response to detecting left swipe gesture 850b, device 600 updates thumbnail media representation 812 to show that the media item corresponding to thumbnail media representation 812b is being displayed as an enlarged media representation in media viewer area 824.

[0285] like Figure 8C As shown, in response to detecting the left swipe gesture 850b, the device 600 continues to display the application control area with a default color, such as Figure 8C The hatching shown in the figure has the same Figure 8B The same density of hatching lines in Figure 8C , device 600 continues to display the application control area with a default color because the enlarged media representation 824a represents a non-HDR media item. Figure 8C , device 600 detects a left swipe gesture 850c in media viewer area 824.

[0286] like Fig.8D As shown, in response to detecting the left swipe gesture 850c, device 600 replaces enlarged media representation 824b with enlarged media representation 824c. Enlarged media representation 824c represents the same media item as thumbnail media representation 812c. Thus, enlarged media representation 812c represents an HDR media item (e.g., as described above with respect to Fig. 8A The thumbnail media representation 812c discussed in Fig.8D It is indicated by the label "HDR". Fig. 8A The thumbnail media representation 812c does not include HDR content for visual display, but Fig.8D The upscaled media representation 824b includes HDR content for visual display. Fig.8D As shown, the device 600 also uses similar techniques and for the same purpose as above (e.g., in FIG. 8B to FIG. 8C Thumbnail media representation 812 is updated to show thumbnail 812c for similar reasons as described in ).

[0287] like Fig.8D As shown, in response to detecting the left swipe gesture 850c, the device 600 updates the application control area to have a larger area than the left swipe gesture 850c. Figure 8C A brighter color (e.g., a lighter color, a color with more white) in the application control area (e.g., Fig.8D The hatching line has a Figure 8C The shadow lines have a lower density level). Fig.8D In the embodiment, the device 600 updates the application control area to have a brightness of the HDR content in the corresponding media item (e.g., the media item represented by the currently displayed enlarged media representation). Fig.8DThe colors shown in .

[0288] exist Fig. 8E , device 600 continues to display the enlarged media representation 824c. As the device continues to display the enlarged media representation 824c (e.g., Fig. 8E ), it is determined that the enlarged media representation 824c has been displayed for longer than a predetermined period of time. Fig. 8E As shown, because it is determined that the enlarged media representation 824c has been displayed for longer than the predetermined period of time, the device 600 updates the application control area to have a larger image size than the image shown in FIG. Fig.8D The color of the application control area displayed in the brighter color (for example, Fig. 8E The hatching is shown as Fig.8D The shadow lines have a lower density level). Fig.8D The brighter color of the application control area in is based on the brightness of the HDR content in the corresponding media item (e.g., the media item represented by the currently displayed upscaled media representation). Fig. 8E In some embodiments, device 600 brightens the color of the application control area based on the amount of time that enlarged media representation 824c has been displayed. In some embodiments, device 600 does not brighten the color of the application control area regardless of the amount of time that enlarged media representation 824c is displayed. Fig. 8E In some embodiments, device 600 does not further brighten the color of the application control area because it is determined that the color has reached a maximum brightness level based on the level of HDR content in the HDR media represented by upscaled media representation 824c. In some embodiments, reference FIG. 8C to FIG. 8E After displaying the enlarged media representation 824c, the device 600 displays the application control area from Figure 8C The color of the application control area gradually lightens to Fig. 8E Animates the color of the application control area.

[0289] In some embodiments, the device 600 brightens (or darkens) the color of the application control area based on the rate of gestures received before the enlarged media representation is displayed (e.g., swipe gesture 850c, or the time to transition the enlarged media representation to be displayed) (e.g., in addition to or instead of based on the time the enlarged media representation is displayed). In some embodiments, the device 600 brightens (or darkens) the color of the application control area more when gestures are detected for a longer duration, and brightens (or darkens) the color of the application control area less when gestures are detected for a shorter duration. In some embodiments, the device 600 brightens (or darkens) the color of the application control area based on the average rate of gestures received before the enlarged media representation is displayed (e.g., gestures 850b and 850c). In some embodiments, the device 600 brightens (or darkens) the color of the application control area more when the average rate of gestures is lower, and brightens (or darkens) the color of the application control area less when the average rate of gestures is higher. Fig. 8E , device 600 detects a tap gesture 850e on thumbnail representation 812d.

[0290] like Fig.8F As shown, in response to detecting the tap gesture 850e, the device 600 replaces the enlarged media representation 824c with the enlarged media representation 824d. The enlarged media representation 824d represents the same media item (e.g., HDR media item) as the thumbnail media representation 812d, which is Fig.8F In response to detecting tap gesture 850e, device 600 also updates thumbnail media representation 812 to show that the media item corresponding to thumbnail media representation 812d is being displayed as an enlarged media representation in media viewer area 824. FIG. 8D to FIG. 8E ) and amplifying media representation 824d (e.g., in Fig.8F ), enlarged media representation 824d is visually darker than enlarged media representation 824c. Fig.8F At 80, it is determined that the media item represented by the enlarged media representation 824d includes HDR content having a second brightness amount. The second brightness amount of the HDR content in the media item represented by the enlarged media representation 824d is greater than that of the HDR content in the media item represented by the enlarged media representation 824d. FIG. 8D to FIG. 8E The upscaled media representation 824c represents a media item in which the brightness amount of the HDR content is darker.

[0291] like Fig.8F As shown, in response to detecting the tap gesture 850e and because it is determined that the media item represented by the enlarged media representation 824d includes content having a second brightness amount, the device 600 updates the color of the application control area. Specifically, the device 600 updates the color of the application control area so that Fig.8F The application control area is larger than Fig. 8E The application controls area is darker. Fig.8F In the example, device 600 will Fig.8F Updated the color of the application controls area to be more visually Fig. 8E The application control area is darker because the enlarged media representation 824d (e.g., Fig.8F ) is represented by the upscaled media representation 824c (e.g., Fig. 8E Therefore, device 600 updates the color of the application control area based on the brightness of the HDR content in the media item currently displayed on device 600 (e.g., via a zoomed-in media representation). In some embodiments, the brightness level of the HDR content in the media item is based on the number of bright portions in the media item, the overall brightness of the media item, the brightest portions of the media item, and / or the brightness of certain portions of the media item. In some embodiments, device 600 determines how much to darken the color of the application control area using one or more of the techniques described above. Fig.8F , device 600 detects a left swipe gesture 850 f in media viewer area 824 .

[0292] like Figure 8G As shown, in response to detecting the left swipe gesture 850f, the device 600 replaces the enlarged media representation 824d with the enlarged media representation 824e. The enlarged media representation 824e represents the same media item (e.g., HDR media item) as the thumbnail media representation 812e, which is Figure 8G In response to detecting the left swipe gesture 850f, device 600 also updates thumbnail media representation 812 to show that the media item corresponding to thumbnail media representation 812e is being displayed as an enlarged media representation in media viewer area 824. When comparing enlarged media representation 824d (e.g., Fig.8F ) and enlarged media representation 824e (e.g., in Fig.8F ), enlarged media representation 824e is visually darker than enlarged media representation 824d (e.g., and enlarged media representation 824c, as described above). Figure 8G 824d, the media item represented by upscaled media representation 824e is determined using one or more of the techniques described above to include HDR content having a third luminance amount. The third luminance amount of the HDR content in the media item represented by representation 824e is brighter than the second luminance amount of the HDR content in the media item representation represented by representation 824d.

[0293] like Figure 8GAs shown, in response to detecting the left swipe gesture 850f and due to determining that the media item represented by the enlarged media representation 824e includes HDR content having a third brightness amount, the device 600 updates the color of the application control area. Figure 8G In the embodiment, the device 600 updates the color of the application control area so that Figure 8G The application control area is larger than FIG. 8E to FIG. 8D The application control area is brighter (e.g., because the third brightness amount (e.g., Figure 8G ) is greater than the second brightness amount (e.g., Fig.8D )). As described above, the device 600 uses one or more techniques to update Figure 8G The color of the application area. Figure 8G , device 600 detects a left swipe gesture 850g in media viewer area 824.

[0294] FIG. 8H to FIG. 8I 850g is displayed. In some embodiments, the media viewer user interface 820 is displayed in response to the device 600 detecting the left swipe gesture 850g. Figure 8H and after the media viewer user interface 820 is displayed for a predetermined period of time, displaying the media viewer user interface 820 Figure 8I The media viewer user interface 820 of FIG. 8D to FIG. 8E In some embodiments, Figure 8H The media viewer user interface 820 of is not displayed in response to detecting the left swipe gesture 850g, and Figure 8I Media viewer user interface 820 of is displayed in response to detecting left swipe gesture 850g.

[0295] like Figure 8H (and Figure 8I ), in response to detecting the tap gesture 850g, the device 600 replaces the enlarged media representation 824e with the enlarged media representation 824f. The enlarged media representation 824f represents the same media item (e.g., HDR media item) as the thumbnail media representation 812f, which is Figure 8H (and Figure 8I ) is indicated by the “HDR” label in the media viewer area 824. In response to detecting the tap gesture 850g, the device 600 also updates the thumbnail media representation 812 to show that the media item corresponding to the thumbnail media representation 812f is being displayed as an enlarged media representation in the media viewer area 824. Figure 8G ) and enlarged media representation 824f (e.g., in Figure 8H), the enlarged media representation 824f is visually brighter than the enlarged media representation 824e. Figure 8H (or Figure 8I ), it is determined that the media item represented by the upscaled media representation 824f has HDR content that exceeds a brightness threshold.

[0296] like Figure 8I As shown, because it is determined that the media item (e.g., represented by the enlarged media representation 824f) exceeds the brightness threshold (e.g., and in response to detecting the swipe gesture 850g), the device 600 dims the HDR content of the enlarged media representation 824f (e.g., Figure 8I The enlarged media representation 824f is shown, which has a ratio Figure 8H In addition, the device 600 updates the color of the application control area so that Figure 8I The application control area is larger than Figure 8G As described above, device 600 uses one or more techniques to update Figure 8I The color of the application area. Figure 8I When it is determined that the media item exceeds the brightness threshold, the device 600 modifies both the enlarged media representation and the application control area of ​​the media item so that the brightness of the enlarged media representation is closer to the brightness of the application control area. In some embodiments, the device 600 displays a less visually distracting media user interface by displaying the application control area with a brightness closer to the brightness of the enlarged representation. Figure 8I , device 600 detects a left swipe gesture 850i in media viewer area 824.

[0297] like Figure 8J As shown, in response to detecting the left swipe gesture 850i, the device 600 replaces the enlarged media representation 824f with the enlarged media representation 824g. The enlarged media representation 824g represents the same media item (e.g., a non-HDR media item) as the thumbnail media representation 812g, which is Figure 8J Indicated by the "Non-HDR" label. Figure 8J As shown, in response to detecting the left swipe gesture 850i and because the corresponding media item is a non-HDR media item, the device 600 updates the color of the application control area to a default color (e.g., by Figure 8J The Figure 8B The same density of hatching lines in the figure).

[0298] Figures 8K to 8L Device 600 is shown operating in dark mode and / or displaying a dark overlay in an application area. Figure 8KAs shown, device 600 displays an application control area with a dark overlay (e.g., dark gray, black; non-translucent) and an enlarged media representation 824b displayed in media viewer area 824. Figure 8K , device 600 detects a left swipe gesture 850k in media viewer area 824.

[0299] like Figure 8L As shown, in response to detecting the left swipe gesture 850k, device 600 replaces enlarged media representation 824b with enlarged media representation 824c. Enlarged media representation 824c represents the same media item as thumbnail media representation 812c. Thus, enlarged media representation 812c represents an HDR media item (e.g., as described above with respect to Fig. 8A The thumbnail media representation 812c discussed in Fig.8D Indicated by the label "HDR". Figure 8K As shown, the device 600 continues to display the application control area with Figure 8K , even though the enlarged media representation 812 c represents an HDR media item. Thus, when device 600 displays the application area with a dark overlay, device 600 does not update the visual appearance of the application control area based on the brightness of the HDR content in the media item (e.g., unlike when device 600 displays the application control area with a light overlay, FIG. 8C to FIG. 8D (When device 600 updates the visual appearance of the application control area).

[0300] Fig. 9 900 is a flowchart illustrating a method for displaying media using a computer system according to some embodiments. Method 900 is performed at a computer system (e.g., 100, 300, 500, 600) in communication with a display generation component (e.g., a display controller, a touch-sensitive display system) and one or more input devices (e.g., a touch-sensitive surface). Some operations in method 900 are optionally combined, the order of some operations is optionally changed, and some operations are optionally omitted.

[0301] As described below, method 900 provides an intuitive way to display media. The method reduces the cognitive burden on the user when displaying media, thereby creating a more efficient human-computer interface. For battery-powered computing systems, enabling users to view media faster and more efficiently saves power and increases the time between battery charges.

[0302] The computer system (e.g., 600) (e.g., a smart phone, a smart watch) displays (902) via a display generation component a media viewer user interface (e.g., 820) (e.g., for displaying one or more representations (e.g., enlarged representations or non-thumbnail representations) of previously captured media, the media viewer user interface comprising: a first portion (e.g., 824) comprising representations (e.g., 824a-824f) of a first previously captured media item (e.g., an image, a video); and a second portion (e.g., 822 and / or 826) (e.g., a chrome portion of the user interface (e.g., a header, footer, menu portion of the user interface), the portion of the user interface In some embodiments, the first portion of the media viewer user interface is a portion of the visual content of the media viewer user interface (e.g., the first portion), the second portion having a first visual appearance and being distinct from (e.g., separate from, independent of) the first portion (e.g., 824) of the media viewer user interface (e.g., 820). In some embodiments, the representation of the previously captured media has been captured by one or more cameras of the computer system. In some embodiments, the first previously captured media is high dynamic range (HDR) media. In some embodiments, the first previously captured media is not high dynamic range media. In some embodiments, the second portion of the media viewer user interface is outside of the first portion of the media viewer user interface. In some embodiments, The second portion of the media viewer user interface is above and / or below the first portion of the media viewer user interface. In some embodiments, the second portion includes a third portion of the media user interface and a fourth portion of the media user interface, which are separated by the first portion of the media user interface. In some embodiments, the second portion includes multiple affordances (e.g., an affordance that, when selected, causes the computer system to share a representation of previously captured media via one or more applications, an affordance that, when selected, causes the computer system to display a user interface for editing a representation of previously captured media, an affordance that, when selected, causes the computer system to delete a displayed representation of previously captured media, an affordance that, when selected, causes the computer system to A computer system includes a representation of previously captured media in a particular set of representations (e.g., a favorite representation, a "liked" representation, etc.), an affordance that when selected causes the computer system to display multiple representations simultaneously (e.g., a media library with multiple photos in a grid), and an affordance that when selected causes the computer system to stop displaying a media viewer user interface and display a user interface different from the media viewer user interface. In some embodiments, the representation of the previously captured media has been captured by one or more cameras of the computer system. In some embodiments, the first previously captured media is high dynamic range media. In some embodiments, the first previously captured media is not high dynamic range media.

[0303] In displaying, via the display generation component, a display having a first visual appearance (e.g., Fig.8F When a second portion (e.g., 822 and / or 826) of a media viewer user interface (e.g., 820) (and a first portion including a representation of a first previously captured media item) is displayed (e.g., 850f) the computer system receives a request (e.g., a swipe gesture on the media viewer user interface (e.g., 820)) to display a representation (e.g., 824e) of a second previously captured media item (e.g., still image, video) that is different from the first previously captured media item (e.g., 824d) (e.g., to replace display of the representation of the first previously captured media item with the representation of the second previously captured media item).

[0304] In response to receiving (906) a request to display a representation of a second previously captured media item and determining, in accordance with (908) that a first set of criteria is satisfied, wherein the first set of criteria includes criteria that are satisfied when the representation (e.g., 824e) of the second previously captured media item (or a different media item) is a high dynamic range (HDR) media item, the computer system displays (910) the representation of the second previously captured media item (e.g., replacing display of the representation of the first previously captured media item with the representation of the second previously captured media item) and updates (912) a second portion (e.g., 822 and / or 826) of the media viewer user interface (e.g., 820) to have a different visual appearance than the first portion (e.g., 824e). Fig.8F 822 and / or 826) of the second visual appearance (e.g., Figure 8G822 and / or 826 in ). In some embodiments, based on determining that the first set of criteria is met, the first previously captured media item is stopped from being displayed. In some embodiments, the second visual appearance is brighter / less bright (or has more / less white) than the first visual appearance. In some embodiments, the second visual appearance is based on a brightness level of the representation of the second previously captured media item. In some embodiments, the brightness level may include the corresponding brightness of certain elements in the representation of the previously captured media and / or may be based on multiple bright elements in the representation of the previously captured media, and / or may be based on the overall brightness of the representation of the previously captured media. Updating a portion of the media viewer user interface (e.g., 820) (e.g., a border, chrome of an image) when a specified condition is met (e.g., when an HDR photo is displayed) makes the user interface less visually distracting when the HDR photo is displayed because the updated portion of the media portion more closely matches the elements in the HDR photo. Performing operations when a set of conditions have been met without requiring further user input enhances the operability of the system and makes the user-system interface more efficient (e.g., by helping the user provide appropriate input and reducing user errors when operating / interacting with the system), which in turn reduces power usage and extends the battery life of the system by enabling the user to use the system more quickly and efficiently.

[0305] In some embodiments, as part of updating a second portion (e.g., 822 and 826) of a media viewer user interface (e.g., 820) to have a second visual appearance different from the first visual appearance and based on determining a portion of a media item (e.g., Fig.8F 824d) (e.g., HDR content) has a first brightness level, the computer system displays a second portion (e.g., Fig.8F In some embodiments, as part of updating a second portion of the media viewer user interface (e.g., 820) to have a second visual appearance different from the first visual appearance and based on determining that the portion of the media item has a second brightness level (e.g., Figure 8G 824e), the computer system displays a second portion (e.g., Figure 8GIn some embodiments, based on the brightness of the content in the media item (e.g., HDR content), the second portion of the media viewer user interface is updated to have a second visual appearance. In some embodiments, when the second brightness level is higher than (or alternatively, lower than) the first brightness level, the second amount is higher than the first amount. In some embodiments, when the media item is HDR content and a portion of the media item is configured to display a brightness higher than the first brightness level, the second portion of the media viewer user interface is displayed as the first amount of visual characteristics; and when the media item is HDR content and no portion of the media item is configured to display a brightness higher than the first brightness level, the second portion of the media viewer user interface is displayed as the second amount of visual characteristics (e.g., brightness level, opacity, color (e.g., whiteness)) different from the first amount of visual characteristics. Dynamically updating a portion (e.g., chrome) of a media viewer user interface in different ways based on the brightness of the HDR content of different media items makes the user interface less visually distracting when displaying the corresponding media items (e.g., when the HDR content of the media is brighter, the portion of the media viewer user interface is brighter). Performing operations when a set of conditions have been met without further user input enhances the operability of the system and makes the user-system interface more efficient (e.g., by helping the user provide appropriate input and reducing user errors when operating / interacting with the system), which in turn reduces power usage and extends the battery life of the system by enabling the user to use the system more quickly and efficiently.

[0306] In some embodiments, as part of updating the second portion of the media viewer user interface (e.g., 820) to have a second visual appearance different from the first visual appearance and based on determining that the media item (e.g., 824c) has been displayed for the first amount of time, the computer system displays the second portion (e.g., 824c) of the media viewer user interface (e.g., 820). Fig.8D In some embodiments, as part of updating the second portion of the media viewer user interface (e.g., 820) to have a second visual appearance different from the first visual appearance and based on determining that the media item (e.g., 824c) has been displayed for a second amount of time different from the first amount of time, the computer system displays the second portion of the media viewer user interface (e.g., 820) (e.g., Fig. 8E822 and / or 826 in 822 and / or 826) have a fourth amount of visual characteristics (e.g., brightness level, opacity, color (e.g., whiteness)) that are different from the third amount of visual characteristics. In some embodiments, based on the amount of time the media item has been displayed, the second portion of the media viewer user interface is updated to have a second visual appearance. In some embodiments, while the media item is displayed, the visual appearance of the second portion may change over a period of time (e.g., change over a period of 0.5 seconds, 1 second, 2 seconds, 5 seconds, or 10 seconds, and then optionally stop changing while continuing to display the same media item) (e.g., gradually change, multiple times). In some embodiments, when the media item is displayed for a second amount of time that is longer (or alternatively, shorter) than the first amount of time, the visual characteristics of the fourth amount are higher than the visual characteristics of the third amount. In some embodiments, the second portion of the media viewer user interface is displayed to have an amount (or degree) of visual characteristics, where the amount of the visual characteristics is based on the amount of elapsed time (e.g., the amount of time the first previously captured media item is displayed, the amount of time the second previously captured media item is displayed). Dynamically updating a portion of the media viewer user interface (e.g., chrome) in different ways based on when the HDR media is displayed makes the user interface less visually distracting when displaying the media (e.g., changes less when the media is displayed for a shorter time), and reduces the amount of different brightness levels that the portion of the media viewer user interface is updated to. Performing operations when a set of conditions have been met without further user input enhances the operability of the system and makes the user-system interface more efficient (e.g., by helping the user provide appropriate input and reducing user errors when operating / interacting with the system), which in turn reduces power usage and extends the battery life of the system by enabling the user to use the system more quickly and efficiently.

[0307] In some embodiments, as part of displaying a representation of a second previously captured media item (e.g., 824c-824f), the computer system replaces the representation of the first previously captured media item with the representation of the second previously captured media. In some embodiments, as part of updating the second portion of the media viewer user interface to have a second visual appearance different from the first visual appearance and based on determining that the representation of the first previously captured media item was displayed for at least a first amount of time before being replaced by the representation of the second previously captured media, the computer system displays the second portion of the media viewer user interface (e.g., 820) with a fifth amount of visual characteristics (e.g., brightness, opacity, color (e.g., whiteness)). In some embodiments, as part of updating the second portion of the media viewer user interface (e.g., 820) to have a second visual appearance different from the first visual appearance and based on determining that the representation of the first previously captured media item content has been replaced by the representation of the second previously captured media for a second amount of time different from the first amount of time, the computer system displays the second portion of the media viewer user interface (e.g., 820) with a sixth amount of visual characteristics (e.g., brightness, opacity, color (e.g., whiteness)) different from the fifth amount of visual characteristics. In some embodiments, based on the duration of the transition between previously displayed representations, a second portion of the media viewer user interface is updated to have a second visual appearance. In some embodiments, when the duration of the transition between representations is smaller (larger), the amount of change in visual appearance is smaller (larger). Dynamically updating a portion of the media viewer user interface (e.g., border, chrome) in different ways based on the transition time between two media items makes the user interface less visually distracting when displaying media (e.g., less change when media transitions faster), and reduces the abruptness of the amount of brightness change when transitioning quickly between media. Performing operations when a set of conditions have been met without further user input enhances the operability of the system and makes the user-system interface more efficient (e.g., by helping the user provide appropriate input and reducing user errors when operating / interacting with the system), which in turn reduces power usage and extends the battery life of the system by enabling the user to use the system more quickly and efficiently.

[0308] In some embodiments, as part of updating a second portion of a media viewer user interface (e.g., 820) to have a second visual appearance different from the first visual appearance and based on determining that an average rate of requests to display previously captured media items (e.g., 850f, 850g) (e.g., the first 5 requests) is below a first threshold (e.g., or a first number of requests to display multiple representations of previously captured media items are received within a predetermined time before displaying a representation of a second previously captured media item), the computer system displays the second portion of the media viewer user interface (e.g., 820) having a seventh quantity of visual characteristics (e.g., brightness, opacity, color (e.g., whiteness)). In some embodiments, as part of updating a second portion of a media viewer user interface (e.g., 820) to have a second visual appearance different from the first visual appearance and based on determining that an average rate of requests to display previously captured media items is not less than a first threshold (e.g., a second number of requests to display multiple representations of previously captured media items are received within a predetermined time before displaying a representation of a second previously captured media item), the computer system displays the second portion of the media viewer user interface (e.g., 820) having an eighth quantity of visual characteristics (e.g., brightness, opacity, color (e.g., whiteness)) that is different from a seventh quantity of visual characteristics. In some embodiments, the second quantity is different from the first quantity. In some embodiments, the second portion of the media viewer user interface is updated to have the second visual appearance based on an average rate of input (e.g., a swipe rate or speed). In some embodiments, when the average rate of input is higher, the change in the second portion is less than the change when the average rate of subsequent input is lower. In some embodiments, the second portion of the media viewer user interface is displayed to have a certain amount (or degree) of visual characteristics, where the amount of the visual characteristics is based on the rate at which content has been displayed in the first portion of the media browser interface (e.g., the number of images per unit time). Dynamically updating a portion of a media viewer user interface (e.g., borders, chrome) in different ways based on the rate of transitions between media items makes the user interface less visually distracting when displaying media (e.g., changes less when the rate is faster), and reduces the abruptness of the amount of brightness change when transitioning quickly between media. Performing operations when a set of conditions have been met without further user input enhances the operability of the system and makes the user-system interface more efficient (e.g., by helping the user provide appropriate input and reducing user errors when operating / interacting with the system), which in turn reduces power usage and extends the battery life of the system by enabling the user to use the system more quickly and efficiently.

[0309] In some embodiments, while displaying a media viewer user interface including a second portion of the media viewer user interface (e.g., 820) having a first visual appearance (and a first portion including a representation of a first previously captured media item) via a display generation component, a computer system receives a request to display a representation of a third previously captured media item that is different from the first previously captured media item and the second previously captured media item. In some embodiments, in response to receiving the request to display the representation of the third previously captured media item and based on determining that a first set of criteria is met, the computer displays the representation of the third previously captured media item (e.g., by replacing the representation of the second previously captured media item) and updates the second portion (e.g., 822 and / or 826) of the media viewer user interface (e.g., 820) to have a third visual appearance that is different from the first visual appearance and the second visual appearance. In some embodiments, the first set of criteria includes criteria that are met when the representation of the third previously captured media item is an HDR media item. In some embodiments, when the third media item has content with a higher brightness level (e.g., the brightness level may include the corresponding brightness of certain elements in the image, which may be based on a plurality of bright elements in the image, and / or may be based on the overall brightness of the image) than the previously displayed media item, the second portion (e.g., 822 and / or 826) of the media viewer user interface (e.g., 820) is brighter (or has more white) when the third media item is displayed than when the previously displayed media item was displayed. Dynamically updating a portion (e.g., chrome) of the media viewer user interface in different ways based on the brightness of the HDR content of different media items makes the user interface less visually distracting when displaying the corresponding media items (e.g., as the HDR content of the media becomes brighter, the portion of the media viewer user interface becomes brighter). Performing operations when a set of conditions have been met without further user input enhances the operability of the system and makes the user-system interface more efficient (e.g., by helping the user provide appropriate input and reducing user errors when operating / interacting with the system), which in turn reduces power usage and extends the battery life of the system by enabling the user to use the system more quickly and efficiently.

[0310] In some embodiments, the second previously captured media item is an HDR media item (e.g., 824c-824f). In some embodiments, a representation of the second previously captured media item is displayed as having HDR. In some embodiments, for a media item (e.g., an image or video) having at least a portion that is intended to be displayed as having a specific brightness level that is higher than a standard dynamic range of brightness, the representation of the media item is displayed as having a brightness level (e.g., a specific brightness level) that is higher than the standard dynamic range.

[0311] In some embodiments, the first set of criteria includes criteria that are satisfied when the second portion (e.g., 822 and / or 826) is (or is within a threshold value (e.g., red-blue-green value, hexadecimal value)) a first color (e.g., a color (e.g., white or a light color), a bright color (e.g., a color with more white than black) that is not a second color (e.g., black or a dark color)). In some embodiments, the first set of criteria includes criteria that are satisfied when the second portion (e.g., 822 and / or 826) is not the second color (e.g., black or a dark color). In some embodiments, the computer system receives user input selecting between two or more options for a color range for the second portion (e.g., 822 and / or 826), and the first set of criteria includes criteria that are satisfied when the current color range selection for the second portion (e.g., 822 and / or 826) is the first color range (rather than the second color or a second color range).

[0312] In some embodiments, as part of updating the second portion (e.g., 822 and / or 826) of the media viewer user interface to have a second visual appearance, the computer system displays an animation that gradually (e.g., fades over a period of time (e.g., 1 second, 2 seconds, 3 seconds)) transitions the second portion (e.g., 822 and / or 826) of the media viewer user interface from having a first visual appearance to having a second visual appearance. Gradually and dynamically updating a portion (e.g., chrome) of the media viewer user interface when displaying HDR media items makes the user interface less visually distracting when displaying HDR media items and reduces the abruptness of changes in that portion of the media viewer interface. Providing improved visual feedback to the user enhances the operability of the system and makes the user-system interface more efficient (e.g., by helping the user provide appropriate input and reducing user errors when operating / interacting with the system), which in turn reduces power usage and extends the battery life of the system by enabling the user to use the system more quickly and efficiently.

[0313] In some embodiments, a representation of a previously captured media item (e.g., a first previously captured media item, a second previously captured media item, etc.) includes a brightness amount (e.g., average brightness, percentage of bright areas). In some embodiments, based on determining that the brightness amount (e.g., average brightness, percentage of bright areas) exceeds a brightness threshold, the representation of the previously captured media item is displayed with a modified (e.g., reduced) brightness amount (e.g., reduced average brightness; reduced brightness in some portions while maintaining brightness in other portions; brightness reduced equally across the entire image). In some embodiments, based on determining that the brightness amount does not exceed a brightness threshold, the representation of the previously captured media item is displayed with the brightness amount (e.g., without reducing the average brightness, without reducing the brightness equally across the image). In some embodiments, the underlying content of the media item remains the same (e.g., with a brightness amount that exceeds the brightness threshold), but the media item is displayed as having a modified (e.g., reduced) brightness amount. Dynamically changing the displayed HDR media items in different ways based on the brightness of the HDR content of the different media items makes the user interface less visually distracting when displaying the corresponding media items (e.g., as the HDR content of the photo is brighter, the photo is displayed darker, thereby reducing the visual difference between the chrome and the photo). Performing operations when a set of conditions have been met without further user input enhances the operability of the system and makes the user-system interface more efficient (e.g., by helping the user provide appropriate input and reducing user errors when operating / interacting with the system), which in turn reduces power usage and extends the battery life of the system by enabling the user to use the system more quickly and efficiently.

[0314] In some embodiments, the first previously captured media item (e.g., 824a-824b, 824g) is not an HDR media item. In some embodiments, the second previously captured media item (e.g., 824c-824f) is an HDR media item. In some embodiments, before displaying the media viewer user interface including the first portion and the second portion (e.g., 822 and / or 826) via the display generation component, the computer system displays a user interface (e.g., 810) including multiple representations (e.g., 812a to 812g) of the media items via the display generation component. In some embodiments, the multiple representations of the media items include a second representation (e.g., 812a-812b, 812g) (e.g., a thumbnail) of the first previously captured media item without HDR content and a second representation (e.g., 812c-812f) (e.g., a thumbnail) of the second previously captured media item without HDR content. In some embodiments, thumbnails of media items (e.g., images) are displayed using standard dynamic range brightness, regardless of whether the media items are expected to be displayed as having a specific brightness level that is above the standard dynamic range of brightness. In some embodiments, while displaying the multiple representations of the media items, the computer system receives a request to display a first (or alternatively, a second or any other representation in the multiple representations) previously captured media item (e.g., selecting (e.g., tapping) a second representation of the first (or alternatively, a second or any other representation in the multiple representations) previously captured media item), and in response to receiving a request to display the first representation (or alternatively, the second or any other representation in the multiple representations), electronically displays a media interface that includes a first portion (e.g., having the first (or alternatively, the second or any other representation in the multiple representations) previously captured media item) and a second portion (e.g., 822 and / or 826) (e.g., having a first visual appearance (or alternatively, having a second visual appearance when the second previously captured media item is displayed in the first portion).

[0315] In some embodiments, in response to (906) receiving a request to display a representation of a second previously captured media item and based on determining that the first set of criteria are not met, the computer system abandons (914) updating the second portion (e.g., 822 and / or 826) of the media viewer user interface (e.g., 820) to have a second visual appearance different from the first visual appearance (e.g., displaying (or continuing to display) the second portion (e.g., 822 and / or 826) of the media viewer user interface (e.g., 820) as having the first visual appearance). In some embodiments, the first set of criteria are not met when the representation of the second previously captured media item is not an HDR media item. In some embodiments, the chrome (the area surrounding the displayed image) does not change when displaying a non-HDR photo. In some embodiments, based on determining that the first set of criteria are not met, the computer system transitions the display of the second portion (e.g., 822 and / or 826) to a predefined (e.g., independent of the brightness of the previously captured second media item) visual appearance. Thus, as long as the image is not an HDR image, the second portion (e.g., 822 and / or 826) is displayed using a predefined appearance, regardless of the amount of brightness / darkness of the non-HDR image. Dynamically discarding the change to that portion of the media user interface when the media is not HDR media makes the user interface less visually distracting when displaying non-HDR corresponding media items. Performing operations when a set of conditions have been met without further user input enhances the operability of the system and makes the user-system interface more efficient (e.g., by helping the user provide appropriate input and reducing user errors when operating / interacting with the system), which in turn reduces power usage and extends the battery life of the system by enabling the user to use the system more quickly and efficiently.

[0316] In some embodiments, while displaying a representation of a second previously captured media item and the second portion (e.g., 822 and / or 826) has a second visual appearance, the computer system receives (e.g., 850g, 850i) a request to display a representation of a fourth previously captured media item. In some embodiments, in response to receiving (e.g., 850g, 850i) a request to display a third previously captured media item and based on determining that a first set of criteria is met, the computer system displays a representation of the fourth previously captured media item (e.g., by replacing display of the second previously captured media item) without updating the visual appearance of the second portion (e.g., 822 and / or 826), and updates the second portion (e.g., 822 and / or 826) of the media to have a visual appearance different from the first visual appearance and the second visual appearance (e.g., FIG. 8E to FIG. 8IIn some embodiments, in response to receiving a request to display a third previously captured media item and based on determining that the first set of criteria is not met (e.g., the fourth previously captured media item is not an HDR media item), the computer system displays a representation of the fourth previously captured media item and updates the second portion of the media (e.g., 822 and / or 826) to have a predefined (e.g., independent of the brightness of the second previously captured media item) visual appearance that is different from the second visual appearance (e.g., 8C to 8D). Fig.8D and Figure 8J 822 and / or 826 in ). In some embodiments, as long as the fourth previously captured media item is not HDR, the second portion (e.g., 822 and / or 826) is displayed using a predefined visual appearance, regardless of how bright / dark the non-HDR image is. In some embodiments, when a non-HDR image is requested to be displayed, the second portion (e.g., 822 and / or 826) is displayed using a predefined visual appearance (e.g., all non-HDR images have the same color and / or brightness), regardless of how bright / dark the non-HDR image is; and when an HDR image is requested to be displayed, the second portion (e.g., 822 and / or 826) is displayed using a variable visual appearance based on the brightness / darkness of the HDR image.

[0317] Note that the above description is relative to method 900 (eg, Fig. 9 ) also apply in a similar manner to the methods described below / above. For example, methods 700 and 1100 optionally include one or more of the features of the various methods described above with reference to method 900. For example, method 900 may display media that has been captured using a computer system that is configured to capture media with a specific exposure compensation value using one or more steps of method 700 (described above). For the sake of brevity, these details are not repeated below.

[0318] FIG. 10A to FIG. 10AC An exemplary user interface for displaying a status indicator using an electronic device according to some embodiments is shown. The user interface in some figures is used to illustrate the processes described below, which include Fig.11 process.

[0319] exist FIG. 10A to FIG. 10AC In the embodiment of the present invention, device 600 may use one or more media capture devices such as microphones (e.g., in Fig. 10B , Fig.10E ) and / or camera (e.g., in Figure 10Q , Figure 10W to record (or capture) media. FIG. 10A to FIG. 10ACAn exemplary scenario is shown in which device 600 displays or does not display a recording status indicator based on the type of data being recorded by at least one of the media capture devices. FIG. 10A to FIG. 10C As used herein, the type of data refers to how the data will be used (e.g., whether the data is available for playback; whether the data is delivered to a trusted application or an untrusted application) and not the format of the data. FIG. 10A to FIG. 10AC As used herein, a first type of data (e.g., a data type that displays its capture status indicator) refers to data that is determined to be used (or potentially used) in a first manner, and a second type of data (e.g., a data type that does not display its capture status indicator) refers to data that is determined not to be used in a first manner. In some embodiments, the first type of data (e.g., a data type that displays its capture status indicator) corresponds to data that can be used (e.g., stored) for later playback, and the second type of data (e.g., a data type that does not display its capture status indicator) corresponds to data that is not available for playback. In some embodiments, the first type of data (e.g., a data type that displays its capture status indicator) corresponds to data that is passed to a non-trusted application (e.g., a non-first-party voice assistant application, a non-first-party authentication application) and the second type of data (e.g., a data type that does not display its capture status indicator) corresponds to data that is used to control various features of a device by one or more trusted applications (e.g., components of an operating system or trusted first-party and / or third-party applications) without being passed to a non-trusted application (e.g., a non-first-party voice assistant application, a non-first-party authentication application) and is not retained as media that can be played back later (e.g., by the device or by another device). Thus, the determination is based on whether the non-trusted application has access rights to the recorded data (e.g., audio or video content). In some embodiments, the recording status indicator is displayed regardless of whether the application that is recording the data displays the indicator for the recording.

[0320] Fig. 10A Device 600 is shown displaying a user interface having icons 690. Fig. 10A , device 600 detects voice input 1050a (e.g., “Hey, Assistant”) via a microphone of device 600. Fig. 10B As shown, in response to detecting voice input 1050a, device 600 displays user interface 1004. User interface 1004 is a user interface for a voice assistant application. User interface 1004 includes a phrase "What can I do for you", which indicates that device 600 is waiting to receive a voice input corresponding to a command.

[0321] It is worth noting that in the range of 10A to Fig. 10BIn , device 600 records data via a microphone of device 600 in order to recognize a command (e.g., a command spoken by a user of device 600). However, in FIG. 10A to FIG. 10B In the example, the device 600 does not display a recording status indicator (e.g., Fig.10E The recording status indicator 1042 shown in FIG. 10A is displayed because it is determined that the device 600 is not recording data of the first type. Fig. 10B In , the device 600 is not recording data of the first type because the data being recorded is determined to be data that is not available for later playback. FIG. 10A to FIG. 10B The data recorded in is being passed to a trusted application and is not available for later playback because the device 600 is recording the data to identify voice commands that will allow the local assistant (or trusted) voice application to cause the device 600 to perform one or more actions (e.g., provide directions to a location, provide an answer to a query from a user).

[0322] At some point after displaying user interface 1010, device 600 redisplays a user interface with application icons 690 (including voice memo application icon 690b). Fig. 10C , the device 600 detects a tap gesture 1050c on the voice memo application icon 690b. Fig. 10D As shown, in response to detecting tap gesture 1050c, device 600 launches a voice memo application corresponding to voice memo application icon 690b and displays a recording initiation user interface (e.g., for a voice memo application) including an audio recording enable indication 1010. Because it is determined that the first type of data is not being recorded, Fig. 10C , the device 600 does not display the recording status indicator 1042. Fig. 10D , device 600 detects a tap gesture 1050d on audio recording indication 1010.

[0323] like Fig.10E As shown, in response to detecting tap gesture 1050d, device 600 displays an audio recording user interface including stop enable indication 1016, which indicates that device 600 is recording data (e.g., audio recording enable indication 1010 has stopped being displayed). Fig.10E In response to detecting the tap gesture 1050d, the device 600 causes one or more microphones of the device 600 to record data (e.g., audio data). Fig.10E The data recorded in (e.g., in response to detecting the tap gesture 1050d) is data being recorded for the voice memo application (e.g., accessible to and / or initiated by the voice memo application). Fig.10EIn the embodiment of the present invention, it is determined that the data recorded for the voice memo application is the first type of data. The data recorded for the voice memo application is determined to be the first type of data because it is determined that the data is being recorded for later playback.

[0324] like Fig.10E As shown, because the data recorded by the voice memo application is determined to be the first type of data, the device 600 displays a recording status indicator 1042 at the location of the cellular signal status indicator 820a. Therefore, in some embodiments, the recording status indicator 1042 indicates to the user that one or more media capture devices (e.g., microphone, camera) of the device 600 are recording the first type of data, so that if necessary, the user can stop the device 600 from recording data. In some embodiments, the user may not know that the first type of data is being recorded, such as if the application that initiates the recording does not provide appropriate instructions. Therefore, in some embodiments, displaying the recording status indicator 1042 can provide the user with information related to user privacy (e.g., whether the user's voice or photos or images of the user are recorded and can be used for playback later on one or more devices). While continuing to record the first type of data of the voice memo application, the device 600 receives an indication of an incoming call via a web call application.

[0325] like Fig.10F As shown, in response to receiving an indication of an incoming call, device 600 displays a web call user interface that includes acceptance affordance 1032 and an indication that an incoming call is being received from an external device associated with "John". Fig.10F As shown, the device 600 continues to display the recording status indicator 1042 while displaying the web call user interface. The device 600 continues to display the recording status indicator 1042 because the device 600 continues to record audio data for the voice memo application, as described above with respect to Fig.10E discussed (e.g., audio recorded in FIG. 10E to FIG. 10F ). Fig.10F , the device 600 detects a tap gesture 1050f on the acceptance indication 1032.

[0326] like Figure 10G As shown, in response to detecting tap gesture 1050f, device 600 answers the incoming call and displays a user interface with end affordance indication 1034. Figure 10G In , after answering the incoming call, the device 600 causes the microphone of the device 600 (e.g., the same or different microphone as the microphone currently recording data for the voice memo application) to record data for the web call application. Figure 10GIn , device 600 simultaneously records data (e.g., via a microphone of device 600) for a voice memo application and a web call application. Figure 10G In , device 600 uses one or more techniques similar to those discussed above to determine that the data recorded for the web call application is data of the first type (e.g., because the data recorded for the web call application is available for playback by John's device). Figure 10G As shown, device 600 does not display additional recording status indicators. Device 600 does not display additional recording status indicators because recording status indicator 1042 is already displayed (e.g., or a predetermined number of recording status indicators are displayed) due to recording the first type of data for the voice memo application. In some embodiments, when device 600 does not display recording status indicator 1042 before recording data for the web call application, device 600 displays recording status indicator 1042 in response to detecting tap gesture 1050f. Figure 10G , device 600 detects a downward swipe gesture 1050g.

[0327] like Fig. 10H As shown, in response to detecting the downward swipe gesture 1050g, the device 600 displays the control user interface 1038. The control user interface 1038 includes a device control 1046 for modifying the state of the device 600, such as connectivity settings (e.g., wireless, cellular, Bluetooth settings). In addition, the control user interface 1038 includes a web call recording state indicator 1044a and a voice memo recording state indicator 1044b, because the device 600 captures the first type of data for the web call application (e.g., a third-party application) and the voice memo application at the same time. Because the device 600 is displaying the control user interface 1038, the web call recording state indicator 1044a and the voice memo recording state indicator 1044b are displayed. Fig. 10H The record status indicators each include Figure 10G The recording status indicator 1042 shown is more visual content. In addition, the device 600 displays multiple recording status indicators on the control user interface 1038, and when the control user interface 1038 is not displayed (for example, in Figure 10G In some embodiments, in response to detecting a downward swipe gesture 1050g, the device 600 displays an animation of the recording status indicator 1042 transitioning to one or both of the recording status indicator 1044a and the voice memo recording status indicator 1044b.

[0328] The web call recording status indicator 1044a includes an application indication 1044a1, a device indication 1044a2, and a configuration indication 1044a3. The application indication 1044a1 indicates that the device 600 is recording an application of the first type of data (e.g., a web call application). The device indication 1044a2 indicates that the microphone of the device 600 is being used to record the first type of data for the web call application. In addition, the configuration indication 1044a3 indicates that the web call recording status indicator 1044a is optional. The voice memo recording status indicator 1044b includes similar indications, such as an application indication 1044b1 (e.g., which indicates that the first type of data is being recorded for the voice memo application) and a device indication 1044b2 (e.g., which indicates that the microphone of the device 600 is being used to record the first type of data for the voice memo application). However, as Fig. 10H As shown, the voice memo recording status indicator 1044b does not include a configuration indication.

[0329] exist Fig. 10H , the voice memo recording status indicator 1044b does not include a configuration indication because it is determined that the voice memo application is not a type of application that can be configured via the control user interface 1038 (e.g., does not have configurable permissions for enabling / disabling access to the media capture device). On the other hand, the web call recording status indicator 1044a includes a configuration indication 1044a3 because it is determined that the web call application is a type of application that can be configured via the control user interface 1038. In some embodiments, the device 600 detects a tap gesture 1050h1 on the voice memo recording status indicator 1044b. In some embodiments, in response to detecting the tap gesture 1050h1, the device 600 continues to display the control user interface 1038 without displaying any additional content because the voice memo recording status indicator 1044b is not selectable. Fig. 10H , the device 600 detects a tap gesture 1050h2 on the web call recording status indicator 1044a.

[0330] like Fig.10IAs shown, in response to detecting the tap gesture 1050h2, the device 600 stops displaying the control user interface 1038, and displays a permission management user interface for the web call application including the permission control 1052. It is worth noting that because the control user interface 1038 has stopped being displayed, the device 600 also stops displaying the separate recording status indicators for the web call application and the voice memo application (e.g., the web call recording status indicator 1044a and the voice memo recording status indicator 1044b), and displays a single or combined recording status indicator for these applications (e.g., the recording status indicator 1042).

[0331] like Fig.10I As shown, permission control 1052 includes microphone access enable indication 1052a and camera access enable indication 1052b, both of which are activated (e.g., "on"). In some embodiments, in response to detecting a tap gesture on microphone access enable indication 1052a, device 600 stops allowing data to be recorded for the web call application via the microphone of device 600, and also stops recording a first type of data for the web call application, which first type of data began to be recorded in response to detecting input gesture 1050f. In some embodiments, in response to detecting a tap gesture on camera access enable indication 1052a, device 600 stops allowing data to be recorded for the web call application via the camera of device 600. Fig.10I , device 600 detects a right swipe gesture 1050i on the bottom of the rights management user interface.

[0332] like Fig.10J As shown, in response to detecting right swipe gesture 1050i, device 600 redisplays the user interface with end affordance 1034. Fig.10J , the device 600 detects the tap gesture 1050j on the enable indication 1034 to end.

[0333] like Figure 10K As shown, in response to detecting the tap gesture 1050j, the device 600 stops recording the first type of data for the web call application (e.g., via the microphone of the device 600) and displays a user interface of the web call application indicating that the call has ended. Figure 10K , the device 600 continues to display the recording status indicator 1042 because the first type of data has continued to be recorded for the voice memo application even though the recording of the first type of data has stopped for the web call application. Figure 10K , device 600 detects an upward swipe gesture 1050k on the user interface of the web call application, which indicates that the call has ended.

[0334] like Fig.10L As shown, in response to detecting the upward swipe gesture 1050k, the device 600 uses the method described above (e.g., in Fig.10E ) to display a user interface with icon 690 while continuing to display recording status indicator 1042. Fig.10L As shown, icons 690 include a camera application icon 690a. Fig.10L , the device 600 detects a tap gesture 10501 on the camera application icon 690a.

[0335] like Figure 10M As shown, in response to detecting the tap gesture 10501, the device 600 displays a camera user interface. Fig. 6A One or more similar techniques described in the camera user interface to display Figure 10M For example, Figure 10M The camera user interface of 604 includes an indicator area 602, a camera display area 604, and a control area 606. The camera display area 604 includes a real-time preview 630, and the control area 604 includes a camera mode enable indication 620 and a shutter enable indication 610. Figure 10M As shown, the video camera mode enable indication 620b is centered (e.g., and "Video" is bolded), indicating that the device 600 is configured to record data representing video media in response to receiving a selection of the shutter enable indication 610. Figure 10M , device 600 detects a tap gesture 1050m on shutter enable indication 610.

[0336] like Fig.10N As shown, in response to detecting the tap gesture 1050m, the device 600 begins recording data for the camera application via one or more cameras of the device 600. Fig.10N In one embodiment, the data recorded for the camera application is determined to be a first type of data (e.g., because the recorded data may be used for later playback) using one or more similar techniques discussed above. Fig.10N , device 600 does not display additional recording status indicators (e.g., in addition to recording status indicator 1042) because device 600 is not currently displaying control user interface 1038 (e.g., and for similar reasons as described above with respect to Figure 10G discussed). Fig.10N , device 600 detects a downward swipe gesture 1050n that begins near the top of the camera user interface.

[0337] like Fig.10OAs shown, in response to detecting the downward swipe gesture 1050n, the device 600 redisplays the control user interface 1038. The control user interface 1038 includes a voice memo recording status indicator 1044b and a camera recording status indicator 1044c. The camera recording status indicator 1044c includes a device identifier 1044c2, which is different from the device identifier 1044b2 (e.g., the device identifier of the voice memo recording status indicator 1044b) because the device 600 is using one or more cameras to record the first type of data for the camera application, rather than using a microphone to record the first type of data. The voice memo recording status indicator 1044b and the camera recording status indicator 1044c are displayed simultaneously because the device 600 is recording the first type of data for both applications simultaneously (e.g., using the above description relative to Fig. 10H One or more similar techniques discussed).

[0338] Figure 10P A different version of the control user interface 1038 is shown that may be displayed in response to detecting a swipe down gesture 1050n. Figure 10P The control user interface 1038 includes an additional indication (e.g., "currently in use") of the current status of each corresponding application use (e.g., voice memo application, camera application) of the corresponding device (e.g., microphone, camera). However, the control user interface 1038 does not include the additional indication. In some embodiments, because the additional indication takes up more space in the control user interface, the device 600 may display the additional indication when recording the first type of data for less than a threshold number (e.g., 1, 2) of applications (and / or devices) or when a threshold number of recording status indicators are displayed simultaneously. Return to Fig.10O , the device 600 detects an upward swipe gesture 1050o on the control user interface 1038.

[0339] like Figure 10Q As shown, in response to detecting swipe gesture 1050o, device 600 redisplays the camera user interface including stop enabling indication 614. Figure 10Q , device 600 detects tap gesture 1050q on stop enable indication 614. Figure 10R As shown, in response to detecting the tap gesture 1050q, the device 600 stops recording data representing the video media. Figure 10R , device 600 detects a swipe gesture 1050r on the camera user interface.

[0340] like Fig. 10S As shown, in response to detecting the swipe gesture 1050r, the device 600 displays the control user interface 1038. Fig. 10SAs shown, the control user interface 1038 continues to display the camera recording status indicator 1044c, even though the device 600 is no longer recording the first type of data for the camera application. Fig. 10S , the device 600 updates the camera recording status indicator 1044c to indicate that the camera application was recently used (e.g., Fig. 10S ), which corresponds to the camera recording status indicator 1044c in Fig.10O are shown without additional indications and / or in Figure 10P is displayed with an additional indication ("Currently in use") instead. Fig. 10S , the device 600 continues to display the voice memo recording status indicator 1044b because the device 600 is still recording the first type of data for the voice memo application (e.g., using one or more techniques and / or for similar reasons as described above). Fig. 10S , the device 600 detects a right swipe gesture 1050s on the bottom of the control user interface 1038.

[0341] like Figure 10T As shown, in response to detecting the right swipe gesture 1050s, device 600 displays an audio recording user interface including a stop enable indication 1016. Fig. 10S , device 600 detects a tap gesture 1050t on stop enabling indication 1016. In some embodiments, in response to detecting tap gesture 1050t, device 600 stops recording the first type of data for the voice memo application. In some embodiments, after stopping recording the first type of data for the voice memo application, device 600 stops displaying recording status indication 1042 because device 600 is no longer recording the first type of data.

[0342] like Figure 10U As shown (e.g., some time after displaying the audio recording user interface), device 600 displays the camera user interface. Figure 10U , device 600 is operating in a “photo” camera mode, as indicated by the centered photo camera mode enable indication 620c and the bold “photo”.

[0343] As mentioned above Fig. 6A As discussed, device 600 displays live preview 630 by recording data in the field of view (“FOV”) of one or more cameras of device 600. Figure 10U , device 600 determines, using one or more of the techniques described above, that the data that device 600 is recording to display real-time preview 630 is data of the first type (e.g., because the data that is being recorded to display real-time preview 630 is available for later playback, as shown in real-time preview 630). Figure 10U As shown, the device 600 displays the recording status indicator 1042 because the data that the device 600 is recording to display the real-time preview 630 is determined to be the first type of data. Figure 10U In some embodiments, the device 600 does not display the recording status indicator 1042 because a different determination is made using one or more techniques similar to those discussed above that the data being recorded to display the real-time preview 630 is not data of the first type (e.g., because the recorded data is not available for playback at a later time). Figure 10U , device 600 detects a tap gesture 1050u on shutter enable indication 610.

[0344] like Figure 10V As shown, in response to detecting the tap gesture 1050u, the device 600 records an image representing the live preview 630 and updates the media collection 612 to show a representation of the recorded image (e.g., see Figure 10U and Figure 10V The difference between the media collection 612). Figure 10V , the device 600 detects an upward swipe gesture 1050v on the camera user interface.

[0345] like Figure 10W As shown, in response to detecting the swipe gesture 1050v, the device 600 displays a user interface having an icon 690. Figure 10W When the user interface of the device 600 is displayed, the device 600 continues to display the recording status indicator 1042, even though the device 600 is not simultaneously capturing the first type of data for the camera application. Figure 10W , device 600 displays a recording status indicator 1042 because the device 600 has recorded a first type of data (eg, corresponding to a Figure 10W In other words, because the recording data corresponding to the recorded photo caused the camera to activate (e.g., cause the camera to record media) for less than the predetermined time period, the device 600 displays the recording status indicator 1042 for the minimum time period and / or after the camera stops recording data of the first type. The user recognizes that the application has recorded data of the first type even when the application only recorded data of the first type for a short time period. Figure 10W As shown, the recording status indicator 1042 is displayed near (or adjacent to) one of the cameras (e.g., 1008) of the device 600. Figure 10W , device 600 detects a downward swipe gesture 1050w on a user interface having icon 690 .

[0346] like Figure 10X As shown, in response to detecting the downward swipe gesture 1050w, the device 600 displays the control user interface 1338. Figure 10X As shown, the control user interface 1338 includes a camera recording status indicator 1044c, which indicates that the camera was most recently used to record data of the first type. Figure 10X In some embodiments, controls user interface 1338 includes camera recording status indicator 1044c because controls user interface 1338 is displayed within a predetermined time period (e.g., 1-45 seconds) after recording the first type of data for the camera application (e.g., a photo recorded in response to detecting tap gesture 1050u). Therefore, in some embodiments, controls user interface 1338 does not include camera recording status indicator 1044c when controls user interface 1338 is not displayed within a predetermined time period after recording of the first type of data for the camera application ends.

[0347] Figure 10Y The device 600 is shown in a locked state, which is indicated by the lock icon 1078a. Figure 10Y In the embodiment, the device 600 (e.g., via a camera having a FOV) detects a scene in the FOV corresponding to data that will unlock the device 600 (e.g., a scene including a user's face, a specific object). Figure 10Z As shown, in response to detecting a scene in the FOV corresponding to data that will unlock the device 600, the device 600 changes from a locked state to an unlocked state, as indicated by the unlock icon 1078b.

[0348] It is worth noting that in Figure 10Y to Figure 10Z In , device 600 records data via a camera of device 600 (e.g., using a first-party trusted application) in order to identify a portion of a scene that would allow device 600 to change to an unlocked state. Figure 10Y to Figure 10Z In 10A to 10B, the device 600 does not display the recording status indicator 1042 because it is determined that the data recorded by the device 600 is not the first type of data. Fig. 10B In , the device 600 is not recording data of the first type because the data being recorded is determined to be data that is not available for later playback. Figure 10Y to Figure 10Z The data recorded in is not available for later playback because device 600 is recording data to identify a portion of the scene in the FOV that will allow device 600 to change to an unlocked state.

[0349] Figures 10AA to 10AC Device 1000 is shown displaying a user interface including capture status indicator 1042. Device 1000 optionally includes one or more components of device 100, device 300, and device 500 described above.

[0350] like Figure 10AA As shown, device 1000 is displaying a user interface including status bar 1022. Figure 10AA In the embodiment of the present invention, because the device 1000 is displaying a user interface including the status bar 1022, the device 1000 displays the capture status indicator 1042 and the status indicators 1022a-1022e in the status bar 1022. The capture status indicator 1042 is at the leftmost of the status indicators 1022a-1022e. In some embodiments, when the status indicator (such as the status bar indicator 1022c) is removed from the status bar 1022, the remaining status bar indicators move to the right to fill the space left by the removed status indicators, and the capture status indicator 1042 remains as the leftmost status indicator in the status bar. In some embodiments, when the status indicator is added to the status bar 1022, the capture status indicator 1042 moves to the left and remains as the leftmost status indicator in the status bar 1022.

[0351] Fig.10AB Device 1000 is shown displaying a user interface that does not include a status bar. Figure 10AA In FIG. 1 , because device 1000 does not display a status bar, device 1000 displays a capture status indicator 1042 at the upper right corner of the user interface, and the position of the capture status indicator is different from that in FIG. 1 . Figure 10AA 1042 is displayed in the capture status indicator (eg, when the status bar 1022 is displayed).

[0352] Figure 10AC The device 1000 is shown in Fig.10AB When the device 1000 is oriented in different directions, the device 1000 displays a user interface that does not include a status bar. Figure 10AC As shown, despite Fig.10AB Compared with device 1000 in Figure 10AC 1000 is in a different orientation, but the device 1000 displays a capture status indicator 1042 in the upper right corner of the user interface. Figures 10AB to 10AC , when the status bar is not displayed, device 1000 displays the capture status indicator at the same location regardless of the orientation of device 600.

[0353] Fig.111100 is a flowchart showing a method for providing a status indicator using a computer system according to some embodiments. Method 1100 is performed at a computer system (e.g., 100, 300, 500, 600) having a first media capture device (e.g., one or more cameras (e.g., dual cameras, triple cameras, quad cameras, etc.) on the same side or different sides (e.g., front camera, rear camera) of the computer system, and / or one or more microphones, etc.) and communicating with a display generation component (e.g., display controller, touch-sensitive display system) and one or more input devices (e.g., touch-sensitive surface). Some operations in method 1100 are optionally combined, the order of some operations is optionally changed, and some operations are optionally omitted.

[0354] As described below, method 1100 provides an intuitive way to provide status indicators to users of a computer system. The method reduces the cognitive burden on the user in determining the status of one or more media capture devices, thereby creating a more efficient human-computer interface. For battery-powered computing devices, enabling the user to manage one or more media capture devices faster and more efficiently saves power and increases the time interval between battery charges.

[0355] A computer system (e.g., 600) (e.g., a smart phone, a smart watch) receives (1102) an indication that a first media capture device has been activated (e.g., recently activated (e.g., activated within a predetermined time (e.g., 1 or 2 seconds) prior to receiving the indication)). In some embodiments, the computer system receives the indication that the first media capture device has been activated by detecting that the first media capture device is actively recording or has been actively recording data (e.g., data representing one or more different types of media (e.g., audio, video, images (e.g., still images))). In some embodiments, the computer system receives the indication that the first media capture device has been activated by detecting that one or more applications are currently (or have been) using a camera or microphone to capture or record media.

[0356] In response to receiving (1104) an indication that the first media capture device has been activated and in accordance with (1106) determining that a first type of data was recorded while the first media capture device was activated (e.g., within a first predetermined time period) (e.g., regardless of (e.g., independent of, irrespective of) whether the media capture device recorded a second type of data), the computer system displays (1108) via a display generation component a graphical indicator (e.g., 1042, 1044a-1044d) indicating activation of the first media capture device. In some embodiments, the first type of data is data that is recorded, stored, retained, or available (e.g., available to one or more applications that cause the media capture device to record data) for later playback as a media item. In some embodiments, the first type of data is data that is readable and accessible for selection and playback by a user via one or more user inputs on a touch-sensitive display of the computer system (e.g., via one or more programs or applications on the system). In some embodiments, based on determining that the first media capture device recorded a first type of data when activated (e.g., regardless of (e.g., independent of, without regard to) whether the media capture device recorded a second type of data), the computer system stops displaying a graphical indicator indicating that another media capture device has been activated. In some embodiments, based on determining that the first media capture device recorded a first type of data when activated, the computer system replaces a graphical indicator indicating that another media capture device has been activated with a graphical indicator indicating activation of the first media capture device. In some embodiments, the first type of data is data that has not been acquired and / or processed to determine whether one or more triggering events (e.g., audible phrases, presence / absence of user's gaze) have occurred. In some embodiments, the first type of data (e.g., a type of data for which a capture status indicator is displayed) corresponds to data passed to a non-trusted application (e.g., a non-first-party voice assistant application, a non-first-party authentication application). In some embodiments, the recording status indicator is displayed regardless of whether the application that is recording the data displays the recorded indicator. Displaying a graphical indicator when a specified condition is met (e.g., when a media capture device is recording a first type of data (e.g., multimedia data)) allows a user to quickly identify when a particular type of data is being (or has been) recorded, and enables the user to take certain actions based on whether the particular type of data is being (or has been) recorded. Performing optimization operations when a set of conditions have been met without further user input enhances the operability of the system and makes the user-system interface more efficient (e.g., by helping the user provide appropriate input and reducing user errors when operating / interacting with the system), which in turn reduces power usage and extends the battery life of the system by enabling the user to use the system more quickly and efficiently.Displaying a graphical indicator when the media capture device is recording a first type of data (e.g., multimedia data) provides feedback to the user that the first media capture device is active and recording the first type of data, which allows the user to be reminded of the recording of the first type of data. Providing improved visual feedback to the user enhances the operability of the system and makes the user-system interface more efficient (e.g., by helping the user provide appropriate input and reducing user errors when operating / interacting with the system), which in turn reduces power usage and extends the battery life of the system by enabling the user to use the system more quickly and efficiently.

[0357] In some embodiments, the first media capture device is a media capture device of the second type. In some embodiments, the computer system displays a third graphical indicator (e.g., 1044c) that is different from the graphical indicator (e.g., 1044b) simultaneously with the graphical indicator (1110). In some embodiments, the graphical indicator includes an indication of a media capture device of the second type; and the third graphical indicator includes an indication of a media capture device of the third type that is different from the media capture device of the second type. In some embodiments, a fourth graphical indicator is displayed together with the graphical indicator. In some embodiments, the fourth graphical indication and the graphical indication are associated with the same media capture device (e.g., the media capture device of the second type). In some embodiments, the graphical indicator includes content indicating that the first application is using or has used the media capture device of the first type, and the graphical indicator includes content indicating that the second application that is different from the first application is using or has used the media capture device of the first type. In some embodiments, the third graphical indicator is displayed based on determining that the computer system is displaying a first user interface (e.g., a settings configuration user interface) (or at this time). In some embodiments, the third graphical indicator is not displayed based on determining that the computer system is displaying a second user interface that is not the first user interface (e.g., a settings configuration user interface) (or at this time). In some embodiments, the graphical indicator and the third graphical indicator are displayed simultaneously (e.g., in response to receiving the first input (e.g., a drag input) and / or when a user interface including multiple settings (e.g., one or more settings for controlling a computer system) is displayed. Displaying a graphical indicator showing that a first type of media capture device (e.g., a microphone) is capturing the first type of data and a graphical indicator showing that a second type of media capture device (e.g., a camera) is capturing the second type of data provides feedback to the user regarding whether the first type of media capture device and the second type of media capture device are being used to capture the first type of data simultaneously. Providing improved visual feedback to the user enhances the operability of the system and makes the user-system interface more efficient (e.g., by helping the user provide appropriate input and reducing user errors when operating / interacting with the system), which in turn reduces power usage and extends the battery life of the system by enabling the user to use the system more quickly and efficiently.

[0358] In response to (1104) receiving an indication that the first media capture device has been activated and based on determining that the first media capture device recorded a second type of data (e.g., FIG. 10A to FIG. 10B , Figure 10Y to Figure 10Z) (e.g., different from the first type) without recording the first type of data (e.g., within a predetermined time period), the computer system forgoes (1112) displaying a graphical indicator (e.g., 1042, 1044a-1044d) indicating activation of the first media capture device. In some embodiments, the second type of data is data that is acquired and / or processed to determine whether one or more triggering events (e.g., audible phrases, presence / absence of user's gaze) have occurred. In some embodiments, the second type of data is data that is not stored as (and / or is not available for) playback at a later time (e.g., audio, video media). In some embodiments, the second type of data is data that is not readable accessible for selection and playback by a user through one or more user inputs on a touch-sensitive display of the computer system (e.g., via one or more programs or applications on the system). In some embodiments, the second type of data (e.g., the type of data for which a capture status indicator is displayed) corresponds to data used to control various features of the device by one or more trusted applications (e.g., components of an operating system or trusted first-party and / or third-party applications) without being passed to non-trusted applications (e.g., non-first-party voice assistant applications, non-authenticated applications) and not being retained as media that can be played back later (e.g., by the device or by another device). In some embodiments, based on determining that the first media capture device has not recorded any data when activated, the computer system abandons displaying a graphical indicator indicating that one or more media capture devices have been activated. In some embodiments, based on determining that the first media capture device recorded the second type of data while activated and did not record the first type of data, the computer system stops displaying a graphical indicator indicating that another media capture device has been activated. Not displaying the graphical indicator when the media capture device records the second type of data (e.g., metadata) provides the user with feedback that the first media capture device is not in an activated state and / or is not recording the first type of data, which allows the user to not be unnecessarily reminded of the recording of the second type of data. Providing improved visual feedback to the user enhances the operability of the device and makes the user-device interface more efficient (e.g., by helping the user provide appropriate input and reducing user errors when ope...

Claims

1. A method comprising: At a computer system in communication with a display generating component and one or more input devices: Displayed via the display generation component: a media viewer user interface including a representation of a first previously captured media item; and a graphical element having a first visual appearance, wherein the graphical element is different from the representation of the first previously captured media item; while displaying the graphical element having the first visual appearance and the media viewer user interface including the representation of the first previously captured media item, receiving a request to display a representation of a second previously captured media item that is different from the first previously captured media item; as well as In response to receiving the request to display the representation of the second previously captured media item: According to determining that a first set of criteria is satisfied, wherein the first set of criteria includes criteria that are satisfied when the representation of the second previously captured media item is a high dynamic range (HDR) media item: displaying the representation of the second previously captured media item; and The graphical element is updated to have a second visual appearance different from the first visual appearance.

2. The method of claim 1 , wherein updating the graphical element to have the second visual appearance different from the first visual appearance comprises: displaying the graphical element as having a first amount of visual characteristics based on determining that a portion of the second previously captured media item has a first brightness level; as well as Based on determining that the portion of the second previously captured media item has a second brightness level different from the first brightness level, the graphical element is displayed having a second amount of the visual characteristic different from the first amount of the visual characteristic.

3. The method of any one of claims 1 to 2, wherein updating the graphical element to have the second visual appearance different from the first visual appearance comprises: displaying the graphical element to have a third amount of visual characteristics based on determining that the second previously captured media item has been displayed for a first amount of time; as well as Based on determining that the second previously captured media item has been displayed for a second amount of time different from the first amount of time, the graphical element is displayed having a fourth amount of the visual characteristic that is different from the third amount of the visual characteristic.

4. The method according to any one of claims 1 to 2, wherein: displaying the representation of the second previously captured media item comprises replacing the representation of the first previously captured media item with the representation of the second previously captured media item; as well as Updating the graphical element to have the second visual appearance different from the first visual appearance includes: displaying the graphical element to have a fifth amount of visual characteristics based on determining that the representation of the first previously captured media item was displayed for at least a first amount of time before being replaced by the representation of the second previously captured media item; as well as Based on determining that the representation of the first previously captured media item has been replaced by the representation of the second previously captured media item within a second amount of time different from the first amount of time, the graphical element is displayed as having a sixth amount of the visual characteristics that is different from the fifth amount of the visual characteristics.

5. The method of any one of claims 1 to 2, wherein updating the graphical element to have the second visual appearance different from the first visual appearance comprises: displaying the graphical element with a seventh quantity of visual characteristics based on determining that an average rate of requests to display previously captured media items is below a first threshold; as well as Based on determining that the average rate of requests to display previously captured media items is not below the first threshold, displaying the graphical element having an eighth amount of the visual characteristic that is different from the seventh amount of the visual characteristic.

6. The method according to any one of claims 1 to 2, further comprising: receiving a request to display a representation of a third previously captured media item different from the first previously captured media item and the second previously captured media item while displaying the graphical element having the first visual appearance via the display generation component; as well as In response to receiving the request to display the representation of the third previously captured media item and in accordance with determining that the first set of criteria is satisfied, wherein the first set of criteria includes criteria that are satisfied when the representation of the third previously captured media item is an HDR media item: displaying the representation of the third previously captured media item; and The graphical element is updated to have a third visual appearance different from the first visual appearance and the second visual appearance.

7. The method of any one of claims 1 to 2, wherein the second previously captured media item is an HDR media item, and wherein the representation of the second previously captured media item is displayed with HDR.

8. The method of any one of claims 1 to 2, wherein the first set of criteria includes criteria that are satisfied when the graphical element is a first color.

9. The method of any one of claims 1 to 2, wherein updating the graphical element to have the second visual appearance comprises displaying an animation that gradually transitions the graphical element from having the first visual appearance to having the second visual appearance.

10. The method of any one of claims 1 to 2, wherein the representation of the second previously captured media item includes content having a luminance amount, and wherein the representation of the second previously captured media item is displayed as having the following content: Based on determining that the brightness amount exceeds a brightness threshold, the representation of the previously captured media item is displayed with a modified brightness amount; and Based on determining that the brightness amount does not exceed the brightness threshold, the representation of the previously captured media item is displayed having the brightness amount.

11. The method according to any one of claims 1 to 2, wherein: the first previously captured media item is not an HDR media item; the second previously captured media item is an HDR media item; and The method further comprises: Prior to displaying, via the display generation component, the media viewer user interface including the representation of the first previously captured media item, displaying, via the display generation component, a user interface including a plurality of representations of media items, wherein: The plurality of representations of media items includes display of a second representation of the first previously captured media item without HDR content and a second representation of the second previously captured media item without HDR content.

12. The method according to any one of claims 1 to 2, further comprising: In response to receiving the request to display the representation of the second previously captured media item: Based on determining that the first set of criteria is not satisfied, updating the graphical element to have the second visual appearance different from the first visual appearance is abandoned.

13. The method according to any one of claims 1 to 2, further comprising: receiving a request to display the representation of a fourth previously captured media item while displaying the representation of the second previously captured media item and the graphical element having the second visual appearance; as well as In response to receiving the request to display the representation of the fourth previously captured media item: According to determining that the first set of criteria is satisfied, wherein the first set of criteria includes criteria that are satisfied when the representation of the fourth previously captured media item is an HDR media item: displaying the representation of the fourth previously captured media item without updating the visual appearance of the graphical element; as well as Upon determination that the first set of criteria is not met: displaying said representation of said fourth previously captured media item; as well as The graphical element is updated to have a predefined visual appearance different from the second visual appearance.

14. A computer-readable storage medium storing one or more programs configured to be executed by one or more processors of a computer system in communication with a display generation component and one or more input devices, the one or more programs comprising instructions for executing the method according to any one of claims 1 to 13.

15. A computer system configured to communicate with a display generation component and one or more input devices, the computer system comprising: one or more processors; and A memory storing one or more programs configured to be executed by the one or more processors, the one or more programs comprising instructions for executing the method according to any one of claims 1 to 13.

16. A computer system configured to communicate with a display generation component and one or more input devices, the computer system comprising: Device for carrying out the method according to any one of claims 1 to 13.

17. A computer program product comprising one or more programs configured to be executed by one or more processors of a computer system in communication with a display generating component and one or more input devices, the one or more programs including instructions for performing the method according to any one of claims 1 to 13.

Images