User interfaces for managing media

Efficient media management methods and interfaces on electronic devices address the inefficiencies of existing interfaces by reducing cognitive burden and conserving battery life through exposure compensation and HDR handling, enhancing user satisfaction and device performance.

JP2025093911AInactive Publication Date: 2025-06-24APPLE INC
View PDF 5 Cites 0 Cited by

Patent Information

Application Number
JP2025018293
Authority / Receiving Office
JP · JP
Patent Type
Applications
Current Assignee / Owner
Priority Date
2020-09-21
Filing Date
2025-02-06
Publication Date
2025-06-24
Estimated Expiration
Not applicable · inactive patent

Smart Images

  • Figure 2025093911000001_ABST
    Figure 2025093911000001_ABST
Patent Text Reader

Abstract

To provide, generally, computer user interfaces, and more specifically, techniques for managing media.SOLUTION: The present disclosure generally relates to user interfaces for managing exposure compensation when capturing media (e.g., an image or video), for displaying representations of media (an image or video), and for displaying a status indicator (e.g., a status indicator indicating that media is and / or has been captured).SELECTED DRAWING: Figure 6B
Need to check novelty before this filing date? Find Prior Art

Description

Technical Field

[0001] The present disclosure generally relates to computer user interfaces, and more specifically to techniques for managing media.

Background Art

[0002] Users of smartphones and other personal electronic devices capture, store, and edit media more frequently to safely preserve memories and share them with friends. Some existing techniques enable users to capture media such as images, audio, and / or video. Users can manage such media, for example, by capturing, storing, and editing it.

Summary of the Invention

[0003] However, some user interfaces for managing media using electronic devices are generally cumbersome and inefficient. For example, some existing techniques use complex and time-consuming user interfaces that may involve multiple key presses or keystrokes. Existing techniques take more time than necessary and waste the user's time and the device's energy. The latter problem is particularly critical in battery-operated devices.

[0004] Accordingly, the present technology provides faster and more efficient methods and interfaces for electronic devices to manage media. Such methods and interfaces optionally complement or replace other methods for managing media. Such methods and interfaces reduce the cognitive burden on the user and create a more efficient human-machine interface. In the case of battery-operated computing systems, such methods and interfaces conserve power and increase the battery charging interval.

[0005] In some examples, the present technology enables a user of a computer system to capture and display media that has been captured in a time - efficient and input - efficient manner, thereby reducing the amount of processing that the device needs to perform. In some examples, the present technology manages the luminance of the area of the user interface, thereby saving battery life.

[0006] According to some embodiments, a method is described. The method is executed in a computer system having one or more cameras, the computer system communicating with a display generation component and one or more input devices. The method includes receiving a request to display a camera user interface, and in response to receiving the request to display the camera user interface, while one or more cameras are configured to capture an image based on a first exposure compensation value, displaying the camera user interface via the display generation component, displaying a first representation of the field of view of the one or more cameras via the display generation component, and displaying an exposure compensation indicator including a first representation of the first exposure compensation value and a visual indication that the computer system has determined that clipping is predicted to occur in response to receiving a request to capture media corresponding to the representation of the field of view of the one or more cameras, simultaneously with the representation of the field of view of the one or more cameras, according to a determination that a set of exposure compensation criteria including criteria to be met when an exposure compensation mode is enabled has been met. The method includes displaying the camera user interface.

[0007] According to some embodiments, a non-transitory computer-readable storage medium is described. The non-transitory computer-readable storage medium stores one or more programs configured to be executed by one or more processors of a computer system having one or more cameras, the computer system communicating with a display generation component and one or more input devices, the one or more programs receiving a request to display a camera user interface, and in response to receiving the request to display the camera user interface, while the one or more cameras are configured to capture an image based on a first exposure compensation value, displaying the camera user interface via the display generation component, displaying a first representation of the field of view of the one or more cameras via the display generation component, and according to a determination that a set of exposure compensation criteria including criteria satisfied when an exposure compensation mode is enabled is satisfied, simultaneously with the representation of the field of view of the one or more cameras, displaying a representation of the first exposure compensation value, and a visual indication to the effect that clipping is predicted to occur in response to the computer system receiving a request to capture media corresponding to the representation of the field of view of the one or more cameras, including an exposure compensation indicator. The instructions include displaying a camera user interface.

[0008] According to some embodiments, a non-transitory computer-readable storage medium is described. The non-transitory computer-readable storage medium stores one or more programs configured to be executed by one or more processors of a computer system having one or more cameras, the computer system communicating with a display generation component and one or more input devices, the one or more programs receiving a request to display a camera user interface, and in response to receiving the request to display the camera user interface, while the one or more cameras are configured to capture an image based on a first exposure compensation value, displaying the camera user interface via the display generation component, displaying a first representation of the field of view of the one or more cameras via the display generation component, and displaying, simultaneously with the representation of the field of view of the one or more cameras, a representation of the first exposure compensation value and a visual indication that the computer system has determined that clipping is predicted to occur in response to receiving a request to capture media corresponding to the representation of the field of view of the one or more cameras, according to a determination that a set of exposure compensation criteria including criteria to be satisfied when an exposure compensation mode is enabled has been satisfied, including an exposure compensation indicator. The request to display the camera user interface includes an instruction to display the camera user interface.

[0009] According to some embodiments, a computer system is described. The computer system includes one or more cameras, one or more processors configured such that the computer system communicates with a display generation component and one or more input devices, and a memory storing one or more programs configured to be executed by the one or more processors. The one or more programs receive a request to display a camera user interface, and in response to receiving the request to display the camera user interface, while the one or more cameras are configured to capture an image based on a first exposure compensation value, display the camera user interface via the display generation component, and display a first representation of the field of view of the one or more cameras via the display generation component. And in accordance with a determination that a set of exposure compensation criteria including criteria satisfied when an exposure compensation mode is enabled is satisfied, simultaneously with the representation of the field of view of the one or more cameras, display a representation of the first exposure compensation value, and the computer system determines that clipping is predicted to occur in response to receiving a request to capture media corresponding to the representation of the field of view of the one or more cameras. Displaying an exposure compensation indicator including a visual indication to that effect. And including an instruction to display a camera user interface.

[0010] According to some embodiments, a computer system is described. The computer system includes means for receiving a request to display a camera user interface, and in response to receiving the request to display a camera user interface, while one or more cameras are configured to capture an image based on a first exposure compensation value, means for displaying the camera user interface via a display generation component, the means for displaying a first representation of the field of view of one or more cameras via the display generation component, and according to a determination that a set of exposure compensation criteria including criteria to be satisfied when an exposure compensation mode is enabled is satisfied, means for displaying an exposure compensation indicator including, simultaneously with the representation of the field of view of one or more cameras, a representation of the first exposure compensation value, and a visual indication that the computer system has determined that clipping is predicted to occur in response to receiving a request to capture media corresponding to the representation of the field of view of one or more cameras.

[0011] According to one embodiment, a method is described. The method is executed in a computer system that communicates with a display generation component and one or more input devices. The method includes, via the display generation component, displaying a media viewer user interface that includes a first portion that includes a representation of a first previously captured media item and a second portion that has a first visual appearance and is different from a first portion of the user interface of the media viewer, and while displaying the media viewer user interface that includes the second portion of the media viewer user interface having the first visual appearance, receiving a request to display a representation of a second previously captured media item that is different from the first previously captured media item, and in response to receiving the request to display the representation of the second previously captured media item, displaying the representation of the second previously captured media item according to a determination that a first set of criteria including criteria that are satisfied when the representation of the second previously captured media item is a high dynamic range (HDR) media item is satisfied, and updating the second portion of the media viewer user interface to have a second visual appearance that is different from the first visual appearance.

[0012] According to some embodiments, a non-transitory computer-readable storage medium is described. A non-transitory computer-readable storage medium storing one or more programs configured to be executed by one or more processors of a computer system, wherein the computer system communicates with a display generation component and one or more input devices, and the one or more programs, via the display generation component, display a media viewer user interface including a first portion including a representation of a first previously captured media item and a second portion having a first visual appearance different from the first portion of the media viewer user interface; while displaying the media viewer user interface including the second portion of the media viewer user interface having the first visual appearance via the display generation component, receive a request to display a representation of a second previously captured media item different from the first previously captured media item; in response to receiving the request to display the representation of the second previously captured media item, display the representation of the second previously captured media item according to a determination that a first set of criteria including criteria satisfied when the representation of the second previously captured media item is a high dynamic range (HDR) media item is satisfied; and update the second portion of the media viewer user interface to have a second visual appearance different from the first visual appearance.

[0013] According to some embodiments, a non-transitory computer-readable storage medium is described. The non-transitory computer-readable storage medium stores one or more programs configured to be executed by one or more processors of a computer system, and the computer system communicates with a display generation component and one or more input devices. The one or more programs cause the computer system to display a media viewer user interface including a first portion including a representation of a first previously captured media item via the display generation component, and a second portion having a first visual appearance different from a first portion of the media viewer user interface. While the computer system is displaying the media viewer user interface including the second portion of the media viewer user interface having the first visual appearance via the display generation component, receive a request to display a representation of a second previously captured media item different from the first previously captured media item. In response to receiving the request to display the representation of the second previously captured media item, display the representation of the second previously captured media item according to a determination that a first set of criteria including criteria satisfied when the representation of the second previously captured media item is a high dynamic range (HDR) media item is satisfied. Update the second portion of the media viewer user interface to have a second visual appearance different from the first visual appearance.

[0014] According to some embodiments, a computer system is described. The computer system includes one or more processors that communicate with a display generation component and one or more input devices, and a memory that stores one or more programs configured to be executed by the one or more processors. The one or more programs cause the computer system to display a media viewer user interface that includes a first portion that includes a representation of a first previously captured media item and a second portion that has a first visual appearance different from the first portion of the media viewer user interface, and while displaying the media viewer user interface that includes the second portion of the media viewer user interface having the first visual appearance, receive a request to display a representation of a second previously captured media item different from the first previously captured media item, and in response to receiving the request to display the representation of the second previously captured media item, display the representation of the second previously captured media item according to a determination that a first set of criteria including criteria satisfied when the representation of the second previously captured media item is a high dynamic range (HDR) media item is satisfied, and update the second portion of the media viewer user interface to have a second visual appearance different from the first visual appearance.

[0015] According to some embodiments, a computer system is described. The computer system includes means for displaying, via a display generation component, a media viewer user interface that includes a first portion that includes a representation of a first previously captured media item and a second portion that has a first visual appearance and is different from a first portion of the user interface of the media viewer, and means for receiving, while displaying, via the display generation component, the media viewer user interface that includes the second portion of the media viewer user interface having the first visual appearance, a request to display a representation of a second previously captured media item that is different from the first previously captured media item, and means for updating, in response to receiving the request to display the representation of the second previously captured media item, the second portion of the media viewer user interface to have a second visual appearance that is different from the first visual appearance, according to a determination that a first set of criteria including criteria that are satisfied when the representation of the second previously captured media item is a high dynamic range (HDR) media item is satisfied, and for displaying the representation of the second previously captured media item.

[0016] According to some embodiments, a method is described. The method is executed in a computer system having a first media capture device, and the computer system communicates with a display generation component and one or more input devices. The method includes receiving an indication that the first media capture device is activated, and in response to receiving the indication that the first media capture device is activated, displaying, via the display generation component, a graphical indicator indicating activation of the first media capture device according to a determination that the first media capture device has recorded first type of data, and while activated, ceasing to display the graphical indicator indicating activation of the first media capture device according to a determination that the first media capture device has recorded second type of data without recording the first type of data.

[0017] According to some embodiments, a non-transitory computer-readable storage medium is described. The non-transitory computer-readable storage medium stores one or more programs configured to be executed by one or more processors of a computer system having a first media capture device, the computer system communicates with a display generation component and one or more input devices, and the one or more programs include instructions to receive an indication that the first media capture device is activated, and in response to receiving the indication that the first media capture device is activated, display, via the display generation component, a graphical indicator indicating activation of the first media capture device according to a determination that the first media capture device has recorded first type of data, and while activated, cease to display the graphical indicator indicating activation of the first media capture device according to a determination that the first media capture device has recorded second type of data without recording the first type of data.

[0018] According to some embodiments, a non-transitory computer-readable storage medium is described. The non-transitory computer-readable storage medium stores one or more programs configured to be executed by one or more processors of a computer system having a first media capture device, the computer system communicating with a display generation component and one or more input devices, and the one or more programs receiving an indication that the first media capture device is activated, and in response to receiving the indication that the first media capture device is activated, displaying, via the display generation component, a graphical indicator indicating the activation of the first media capture device according to a determination that the first media capture device has recorded first type of data, and ceasing to display the graphical indicator indicating the activation of the first media capture device according to a determination that the first media capture device has recorded second type of data without recording the first type of data while being activated, including instructions.

[0019] According to some embodiments, a computer system is described. The computer system includes a first media capture device, which the computer system communicates with a display generation component and one or more input devices, a first media capture device, one or more processors, and a memory storing one or more programs configured to be executed by the one or more processors, the one or more programs receiving an indication that the first media capture device is activated, and in response to receiving the indication that the first media capture device is activated, according to a determination that the first media capture device has recorded first type of data, displaying, via the display generation component, a graphical indicator indicating activation of the first media capture device, and while activated, according to a determination that the first media capture device has recorded second type of data without recording the first type of data, stopping the display of the graphical indicator indicating activation of the first media capture device, the memory including instructions.

[0020] According to some embodiments, a computer system is described. The computer system includes means for a first media capture device to receive an indication that the first media capture device is activated, and in response to receiving the indication that the first media capture device is activated, according to a determination that the first media capture device has recorded first type of data, displaying, via the display generation component, a graphical indicator indicating activation of the first media capture device, and while activated, according to a determination that the first media capture device has recorded second type of data without recording the first type of data, stopping means for displaying the graphical indicator indicating activation of the first media capture device.

[0021] The executable instructions for performing these functions are optionally included within a non-transitory computer-readable storage medium or other computer program product configured to be executed by one or more processors. The executable instructions for performing these functions are optionally included within a transitory computer-readable storage medium or other computer program product configured to be executed by one or more processors.

[0022] Accordingly, a faster and more efficient method and interface for managing media are provided to a device, thereby increasing the effectiveness, efficiency, and user satisfaction of such a device. Such method and interface can complement or replace other methods for managing media.

[0023] To better understand the various embodiments described, the following "Detailed Description of the Invention" should be referred to in conjunction with the following drawings, in which like reference numerals refer to corresponding parts throughout the following figures.

Brief Description of the Drawings

[0024]

Figure 1A

Figure 1B

Figure 2

Figure 3

Figure 4A

Figure 4B

Figure 5A

Figure 5B

Figure 6A

Figure 6B

Figure 6C

Figure 6D

Figure 6E

Figure 6F

Figure 6G

Figure 6H

Figure 6I

Figure 6J

Figure 6K

Figure 6L

Figure 6M

Figure 6N

Figure 6O

Figure 6P

Figure 6Q

Figure 6R

Figure 6S

Figure 6T

Figure 6U

Figure 6V

Figure 7

Figure 8A

Figure 8B

Figure 8C

Figure 8D

Figure 8E

Figure 8F

Figure 8G

Figure 8H

Figure 8I

Figure 8J

Figure 8K

Figure 8L

Figure 9

Figure 10A

Figure 10B

Figure 10C

Figure 10D

Figure 10E

Figure 10F

Figure 10G

Figure 10H

Figure 10I

Figure 10J

Figure 10K

Figure 10L

Figure 10M

Figure 10N

Figure 10O

Figure 10P

Figure 10Q

Figure 10R

Figure 10S

Figure 10T

Figure 10U

Figure 10V

Figure 10W

Figure 10X

Figure 10Y

Figure 10Z

Figure 10AA

Figure 10AB

Figure 10AC

Figure 11

[0025] The following description relates to exemplary methods, parameters, etc. However, such description is not intended as a limitation on the scope of the present disclosure, but rather should be recognized as provided as an explanation of exemplary embodiments instead.

[0026] There is a need for an electronic device that provides an efficient method and interface for managing media, such as the methods described herein, for exposure compensation, capturing media using a display medium, and displaying an indicator of the state of the media. Such technology can reduce the cognitive burden on the user managing the media, thereby enhancing productivity. Further, such techniques can reduce the processor and battery power that would otherwise be wasted on redundant user input.

[0027] Hereinafter, FIGS. 1A - 1B, 2, 3, 4A - 4B, and 5A - 5H provide an explanation of exemplary devices for implementing techniques for managing media.

[0028] FIGS. 6A - 6V show an exemplary user interface for managing exposure compensation according to some embodiments. FIG. 7 is a flowchart showing an exemplary method for managing exposure compensation according to some embodiments. The user interfaces of FIGS. 6A - 6V are used to show the processes described below, including the process of FIG. 7.

[0029] FIGS. 8A - 8L show an exemplary user interface for displaying media according to some embodiments. FIG. 9 is a flowchart showing an exemplary method for displaying media according to some embodiments. The user interfaces of FIGS. 8A - 8L are used to show the processes described below, including the process of FIG. 9.

[0030] Figures 10A to 10AC show exemplary user interfaces for displaying status indicators according to some embodiments. FIG. 11 is a flowchart showing an exemplary method for displaying status indicators according to some embodiments. The user interfaces of FIGS. 10A to 10AC are used to illustrate processes described later, including the process of FIG. 11.

[0031] In the following description, terms such as "first" and "second" are used to describe various elements, but these elements should not be limited by these terms. These terms are only used to distinguish one element from another. For example, without departing from the scope of the various embodiments described, the first touch can be called the second touch, and similarly, the second touch can be called the first touch. The first touch and the second touch are both touches, but they are not the same touch.

[0032] The terms used in the description of the various embodiments described herein are for the purpose of describing particular embodiments only and are not intended to be limiting. In the description of the various embodiments described and the appended claims, the singular forms "a", "an", and "the" are intended to include the plural as well, unless the context clearly dictates otherwise. Also, as used herein, the term "and / or" refers to and includes any and all possible combinations of one or more of the associated listed items. It should be understood that the terms "includes", "including", "comprises", and / or "comprising", when used herein, specify the presence of the stated features, integers, steps, operations, elements, and / or components, but do not preclude the presence or addition of one or more other features, integers, steps, operations, elements, components, and / or groups thereof.

[0033] The term "if" is optionally interpreted, depending on the context, to mean "when" or "upon", or "in response to determining" or "in response to detecting". Similarly, the phrases "if it is determined" or "if [a stated condition or event] is detected" are optionally interpreted, depending on the context, to mean "upon determining" or "in response to determining", or "upon detecting [the stated condition or event]" or "in response to detecting [the stated condition or event]".

[0034] Embodiments of electronic devices, user interfaces for such devices, and related processes for using such devices are described. In some embodiments, the device is a portable communication device such as a cellular phone that also includes other functions such as PDA functionality and / or music player functionality. Exemplary embodiments of portable multifunctional devices include, but are not limited to, the iPhone®, iPod Touch®, and iPad® devices from Apple Inc. of Cupertino, California. Optionally, other portable electronic devices such as laptop or tablet computers having a touch-sensitive surface (e.g., a touch screen display and / or a touch pad) are also used. Also, in some embodiments, it should be understood that the device is not a portable communication device but a desktop computer having a touch-sensitive surface (e.g., a touch screen display and / or a touch pad). In some embodiments, the electronic device is a computer system that communicates (e.g., via wireless communication, via wired communication) with a display generation component. The display generation component is configured to provide a visual output such as a display via a CRT display, a display via an LED display, or a display via image projection. In some embodiments, the display generation component is integrated with the computer system. In some embodiments, the display generation component is separate from the computer system. As used herein, "displaying" content includes causing content (e.g., video data rendered or decoded by display controller 156) to be displayed by sending data (e.g., image data or video data) via a wired or wireless connection to an integrated or external display generation component for visually generating the content.

[0035] In the following discussion, an electronic device including a display and a touch sensing surface will be described. However, it should be understood that the electronic device optionally includes one or more other physical user interface devices such as a physical keyboard, a mouse, and / or a joystick.

[0036] The device typically corresponds to various applications such as one or more of a drawing application, a presentation application, a word processing application, a website creation application, a disk authoring application, a spreadsheet application, a game application, a telephone application, a video conferencing application, an email application, an instant messaging application, a training support application, a photo management application, a digital camera application, a digital video camera application, a web browsing application, a digital music player application, and / or a digital video player application.

[0037] The various applications executed on the device optionally use at least one common physical user interface device such as a touch sensing surface. One or more functions of the touch sensing surface, as well as the corresponding information displayed on the device, are optionally adjusted and / or changed for each application and / or within each respective application. Thus, the common physical architecture of the device (such as a touch sensing surface) optionally supports various applications with a user interface that is intuitive and transparent to the user.

[0038] Attention is now directed to an embodiment of a portable device having a touch-sensing display. FIG. 1A is a block diagram showing a portable multifunctional device 100 having a touch-sensing display system 112 according to some embodiments. The touch-sensing display 112 may be referred to herein, for convenience, as a “touch screen,” and may be known or referred to as a “touch-sensing display system.” Device 100 includes a memory 102 (optionally including one or more computer-readable storage media), a memory controller 122, one or more processing units (CPUs) 120, a peripheral device interface 118, an RF circuit 108, an audio circuit 110, a speaker 111, a microphone 113, an input / output (I / O) subsystem 106, other input control devices 116, and an external port 124. Device 100 optionally includes one or more light sensors 164. Device 100 optionally includes one or more contact intensity sensors 165 (e.g., a touch-sensing surface such as touch-sensing display system 112 of device 100) for detecting the intensity of a contact on device 100. Device 100 optionally includes one or more haptic output generators 167 for generating haptic output on device 100 (e.g., on a touch-sensing surface such as touch-sensing display system 112 of device 100 or touch pad 355 of device 300). These components optionally communicate via one or more communication buses or signal lines 103.

[0039] As used in this specification and the claims, the term "intensity" of a contact on a touch sensing surface refers to the force or pressure (force per unit area) of the contact (e.g., finger contact) on the touch sensing surface, or a proxy for the force or pressure of the contact on the touch sensing surface. The intensity of the contact has a range of values that includes at least four distinct values, and more typically, hundreds (e.g., at least 256) of distinct values. The intensity of the contact is optionally determined (or measured) using a variety of techniques and a variety of sensors or combinations of sensors. For example, one or more force sensors under or adjacent to the touch sensing surface are optionally used to measure the force at various points on the touch sensing surface. In some implementations, force measurements from multiple force sensors are combined (e.g., weighted average) to determine the estimated force of the contact. Similarly, a pressure-sensitive tip of a stylus is optionally used to determine the pressure of the stylus on the touch sensing surface. Alternatively, the size and / or change in size of the contact area detected on the touch sensing surface, the capacitance and / or change in capacitance of the touch sensing surface proximate to the contact, and / or the resistance and / or change in resistance of the touch sensing surface proximate to the contact are optionally used as an alternative to the force or pressure of the contact on the touch sensing surface. In some implementations, an alternative measurement for the force or pressure of the contact is used directly to determine whether it exceeds an intensity threshold (e.g., the intensity threshold is described in units corresponding to the alternative measurement). In some implementations, the proxy measurement for the contact force or pressure is converted to an estimated force or pressure, and the estimated force or pressure is used to determine whether it exceeds an intensity threshold (e.g., the intensity threshold is a pressure threshold measured in units of pressure). By using the intensity of the contact as an attribute of user input, a user can access additional device functions that would normally be inaccessible to the user on a device of reduced size with a limited area for displaying affordances (e.g., on a touch sensing display) and / or receiving user input (e.g., via a touch sensing display, a touch sensing surface, or a physical / mechanical control such as a knob or button).

[0040] As used in this specification and the claims, the term "haptic output" refers to the physical displacement of the device relative to its previous position, the physical displacement of a component of the device (e.g., a touch-sensing surface) relative to another component of the device (e.g., the housing), or the displacement of a component relative to the center of mass of the device, which will be detected by the user's sense of touch. For example, in a situation where the device or a component of the device is in contact with a user's surface sensitive to touch (e.g., a finger, palm, or other part of the user's hand), the haptic output generated by the physical displacement will be interpreted by the user as a tactile sensation corresponding to a perceived change in the physical characteristics of the device or the component of the device. For example, the movement of a touch-sensing surface (e.g., a touch-sensing display or a trackpad) may optionally be interpreted by the user as a "down click" or "up click" of a physical actuator button. In some cases, the user may feel a tactile sensation such as a "down click" or "up click" even when there is no movement of the physical actuator button associated with the touch-sensing surface physically pushed (e.g., displaced) by the user's action. As another example, the movement of a touch-sensing surface may optionally be interpreted or perceived by the user as the "roughness" of the touch-sensing surface even when there is no change in the smoothness of the touch-sensing surface. Such interpretation of touch by the user depends on the user's individual sensory perception, but there are many sensory perceptions of touch that are common to most users. Therefore, when a haptic output is described as corresponding to a particular sensory perception of the user (e.g., "up click", "down click", "roughness"), unless otherwise stated, the generated haptic output corresponds to the physical displacement of the device or a component of the device that generates the described sensory perception of a typical (or average) user.

[0041] Device 100 is merely an example of a portable multifunctional device, and it should be understood that device 100 may optionally have more or fewer components than those shown, may optionally combine two or more components, or may optionally have different configurations or arrangements of those components. The various components shown in FIG. 1A are implemented in a combination of hardware, software, or both hardware and software, including one or more signal processing circuits and / or application specific integrated circuits.

[0042] Memory 102 optionally includes high-speed random access memory and also optionally includes non-volatile memory such as one or more magnetic disk storage devices, flash memory devices, or other non-volatile solid state memory devices. Memory controller 122 optionally controls access to memory 102 by other components of device 100.

[0043] Peripheral interface 118 can be used to couple the input and output peripheral devices of the device to CPU 120 and memory 102. One or more processors 120 operate or execute various software programs and / or instruction sets stored in memory 102 to perform various functions for device 100 and process data. In some embodiments, peripheral interface 118, CPU 120, and memory controller 122 are optionally implemented on a single chip such as chip 104. In some other embodiments, they are optionally implemented on separate chips.

[0044] The RF (radio frequency) circuit 108 transmits and receives RF signals, also called electromagnetic signals. The RF circuit 108 converts electrical signals into electromagnetic signals or vice versa and communicates with a communication network and other communication devices via the electromagnetic signals. The RF circuit 108 optionally includes well-known circuits for performing these functions, including, but not limited to, an antenna system, an RF transceiver, one or more amplifiers, a tuner, one or more oscillators, a digital signal processor, a CODEC chipset, a subscriber identity module (SIM) card, memory, and the like. The RF circuit 108 optionally communicates wirelessly with networks such as the Internet, also called the World Wide Web, an intranet, and / or a wireless network such as a cellular telephone network, a wireless local area network (LAN), and / or a metropolitan area network (MAN), and with other devices. The RF circuit 108 optionally includes well-known circuits for detecting a near field communication (NFC) field, such as by a short-range communication radio. Wireless communication optionally includes, but is not limited to, Global System for Mobile Communications (GSM) for mobile communication, Enhanced Data GSM Environment (EDGE), high-speed downlink packet access (HSDPA), high-speed uplink packet access (HSUPA), Evolution, Data-Only (EV-DO), HSPA, HSPA+, Dual-Cell HSPA (DC-HSPDA), Long Termevolution, LTE), Near Field Communication (NFC), Wideband Code Division Multiple Access (W-CDMA), Code Division Multiple Access (CDMA), Time Division Multiple Access (TDMA), Bluetooth (registered trademark), Bluetooth Low Energy (BTLE (registered trademark)), Wireless Fidelity (Wi-Fi (registered trademark)) (e.g., IEEE 802.11a, IEEE 802.11b, IEEE 802.11g, IEEE 802.11n, and / or IEEE 802.11ac), Voice over Internet Protocol (VoIP), Wi-MAX (registered trademark), protocols for email (e.g., Internet Message Access Protocol (IMAP) and / or Post Office Protocol (POP)), instant messaging (e.g., Extensible Messaging and Presence Protocol (XMPP), Session Initiation Protocol for Instant Messaging and Presence Leveraging Extensions (SIMPLE), Instant Messaging and Presence Service (IMPS)), and / or Short Message Service (SMS), or any other suitable communication protocol including communication protocols not yet developed as of the filing date of this specification.

[0045] The audio circuit 110, the speaker 111, and the microphone 113 provide an audio interface between the user and the device 100. The audio circuit 110 receives audio data from the peripheral device interface 118, converts this audio data into an electrical signal, and transmits this electrical signal to the speaker 111. The speaker 111 converts the electrical signal into human audible sound waves. Also, the audio circuit 110 receives the electrical signal converted from sound waves by the microphone 113. The audio circuit 110 converts the electrical signal into audio data and transmits this audio data to the peripheral device interface 118 for processing. The audio data is optionally obtained from and / or transmitted to the memory 102 and / or the RF circuit 108 by the peripheral device interface 118. In some embodiments, the audio circuit 110 also includes a headset jack (e.g., 212 of FIG. 2). The headset jack provides an interface between the audio circuit 110 and a detachable audio input / output peripheral device such as an output-only headset or a headset having both an output (e.g., mono or stereo headphones) and an input (e.g., a microphone).

[0046] The I / O subsystem 106 couples input / output peripheral devices on the device 100, such as the touch screen 112 and other input control devices 116, to the peripheral device interface 118. The I / O subsystem 106 optionally includes a display controller 156, a light sensor controller 158, a depth camera controller 169, an intensity sensor controller 159, a tactile feedback controller 161, and one or more input controllers 160 for other input devices or control devices. The one or more input controllers 160 receive electrical signals from and / or transmit electrical signals to other input control devices 116. The other input control devices 116 optionally include physical buttons (e.g., push buttons, rocker buttons, etc.), dials, slider switches, joysticks, click wheels, and the like. In some embodiments, the input controller(s) 160 are optionally coupled to (or not coupled to any of) a keyboard, an infrared port, a USB port, and pointer devices such as a mouse. One or more buttons (e.g., 208 of FIG. 2) optionally include up and down buttons for volume control of the speaker 111 and / or the microphone 113. One or more buttons optionally include push buttons (e.g., 206 of FIG. 2). In some embodiments, the electronic device is a computer system that communicates with one or more input devices (e.g., via wireless communication, via wired communication). In some embodiments, the one or more input devices include a touch sensing surface (e.g., a trackpad as part of a touch sensing display). In some embodiments, the one or more input devices include one or more camera sensors (e.g., one or more optical sensors 164 and / or one or more depth camera sensors 175) for tracking a user's gesture (e.g., a hand gesture) as an input. In some embodiments, the one or more input devices are integrated with the computer system. In some embodiments, the one or more input devices are separate from the computer system.

[0047] As described in U.S. Patent Application No. 11 / 322,549, filed December 23, 2005, "Unlocking a Device by Performing Gestures on an Unlock Image," and U.S. Patent No. 7,657,849, which are hereby incorporated by reference in their entirety, a quick press of a push button optionally engages or disengages the lock of the touch screen 112, or optionally initiates a process of unlocking the device using gestures on the touch screen. A longer press of a push button (e.g., 206) optionally turns the power to the device 100 on or off. The functionality of one or more of the buttons is optionally customizable by the user. The touch screen 112 is used to implement virtual or soft buttons and one or more soft keyboards.

[0048] The touch-sensitive display 112 provides an input interface and an output interface between the device and the user. The display controller 156 receives electrical signals from the touch screen 112 and / or transmits electrical signals to the touch screen 112. The touch screen 112 displays a visual output to the user. This visual output optionally includes graphics, text, icons, video, and any combination thereof (collectively referred to as "graphics"). In some embodiments, some or all of the visual output optionally corresponds to user interface objects.

[0049] The touch screen 112 has a touch sensing surface, sensor, or set of sensors that accepts input from a user based on tactile and / or haptic contact. The touch screen 112 and the display controller 156 (along with any associated modules and / or instruction sets within the memory 102) detect contact (and any movement or interruption of the contact) on the touch screen 112 and convert the detected contact into an interaction with user interface objects (e.g., one or more soft keys, icons, web pages, or images) displayed on the touch screen 112. In an exemplary embodiment, the point of contact between the touch screen 112 and the user corresponds to the user's finger.

[0050] The touch screen 112 optionally uses LCD (liquid crystal display) technology, LPD (light emitting polymer display) technology, or LED (light emitting diode) technology, although in other embodiments other display technologies are also used. The touch screen 112 and the display controller 156 optionally use any of a plurality of touch sensing technologies, now known or hereafter developed, including but not limited to capacitive, resistive, infrared, and surface acoustic wave technologies, and other proximity sensor arrays or other elements for determining one or more points of contact with the touch screen 112, to detect contact and any movement or interruption thereof. In an exemplary embodiment, projected mutual capacitance sensing technology, such as that found in the iPhone® and iPod Touch® from Apple Inc. of Cupertino, California, is used.

[0051] The touch-sensitive displays in some embodiments of the touch screen 112 are optionally similar to multi-touch sensitive touch pads as described in U.S. Patent Nos. 6,323,846 (Westerman et al.), 6,570,557 (Westerman et al.), and / or 6,677,932 (Westerman), and / or U.S. Patent Publication No. 2002 / 0015024 (A1), each of which is hereby incorporated by reference in its entirety. However, the touch screen 112 displays visual output from the device 100, whereas the touch-sensitive touch pad does not provide visual output.

[0052] Touch sensing displays in some embodiments of touch screen 112 are described in (1) U.S. Patent Application No. 11 / 381,313, filed May 2, 2006, "Multipoint Touch Surface Controller", (2) U.S. Patent Application No. 10 / 840,862, filed May 6, 2004, "Multipoint Touchscreen", (3) U.S. Patent Application No. 10 / 903,964, filed Jul. 30, 2004, "Gestures For Touch Sensitive Input Devices", (4) U.S. Patent Application No. 11 / 048,264, filed Jan. 31, 2005, "Gestures For Touch Sensitive Input Devices", (5) U.S. Patent Application No. 11 / 038,590, filed Jan. 18, 2005, "Mode-Based Graphical User Interfaces For Touch Sensitive Input Devices", (6) U.S. Patent Application No. 11 / 228,758, filed Sep. 16, 2005, "Virtual Input Device Placement On A Touch Screen User Interface", (7) U.S. Patent Application No. 11 / 228,700, filed Sep. 16, 2005, "Operation Of A Computer With A Touch Screen Interface", (8) U.S. Patent Application No. 11 / 228,737, filed Sep. 16, 2005, "Activating Virtual Keys Of A Touch-Screen Virtual Keyboard", and (9) U.S. Patent Application No. 11 / 367,749, filed Mar. 3, 2006, "Multi-Functional Hand-Held Device". All of these applications are hereby incorporated by reference in their entirety.

[0053] The touch screen 112 optionally has a video resolution greater than 100 dpi. In some embodiments, the touch screen has a video resolution of about 160 dpi. The user optionally touches the touch screen 112 using any suitable object or appendage such as a stylus, finger, etc. In some embodiments, the user interface is designed to primarily handle finger-based contact and gestures, although this may not be as precise as stylus-based input due to the larger contact area of the finger on the touch screen. In some embodiments, the device converts rough input by a finger into an accurate pointer / cursor position or command for performing the action desired by the user.

[0054] In some embodiments, in addition to the touch screen, the device 100 optionally includes a touch pad for activating or deactivating certain functions. In some embodiments, the touch pad, unlike the touch screen, is a touch-sensitive area of the device that does not display a visual output. The touch pad is optionally a touch-sensitive surface separate from the touch screen 112 or an extension of the touch-sensitive surface formed by the touch screen.

[0055] The device 100 also includes a power system 162 that supplies power to various components. The power system 162 optionally includes a power management system, one or more power sources (e.g., battery, alternating current (AC)), a recharge system, a power outage detection circuit, a power converter or inverter, a power status indicator (e.g., light-emitting diode (LED)), and any other components associated with the generation, management, and distribution of power within a portable device.

[0056] Device 100 also optionally includes one or more light sensors 164. FIG. 1A shows a light sensor coupled to a light sensor controller 158 within I / O subsystem 106. Light sensor 164 optionally includes a charge-coupled device (CCD) or a complementary metal-oxide semiconductor (CMOS) phototransistor. Light sensor 164 receives light from the environment projected through one or more lenses and converts the light into data representing an image. Light sensor 164 cooperates with imaging module 143 (also referred to as a camera module) to optionally capture a still image or video. In some embodiments, the light sensor is located on the back surface of device 100 opposite touch screen display 112 on the front surface of the device, and thus the touch screen display can be effectively used as a viewfinder for acquiring still and / or video images. In some embodiments, the light sensor is located on the front surface of the device, and thus an image of the user can optionally be obtained for a video conference, and the user can view other video conference participants on the touch screen display. In some embodiments, the position of light sensor 164 can be changed by the user (e.g., by rotating the lens and sensor within the device housing), and thus a single light sensor 164 can be used for both video conferencing and for acquiring still and / or video images together with the touch screen display.

[0057] Device 100 also optionally includes one or more depth camera sensors 175. FIG. 1A shows a depth camera sensor coupled to a depth camera controller 169 within I / O subsystem 106. The depth camera sensor 175 receives data from the environment and creates a three-dimensional model of an object (e.g., a face) within the scene from the viewpoint (e.g., the depth camera sensor). In some embodiments, in cooperation with imaging module 143 (also referred to as the camera module), the depth camera sensor 175 is optionally used to determine depth maps of various portions of an image captured by imaging module 143. In some embodiments, a depth camera sensor is disposed on the front face of device 100 such that an image of the user with depth information is optionally acquired for a video conference and a self-portrait image with depth map data is captured while the user is viewing other video conference participants on a touch screen display. In some embodiments, the depth camera sensor 175 is disposed on the back face of the device, or on both the back and front faces of device 100. In some embodiments, the position of the depth camera sensor 175 can be changed by the user (e.g., by rotating the lens and sensor within the device housing), such that the depth camera sensor 175 is used both with the touch screen display for video conferencing and for acquiring still and / or video images.

[0058] In some embodiments, a depth map (e.g., a depth map image) includes information (e.g., values) regarding the distance of objects within a scene from a viewpoint (e.g., a camera, a light sensor, a depth camera sensor). In one embodiment of a depth map, each depth pixel defines a position along the Z-axis of the viewpoint at which its corresponding 2D pixel is located. In some embodiments, the depth map is composed of pixels, and each pixel is defined by a value (e.g., between 0 and 255). For example, the value "0" represents a pixel located at the farthest location within the "3D" scene, and the value "255" represents a pixel located closest to the viewpoint (e.g., a camera, a light sensor, a depth camera sensor) within that "3D" scene. In other embodiments, the depth map represents the distance between an object within the scene and the plane of the viewpoint. In some embodiments, the depth map includes information regarding the relative depth of various features of an object of interest (e.g., the relative depth of the eyes, nose, mouth, ears of a user's face) as seen from a depth camera. In some embodiments, the depth map includes information that enables the device to determine the outline of an object of interest in the z-direction.

[0059] Device 100 also optionally includes one or more contact intensity sensors 165. FIG. 1A shows a contact intensity sensor coupled to an intensity sensor controller 159 within I / O subsystem 106. Contact intensity sensor 165 optionally includes one or more piezoresistive strain gauges, capacitive force sensors, electrokinetic sensors, piezoelectric sensors, optical force sensors, capacitive touch sensing surfaces, or other intensity sensors (e.g., sensors used to measure the force (or pressure) of contact on a touch sensing surface). Contact intensity sensor 165 receives contact intensity information (e.g., pressure information, or a proxy for pressure information) from the environment. In some embodiments, at least one contact intensity sensor is juxtaposed with, or in proximity to, a touch sensing surface (e.g., touch sensing display system 112). In some embodiments, at least one contact intensity sensor is disposed on the back of device 100, on the opposite side of touch screen display 112 disposed on the front of device 100.

[0060] In addition, device 100 optionally includes one or more proximity sensors 166. FIG. 1A shows proximity sensor 166 coupled to peripheral device interface 118. Alternatively, proximity sensor 166 is optionally coupled to input controller 160 within I / O subsystem 106. Proximity sensor 166 functions as described in U.S. Patent Application Nos. 11 / 241,839, "Proximity Detector In Handheld Device", 11 / 240,788, "Proximity Detector In Handheld Device", 11 / 620,702, "Using Ambient Light Sensor To Augment Proximity Sensor Output", 11 / 586,862, "Automated Response To And Sensing Of User Activity In Portable Devices", and 11 / 638,251, "Methods And Systems For Automatic Configuration Of Peripherals", which are hereby incorporated by reference in their entirety. In some embodiments, when a multifunctional device is placed near the user's ear (e.g., when the user is on a phone call), the proximity sensor turns off and disables touch screen 112.

[0061] Device 100 also optionally includes one or more haptic output generators 167. FIG. 1A shows a haptic output generator coupled to a haptic feedback controller 161 within I / O subsystem 106. The haptic output generator 167 optionally includes one or more electroacoustic devices, such as speakers or other audio components, and / or electromechanical devices that convert energy, such as motors, solenoids, electroactive polymers, piezoelectric actuators, electrostatic actuators, or other haptic output generating components (e.g., components that convert an electrical signal into a haptic output on the device), into linear movement. The contact intensity sensor 165 receives haptic feedback generation instructions from the haptic feedback module 133 and generates a haptic output on device 100 that can be sensed by a user of device 100. In some embodiments, at least one haptic output generator is juxtaposed with, or proximate to, a touch sensing surface (e.g., touch sensing display system 112) and optionally generates a haptic output by moving the touch sensing surface in a vertical direction (e.g., in / out of the surface of device 100) or in a horizontal direction (e.g., back and forth within the same plane as the surface of device 100). In some embodiments, at least one haptic output generator sensor is disposed on the back of device 100, on the opposite side of touch screen display 112 disposed on the front of device 100.

[0062] Device 100 also optionally includes one or more accelerometers 168. FIG. 1A shows an accelerometer 168 coupled to the peripheral device interface 118. Alternatively, the accelerometer 168 is optionally coupled to an input controller 160 within the I / O subsystem 106. The accelerometer 168 functions as described, for example, in U.S. Patent Publication No. 20050190059, "Acceleration-based Theft Detection System for Portable Electronic Devices," and U.S. Patent Publication No. 20060017692, "Methods And Apparatuses For Operating A Portable Device Based On An Accelerometer," both of which are hereby incorporated by reference in their entireties. In some embodiments, information is displayed on the touch screen display in portrait or landscape view based on analysis of data received from one or more accelerometers. In addition to the accelerometer 168, device 100 optionally includes a magnetometer and a GPS (or GLONASS or other global navigation system) receiver for obtaining information regarding the location and orientation (e.g., vertical or horizontal) of device 100.

[0063] In some embodiments, the software components stored in memory 102 include an operating system 126, a communication module (or instruction set) 128, a touch / motion module (or instruction set) 130, a graphics module (or instruction set) 132, a text input module (or instruction set) 134, a Global Positioning System (GPS) module (or instruction set) 135, and an application (or instruction set) 136. Further, in some embodiments, memory 102 (FIG. 1A) or 370 (FIG. 3) stores a device / global internal state 157 as shown in FIGS. 1A and 3. The device / global internal state 157 includes one or more of an active application state indicating which application is active if there is a currently active application, a display state indicating which application, view, or other information occupies various regions of the touch screen display 112, a sensor state including information obtained from various sensors and input control devices 116 of the device, and position information regarding the position and / or orientation of the device.

[0064] The operating system 126 (e.g., an embedded operating system such as Darwin®, RTXC®, LINUX®, UNIX®, OS X®, iOS®, WINDOWS®, or VxWorks®) includes various software components and / or drivers that control and manage common system tasks (e.g., memory management, control of storage devices, power management, etc.) and facilitate communication between various hardware components and software components.

[0065] The communication module 128 facilitates communication with other devices via one or more external ports 124 and also includes various software components for processing data received by the RF circuit 108 and / or the external port 124. The external ports 124 (e.g., Universal Serial Bus (USB), FIREWIRE (registered trademark), etc.) are adapted to couple to other devices either directly or indirectly via a network (e.g., the Internet, a wireless LAN, etc.). In some embodiments, the external port is a multi-pin (e.g., 30-pin) connector that is the same as or similar to and / or compatible with the 30-pin connector used on iPod (registered trademark) devices (a trademark of Apple Inc.).

[0066] The contact / motion module 130 optionally detects contact with the touch screen 112 (in cooperation with the display controller 156) and other touch sensing devices (e.g., a touch pad or a physical click wheel). The contact / motion module 130 performs various operations related to the detection of contact, such as determining whether contact has occurred (e.g., detecting an event of a finger being lowered), determining the intensity of the contact (e.g., the force or pressure of the contact, or an alternative to the force or pressure of the contact), determining whether there is movement of the contact, tracking movement across the touch sensing surface (e.g., detecting one or more events of a finger being dragged), and determining whether the contact has stopped (e.g., detecting an event of a finger being raised or an interruption of the contact), and includes various software components for performing these operations. The contact / motion module 130 receives contact data from the touch sensing surface. Determining the movement of the contact point, represented by a series of contact data, optionally includes determining the speed (magnitude), velocity (magnitude and direction), and / or acceleration (change in magnitude and / or direction) of the contact point. These operations are optionally applied to a single contact (e.g., contact with one finger) or multiple simultaneous contacts (e.g., "multi-touch" / contact with multiple fingers). In some embodiments, the contact / motion module 130 and the display controller 156 detect contact on the touch pad.

[0067] In some embodiments, the contact / motion module 130 uses a set of one or more intensity thresholds to determine whether an action has been performed by the user (e.g., to determine whether the user has "clicked" on an icon). In some embodiments, at least one subset of the intensity thresholds is determined according to software parameters (e.g., the intensity thresholds can be adjusted without changing the physical hardware of the device 100, rather than being determined by the activation thresholds of specific physical actuators). For example, the mouse "click" threshold for a trackpad or touch screen display can be set to any of a wide range of default thresholds without changing the trackpad or touch screen display hardware. Additionally, in some implementations, the user of the device is provided with software settings for adjusting one or more of the set of intensity thresholds (e.g., by a system-level click "intensity" parameter to adjust individual intensity thresholds and / or multiple intensity thresholds at once).

[0068] The contact / motion module 130 optionally detects gesture inputs by the user. Different gestures on the touch-sensing surface have different contact patterns (e.g., the detected movement, timing, and / or intensity of the contact is different). Thus, gestures are optionally detected by detecting a specific contact pattern. For example, detecting a finger tap gesture includes detecting a finger down event, followed by detecting a finger up (lift off) event at the same position (or substantially the same position) as the finger down event (e.g., the position of an icon). As another example, detecting a finger swipe gesture on the touch-sensing surface includes detecting a finger down event, followed by detecting one or more finger drag events, and then followed by detecting a finger up (lift off) event.

[0069] The graphic module 132 includes various known software components for rendering and displaying graphics on the touch screen 112 or other display, including components that vary the visual impact of the displayed graphics (e.g., brightness, transparency, saturation, contrast, or other visual characteristics). As used herein, the term "graphic" includes, but is not limited to, any object that can be displayed to a user, including letters, web pages, icons (such as user interface objects including soft keys), digital images, videos, animations, and the like.

[0070] In some embodiments, the graphic module 132 stores data representing the graphics that will be used. Each graphic is optionally assigned a corresponding code. The graphic module 132 receives, from an application or the like, one or more codes specifying the graphics to be displayed, along with coordinate data and other graphic characteristic data as needed, and then generates the image data for the screen to be output to the display controller 156.

[0071] The haptic feedback module 133 includes various software components for generating instructions to be used by the haptic output generator(s) 167 to generate haptic output at one or more locations on the device 100 in response to user interaction with the device 100.

[0072] The text input module 134 is optionally a component of the graphic module 132 and provides a soft keyboard for entering text in various applications (e.g., contacts 137, email 140, IM 141, browser 147, and any other application that requires text input).

[0073] The GPS module 135 determines the location of the device and provides this information for use in various applications (e.g., to the phone 138 for location-based dialing, to the camera 143 as metadata for photos / videos, and to applications that provide location-based services such as weather widgets, local yellow page widgets, and map / navigation widgets).

[0074] The application 136 optionally includes the following modules (or sets of instructions) or subsets or supersets thereof. ● Contact module 137 (sometimes referred to as an address book or contact list), ● Phone module 138, ● Video conferencing module 139, ● Email client module 140, ● Instant messaging (IM) module 141, ● Training support module 142, ● Camera module 143 for still and / or video images, ● Image management module 144, ● Video player module, ● Music player module, ● Browser module 147, ● Calendar module 148, ● Widget module 149 that optionally includes one or more of weather widget 149-1, stock price widget 149-2, calculator widget 149-3, alarm clock widget 149-4, dictionary widget 149-5, and other widgets obtained by the user, as well as user-created widget 149-6, ● Widget creation module 150 for creating user-created widget 149-6, ● Search module 151, ● Video and music player module 152 that integrates the video player module and the music player module ● Memo module 153, ● Map module 154, and / or ● Online video module 155.

[0075] Examples of other applications 136 optionally stored in the memory 102 include other word processing applications, other image editing applications, drawing applications, presentation applications, JAVA (registered trademark)-compatible applications, encryption, digital rights management, voice recognition, and voice replication.

[0076] In cooperation with the touch screen 112, the display controller 156, the contact / motion module 130, the graphic module 132, and the text input module 134, the contact module 137 is optionally used to add name(s) to the address book, delete name(s) from the address book, associate a phone number(s), an email address(es), a physical address(es), or other information with a name, associate an image with a name, classify and sort names, provide a phone number or email address to initiate and / or facilitate communication by phone 138, the videoconference module 139, email 140, or IM 141, etc., for managing the address book or contact list (e.g., stored in the application internal state 192 of the contact module 137 in the memory 102 or the memory 370).

[0077] In cooperation with the RF circuit 108, audio circuit 110, speaker 111, microphone 113, touch screen 112, display controller 156, contact / motion module 130, graphic module 132, and text input module 134, the telephone module 138 is optionally used for input of a character sequence corresponding to a telephone number, access to one or more telephone numbers in the contact module 137, modification of an input telephone number, dialing of each telephone number, conducting a conversation, and call termination or hang-up when the conversation ends. As described above, the wireless communication optionally uses any of a plurality of communication standards, protocols, and technologies.

[0078] In cooperation with the RF circuit 108, audio circuit 110, speaker 111, microphone 113, touch screen 112, display controller 156, optical sensor 164, optical sensor controller 158, contact / motion module 130, graphic module 132, text input module 134, contact module 137, and telephone module 138, the videoconference module 139 includes executable instructions for starting, executing, and ending a videoconference between the user and one or more other participants according to a user command.

[0079] In cooperation with the RF circuit 108, touch screen 112, display controller 156, contact / motion module 130, graphic module 132, and text input module 134, the email client module 140 includes executable instructions for creating, sending, receiving, and managing emails in response to user commands. In cooperation with the image management module 144, the email client module 140 facilitates the creation and sending of emails with still or video images captured by the camera module 143.

[0080] In cooperation with the RF circuit 108, touch screen 112, display controller 156, contact / motion module 130, graphic module 132, and text input module 134, the instant messaging module 141 includes executable instructions for inputting a character sequence corresponding to an instant message, modifying previously input characters, sending each instant message (e.g., using the Short Message Service (SMS) or Multimedia Message Service (MMS) protocol for phone communication-based instant messages, or using XMPP, SIMPLE, or IMPS for Internet-based instant messages), receiving instant messages, and viewing received instant messages. In some embodiments, the instant messages transmitted and / or received optionally include graphics, photos, audio files, video files, and / or other attached files supported by MMS and / or Enhanced Messaging Service (EMS). As used herein, "instant messaging" refers to both phone communication-based messages (e.g., messages sent using SMS or MMS) and Internet-based messages (e.g., messages sent using XMPP, SIMPLE, or IMPS).

[0081] In cooperation with the RF circuit 108, touch screen 112, display controller 156, contact / motion module 130, graphic module 132, text input module 134, GPS module 135, map module 154, and music player module, the training support module 142 creates training (e.g., having time, distance, and / or calorie burn goals), communicates with a training sensor (sports device), receives training sensor data, calibrates sensors used to monitor the training, selects and plays music for the training, and includes executable instructions for displaying, storing, and transmitting training data.

[0082] In cooperation with the touch screen 112, display controller 156, light sensor(s) 164, light sensor controller 158, contact / motion module 130, graphic module 132, and image management module 144, the camera module 143 includes executable instructions for capturing a still image or video (including a video stream) and storing it in the memory 102, modifying the characteristics of the still image or video, or deleting the still image or video from the memory 102.

[0083] In cooperation with the touch screen 112, display controller 156, contact / motion module 130, graphic module 132, text input module 134, and camera module 143, the image management module 144 includes executable instructions for arranging, modifying (e.g., editing), or otherwise operating on still images and / or video images, labeling, deleting, presenting (e.g., in a digital slide show or album), and storing them.

[0084] In cooperation with the RF circuit 108, touch screen 112, display controller 156, contact / motion module 130, graphic module 132, and text input module 134, the browser module 147 includes executable instructions for browsing the Internet according to user commands, including searching for, linking to, receiving, and displaying a web page or a portion thereof, as well as attached files and other files linked to the web page.

[0085] In cooperation with the RF circuit 108, touch screen 112, display controller 156, contact / motion module 130, graphic module 132, text input module 134, email client module 140, and browser module 147, the calendar module 148 includes executable instructions for creating, displaying, modifying, and storing a calendar and data associated with the calendar (e.g., calendar items, to do lists, etc.) according to user instructions.

[0086] In cooperation with the RF circuit 108, touch screen 112, display controller 156, contact / motion module 130, graphic module 132, text input module 134, and browser module 147, the widget module 149 is a mini-application (e.g., weather widget 149-1, stock price widget 149-2, calculator widget 149-3, alarm clock widget 149-4, and dictionary widget 149-5) that is optionally downloaded and used by the user, or a mini-application (e.g., user-created widget 149-6) created by the user. In some embodiments, the widget includes an HTML (Hypertext Markup Language) file, a CSS (Cascading Style Sheets) file, and a JavaScript file. In some embodiments, the widget includes an XML (Extensible Markup Language) file and a JavaScript file (e.g., Yahoo! widget).

[0087] In cooperation with the RF circuit 108, touch screen 112, display controller 156, contact / motion module 130, graphic module 132, text input module 134, and browser module 147, the widget creator module 150 is optionally used by the user to create a widget (e.g., make a user-specified portion of a web page into a widget).

[0088] In cooperation with the touch screen 112, display controller 156, contact / motion module 130, graphic module 132, and text input module 134, the search module 151 includes executable instructions for searching for characters, music, sound, images, video, and / or other files in the memory 102 that match one or more search criteria (e.g., one or more user-specified search terms) according to a user command.

[0089] In conjunction with touch screen 112, display controller 156, contact / motion module 130, graphic module 132, audio circuit 110, speaker 111, RF circuit 108, and browser module 147, video and music player module 152 includes executable instructions that enable a user to download and play recorded music and other sound files stored in one or more file formats such as MP3 or AAC files, and executable instructions for displaying, presenting, or otherwise playing video (e.g., on touch screen 112 or on an external display connected via external port 124). In some embodiments, device 100 optionally includes the functionality of an MP3 player such as an iPod (trademark of Apple Inc.).

[0090] In conjunction with touch screen 112, display controller 156, contact / motion module 130, graphic module 132, and text input module 134, memo module 153 includes executable instructions for creating and managing memos, to-do lists, etc. in accordance with user instructions.

[0091] In conjunction with RF circuit 108, touch screen 112, display controller 156, contact / motion module 130, graphic module 132, text input module 134, GPS module 135, and browser module 147, map module 154 is optionally used to receive, display, modify, and store maps and data associated with the maps (e.g., driving directions, data regarding stores and other points of interest near or at a particular location, and other location-based data) in accordance with user instructions.

[0092] In cooperation with touch screen 112, display controller 156, contact / motion module 130, graphic module 132, audio circuit 110, speaker 111, RF circuit 108, text input module 134, email client module 140, and browser module 147, online video module 155 includes instructions that enable a user to access a particular online video, browse a particular online video, receive (e.g., by streaming and / or downloading), play (e.g., on the touch screen or on an external display connected via external port 124), send an email having a link to a particular online video, and perform other management of online videos in one or more file formats such as H.264. In some embodiments, instead of email client module 140, instant messaging module 141 is used to send a link to a particular online video. Additional explanation of the online video application can be found in U.S. Provisional Patent Application No. 60 / 936,562, filed Jun. 20, 2007, "Portable Multifunction Device, Method, and Graphical User Interface for Playing Online Videos", and U.S. Patent Application No. 11 / 968,067, filed Dec. 31, 2007, "Portable Multifunction Device, Method, and Graphical User Interface for Playing Online Videos", the contents of which are hereby incorporated by reference in their entirety.

[0093] The modules and applications identified above each correspond to a set of executable instructions that perform one or more of the functions described above and the methods described in this application (e.g., the computer-implemented methods and other information processing methods described herein). These modules (e.g., instruction sets) need not be implemented as separate software programs, procedures, or modules, and thus, in various embodiments, various subsets of these modules may optionally be combined or otherwise reconfigured. For example, a video player module may optionally be combined with a music player module to form a single module (e.g., the video and music player module 152 of FIG. 1A). In some embodiments, the memory 102 optionally stores a subset of the modules and data structures identified above. Further, the memory 102 optionally stores additional modules and data structures not described above.

[0094] In some embodiments, the device 100 is a device in which the operation of a set of default functions in the device is performed only via a touch screen and / or a touch pad. By using the touch screen and / or the touch pad as the main input control device for the device 100 to operate, the number of physical input control devices (push buttons, dials, etc.) on the device 100 is optionally reduced.

[0095] The set of default functions performed only through the touch screen and / or the touch pad optionally includes navigation between user interfaces. In some embodiments, when touched by the user, the touch pad navigates the device 100 from any user interface displayed on the device 100 to the main menu, home menu, or root menu. In such embodiments, the "menu button" is implemented using the touch pad. In some other embodiments, the menu button is a physical push button or other physical input control device rather than the touch pad.

[0096] Figure 1B is a block diagram showing exemplary components for event processing according to some embodiments. In some embodiments, memory 102 (FIG. 1A) or 370 (FIG. 3) includes an event sorter 170 (e.g., within operating system 126) and respective applications 136-1 (e.g., any of the aforementioned applications 137-151, 155, 380-390).

[0097] The event sorter 170 receives event information and determines the application 136-1 to which the event information is to be delivered and the application view 191 of the application 136-1. The event sorter 170 includes an event monitor 171 and an event dispatcher module 174. In some embodiments, the application 136-1 includes an application internal state 192 that indicates the current application view(s) displayed on the touch-sensitive display 112 when the application is active or running. In some embodiments, the device / global internal state 157 is used by the event sorter 170 to determine which application(s) is / are currently active, and the application internal state 192 is used by the event sorter 170 to determine the application view 191 to which the event information is to be delivered.

[0098] In some embodiments, the application internal state 192 includes additional information such as resume information to be used when the application 136-1 resumes execution, user interface state information indicating or ready to display the information being displayed by the application 136-1, a state queue that enables the user to return to the previous state or view of the application 136-1, and a redo / undo queue of previous actions performed by the user.

[0099] The event monitor 171 receives event information from the peripheral device interface 118. The event information includes information regarding sub-events (e.g., a user touch on the touch-sensitive display 112 as part of a multi-touch gesture). The peripheral device interface 118 transmits information received from the I / O subsystem 106, or sensors such as the proximity sensor 166, the accelerometer(s) 168, and / or the microphone 113 (via the audio circuit 110). The information that the peripheral device interface 118 receives from the I / O subsystem 106 includes information from the touch-sensitive display 112 or a touch-sensitive surface.

[0100] In some embodiments, the event monitor 171 transmits requests to the peripheral device interface 118 at predetermined intervals. In response, the peripheral device interface 118 transmits event information. In other embodiments, the peripheral device interface 118 transmits event information only when there is an important event (e.g., reception of an input that exceeds a predetermined noise threshold and / or exceeds a predetermined duration).

[0101] In some embodiments, the event sorter 170 also includes a hit view determination module 172 and / or an active event recognition unit determination module 173.

[0102] The hit view determination module 172 provides a software procedure for determining where within one or more views a sub-event occurs when the touch-sensitive display 112 displays two or more views. A view is composed of control devices and other elements that a user can view on the display.

[0103] Another aspect of the user interface associated with an application is a set of views, sometimes referred to herein as application views or user interface windows, in which information is displayed and touch-based gestures occur. The application views (for each application) in which touches are detected optionally correspond to a program level within the program hierarchy or view hierarchy of the application. For example, the lowest level view in which a touch is detected is optionally referred to as the hit view, and the set of events recognized as appropriate input is optionally determined based at least in part on the hit view of the initial touch that initiates the touch-based gesture.

[0104] The hit view determination module 172 receives information related to sub-events of touch-based gestures. When an application has a plurality of hierarchically structured views, the hit view determination module 172 identifies the hit view as the lowest level view within the hierarchy in which the sub-events are to be processed. In most situations, the hit view is the lowest level view in which the start sub-event (e.g., the first sub-event in a sequence of sub-events that form an event or potential event) occurs. Once the hit view is identified by the hit view determination module 172, this hit view typically receives all sub-events related to the same touch or input source that was identified as the hit view.

[0105] The active event recognition unit determination module 173 determines which view(s) within the view hierarchy should receive a particular sequence of sub-events. In some embodiments, the active event recognition unit determination module 173 determines that only the hit view should receive a particular sequence of sub-events. In other embodiments, the active event recognition unit determination module 173 determines that all views including the physical location of the sub-event are views that are actively involved, and thus determines that all views that are actively involved should receive a particular sequence of sub-events. In other embodiments, even if a touch sub-event is completely limited to an area associated with one particular view, the upper-level views within the hierarchy remain views that are still actively involved.

[0106] The event dispatcher module 174 dispatches event information to an event recognition unit (e.g., event recognition unit 180). In embodiments that include the active event recognition unit determination module 173, the event dispatcher module 174 distributes event information to the event recognition unit determined by the active event recognition unit determination module 173. In some embodiments, the event dispatcher module 174 stores the event information obtained by each event receiver 182 in an event queue.

[0107] In some embodiments, the operating system 126 includes an event sorter 170. Alternatively, the application 136-1 includes an event sorter 170. In still other embodiments, the event sorter 170 is a stand-alone module or a part of another module stored in the memory 102 such as the touch / motion module 130.

[0108] In some embodiments, application 136-1 includes a plurality of event processing units 190 and one or more application views 191, each including instructions for processing touch events that occur within respective views of the application's user interface. Each application view 191 of application 136-1 includes one or more event recognition units 180. Typically, each application view 191 includes a plurality of event recognition units 180. In other embodiments, one or more of the event recognition units 180 are part of a separate module, such as a user interface kit or a higher-level object from which application 136-1 inherits methods and other attributes. In some embodiments, each event processing unit 190 includes one or more of event data 179 received from data update unit 176, object update unit 177, GUI update unit 178, and / or event sorter 170. The event processing unit 190 optionally utilizes or invokes the data update unit 176, object update unit 177, or GUI update unit 178 to update the internal state 192 of the application. Alternatively, one or more of the application views 191 include one or more respective event processing units 190. Also, in some embodiments, one or more of the data update unit 176, object update unit 177, and GUI update unit 178 are included in respective application views 191.

[0109] Each event recognition unit 180 receives event information (e.g., event data 179) from event sorter 170 and identifies an event from this event information. The event recognition unit 180 includes an event receiving unit 182 and an event comparing unit 184. In some embodiments, the event recognition unit 180 also includes at least a subset of metadata 183 and event distribution instructions 188 (optionally including sub-event distribution instructions).

[0110] The event receiving unit 182 receives event information from the event sorter 170. The event information includes sub-events, for example, information about a touch or a movement of a touch. Depending on the sub-event, the event information also includes additional information such as the position of the sub-event. When the sub-event relates to a movement of a touch, the event information also optionally includes the speed and direction of the sub-event. In some embodiments, the event includes a rotation of the device from one orientation to another (e.g., from portrait to landscape or vice versa), and the event information includes corresponding information about the current orientation of the device (also referred to as the posture of the device).

[0111] The event comparison unit 184 compares the event information with the definition of a defined event or sub-event, and based on the comparison, determines an event or sub-event, or determines or updates the state of an event or sub-event. In some embodiments, the event comparison unit 184 includes an event definition 186. The event definition 186 includes definitions of events (e.g., a sequence of predefined sub-events) such as event 1 (187-1) and event 2 (187-2). In some embodiments, the sub-events within an event (187) include, for example, a start of a touch, an end of a touch, a movement of a touch, a cancellation of a touch, and multiple touches. In one example, the definition of event 1 (187-1) is a double-tap on a displayed object. The double-tap includes, for example, a first touch (touch start) on the displayed object for a predetermined stage, a first lift-off (touch end) for the predetermined stage, a second touch (touch start) on the displayed object for the predetermined stage, and a second lift-off (touch end) for the predetermined stage. In another example, the definition of event 2 (187-2) is a drag on a displayed object. The drag includes, for example, a touch (or contact) on the displayed object for a predetermined stage, a movement of the touch across the touch-sensitive display 112, and a lift-off of the touch (touch end). In some embodiments, the event also includes information about one or more associated event processing units 190.

[0112] In some embodiments, event definition 187 includes the definition of events for each user interface object. In some embodiments, event comparison unit 184 performs a hit test to determine which user interface object is associated with the sub - event. For example, within an application view where three user interface objects are displayed on touch - sensitive display 112, when a touch is detected on touch - sensitive display 112, event comparison unit 184 performs a hit test to determine which of the three user interface objects is associated with the touch (sub - event). If each displayed object is associated with a respective event processing unit 190, the event comparison unit uses the result of the hit test to determine which event processing unit 190 should be activated. For example, event comparison unit 184 selects the event processing unit associated with the sub - event and object that triggered the hit test.

[0113] In some embodiments, the definition of each event 187 also includes a delay action that delays the delivery of event information until it is determined whether the sequence of sub - events corresponds to the event type of the event recognition unit.

[0114] If each event recognition unit 180 determines that a series of sub - events does not match any of the events in event definition 186, each event recognition unit 180 enters a state of event impossible, event failure, or event end, and then ignores the next sub - event of the touch - based gesture. In this situation, if there are other event recognition units that remain active for the hit view, that event recognition unit continues to track and process the sub - events of the ongoing touch - based gesture.

[0115] In some embodiments, each event recognition unit 180 includes metadata 183 having configurable properties, flags, and / or lists indicating how the event distribution system should actively participate in event recognition units that perform sub-event distribution. In some embodiments, the metadata 183 includes configurable properties, flags, and / or lists indicating how event recognition units interact with each other or how they can interact with each other. In some embodiments, the metadata 183 includes configurable properties, flags, and / or lists indicating whether sub-events are distributed to various levels in the view hierarchy or program hierarchy.

[0116] In some embodiments, each event recognition unit 180 activates an event processing unit 190 associated with the event when one or more specific sub-events of the event are recognized. In some embodiments, each event recognition unit 180 distributes event information associated with the event to the event processing unit 190. Activating the event processing unit 190 is separate from sending (and deferring sending) sub-events to each hit view. In some embodiments, the event recognition unit 180 sets a flag associated with the recognized event, and the event processing unit 190 associated with the flag catches the flag and executes a predefined process.

[0117] In some embodiments, the event distribution command 188 includes a sub-event distribution command that distributes event information about sub-events without activating the event processing unit. Instead, the sub-event distribution command distributes the event information to an event processing unit associated with a series of sub-events or to a view actively involved. The event processing unit associated with a series of sub-events or an actively involved view receives the event information and performs predetermined processing.

[0118] In some embodiments, the data update unit 176 creates and updates data used in the application 136-1. For example, the data update unit 176 updates the phone numbers used in the contact module 137 or stores video files used in the video player module. In some embodiments, the object update unit 177 creates and updates objects used in the application 136-1. For example, the object update unit 177 creates a new user interface object or updates the position of a user interface object. The GUI update unit 178 updates the GUI. For example, the GUI update unit 178 prepares display information and sends the display information to the graphic module 132 for display on the touch-sensitive display.

[0119] In some embodiments, the event processing unit(s) 190 includes or has access to the data update unit 176, the object update unit 177, and the GUI update unit 178. In some embodiments, the data update unit 176, the object update unit 177, and the GUI update unit 178 are included in a single module of their respective application 136-1 or application view 191. In other embodiments, they are included in two or more software modules.

[0120] The foregoing description regarding event processing of a user's touch on the touch-sensitive display also applies to other forms of user input for operating the multifunctional device 100 using an input device, but it should be understood that not all of them are initiated on the touch screen. For example, the movement of a mouse and the pressing of a mouse button, the movement of a contact such as a tap, drag, or scroll on a touch pad, a pen stylus input, the movement of the device, a spoken command, a detected eye movement, a biometric input, and / or any combination thereof, optionally in association with a single or multiple presses or holds of a keyboard, are used as inputs corresponding to sub-events that define events to be optionally recognized.

[0121] FIG. 2 shows a portable multifunctional device 100 having a touch screen 112 according to some embodiments. The touch screen optionally displays one or more graphics within a user interface (UI) 200. In this embodiment, as well as in other embodiments described below, a user can select one or more of those graphics by performing a gesture on the graphics, for example, using one or more fingers 202 (not drawn to scale in the figure) or one or more styli 203 (not drawn to scale in the figure). In some embodiments, the selection of one or more graphics is performed when the user interrupts contact with the one or more graphics. In some embodiments, the gesture optionally includes one or more taps, one or more swipes (from left to right, from right to left, upward and / or downward), and / or rolling of a finger in contact with the device 100 (from right to left, from left to right, upward and / or downward). In some implementations or situations, an unexpected contact with a graphic does not select that graphic. For example, if the gesture corresponding to the selection is a tap, a swipe gesture that sweeps over an application icon does not optionally select the corresponding application.

[0122] The device 100 also optionally includes one or more physical buttons, such as a "home" button or a menu button 204. As described above, the menu button 204 is optionally used to navigate to any application 136 within a set of applications optionally running on the device 100. Alternatively, in some embodiments, the menu button is implemented as a soft key within a GUI displayed on the touch screen 112.

[0123] In some embodiments, device 100 includes a touch screen 112, a menu button 204, a push button 206 for turning the device on / off and locking the device, volume adjustment buttons 208, a subscriber identity module (SIM) card slot 210, a headset jack 212, and a docking / charging external port 124. The push button 206 is optionally used to turn the device on / off by pressing the button and holding it pressed for a predefined period, to lock the device by pressing the button and releasing it before a predefined time has elapsed, and / or to unlock the device or initiate an unlock process. In an alternative embodiment, device 100 also accepts verbal input via a microphone 113 to activate or deactivate some functions. Device 100 also optionally includes one or more contact intensity sensors 165 for detecting the intensity of contact on the touch screen 112 and / or one or more haptic output generators 167 for generating haptic output to the user of device 100.

[0124] FIG. 3 is a block diagram of an exemplary multifunctional device having a display and a touch sensing surface, according to some embodiments. Device 300 need not be portable. In some embodiments, device 300 is a laptop computer, a desktop computer, a tablet computer, a multimedia player device, a navigation device, an educational device (such as a child's learning toy), a gaming system, or a control device (e.g., a home or industrial controller). Device 300 typically includes one or more processing units (CPUs) 310, one or more networks or other communication interfaces 360, memory 370, and one or more communication buses 320 interconnecting these components. Communication bus 320 optionally includes circuitry (sometimes called a chipset) that interconnects and controls communications between system components. Device 300 includes an input / output (I / O) interface 330 that includes a display 340, which is typically a touch screen display. I / O interface 330 also optionally includes a keyboard and / or mouse (or other pointing device) 350, a touch pad 355, a haptic output generator 357 that generates haptic output on device 300 (e.g., similar to haptic output generator 167 described above with reference to FIG. 1A), and a sensor 359 (e.g., a light, acceleration, proximity, touch sensing, and / or contact intensity sensor similar to contact intensity sensor 165 described above with reference to FIG. 1A). Memory 370 includes high-speed random access memory such as DRAM, SRAM, DDR RAM, or other random access solid state memory devices, and optionally includes non-volatile memory such as one or more magnetic disk storage devices, optical disk storage devices, flash memory devices, or other non-volatile solid state storage devices. Memory 370 optionally includes one or more storage devices remotely located from the CPU(s) 310.In some embodiments, the memory 370 stores programs, modules, and data structures similar to, or a subset of, the programs, modules, and data structures stored in the memory 102 of the portable multifunctional device 100 (FIG. 1A). Further, the memory 370 optionally stores additional programs, modules, and data structures that do not exist in the memory 102 of the portable multifunctional device 100. For example, the memory 370 of the device 300 optionally stores a drawing module 380, a presentation module 382, a word processing module 384, a website creation module 386, a disk authoring module 388, and / or a spreadsheet module 390, whereas the memory 102 of the portable multifunctional device 100 (FIG. 1A) optionally does not store these modules.

[0125] Each of the elements identified above in FIG. 3 is optionally stored in one or more of the memory devices described above. Each of the modules identified above corresponds to a set of instructions that perform the functions described above. The modules or programs (e.g., sets of instructions) identified above need not be implemented as separate software programs, procedures, or modules, and thus in various embodiments, various subsets of these modules are optionally combined or otherwise reconfigured. In some embodiments, the memory 370 optionally stores a subset of the modules and data structures identified above. Further, the memory 370 optionally stores additional modules and data structures not described above.

[0126] Next, attention is optionally directed to embodiments of a user interface that are implemented, for example, on the portable multifunctional device 100.

[0127] FIG. 4A shows an exemplary user interface of a menu of applications on a portable multifunctional device 100 according to some embodiments. A similar user interface is optionally implemented on device 300. In some embodiments, the user interface 400 includes the following elements, or a subset or superset thereof. ● Signal strength indicator(s) 402 for wireless communication(s) such as cellular signal and Wi-Fi® signal, ● Time 404, ● Bluetooth® indicator 405, ● Battery status indicator 406, ● A tray 408 having icons of frequently used applications such as ○ An icon 416 of the phone module 138 labeled "Phone", optionally including an indicator 414 of the number of missed calls or voicemail messages, ○ An icon 418 of the email client module 140 labeled "Mail", optionally including an indicator 410 of the number of unread emails, ○ An icon 420 of the browser module 147 labeled "Browser", and ○ An icon 422 of the video and music player module 152, also referred to as the iPod (trademark of Apple Inc.) module 152, labeled "iPod", and ● Icons of other applications such as ○ An icon 424 of the IM module 141 labeled "Message", ○ An icon 426 of the calendar module 148 labeled "Calendar", ○ An icon 428 of the image management module 144 labeled "Photos", ○ An icon 430 of the camera module 143 labeled "Camera", ○ An icon 432 of the online video module 155 labeled "Online Video", ○ An icon 434 of the stock price widget 149-2, labeled with "Stock Price", ○ An icon 436 of the map module 154, labeled with "Map", ○ An icon 438 of the weather widget 149-1, labeled with "Weather", ○ An icon 440 of the alarm clock widget 149-4, labeled with "Clock", ○ An icon 442 of the training support module 142, labeled with "Training Support", ○ An icon 444 of the memo module 153, labeled with "Memo", and ○ An icon 446 of the settings application or module, labeled with "Settings", which provides access to the settings for the device 100 and its various applications 136.

[0128] Note that the icon labels shown in FIG. 4A are merely illustrative. For example, other labels such as "Music" or "Music Player" that are displayed for the icon 422 for the video and music player module 152 may be optionally used for various application icons. In some embodiments, the label for each application icon includes the name of the application corresponding to that application icon. In some embodiments, the label for a particular application icon is different from the name of the application corresponding to that particular application icon.

[0129] FIG. 4B shows an exemplary user interface on a device (e.g., device 300 of FIG. 3) having a touch sensing surface 451 (e.g., the tablet or touch pad 355 of FIG. 3) separate from the display 450 (e.g., touch screen display 112). The device 300 also optionally includes one or more contact intensity sensors (e.g., one or more of the sensors 359) that detect the intensity of contact on the touch sensing surface 451, and / or one or more haptic output generators 357 that generate haptic output to the user of the device 300.

[0130] Some of the following examples are given with reference to inputs on the touch screen display 112 (where the touch sensing surface and the display are combined), but in some embodiments, the device detects inputs on a touch sensing surface separate from the display shown in FIG. 4B. In some embodiments, the touch sensing surface (e.g., 451 in FIG. 4B) has a primary axis (e.g., 452 in FIG. 4B) corresponding to the primary axis (e.g., 453 in FIG. 4B) on the display (e.g., 450). According to these embodiments, the device detects contact with the touch sensing surface 451 (e.g., 460 and 462 in FIG. 4B) at locations corresponding to each location on the display (e.g., in FIG. 4B, 460 corresponds to 468 and 462 corresponds to 470). In this way, user inputs (e.g., contacts 460 and 462 and their movements) detected by the device on the touch sensing surface (e.g., 451 in FIG. 4B) are used by the device to operate the user interface on the display (e.g., 450 in FIG. 4B) of the multifunctional device when the touch sensing surface is separate from the display. It should be understood that a similar method is optionally used for other user interfaces described herein.

[0131] In addition, the following examples are given mainly with reference to finger inputs (e.g., finger contact, finger tap gesture, finger swipe gesture), but it should be understood that in some embodiments, one or more of the finger inputs may be replaced by inputs from another input device (e.g., mouse-based input or stylus input). For example, a swipe gesture may optionally be replaced by the movement of a cursor along a swipe path followed by a mouse click (e.g., instead of contact movement). As another example, a tap gesture may optionally be replaced by a mouse click while the cursor is positioned over the location of the tap gesture (e.g., instead of detecting contact and then stopping detection of the contact). Similarly, it should be understood that when multiple user inputs are detected simultaneously, multiple computer mice may optionally be used simultaneously, or mouse and finger contacts may optionally be used simultaneously.

[0132] FIG. 5A shows an exemplary personal electronic device 500. The device 500 includes a body 502. In some embodiments, the device 500 can include some or all of the features described with respect to devices 100 and 300 (e.g., FIGS. 1A - 4B). In some embodiments, the device 500 has a touch-sensitive display screen 504, hereinafter the touch screen 504. Alternatively, or in addition to the touch screen 504, the device 500 has a display and a touch-sensitive surface. Similar to devices 100 and 300, in some embodiments, the touch screen 504 (or the touch-sensitive surface) optionally includes one or more intensity sensors that detect the intensity of an applied contact (e.g., a touch). One or more intensity sensors of the touch screen 504 (or the touch-sensitive surface) can provide output data representing the intensity of the touch. The user interface of the device 500 can respond to a touch based on the intensity of the touch, which means that touches of different intensities can call different user interface operations on the device 500.

[0133] Exemplary techniques for detecting and processing touch intensity can be found, for example, in International Patent Application No. PCT / US2013 / 040061, filed May 8, 2013, published as International Patent No. WO / 2013 / 169849, "Device, Method, and Graphical User Interface for Displaying User Interface Objects Corresponding to an Application", and International Patent Application No. PCT / US2013 / 069483, filed November 11, 2013, published as International Patent No. WO / 2014 / 105276, "Device, Method, and Graphical User Interface for Transitioning Between Touch Input to Display Output Relationships", each of which is hereby incorporated by reference in its entirety.

[0134] In some embodiments, device 500 has one or more input mechanisms 506 and 508. Input mechanisms 506 and 508, if included, can be physical mechanisms. Examples of physical input mechanisms include push buttons and rotatable mechanisms. In some embodiments, device 500 has one or more attachment mechanisms. Such attachment mechanisms, if included, can enable device 500 to be attached, for example, to hats, eyewear, earrings, necklaces, shirts, jackets, bracelets, watch bands, chains, pants, belts, shoes, wallets, backpacks, etc. These attachment mechanisms enable the user to wear device 500.

[0135] FIG. 5B shows an exemplary personal electronic device 500. In some embodiments, device 500 can include some or all of the components described with respect to FIGS. 1A, 1B, and 3. Device 500 has a bus 512 that operably couples an I / O section 514 to one or more computer processors 516 and a memory 518. The I / O section 514 can be connected to a display 504, which can have a touch sensing component 522 and optionally an intensity sensor 524 (e.g., a contact intensity sensor). Additionally, the I / O section 514 can be connected to a communication unit 530 that receives application and operating system data using Wi-Fi, Bluetooth®, near field communication (NFC), cellular, and / or other wireless communication techniques. The device 500 can include an input mechanism 506 and / or 508. The input mechanism 506 can optionally be, for example, a rotatable input device or a depressible and rotatable input device. In some examples, the input mechanism 508 can optionally be a button.

[0136] In some examples, the input mechanism 508 can optionally be a microphone. The personal electronic device 500 can optionally include various sensors such as a GPS sensor 532, an accelerometer 534, a direction sensor 540 (e.g., a compass), a gyroscope 536, a motion sensor 538, and / or combinations thereof, all of which can be operably connected to the I / O section 514.

[0137] The memory 518 of the personal electronic device 500 can include one or more non-transitory computer-readable storage media for storing computer-executable instructions that, when executed by one or more computer processors 516, can cause the computer processor to perform, for example, the techniques described below, including processes 700, 900, and 1100 (FIGS. 7, 9, and 11). A computer-readable storage media can be any media that tangibly contains or stores computer-executable instructions for use by or in connection with an instruction execution system, apparatus, or device. In some embodiments, the storage media is a transitory computer-readable storage media. In some embodiments, the storage media is a non-transitory computer-readable storage media. Non-transitory computer-readable storage media can include, but is not limited to, magnetic, optical, and / or semiconductor memory devices. Examples of such storage devices include magnetic disks, optical disks based on CD, DVD, or Blu-ray technology, and persistent solid-state memories such as flash, solid-state drives. The personal electronic device 500 is not limited to the components and configurations of FIG. 5B and can include other or additional components in a plurality of configurations.

[0138] As used herein, the term "affordance" optionally refers to user interaction graphical user interface objects that are displayed on the display screens of devices 100, 300, and / or 500 (FIGS. 1A, 3, and 5A-5B). For example, images (e.g., icons), buttons, and text (e.g., hyperlinks) each optionally constitute an affordance.

[0139] As used herein, the term "focus selector" refers to an input element that indicates the current part of the user interface with which the user is interacting. In some implementations that include a cursor or other location marker, the cursor acts as the "focus selector," and thus when an input (e.g., a press input) is detected on a touch-sensitive surface (e.g., touchpad 355 of FIG. 3 or touch-sensitive surface 451 of FIG. 4B) while the cursor is positioned over a particular user interface element (e.g., a button, window, slider, or other user interface element), the particular user interface element is adjusted according to the detected input. In some implementations that include a touch screen display (e.g., touch-sensitive display system 112 of FIG. 1A or touch screen 112 of FIG. 4A) that enables direct interaction with user interface elements on the touch screen display, the detected contact on the touch screen acts as the "focus selector," and thus when an input (e.g., a press input by contact) is detected at the location of a particular user interface element (e.g., a button, window, slider, or other user interface element) on the touch screen display, the particular user interface element is adjusted according to the detected input. In some implementations, the focus is moved from one region of the user interface to another region of the user interface without movement of the corresponding cursor or movement of the contact on the touch screen display (e.g., by using the tab key or arrow keys to move the focus from one button to another), and in these implementations, the focus selector moves in accordance with the movement of the focus between different regions of the user interface. Regardless of the particular form taken by the focus selector, the focus selector is generally a user interface element (or a contact on the touch screen display) that is controlled by the user (e.g., by indicating to the device the element of the user interface with which the user intends to interact) to communicate the user's intended interaction to the user interface.For example, while a press input is detected on a touch sensing surface (e.g., a touch pad or a touch screen), the position of a focus selector (e.g., a cursor, a contact, or a selection box) over the corresponding button indicates that the user intends to activate that corresponding button (as opposed to other user interface elements shown on the display of the device).

[0140] As used in this specification and the claims, the term "characteristic strength" of a contact refers to the characteristics of that contact based on one or more strengths of the contact. In some embodiments, the characteristic strength is based on a plurality of strength samples. The characteristic strength is optionally based on a set of strength samples collected during a predetermined period (e.g., 0.05, 0.1, 0.2, 0.5, 1, 2, 5, 10 seconds) associated with a predetermined number of strength samples, i.e., a predetermined event (e.g., after detecting a contact, before detecting a lift-off of the contact, before or after detecting a start of movement of the contact, before detecting an end of the contact, before or after detecting an increase in the strength of the contact, and / or before or after detecting a decrease in the strength of the contact). The characteristic strength of a contact is optionally based on one or more of the maximum value of the strength of the contact, the mean value of the strength of the contact, the average value of the strength of the contact, the top 10 percentile value of the strength of the contact, the median value of the strength of the contact, the top 90 percent value of the strength of the contact, etc. In some embodiments, the duration of the contact is used when determining the characteristic strength (e.g., when the characteristic strength is the average of the strength of the contact over time). In some embodiments, the characteristic strength is compared to a set of one or more strength thresholds to determine whether an action has been performed by a user. For example, a set of one or more strength thresholds optionally includes a first strength threshold and a second strength threshold. In this example, a contact having a characteristic strength that does not exceed the first threshold results in a first action, a contact having a characteristic strength that exceeds the first threshold but does not exceed the second threshold results in a second action, and a contact having a characteristic strength that exceeds the second threshold results in a third action. In some embodiments, the comparison between the characteristic strength and one or more thresholds is not used to determine whether to perform a first action or a second action, but is used to determine whether to perform one or more actions (e.g., whether to perform each action or whether to refrain from performing each action).

[0141] In some embodiments, for the purpose of determining characteristic strength, a portion of the gesture is identified. For example, the touch sensing surface optionally receives a continuous swipe contact that transitions from a starting location to reach an ending location, at which point the intensity of the contact increases. In this example, the characteristic strength of the contact at the ending location is optionally based on only a portion of the continuous swipe contact (e.g., only the portion of the swipe contact at the ending location) rather than the entire swipe contact. In some embodiments, optionally, a smoothing algorithm is applied to the intensity of the swipe contact before determining the characteristic strength of the contact. For example, the smoothing algorithm optionally includes one or more of an unweighted moving average smoothing algorithm, a triangular smoothing algorithm, a median filter smoothing algorithm, and / or an exponential smoothing algorithm. In some situations, these smoothing algorithms eliminate minor increases or decreases in the intensity of the swipe contact for the purpose of determining characteristic strength.

[0142] The intensity of a contact on the touch sensing surface is optionally characterized relative to one or more intensity thresholds such as a contact detection intensity threshold, a light press intensity threshold, a deep press intensity threshold, and / or one or more other intensity thresholds. In some embodiments, the light press intensity threshold typically corresponds to the intensity at which the device performs an operation associated with clicking a button or trackpad of a physical mouse. In some embodiments, the deep press intensity threshold typically corresponds to the intensity at which the device performs an operation different from that associated with clicking a button or trackpad of a physical mouse. In some embodiments, when a contact having a characteristic strength below the light press intensity threshold (e.g., above a nominal contact detection intensity threshold below which the contact is not detected) is detected, the device moves the focus selector in accordance with the movement of the contact on the touch sensing surface without performing an operation associated with the light press intensity threshold or the deep press intensity threshold. Generally, unless otherwise specified, these intensity thresholds are consistent across various sets of user interface figures.

[0143] An increase in the characteristic intensity of a contact from an intensity below a light press intensity threshold to an intensity between the light press intensity threshold and a deep press intensity threshold may be referred to as an input of "light press". An increase in the characteristic intensity of a contact from an intensity below a deep press intensity threshold to an intensity above the deep press intensity threshold may be referred to as an input of "deep press". An increase in the characteristic intensity of a contact from an intensity below a contact detection intensity threshold to an intensity between the contact detection intensity threshold and the light press intensity threshold may be referred to as a detection of a contact on the touch surface. A decrease in the characteristic intensity of a contact from an intensity above the contact detection intensity threshold to an intensity below the contact detection intensity threshold may be referred to as a detection of a lift-off of the contact from the touch surface. In some embodiments, the contact detection intensity threshold is zero. In some embodiments, the contact detection intensity threshold is greater than zero.

[0144] In some embodiments described herein, in response to detecting a gesture including each press input, or in response to detecting each press input performed by each contact (or contacts), one or more operations are performed, and each press input is detected at least in part based on detecting an increase in the intensity of a contact (or contacts) above a press input intensity threshold. In some embodiments, each operation is performed in response to detecting an increase in the intensity of each contact above the press input intensity threshold (e.g., the "downstroke" of each press input). In some embodiments, the press input includes an increase in the intensity of each contact above the press input intensity threshold and a subsequent decrease in the intensity of the contact below the press input intensity threshold, and each operation is performed in response to detecting a subsequent decrease in the intensity of each contact below the press input threshold (e.g., the "upstroke" of each press input).

[0145] In some embodiments, the device employs intensity hysteresis to avoid spurious inputs sometimes referred to as "jitter", and the device defines or selects a hysteresis intensity threshold having a predefined relationship to the press input intensity threshold (e.g., the hysteresis intensity threshold is X intensity units lower than the press input intensity threshold, or the hysteresis intensity threshold is 75%, 90%, or some reasonable percentage of the press input intensity threshold). Thus, in some embodiments, a press input includes an increase in the intensity of each contact above the press input intensity threshold, and a subsequent decrease in the intensity of the contact below the hysteresis intensity threshold corresponding to the press input intensity threshold, and each operation is performed in response to detecting a subsequent decrease in the intensity of each contact below the hysteresis intensity threshold (e.g., the "upstroke" of each press input). Similarly, in some embodiments, a press input is detected only when the device detects an increase in the intensity of a contact from an intensity below the hysteresis intensity threshold to an intensity above the press input intensity threshold, and optionally, a subsequent decrease in the intensity of the contact to an intensity below the hysteresis intensity, and each operation is performed in response to detecting the press input (e.g., an increase in the intensity of the contact or a decrease in the intensity of the contact, depending on the situation).

[0146] For ease of explanation, the description of an operation performed in response to a press input associated with a press input intensity threshold, or a gesture including a press input, is optionally triggered in response to detecting any of an increase in the intensity of a contact above the press input intensity threshold, an increase in the intensity of a contact from an intensity below the hysteresis intensity threshold to an intensity above the press input intensity threshold, a decrease in the intensity of a contact below the press input intensity threshold, and / or a decrease in the intensity of a contact below the hysteresis intensity threshold corresponding to the press input intensity threshold. Further, in an example where an operation is described as being performed in response to detecting a decrease in the intensity of a contact below the press input intensity threshold, the operation is optionally performed in response to detecting a decrease in the intensity of a contact corresponding to and below a hysteresis intensity threshold lower than the press input intensity threshold.

[0147] As used herein, an "installed application" refers to a software application that has been downloaded onto an electronic device (e.g., device 100, 300, and / or 500) and is ready to be launched (e.g., opened) on the device. In some embodiments, the downloaded application becomes an installed application by an installation program that extracts a program portion from the downloaded package and integrates the extracted portion with the operating system of the computer system.

[0148] As used herein, the terms "open application" or "running application" refer to a software application that has retained state information (e.g., as part of device / global internal state 157 and / or application internal state 192). An open or running application is optionally any one of the following types of applications. ● An active application that is currently displayed on the display screen of the device being used by the application, ● A background application (or background process) for which one or more processes are being processed by one or more processors although not currently displayed, and ● An interrupted or suspended application that is not running but is stored in memory (volatile and non-volatile respectively) and has state information that can be used to resume execution of the application.

[0149] As used herein, the term "closed application" refers to a software application that does not have retained state information (e.g., state information for a closed application is not stored in the memory of the device). Thus, closing an application includes stopping and / or removing the application process for the application and removing the state information for the application from the device's memory. Generally, opening a second application within a first application does not close the first application. When the second application is being displayed and the first application has finished being displayed, the first application becomes a background application.

[0150] Next, attention is directed to embodiments of a user interface ("UI") and related processes implemented on an electronic device such as the portable multifunctional device 100, the device 300, or the device 500.

[0151] Figures 6A - 6V illustrate exemplary user interfaces for managing exposure compensation using an electronic device, according to some embodiments. The user interfaces of these figures are used to illustrate the processes described below, including the process of FIG. 7.

[0152] FIG. 6A shows an electronic device 600 that displays a camera user interface including a live preview 630 that optionally extends from the top of the display to the bottom of the display. The device 600 optionally includes one or more features of the device 100, the device 300, or the device 500.

[0153] The live preview 630 shows a particular scene (e.g., the sky in FIG. 6A) within the field of view of one or more cameras. The live preview 630 is a representation of the (e.g., partial) field of view (“FOV”) of one or more cameras of the device 600. The live preview 630 is based on an image detected in the FOV. In some embodiments, the device 600 uses multiple camera sensors to capture images and combines them to display the live preview 630. In some embodiments, the device 600 uses a single camera sensor to capture an image and display the live preview 630.

[0154] The camera user interface of FIG. 6A includes an indicator region 602 and a control region 606. The indicator region 602 and the control region 606 are superimposed on the live preview 630 so that indicators and controls can be displayed simultaneously with the live preview 630. The camera display region 604 is sandwiched between the indicator region 602 and the control region 606 and does not substantially overlap with an indicator or a control.

[0155] As shown in FIG. 6A, the indicator region 602 includes indicators such as a flash indicator 602a and an animation image indicator 602b. The flash indicator 602a indicates whether the flash is on, off, or in another mode (e.g., automatic mode). In FIG. 6A, the flash indicator 602a indicates to the user that the flash is off. The animation image indicator 602b indicates whether the camera is configured to capture a single image or multiple images (e.g., in response to detecting a request to capture media). In some embodiments, the indicator region 602 includes an overlay that is superimposed on the live preview 630 and optionally colored (e.g., gray, translucent).

[0156] As shown in FIG. 6A, the camera display area 604 includes a live preview 630 and a zoom affordance 622. Here, the "1×" zoom affordance is selected, indicating that the live preview 630 is represented at the 1× zoom level.

[0157] As shown in FIG. 6A, the control region 606 includes a shutter affordance 610, a camera switcher affordance 614, a representation of the media collection 612, and a camera settings affordance 626. When activated, the shutter affordance 610 causes the device 600 to capture media (e.g., a photo) using one or more camera sensors based on the current state of the live preview 630 and the current state of the camera application. The captured media is stored locally on the electronic device 600 and / or transmitted to a remote server for storage. When activated, the camera switcher affordance 614 causes the device 600 to switch, such as between a rear camera sensor and a front camera sensor, to show the view of different cameras within the live preview 630. The representation of the media collection 612 shown in FIG. 6A is a representation of the media (images, videos) most recently captured by the device 600. In some embodiments, in response to detecting a gesture on the media collection 612, the device 600 displays a user interface similar to the user interface shown in FIG. 8A (described below). As shown in FIG. 6A, the camera settings affordance 626 includes a flash settings affordance 626a, an animated image capture settings affordance 626b, an aspect ratio settings affordance 626c, an exposure compensation settings affordance 626d, a timer settings affordance 626e, and a filter settings affordance 626f. When selected (e.g., via a gesture detected on a particular camera settings affordance), the camera settings affordance 626 causes the device 600 to change (or initiate a process to change) the camera settings associated with a particular camera mode. For example, when activated, the flash settings affordance 626a causes the device 600 to turn the flash mode on / off, and when selected, the timer affordance 626d causes the device to initiate a process to set a self-delay timer.In some embodiments, the control region 606 includes an overlay that is superimposed on the live preview 630 and optionally colored (e.g., gray, translucent). In FIG. 6A, the device 600 detects a tap gesture 650a on the exposure compensation setting affordance 626d (e.g., at the corresponding location).

[0158] As shown in FIG. 6B, in response to detecting the tap gesture 650a, the device 600 displays an exposure compensation indicator 602d within the indicator region 602 simultaneously with the live preview 630. In some embodiments, the device 600 displays the exposure compensation indicator 602d within the indicator region 602 in response to detecting the tap gesture 650a because the device 600 activates the exposure compensation mode.

[0159] The exposure compensation indicator 602d includes an exposure compensation value representation 602d1 and a clipping indication 602d2. Each of the exposure compensation value representation 602d1 and the clipping indication 602d2 is displayed outside the camera display region 604. In some embodiments, in response to receiving a request to display a captured media representing the live preview 630 that extends into the indicator region 602 and / or the control region 606, the device 600 displays the representation of the portion of the live preview 630 shown in the camera display region 604 without displaying the representation of the portion of the live preview 630 within the indicator region 602 and the control region 606. Thus, in some embodiments, the exposure compensation value representation 602d1 and the clipping indication 602d2 are displayed outside the camera display region 604 so as not to interfere with the portion of the live preview 630 (e.g., within the camera display region 604) shown in response to receiving a request to display the captured media representing the live preview 630.

[0160] As shown in FIG. 6B, the exposure compensation value representation 602d1 is a numerical value (the "0" in FIG. 6B) indicating the level of exposure that the device 600 uses to capture media in response to receiving a request to capture media (e.g., in response to detecting a gesture on the shutter affordance 610). In some embodiments, the exposure level indicated by the exposure compensation value representation 602d1 can be combined with one or more other exposure compensation values (e.g., an exposure compensation bias value). In some embodiments, the device 600 is configured to use a total compensation value (e.g., a combination of exposure compensation levels indicated by the exposure compensation value representation 602d1 combined with other exposure compensation values) to capture media in response to receiving a request to capture media, as described below (e.g., FIGS. 6F-6I).

[0161] In FIG. 6B, the clipping indication 602d2 indicates the predicted size and type of clipping that is predicted to occur in response to detecting a request to capture the current media. As used herein, "current media" is (1) the media representing the live preview 630, and (2) the media that is captured (or is to be captured) in response to detecting a request to capture media while the device 600 is configured to capture media at the exposure level indicated by the exposure compensation value representation 602d1 and / or the total level of exposure compensation. As described in more detail below, the predicted size of the clipping is represented by the size (e.g., length, width), thickness, and / or opacity of the clipping indication 602d2. Further, the predicted type of clipping is represented by the position of the clipping indication 602d2. As shown in FIGS. 6B and 6J, the clipping indication 602d2 can indicate the predicted occurrence of two types of clipping, highlight clipping and shadow clipping. In some embodiments, highlight clipping is predicted to occur when a determination is made that a set of luminance intensity values (e.g., the white value or highlight of an image (e.g., that is to be captured)) within the FOV (or current media) exceeds the range of luminance intensity values that can be accurately captured and / or represented within the current media (e.g., a non-zero range). In other words, the set of luminance intensity values is too bright to be accurately captured and / or represented by the device 600 (e.g., within the current media). In some embodiments, shadow clipping is predicted to occur when a determination is made that the luminance intensity value (e.g., the black value or shadow of an image (e.g., that is to be captured)) of the FOV (or current media) is below the range of luminance intensity values that can be accurately captured and / or represented within the current media. In other words, the set of luminance intensity values is too dark to be accurately captured and / or represented by the device 600 (e.g., within the current media).In FIG. 6B, the clipping indication 602d2 indicates that highlight clipping is expected to occur because the clipping indication 602d2 is positioned such that it is at the rightmost scale of the exposure compensation indicator 602d. However, the clipping indication 602d2 in FIG. 6J indicates that shadow clipping is expected to occur because the clipping indication 602d2 is positioned such that it is at the leftmost scale of the exposure compensation indicator 602d in FIG. 6J (or the opposite side if the clipping indication 602d2 is shown in FIG. 6A).

[0162] As shown in FIG. 6B, in response to detecting the tap gesture 650a, the device 600 also replaces the camera setting affordance 626 with the exposure compensation control 636 within the control region 606. The exposure compensation control 636 is a slider that is displayed with a value indication 636a positioned on the slider. The positioning of the value indication 636a represents a value (e.g., 0) of the current exposure compensation level that corresponds to the exposure compensation value indicated by the exposure compensation value representation 602d1. During the transition between FIGS. 6B and 6C, the environment becomes brighter, and the device 600 detects a change in the FOV indicating that the environment of the scene within the FOV is brighter.

[0163] In FIG. 6C, it is determined that in response to detecting a change in the FOV, a second amount (or level) of highlight clipping is predicted to occur. In FIG. 6C, the second amount of highlight clipping predicted to occur is greater than the amount of highlight clipping predicted to occur in FIG. 6B. In FIG. 6C, the second amount is greater than the amount of highlight clipping predicted to occur in FIG. 6B because the luminance level in the environment increases (as can be seen when comparing the live previews 630 shown in FIGS. 6B - 6C, for example) and the current exposure compensation level remains the same (as indicated by the exposure compensation value representation 602d1, for example). Thus, in FIG. 6C, device 600 detects a larger luminance intensity value that exceeds the range of luminance intensity values that device 600 detected in FIG. 6B (for example, to display the live preview 630).

[0164] As shown in FIG. 6C, in response to detecting a change in the FOV, it was determined that a second amount of highlight clipping is predicted to occur. Therefore, device 600 increases the size of the clipping indication 602d2, which indicates that more highlight clipping is predicted to occur in FIG. 6C than the highlights predicted to occur in FIG. 6B. Thus, in FIG. 6C, the clipping indication 602d2 indicates the type and amount of clipping predicted to occur. Specifically, the clipping indication 602d2 in FIG. 6C is longer and wider than the clipping indication 602d2 in FIG. 6B. During the transition between FIGS. 6C and 6D, the environment becomes brighter, and device 600 detects more changes in the FOV indicating that the environment of the scene within the FOV is brighter.

[0165] In FIG. 6D, it is determined that a third amount of highlight clipping is predicted to occur. In FIG. 6D, the third amount of highlight clipping predicted to occur is greater than the second amount of highlights predicted to occur in FIG. 6C. Here, the third amount of highlight clipping is greater than the second amount of highlight clipping because the luminance level in the environment (e.g., as seen when comparing the live preview 630 shown in FIGS. 6C - 6D) increases and the current exposure compensation level remains the same (e.g., as indicated by the exposure compensation value representation 602d1). In FIG. 6D, it is determined that the third amount of highlight clipping is predicted to occur using one or more similar techniques as described above in relation to FIG. 6C.

[0166] As shown in FIG. 6D, in response to detecting a change in the FOV (e.g., in FIG. 6C), it is determined that a third amount of highlight clipping will occur, so the device 600 increases the size 602d2 of the clipping indication, which indicates that the third amount of highlight clipping predicted to occur is greater than the second amount of highlights predicted to occur in FIG. 6C (using one or more similar techniques as described above in relation to FIG. 6C). Thus, in FIG. 6D, the clipping indication 602d2 indicates the type and amount of clipping predicted to occur. In some embodiments, the device 600 displays an animation of the clipping indication 602d2 that increases in size from the size of the clipping indication 602d2 in FIG. 6B to the size of the clipping indication 602d2 in FIG. 6D. In FIG. 6D, the device 600 detects a right - swipe gesture 650d on the exposure compensation control 636.

[0167] As shown in FIG. 6E, in response to detecting a rightward swipe gesture 650d, the device 600 updates the exposure compensation control 636 such that the value indication 636a is positioned at a value (e.g., -0.2) representing an updated exposure compensation level. Further, the device 600 also updates the exposure compensation value representation 602d1 to reflect the value (e.g., -0.2) representing the updated exposure compensation level. Compared to FIG. 6D, the value of the updated exposure compensation level is decreased in FIG. 6E.

[0168] In FIG. 6E, since the current exposure compensation level is changing (e.g., from 0 to -0.2), a determination is made that a fourth amount of highlight clipping is expected to occur. In FIG. 6E, the fourth amount of highlight clipping expected to occur is less than the third amount of highlight clipping expected to occur in FIG. 6D. In FIG. 6E, since the exposure compensation level used by the device 600 to capture the current media is decreasing (e.g., from 0 to -0.2), the fourth amount is less than the third amount. When the device 600 captures the current media using a lower exposure compensation value, the device 600 is configured to capture a lower luminance intensity value (e.g., less white) in response to receiving a request to capture the media. Effectively capturing a lower luminance value results in the device 600 capturing a lower luminance intensity value that is below the range of the luminance intensity values. As shown in FIG. 6E, since a determination is made that a fourth amount of clipping is expected to occur, the device 600 reduces the size of the clipping indication 602d2, which indicates that the fourth amount of clipping expected to occur is less than the third amount of clipping expected to occur. Thus, in FIG. 6E, the clipping indication 602d2 indicates the type and amount of clipping expected to occur.

[0169] As shown in FIG. 6E, the device 600 also dims the live preview 630 to reflect the media captured based on the updated exposure compensation level. Here, since the device 600 is configured to capture lower luminance intensity values in response to receiving a request to capture media (e.g., based on a lower exposure compensation value), the live preview 630 is darker (compared to the live preview 630 in FIG. 6D). In FIG. 6E, the device 600 detects a downward swipe gesture 650e within the camera display area 604.

[0170] As shown in FIG. 6F, in response to detecting the downward swipe gesture 650e, the device 600 replaces the exposure compensation control 636 with the camera mode affordance 620 within the control area 606. The camera mode affordance 620 indicates which camera mode is currently selected and enables the user to change the camera mode. In FIG. 6F, camera mode affordances 620a - 620e are displayed. The camera mode affordance 620 indicates that the photo camera mode is active, as indicated by the photo camera mode affordance 620c and the bold "PHOTO". As shown in FIG. 6F, the device 600 also stops displaying the exposure compensation control 636 but continues to display the exposure compensation indicator 602d. In FIG. 6F, continuing to display the exposure compensation indicator 602d includes maintaining the exposure compensation value representation 602d1 at the same exposure compensation value (e.g., - 0.2) and the clipping indication 602d2 as the same size as that displayed in FIG. 6E. Thus, in FIG. 6F, stopping the display of the compensation control 636 did not affect the current exposure compensation value (e.g., as indicated by the exposure compensation value representation 602d1) or the determination of predicted clipping (e.g., as indicated by the clipping indication 602d2). In FIG. 6F, the device 600 detects a press - and - hold gesture 650f at the location corresponding to the camera display area 604.

[0171] As shown in FIG. 6G, in response to detecting a press and hold gesture 650f, the device 600 locks the autofocus setting on the device 600 such that the device 600 focuses one or more of its cameras at a particular focal distance (e.g., position) within the FOV. In FIG. 6G, the position corresponds to the area of the box of the compensation bias control 644 that is displayed within the camera display area 604 of FIG. 6G. The compensation bias control 644 is displayed with a value indication 644a positioned at a position on the compensation bias control 644 corresponding to the current exposure compensation bias value at which the device 600 is currently configured to capture the current media (e.g., in response to receiving a request to capture media).

[0172] In FIG. 6G, the device 600 detects a downward swipe gesture 650g within the camera display area 604. FIGS. 6H-6I show alternative user interfaces that can be displayed in response to detecting the downward swipe gesture 650g.

[0173] As shown in FIG. 6H, in response to detecting a downward swipe gesture 650g, the device 600 updates the compensation bias control 644 such that the value indication 644a is displayed at a new position on the compensation bias control 644, indicating that the updated exposure compensation bias value has been updated. The updated exposure compensation bias value in FIG. 6H is lower than the exposure compensation bias value in FIG. 6G. Thus, as shown in FIG. 6H, since the compensation bias value is lower, the live preview 630 becomes darker. In FIG. 6H, the device 600 is configured to capture media based on the total compensation value (e.g., the sum of the exposure compensation values represented by the exposure compensation value representation 602d1 and the updated exposure compensation bias value). However, as shown in FIG. 6H, the device 600 does not update the exposure compensation indicator 602d to reflect the change in the total exposure compensation. In some embodiments, in FIG. 6H, the device 600 displays a representation of the total exposure compensation simultaneously with the exposure compensation indicator 602d (e.g., because the compensation indicator is displayed with the same exposure compensation value representation (e.g., -0.2) and the clipping indicator 602d2 is the same size). In some embodiments, the representation of the total exposure compensation is displayed within the camera display area 604 while the exposure compensation indicator 602d remains displayed within the indicator area 602.

[0174] Instead of FIG. 6H, as shown in FIG. 6I, in response to detecting a downward gesture 650g, the device 600 updates the compensation bias control 644 and the live preview 630 using the same techniques as described above with respect to FIG. 6H. However, in FIG. 6I, the device 600 updates the exposure compensation indicator 602d (which was not updated in FIG. 6H, for example) to reflect the change in the total exposure compensation. For example, in response to a request to capture the current media, the device 600 updates the exposure compensation value representation 602d1 such that the total exposure compensation is -0.3, and updates the clipping indicator 602d2 to reflect that a lower predicted clipping is expected (due to the lower total exposure compensation value using the techniques described above, for example). In FIG. 6H or FIG. 6I, the device 600 detects a change in the FOV.

[0175] In FIG. 6J, in response to detecting a change in the FOV (e.g., in FIG. 6H or FIG. 6I), a determination is made that the scene within the FOV has changed. As shown in FIG. 6J, the live preview 630 shows a pair of shoes on a dark surface, while the live preview 630 in FIG. 6I shows the sky. Compared to the live preview 630 in FIG. 6I, the live preview 630 in FIG. 6J becomes considerably darker because the scene within the FOV becomes considerably darker.

[0176] In FIG. 6J, since a determination is made that the scene has changed within the FOV, the device 600 resets the exposure compensation bias value to the default exposure compensation bias value (e.g., the compensation bias value set before detecting the gesture 650f in FIG. 6F or the gesture 650g in FIG. 6G). As shown in FIG. 6J, the device 600 also stops displaying the compensation bias indicator 644 for this scene change determination. In particular, in FIG. 6J, the device 600 remains configured to capture the current media via the exposure compensation level (e.g., -0.2) indicated by the exposure compensation value indicator 602d2 in FIG. 6F (e.g., before the compensation bias value was displayed and / or adjusted (e.g., in FIGS. 6F - 6G)). Thus, the set compensation bias value disappears (e.g., returns to the default value) when the scene within the FOV changes, but the exposure compensation value set (e.g., via the exposure compensation control 636) is maintained regardless of the determination that the scene has changed within the FOV.

[0177] In FIG. 6J, it is also determined that shadow clipping is likely to occur because the luminance level in the environment within the new scene (e.g., shoes on a dark surface) is significantly reduced. Specifically, it is determined that a set of luminance intensity values in the FOV (or the current media) (e.g., the black value or shadow of an image (which will be captured, for example)) is below the range of luminance intensity values that can be accurately represented or captured, so it is determined that shadow clipping is likely to occur. The determination that shadow clipping is likely to occur is based on the luminance level within the environment and the current exposure compensation level (e.g., -0.2 as indicated by the exposure compensation value representation 602d1).

[0178] As shown in FIG. 6J, since it is determined that shadow clipping is likely to occur, the device 600 displays the clipping indication 602d2 as the leftmost scale of the exposure compensation indicator 602d (instead of being displayed as the rightmost scale of the exposure compensation indicator 602 when it was predicted that highlight clipping would occur in FIG. 6F, for example). In FIG. 6J, the size of the clipping indication 602d2 also changes to reflect the magnitude (e.g., amount or level) of the shadow clipping that is predicted to occur when the device 600 is configured to capture the media at the current exposure compensation level (e.g., -0.2). In FIG. 6J, the device 600 detects changes within the FOV.

[0179] In FIG. 6K, in response to detecting a change within the FOV, a determination is made that the scene has changed within the FOV. When compared to the live preview 630 of FIG. 6J, the live preview 630 of FIG. 6K becomes considerably darker because the scene within the FOV of FIG. 6K becomes considerably darker. In FIG. 6K, a determination is also made that a second amount of shadow clipping is expected to occur using one or more techniques as described above (e.g., in FIGS. 6B - 6J). In FIG. 6K, since a darker scene is within the FOV of one or more cameras and the current exposure compensation level remains the same, the second amount of shadow clipping is greater than the amount of shadow clipping predicted to occur in FIG. 6J.

[0180] As shown in FIG. 6K, since a determination is made that a second amount of shadow clipping is expected to occur, the device 600 increases the size of the clipping indicator 602d2 while maintaining the display of the clipping indicator 602d2 to the left of the exposure compensation indicator 602d. Thus, in FIG. 6K, the clipping indicator 602d2 indicates the type and amount of clipping expected to occur. Further, the live preview 630 is updated to show the new scene. In FIG. 6K, the device 600 detects a tap gesture 650k on the exposure compensation indicator 602d.

[0181] As shown in FIG. 6L, in response to detecting the tap gesture 650k, the device 600 replaces the display of the camera affordance 620 with the display of an exposure compensation control 636 that includes a value indicator 636a. In FIG. 6L, the device 600 detects a left - swipe gesture 650l on the exposure compensation control 636.

[0182] As shown in FIG. 6M, in response to detecting a leftward swipe gesture 650l, the device 600 updates the level of exposure compensation, which is indicated via a new value (e.g., 1.0) represented by the exposure compensation value representation 602d1 and is also displayed on the value indication 636a on the exposure compensation control 636. The new exposure compensation level (e.g., 1.0 in FIG. 6M) is higher than the previous exposure compensation level (e.g., -0.2 in FIG. 6L).

[0183] In FIG. 6M, one or more techniques similar to those described above are used to make a determination that minimum (or no clipping) is expected to occur (or that clipping less than a (e.g., non-zero) threshold level is expected to occur). Thus, in other words, a determination is made that the device 600 can accurately represent or capture the current media with an amount of clipping less than a (e.g., non-zero) threshold amount of clipping. As shown in FIG. 6M, for the determination that minimum clipping is expected to occur or that no clipping is expected to occur (e.g., or that clipping less than a (e.g., non-zero) threshold level is expected to occur), the device 600 stops displaying the clipping indication 602d2. In FIG. 6M, the device 600 detects a leftward swipe gesture 650m on the exposure compensation control 636a.

[0184] As shown in FIG. 6N, in response to detecting a leftward swipe gesture 650m, device 600 updates the exposure compensation level, which is indicated via a new value (e.g., 1.5) represented by exposure compensation value representation 602d1 and is displayed on value indication 636a on exposure compensation control 636. The new exposure compensation level (e.g., 1.5 in FIG. 6M) is higher than the previous exposure compensation level (e.g., 1.0 in FIG. 6L). In FIG. 6N, using one or more of the similar techniques described above, a determination is made that a fifth amount of highlight clipping is expected to occur (e.g., the exposure compensation level is adjusted sufficiently for highlight clipping to be expected). As shown in FIG. 6N, since a determination is made that a fifth amount of highlight (and no shadow) clipping is expected to occur, device 600 displays a clipping indication 602d2 to the right of exposure compensation indicator 602d. Thus, in FIG. 6N, clipping indication 602d2 indicates the type and amount of clipping expected to occur. In FIG. 6N, device 600 detects an upward swipe gesture 650n from the bottom of control region 606.

[0185] In FIG. 6O, in response to detecting an upward swipe gesture 650n, for example, since the device 600 stopped displaying (or closed from) the camera application, it is determined that a session associated with the use of the camera application (for example, an application corresponding to the camera user interface) has ended. In some embodiments, when the device 600 stops displaying or closes the camera application for a predetermined period, the session associated with the use of the camera application ends. In some embodiments, when it is determined that the camera application has stopped operating on the device 600, the session associated with the use of the camera application ends. In some embodiments, the session associated with the use of the camera application ends at a specific time (at the end of the day (a specific time of that day) when the camera application is not being used or when the camera application is interacted with by the user). In some embodiments, after the device 600 has been in a locked state for a predetermined period, the session associated with the use of the camera application ends. Further, as shown in FIG. 6O, the device 600 stops displaying the camera user interface and displays a user interface with the application icon 690. The application icon 690 includes application icons such as the camera application icon 690a. In FIG. 6O, the device 600 detects a tap gesture 650o on the camera application icon 690a.

[0186] As shown in FIG. 6P, in response to detecting a tap gesture 650o, the device 600 stops displaying the user interface with the application icon and displays the camera user interface. As shown in FIG. 6P, the exposure compensation indicator 602d is in the same state as the state shown in FIG. 6N. For example, in FIG. 6P, the exposure compensation value representation 602d1 indicates the current exposure level 1.5, which is the same as the exposure level when the camera user interface was last displayed in FIG. 6N. In FIG. 6P, the device 600 detects a leftward swipe gesture 650p at the bottom of the control region 606.

[0187] As shown in FIG. 6Q, in response to detecting a leftward swipe gesture 650p, the device 600 displays a camera user interface including settings 692 such as the exposure control setting 692a. In FIG. 6Q, the exposure control setting 692a is set to on, which indicates that the current exposure level is maintained and not automatically reset. Further, the exposure control setting 692a indicates that the exposure compensation indicator 602d continues to be displayed (e.g., after the exposure compensation was first set via the exposure compensation control 644). In some embodiments, the control setting 692a indicates that the exposure compensation indicator 602d is always displayed (regardless of whether the exposure compensation was initially set or not). Referring back to FIGS. 6N - 6P, since the control setting 692a is set to on, the device 600 maintains the exposure compensation indicator 602d in the same state as FIG. 6P (e.g., after determining that the session associated with the use of the camera application has ended). In FIG. 6Q, the device 600 detects a tap gesture 650q on the exposure control setting 692a.

[0188] As shown in FIG. 6R, in response to detecting a tap gesture 650q, the device 600 switches the exposure control setting 692a from the on state to the off state. In FIG. 6R, the device 600 detects an upward swipe gesture 650r at the bottom of the control region 606.

[0189] As shown in FIG. 6S, in response to detecting an upward swipe gesture 650r, the device 600 redisplayed a user interface having an application icon 690a. In FIG. 6S, in response to detecting an upward swipe gesture 650r, a determination is made that a session associated with the use of the camera application has ended, using a technique similar to that described above with respect to FIG. 6O. In FIG. 6S, the device 600 detects a tap gesture 650s on the camera application icon 690a.

[0190] As shown in FIG. 6T, in response to detecting the tap gesture 650s, the device 600 displays a camera user interface without an exposure compensation indicator 602d because the exposure control setting 692a is set to on (as opposed to displaying the exposure compensation indicator 602d when the exposure control setting 692a is set to off as described above).

[0191] FIG. 6U shows a camera user interface having an exposure compensation indicator 602d that is displayed while the device 600 is operating in video mode, as indicated by the video camera mode affordance 602b and the bold "VIDEO" in FIG. 6U.

[0192] FIG. 6V shows a camera user interface having an exposure compensation indicator 602d that is displayed while the device 600 is operating in portrait mode, as indicated by the portrait camera mode affordance 602e and the bold "PORTRAIT" in FIG. 6V.

[0193] FIG. 7 is a flow diagram showing a method for managing exposure compensation using a computer system according to some embodiments. Method 700 is executed in a computer system (e.g., 100, 300, 500, 600). The computer has one or more cameras (e.g., one or more cameras (e.g., dual camera, triple camera, quad camera, etc.) on the same side or different sides of the computer system (e.g., front camera, rear camera)), and communicates with a display generation component (e.g., display controller, touch-sensitive display system) and one or more input devices (e.g., touch-sensitive surface). Some operations of method 700 are optionally combined, the order of some operations is optionally changed, and some operations are optionally omitted.

[0194] As described below, method 700 provides an intuitive method for managing exposure compensation. This method reduces the user's cognitive burden when managing exposure compensation, thereby creating a more efficient human-machine interface. In the case of a battery-operated computing device, it saves power and increases the battery charging interval by enabling the user to manage exposure compensation more quickly and efficiently.

[0195] The computer system receives a request (e.g., a request to display a camera application or a request to switch to a media capture mode within a camera application) to display a camera user interface (e.g., the user interface in FIG. 6B) (702).

[0196] In response to receiving a request to display a camera user interface, one or more cameras are configured to capture an image (e.g., video, photo) based on a first exposure compensation value (e.g., a value representing the amount of exposure used to capture media corresponding to the representation of the field of view of one or more cameras) (e.g., as indicated by 602d1), and the computer system displays (704) the camera user interface (e.g., the user interface of FIG. 6B) via a display generation component.

[0197] As part of displaying the camera user interface via the display generation component, the computer system displays (706) a first representation (e.g., 630) (e.g., a representation over time, a live preview feed of data from the camera) of the field of view of one or more cameras (e.g., an open observable area visible to the camera, the horizontal (or vertical or diagonal) length of an image at a given distance from the camera lens) via the display generation component. In some embodiments, the value is the default exposure compensation value used to capture media regardless of whether the exposure compensation mode is enabled or not. In some embodiments, the representation of the field of view of one or more cameras is displayed in a camera display area.

[0198] In accordance with a determination that a set of exposure compensation criteria is met, including as part of displaying a camera user and a criterion (e.g., 692a in FIG. 6Q) (e.g., active) that is satisfied when an exposure compensation mode is enabled (708), the computer system displays (710) an exposure compensation indicator (e.g., 602d) including the following, simultaneously with a representation of the field of view of one or more cameras (e.g., 630): a representation of a first exposure compensation value (e.g., a numerical representation (e.g., 1.5, -1.5), symbol transition), as indicated by (e.g., as shown by 602d1); and a visual indication (e.g., 602d2) that the computer system has determined that clipping (e.g., one or more regions of the captured media that lose detail as a result of the exposure compensation setting) is predicted to occur in response to receiving a request to capture media corresponding to the representation of the field of view of one or more cameras (e.g., receiving an input at 610). In some embodiments, one or more cameras are configured to capture an image based on the first exposure compensation value, and the representation of the first exposure compensation value is displayed (alternatively, or, instead, not displayed) (e.g., simultaneously with, adjacent to, and / or on top of the representation of the field of view of one or more cameras). In some embodiments, the exposure compensation mode is enabled when the computer system is configured to maintain exposure adjustment when displaying different representations of the field of view of one or more cameras (e.g., representations captured over time or representations of different scenes) and / or when the computer system is configured to indicate an exposure adjustment indicator. In some embodiments, the exposure compensation mode is enabled when a selection is made on the exposure compensation indicator and / or when a new exposure compensation is set (e.g., via an exposure adjustment control). In some embodiments, when clipping occurs, the clipped area can be represented by the minimum or maximum luminance within the representation of the captured media.In some embodiments, the clipped area within the representation of the captured media has a different level of brightness, highlight, shadow, and / or a different level of detail (e.g., less detail) than the area corresponding to the clipped area in the representation of the field of view of one or more cameras. In some embodiments, a representation of exposure compensation and a visual indication (e.g., that the computer system has determined that clipping is expected to occur) are displayed simultaneously. In some embodiments, the exposure compensation indicator is displayed within the camera indicator area. In some embodiments, the camera indicator area includes a plurality of indicators (e.g., affordances, selectable user interface objects) that configure the computer system to capture media based on one or more camera settings (e.g., exposure settings, flash settings, low light mode settings, timer settings, etc.). In some embodiments, the representation of the exposure compensation value is on top of the visual indication. In some embodiments, in accordance with a determination that a set of exposure compensation criteria is not met, the computer system stops displaying the exposure compensation indicator. In some embodiments, in accordance with a determination that a set of exposure compensation criteria is not met, the first representation is displayed with a default exposure compensation value (e.g., a zero value), and the computer system is configured to capture media using the default exposure compensation value when the exposure compensation mode is not enabled. In some embodiments, the computer system predicts that clipping will occur based on one or more determinations that clipping is expected to occur in response to receiving a request to capture media corresponding to the representation of the field of view of one or more cameras by receiving one or more instructions or bases, or in response to receiving a request to capture media corresponding to the representation of the field of view of one or more cameras created by one or more external devices.Displaying an exposure compensation indicator that includes an exposure compensation value and an indicator of predicted clipping provides feedback to the user regarding the relationship between the current exposure compensation value, the current scene within the field of view of the system's camera, and the predicted clipping that can occur when media corresponding to the current scene is captured. Thus, displaying the exposure compensation indicator enables the user to visually confirm how adjustments to the current exposure compensation value and / or changes to the scene within the field of view of at least one camera affect the predicted clipping. By providing improved visual feedback to the user, the operability of the system is enhanced, (e.g., by assisting the user in providing appropriate inputs when operating / interacting with the system and reducing user errors), making the user-system interface more efficient, and in addition, reducing power usage and improving the battery life of the system by enabling the user to use the system more quickly and efficiently. Displaying an exposure compensation indicator that includes an exposure compensation value and an indicator of predicted clipping provides feedback to the user regarding the relationship between the current exposure compensation value, the current scene within the field of view of the system's camera, and the predicted clipping that can occur when media corresponding to the current scene is captured, which reduces the number of times media needs to be captured to obtain an image with reduced (or little) clipping. By reducing the number of operations that need to be performed, the operability of the system is enhanced, (e.g., by assisting the user in providing appropriate inputs when operating / interacting with the system and reducing user errors), making the user-system interface more efficient, and in addition, reducing power usage and improving the battery life of the system by enabling the user to use the system more quickly and efficiently.

[0199] In some embodiments, while displaying an exposure compensation indicator (e.g., 602d), and in accordance with a determination that clipping that is expected to occur is of a first type of clipping, a visual indication is displayed at a first location (e.g., 602d2 in FIG. 6B) (e.g., on a display generation component (e.g., a location adjacent to the exposure compensation indicator)). In some embodiments, while displaying an exposure compensation indicator, and in accordance with a determination that clipping that is expected to occur is of a second type of clipping that is different from the first type of clipping, a visual indication is displayed at a second location that is different from the first location (e.g., 602d2 in FIG. 6J) (e.g., on a display generation component (e.g., a location adjacent to the exposure compensation indicator)). In some embodiments, the first type of clipping is clipping based on a value of a parameter (e.g., luminance intensity) of a media that exceeds a range of values of the parameter (e.g., a capturable range (e.g., a range within which a luminance intensity value can be captured by a computer system), a representable range (e.g., a range within which a luminance intensity value can be represented by a computer system) (e.g., clipping of highlights, clipping of brighter / white areas)) (e.g., clipping that is expected to occur in response to receiving a request to capture the media) (e.g., (e.g., clipping that is expected to occur when a brighter area (e.g., a white area) of a scene is represented with less detail than other areas of the scene)).In some embodiments, the second type of clipping is clipping based on the value of a parameter of the media (e.g., luminance intensity) that is below the range of values of the parameter (e.g., the range that can be captured (e.g., the range within which the luminance intensity value can be captured by a computer system), the range that can be represented (e.g., the range within which the luminance intensity value can be represented by a computer system) (e.g., clipping of black crush, darker / black areas)) (e.g., in response to receiving a request to capture media, e.g., clipping that occurs (and is predicted to occur) when a darker area of the scene (e.g., a black area) is represented with less detail than other areas of the scene). In some embodiments, while displaying a visual indication at a first position, and in response to receiving a request to capture media corresponding to the representation of the field of view of one or more cameras, and if it is predicted that a second (e.g., new, subsequent) clipping will occur and the second clipping is determined to be of the first type of clipping, the computer system displays a visual indication at the first position. While displaying a visual indication at the first position, and in response to receiving a request to capture media corresponding to the representation of the field of view of one or more cameras, and if it is predicted that a second (e.g., new, subsequent) clipping will occur and the second clipping is determined to be of the second type of clipping, the computer system displays a visual indication at the second position. In some embodiments, the visual indication moves from the first position to the second position, or vice versa. In some embodiments, the first position is on one side (e.g., right / left / up / down) of the exposure compensation indicator, and the second position is located on the opposite side (e.g., left / right / down / up) of the side where the first position is on. Displaying indicators of predicted clipping at different positions on the exposure compensation indicator provides feedback to the user regarding how to adjust the current exposure compensation value and / or changes in the scene within the field of view of the camera, to affect (e.g., reduce) the predicted clipping, if each position corresponds to the type of clipping that is predicted to occur.By providing improved visual feedback to the user, the operability of the system is enhanced, (e.g., by assisting the user to provide appropriate inputs when operating the system / interacting with the system and reducing user errors) making the user-system interface more efficient, and in addition, by enabling the user to use the system more quickly and efficiently, reducing power consumption and improving the battery life of the system. Displaying an indicator of predicted clipping at one position where high-light clipping is predicted to occur and shadow clipping is predicted to occur provides feedback to the user regarding how to adjust the current exposure compensation value and / or changes in the scene within the camera's field of view to affect (e.g., reduce) the predicted clipping. By providing improved visual feedback to the user, the operability of the system is enhanced, (e.g., by assisting the user to provide appropriate inputs when operating the system / interacting with the system and reducing user errors) making the user-system interface more efficient, and in addition, by enabling the user to use the system more quickly and efficiently, reducing power consumption and improving the battery life of the system.

[0200] In some embodiments, prior to the first time (e.g., while displaying the exposure compensation indicator), the visual indication is displayed with a first visual appearance (e.g., 602d2 in FIG. 6B) (e.g., thickness, size, length, color, thickness, and / or opacity). In some embodiments, at the first time while the exposure compensation indicator is being displayed and in accordance with a determination that the clipping that is expected to occur has changed (e.g., the amount of clipping has changed, the type of clipping has changed), the computer system displays a visual indication (e.g., 602d2 in FIG. 6C) with a second visual appearance that is different from the first visual appearance (e.g., 602d2 in FIG. 6B) (e.g., thickness, size, length, color, thickness, and / or opacity). In some embodiments, in accordance with a determination that the clipping that is expected to occur has increased (or alternatively, decreased), the visual indicator has an appearance (e.g., a second appearance) that is thicker (e.g., wider, higher opacity) and / or (e.g., taller) longer than the previously had visual indicator (e.g., the first appearance) (or alternatively, (e.g., wider) thinner and / or (e.g., taller) shorter). In some embodiments, displaying the visual indication with a second appearance that is different from the first visual appearance includes animating (e.g., gradually animating) the change (e.g., thickening or thinning) of the visual indication from the first visual appearance to the second visual appearance. In some embodiments, it is determined that the clipping that is expected to occur changes when the field of view of one or more cameras and / or objects within the field of view of one or more cameras changes. In some embodiments, the clipping that is expected to occur changes in response to a change of a first compensation value to a second exposure compensation value (e.g., via a selectable exposure compensation control (e.g., a slider)). In some embodiments, the clipping that is expected to occur changes in response to a change in the field of view of one or more cameras (e.g., a change in the scene of the field of view of one or more cameras).Displaying an indicator of predicted clipping based on the predicted clipping size provides feedback to the user regarding a method of adjusting the current exposure compensation value and / or changes in the scene within the field of view of one or more cameras to affect (e.g., reduce) the predicted clipping. By providing improved visual feedback to the user, the operability of the system is improved, (e.g., assisting the user to provide appropriate input when operating / interacting with the system and reducing user errors), making the user-system interface more efficient, and in addition, reducing power usage and improving the battery life of the system by enabling the user to use the system more quickly and efficiently.

[0201] In some embodiments, the visual indication (e.g., 602d2) is displayed via the display generation component at a location outside (e.g., away from, not on, not overlapping with) the first representation. In some embodiments, the exposure compensation indicator is at a location outside the first representation. Displaying an indicator of predicted clipping away from the representation of the scene provides feedback to the user regarding the relationship between the current exposure compensation value and the current scene within the field of view of the system's camera, and the predicted clipping that may occur when media corresponding to the current scene is captured enables browsing of the representation of the scene within the field of view of at least one camera of the computer system with fewer visual elements superimposed on the representation of the scene and captured, which can reduce the number of time units required to capture the intended scene. By reducing the number of inputs required to perform an operation, the operability of the system is improved, (e.g., assisting the user to provide appropriate input when operating / interacting with the system and reducing user errors), making the user-system interface more efficient, and in addition, reducing power usage and improving the battery life of the system by enabling the user to use the system more quickly and efficiently.

[0202] In some embodiments, while displaying an exposure compensation indicator (e.g., 602d) that includes an indication of a first exposure compensation value (e.g., as shown by 602d1 in FIG. 6B), the computer system detects changes within the field of view of one or more cameras. In some embodiments, in response to detecting a change in the field of view of one or more cameras, the computer system continues to display the first exposure compensation value (e.g., as shown by 602d1 in FIG. 6C) (e.g., the exposure compensation value is maintained regardless of the detected change in the field of view of one or more cameras and / or a change in the scene). In some embodiments, in accordance with a determination that a change in the field of view of one or more cameras exceeds a threshold (e.g., a non-zero threshold) (the threshold indicating the amount of change in the field of view is comparable to a change in the scene), the computer system continues to display the exposure compensation indicator that includes the first exposure compensation value. In some embodiments, in accordance with a determination that a change in the field of view of one or more cameras exceeds a threshold, the computer system continues to display the exposure compensation indicator that includes the first exposure compensation value. Maintaining the exposure compensation value when the scene changes reduces (or eliminates) the number of inputs required to reset the compensation value each time the scene changes, and also reduces the number of times the exposure compensation is reset when the scene temporarily changes within the field of view of one or more cameras. By reducing the number of inputs required to perform an operation, the operability of the system is improved, (e.g., by assisting the user to provide appropriate inputs when operating / interacting with the system and reducing user errors), making the user-system interface more efficient, and in addition, reducing power consumption and improving the battery life of the system by enabling the user to use the system more quickly and efficiently.

[0203] In some embodiments, one or more cameras are configured to capture an image based on a cumulative exposure compensation value that is based on the sum of a first exposure compensation value (e.g., as shown by 602d1) and a compensation bias value (e.g., 644a in FIG. 6H).

[0204] In some embodiments, in accordance with a determination that a set of exposure compensation criteria has been met, the computer system simultaneously displays an indication of the cumulative exposure compensation value (712) (e.g., displays a value, displays a graphical representation corresponding to the value) along with an exposure compensation indicator (e.g., 602d) (e.g., as shown by 602d1 in FIG. 6I) that includes an indication of a first compensation value (e.g., when one or more cameras are configured to capture an image based on the first exposure compensation value at a first time). In some embodiments, while displaying an exposure compensation indicator that includes an indication of a first exposure compensation value (e.g.), the computer system receives one or more user inputs (e.g., a tap input followed by a drag input), and in response to receiving the one or more user inputs, the computer system displays the cumulative exposure compensation value simultaneously with the exposure compensation indicator that includes an indication of the first compensation value. Displaying an indication of the cumulative exposure compensation value provides feedback to the user regarding how the exposure compensation value and the bias compensation value affect the cumulative amount of exposure used to capture media in response to a request to capture media. By providing improved feedback, the operability of the system is improved, the user-system interface is made more efficient (e.g., by assisting the user in providing appropriate inputs when operating / interacting with the system and reducing user errors), and in addition, the power consumption is reduced and the battery life of the system is improved by enabling the user to use the system more quickly and efficiently.

[0205] In some embodiments, while displaying an exposure compensation indicator (e.g., 602d) that includes an indication of a first exposure compensation value (e.g., as shown by 602d1 in FIG. 6G), the computer system detects one or more user inputs (e.g., 650f, 650g, 650h) (e.g., a tap input followed by a drag input on a viewfinder of one or more cameras' fields of view) via one or more input devices. In some embodiments, in response to detecting one or more inputs, the computer system changes the compensation bias value from a default compensation bias value (e.g., 644a in FIG. 6G) (e.g., a default compensation value (e.g., a value of zero)) to a new compensation bias value (e.g., 644a in FIG. 6H) (e.g., a non-zero value, a new compensation value). In some embodiments, the computer system is configured to capture an image based on cumulative compensation based on the sum of the first exposure compensation value and the bias compensation value, and continue to display the indication of the first exposure compensation value. In some embodiments, while displaying an exposure compensation indicator that includes an indication of the first exposure compensation value and the compensation bias value changed to a new compensation value, the computer system detects a change in the field of view of one or more cameras (e.g., a scene change). In some embodiments, in response to detecting a change in the field of view of one or more cameras and in accordance with a determination that the change in the field of view of one or more cameras exceeds a threshold (e.g., a non-zero threshold) (the threshold indicating the amount of change in the field of view is comparable to the amount of change within the scene), the computer system updates (e.g., resets) the compensation bias value to the default compensation bias value and continues to display the indication of the first exposure compensation value (e.g., 602d2 in FIG. 6J). In some embodiments, in response to detecting a change in the field of view of one or more cameras and in accordance with a determination that the change in the field of view of one or more cameras exceeds a threshold, the computer system continues to display an exposure compensation indicator that includes an indication of the first exposure compensation value (e.g., the exposure compensation value does not change), stops the update (e.g., reset) of the compensation value to the default bias compensation value, and / or maintains the bias compensation value (e.g., the bias compensation value does not change).Maintaining the exposure compensation value when the scene changes and the bias value is updated reduces the number of inputs required to reset the compensation value each time the scene changes, and also reduces the number of times the exposure compensation is reset when the scene temporarily changes within the field of view of one or more cameras. By reducing the number of inputs required to perform the operation, the operability of the system is improved, (e.g., by assisting the user to provide appropriate inputs when operating / interacting with the system and reducing user errors) making the user-system interface more efficient, and in addition, reducing power consumption and improving the battery life of the system by enabling the user to use the system more quickly and efficiently.

[0206] In some embodiments, in accordance with a determination that a set of reset criteria has been met, the computer system sets the first exposure compensation value to a default compensation value (e.g., as shown by 602d1 in FIG. 6T). In some embodiments, the set of reset criteria includes a first criterion that is met at the end of a media capture session and a second criterion (e.g., 692a in FIG. 6R) that is met when the exposure compensation save mode is not enabled. In some embodiments, in accordance with a determination that the set of reset criteria has not been met, the computer system refrains from setting the first exposure compensation value to a first (e.g., default) compensation value (e.g., as shown by 602d1 in FIG. 6P). In some embodiments, the computer system maintains the first exposure compensation value as the value it was prior to the end of the media capture session.

[0207] In some embodiments, the set of exposure compensation criteria includes criteria that are met when the exposure compensation save mode is enabled (e.g., 692a in FIG. 6Q). In some embodiments, the set of exposure compensation criteria includes criteria that are met when the first exposure compensation value is not equal to the default compensation value. In some embodiments, the set of exposure compensation criteria includes criteria that are met when the exposure compensation save mode is enabled and the exposure compensation is at the default value. In some embodiments, the set of exposure compensation criteria includes criteria that are met when the first exposure compensation value is not equal to the default compensation value, the exposure compensation save mode is enabled, and the exposure compensation is at the default value. Automatically displaying the exposure compensation indicator only when a predetermined condition is met enables the display of the indicator without requiring additional user input. By performing an operation when a set of conditions is met without requiring further user input, the operability of the system is enhanced, the user-system interface is made more efficient (e.g., by assisting the user to provide appropriate input when operating / interacting with the system and reducing user errors), and in addition, the power consumption of the system is reduced and the battery life is improved by enabling the user to use the system more quickly and efficiently.

[0208] In some embodiments, in accordance with a determination that a set of exposure compensation criteria is not met, the computer system stops displaying an exposure compensation indicator (e.g., 602 in FIG. 6M). In some embodiments, after displaying an exposure compensation indication, the computer system receives one or more inputs to deactivate the exposure compensation mode (e.g., receives an input of one selectable user interface object for configuring the exposure compensation mode), and in response to receiving the one or more inputs, the computer system stops displaying the exposure compensation indicator (e.g., previously displayed). When a predetermined condition is met, by automatically displaying the exposure compensation indicator, the display of the indicator is enabled without requiring additional user input. By performing an operation when a set of conditions is met without requiring further user input, the operability of the system is enhanced, the user-system interface is made more efficient (e.g., by assisting the user to provide appropriate input when operating / interacting with the system and reducing user errors), and in addition, by enabling the user to use the system more quickly and efficiently, the power consumption of the system is reduced and the battery life is improved.

[0209] In some embodiments, during a second time while an exposure compensation indicator is being displayed, in accordance with a determination that predicted clipping that is expected to occur has changed, the computer system transitions from a first visual state (e.g., a first position of an indication and / or a visual appearance (e.g., thickness, size, color, thickness, opacity), a visual state of a first compensation value) to a second visual state different from the first visual state (e.g., a first position of an indication and / or a visual appearance (e.g., thickness, size, color, thickness, opacity), a visual state of a second compensation value) by displaying an animation of an exposure compensation indication (e.g., 602 of FIGS. 6B-6D). In some embodiments, the animation includes moving a visual indication to a different position, making the visual indication thinner / thicker, and / or displaying a first compensation value that has changed to a second compensation value. By displaying an animation of the exposure compensation indicator that changes when the predicted clipping that is expected to occur changes, feedback is provided to the user regarding a change in a scene within the field of view of at least one camera that affects (e.g., reduces) the current exposure compensation value and / or the predicted clipping. By providing improved visual feedback to the user, the operability of the system is improved, (e.g., by assisting the user to provide appropriate input when operating / interacting with the system and reducing user errors), making the user-system interface more efficient, and in addition, reducing power usage and improving the battery life of the system by enabling the user to use the system more quickly and efficiently.

[0210] In some embodiments, while displaying an exposure compensation indicator (e.g., 602d), the computer system receives a selection (e.g., 650k) (e.g., a tap on the exposure compensation indicator) of the exposure compensation indicator (e.g., 602d) (e.g., a selectable user interface object). In some embodiments, in response to receiving a selection (e.g., 650k) of the exposure compensation indicator, the computer system displays a control (e.g., 636) (e.g., an adjustable control, a slider) for adjusting the exposure compensation that, when selected (e.g., 650l), updates the exposure compensation indicator (e.g., as shown by 602d1 in FIG. 6M). In some embodiments, the adjustable control includes tick marks, and each tick mark represents a value of the adjustable control. In some embodiments, while displaying a control for adjusting the exposure compensation, the computer system displays a first indication (e.g., a number, a slider knob (e.g., a bar) on the slider track) of the current exposure compensation value, and in response to receiving a request (e.g., a drag gesture (e.g., a drag of an indication from each position (e.g., a scale mark) on the adjustable control to another corresponding position on the adjustable control (e.g., a slide bar))) to adjust the control for adjusting the exposure compensation (and while displaying the control for adjusting the exposure compensation), the computer system replaces the display of the first indication of the first exposure compensation value with a display of a second indication of a second exposure compensation value and / or captures media based on the second exposure compensation value (e.g., without capturing media based on the first exposure compensation value). In some embodiments, updating the exposure compensation indicator includes displaying a representation of a second exposure compensation value that is different from the representation of the first exposure compensation value (and ceasing to display the representation of the first exposure compensation value). In some embodiments, updating the exposure compensation indicator includes displaying a visual indication (e.g., of predicted clipping) with a different visual appearance and / or at a different location.

[0211] In some embodiments, in response to a determination that clipping is not predicted (e.g., is unlikely to occur) while displaying an exposure compensation indicator (e.g., 602d) and receiving a request to capture media corresponding to the representation of the field of view of one or more cameras, the computer system stops displaying a visual indication (e.g., 602d2 of FIG. 6M) (e.g., while continuing to display the exposure compensation indicator including the representation of the exposure compensation value). In some embodiments, clipping is not predicted to occur after the first compensation value changes to the second compensation value. In some embodiments, clipping is not predicted to occur after a change in the field of view of one or more cameras is detected (e.g., after the scene within the field of view of one or more cameras changes). In some embodiments, in response to a determination that clipping is predicted to occur while displaying an exposure compensation indicator and receiving a request to capture media corresponding to the representation of the field of view of one or more cameras, the computer system continues to display the visual indication. By stopping displaying an indication of predicted clipping when a predetermined condition is met, feedback is provided to the user regarding an adjustment of the current exposure compensation value and / or a change in the scene within at least one camera's field of view that affected (e.g., reduced) the predicted clipping. By providing improved visual feedback to the user, the operability of the system is improved, the user-system interface is made more efficient (e.g., by assisting the user to provide appropriate inputs when operating / interacting with the system and reducing user errors), and in addition, the power consumption is reduced and the battery life of the system is improved by enabling the user to use the system more quickly and efficiently.

[0212] Note that the details of the processes described above in connection with method 700 (e.g., FIG. 7) are also applicable in a similar manner to the methods described later. For example, method 900 optionally includes one or more of the various method characteristics described above with reference to method 700. For example, using the method 700 described above, a computer system can be configured to capture media using exposure compensation for each amount that can be displayed using the method described below with respect to method 900. For the sake of brevity, these details are not repeated below.

[0213] FIGS. 8A-8L show exemplary user interfaces for displaying media using an electronic device according to some embodiments. The user interfaces of these figures are used to illustrate the processes described later, including the process of FIG. 9.

[0214] FIG. 8A shows an electronic device 600 displaying a media gallery user interface 810 that includes a thumbnail media representation 812. The thumbnail media representation 812 includes thumbnail media representations 812a-812g, and each of the thumbnail media representations 812a-812g represents a different media item (e.g., a media item captured at different instances within a time period). In FIG. 8A, the media representation 812 includes thumbnail media representations representing at least two types of media items. For example, thumbnail media representations 812a, 812b, and 812g represent media items that do not include high dynamic range (``HDR'') content, and thumbnail media representations 812c-812h represent media items that include HDR content. In FIG. 8A, the thumbnail media representations 812c-812h represent media items that include HDR content, but are displayed without HDR content within the media gallery user interface 810.

[0215] As shown in FIG. 8A, the thumbnail media representations 812a-812g are each displayed with a "non-HDR" or "HDR" label. It should be understood that the "non-HDR" and "HDR" labels are included to enable a reader of the subject matter herein to quickly identify whether a particular thumbnail media representation represents a media item that does not contain HDR content ("non-HDR media item") or a media item that contains HDR content ("HDR media item"). Thus, the "non-HDR" and "HDR" labels should not be considered as part of the user interface, part of the thumbnail media representations 812a-812g, and / or part of a particular media item represented by a particular thumbnail media representation. In FIG. 8A, device 600 detects a tap gesture 850a on thumbnail media representation 812a.

[0216] As shown in FIG. 8B, in response to detecting tap gesture 850a, device 600 displays media viewer user interface 820 and ceases to display media gallery user interface 810. Media viewer user interface 820 includes a media viewer region 824 positioned between application control region 822 and application control region 826. Media viewer region 824 includes an enlarged media representation 824a that represents the same media item as thumbnail media representation 812a. Thus, enlarged media representation 824a represents a non-HDR media item indicated by the "non-HDR" label in FIG. 8B. While application control region 822 and application control region 826 are substantially superimposed with the controls, media viewer user interface 820 is not substantially superimposed with the controls.

[0217] The application control region 822 optionally includes an indicator of the current time (e.g., "10:20" in FIG. 8B), the current date ("April 18, 2019" in FIG. 8B), a cellular signal status indicator 820a indicating the status of the cellular signal, and a battery level status indicator 820b indicating the status of the remaining battery life of the device 600. The application control region 822 also includes a back affordance 822a (e.g., when selected, causes the device 600 to redisplay the media gallery user interface 810) and an edit affordance 824b (e.g., when selected, causes the device 600 to display a media edit user interface including one or more controls for editing the representation of the media item represented by the currently displayed enlarged media representation).

[0218] The application control region 826 includes a portion of the thumbnail media representations 812 (e.g., 812a - 812f) displayed in a column. Since the enlarged media representation 824a is displayed, the thumbnail media representation 812a is displayed to be selected. Specifically, the thumbnail media representation 812a is displayed as the one selected in FIG. 8B by being the only thumbnail media representation displayed with a gap (e.g., the space between the thumbnail media representation 812a and the thumbnail media presentation 812b). Further, the application control region 826 includes a send affordance 826b (e.g., when selected, causes the device 600 to initiate a process of sending the media item represented by the enlarged media representation), a favorite affordance 826c (e.g., when selected, causes the device 600 to mark / unmark the media item represented by the enlarged representation as a favorite media), and a trash can affordance 826d (e.g., when selected, causes the device 600 to delete (or initiate a process for deleting) the media item represented by the enlarged media representation).

[0219] As shown in FIG. 8B, application control regions 822 and 826 (the "application control regions") are background portions of the region of the media viewer user interface 820. In FIG. 8B, the application controls are at the edges of the media viewer user interface 820. Application control region 822 is the header of the media viewer user interface, and application control region 826 is the footer of the media viewer user interface 820.

[0220] As shown in FIG. 8B, the application control region includes a light-colored (e.g., light gray, bright color) overlay. The light-colored overlay indicates that the device 600 is not operating in dark mode. In some embodiments, when the device 600 is operating in dark mode, the application control region includes a dark-colored (e.g., dark gray, black) overlay as described below in connection with FIGS. 8K-8L. For illustrative purposes, the application control region includes hatching that indicates how dark and shadowed the application control region is. For example, an application control region indicated with a higher line density (e.g., lines closer together) has a visual appearance that is darker than the visual appearance of an application control region indicated with a lower line density (e.g., lines not as close together). Thus, the hatching depicted in the application control regions of FIGS. 8B-8K indicates the darkness / brightness or color of the corresponding portions of the media viewer user interface 820.

[0221] As shown in FIG. 8B, the application control area is displayed in a default color (e.g., color shade level) as indicated by the hatching shown in FIG. 8B. In FIG. 8B, since the enlarged media representation 824a represents a non-HDR media item, the device 600 is displaying the application control area in the default color (and / or default brightness level). In FIG. 8B, the device 600 detects a leftward swipe gesture 850b within the media viewer area 824.

[0222] As shown in FIG. 8C, in response to detecting the leftward swipe gesture 850b, the device 600 replaces the enlarged media representation 824a with the enlarged media representation 824b. The enlarged media representation 824b represents the same media item as the thumbnail media representation 812b. Thus, the enlarged media representation 812b represents the non-HDR media item indicated by the "Non-HDR" label in FIG. 8C (e.g., as described above with respect to the thumbnail media representation 812b in FIG. 8A). In response to detecting the leftward swipe gesture 850b, the device 600 updates the thumbnail media representation 812 to indicate that the media item corresponding to the thumbnail media representation 812b is being displayed as the enlarged media representation within the media viewer area 824.

[0223] As shown in FIG. 8C, in response to detecting the leftward swipe gesture 850b, the device 600 continues to display the application control area in the default color as indicated by the hatching shown in FIG. 8C, which has the same density as the hatching in FIG. 8B. In FIG. 8C, since the enlarged media representation 824a represents a non-HDR media item, the device 600 continues to display the application control area in the default color. In FIG. 8C, the device 600 detects a leftward swipe gesture 850c within the media viewer area 824.

[0224] As shown in FIG. 8D, in response to detecting a leftward swipe gesture 850c, device 600 replaces the enlarged media representation 824b with the enlarged media representation 824c. The enlarged media representation 824c represents the same media item as the thumbnail media representation 812c. Thus, the enlarged media representation 812c represents the HDR media item indicated by the "HDR" label in FIG. 8D (e.g., as described above with respect to the thumbnail media representation 812c in FIG. 8A). In particular, the thumbnail media representation 812c in FIG. 8A did not include visually displayed HDR content, while the enlarged media representation 824b in FIG. 8D includes visually displayed HDR content. As shown in FIG. 8D, device 600 also updates the thumbnail media representation 812 to show its thumbnail 812c using a similar technique and for the same reasons as described above (e.g., in FIGS. 8B - 8C).

[0225] As shown in FIG. 8D, in response to detecting a leftward swipe gesture 850c, device 600 updates the application control region to have a lighter color (e.g., a lighter color, a more white color) than the color of the application control region in FIG. 8C (e.g., as indicated by the hatching in FIG. 8D having a lower level of density than the hatching in FIG. 8C). In FIG. 8D, device 600 updates the application control region to have the colors shown in FIG. 8D based on the luminance of the HDR content within each media item (e.g., the media item represented by the currently displayed enlarged media representation).

[0226] In FIG. 8E, device 600 continues to display the enlarged media representation 824c. When the device continues to display the enlarged media representation 824c (e.g., in FIG. 8E), a determination is made that the enlarged media representation 824c has been displayed for longer than a predetermined period. As shown in FIG. 8E, since a determination is made that the enlarged media representation 824c has been displayed for longer than a predetermined period, device 600 updates the application control region to have a color brighter than the color of the application control region displayed in FIG. 8D (e.g., as shown by the hatching in FIG. 8E having a lower density level than the hatching in FIG. 8D as a hatch). The brighter color of the application control region in FIG. 8D is based on the luminance of the HDR content within each media item (e.g., the media item represented by the currently displayed enlarged media representation). Thus, in FIG. 8E, device 600 brightens the color of the application control region based on the amount of time the enlarged media representation 824c has been displayed. In some embodiments, device 600 does not brighten the color of the application control region any further beyond the color of the application control region displayed in FIG. 8E, regardless of the amount of time the enlarged media representation 824c has been displayed. In some embodiments, device 600 makes a determination that the maximum luminance level based on the level of HDR content in the HDR media represented by the enlarged media representation 824c has been reached, and thus device 600 does not brighten the color of the application control region any further. In some embodiments, referring to FIGS. 8C - 8E, device 600 displays an animation of the application control region that gradually brightens from the color of the application control region in FIG. 8C to the color of the application control region in FIG. 8E after the enlarged media representation 824c has been displayed.

[0227] In some embodiments, device 600 brightens (or darkens) the color of the application control region based on the speed of a gesture received before the enlarged media representation is displayed (e.g., additionally or alternatively, based on the time at which the enlarged media representation was displayed) (e.g., swipe gesture 850c, or the time to transition the displayed enlarged media representation). In some embodiments, device 600 brightens (or darkens) more of the color of the application control region when a gesture is detected over a longer duration and less of the color of the application control region when a gesture is detected over a shorter duration. In some embodiments, device 600 brightens (or darkens) the color of the application control region based on the average speed of gestures (e.g., gestures 850b and 850c) received before the enlarged media representation is displayed. In some embodiments, device 600 brightens (or darkens) more of the color of the application control region when the average speed of the gesture is lower and less of the color of the application control region when the average speed of the gesture is higher. In FIG. 8E, device 600 detects a tap gesture 850e on thumbnail representation 812d.

[0228] As shown in FIG. 8F, in response to detecting a tap gesture 850e, device 600 replaces the enlarged media representation 824c with the enlarged media representation 824d. The enlarged media representation 824d represents the same media item as the thumbnail media representation 812d (e.g., an HDR media item) indicated by the "HDR" label in FIG. 8F. In response to detecting the tap gesture 850e, device 600 also updates the thumbnail media representation 812 to indicate that the media item corresponding to the thumbnail media representation 812d is being displayed as an enlarged media representation within the media viewer area 824. Comparing the enlarged media representation 824c (e.g., FIGS. 8D - 8E) and the enlarged media representation 824d (e.g., FIG. 8F), the enlarged media representation 824d is visually darker than the enlarged media representation 824c. In FIG. 8F, it is determined that the media item represented by the enlarged media representation 824d includes HDR content having a second amount of luminance. The second amount of luminance of the HDR content within the media item represented by the enlarged media representation 824d is darker than the amount of luminance of the HDR content within the media item represented by the enlarged media representation 824c in FIGS. 8D - 8E.

[0229] As shown in FIG. 8F, in response to detecting a tap gesture 850e and since it is determined that the media item represented by the enlarged media representation 824d includes content having a second amount of luminance, device 600 updates the color of the application control region. Specifically, device 600 updates the color of the application control region such that the application control region in FIG. 8F is darker than the application control region in FIG. 8E. In FIG. 8F, since the second amount of luminance of the HDR content within the media item represented by the enlarged media representation 824d (e.g., shown in FIG. 8F) is darker than the amount of luminance of the HDR content within the media item represented by the enlarged media representation 824c (e.g., shown in FIG. 8E), device 600 updates the color of the application control region in FIG. 8F to be visually darker than the application control region in FIG. 8E. Thus, device 600 updates the color of the application control region based on the luminance of the HDR content within the media item currently being displayed (e.g., via the enlarged media representation) on device 600. In some embodiments, the luminance level of the HDR content within the media item is based on the number of bright portions within the media item, the overall luminance of the media item, the brightest portion of the media item, and / or the luminance of a particular portion of the media item. In some embodiments, device 600 uses one or more techniques to determine how much to darken the color of the application control region as described above. In FIG. 8F, device 600 detects a leftward swipe gesture 850f within the media viewer region 824.

[0230] As shown in FIG. 8G, in response to detecting a leftward swipe gesture 850f, device 600 replaces the enlarged media representation 824d with the enlarged media representation 824e. The enlarged media representation 824e represents the same media item as the thumbnail media representation 812e (e.g., an HDR media item) indicated by the "HDR" label in FIG. 8G. In response to detecting a leftward swipe gesture 850f, device 600 also updates the thumbnail media representation 812 to indicate that the media item corresponding to the thumbnail media representation 812e is being displayed as the enlarged media representation within the media viewer area 824. Comparing the enlarged media representation 824d (e.g., FIG. 8F) and the enlarged media representation 824e (e.g., FIG. 8F), the enlarged media representation 824e is visually darker than the enlarged media representation 824d (e.g., as described above, and the enlarged media representation 824c). In FIG. 8G, it is determined that the media item represented by the enlarged media representation 824e includes HDR content having a third amount of luminance using one or more of the techniques described above. The third amount of luminance of the HDR content within the media item represented by the representation 824e is brighter than the second amount of luminance of the HDR content within the media item representation by the representation 824d.

[0231] As shown in FIG. 8G, in response to detecting a leftward swipe gesture 850f and since the media item represented by the enlarged media representation 824e includes HDR content having a third amount of luminance, device 600 updates the color of the application control region. In FIG. 8G, device 600 updates the color of the application control region such that the application control region in FIG. 8G is brighter than the application control regions in FIGS. 8E - 8D (e.g., because the third amount of luminance (e.g., FIG. 8G) is greater than the second amount of luminance (e.g., FIG. 8D)). Device 600 updates the color of the application region in FIG. 8G using one or more of the techniques described above. In FIG. 8G, device 600 detects a leftward swipe gesture 850g within the media viewer area 824.

[0232] Figures 8H - 8I show a media viewer user interface 820 that can be displayed in response to the device 600 detecting a left - swipe gesture 850g. In some embodiments, the media viewer user interface 820 of Figure 8H is displayed in response to the device 600 detecting a left - swipe gesture 850g, and the media viewer user interface 820 of Figure 8I is displayed after the media viewer user interface 820 has been displayed for a predetermined period (e.g., using the techniques described above in connection with Figures 8D - 8E). In some embodiments, the media viewer user interface 820 of Figure 8H is not displayed in response to detecting a left - swipe gesture 850g, and the media viewer user interface 820 of Figure 8I is displayed in response to detecting a left - swipe gesture 850g.

[0233] As shown in Figure 8H (and Figure 8I), in response to detecting a tap gesture 850g, the device 600 replaces the enlarged media representation 824e with the enlarged media representation 824f. The enlarged media representation 824f represents the same media item as the thumbnail media representation 812f (e.g., an HDR media item) indicated by the "HDR" label in Figure 8H (and Figure 8I). In response to detecting a tap gesture 850g, the device 600 also updates the thumbnail media representation 812 to indicate that the media item corresponding to the thumbnail media representation 812f is being displayed as an enlarged media representation within the media viewer area 824. Comparing the enlarged media representation 824e (e.g., Figure 8G) and the enlarged media representation 824f (e.g., Figure 8H), the enlarged media representation 824f is visually brighter than the enlarged media representation 824e. In Figure 8H (or Figure 8I), a determination is made that the media item represented by the enlarged media representation 824f has HDR content that exceeds a luminance threshold.

[0234] As shown in FIG. 8I, since it is determined that a media item (e.g., represented by the enlarged media representation 824f) exceeds a luminance threshold (e.g., in response to detecting the swipe gesture 850g), the device 600 darkens the HDR content of the enlarged media representation 824f (as shown by the enlarged media representation 824f in FIG. 8I having a line darker than the line of the enlarged media representation 824f in FIG. 8H). Further, the device 600 updates the color of the application control region so that the application control region in FIG. 8I is brighter than the application control region in FIG. 8G. The device 600 updates the color of the application region in FIG. 8I using one or more techniques as described above. Thus, in FIG. 8I, when it is determined that a media item exceeds the luminance threshold, the device 600 changes both the enlarged media representation of the media item and the application control region so that the luminance of the enlarged media representation approaches the luminance of the application control region. In some embodiments, the device 600 displays a media user interface that is not visually obtrusive by displaying an application control region having a luminance close to the luminance of the enlarged representation. In FIG. 8I, the device 600 detects a leftward swipe gesture 850i within the media viewer region 824.

[0235] As shown in FIG. 8J, in response to detecting the leftward swipe gesture 850i, the device 600 replaces the enlarged media representation 824f with the enlarged media representation 824g. The enlarged media representation 824g represents the same media item as the thumbnail media representation 812g (e.g., a non-HDR media item) indicated by the "Non-HDR" label in FIG. 8J. As shown in FIG. 8J, in response to detecting the leftward swipe gesture 850i and since each media item is a non-HDR media item, the device 600 updates the color of the application control region to the default color (e.g., by the hatching shown in FIG. 8J having the same density as the hatching in FIG. 8B).

[0236] Figures 8K - 8L illustrate device 600 when operating in dark mode and / or displaying a dark overlay within the application area. As shown in Figure 8K, device 600 displays an application control area with a dark overlay (e.g., dark gray, black; non - translucent) and an enlarged media representation 824b displayed within media viewer area 824. In Figure 8K, device 600 detects a left - swipe gesture 850k within media viewer area 824.

[0237] As shown in Figure 8L, in response to detecting left - swipe gesture 850k, device 600 replaces enlarged media representation 824b with enlarged media representation 824c. Enlarged media representation 824c represents the same media item as thumbnail media representation 812c. Thus, enlarged media representation 812c represents the HDR media item indicated by the "HDR" label in Figure 8D (e.g., as described above with respect to thumbnail media representation 812c in Figure 8A). As shown in Figure 8K, device 600 continues to display an application control area having the same visual appearance as the application control area shown in Figure 8K, but with enlarged media representation 812c representing the HDR media item. Thus, when device 600 displays an overly dark application area, device 600 does not update the visual appearance of the application control area based on the luminance of the HDR content within the media item (in contrast to when device 600 updates the visual appearance of the application control areas in Figures 8C - 8D when device 600 displays the application control area with a light - colored overlay).

[0238] FIG. 9 is a flow diagram showing a method for displaying media using a computer system according to some embodiments. Method 900 is executed in a computer system (e.g., 100, 300, 500, 600) that communicates with a display generation component (e.g., a display controller, a touch-sensitive display system) and one or more input devices (e.g., a touch-sensitive surface). Some operations of method 900 are optionally combined, the order of some operations is optionally changed, and some operations are optionally omitted.

[0239] As described below, method 900 provides an intuitive way for displaying media. This method reduces the user's cognitive burden when displaying media, thereby creating a more efficient human-machine interface. In the case of a battery-operated computing system, by enabling the user to view media faster and more efficiently, power is conserved and the time between battery charges is extended.

[0240] A computer system (e.g., 600) (e.g., a smartphone, a smartwatch) displays (902), via a display generation component, a media viewer user interface (e.g., 820) (e.g., an interface for displaying one or more representations (e.g., an enlarged representation or a thumbnail representation) of previously captured media): a first portion (e.g., 824) including representations (e.g., 824a - 824f) of a first previously captured media item (e.g., an image, a video); and a second portion (e.g., 822 and / or 826) of a user interface having a first visual appearance and different from (e.g., separate from, independent of) the first portion (e.g., 824) of the media viewer user interface (e.g., 820) (e.g., a chrome portion of the user interface (e.g., a header, a footer, a menu section of the user interface), a portion of the user interface that partially or completely surrounds the visual content of the user interface (e.g., the first portion)). In some embodiments, the representation of the previously captured media is captured by one or more cameras of the computer system. In some embodiments, the first previously captured media is high dynamic range (HDR) media. In some embodiments, the first previously captured media is not high dynamic range media. In some embodiments, the second portion of the media viewer user interface is outside the first portion of the media viewer user interface. In some embodiments, the second portion of the media viewer user interface is above and / or below the first portion of the media viewer user interface. In some embodiments, the second portion includes a third portion of the media user interface and a fourth portion of the media user interface separated by the first portion of the media user interface.In some embodiments, the second portion includes a plurality of affordances (e.g., when selected, an affordance to cause the computer system to share a representation of previously captured media via one or more applications; when selected, an affordance to cause the computer system to display a user interface for editing a representation of previously captured media; when selected, an affordance to cause the computer system to delete a displayed representation of previously captured media; when selected, an affordance to cause the computer system to include a representation of previously captured media in a particular group of representations (e.g., a favorite representation, a "like" representation, etc.); when selected, an affordance to cause the computer system to simultaneously display a plurality of representations (e.g., a media gallery having a plurality of photos in a grid); when selected, an affordance to cause the computer system to stop displaying the media viewer user interface and display a user interface different from the media viewer user interface). In some embodiments, the representation of previously captured media has been captured by one or more cameras of the computer system. In some embodiments, the first previously captured media is high dynamic range media. In some embodiments, the first previously captured media is not high dynamic range media.

[0241] While displaying a media viewer user interface (e.g., 820) that includes a second portion (e.g., 822 and / or 826) of a media viewer user interface having a first visual appearance (e.g., 822 and / or 826 of FIG. 8F) (and a first portion including a representation of a first previously captured media item) via a display generation component, the computer system receives (904) (e.g., 850f) a request to display a representation (e.g., 824e) of a second previously captured media item (e.g., a still image, video) different from the first previously captured media item (e.g., 824d) (e.g., a swipe gesture on the media viewer user interface (e.g., 820)) (e.g., to replace the display of the representation of the first previously captured media item with the representation of the second previously captured media item).

[0242] In response to receiving a request to display a representation of a second previously captured media item (906), and in accordance with a determination (908) that a first set of criteria is met, including criteria that are met when the representation of the second previously captured media item (e.g., 824e) (or a different media item) is a high dynamic range (HDR) media item, the computer system displays a representation of the second previously captured media item (e.g., replaces the display of the representation of the first previously captured media item with the representation of the second previously captured media item) (910) and updates a second portion (e.g., 822 and / or 826) of a media viewer user interface (e.g., 820) to have a second visual appearance (e.g., 822 and / or 826 in FIG. 8G) different from a first visual appearance (e.g., 822 and / or 826 in FIG. 8F) (912). In some embodiments, in accordance with the determination that the first set of criteria is met, the first previously captured media item ceases to be displayed. In some embodiments, the second visual appearance is brighter / darker (or whiter) than the first visual appearance. In some embodiments, the second visual appearance is based on the luminance level of the representation of the second previously captured media item. In some embodiments, the luminance level can include the respective luminance of specific elements within the representation of the previously captured media, and / or can be based on the number of bright elements within the representation of the previously captured media, and / or can be based on the overall luminance of the representation of the previously captured media. When certain conditions are met (e.g., when displaying an HDR photo), updating a portion (e.g., the image border, chrome) of the media viewer user interface (e.g., 820) causes the updated portion of the media to more closely match elements within the HDR photo, making the user interface less visually obtrusive when the HDR photo is displayed.By performing an operation when a set of conditions is met without requiring further user input, the operability of the system is enhanced, the user-system interface is made more efficient (e.g., by assisting the user to provide appropriate input when operating / interacting with the system and reducing user errors), and in addition, by enabling the user to use the system more quickly and efficiently, the power consumption of the system is suppressed and the battery life is improved.

[0243] In some embodiments, as part of updating a second portion (e.g., 822 and 826) of a media viewer user interface (e.g., 820) to have a second visual appearance different from the first visual appearance, and in accordance with a determination that a portion of a media item (e.g., 824d in FIG. 8F) (e.g., HDR content) has a first level of luminance, the computer system displays a second portion (e.g., 822 and / or 826 in FIG. 8F) of the media viewer user interface (e.g., 820) having a first amount of visual characteristics (e.g., luminance level, opacity, color (e.g., whiteness)). In some embodiments, as part of updating a second portion of a media viewer user interface (e.g., 820) to have a second visual appearance different from the first visual appearance, and in accordance with a determination that a portion of a media item has a second level of luminance (e.g., 824e in FIG. 8G), the computer system displays a second portion (e.g., 822 and / or 826 in FIG. 8G) of the media viewer user interface (e.g., 820) having a second amount of visual characteristics different from the first amount of visual characteristics (e.g., luminance level, opacity, color (e.g., whiteness)). In some embodiments, the second portion of the media viewer user interface is updated to have a second visual appearance based on the luminance of the content (e.g., HDR content) within the media item. In some embodiments, when the second luminance level is higher (or, alternatively, lower) than the first luminance level, the second amount is higher than the first amount. In some embodiments, when the media item is HDR content and a portion of the media item is configured to be displayed at a luminance above the first level of luminance, the second portion of the media viewer user interface is displayed with the first amount of visual characteristics, and when the media item is HDR content and a portion of the media item is configured not to be displayed at a luminance above the first level of luminance, the second portion of the media viewer user interface is displayed with a second amount of visual characteristics different from the first amount of visual characteristics (e.g., luminance level, opacity, color (e.g., whiteness)).By dynamically updating a part of the media viewer user interface (e.g., Chrome) to be different based on the luminance of the HDR content of different media items, the user interface is made not visually obtrusive when displaying each media item (e.g., when the HDR content of the media is brighter, a part of the media viewer user interface is brighter). By performing an operation when a set of conditions is met without requiring further user input, the operability of the system is enhanced, the user-system interface is made more efficient (e.g., by assisting the user to provide appropriate input when operating / interacting with the system and reducing user errors), and in addition, by enabling the user to use the system more quickly and efficiently, the power consumption of the system is suppressed and the battery life is improved.

[0244] In some embodiments, as part of updating a second portion of a media viewer user interface (e.g., 820) to have a second visual appearance different from a first visual appearance, and in accordance with a determination that a media item (e.g., 824c) has been displayed for a first amount of time, the computer system displays a second portion (e.g., 822 and / or 826 in FIG. 8D) of the media viewer user interface (e.g., 820) having a third amount of visual characteristics (e.g., luminance level, opacity, color (e.g., whiteness)). In some embodiments, as part of updating a second portion of a media viewer user interface (e.g., 820) to have a second visual appearance different from a first visual appearance, and in accordance with a determination that a media item (e.g., 824c) has been displayed for a second amount of time different from the first amount of time, the computer system displays a second portion (e.g., 822 and / or 826 in FIG. 8E) of the media viewer user interface (e.g., 820) having a fourth amount of visual characteristics different from the third amount of visual characteristics (e.g., luminance level, opacity, color (e.g., whiteness)). In some embodiments, the second portion of the media viewer user interface is updated to have a second visual appearance based on the amount of time the media item has been displayed. In some embodiments, while a media item is being displayed, the visual appearance of the second portion can change over time (e.g., gradually, multiple times) (e.g., over a period of 0.5, 1, 2, 5, or 10 seconds and then optionally stop changing while the same media item continues to be displayed). In some embodiments, when a media item is displayed for a second amount of time that is longer (or alternatively shorter) than the first amount of time, the fourth amount of visual characteristics is higher than the third amount of visual characteristics. In some embodiments, the second portion of the media viewer user interface is displayed with a predetermined amount (or degree) of visual characteristics, and the amount of visual characteristics is based on the amount of elapsed time (e.g., the amount of time a previously captured media item was displayed, the amount of time a second previously captured media item was displayed).By dynamically updating a part of the media viewer user interface (e.g., Chrome) to be different based on the time the HDR media is displayed, the user interface is made less visually intrusive when displaying media (e.g., reducing changes when the media is displayed for less time), and the amount of different levels of luminance at which a part of the media viewer user interface is updated is reduced. By performing an operation when a set of conditions is met without requiring further user input, the operability of the system is enhanced, the user-system interface is made more efficient (e.g., by assisting the user to provide appropriate input when operating / interacting with the system and reducing user errors), and in addition, by enabling the user to use the system more quickly and efficiently, the power consumption of the system is reduced and the battery life is improved.

[0245] In some embodiments, as part of displaying a representation of a second previously captured media item (e.g., 824c - 824f), the computer system replaces the representation of a first previously captured media item with the representation of the second previously captured media. In some embodiments, as part of updating a second portion of the media viewer user interface to have a second visual appearance different from the first visual appearance, and in accordance with a determination that the representation of the first previously captured media item was displayed for at least a first amount of time before being replaced with the representation of the second previously captured media, the computer system displays a second portion of the media viewer user interface (e.g., 820) having a fifth amount of visual characteristics (e.g., luminance level, opacity, color (e.g., whiteness)). In some embodiments, as part of updating a second portion of the media viewer user interface (e.g., 820) to have a second visual appearance different from the first visual appearance, and in accordance with a determination that the representation of the first previously captured media item content was replaced with the representation of the second previously captured media at a second amount of time different from the first time, the computer system displays a second portion of the media viewer user interface (e.g., 820) having a sixth amount of visual characteristics different from the fifth amount of visual characteristics (e.g., luminance level, opacity, color (e.g., whiteness)). In some embodiments, the second portion of the media viewer user interface is updated to have a second visual appearance based on the duration of the transition between the previously displayed representations. In some embodiments, when the duration of the transition between the representations is smaller (larger), the amount of change in the visual appearance is smaller (larger).By dynamically updating a part of the media viewer user interface (e.g., the border, chrome) to be different based on the transition time between two media items, the user interface is made less visually intrusive when displaying media (e.g., reducing changes when the media is transitioned more quickly), and the harshness in the change of the amount of luminance when quickly transitioning between media is reduced. By performing an operation when a set of conditions is met without requiring further user input, the operability of the system is enhanced, the user-system interface is made more efficient (e.g., by assisting the user to provide appropriate input when operating / interacting with the system and reducing user errors), and in addition, by enabling the user to use the system more quickly and efficiently, the power consumption of the system is suppressed and the battery life is improved.

[0246] In some embodiments, as part of updating a second portion of a media viewer user interface (e.g., 820) to have a second visual appearance different from a first visual appearance, and in accordance with a determination that an average rate of requests to display previously captured media items (e.g., 850f, 850g) (e.g., the previous five requests) is below a first threshold (e.g., or a first number of requests to display multiple representations of a previously captured media item is received within a predetermined time before a second representation of a previously captured media item is displayed), the computer system displays a second portion of the media viewer user interface (e.g., 820) having a seventh amount of visual characteristics (e.g., luminance level, opacity, color (e.g., whiteness)). In some embodiments, as part of updating a second portion of a media viewer user interface (e.g., 820) to have a second visual appearance different from a first visual appearance, and in accordance with a determination that an average rate of requests to display previously captured media items is not below a first threshold (e.g., a second number of requests to display multiple representations of a previously captured media item is received within a predetermined time before a second representation of a previously captured media item is displayed), the computer system displays a second portion of the media viewer user interface (e.g., 820) having an eighth amount of visual characteristics different from the seventh amount of visual characteristics (e.g., luminance level, opacity, color (e.g., whiteness)). In some embodiments, the second number is different from the first number. In some embodiments, the second portion of the media viewer user interface is updated to have a second visual appearance based on an average rate of input (e.g., swipe speed or velocity). In some embodiments, when the average rate of input is high, the second portion changes less than when the average rate of subsequent input is lower. In some embodiments, the second portion of the media viewer user interface is displayed with a predetermined amount (or degree) of visual characteristics, and the amount of visual characteristics is based on a rate at which content is displayed within a first portion of the media browser interface (e.g., number of images per unit time).By dynamically updating a part of the media viewer user interface (e.g., borders, chrome) to be different based on the transition time between media items, the user interface is made less visually intrusive when displaying media (e.g., reducing changes when the speed is faster), and the harshness in the change of the amount of luminance when quickly transitioning between media is reduced. By performing an operation when a set of conditions is met without requiring further user input, the operability of the system is enhanced, the user-system interface is made more efficient (e.g., by assisting the user to provide appropriate input when operating the system / interacting with the system and reducing user errors), and in addition, by enabling the user to use the system more quickly and efficiently, the power consumption of the system is suppressed and the battery life is improved.

[0247] In some embodiments, while displaying a media viewer user interface (e.g., 820) having a first visual appearance via a display generation component, which includes a second portion (and a first portion including a representation of a first previously captured media item) of the media viewer user interface, the computer system receives a request to display a representation of a third previously captured media item that is different from the first previously captured media item and the second previously captured media item. In some embodiments, in response to receiving the request to display a representation of the third previously captured media item and in accordance with a determination that a first set of criteria is met, the computer displays the representation of the third previously captured media item (e.g., by replacing the representation of the second previously captured media item) and updates a second portion (e.g., 822 and / or 826) of the media viewer user interface (e.g., 820) to have a third visual appearance that is different from the first visual appearance and the second visual appearance. In some embodiments, the first set of criteria includes criteria that are met when the representation of the third previous media is an HDR media item. In some embodiments, when the third media item has a higher luminance level of content than a previously displayed media item (e.g., the luminance level can be based on the number of bright elements in the image and / or can include the respective luminance of specific elements in the image that can be based on the overall luminance of the image), the second portion (e.g., 822 and / or 826) of the media viewer user interface (e.g., 820) is brighter (or has a more white color), while the third media item is displayed more than when the previous media item was displayed.By dynamically updating a part of the media viewer user interface (e.g., Chrome) to be different based on the luminance of the HDR content of different media items, the user interface is made not visually obtrusive when displaying each media item (e.g., when the HDR content of the media is brighter, a part of the media viewer user interface becomes brighter). By performing an operation when a set of conditions is satisfied without requiring further user input, the operability of the system is enhanced, the user-system interface is made more efficient (e.g., by assisting the user to provide appropriate input when operating / interacting with the system and reducing user errors), and in addition, by enabling the user to use the system more quickly and efficiently, the power consumption of the system is suppressed and the battery life is improved.

[0248] In some embodiments, the second previously captured media item is an HDR media item (e.g., 824c - 824f). In some embodiments, the representation of the second previously captured media item is displayed in HDR. In some embodiments, for a media item (e.g., an image or video) having at least a part intended to be displayed at a specific luminance level above the standard dynamic range for luminance, the representation of the media item is displayed at a luminance level above the standard dynamic range (e.g., a specific luminance level).

[0249] In some embodiments, the first set of criteria includes criteria that are met when the second portion (e.g., 822 and / or 826) is a color that is not the second color (e.g., a color that is not black or a dark color, such as white or a light color, a bright color (e.g., a color that is more white than black)) (or is within a threshold (e.g., red - blue - green value, hexadecimal value)). In some embodiments, the first set of criteria includes criteria that are met when the second portion (e.g., 822 and / or 826) is not the second color (e.g., black or a dark color). In some embodiments, the computer system receives user input to select from among two or more options for the color range of the second portion (e.g., 822 and / or 826), and the first set of criteria includes criteria that are met when the current color range selection for the second portion (e.g., 822 and / or 826) is the first color range (not the second color or the second color range).

[0250] In some embodiments, as part of updating the second portion (e.g., 822 and / or 826) of the media viewer user interface to have a second visual appearance, the computer system displays an animation that gradually transitions (e.g., fades over a predetermined period (e.g., 1, 2, 3 seconds)) the second portion (e.g., 822 and / or 826) of the media viewer user interface from the first visual appearance to the second visual appearance. By gradually updating a part of the media viewer user interface (e.g., chrome) when an HDR media item is displayed, the user interface is made less visually intrusive when displaying an HDR media item and reduces the obtrusiveness of changes to a part of the media viewer interface. By providing improved visual feedback to the user, the operability of the system is improved, (e.g., by assisting the user to provide appropriate input when operating / interacting with the system and reducing user errors) making the user - system interface more efficient, and in addition, reducing power usage and improving the battery life of the system by enabling the user to use the system more quickly and efficiently.

[0251] In some embodiments, the representation of previously captured media items (e.g., a first previously captured media item, a second previously captured media item, etc.) includes an amount of luminance (e.g., average luminance, percentage of bright areas). In some embodiments, the representation of a previously captured media item is displayed with an altered amount of luminance (e.g., reduced) (e.g., reduced average luminance, reduced luminance in some portions while maintaining the luminance of other portions, equally reduced luminance across the image) according to a determination that the amount of luminance exceeds a luminance threshold. In some embodiments, the representation of a previously captured media item is displayed with the amount of luminance (e.g., without reducing the average luminance, without equally reducing the luminance across the image) according to a determination that the amount of luminance does not exceed the luminance threshold. In some embodiments, the content below the media item remains the same (e.g., having an amount of luminance that exceeds the luminance threshold), but the media item is displayed with an altered amount of luminance (e.g., reduced). By dynamically changing HDR media items that are displayed differently based on the luminance of the HDR content of different media items, the user interface is made less visually obtrusive when displaying each media item (e.g., as the HDR content of a photo becomes brighter, the photo is displayed darker, reducing the visual difference between the chrome and the photo). By performing an operation when a set of conditions is met without requiring further user input, the operability of the system is enhanced, the user-system interface is made more efficient (e.g., by assisting the user to provide appropriate input when operating / interacting with the system and reducing user errors), and in addition, the power consumption of the system is reduced and the battery life is improved by enabling the user to use the system more quickly and efficiently.

[0252] In some embodiments, the first previously captured media items (e.g., 824a - 824b, 824g) are not HDR media items. In some embodiments, the second previously captured media items (e.g., 824c - 824f) are HDR media items. In some embodiments, before displaying, via a display generation component, a media viewer user interface that includes a first portion and a second portion (e.g., 822 and / or 826), the computer system displays, via the display generation component, a user interface (e.g., 810) that includes a plurality of representations of the media item (e.g., 812a - 812g). In some embodiments, the plurality of representations of the media item includes a second representation (e.g., 812a - 812b, 812g) (e.g., a thumbnail) of the first previously captured media item without HDR content, and a second representation (e.g., 812c - 812f) (e.g., a thumbnail) of the second previously captured media item without HDR content. In some embodiments, the thumbnail (e.g., an image) of the media item is displayed using standard dynamic range luminance, regardless of whether the media item is intended to be displayed at a particular luminance level that exceeds the standard dynamic range for luminance.In some embodiments, while displaying a plurality of representations of a media item, the computer system receives a request to display a first (or, alternatively, any of a second or other plurality of representations) previously captured media item (e.g., a selection (e.g., a tap) of a second representation of a first (or, alternatively, any of a second or other plurality of representations) previously captured media item), and in response to receiving the request to display the first (or, alternatively, any of a second or other plurality of representations) representation, the electronic device displays a media interface including a first portion (e.g., having a representation of a first (or, alternatively, any of a second or other plurality of representations) previously captured media item) and a second portion (e.g., 822 and / or 826) having a first visual appearance (or, alternatively, a second visual appearance when a second previously captured media item is displayed in the first portion).

[0253] In some embodiments, in response to receiving a request to display a representation of a second previously captured media item (906), and in accordance with a determination that a first set of criteria is not met, the computer system halts (914) the update of a second portion (e.g., 822 and / or 826) of a media viewer user interface (e.g., 820) to have a second visual appearance that is different from the first visual appearance (e.g., display (or continue to display) the second portion (e.g., 822 and / or 826) of the media viewer user interface (e.g., 820) having the first visual appearance). In some embodiments, the first set of criteria is not met if the representation of the second previously captured media item is not an HDR media item. In some embodiments, when a non-HDR photograph is displayed, the chrome (the area surrounding the displayed image) does not change. In some embodiments, in accordance with a determination that the first set of criteria is not met, the computer system transitions the display of the second portion (e.g., 822 and / or 826) to a predetermined visual appearance (e.g., independent of the luminance of the second previously captured media item). Thus, unless the image is an HDR image, the second portion (e.g., 822 and / or 826) is displayed using a predetermined appearance regardless of the amount of luminance / darkness of the non-HDR image. By dynamically halting changes to a portion of the media user interface when the media is not HDR media, the user interface is made less visually intrusive when displaying each non-HDR-compatible media item. By performing an operation when a set of conditions is met without requiring further user input, the operability of the system is enhanced, the user-system interface is made more efficient (e.g., by assisting the user to provide appropriate input when operating / interacting with the system and reducing user errors), and in addition, the power usage of the system is reduced and the battery life is improved by enabling the user to use the system more quickly and efficiently.

[0254] In some embodiments, while displaying a representation of a second previously captured media item and a second portion (e.g., 822 and / or 826) having a second visual appearance, the computer system receives a request to display a representation of a fourth previously captured media item (e.g., 850g, 850i). In some embodiments, in response to receiving a request to display a third previously captured media item (e.g., 850g, 850i), and in accordance with a determination that a first set of criteria is met, the computer system displays a representation of the fourth previously captured media item without updating the visual appearance of the second portion (e.g., 822 and / or 826), (e.g., by replacing the display of the second previously captured media item), and updates the second portion of the media (e.g., 822 and / or 826) to have a visual appearance (e.g., 822 and / or 826 in FIGS. 8E - 8I) that is different from the first visual appearance and the second visual appearance. In some embodiments, in response to receiving a request to display a third previously captured media item, and in accordance with a determination that the first set of criteria is not met (e.g., the fourth previously captured media item is not an HDR media item), the computer system displays a representation of the fourth previously captured media item and updates the second portion of the media (e.g., 822 and / or 826) to have a predetermined visual appearance (e.g., 822 and / or 826 in FIGS. 8C - 8D and 8J) that is different from the second visual appearance (e.g., regardless of the luminance of the second previously captured media item). In some embodiments, unless the fourth previously captured media item is HDR, the second portion (e.g., 822 and / or 826) is displayed using a predetermined visual appearance regardless of how bright / dark the non - HDR image is.In some embodiments, when a non-HDR image is required to be displayed, the second portion (e.g., 822 and / or 826) is displayed using a predetermined visual appearance (e.g., the same color and / or luminance for all non-HDR images) regardless of how bright / dark the non-HDR image is, and when an HDR image is required to be displayed, the second portion (e.g., 822 and / or 826) is displayed using a variable visual appearance based on how bright / dark the HDR image is.

[0255] Note that the details of the process described above with respect to method 900 (e.g., FIG. 9) are also applicable in a similar manner to the methods described hereinafter / above. For example, method 700 and method 1100 optionally include one or more of the characteristics of the various methods described above with reference to method 900. For example, method 900 can display media captured using a computer system configured to capture media at a specific exposure compensation value using one or more steps of method 700 (described above). For the sake of brevity, these details are not repeated below.

[0256] FIGS. 10A-10AC show exemplary user interfaces for displaying status indicators using an electronic device, according to some embodiments. The user interfaces of these figures are used to illustrate processes described hereinafter, including the process of FIG. 11.

[0257] In FIGS. 10A - 10AC, device 600 can record (or capture) media using one or more media capture devices such as a microphone (e.g., FIGS. 10B, 10E) and / or a camera (e.g., FIGS. 10Q, 10W). FIGS. 10A - 10AC show exemplary scenarios where device 600 displays or does not display a recording status indicator based on the type of data recorded by at least one of the media capture devices. When used in connection with FIGS. 10A - 10C, the type of data refers not to the format of the data, but rather to how the data is used (e.g., whether the data is available for playback; whether the data is passed to a trusted or untrusted application). As used herein in connection with FIGS. 10A - 10AC, a first type of data (e.g., the type of data for which a capture status indicator is displayed) refers to data that is determined to be used (or potentially used) in a first way, and a second type of data (e.g., the type of data for which a capture status indicator is not displayed) refers to data that is determined not to be used in the first way. In some embodiments, the first type of data (e.g., the type of data for which a capture status indicator is displayed) corresponds to data that is available (e.g., stored) for later playback, and the second type of data (e.g., the type of data for which a capture status indicator is not displayed) corresponds to data that is not available for playback.In some embodiments, a first type of data (e.g., the type of data for which a capture status indicator is displayed) corresponds to data passed to untrusted applications (e.g., a non-first-party voice assistant application, a non-first-party authentication application), and a second type of data (e.g., the type of data for which a capture status indicator is not displayed) is not passed to untrusted applications (e.g., a non-first-party voice assistant application, a non-first-party third-party authentication application) and is not retained as media that can be played back at a later time (e.g., by the device or by another device), but corresponds to data used by one or more trusted applications (e.g., components of an operating system or trusted first-party and / or third-party applications) to control various features of the device. Thus, the determination is based on whether an untrusted application has access to data (e.g., audio or video content) recorded by the untrusted application. In some embodiments, a recording status indicator is displayed regardless of whether an indicator of recording is displayed by the application that records the data.

[0258] FIG. 10A shows a device 600 that displays a user interface having an icon 690. In FIG. 10A, the device 600 detects an audio input 1050a (e.g., "Yes, Assistant") via a microphone of the device 600. As shown in FIG. 10B, in response to detecting the audio input 1050a, the device 600 displays a user interface 1004. The user interface 1004 is a user interface for a voice assistant application. The user interface 1004 includes the phrase "What can I do for you?", which indicates that the device 600 is waiting to receive an audio input corresponding to a command.

[0259] Specifically, in FIGS. 10A - 10B, the device 600 records data via the microphone of the device 600 to identify a command (e.g., spoken by the user of the device 600). However, in FIGS. 10A - 10B, since the device 600 is determined not to be recording the first type of data, it does not display a recording status indicator (e.g., the recording status indicator 1042 shown in FIG. 10E). In FIGS. 10A - 10B, since the recorded data is determined to be data that cannot be used for later playback, the device 600 is not recording the first type of data. Specifically, since the device 600 records data and identifies a voice command that enables a native assistant (or trusted) voice application to cause the device 600 to perform one or more operations (e.g., provide a direction to a location, provide an answer to a query from the user), the data recorded in FIGS. 10A - 10B is passed to a trusted application and is not available for later playback.

[0260] At some point after displaying the user interface 1010, the device 600 redisplayed a user interface having an application icon 690 that includes a voice memo application icon 690b. In FIG. 10C, the device 600 detects a tap gesture 1050c on the voice memo application icon 690b. In response to detecting the tap gesture 1050c, as shown in FIG. 10D, the device 600 launches the voice memo application corresponding to the voice memo application icon 690b and displays a recording start user interface (e.g., for the voice memo application) that includes an audio recording affordance 1010. Since it is determined that the first type of data is not being recorded, the device 600 does not display the recording status indicator 1042 in FIG. 10C. In FIG. 10D, the device 600 detects a tap gesture 1050d on the audio recording affordance 1010.

[0261] As shown in FIG. 10E, in response to detecting the tap gesture 1050d, the device 600 displays an audio recording user interface that includes a stop affordance 1016 indicating that the device 600 is recording data (e.g., ceasing to display the audio recording affordance 1010). In FIG. 10E, in response to detecting the tap gesture 1050d, the device 600 causes data (e.g., audio data) to be recorded on one or more of the microphones of the device 600. The data recorded in FIG. 10E (e.g., in response to detecting the tap gesture 1050d) is data that is recorded for an audio memo application (e.g., that can be accessed by and / or initiated by an audio memo application). In FIG. 10E, it is determined that the data recorded for the audio memo application is a first type of data. The data recorded for the audio memo application is determined to be a first type of data because it is determined that the data is recorded such that it is available for later playback.

[0262] As shown in FIG. 10E, since it is determined that the data recorded for the voice memo application is the first type of data, the device 600 displays a recording status indicator 1042 at the location of the cellular signal status indicator 820a. Thus, in some embodiments, the recording status indicator 1042 indicates to the user that one or more media capture devices (e.g., microphone, camera) of the device 600 are recording the first type of data so that the device 600 can stop recording the data if the user desires. In some embodiments, the user may not recognize that the first type of data is being recorded, such as when the application starting the recording does not provide appropriate instructions. Thus, in some embodiments, displaying the recording status indicator 1042 can provide the user with information related to the user's privacy (e.g., whether the user's voice or the user's photo or image is recorded and available for later playback on one or more devices). While continuing to record the first type of data for the voice memo application, the device 600 receives an incoming call instruction via the web conferencing application.

[0263] As shown in FIG. 10F, in response to receiving the incoming call instruction, the device 600 displays a web conferencing user interface that includes an acceptance affordance 1032 and an indication that the incoming call is received from an external device associated with "John". As shown in FIG. 10F, while the device 600 is displaying the web conferencing user interface, it continues to display the recording status indicator 1042. Since the device 600 continues to record the voice data for the voice memo application as described above in connection with FIG. 10E, the device 600 continues to display the recording status indicator 1042 (e.g., the audio recording was not stopped in FIGS. 10E-10F). In FIG. 10F, the device 600 detects a tap gesture 1050f on the acceptance affordance 1032.

[0264] As shown in FIG. 10G, in response to detecting the tap gesture 1050f, the device 600 causes an incoming readout and displays a user interface having an end affordance 1034. In FIG. 10G, after an incoming call is answered, the device 600 causes the data of the web conferencing application to be recorded by a microphone of the device 600 (e.g., the same or a different microphone from the microphone currently recording data for the voice memo application). In FIG. 10G, the device 600 simultaneously records the data of the voice memo application and the data of the web conferencing application (e.g., via the microphone of the device 600). In FIG. 10G, the device 600 uses one or more techniques similar to those described above to determine that the data recorded for the web conferencing application is of a first type of data (e.g., because the data recorded for the web conferencing application is available to be played back by John's device). As shown in FIG. 10G, the device 600 does not display an additional recording status indicator. Since the recording status indicator 1042 is already displayed (e.g., a predetermined number of recording status indicators are displayed) due to the first type of data being recorded in the voice memo application, the device 600 does not display an additional recording status indicator. In some embodiments, if the recording status indicator 1042 is not displayed before the device 600 records data for the web conferencing application, the device 600 displays the recording status indicator 1042 in response to detecting the tap gesture 1050f. In FIG. 10G, the device 600 detects a downward swipe gesture 1050g.

[0265] As shown in FIG. 10H, in response to detecting a downward swipe gesture 1050g, device 600 displays a control user interface 1038. The control user interface 1038 includes device controls 1046 for changing the state of device 600, such as connectivity settings (e.g., wireless, cellular, Bluetooth settings). Further, since device 600 is simultaneously capturing a first type of data for a web colling application (e.g., a third-party application) and a voice memo application, the control user interface 1038 includes a web colling recording status indicator 1044a and a voice memo recording status indicator 1044b. Since device 600 is displaying the control user interface 1038, the web colling recording status indicator 1044a and the voice memo recording status indicator 1044b are displayed. The recording status indicators in FIG. 10H each include more visual content than the recording status indicator 1042 shown in FIG. 10G. Further, device 600 displays a plurality of recording status indicators on the control user interface 1038 while only displaying one recording status indicator when the control user interface 1038 is not being displayed (e.g., in FIG. 10G). In some embodiments, in response to detecting a downward swipe gesture 1050g, device 600 displays an animation of the recording status indicator 1042 that transitions to one or both of the recording status indicator 1044a and the voice memo recording status indicator 1044b.

[0266] The web - curling recording status indicator 1044a includes an application instruction 1044a1, a device instruction 1044a2, and a configuration instruction 1044a3. The application instruction 1044a1 indicates an application (e.g., a web - curling application) for which the device 600 is recording the first type of data. The device instruction 1044a2 indicates that the microphone of the device 600 is being used to record the first type of data for the web - curling application. Further, the configuration instruction 1044a3 indicates that the web - curling recording status indicator 1044a is selectable. The voice - memo recording status indicator 1044b includes similar instructions such as an application instruction 1044b1 (e.g., indicating that the first type of data for the voice - memo application is being recorded) and a device instruction 1044b2 (e.g., indicating that the microphone of the device 600 is being used to record the first type of data for the voice - memo application). However, as shown in FIG. 10H, the voice - memo recording status indicator 1044b does not include a configuration instruction.

[0267] In FIG. 10H, since it is determined that the voice memo application is not configurable via the control user interface 1038 (e.g., it does not have a configurable permission to enable / disable access to the media capture device), the voice memo recording status indicator 1044b does not include a configuration instruction. On the other hand, the web calling recording status indicator 1044a includes a configuration instruction 1044a3 because the web calling application is determined to be a type of application that is configurable via the control user interface 1038. In some embodiments, the device 600 detects a tap gesture 1050h1 on the voice memo recording status indicator 1044b. In some embodiments, in response to detecting the tap gesture 1050h1, since the voice memo recording status indicator 1044b is not selectable, the device 600 continues to display the control user interface 1038 without displaying any additional content. In FIG. 10H, the device 600 detects a tap gesture 1050h2 on the web calling recording status indicator 1044a.

[0268] As shown in FIG. 10I, in response to detecting the tap gesture 1050h2, the device 600 stops displaying the control user interface 1038 and displays a permission management user interface for the web calling application that includes a permission control 1052. In particular, since the display of the control user interface 1038 has been stopped, the device 600 also stops displaying separate recording status indicators for the web calling and voice memo applications (e.g., the web calling recording status indicator 1044a and the voice memo recording status indicator 1044b) and displays a single or combined recording status indicator for the application (e.g., the recording status indicator 1042).

[0269] As shown in FIG. 10I, the permission control 1052 includes a microphone access affordance 1052a and a camera access affordance 1052b that are both active (e.g., “on”). In some embodiments, in response to detecting a tap gesture on the microphone access affordance 1052a, the device 600 stops enabling data of the web conferencing application to be recorded via the microphone of the device 600, and also stops recording the first type of data of the web conferencing application that starts recording in response to the detection of the input gesture 1050f. In some embodiments, in response to detecting a tap gesture on the camera access affordance 1052a, the device 600 stops enabling data of the web conferencing application to be recorded via the camera of the device 600. In FIG. 10I, the device 600 detects a rightward swipe gesture 1050i at the bottom of the permission management user interface.

[0270] As shown in FIG. 10J, in response to detecting the rightward swipe gesture 1050i, the device 600 redisplays the user interface having the end affordance 1034. In FIG. 10J, the device 600 detects a tap gesture 1050j on the end affordance 1034.

[0271] As shown in FIG. 10K, in response to detecting a tap gesture 1050j, device 600 stops recording the first type of data of the web conferencing application (e.g., via the microphone of device 600) and displays a user interface of the web conferencing application indicating that the call has ended. In particular, in FIG. 10K, device 600 continues to display a recording status indicator 1042 because the first type of data continues to be recorded for the voice memo application, but the recording for the web conferencing application has been stopped. In FIG. 10K, device 600 detects an upward swipe gesture 1050k on the user interface of the web conferencing application indicating that the call has ended.

[0272] As shown in FIG. 10L, in response to detecting an upward swipe gesture 1050k, device 600 displays a user interface with an icon 690 while continuing to display the recording status indicator 1042 using one or more similar techniques as described above (e.g., in FIG. 10E). As shown in FIG. 10L, icon 690 includes a camera application icon 690a. In FIG. 10L, device 600 detects a tap gesture 1050l on the camera application icon 690a.

[0273] As shown in FIG. 10M, in response to detecting a tap gesture 1050l, device 600 displays a camera user interface. The camera user interface shown in FIG. 10M is displayed using one or more similar techniques as described above with respect to the camera user interface of FIG. 6A. For example, the camera user interface of FIG. 10M includes an indicator region 602, a camera display region 604, and a control region 606. The camera display region 604 includes a live preview 630, and the control region 604 includes a camera mode affordance 620 and a shutter affordance 610. As shown in FIG. 10M, the video camera mode affordance 620b is centered (e.g., "Video" is bolded), indicating that device 600 is configured to record data representing video media in response to receiving a selection of the shutter affordance 610. In FIG. 10M, device 600 detects a tap gesture 1050m on the shutter affordance 610.

[0274] As shown in FIG. 10N, in response to detecting a tap gesture 1050m, device 600 begins recording data of the camera application via one or more cameras of device 600. In FIG. 10N, using one or more similar techniques described above, a determination is made that the data being recorded for the camera application is of a first type (e.g., because the recorded data is available for later playback). In FIG. 10N, since device 600 is not simultaneously displaying the control user interface 1038 (for similar reasons as described above in relation to FIG. 10G), device 600 is not displaying an additional recording status indicator (in addition to the recording status indicator 1042). In FIG. 10N, device 600 detects a downward swipe gesture 1050n that starts near the top of the camera user interface.

[0275] As shown in FIG. 10O, in response to detecting a downward swipe gesture 1050n, device 600 redisplayed the control user interface 1038. The control user interface 1038 includes a voice memo recording status indicator 1044b and a camera recording status indicator 1044c. Since device 600 uses one or more cameras to record a first type of data for a camera application, as opposed to using a microphone to record a first type of data, the camera recording status indicator 1044c includes a device identifier 1044c2 that is different from the device identifier 1044b2 of (e.g., the voice memo recording status indicator 1044b). Since device 600 is recording a first type of data for both applications (e.g., using one or more similar techniques as described above with respect to FIG. 10H) simultaneously, the voice memo recording status indicator 1044b and the camera recording status indicator 1044c are displayed simultaneously.

[0276] FIG. 10P shows a different version of the control user interface 1038 that can be displayed in response to detecting a downward swipe gesture 1050n. The control user interface 1038 of FIG. 10P includes additional indications (e.g., "currently in use") of the current state of use of each application (e.g., voice memo application, camera application) of each device (e.g., microphone, camera). However, the control user interface 1038 does not include additional indications. In some embodiments, since the additional indications take up more space within the control user interface, device 600 can display the additional indications while the first type of data is less than a threshold number (e.g., 1, 2) of applications (and / or devices), or when the recording status indicators of the threshold number are displayed simultaneously. Returning to FIG. 10O, device 600 detects an upward swipe gesture 1050o on the control user interface 1038.

[0277] As shown in FIG. 10Q, in response to detecting a swipe gesture 1050o, device 600 redisplayed a camera user interface that includes a stop affordance 614. In FIG. 10Q, device 600 detected a tap gesture 1050q on the stop affordance 614. As shown in FIG. 10R, in response to detecting the tap gesture 1050q, device 600 stopped recording data representing video media. In FIG. 10R, device 600 detected a swipe gesture 1050r on the camera user interface.

[0278] As shown in FIG. 10S, in response to detecting the swipe gesture 1050r, device 600 displayed a control user interface 1038. As shown in FIG. 10S, the control user interface 1038 continues to display a camera recording status indicator 1044c, but device 600 is no longer recording a first type of data of the camera application. In FIG. 10S, device 600 updates the camera recording status indicator 1044c to indicate that the camera application has been recently used (e.g., “recently” in FIG. 10S), in contrast to the camera recording status indicator 1044c that is displayed without additional indication in FIG. 10O and / or with the additional indication (“currently in use”) in FIG. 10P. Further, in FIG. 10S, since device 600 is still recording a first type of data for the voice memo application (e.g., using one or more of the techniques described above and / or for similar reasons), device 600 continues to display a voice memo recording status indicator 1044b. In FIG. 10S, device 600 detected a rightward swipe gesture 1050s at the bottom of the control user interface 1038.

[0279] As shown in FIG. 10T, in response to detecting a rightward swipe gesture 1050s, device 600 displays an audio recording user interface that includes a stop affordance 1016. In FIG. 10S, device 600 detects a tap gesture 1050t on the stop affordance 1016. In some embodiments, in response to detecting the tap gesture 1050t, device 600 stops recording the first type of data of the voice memo application. In some embodiments, after stopping the recording of the first type of data of the voice memo application, device 600 stops displaying the recording status indicator 1042 because device 600 is no longer recording the first type of data.

[0280] As shown in FIG. 10U (e.g., during some period after displaying the audio recording user interface), device 600 displays a camera user interface. In FIG. 10U, device 600 is operating in the "photo" camera mode, which is indicated by the central photo camera mode affordance 620c and the bolded "photo".

[0281] As described above with respect to FIG. 6A, device 600 displays live preview 630 by recording data within the field of view (“FOV”) of one or more cameras of device 600. Thus, in FIG. 10U, device 600 uses one or more techniques as described above to determine that the data recorded by device 600 to display live preview 630 is of a first type of data (e.g., because the data recorded to display live preview 630 can be made available for later playback as shown by live preview 630). As shown in FIG. 10U, device 600 displays recording status indicator 1042 because it is determined that the data recorded by device 600 to display live preview 630 is of a first type of data. In some embodiments, device 600 does not display recording status indicator 1042 in FIG. 10U. In some embodiments, device 600 uses one or more techniques similar to those described above to make a different determination that the data recorded to display live preview 630 is not of a first type of data (e.g., because the recorded data is not available for playback at a later time), and thus does not display recording status indicator 1042. In FIG. 10U, device 600 detects tap gesture 1050u on shutter affordance 610.

[0282] As shown in FIG. 10V, in response to detecting tap gesture 1050u, device 600 records an image representing live preview 630 and updates media collection 612 to show the representation of the recorded image (e.g., see the difference between media collections 612 in FIGS. 10U and 10V). In FIG. 10V, device 600 detects upward swipe gesture 1050v on the camera user interface.

[0283] As shown in FIG. 10W, in response to detecting a swipe gesture 1050v, device 600 displays a user interface having icon 690. While displaying the user interface of FIG. 10W, device 600 is not simultaneously capturing a first type of data of the camera application, but device 600 continues to display recording status indicator 1042. In FIG. 10W, after device 600 records a first type of data of the camera application (e.g., data corresponding to the photo recorded in FIG. 10W), recording status indicator 1042 is displayed for at least a minimum period, so device 600 displays recording status indicator 1042. In other words, by recording data corresponding to the recorded photo, the camera is activated for less than a predetermined period (e.g., recording media in the camera), so device 600 displays recording status indicator 1042 after only the minimum period and / or after the camera stops recording the first type of data. This user recognizes that the application is recording the first type of data even when the application records the first type of data for a short period. As shown in FIG. 10W, recording status indicator 1042 is displayed near (or adjacent to) one of the cameras (e.g., 1008) of device 600. In FIG. 10W, device 600 detects a downward swipe gesture 1050w on the user interface having icon 690.

[0284] As shown in FIG. 10X, in response to detecting a swipe gesture 1050w, device 600 displays a control user interface 1338. As shown in FIG. 10X, the control user interface 1338 includes a camera recording status indicator 1044c indicating that the camera was recently used to record a first type of data. In FIG. 10X, after the control user interface 1338 is displayed within a predetermined period (e.g., 1 to 45 seconds) after recording a first type of data (e.g., a photo recorded in response to detecting a tap gesture 1050u) of the camera application, the control user interface 1338 includes the camera recording status indicator 1044c. Thus, in some embodiments, when the control user interface 1338 is not displayed within a predetermined period after finishing recording a first type of data of the camera application, the control user interface 1338 does not include the camera recording status indicator 1044c.

[0285] FIG. 10Y shows device 600 in a locked state, which is indicated by a lock icon 1078a. In FIG. 10Y, device 600 detects a scene (e.g., a scene including a user's face, a specific object) within the FOV corresponding to data for unlocking device 600 (e.g., via a camera having the FOV). As shown in FIG. 10Z, in response to detecting a scene within the FOV corresponding to data for unlocking device 600, device 600 changes from the locked state to an unlocked state indicated by an unlock icon 1078b.

[0286] In particular, in FIGS. 10Y-10Z, device 600 records data via the camera of device 600 (e.g., using a trusted application of a first party) to identify a part of a scene that enables device 600 to change to an unlocked state. However, in FIGS. 10Y-10Z, since it is determined that the data recorded by device 600 is not the first type of data, device 600 does not display the recording status indicator 1042. In FIGS. 10A-10B, since it is determined that the recorded data is data that cannot be used for later playback, device 600 does not record the first type of data. Specifically, the data recorded in FIGS. 10Y-10Z is not available for later playback because device 600 records the data to identify a part of the scene within the FOV that enables device 600 to change to an unlocked state.

[0287] FIGS. 10AA-10AC show a device 1000 that displays a user interface including a capture status indicator 1042. Device 1000 optionally includes one or more components of the above-described devices 100, 300, and 500.

[0288] As shown in FIG. 10AA, device 1000 displays a user interface including a status bar 1022. In FIG. 10AA, since device 1000 displays a user interface including status bar 1022, device 1000 displays a capture status indicator 1042 within status bar 1022 along with status indicators 1022a - 1022e. Capture status indicator 1042 is the leftmost of status indicators 1022a - 1022e. In some embodiments, when a status indicator is removed from status bar 1022, such as status bar indicator 1022c, the remaining status bar indicators move to the right to fill the space vacated by the removed status indicator, and capture status indicator 1042 maintains its position as the leftmost status indicator within the status bar. In some embodiments, when a status indicator is added to status bar 1022, capture status indicator 1042 moves to the left and maintains its position as the leftmost status indicator within status bar 1022.

[0289] FIG. 10AB shows device 1000 displaying a user interface without a status bar. In FIG. 10AA, since device 1000 is not displaying a status bar, device 1000 displays capture status indicator 1042 in the upper right of the user interface at a location different from where capture status indicator 1042 was displayed in FIG. 10AA (e.g., when status bar 1022 was displayed).

[0290] FIG. 10AC shows device 1000 displaying a user interface without a status bar when device 1000 is in a different orientation from the device 1000 of FIG. 10AB. As shown in FIG. 10AC, device 600 is in a different orientation in FIG. 10AC compared to device 1000 of FIG. 10AB, but device 1000 captures status indicator 1042 in the upper right of the user interface. Thus, looking at FIGS. 10AB - 10AC, when the status bar is not displayed, device 1000 displays the capture status indicator in the same position regardless of the orientation of device 600.

[0291] Figure 11 is a flow diagram showing a method for providing a status indicator using a computer system according to some embodiments. Method 1100 is executed in a computer system (e.g., 100, 300, 500, 600) having one or more media capture devices (e.g., one or more cameras (e.g., dual camera, triple camera, quad camera, etc.) on the same side or different sides of the computer system (e.g., front camera, rear camera), and / or one or more microphones, etc.), and communicates with a display generation component (e.g., display controller, touch-sensitive display system) and one or more input devices (e.g., touch-sensitive surface). Some operations of method 1100 are optionally combined, the order of some operations is optionally changed, and some operations are optionally omitted.

[0292] As described below, method 1100 provides an intuitive way to provide a status indicator to a user of the computer system. This method reduces the user's cognitive burden of determining the status of one or more media capture devices, thereby creating a more efficient human-machine interface. In the case of battery-operated computing devices, it saves power and increases the battery charging interval by enabling the user to manage one or more media capture devices faster and more efficiently.

[0293] A computer system (e.g., 600) (e.g., a smartphone, a smartwatch) receives an indication (1102) that a first media capture device has been activated (e.g., recently activated (e.g., activated within a predetermined time (e.g., 1 or 2 seconds) before receiving an instruction)). In some embodiments, the computer system receives an indication that the first media capture device has been activated by detecting that the first media capture device is active or has actively recorded data (e.g., data representing one or more different types of media (e.g., audio, video, images (e.g., still images))). In some embodiments, the computer system receives an indication that the first media capture device (e.g., a video camera) is (or is being used as) a camera or microphone for currently capturing or recording media by detecting one or more applications.

[0294] In response to receiving an indication that the first media capture device is activated (1104), and while it is activated, in accordance with a determination that the first media capture device has recorded first type of data (e.g., within a first predetermined period) (e.g., regardless of whether the media capture device has recorded a second type of data (e.g., without considering it, regardless thereof)) (1106), the computer system displays, via a display generation component, a graphical indicator (e.g., 1042, 1044a - 1044d) indicating the activation of the first media capture device (1108). In some embodiments, the first type of data is data that is recorded, stored, held, or made available (e.g., available to one or more applications that cause the media capture device to record data) as a media item to be played back at a later time. In some embodiments, the first type of data is data that is readably accessible (e.g., via one or more programs or applications on the system) so as to be selected and played back by a user via one or more user inputs on a touch - sensitive display of the computer system. In some embodiments, while it is activated, in accordance with a determination that the first media capture device has recorded first type of data (e.g., regardless of whether the media capture device has recorded a second type of data (e.g., without considering it, regardless thereof)), the computer system stops displaying a graphical indicator indicating that another media capture device is activated. In some embodiments, the computer system replaces a graphical indicator indicating that another media capture device is activated with a graphical indicator indicating the activation of the first media capture device, in accordance with a determination that the first media capture device has recorded first type of data while it is activated.In some embodiments, the first type of data is data that has not been acquired and / or processed to determine whether one or more trigger events (e.g., an audible phrase, presentation / non-presentation of the user's line of sight) have occurred. In some embodiments, the first type of data (e.g., the type of data for which a capture status indicator is displayed) corresponds to data that is passed to untrusted applications (e.g., a non-first-party voice assistant application, a non-first-party authentication application). In some embodiments, the recording status indicator is displayed regardless of whether the recording indicator is displayed by the application that records the data. By displaying a graphical indicator when a predetermined condition is met (e.g., when the media capture device records the first type of data (e.g., multimedia data)), the user is enabled to quickly recognize when a particular type of data is being recorded (or has been recorded), and the user is enabled to take a particular action based on whether the type of data is being recorded (or has been recorded). By performing an optimized operation when a set of conditions is met without requiring further user input, the operability of the system is enhanced, the user-system interface is made more efficient (e.g., by assisting the user to provide appropriate input when operating / interacting with the system and reducing user errors), and in addition, the power consumption of the system is reduced and the battery life is improved by enabling the user to use the system more quickly and efficiently. By displaying a graphical indicator when the media capture device records the first type of data (e.g., multimedia data), feedback is provided to the user regarding the first media capture device being active and recording the first type of data, thereby enabling the user to be alerted to the recording of the first type of data.By providing the user with improved visual feedback, the operability of the system is improved, (e.g., by assisting the user to provide appropriate input when operating / interacting with the system and reducing user errors), making the user-system interface more efficient, and in addition, by enabling the user to use the system more quickly and efficiently, reducing power consumption and improving the battery life of the system.

[0295] In some embodiments, the fi...

Claims

1. 1. A method comprising:

1. A computer system having one or more cameras, the computer system in communication with a display generating component and one or more input devices, comprising: Receiving a request to display a camera user interface; in response to receiving the request to display the camera user interface, displaying, via the display generation component, a camera user interface while the one or more cameras are configured to capture an image based on a first exposure compensation value; displaying, via the display generation component, a first representation of a field of view of the one or more cameras; displaying the camera user interface, comprising: displaying an exposure compensation indicator concurrently with the representation of the field of view of the one or more cameras in accordance with a determination that a set of exposure compensation criteria are satisfied, the exposure compensation criteria including criteria that are satisfied when an exposure compensation mode is enabled, the exposure compensation indicator comprising: a representation of the first exposure compensation value; and and a visual indication that the computer system has determined that clipping is predicted to occur in response to receiving a request to capture media corresponding to the representation of the field of view of the one or more cameras.

2. While displaying the exposure compensation indicator, In response to determining that the predicted clipping is a first type of clipping, the visual indication is displayed at a first location; 2. The method of claim 1, wherein pursuant to a determination that the predicted clipping is a second type of clipping that is different from the first type of clipping, the visual indication is displayed at a second location that is different from the first location.

3. the first type of clipping is clipping based on a value of a parameter of the media exceeding a range of values ​​of the parameter; the second type of clipping is based on a value of the parameter of the media falling below a range of values ​​of the parameter; The method of claim 2.

4. prior to a first time, the visual indication is displayed in a first visual appearance; The method further comprises: displaying the visual indication in a second visual appearance different from the first visual appearance at a first time while displaying the exposure compensation indicator and in accordance with a determination that the predicted clipping has changed.

4. The method according to any one of claims 1 to 3.

5. The method of claim 1 , wherein the visual indication is displayed via the display generation component at a location outside the first representation.

6. detecting a change in the field of view of the one or more cameras while displaying the exposure compensation indicator including the representation of the first exposure compensation value; and continuing to display the first exposure compensation value in response to detecting a change in the field of view of the one or more cameras.

6. The method according to any one of claims 1 to 5.

7. The method of claim 1 , wherein the one or more cameras are configured to capture images based on a cumulative exposure compensation value that is based on a sum of the first exposure compensation value and a compensation bias value.

8. and displaying an indication of the cumulative exposure compensation value concurrently with the exposure compensation indicator in response to a determination that the set of exposure compensation criteria is satisfied. The method of claim 7.

9. detecting one or more user inputs via the one or more input devices while displaying the exposure compensation indicator including the representation of the first exposure compensation value; in response to detecting the one or more gestures; changing a compensation bias value from a default compensation bias value to a new compensation bias value, the computer system being configured to capture an image based on a cumulative compensation based on a sum of the first exposure compensation value and the bias compensation value; and continuing to display the representation of the first exposure compensation value.

9. The method according to any one of claims 1 to 8.

10. displaying an exposure compensation indicator including the representation of the first exposure compensation value and detecting a change in the field of view of the one or more cameras while the compensation bias value is being changed to the new compensation value; in response to detecting a change in the field of view of the one or more cameras and in accordance with a determination that the change in the field of view of the one or more cameras is above a threshold; updating the compensation bias value to the default compensation bias value; and continuing to display the representation of the first exposure compensation value.

10. The method of claim 9.

11. setting the first exposure compensation value to a default compensation value in response to a determination that a set of reset criteria is satisfied, the reset criteria including a first criterion that is satisfied at the end of a media capture session and a second criterion that is satisfied when an exposure compensation save mode is not enabled; and refraining from setting the first exposure compensation value to the first compensation value in response to a determination that the set of reset criteria is not satisfied.

11. The method according to any one of claims 1 to 10.

12. The method of claim 1 , wherein the set of exposure compensation criteria comprises criteria that are met when an exposure compensation conservation mode is enabled.

13. and ceasing to display the exposure compensation indicator in response to a determination that the set of exposure compensation criteria is not satisfied.

13. The method according to any one of claims 1 to 12.

14. displaying an animation of the exposure compensation instruction transitioning from a first visual state to a second visual state different from the first visual state at a second time while displaying the exposure compensation indicator and in accordance with a determination that the predicted clipping has changed.

14. The method according to any one of claims 1 to 13.

15. receiving a selection of the exposure compensation indicator while displaying the exposure compensation indicator; and in response to receiving the selection of the exposure compensation indicator, displaying a control for adjusting the exposure compensation that, when selected, causes the exposure compensation indicator to be updated.

15. The method according to any one of claims 1 to 14.

16. and ceasing display of the visual indication while displaying the exposure compensation indicator and in response to receiving a request to capture media corresponding to the representation of the field of view of the one or more cameras in accordance with determining that clipping is not expected to occur.

16. The method according to any one of claims 1 to 15.

17. 17. A non-transitory computer-readable storage medium storing one or more programs configured to be executed by one or more processors of a computer system having one or more cameras, the computer system in communication with a display generating component and one or more input devices, the one or more programs including instructions for performing the method of any one of claims 1 to 16.

18. 1. A computer system comprising: one or more cameras, wherein the computer system is in communication with a display generating component and one or more input devices; one or more processors; 17. A computer system comprising: a memory storing one or more programs configured to be executed by the one or more processors, the one or more programs including instructions for performing the method of any one of claims 1 to 16.

19. 1. A computer system comprising: One or more cameras; A computer system comprising: means for executing the method according to any one of claims 1 to 16.

20. 1. A non-transitory computer-readable storage medium storing one or more programs configured to be executed by one or more processors of a computer system having one or more cameras, the computer system in communication with a display generating component and one or more input devices, the one or more programs comprising: receiving a request to display a camera user interface; in response to receiving a request to display the camera user interface, displaying, via the display generation component, a camera user interface while the one or more cameras are configured to capture an image based on a first exposure compensation value; displaying, via the display generation component, a first representation of a field of view of the one or more cameras; and displaying an exposure compensation indicator, concurrently with the representation of the field of view of the one or more cameras, in accordance with a determination that a set of exposure compensation criteria are satisfied, the criteria including criteria that are satisfied when an exposure compensation mode is enabled, wherein the exposure compensation indicator comprises: a representation of the first exposure compensation value; and and a visual indication that the computer system has determined that clipping is predicted to occur in response to receiving a request to capture media corresponding to the representation of the field of view of the one or more cameras.

21. 1. A computer system comprising: One or more cameras; one or more processors, the computer system in communication with a display generation component and one or more input devices; a memory storing one or more programs configured to be executed by the one or more processors; said one or more programs comprising: receiving a request to display a camera user interface; in response to receiving the request to display the camera user interface, displaying, via the display generation component, a camera user interface while the one or more cameras are configured to capture an image based on a first exposure compensation value; displaying, via the display generation component, a first representation of a field of view of the one or more cameras; and displaying an exposure compensation indicator, concurrently with the representation of the field of view of the one or more cameras, in accordance with a determination that a set of exposure compensation criteria are satisfied, the criteria including criteria that are satisfied when an exposure compensation mode is enabled, wherein the exposure compensation indicator comprises: a representation of the first exposure compensation value; and and a visual indication that the computer system has determined that clipping is predicted to occur in response to receiving a request to capture media corresponding to the representation of the field of view of the one or more cameras.

22. 1. A computer system comprising: means for receiving a request to display a camera user interface; means for displaying, via the display generation component, a camera user interface while the one or more cameras are configured to capture an image based on a first exposure compensation value, in response to receiving the request to display the camera user interface; means for displaying, via the display generation component, a first representation of a field of view of the one or more cameras; and means for displaying the camera user interface, the means comprising: means for displaying an exposure compensation indicator, concurrently with the representation of the field of view of the one or more cameras, pursuant to a determination that a set of exposure compensation criteria are satisfied, the criteria including criteria that are satisfied when an exposure compensation mode is enabled, the exposure compensation indicator comprising: a representation of the first exposure compensation value; and and a visual indication that the computer system has determined that clipping is predicted to occur in response to receiving a request to capture media corresponding to the representation of the field of view of the one or more cameras.

23. 1. A method comprising:

1. A computer system in communication with a display generation component and one or more input devices, comprising: displaying, via the display generation component, a media viewer user interface; a first portion including a representation of a first previously captured media item; displaying a media viewer user interface having a first visual appearance and including a second portion of the media viewer user interface that is different from the first portion; receiving, via the display generation component, a request to display a representation of a second previously captured media item different from the first previously captured media item while displaying the media viewer user interface including the second portion of the media viewer user interface having the first visual appearance; in response to receiving the request to display the representation of the second previously captured media item; upon determining that a first set of criteria is satisfied, the first set of criteria including criteria that are satisfied when the representation of the second previously captured media item is a high dynamic range (HDR) media item; displaying the representation of the second previously captured media item; and updating the second portion of the media viewer user interface to have a second visual appearance that is different from the first visual appearance.

24. updating the second portion of the media viewer user interface to have a second visual appearance different from the first visual appearance; displaying the second portion of the media viewer user interface with a first amount of visual characteristics in accordance with determining that the portion of the media item has a first brightness level; 24. The method of claim 23, further comprising: displaying the second portion of the media viewer user interface with a second amount of visual characteristics different from the first amount of visual characteristics in accordance with a determination that the portion of the media item has a second brightness level different from the first brightness level.

25. updating the second portion of the media viewer user interface to have a second visual appearance different from the first visual appearance; displaying the second portion of the media viewer user interface with a third amount of visual characteristics in accordance with determining that the media item has been displayed for a first amount of time; 25. The method of claim 23, further comprising: displaying the second portion of the media viewer user interface with a fourth amount of visual characteristics different from the third amount of visual characteristics in accordance with a determination that the media item has been displayed for a second amount of time different from the first amount of time.

26. 1. A method comprising: displaying the representation of the second previously captured media item includes replacing the representation of the first previously captured media item with the representation of the second previously captured media item; updating the second portion of the media viewer user interface to have a second visual appearance different from the first visual appearance; displaying the second portion of the media viewer user interface with a fifth amount of visual characteristics in accordance with a determination that the representation of the first previously captured media item was displayed for at least a first amount of time before being replaced with the representation of the second previously captured media item; 26. The method of claim 23, further comprising: displaying the second portion of the media viewer user interface with a sixth amount of visual characteristics different from the fifth amount of visual characteristics in accordance with a determination that the representation of the first previously captured media item content has been replaced with the representation of the second previously captured media for a second amount of time different from the first amount of time.

27. updating the second portion of the media viewer user interface to have a second visual appearance different from the first visual appearance; displaying the second portion of the media viewer user interface with a seventh amount of visual characteristics in response to a determination that an average rate of requests to view previously captured media items falls below a first threshold; 27. The method of claim 23, further comprising: displaying the second portion of the media viewer user interface with an eighth amount of visual characteristics different from the seventh amount of visual characteristics, the second number being different from the first number in accordance with a determination that an average rate of requests to display previously captured media items does not fall below the first threshold.

28. 1. A method comprising: receiving, via the display generation component, a request to display a representation of the first previously captured media item and a third previously captured media item distinct from the second previously captured media item while displaying the media viewer user interface including the second portion of the media viewer user interface having the first visual appearance; in response to receiving the request to display the representation of the third previously captured media item and in response to a determination that the first set of criteria are satisfied, the criteria including criteria that are satisfied when the representation of the third previously captured media item is an HDR media item; displaying the representation of the third previously captured media item; and 28. The method of claim 23, further comprising updating the second portion of the media viewer user interface to have a third visual appearance that is different from the first visual appearance and the second visual appearance.

29. 29. The method of any one of claims 23 to 28, wherein the second previously captured media item is a HDR media item and the representation of the second previously captured media item is displayed in HDR.

30. 30. A method according to any one of claims 23 to 29, wherein the first set of criteria includes criteria that are met when the second portion is of a first colour.

31. 31. The method of claim 23, wherein updating the second portion of the media viewer user interface to have the second visual appearance comprises displaying an animation that gradually transitions the second portion of the media viewer user interface from the first visual appearance to having the second visual appearance.

32. the representation of the previously captured media item includes content having a predetermined amount of luminance, the representation of the previously captured media item comprising: displayed at a modified amount of luminance in accordance with a determination that the amount of luminance exceeds a luminance threshold; 32. The method of claim 23, wherein the amount of luminance is displayed in accordance with a determination that the amount of luminance does not exceed the luminance threshold.

33. 1. A method comprising: the first previously captured media item is not the HDR media item; the second previously captured media item is the HDR media item; The method further comprises: prior to displaying, via the display generation component, the media viewer user interface including the first portion and the second portion, displaying, via the display generation component, a user interface including a plurality of representations of a media item; 33. The method of any one of claims 23 to 32, wherein the multiple representations of the media item include a second representation of the first previously captured media item that does not have HDR content and a second representation of the second previously captured media item that does not have HDR content.

34. 1. A method comprising: in response to receiving the request to display the representation of the second previously captured media item; 34. The method of claim 23, further comprising: refraining from updating the second portion of the media viewer user interface to have the second visual appearance different from the first visual appearance in accordance with a determination that the first set of criteria is not satisfied.

35. 1. A method comprising: while displaying the representation of the second previously captured media item, the second portion having the second visual appearance, receiving a request to display the representation of a fourth previously captured media item; in response to receiving a request to display the third previously captured media item; upon determining that the first set of criteria is satisfied, the first set of criteria including criteria that are satisfied when the representation of the fourth previously captured media item is an HDR media item; displaying the representation of the fourth previously captured media item without updating the visual appearance of the second portion; and updating the second portion of the media to have a visual appearance that is based on and different from the first visual appearance and the second visual appearance; upon determining that the first set of criteria is not satisfied, displaying the representation of the fourth previously captured media item; and 35. The method of any one of claims 23 to 34, further comprising updating the second portion of the media to have a predetermined visual appearance different from the second visual appearance.

36. 36. A non-transitory computer readable storage medium storing one or more programs configured to be executed by one or more processors of a computer system in communication with a display generating component and one or more input devices, the one or more programs including instructions for performing the method of any one of claims 23 to 35.

37. 1. A computer system comprising: one or more processors, the computer system in communication with a display generation component and one or more input devices; 36. A computer system comprising: a memory storing one or more programs configured to be executed by the one or more processors, the one or more programs including instructions for performing a method according to any one of claims 23 to 35.

38. 1. A computer system comprising: A computer system comprising means for carrying out the method of any one of claims 23 to 35.

39. 1. A non-transitory computer-readable storage medium storing one or more programs configured to be executed by one or more processors of a computer system, the computer system being in communication with a display generating component and one or more input devices, the one or more programs comprising: displaying, via the display generation component, a media viewer user interface; a first portion including a representation of a first previously captured media item; a second portion of the media viewer user interface having a first visual appearance and different from the first portion of the media viewer user interface; receiving, via the display generation component, a request to display a representation of a second previously captured media item different from the first previously captured media item while displaying the media viewer user interface including the second portion of the media viewer user interface having the first visual appearance; in response to receiving the request to display the representation of the second previously captured media item; upon determining that a first set of criteria is satisfied, the first set of criteria including criteria that are satisfied when the representation of the second previously captured media item is a high dynamic range (HDR) media item; displaying the representation of the second previously captured media item; A non-transitory computer-readable storage medium comprising instructions for updating the second portion of the media viewer user interface to have a second visual appearance that is different from the first visual appearance.

40. 1. A computer system comprising: one or more processors, the computer system in communication with a display generation component and one or more input devices; a memory storing one or more programs configured to be executed by the one or more processors; said one or more programs comprising: displaying, via the display generation component, a media viewer user interface; a first portion including a representation of a first previously captured media item; a second portion of the media viewer user interface having a first visual appearance and different from the first portion of the media viewer user interface; receiving, via the display generation component, a request to display a representation of a second previously captured media item different from the first previously captured media item while displaying the media viewer user interface including the second portion of the media viewer user interface having the first visual appearance; in response to receiving the request to display the representation of the second previously captured media item; upon determining that a first set of criteria is satisfied, the first set of criteria including criteria that are satisfied when the representation of the second previously captured media item is a high dynamic range (HDR) media item; displaying the representation of the second previously captured media item; A non-transitory computer-readable storage medium comprising instructions for updating the second portion of the media viewer user interface to have a second visual appearance that is different from the first visual appearance.

41. 1. A computer system comprising: means for displaying, via the display generation component, a media viewer user interface, the means comprising: a first portion including a representation of a first previously captured media item; means for displaying a media viewer user interface having a first visual appearance and a second portion of the media viewer user interface that is different from the first portion; means for receiving, via the display generation component, a request to display a representation of a second previously captured media item different from the first previously captured media item while displaying the media viewer user interface including the second portion of the media viewer user interface having the first visual appearance; in response to receiving the request to display the representation of the second previously captured media item; upon determining that a first set of criteria is satisfied, the first set of criteria including criteria that are satisfied when the representation of the second previously captured media item is a high dynamic range (HDR) media item; displaying the representation of the second previously captured media item; means for updating the second portion of the media viewer user interface to have a second visual appearance that is different from the first visual appearance.

42. 1. A method comprising:

1. A computer system having a first media capture device in communication with a display generation component and one or more input devices, comprising: receiving an indication that the first media capture device is activated; in response to receiving the indication that the first media capture device is activated; displaying, via the display generation component, a graphical indicator indicating activation of the first media capture device in accordance with a determination that the first media capture device recorded a first type of data while activated; ceasing to display the graphical indicator indicating activation of the first media capture device in accordance with a determination that, while activated, the first media capture device has recorded a second type of data without recording the first type of data.

43. 43. The method of claim 42, wherein the recorded data of the second type corresponds to data that is not available for playback.

44. 44. A method according to any one of claims 42 to 43, wherein the recorded data of the first type corresponds to data available for playback.

45. 45. The method of any one of claims 42 to 44, wherein the graphical indicator is displayed regardless of whether a status bar is displayed.

46. 46. ​​The method of any one of claims 42 to 45, wherein the graphical indicator is displayed adjacent to at least one media capture device.

47. 11. A method, comprising: pursuant to a determination that the status bar is not currently displayed, displaying the status bar in a first position; 47. The method of any one of claims 42 to 46, wherein, pursuant to a determination that the status bar is not currently displayed, the status bar is displayed at a second location that is different from the first location.

48. receiving a first input while displaying the graphical indicator; and in response to receiving the first input, displaying a user interface including a second graphical indicator indicating activation of the first media capture device.

48. The method of any one of claims 42 to 47.

49. 49. The method of claim 48, wherein the second graphical indicator comprises displayed content that is different from the displayed content of the graphical indicator.

50. 50. The method of claim 42, wherein the first media capture device is a first type of media capture device and the displayed content of the graphical indicator includes an indication of the first type of media capture device.

51. 51. The method of any one of claims 42 to 50, wherein the displayed content of the graphical indicator includes an indication of an application that is currently recording data via the first media capture device.

52. 52. The method of any one of claims 42 to 51, wherein the displayed content of the graphical indicator includes an indication of an application that previously recorded data via the first media capture device.

53. 1. A method comprising: the first media capture device is a second type of media capture device; The method further comprises:

53. The method of any one of claims 42 to 52, comprising displaying, concurrently with the graphical indicator, a third graphical indicator different from the graphical indicator, the graphical indicator including an indication of the second type of media capture device, and the third graphical indicator including an indication of a third type of media capture device different from the second type of media capture device.

54. 11. A method, comprising: selectable in response to a determination that the graphical indicator corresponds to an application of a first application type; 54. The method of claim 42, wherein the graphical indicator is not selectable pursuant to a determination that the graphical indicator does not correspond to an application of the first application type.

55. 1. A method comprising: receiving user input corresponding to a selection of the graphical indication while displaying the selectable graphical indications; 55. The method of claim 54, further comprising: in response to receiving the user input corresponding to the selection of the graphical indication, displaying a third user interface for managing one or more permissions of the application of the first application type.

56. 1. A method comprising: receiving a third user input; In response to receiving the third user input, displaying a user interface; displaying the graphical indication indicating activation of the first media capture device pursuant to a determination that the third user input is received while the first media capture device continues to be activated or within a predetermined time after the first media capture device was active; 56. The method of claim 42, further comprising: displaying the user interface that does not include displaying the graphical indicator indicating activation of the first media capture device pursuant to a determination that the third user input is not received while the first media capture device continues to be activated or within a predetermined time after the first media capture device is active.

57. 57. The method of any one of claims 42 to 56, wherein the graphical indicator is displayed for at least a minimum period of time.

58. 58. The method of any one of claims 42 to 57, wherein the graphical indicator is displayed for a length of time based on a length of time the first media capture device has been active.

59. 59. The method of any one of claims 42 to 58, wherein the display position of the graphical indicator does not change regardless of the application or function being executed or displayed.

60. 60. A non-transitory computer-readable storage medium storing one or more programs configured to be executed by one or more processors of a computer system having a first media capture device, the computer system in communication with a display generation component and one or more input devices, the one or more programs including instructions for performing the method of any one of claims 42 to 59.

61. 1. A computer system comprising: a first media capture device, the computer system being in communication with a display generation component and one or more input devices; one or more processors; 60. A computer system comprising: a memory storing one or more programs configured to be executed by the one or more processors, the one or more programs including instructions for performing a method according to any one of claims 42 to 59.

62. 1. A computer system comprising: a first media capture device; 60. A computer system comprising means for carrying out the method of any one of claims 42 to 59.

63. 1. A non-transitory computer-readable storage medium storing one or more programs configured to be executed by one or more processors of a computer system having a first media capture device, the computer system being in communication with a display generation component and one or more input devices, the one or more programs comprising: receiving an indication that the first media capture device is activated; in response to receiving the indication that the first media capture device is activated; displaying, via the display generation component, a graphical indicator indicating activation of the first media capture device in accordance with a determination that the first media capture device recorded a first type of data while activated; 12. A non-transitory computer-readable storage medium comprising: instructions for ceasing display of the graphical indicator indicating activation of the first media capture device pursuant to a determination that, while activated, the first media capture device has recorded a second type of data without recording the first type of data.

64. 1. A computer system comprising: a first media capture device, the computer system being in communication with a display generation component and one or more input devices; one or more processors; a memory storing one or more programs configured to be executed by the one or more processors; said one or more programs comprising: receiving an indication that the first media capture device is activated; in response to receiving the indication that the first media capture device is activated; displaying, via the display generation component, a graphical indicator indicating activation of the first media capture device in accordance with a determination that the first media capture device recorded a first type of data while activated; 11. A computer system comprising: instructions for ceasing display of the graphical indicator indicating activation of the first media capture device pursuant to a determination that, while activated, the first media capture device has recorded a second type of data without recording the first type of data.

65. 1. A computer system comprising: a first media capture device; means for receiving an indication that the first media capture device is activated; in response to receiving the indication that the first media capture device is activated; displaying, via the display generation component, a graphical indicator indicating activation of the first media capture device in accordance with a determination that the first media capture device recorded a first type of data while activated; means for ceasing to display the graphical indicator indicating activation of the first media capture device in accordance with a determination that, while activated, the first media capture device has recorded a second type of data without recording the first type of data.

Citation Information

Patent Citations

  • Capturing multimedia and sending it as an electronic message

    JP2017521737A

  • Mobile terminal and controlling method thereof

    US20150207924A1

  • Capturing and sending multimedia as electronic messages

    US20150312185A1

  • Device, Method, and Graphical User Interface for Handling Data Encoded in Machine-Readable Format

    US20180349659A1

  • Privacy mode for a wireless audio device

    WO2019118933A1