User Interface for Changing Visual Media

Abstract

This disclosure generally relates to user interfaces for modifying visual media. In some embodiments, a user interface captures visual media (e.g., via a synthetic depth of field effect), plays visual media (e.g., via a synthetic depth of field effect), edits visual media (e.g., with a synthetic depth of field effect applied), and / or manages media capture.

Description

[Technical field]

[0001] (CROSS REFERENCE TO RELATED APPLICATIONS) This application is a continuation of U.S. patent application Ser. No. 17 / 484,321, entitled "USER INTERFACES FOR ALTERING VISUAL MEDIA", filed September 24, 2021, U.S. patent application Ser. No. 17 / 484,307, entitled "USER INTERFACES FOR ALTERING VISUAL MEDIA", filed September 24, 2021, U.S. patent application Ser. No. 17 / 484,279, entitled "USER INTERFACES FOR ALTERING VISUAL MEDIA", filed September 24, 2021, U.S. patent application Ser. No. 17 / 483,684, entitled "USER INTERFACES FOR ALTERING VISUAL MEDIA", filed September 23, 2021, and U.S. patent application Ser. No. 17 / 483,684, entitled "USER INTERFACES FOR ALTERING VISUAL MEDIA", filed September 14, 2021. This application claims priority to U.S. Provisional Patent Application No. 63 / 244,213 entitled "USER INTERFACES FOR ALTERING VISUAL MEDIA," filed September 13, 2021, U.S. Provisional Patent Application No. 63 / 243,724 entitled "USER INTERFACES FOR ALTERING VISUAL MEDIA," filed June 6, 2021, U.S. Provisional Patent Application No. 63 / 197,460 entitled "USER INTERFACES FOR ALTERING VISUAL MEDIA," filed April 30, 2021, and U.S. Provisional Patent Application No. 63 / 182,751 entitled "USER INTERFACES FOR ALTERING VISUAL MEDIA," filed April 30, 2021. The contents of each of these applications are incorporated herein by reference in their entirety.

[0002] FIELD OF THE DISCLOSURE This disclosure relates generally to computer user interfaces and related technologies, and more particularly to user interfaces and techniques for modifying visual media. [Background technology]

[0003] Users of smartphones and other personal electronic devices are increasingly capturing, storing, and editing media to keep memories safe and share with friends. Several existing technologies allow users to capture media, such as images, audio, and / or video. Users can manage such media, for example, by capturing, storing, and editing the media. Summary of the Invention

[0004] Some techniques for modifying visual information using computer systems and other electronic devices are generally cumbersome and inefficient. For example, some existing techniques use complex and time-consuming user interfaces that may involve multiple key presses or strokes. Existing techniques take more time than necessary, wasting the user's time and the device's energy. This latter consideration is particularly important in battery-operated devices.

[0005] The present technology thus provides electronic devices with faster and more efficient methods and interfaces for modifying visual content, including applying synthetic depth-of-field effects to visual content to highlight portions of media. Such methods and interfaces optionally complement or replace other methods for modifying visual content. Such methods and interfaces reduce the cognitive burden on users and create a more efficient human-machine interface. For battery-operated computing devices, such methods and interfaces conserve power and increase the time between battery charges.

[0006] According to some embodiments, a method is described that is executed in a computer system in communication with one or more cameras and one or more input devices, the method including: detecting, via the one or more input devices, a request to capture a video representative of a field of view of the one or more cameras; and, in response to detecting the request to capture the video, capturing a video over a first capture duration, the video including a plurality of frames captured over the first capture duration that represent a first object in a field of view of the one or more cameras and a second object in a field of view of the one or more cameras, where in the plurality of frames the first object is moving relative to the field of view of the one or more cameras over the first capture duration; and applying a synthetic depth of field effect to the plurality of frames of the video that modifies visual information captured by the one or more cameras to emphasize the first object in the plurality of frames of the video relative to the second object in the plurality of frames of the video, the synthetic depth of field effect changing over time as the first object moves within the field of view of the one or more cameras.

[0007] According to some embodiments, a non-transitory computer readable storage medium is described, the non-transitory computer readable storage medium including one or more programs configured to be executed by one or more processors of a computer system in communication with one or more cameras and one or more input devices, detecting a request via the one or more input devices to capture a video representative of a field of view of the one or more cameras, and in response to detecting the request to capture the video, capturing a video over a first capture duration, the video including a plurality of frames captured over the first capture duration representing a first subject within the field of view of the one or more cameras and a second subject within the field of view of the one or more cameras, where in the plurality of frames the first subject is moving relative to the field of view of the one or more cameras over the first capture duration, and applying a synthetic depth of field effect to the plurality of frames of the video that modifies visual information captured by the one or more cameras to emphasize the first subject in the plurality of frames of the video relative to the second subject in the plurality of frames of the video, the synthetic depth of field effect changing over time as the first subject moves within the field of view of the one or more cameras.

[0008] According to some embodiments, a temporary computer readable storage medium is described, the temporary computer readable storage medium including one or more programs configured to be executed by one or more processors in communication with one or more cameras and one or more input devices, detecting a request via the one or more input devices to capture a video representative of a field of view of the one or more cameras, and in response to detecting the request to capture the video, capturing a video over a first capture duration, the video including a plurality of frames captured over the first capture duration representing a first subject in the field of view of the one or more cameras and a second subject in the field of view of the one or more cameras, where in the plurality of frames the first subject is moving relative to the field of view of the one or more cameras over the first capture duration, and applying a synthetic depth of field effect to the plurality of frames of the video that modifies visual information captured by the one or more cameras to emphasize the first subject in the plurality of frames of the video relative to the second subject in the plurality of frames of the video, the synthetic depth of field effect changing over time as the first subject moves within the field of view of the one or more cameras.

[0009] According to some embodiments, a computer system is described. The computer system is configured to communicate with one or more cameras and one or more input devices. The computer system includes one or more processors and one or more programs configured to be executed by the one or more processors to detect a request to capture a video representative of a field of view of the one or more cameras via the one or more input devices, and in response to detecting the request to capture the video, capture a video over a first capture duration, the video including a plurality of frames captured over the first capture duration representing a first object in the field of view of the one or more cameras and a second object in the field of view of the one or more cameras, where in the plurality of frames the first object is moving relative to the field of view of the one or more cameras over the first capture duration, and apply a synthetic depth of field effect to the plurality of frames of the video that modifies visual information captured by the one or more cameras to emphasize the first object in the plurality of frames of the video relative to the second object in the plurality of frames of the video, the synthetic depth of field effect changing over time as the first object moves within the field of view of the one or more cameras.

[0010] According to some embodiments, a computer system is described. The computer system is configured to communicate with one or more cameras and one or more input devices. The computer system includes: means for detecting, via the one or more input devices, a request to capture a video representative of a field of view of the one or more cameras; and means for capturing, in response to detecting the request to capture the video, a video over a first capture duration, the video including a plurality of frames captured over the first capture duration representing a first object in the field of view of the one or more cameras and a second object in the field of view of the one or more cameras, where in the plurality of frames the first object is moving relative to the field of view of the one or more cameras over the first capture duration; and means for applying to the plurality of frames of the video a synthetic depth of field effect that modifies visual information captured by the one or more cameras to emphasize the first object in the plurality of frames of the video relative to the second object in the plurality of frames of the video, the synthetic depth of field effect changing over time as the first object moves within the field of view of the one or more cameras.

[0011] According to some embodiments, a computer program product is described that includes one or more programs configured to be executed by one or more processors of a computer system in communication with one or more cameras and one or more input devices, detecting a request via the one or more input devices to capture a video representative of a field of view of the one or more cameras, and in response to detecting the request to capture the video, capturing a video over a first capture duration, the video including a plurality of frames captured over the first capture duration representing a first object in the field of view of the one or more cameras and a second object in the field of view of the one or more cameras, where in the plurality of frames the first object is moving relative to the field of view of the one or more cameras over the first capture duration, and applying a synthetic depth of field effect to the plurality of frames of the video that modifies visual information captured by the one or more cameras to emphasize the first object in the plurality of frames of the video relative to the second object in the plurality of frames of the video, the synthetic depth of field effect changing over time as the first object moves within the field of view of the one or more cameras.

[0012] According to some embodiments, a method is described that is implemented in a computer system in communication with one or more cameras, a display generating component, and one or more input devices. The method includes displaying, via a display generation component, a user interface including a representation of a video including a plurality of frames, the representation including a first subject and a second subject, and a first user interface object indicating that the first subject has been enhanced with a synthetic depth of field effect that modifies visual information captured by the one or more cameras to emphasize the first subject in the plurality of frames relative to the second subject; detecting, while displaying the user interface including the representation of the video and the first user interface object, a gesture corresponding to a selection of the second subject in the representation of the video, via one or more input devices; in response to detecting the gesture corresponding to the selection of the second subject in the representation of the video, modifying the visual information captured by the one or more cameras to modify the synthetic depth of field effect to emphasize the second subject in the plurality of frames relative to the first subject; and displaying a second user interface object indicating that the second subject has been enhanced with a modified synthetic depth of field effect that modifies the visual information captured by the one or more cameras to emphasize the second subject in the plurality of frames relative to the first subject.

[0013] According to some embodiments, a non-transitory computer readable storage medium is described that includes one or more programs configured to be executed by one or more processors of a computer system in communication with one or more cameras, a display generation component, and one or more input devices to display, via the display generation component, a user interface including a representation of a video including a plurality of frames, the representation including a first subject and a second subject, and a first user interface object indicating that the first subject is enhanced by a synthetic depth of field effect that modifies visual information captured by the one or more cameras to enhance the first subject in the plurality of frames relative to the second subject, and a user interface including the representation of the video and the first user interface object. The method includes detecting, while displaying the user interface, a gesture via the one or more input devices corresponding to a selection of a second subject in the representation of the video; and in response to detecting the gesture corresponding to the selection of the second subject in the representation of the video, modifying the visual information captured by the one or more cameras to modify the synthetic depth of field effect to emphasize the second subject in the multiple frames relative to the first subject; and displaying a second user interface object indicating that the second subject is emphasized by the modified synthetic depth of field effect that modifies the visual information captured by the one or more cameras to emphasize the second subject in the multiple frames relative to the first subject.

[0014] According to some embodiments, a temporary computer-readable storage medium is described that includes one or more programs configured to be executed by one or more processors of a computer system in communication with one or more cameras, a display generation component, and one or more input devices to display, via the display generation component, a user interface including a representation of a video including a plurality of frames, the representation including a first subject and a second subject, and a first user interface object indicating that the first subject is enhanced by a synthetic depth of field effect that modifies visual information captured by the one or more cameras to enhance the first subject in the plurality of frames relative to the second subject; detecting, via the one or more input devices, a gesture corresponding to a selection of a second subject in the representation of the video while displaying the user interface; in response to detecting the gesture corresponding to the selection of the second subject in the representation of the video, modifying the visual information captured by the one or more cameras to modify the synthetic depth of field effect to emphasize the second subject in the plurality of frames relative to the first subject; and displaying a second user interface object indicating that the second subject is emphasized by the modified synthetic depth of field effect that modifies the visual information captured by the one or more cameras to emphasize the second subject in the plurality of frames relative to the first subject.

[0015] According to some embodiments, a computer system is described that is configured to communicate with one or more cameras, a display generating component, and one or more input devices. The computer system includes one or more processors and one or more programs configured to be executed by the one or more processors to: display, via a display generation component, a user interface including a representation of a video including a plurality of frames, the representation including a first subject and a second subject, and a first user interface object indicating that the first subject has been enhanced by a synthetic depth of field effect that modifies visual information captured by the one or more cameras to emphasize the first subject in the plurality of frames relative to the second subject; detecting, while displaying the user interface including the representation of the video and the first user interface object, a gesture corresponding to a selection of the second subject in the representation of the video, via one or more input devices; in response to detecting the gesture corresponding to the selection of the second subject in the representation of the video, modifying the visual information captured by the one or more cameras with a modified synthetic depth of field effect to emphasize the second subject in the plurality of frames relative to the first subject; and displaying a second user interface object indicating that the second subject has been enhanced by a modified synthetic depth of field effect that modifies the visual information captured by the one or more cameras to emphasize the second subject in the plurality of frames relative to the first subject.

[0016] According to some embodiments, a computer system is described that is configured to communicate with one or more cameras, a display generating component, and one or more input devices. The computer system comprises: means for displaying, via a display generation component, a user interface including a representation of a video including a plurality of frames, the representation including a first subject and a second subject, and a first user interface object indicating that the first subject has been enhanced by a synthetic depth of field effect that modifies visual information captured by one or more cameras to emphasize the first subject in the plurality of frames relative to the second subject; means for detecting, via one or more input devices, a gesture corresponding to a selection of the second subject in the representation of the video while displaying the user interface including the representation of the video and the first user interface object; and means for, in response to detecting the gesture corresponding to the selection of the second subject in the representation of the video, modifying the visual information captured by the one or more cameras to modify the synthetic depth of field effect to emphasize the second subject in the plurality of frames relative to the first subject, and displaying a second user interface object indicating that the second subject has been enhanced by a modified synthetic depth of field effect that modifies the visual information captured by the one or more cameras to emphasize the second subject in the plurality of frames relative to the first subject.

[0017] According to some embodiments, a computer program product is described that includes one or more cameras, a display generation component, one or more input devices, one or more processors, and one or more programs configured to be executed by the one or more processors to display, via the display generation component, a user interface including a representation of a video including a plurality of frames, the representation including a first subject and a second subject, and a first user interface object indicating that the first subject is enhanced by a synthetic depth of field effect that modifies visual information captured by the one or more cameras to enhance the first subject in the plurality of frames relative to the second subject; While displaying the interface, detecting, via the one or more input devices, a gesture corresponding to a selection of a second subject in the representation of the video; in response to detecting the gesture corresponding to the selection of the second subject in the representation of the video, modifying the visual information captured by the one or more cameras by modifying the synthetic depth of field effect to emphasize the second subject in the multiple frames relative to the first subject; and displaying a second user interface object indicating that the second subject is emphasized by the modified synthetic depth of field effect that modifies the visual information captured by the one or more cameras to emphasize the second subject in the multiple frames relative to the first subject.

[0018] According to some embodiments, a method is described that is executed in a computer system in communication with a display generation component, the method including displaying, via the display generation component, a user interface that includes simultaneously displaying a representation of the video having a first duration, the plurality of modifications of object emphasis in the video, the modifications of object emphasis in the video including modifications of an appearance of visual information captured by one or more cameras to emphasize a subject relative to one or more elements in the video, the plurality of modifications including automatic modifications of object emphasis at a first time during the first duration and user-specified modifications of object emphasis at a second time during the first duration different from the first time, and a video navigation user interface element for navigating through the video, the video including the representation at the first time and the representation at the second time, the representation at the second time being visually distinct from other times during the first duration of the video that do not correspond to the modifications of object emphasis and the representation at the first time being visually distinct from the representation at the second time.

[0019] According to some embodiments, a non-transitory computer-readable storage medium is described. The non-transitory computer-readable storage medium stores one or more programs configured to be executed by one or more processors of a computer system in communication with a display generation component, the one or more programs including instructions for displaying, via the display generation component, a user interface including simultaneously displaying a representation of a video having a first duration, the plurality of modifications of object emphasis in the video, the modifications of the object emphasis in the video including a modification of an appearance of visual information captured by one or more cameras to emphasize a subject relative to one or more elements in the video, the plurality of modifications including an automatic modification of object emphasis at a first time during the first duration and a user-specified modification of object emphasis at a second time during the first duration different from the first time, and a video navigation user interface element for navigating through the video, the video including the representation at the first time and the representation at the second time, the representation at the second time being visually distinct from other times during the first duration of the video that do not correspond to the modifications of object emphasis, and the representation at the first time being visually distinct from the representation at the second time.

[0020] According to some embodiments, a temporary computer-readable storage medium is described. The temporary computer-readable storage medium stores one or more programs configured to be executed by one or more processors of a computer system in communication with a display generation component, the one or more programs including instructions for displaying, via the display generation component, a user interface including simultaneously displaying a representation of a video having a first duration, the plurality of modifications of object emphasis in the video, the modifications of object emphasis in the video including modifications of an appearance of visual information captured by one or more cameras to emphasize a subject relative to one or more elements in the video, the plurality of modifications including automatic modifications of object emphasis at a first time during the first duration and user-specified modifications of object emphasis at a second time during the first duration different from the first time, and a video navigation user interface element for navigating through the video, the video including the representation at the first time and the representation at the second time, the representation at the second time being visually distinct from other times during the first duration of the video that do not correspond to the modifications of object emphasis, and the representation at the first time being visually distinct from the representation at the second time.

[0021] According to some embodiments, a computer system is described. The computer system is configured to communicate with one or more cameras, a display generation component. The computer system includes one or more processors, and a memory storing one or more programs including instructions for displaying, via the display generation component, a user interface including simultaneously displaying a representation of the video having a first duration, a plurality of modifications of object emphasis in the video, the modifications of the object emphasis in the video including a modification of an appearance of visual information captured by the one or more cameras to emphasize a subject relative to one or more elements in the video, the plurality of modifications including an automatic modification of object emphasis at a first time during the first duration and a user-specified modification of object emphasis at a second time during the first duration different from the first time, and a video navigation user interface element for navigating through the video, the video including the representation at the first time and the representation at the second time, the representation at the second time being visually distinct from other times during the first duration of the video that do not correspond to the modification of object emphasis, and the representation at the first time being visually distinct from the representation at the second time.

[0022] According to some embodiments, a computer system is described. The computer system is configured to communicate with one or more cameras, a display generation component. The computer system includes means for displaying, via the display generation component, a user interface including simultaneously displaying a representation of the video having a first duration, a plurality of modifications of object emphasis in the video, the modifications of object emphasis in the video including modifications of the appearance of visual information captured by the one or more cameras to emphasize a subject relative to one or more elements in the video, the plurality of modifications including automatic modifications of object emphasis at a first time during the first duration and user-specified modifications of object emphasis at a second time during the first duration different from the first time, and a video navigation user interface element for navigating through the video, the representation of the video including the first time and the representation of the second time, the representation of the video including the second time being visually distinct from other times during the first duration of the video that do not correspond to the modifications of object emphasis, and the representation of the first time being visually distinct from the representation of the second time.

[0023] According to some embodiments, a computer program product is described that includes a display generation component, one or more processors, and a memory storing one or more programs including instructions for displaying, via the display generation component, a user interface including simultaneously displaying a representation of a video having a first duration, a plurality of modifications of object emphasis in the video, where the modifications of object emphasis in the video include modifications of an appearance of visual information captured by one or more cameras to emphasize a subject relative to one or more elements in the video, the plurality of modifications including automatic modifications of object emphasis at a first time during the first duration and user-specified modifications of object emphasis at a second time during the first duration different from the first time, and a video navigation user interface element for navigating through the video, the representation at the first time and the representation at the second time, where the representation at the second time is visually distinct from other times during the first duration of the video that do not correspond to the modifications of object emphasis, and the representation at the first time is visually distinct from the representation at the second time.

[0024] According to some embodiments, a method is described that is executed in a computer system in communication with a display generation component and a plurality of cameras, the computer system including a first camera having a first image capture parameter determined by hardware of the first camera, and a second camera having a second image capture parameter determined by hardware of the second camera, the second image capture parameter being different from the first image capture parameter. The method includes displaying, via the display generation component, a camera user interface including a representation of a field of view of one or more of the plurality of cameras, the representation of the field of view being displayed using visual information collected by the first camera along with the first image capture parameter, detecting a decrease in distance between a camera location corresponding to at least one of the plurality of cameras and a focal location corresponding to the focal point while displaying the representation of the field of view using the visual information collected by the first camera, and transitioning from using the visual information collected by the first camera to display the representation of the field of view in accordance with a determination that the decreased distance between the camera location and the focal location is closer than a predetermined threshold distance to using the visual information collected by the second camera to display the representation of the field of view.

[0025] According to some embodiments, a non-transitory computer-readable storage medium is described. The non-transitory computer readable storage medium includes one or more programs configured to be executed by one or more processors of a computer system in communication with a display generation component and a plurality of cameras including a first camera having first image capture parameters determined by hardware of the first camera and a second camera having second image capture parameters determined by hardware of the second camera, the second image capture parameters being different from the first image capture parameters, the computer system including: displaying, via the display generation component, a camera user interface including a representation of a field of view of one or more cameras of the plurality of cameras, the representation of the field of view being displayed using visual information collected by the first camera having the first image capture parameters; detecting, while displaying the representation of the field of view using the visual information collected by the first camera, a decrease in distance between a camera location corresponding to at least one of the plurality of cameras and a focal location corresponding to the focal point; and, in response to detecting the decrease in distance between the camera location and the focal location, transitioning from using the visual information collected by the first camera to display the representation of the field of view to using the visual information collected by the second camera to display the representation of the field of view in accordance with a determination that the decreased distance between the camera location and the focal location is closer than a predetermined threshold distance.

[0026] According to some embodiments, a transitory computer-readable storage medium is described. The temporary computer readable storage medium includes one or more programs configured to be executed by one or more processors of a computer system in communication with a display generation component and a plurality of cameras including a first camera having first image capture parameters determined by hardware of the first camera and a second camera having second image capture parameters determined by hardware of the second camera, the second image capture parameters being different from the first image capture parameters, the computer system including: displaying, via the display generation component, a camera user interface including a representation of a field of view of one or more cameras of the plurality of cameras, the representation of the field of view being displayed using visual information collected by the first camera having the first image capture parameters; detecting, while displaying the representation of the field of view using the visual information collected by the first camera, a decrease in distance between a camera location corresponding to at least one of the plurality of cameras and a focal location corresponding to the focal point; and in response to detecting the decrease in distance between the camera location and the focal location, transitioning from using the visual information collected by the first camera to display the representation of the field of view to using the visual information collected by the second camera to display the representation of the field of view in accordance with a determination that the decreased distance between the camera location and the focal location is closer than a predetermined threshold distance.

[0027] According to some embodiments, a computer system is described that is configured to communicate with a display generating component and a plurality of cameras including a first camera having first image capture parameters determined by hardware of the first camera and a second camera having second image capture parameters determined by hardware of the second camera, the second image capture parameters being different from the first image capture parameters. The computer system includes one or more processors and one or more programs configured to be executed by the one or more processors, via a display generation component, displaying a camera user interface including a representation of a field of view of one or more of the multiple cameras, the representation of the field of view being displayed using visual information collected by the first camera along with first image capture parameters; detecting a decrease in distance between a camera location corresponding to at least one of the multiple cameras and a focal location corresponding to the focal point while displaying the representation of the field of view using the visual information collected by the first camera; and in response to detecting a decrease in distance between the camera location and the focal location, transitioning from using the visual information collected by the first camera to display the representation of the field of view to using visual information collected by the second camera to display the representation of the field of view in accordance with a determination that the reduced distance between the camera location and the focal location is closer than a predetermined threshold distance.

[0028] According to some embodiments, a computer system is described. The computer system is configured to communicate with a display generating component and a plurality of cameras including a first camera having a first image capture parameter determined by the hardware of the first camera and a second camera having a second image capture parameter determined by the hardware of the second camera, the second image capture parameter being different from the first image capture parameter. The computer system comprises: means for displaying, via the display generating component, a camera user interface including a representation of a field of view of one or more of the plurality of cameras, the representation of the field of view being displayed using visual information collected by the first camera along with the first image capture parameter; means for detecting, while displaying the representation of the field of view using the visual information collected by the first camera, a decrease in distance between a camera location corresponding to at least one of the plurality of cameras and a focal location corresponding to the focal point; and means for transitioning from using the visual information collected by the first camera to display the representation of the field of view to using the visual information collected by the second camera to display the representation of the field of view in response to detecting the decrease in distance between the camera location and the focal location in accordance with a determination that the decreased distance between the camera location and the focal location is closer than a predetermined threshold distance.

[0029] According to some embodiments, a computer program product is described, the computer program product comprising one or more programs configured to be executed by one or more processors of a computer system in communication with a display generation component and a plurality of cameras including a first camera having first image capture parameters determined by hardware of the first camera and a second camera having second image capture parameters determined by hardware of the second camera, the second image capture parameters being different than the first image capture parameters. The one or more programs include displaying, via a display generation component, a camera user interface including a representation of a field of view of one or more of the multiple cameras, the representation of the field of view being displayed using visual information collected by the first camera along with first image capture parameters; detecting a decrease in distance between a camera location corresponding to at least one of the multiple cameras and a focal location corresponding to the focal point while displaying the representation of the field of view using the visual information collected by the first camera; and in response to detecting a decrease in distance between the camera location and the focal location, transitioning from using the visual information collected by the first camera to display the representation of the field of view to using visual information collected by the second camera to display the representation of the field of view in accordance with a determination that the reduced distance between the camera location and the focal location is closer than a predetermined threshold distance.

[0030] According to some embodiments, a method is described that is executed in a computer system in communication with a display generation component, the method including: playing, via the display generation component, a portion of a video including a first object emphasis change occurring at a first time, the first object emphasis change including a change in appearance of visual information captured by one or more cameras to emphasize an individual object for one or more elements in the video during a first time period following the first time; detecting, after playing the portion of the video including the first object emphasis change occurring at the first time, a request to change the object emphasis to a second time in the video that is different from the first time; and, in response to detecting the request to change the object emphasis to the second time in the video, changing the object emphasis in the video during a second time period following the second time; and modifying the first object emphasis change occurring at the first time including changing the emphasis of the individual object for one or more elements in the video during a first time period following the first time.

[0031] According to some embodiments, a non-transitory computer readable storage medium is described, the non-transitory computer readable storage medium including one or more programs configured to be executed by one or more processors of a computer system in communication with a display generation component, the non-transitory computer readable storage medium including: playing, via the display generation component, a portion of a video including a first object emphasis change occurring at a first time, the first object emphasis change including changing an appearance of visual information captured by one or more cameras to emphasize an individual object for one or more elements in the video during a first period following the first time; detecting, after playing the portion of the video including the first object emphasis change occurring at the first time, a request to change the object emphasis to a second time in the video different from the first time; in response to detecting the request to change the object emphasis to the second time in the video, changing the object emphasis in the video during a second period following the second time; and modifying the first object emphasis change occurring at the first time including changing the emphasis of the individual object for one or more elements in the video during a first period following the first time.

[0032] According to some embodiments, a temporary computer readable storage medium is described, the temporary computer readable storage medium including one or more programs configured to be executed by one or more processors of a computer system in communication with a display generation component, the one or more programs including: playing, via the display generation component, a portion of a video including a first object emphasis change occurring at a first time, the first object emphasis change including changing an appearance of visual information captured by one or more cameras to emphasize an individual object for one or more elements in the video during a first period following the first time; detecting, after playing the portion of the video including the first object emphasis change occurring at the first time, a request to change the object emphasis to a second time in the video different from the first time; in response to detecting the request to change the object emphasis to the second time in the video, changing the object emphasis in the video during a second period following the second time; and modifying the first object emphasis change occurring at the first time including changing the emphasis of the individual object for one or more elements in the video during a first period following the first time.

[0033] According to some embodiments, a computer system configured to communicate with a display generation component is described, the computer system including one or more processors and one or more programs configured to be executed by the one or more processors to, via the display generation component, play a portion of a video including a first object emphasis change occurring at a first time, the first object emphasis change including changing an appearance of visual information captured by one or more cameras to emphasize an individual object for one or more elements in the video during a first period following the first time, detect a request to change the object emphasis to a second time in the video different from the first time after playing the portion of the video including the first object emphasis change occurring at the first time, change the object emphasis in the video during a second period following the second time in response to detecting the request to change the object emphasis to the second time in the video, and change the first object emphasis change occurring at the first time including changing the emphasis of the individual object for one or more elements in the video during a first period following the first time.

[0034] According to some embodiments, a computer system configured to communicate with a display generation component and one or more input devices is described, the computer system comprising: means for playing, via the display generation component, a portion of a video including a first object emphasis change occurring at a first time, the first object emphasis change including a change in appearance of visual information captured by one or more cameras to emphasize an individual object for one or more elements in the video during a first period following the first time; means for detecting, after playing the portion of the video including the first object emphasis change occurring at the first time, a request to change the object emphasis to a second time in the video different from the first time; and means for modifying the first object emphasis change occurring at the first time, in response to detecting the request to change the object emphasis to the second time in the video, modifying the object emphasis in the video during a second period following the second time, the first object emphasis change including modifying the individual object emphasis for one or more elements in the video during a first period following the first time.

[0035] According to some embodiments, a computer program product is described. The computer program product comprises one or more programs configured to be executed by one or more processors of a computer system in communication with a display generation component. The one or more programs include playing, via the display generation component, a portion of a video including a first object emphasis change occurring at a first time, the first object emphasis change including a change in appearance of visual information captured by one or more cameras to emphasize an individual object for one or more elements in the video during a first period following the first time, detecting a request to change the object emphasis to a second time in the video different from the first time after playing the portion of the video including the first object emphasis change occurring at the first time, and in response to detecting the request to change the object emphasis to the second time in the video, changing the object emphasis in the video during a second period following the second time, and modifying the first object emphasis change occurring at the first time including changing the emphasis of the individual object for one or more elements in the video during a first period following the first time.

[0036] Executable instructions to perform these functions are optionally contained in a non-transitory computer-readable storage medium or other computer program product configured for execution by one or more processors. Executable instructions to perform these functions are optionally contained in a transitory computer-readable storage medium or other computer program product configured for execution by one or more processors.

[0037] Thus, devices are provided with faster, more efficient methods and interfaces for modifying visual content, thereby increasing the effectiveness, efficiency, and user satisfaction of such devices. Such methods and interfaces may complement or replace other methods for modifying visual content. [Brief description of the drawings]

[0038] For a better understanding of the various described embodiments, reference should be made to the following Detailed Description in conjunction with the following drawings, in which like reference numerals refer to corresponding parts throughout:

[0039] [Figure 1A] FIG. 1 is a block diagram illustrating a portable multifunction device with a touch-sensitive display in accordance with some embodiments.

[0040] [Figure 1B] FIG. 2 is a block diagram illustrating example components for event processing according to some embodiments.

[0041] [Diagram 2] FIG. 1 illustrates a portable multifunction device having a touch screen in accordance with some embodiments.

[0042] [Diagram 3] 1 is a block diagram of an exemplary multifunction device having a display and a touch-sensitive surface in accordance with some embodiments.

[0043] [Figure 4A] 1 illustrates an exemplary user interface for a menu of applications on a portable multifunction device in accordance with some embodiments.

[0044] [Figure 4B] 1 illustrates an exemplary user interface of a multifunction device having a touch-sensitive surface that is separate from a display in accordance with some embodiments.

[0045] [Figure 5A] 1 illustrates a personal electronic device according to some embodiments.

[0046] [Figure 5B] FIG. 1 is a block diagram illustrating a personal electronic device according to some embodiments.

[0047] [Figure 6A] 1 illustrates an exemplary user interface for modifying visual media using a computer system according to some embodiments. [Figure 6B] 1 illustrates an exemplary user interface for modifying visual media using a computer system according to some embodiments. [Figure 6C] 1 illustrates an exemplary user interface for modifying visual media using a computer system according to some embodiments. [Figure 6D] 1 illustrates an exemplary user interface for modifying visual media using a computer system according to some embodiments. [Figure 6E] 1 illustrates an exemplary user interface for modifying visual media using a computer system according to some embodiments. [Figure 6F] 1 illustrates an exemplary user interface for modifying visual media using a computer system according to some embodiments. [Figure 6G] 1 illustrates an exemplary user interface for modifying visual media using a computer system according to some embodiments. [Figure 6H] 1 illustrates an exemplary user interface for modifying visual media using a computer system according to some embodiments. [Figure 6I] 1 illustrates an exemplary user interface for modifying visual media using a computer system according to some embodiments. [Figure 6J] 1 illustrates an exemplary user interface for modifying visual media using a computer system according to some embodiments. [Figure 6K] 1 illustrates an exemplary user interface for modifying visual media using a computer system according to some embodiments. [Figure 6L]1 illustrates an exemplary user interface for modifying visual media using a computer system according to some embodiments. [Figure 6M] 1 illustrates an exemplary user interface for modifying visual media using a computer system according to some embodiments. [Figure 6N] 1 illustrates an exemplary user interface for modifying visual media using a computer system according to some embodiments. [Figure 6O] 1 illustrates an exemplary user interface for modifying visual media using a computer system according to some embodiments. [Figure 6P] 1 illustrates an exemplary user interface for modifying visual media using a computer system according to some embodiments. [Figure 6Q] 1 illustrates an exemplary user interface for modifying visual media using a computer system according to some embodiments. [Figure 6R] 1 illustrates an exemplary user interface for modifying visual media using a computer system according to some embodiments. [Figure 6R1] 1 illustrates an exemplary user interface for modifying visual media using a computer system according to some embodiments. [Figure 6S] 1 illustrates an exemplary user interface for modifying visual media using a computer system according to some embodiments. [Figure 6T] 1 illustrates an exemplary user interface for modifying visual media using a computer system according to some embodiments. [Figure 6U] 1 illustrates an exemplary user interface for modifying visual media using a computer system according to some embodiments. [Figure 6V]1 illustrates an exemplary user interface for modifying visual media using a computer system according to some embodiments. [Figure 6W] 1 illustrates an exemplary user interface for modifying visual media using a computer system according to some embodiments. [Figure 6X] 1 illustrates an exemplary user interface for modifying visual media using a computer system according to some embodiments. [Figure 6Y] 1 illustrates an exemplary user interface for modifying visual media using a computer system according to some embodiments. [Figure 6Z] 1 illustrates an exemplary user interface for modifying visual media using a computer system according to some embodiments. [Figure 6AA] 1 illustrates an exemplary user interface for modifying visual media using a computer system according to some embodiments. [Figure 6AB] 1 illustrates an exemplary user interface for modifying visual media using a computer system according to some embodiments. [Figure 6AC] 1 illustrates an exemplary user interface for modifying visual media using a computer system according to some embodiments. [Figure 6A-D] 1 illustrates an exemplary user interface for modifying visual media using a computer system according to some embodiments. [Figure 6AE] 1 illustrates an exemplary user interface for modifying visual media using a computer system according to some embodiments. [Figure 6AF] 1 illustrates an exemplary user interface for modifying visual media using a computer system according to some embodiments. [Figure 6AF1]1 illustrates an exemplary user interface for modifying visual media using a computer system according to some embodiments. [Figure 6A-G] 1 illustrates an exemplary user interface for modifying visual media using a computer system according to some embodiments. [Figure 6AH] 1 illustrates an exemplary user interface for modifying visual media using a computer system according to some embodiments. [Figure 6AI] 1 illustrates an exemplary user interface for modifying visual media using a computer system according to some embodiments. [Figure 6AJ] 1 illustrates an exemplary user interface for modifying visual media using a computer system according to some embodiments. [Figure 6AK] 1 illustrates an exemplary user interface for modifying visual media using a computer system according to some embodiments. [Figure 6AL] 1 illustrates an exemplary user interface for modifying visual media using a computer system according to some embodiments. [Figure 6AM] 1 illustrates an exemplary user interface for modifying visual media using a computer system according to some embodiments. [Figure 6AN] 1 illustrates an exemplary user interface for modifying visual media using a computer system according to some embodiments. [Figure 6AO] 1 illustrates an exemplary user interface for modifying visual media using a computer system according to some embodiments. [Figure 6AP] 1 illustrates an exemplary user interface for modifying visual media using a computer system according to some embodiments. [Figure 6AQ]1 illustrates an exemplary user interface for modifying visual media using a computer system according to some embodiments. [Figure 6AR] 1 illustrates an exemplary user interface for modifying visual media using a computer system according to some embodiments. [Figure 6AS] 1 illustrates an exemplary user interface for modifying visual media using a computer system according to some embodiments. [Figure 6AT] 1 illustrates an exemplary user interface for modifying visual media using a computer system according to some embodiments. [Figure 6AU] 1 illustrates an exemplary user interface for modifying visual media using a computer system according to some embodiments. [Figure 6A-V] 1 illustrates an exemplary user interface for modifying visual media using a computer system according to some embodiments. [Figure 6AW] 1 illustrates an exemplary user interface for modifying visual media using a computer system according to some embodiments. [Figure 6AX] 1 illustrates an exemplary user interface for modifying visual media using a computer system according to some embodiments. [Figure 6AY] 1 illustrates an exemplary user interface for modifying visual media using a computer system according to some embodiments. [Figure 6AZ] 1 illustrates an exemplary user interface for modifying visual media using a computer system according to some embodiments. [Figure 6BA] 1 illustrates an exemplary user interface for modifying visual media using a computer system according to some embodiments. [Figure 6BB]1 illustrates an exemplary user interface for modifying visual media using a computer system according to some embodiments. [Figure 6BC] 1 illustrates an exemplary user interface for modifying visual media using a computer system according to some embodiments. [Figure 6BC1] 1 illustrates an exemplary user interface for modifying visual media using a computer system according to some embodiments. [Figure 6BC2] 1 illustrates an exemplary user interface for modifying visual media using a computer system according to some embodiments. [Figure 6BD] 1 illustrates an exemplary user interface for modifying visual media using a computer system according to some embodiments. [Figure 6BE] 1 illustrates an exemplary user interface for modifying visual media using a computer system according to some embodiments. [Figure 6BF] 1 illustrates an exemplary user interface for modifying visual media using a computer system according to some embodiments. [Figure 6BG] 1 illustrates an exemplary user interface for modifying visual media using a computer system according to some embodiments. [Figure 6BH] 1 illustrates an exemplary user interface for modifying visual media using a computer system according to some embodiments. [Figure 6BI] 1 illustrates an exemplary user interface for modifying visual media using a computer system according to some embodiments. [Figure 6BJ] 1 illustrates an exemplary user interface for modifying visual media using a computer system according to some embodiments.

[0048] [Figure 7]FIG. 1 is a flow diagram illustrating an exemplary method for modifying visual media using a computer system according to some embodiments.

[0049] [Figure 8] FIG. 1 is a flow diagram illustrating an exemplary method for modifying visual media using a computer system according to some embodiments.

[0050] [Figure 9] FIG. 1 is a flow diagram illustrating an exemplary method for modifying visual media using a computer system according to some embodiments.

[0051] [Figure 10A] 1 illustrates an exemplary user interface for managing media capture using a computer system according to some embodiments. [Figure 10B] 1 illustrates an exemplary user interface for managing media capture using a computer system according to some embodiments. [Figure 10C] 1 illustrates an exemplary user interface for managing media capture using a computer system according to some embodiments. [Figure 10D] 1 illustrates an exemplary user interface for managing media capture using a computer system according to some embodiments. [Figure 10E] 1 illustrates an exemplary user interface for managing media capture using a computer system according to some embodiments. [Figure 10F] 1 illustrates an exemplary user interface for managing media capture using a computer system according to some embodiments. [Figure 10G] 1 illustrates an exemplary user interface for managing media capture using a computer system according to some embodiments. [Figure 10H]1 illustrates an exemplary user interface for managing media capture using a computer system according to some embodiments. [Figure 10I] 1 illustrates an exemplary user interface for managing media capture using a computer system according to some embodiments.

[0052] [Figure 11] FIG. 1 is a flow diagram illustrating an example method for managing media capture using a computer system according to some embodiments.

[0053] [Figure 12] FIG. 1 is a block diagram illustrating a neural network system.

[0054] [Figure 13] FIG. 1 is a flow diagram illustrating an exemplary method for modifying visual media using a computer system according to some embodiments. DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS

[0055] The following description sets forth example methods, parameters, etc., however, it should be recognized that such description is not intended as a limitation on the scope of the present disclosure, but rather is provided as a description of example embodiments.

[0056] There is a need for electronic devices that provide efficient methods and interfaces for modifying visual content. For example, there is a need for electronic devices that allow a user to modify visual content by applying a synthetic depth-of-field effect to multiple frames of media without having to manually modify and / or blur frames of media to mimic a depth-of-field effect. Such techniques can reduce the cognitive burden on users who wish to modify the visual content of media, thereby increasing productivity. Furthermore, such techniques can reduce processor usage and battery power that would otherwise be wasted on redundant user input.

[0057] Below, Figures 1A-1B, 2, 3, 4A-4B, 5A-5B, and 12 provide descriptions of example devices and systems for implementing techniques for managing and modifying visual media.

[0058] 6A-6BJ are user interfaces for modifying visual media using a computer system, according to some embodiments. FIG. 7 is a flow diagram illustrating a method for modifying visual content, according to some embodiments. FIG. 8 is a flow diagram illustrating a method for modifying visual content, according to some embodiments. FIG. 9 is a flow diagram illustrating a method for modifying visual content, according to some embodiments. FIG. 13 is a flow diagram illustrating a method for modifying visual content, according to some embodiments. The user interfaces in FIGS. 6A-6BJ are used to illustrate processes described below, including the processes in FIGS. 7, 8, 9, and 13.

[0059] 10A-10I illustrate exemplary user interfaces for managing media capture using a computer system, according to some embodiments. FIG 11 is a flow diagram illustrating an exemplary method for managing media capture using a computer system, according to some embodiments. The user interfaces in FIG 10A-10I are used to illustrate processes described below, including the process in FIG 11.

[0060] The processes described below enhance usability of the device and streamline the user-device interface (e.g., by helping the user provide appropriate inputs and reduce user errors when operating / interacting with the device) through a variety of techniques, including providing improved visual feedback to the user, reducing the number of inputs required to perform an operation, providing additional control options without cluttering the user interface with additional controls that are displayed, performing an operation without requiring further user input when a set of conditions is met, and / or other techniques. These techniques also reduce power usage and improve the device's battery life by allowing the user to use the device more quickly and efficiently.

[0061] Furthermore, in methods described herein in which one or more steps are contingent on one or more conditions being met, it should be understood that the described method can be repeated in multiple iterations such that over the course of the iterations, all of the conditions on which the steps of the method are contingent are met in different iterations of the method. For example, if a method requires performing a first step if a condition is met and performing a second step if the condition is not met, one skilled in the art would understand that the steps recited in the claim are repeated in a particular order until the conditions are met and are no longer met. Thus, a method described with one or more steps that are dependent on one or more conditions being met can be rewritten as a method that is repeated until each condition recited in the method is met. However, this is not required for system or computer readable medium claims in which the system or computer readable medium includes instructions for performing a conditional action based on the satisfaction of the corresponding one or more conditions, and thus can determine whether a contingency is met without explicitly repeating the steps of the method until all conditions on which the steps of the method are contingent are met. Those skilled in the art will also appreciate that, as with methods having conditional steps, the system or computer-readable storage medium may repeat the steps of the method as many times as necessary to ensure that all of the conditional steps have been performed.

[0062] In the following description, terms such as "first" and "second" are used to describe various elements, but these elements should not be limited by these terms. These terms are only used to distinguish one element from another element. For example, a first touch can be called a second touch, and a second touch can be called a first touch, without departing from the scope of various embodiments described. Although a first touch and a second touch are both touches, they are not the same touch.

[0063] The terminology used in the description of the various embodiments described herein is for the purpose of describing particular embodiments only and is not intended to be limiting. In the description of the various embodiments described and in the appended claims, the singular forms "a," "an," and "the" are intended to include the plural forms as well, unless the context clearly dictates otherwise. It should also be understood that as used herein, the term "and / or" refers to and includes any and all possible combinations of one or more of the associated listed items. It will be further understood that the terms "includes," "including," "comprises," and / or "comprising," as used herein, specify the presence of stated features, integers, steps, operations, elements, and / or components, but do not exclude the presence or addition of one or more other features, integers, steps, operations, elements, components, and / or groups thereof.

[0064] The term "if" is, optionally, interpreted as meaning "when" or "upon" or "in response to determining" or "in response to detecting," depending on the context. Similarly, the phrase "if it is determined" or "if [a stated condition or event] is detected" is, optionally, interpreted as meaning "upon determining" or "in response to determining," or "upon detecting [the stated condition or event]" or "in response to detecting [the stated condition or event]," depending on the context.

[0065] Embodiments of electronic devices, user interfaces for such devices, and associated processes for using such devices are described. In some embodiments, the device is a portable communication device, such as a mobile phone, that also includes other functions, such as PDA and / or music player functions. Exemplary embodiments of portable multifunction devices include, but are not limited to, iPhone®, iPod Touch®, and iPad® devices from Apple Inc. of Cupertino, Calif. Optionally, other portable electronic devices, such as laptop computers or tablet computers having a touch-sensitive surface (e.g., a touchscreen display and / or a touchpad), are also used. It should also be understood that in some embodiments, the device is not a portable communication device, but a desktop computer having a touch-sensitive surface (e.g., a touchscreen display and / or a touchpad). In some embodiments, the electronic device is a computer system in communication (e.g., via wired communication, via wireless communication) with a display generating component. The display generating component is configured to provide a visual output, such as a display via a CRT display, a display via an LED display, or a display via image projection. In some embodiments, the display generating component is integrated with the computer system. In some embodiments, the display generation components are separate from the computer system. As used herein, "displaying" content includes causing content (e.g., video data rendered or decoded by display controller 156) to be displayed by transmitting data (e.g., image data or video data) over a wired or wireless connection to an integrated or external display generation component to visually generate the content.

[0066] In the following discussion, electronic devices are described that include a display and a touch-sensitive surface, however, it should be understood that the electronic device optionally includes one or more other physical user-interface devices, such as a physical keyboard, a mouse, and / or a joystick.

[0067] The device typically supports a variety of applications, such as one or more of drawing applications, presentation applications, word processing applications, website creation applications, disc authoring applications, spreadsheet applications, gaming applications, telephony applications, video conferencing applications, email applications, instant messaging applications, training support applications, photo management applications, digital camera applications, digital video camera applications, web browsing applications, digital music player applications, and / or digital video player applications.

[0068] The various applications running on the device optionally use at least one common physical user-interface device, such as a touch-sensitive surface. One or more features of the touch-sensitive surface and corresponding information displayed on the device are optionally adjusted and / or changed for each application and / or within individual applications. In this way, the common physical architecture of the device (such as the touch-sensitive surface) optionally supports a variety of applications with user interfaces that are intuitive and transparent to the user.

[0069] Attention is now directed to embodiments of portable devices with touch-sensitive displays. FIG. 1A is a block diagram illustrating a portable multifunction device 100 having a touch-sensitive display system 112, according to some embodiments. Touch-sensitive display 112 may be conveniently referred to as a "touch screen" and may also be known or referred to as a "touch-sensitive display system." Device 100 includes memory 102 (optionally including one or more computer-readable storage media), memory controller 122, one or more processing units (CPUs) 120, peripherals interface 118, RF circuitry 108, audio circuitry 110, speaker 111, microphone 113, input / output (I / O) subsystem 106, other input control devices 116, and external port 124. Device 100 optionally includes one or more optical sensors 164. Device 100 optionally includes one or more contact intensity sensors 165 that detect the intensity of a contact on device 100 (e.g., a touch-sensitive surface, such as touch-sensitive display system 112 of device 100). Device 100 optionally includes one or more tactile output generators 167 that generate tactile output on device 100 (e.g., generate tactile output on a touch-sensitive surface such as touch-sensitive display system 112 of device 100 or touchpad 355 of device 300). These components optionally communicate over one or more communication buses or signal lines 103.

[0070] As used herein and in the claims, the term “intensity” of a contact on a touch-sensitive surface refers to the force or pressure (force per unit area) of a contact (e.g., a finger contact) on the touch-sensitive surface, or a proxy for the force or pressure of a contact on the touch-sensitive surface. The intensity of a contact has a range of values ​​including at least four distinct values, and more typically including hundreds (e.g., at least 256) distinct values. The intensity of a contact is optionally determined (or measured) using various techniques and various sensors or combinations of sensors. For example, one or more force sensors under or adjacent to the touch-sensitive surface are optionally used to measure the force at various points on the touch-sensitive surface. In some implementations, force measurements from multiple force sensors are combined (e.g., weighted averaged) to determine an estimated force of the contact. Similarly, a pressure-sensitive tip of a stylus is optionally used to determine the pressure of the stylus on the touch-sensitive surface. Alternatively, the size and / or change in the contact area detected on the touch-sensitive surface, the capacitance and / or change in the capacitance of the touch-sensitive surface proximate the contact, and / or the resistance and / or change in the capacitance of the touch-sensitive surface proximate the contact, are optionally used as a surrogate for the force or pressure of the contact on the touch-sensitive surface. In some implementations, the surrogate measure of the force or pressure of the contact is used directly to determine whether an intensity threshold is exceeded (e.g., the intensity threshold is described in units that correspond to the surrogate measure). In some implementations, the surrogate measure of the contact force or pressure is converted to an estimate of the force or pressure, and the estimate of the force or pressure is used to determine whether an intensity threshold is exceeded (e.g., the intensity threshold is a pressure threshold measured in units of pressure). Using the intensity of contact as an attribute of user input may enable a user to access additional device functionality (e.g., on a touch-sensitive display) and / or receive user input (e.g., via a touch-sensitive display, touch-sensitive surface, or physical / mechanical controls such as knobs or buttons) that may not otherwise be accessible on devices of reduced size that have limited footprint for displaying affordances.

[0071] As used herein and in the claims, the term "tactile output" refers to a physical displacement of a device relative to a previous position of the device, a physical displacement of a component of the device (e.g., a touch-sensitive surface) relative to another component of the device (e.g., a housing), or a displacement of a component relative to the center of mass of the device, that will be detected by a user with the user's sense of touch. For example, in a situation where a device or a component of a device is in contact with a touch-sensitive surface of a user (e.g., the fingers, palm, or other part of a user's hand), the tactile output generated by the physical displacement will be interpreted by the user as a tactile sensation corresponding to a perceived change in a physical property of the device or a component of the device. For example, movement of a touch-sensitive surface (e.g., a touch-sensitive display or trackpad) is optionally interpreted by the user as a "down-click" or "up-click" of a physical actuator button. In some cases, a user feels a tactile sensation such as a "down-click" or "up-click" even when there is no movement of a physical actuator button associated with the touch-sensitive surface that is physically pressed (e.g., displaced) by the user's action. As another example, movement of the touch-sensitive surface is optionally interpreted or sensed by a user as "roughness" of the touch-sensitive surface, even when there is no change in the smoothness of the touch-sensitive surface. Such user interpretation of touch depends on the user's personal sensory perception, but there are many sensory perceptions of touch that are common to a majority of users. Thus, when a tactile output is described as corresponding to a particular sensory perception of a user (e.g., an "up click," a "down click," "roughness"), unless otherwise noted, the generated tactile output corresponds to a physical displacement of the device, or a component of the device, that produces the described sensory perception for a typical (or average) user.

[0072] It is understood that device 100 is only one example of a portable multifunction device, and that device 100 optionally has more or fewer components than those shown, optionally combines two or more components, or optionally has a different configuration or arrangement of its components. The various components shown in FIG. 1A are implemented in hardware, software, or a combination of both hardware and software, including one or more signal processing circuits and / or application specific integrated circuits.

[0073] Memory 102 optionally includes high-speed random access memory, and optionally includes non-volatile memory, such as one or more magnetic disk storage devices, flash memory devices, or other non-volatile solid-state memory devices. A memory controller 122 optionally controls access to memory 102 by other components of device 100.

[0074] The peripherals interface 118 can be used to couple input and output peripherals of the device to the CPU 120 and memory 102. The one or more processors 120 operate or execute various software programs (e.g., computer programs (e.g., including instructions)) and / or instruction sets stored in the memory 102 to perform various functions and process data for the device 100. In some embodiments, the peripherals interface 118, the CPU 120, and the memory controller 122 are optionally implemented on a single chip, such as the chip 104. In some other embodiments, they are optionally implemented on separate chips.

[0075] The radio frequency (RF) circuitry 108 transmits and receives RF signals, also referred to as electromagnetic signals. The RF circuitry 108 converts electrical signals to electromagnetic signals or electromagnetic signals to electrical signals and communicates with communication networks and other communication devices via electromagnetic signals. The RF circuitry 108 optionally includes well-known circuits for performing these functions, including, but not limited to, an antenna system, an RF transceiver, one or more amplifiers, a tuner, one or more oscillators, a digital signal processor, a CODEC chipset, a subscriber identity module (SIM) card, memory, etc. The RF circuitry 108 optionally communicates by wireless communication with networks, such as the Internet, also referred to as the World Wide Web (WWW), an intranet, and / or wireless networks, such as cellular telephone networks, wireless local area networks (LANs) and / or metropolitan area networks (MANs), and with other devices. RF circuitry 108 optionally includes well known circuitry for detecting near field communication (NFC) fields, such as by short-range radios. Wireless communication optionally includes, but is not limited to, Global System for Mobile Communications (GSM), Enhanced Data GSM Environment (EDGE), high-speed downlink packet access (HSDPA), high-speed uplink packet access (HSUPA), Evolution, Data-Only (EV-DO), HSPA, HSPA+, Dual-Cell HSPA (DC-HSPA), long term evolution (EV-DO), and other related technologies.Wireless technology includes, but is not limited to, wireless technology such as wireless LAN, wireless technology such as wireless technology with a cellular network (WAN), wireless technology such as wireless technology with a cellular network (WAN-CDMA), wireless technology such as wireless technology with a cellular network (WAN-SWAN ... The present invention may use any of a number of communications standards, protocols, and technologies, including Session Initiation Protocol for Instant Messaging and Presence Leveraging Extensions (XMPP), Session Initiation Protocol for Instant Messaging and Presence Leveraging Extensions (SIMPLE), Instant Messaging and Presence Service (IMPS), and / or Short Message Service (SMS), or any other suitable communications protocol, including communications protocols not yet developed as of the filing date of this application.

[0076] The audio circuit 110, speaker 111, and microphone 113 provide an audio interface between a user and the device 100. The audio circuit 110 receives audio data from the peripherals interface 118, converts the audio data into an electrical signal, and transmits the electrical signal to the speaker 111. The speaker 111 converts the electrical signal into human audible sound waves. The audio circuit 110 also receives an electrical signal converted from the sound waves by the microphone 113. The audio circuit 110 converts the electrical signal into audio data, and transmits the audio data to the peripherals interface 118 for processing. The audio data is optionally retrieved from and / or transmitted to the memory 102 and / or the RF circuit 108 by the peripherals interface 118. In some embodiments, the audio circuit 110 also includes a headset jack (e.g., 212 in FIG. 2). The headset jack provides an interface between audio circuitry 110 and a detachable audio input / output peripheral such as an output-only headphone or a headset with both an output (e.g., one-ear or binaural headphones) and an input (e.g., a microphone).

[0077] The I / O subsystem 106 couples input / output peripherals on the device 100, such as the touch screen 112 and other input control devices 116, to a peripheral interface 118. The I / O subsystem 106 optionally includes a display controller 156, an optical sensor controller 158, a depth camera controller 169, an intensity sensor controller 159, a haptic feedback controller 161, and one or more input controllers 160 for other input or control devices. The one or more input controllers 160 receive / send electrical signals from / to the other input control devices 116. The other input control devices 116 optionally include physical buttons (e.g., push buttons, rocker buttons, etc.), dials, slider switches, joysticks, click wheels, etc. In some embodiments, the input controller(s) 160 are optionally coupled to any (or none) of a keyboard, an infrared port, a USB port, and a pointer device such as a mouse. The one or more buttons (e.g., 208 in FIG. 2) optionally include up / down buttons for volume control of speaker 111 and / or microphone 113. The one or more buttons optionally include push buttons (e.g., 206 in FIG. 2). In some embodiments, the electronic device is a computer system in communication (e.g., via wireless communication over wired communication) with one or more input devices. In some embodiments, the one or more input devices include a touch-sensitive surface (e.g., a trackpad as part of a touch-sensitive display). In some embodiments, the one or more input devices include one or more camera sensors (e.g., one or more optical sensors 164 and / or one or more depth camera sensors 175), such as for tracking a user's gestures (e.g., hand gestures and / or air gestures) as input. In some embodiments, the one or more input devices are integrated with the computer system. In some embodiments, the one or more input devices are separate from the computer system.In some embodiments, an air gesture is a gesture that is detected without the user touching an input element that is part of the device (or independent of an input element that is part of the device) and is based on detected movements of a part of the user's body, including movements of the user's body relative to an absolute reference (e.g., the angle of the user's arm relative to the ground, or the distance of the user's hand relative to the ground), movements of the user's body relative to another part of the user's body (e.g., movements of the user's hand relative to the user's shoulder, movements of the user's other hand relative to one of the user's hands, and / or movements of the user's fingers relative to another finger or part of the user's hand), and / or absolute movements of a part of the user's body (e.g., a tap gesture that includes movements of the hand in a predetermined pose by a predetermined amount and / or speed, or a shake gesture that includes rotation of a part of the user's body a predetermined speed or amount).

[0078] A quick press of the push button optionally unlocks the touch screen 112 or optionally initiates a process of unlocking the device using gestures on the touch screen, as described in U.S. Patent Application Serial No. 11 / 322,549, filed December 23, 2005, "Unlocking a Device by Performing Gestures on an Unlock Image," U.S. Patent No. 7,657,849, which is incorporated herein by reference in its entirety. A longer press of the push button (e.g., 206) optionally turns power on or off to the device 100. The functionality of one or more of the buttons is optionally customizable by the user. The touch screen 112 is used to implement virtual or soft buttons and one or more soft keyboards.

[0079] Touch-sensitive display 112 provides an input and output interface between the device and a user. Display controller 156 receives and / or transmits electrical signals from touchscreen 112. Touchscreen 112 displays visual output to the user. This visual output optionally includes graphics, text, icons, animation, and any combination thereof (collectively "graphics"). In some embodiments, some or all of the visual output optionally corresponds to user interface objects.

[0080] Touchscreen 112 has a touch-sensitive surface, sensor, or set of sensors that accepts input from a user based on haptic and / or tactile contact. Touchscreen 112 and display controller 156 (along with any associated modules and / or instruction sets in memory 102) detects contacts (and any movement or breaking of contact) on touchscreen 112 and translates the detected contacts into interactions with user interface objects (e.g., one or more soft keys, icons, web pages, or images) displayed on touchscreen 112. In an exemplary embodiment, the point of contact between touchscreen 112 and the user corresponds to the user's finger.

[0081] Touchscreen 112 optionally uses LCD (Liquid Crystal Display), LPD (Light Emitting Polymer Display), or LED (Light Emitting Diode) technology, although other display technologies are used in other embodiments. Touchscreen 112 and display controller 156 optionally detect contact and any movement or interruption thereof using any of a number of now known or later developed touch sensing technologies, including, but not limited to, capacitive, resistive, infrared, and surface acoustic wave technologies, as well as other proximity sensor arrays or other elements that determine one or more points of contact with touchscreen 112. In an exemplary embodiment, projected mutual capacitance sensing technology is used, such as that found in the iPhone® and iPod Touch® from Apple Inc. of Cupertino, Calif.

[0082] The touch-sensitive display in some embodiments of touchscreen 112 is optionally similar to a multi-touch-sensing touchpad as described in U.S. Patent Nos. 6,323,846 (Westerman et al.), 6,570,557 (Westerman et al.), and / or 6,677,932 (Westerman), and / or U.S. Patent Application Publication No. 2002 / 0015024 (A1), each of which is incorporated by reference in its entirety. However, whereas touchscreen 112 displays visual output from device 100, a touch-sensitive touchpad does not provide visual output.

[0083] The touch-sensitive display in some embodiments of the touch screen 112 is described in the following applications: (1) U.S. patent application Ser. No. 11 / 381,313, filed May 2, 2006, entitled "Multipoint Touch Surface Controller," (2) U.S. patent application Ser. No. 10 / 840,862, filed May 6, 2004, entitled "Multipoint Touchscreen," (3) U.S. patent application Ser. No. 10 / 903,964, filed July 30, 2004, entitled "Gestures For Touch Sensitive Input Devices," (4) U.S. patent application Ser. No. 11 / 048,264, filed January 31, 2005, entitled "Gestures For Touch Sensitive Input Devices," and (5) U.S. patent application Ser. No. 11 / 038,590, filed January 18, 2005, entitled "Mode-Based Graphical User Interfaces For Touch Sensitive Input No. 11 / 228,758, filed Sep. 16, 2005, entitled "Virtual Input Device Placement On A Touch Screen User Interface," (7) U.S. patent application Ser. No. 11 / 228,700, filed Sep. 16, 2005, entitled "Operation Of A Computer With A Touch Screen Interface," (8) U.S. patent application Ser. No. 11 / 228,737, filed Sep. 16, 2005, entitled "Activating Virtual Keys Of A Touch-Screen Virtual Keyboard," and (9) U.S. patent application Ser. No. 11 / 367,749, filed Mar. 3, 2006, entitled "Multi-Functional Hand-Held Device," all of which are incorporated herein by reference in their entirety.

[0084] Touchscreen 112 optionally has a video resolution of greater than 100 dpi. In some embodiments, the touchscreen has a video resolution of approximately 160 dpi. A user optionally contacts touchscreen 112 using any suitable object or appendage, such as a stylus, finger, etc. In some embodiments, the user interface is designed to operate primarily using finger-based contacts and gestures, which may not be as precise as stylus-based input due to the larger contact area of ​​a finger on the touchscreen. In some embodiments, the device translates the rough finger input into precise pointer / cursor positions or commands to perform the action desired by the user.

[0085] In some embodiments, in addition to a touchscreen, device 100 optionally includes a touchpad for activating or deactivating certain functions. In some embodiments, the touchpad is a touch-sensitive area of ​​the device that, unlike the touchscreen, does not display visual output. The touchpad is optionally a touch-sensitive surface separate from touchscreen 112 or an extension of the touch-sensitive surface formed by the touchscreen.

[0086] Device 100 also includes a power system 162 that provides power to the various components. Power system 162 optionally includes a power management system, one or more power sources (e.g., batteries, alternating current (AC)), a recharging system, power outage detection circuitry, power converters or inverters, power status indicators (e.g., light emitting diodes (LEDs)), and any other components associated with the generation, management, and distribution of power within a portable device.

[0087] Device 100 also optionally includes one or more optical sensors 164. FIG. 1A shows an optical sensor coupled to optical sensor controller 158 in I / O subsystem 106. Optical sensor 164 optionally includes a charge-coupled device (CCD) or a complementary metal-oxide semiconductor (CMOS) phototransistor. Optical sensor 164 receives light from the environment projected through one or more lenses and converts the light into data representing an image. Optical sensor 164 optionally works in conjunction with imaging module 143 (also called a camera module) to capture still or video images. In some embodiments, the optical sensor is located on the back side of device 100 opposite touchscreen display 112 on the front side of the device, so that the touchscreen display can be used as a viewfinder for still and / or video capture. In some embodiments, the optical sensor is located on the front side of the device such that an image of the user is optionally captured for video conferencing while the user views other video conferencing participants on the touchscreen display. In some embodiments, the position of the optical sensor 164 can be changed by the user (e.g., by rotating the lens and sensor within the device housing), such that a single optical sensor 164 is used for both video conferencing and still image and / or video capture, along with a touchscreen display.

[0088] Device 100 also optionally includes one or more depth camera sensors 175. FIG. 1A shows a depth camera sensor coupled to depth camera controller 169 in I / O subsystem 106. Depth camera sensor 175 receives data from the environment to create a three-dimensional model of an object (e.g., a face) in a scene from a viewpoint (e.g., the depth camera sensor). In some embodiments, in cooperation with imaging module 143 (also called camera module), depth camera sensor 175 is optionally used to determine a depth map of different parts of an image captured by imaging module 143. In some embodiments, a depth camera sensor is disposed on the front of device 100 to obtain an image of the user with depth information for a video conference and to capture a selfie image with depth map data while the user is viewing other video conference participants on a touch screen display. In some embodiments, depth camera sensor 175 is disposed on the back of the device, or on the back and front of device 100. In some embodiments, the position of the depth camera sensor 175 can be changed by the user (e.g., by rotating the lens and sensor within the device housing) such that the depth camera sensor 175 is used for both video conferencing and still image and / or video capture in conjunction with a touchscreen display.

[0089] In some embodiments, a depth map (e.g., a depth map image) contains information (e.g., values) about the distance of objects in a scene from a viewpoint (e.g., a camera, light sensor, depth camera sensor). In one embodiment of a depth map, each depth pixel defines a position in the Z-axis of the viewpoint where its corresponding two-dimensional pixel is located. In some embodiments, a depth map is made up of pixels, each pixel defined by a value (e.g., 0-255). For example, a value of "0" represents a pixel located furthest in a "3D" scene, and a value of "255" represents a pixel located closest to the viewpoint (e.g., a camera, light sensor, depth camera sensor) in the "3D" scene. In other embodiments, a depth map represents a distance between objects in a scene and the plane of the viewpoint. In some embodiments, a depth map contains information about the relative depth of various features of a target object as seen by a depth camera (e.g., the relative depth of the eyes, nose, mouth, and ears on a user's face). In some embodiments, the depth map contains information that allows the device to determine the contour of the target object in the z-direction.

[0090] Device 100 also optionally includes one or more contact intensity sensors 165. FIG. 1A shows a contact intensity sensor coupled to intensity sensor controller 159 in I / O subsystem 106. Contact intensity sensor 165 optionally includes one or more piezoresistive strain gauges, capacitive force sensors, electrical force sensors, piezoelectric force sensors, optical force sensors, capacitive touch-sensitive surfaces, or other intensity sensors (e.g., sensors used to measure the force (or pressure) of a contact on a touch-sensitive surface). Contact intensity sensor 165 receives contact intensity information (e.g., pressure information, or a proxy for pressure information) from the environment. In some embodiments, at least one contact intensity sensor is juxtaposed with or proximate to a touch-sensitive surface (e.g., touch-sensitive display system 112). In some embodiments, at least one contact intensity sensor is located on the back of device 100, opposite touchscreen display 112 located on the front of device 100.

[0091] Device 100 also optionally includes one or more proximity sensors 166. Figure 1A shows proximity sensor 166 coupled to peripherals interface 118. Alternatively, proximity sensor 166 is optionally coupled to an input controller 160 within I / O subsystem 106. The proximity sensor 166 optionally functions as described in U.S. patent application Ser. No. 11 / 241,839, "Proximity Detector In Handheld Device," Ser. No. 11 / 240,788, "Proximity Detector In Handheld Device," Ser. No. 11 / 620,702, "Using Ambient Light Sensor To Augment Proximity Sensor Output," Ser. No. 11 / 586,862, "Automated Response To And Sensing Of User Activity In Portable Devices," and Ser. No. 11 / 638,251, "Methods And Systems For Automatic Configuration Of Peripherals," all of which are incorporated herein by reference in their entireties. In some embodiments, the proximity sensor turns off and disables the touchscreen 112 when the multifunction device is placed near the user's ear (e.g., when the user is making a phone call).

[0092] Device 100 also optionally includes one or more tactile output generators 167. FIG. 1A shows a tactile output generator coupled to haptic feedback controller 161 in I / O subsystem 106. Tactile output generator 167 optionally includes one or more electroacoustic devices, such as speakers or other audio components, and / or electromechanical devices that convert energy into linear motion, such as motors, solenoids, electroactive polymers, piezoelectric actuators, electrostatic actuators, or other tactile output generating components (e.g., components that convert electrical signals into tactile output on the device). Contact intensity sensor 165 receives tactile feedback generation commands from haptic feedback module 133 and generates a tactile output on device 100 that can be sensed by a user of device 100. In some embodiments, at least one tactile output generator is juxtaposed with or proximate to a touch-sensitive surface (e.g., touch-sensitive display system 112) and generates a tactile output, optionally by moving the touch-sensitive surface vertically (e.g., in / out of the surface of device 100) or horizontally (e.g., back and forth in the same plane as the surface of device 100). In some embodiments, the at least one tactile output generator sensor is located on the back of device 100, opposite touchscreen display 112, which is located on the front of device 100.

[0093] Device 100 also optionally includes one or more accelerometers 168. FIG. 1A shows accelerometer 168 coupled to peripherals interface 118. Alternatively, accelerometer 168 is optionally coupled to input controller 160 in I / O subsystem 106. Accelerometer 168 optionally functions as described in U.S. Patent Application Publication No. 20050190059, “Acceleration-based Theft Detection System for Portable Electronic Devices,” and U.S. Patent Application Publication No. 20060017692, “Methods And Apparatuses For Operating A Portable Device Based On An Accelerometer,” both of which are incorporated herein by reference in their entireties. In some embodiments, information is displayed on the touchscreen display in portrait or landscape orientation based on an analysis of data received from the one or more accelerometers. In addition to accelerometer(s) 168, device 100 optionally includes a magnetometer and a GPS (or GLONASS or other global navigation system) receiver for obtaining information regarding the location and orientation (e.g., vertical or horizontal) of device 100.

[0094] In some embodiments, the software components stored in memory 102 include an operating system 126, a communication module (or instruction set) 128, a touch / motion module (or instruction set) 130, a graphics module (or instruction set) 132, a text input module (or instruction set) 134, a Global Positioning System (GPS) module (or instruction set) 135, and applications (or instruction sets) 136. Additionally, in some embodiments, memory 102 (FIG. 1A) or 370 (FIG. 3) stores device / global internal state 157, as shown in FIGS. 1A and 3. Device / global internal state 157 includes one or more of an active application state indicating which applications, if any, are currently active, a display state indicating which applications, views, or other information are occupying various regions of touchscreen display 112, a sensor state including information obtained from various sensors and input control devices 116 of the device, and location information regarding the location and / or orientation of the device.

[0095] Operating system 126 (e.g., Darwin, RTXC, LINUX, UNIX, OS X, iOS, WINDOWS, or an embedded operating system such as VxWorks) includes various software components and / or drivers that control and manage general system tasks (e.g., memory management, storage device control, power management, etc.) and facilitate communication between various hardware and software components.

[0096] The communications module 128 also includes various software components for facilitating communication with other devices via one or more external ports 124 and for processing data received by the RF circuitry 108 and / or the external ports 124. The external ports 124 (e.g., Universal Serial Bus (USB), FIREWIRE, etc.) are adapted to couple to other devices directly or indirectly via a network (e.g., the Internet, wireless LAN, etc.). In some embodiments, the external ports are multi-pin (e.g., 30-pin) connectors that are the same as or similar to and / or compatible with the 30-pin connector used on iPod® (a trademark of Apple Inc.) devices.

[0097] Contact / motion module 130, optionally in conjunction with display controller 156, detects contact with touch screen 112 and other touch-sensing devices (e.g., a touchpad or a physical click wheel). Contact / motion module 130 includes various software components for performing various operations related to detecting contact, such as determining whether contact occurs (e.g., detecting a finger-down event), determining the strength of the contact (e.g., the force or pressure of the contact, or a surrogate for the force or pressure of the contact), determining whether there is movement of the contact and tracking the movement across the touch-sensitive surface (e.g., detecting one or more finger-dragging events), and determining whether the contact has ceased (e.g., detecting a finger-up event or an interruption of the contact). Contact / motion module 130 receives contact data from the touch-sensitive surface. Determining the movement of the contact, as represented by the series of contact data, optionally includes determining the speed (magnitude), velocity (magnitude and direction), and / or acceleration (change in magnitude and / or direction) of the contact. These actions are, optionally, applied to a single contact (e.g., one finger contact) or multiple simultaneous contacts (e.g., "multi-touch" / multiple finger contacts). In some embodiments, contact / motion module 130 and display controller 156 detect contacts on a touchpad.

[0098] In some embodiments, the contact / motion module 130 uses a set of one or more intensity thresholds to determine whether an action has been performed by a user (e.g., to determine whether a user has “clicked” on an icon). In some embodiments, at least a subset of the intensity thresholds are determined according to software parameters (e.g., the intensity thresholds are not determined by the activation thresholds of a particular physical actuator, but can be adjusted without modifying the physical hardware of the device 100). For example, the mouse “click” threshold of a trackpad or touchscreen display can be set to any of a wide range of predefined thresholds without modifying the trackpad or touchscreen display hardware. Additionally, in some implementations, a user of the device is provided with a software setting to adjust one or more of the set of intensity thresholds (e.g., by adjusting individual intensity thresholds and / or by adjusting multiple intensity thresholds at once via a system-level click “intensity” parameter).

[0099] Contact / motion module 130 optionally detects gesture input by a user. Different gestures on a touch-sensitive surface have different contact patterns (e.g., different movements, timing, and / or strength of detected contacts). Thus, gestures are optionally detected by detecting a particular contact pattern. For example, detecting a finger tap gesture includes detecting a finger down event, followed by detecting a finger up (lift off) event at the same position (or substantially the same position) as the finger down event (e.g., at the position of an icon). As another example, detecting a finger swipe gesture on the touch-sensitive surface includes detecting a finger down event, followed by one or more finger drag events, followed by detecting a finger up (lift off) event.

[0100] Graphics module 132 includes various known software components that render and display graphics on touchscreen 112 or other display, including components that modify the visual impact (e.g., brightness, transparency, saturation, contrast, or other visual properties) of the displayed graphics. As used herein, the term "graphics" includes any object that can be displayed to a user, including, but not limited to, characters, web pages, icons (such as user interface objects including soft keys), digital images, video, animations, and the like.

[0101] In some embodiments, graphics module 132 stores data representing the graphics to be used. Each graphic is, optionally, assigned a corresponding code. Graphics module 132 receives one or more codes specifying the graphics to be displayed, including, as appropriate, coordinate data and other graphic property data, from an application or the like, and then generates screen image data for output to display controller 156.

[0102] The tactile feedback module 133 includes various software components for generating instructions used by the tactile output generator(s) 167 to generate tactile outputs at one or more locations on the device 100 in response to a user's interaction with the device 100.

[0103] Text input module 134 is optionally a component of graphics module 132 and provides a soft keyboard for entering text in various applications (e.g., contacts 137, email 140, IM 141, browser 147, and any other application requiring text input).

[0104] The GPS module 135 determines the location of the device and provides this information for use within various applications (e.g., to the phone 138 for use in location-based dialing, to the camera 143 as picture / video metadata, and to applications that provide location-based services such as a weather widget, a local yellow pages widget, and a maps / navigation widget).

[0105] Application 136 optionally includes the following modules (or sets of instructions), or a subset or superset thereof: ● a contacts module 137 (sometimes called an address book or contact list); ● Telephone module 138, ● Videoconferencing module 139; ● an email client module 140; ● Instant messaging (IM) module 141, ● Training support module 142, A camera module 143 for still images and / or video; ● Image management module 144, ●Video player module, ●Music player module, ● Browser module 147, ● Calendar module 148, ● A widget module 149, optionally including one or more of a weather widget 149-1, a stock price widget 149-2, a calculator widget 149-3, an alarm clock widget 149-4, a dictionary widget 149-5, and other widgets obtained by the user, as well as user-created widgets 149-6; A widget creator module 150 for creating user-created widgets 149-6; ● Search module 151, A video and music player module 152 that integrates a video player module and a music player module; ● Memo module 153, Map module 154, and / or ●Online video module 155.

[0106] Examples of other applications 136 optionally stored in memory 102 include other word processing applications, other image editing applications, drawing applications, presentation applications, JAVA-enabled applications, encryption, digital rights management, voice recognition, and voice duplication.

[0107] The contacts module 137, along with the touch screen 112, the display controller 156, the contact / motion module 130, the graphics module 132, and the text input module 134, are optionally used to manage an address book or contact list (e.g., stored in the memory 102 or in the application internal state 192 of the contacts module 137 in the memory 370), including adding a name(s) to the address book, deleting a name(s) from the address book, associating a phone number(s), email address(es), address(es), or other information with a name, associating a picture with a name, categorizing and sorting names, providing phone numbers or email addresses to initiate and / or facilitate communication by phone 138, videoconferencing module 139, email 140, or IM 141, etc. used to manage the address book or contact list.

[0108] Telephone module 138, in conjunction with RF circuitry 108, audio circuitry 110, speaker 111, microphone 113, touch screen 112, display controller 156, contact / motion module 130, graphics module 132, and text input module 134, is optionally used to enter a series of characters corresponding to a telephone number, access one or more telephone numbers in contacts module 137, modify entered telephone numbers, dial individual telephone numbers, place calls, and disconnect and hang up when a call is completed. As previously mentioned, wireless communication optionally uses any of a number of communication standards, protocols, and technologies.

[0109] Video conferencing module 139 includes executable instructions to cooperate with RF circuitry 108, audio circuitry 110, speaker 111, microphone 113, touch screen 112, display controller 156, optical sensor 164, optical sensor controller 158, contact / motion module 130, graphics module 132, text input module 134, contact module 137, and telephone module 138 to initiate, conduct, and end a video conference between a user and one or more other participants according to the user's commands.

[0110] The email client module 140, in conjunction with the RF circuitry 108, the touch screen 112, the display controller 156, the contact / motion module 130, the graphics module 132, and the text input module 134, contains executable instructions for composing, sending, receiving, and managing emails in response to user commands. In conjunction with the image management module 144, the email client module 140 greatly facilitates the creation and sending of emails with still or video images captured by the camera module 143.

[0111] Instant messaging module 141 includes executable instructions in cooperation with RF circuitry 108, touch screen 112, display controller 156, contact / motion module 130, graphics module 132, and text input module 134 for entering a sequence of characters corresponding to an instant message, modifying previously entered characters, sending individual instant messages (e.g., using Short Message Service (SMS) or Multimedia Message Service (MMS) protocols for telephony-based instant messaging, or XMPP, SIMPLE, or IMPS for Internet-based instant messaging), receiving instant messages, and viewing received instant messages. In some embodiments, sent and / or received instant messages optionally include graphics, photos, audio files, video files, and / or other attachments as supported by MMS and / or Enhanced Messaging Service (EMS). As used herein, "instant messaging" refers to both telephony-based messages (e.g., messages sent using SMS or MMS) and Internet-based messages (e.g., messages sent using XMPP, SIMPLE, or IMPS).

[0112] In conjunction with the RF circuitry 108, touch screen 112, display controller 156, touch / motion module 130, graphics module 132, text input module 134, GPS module 135, map module 154, and music player module, the training support module 142 includes executable instructions to create workouts (e.g., having time, distance, and / or calorie burn goals), communicate with training sensors (sports devices), receive training sensor data, calibrate sensors used to monitor the workouts, select and play music for the workouts, and display, store, and transmit training data.

[0113] Camera module 143, in conjunction with touch screen 112, display controller 156, optical sensor(s) 164, optical sensor controller 158, contact / motion module 130, graphics module 132, and image management module 144, contains executable instructions to capture and store still images or video (including video streams) in memory 102, modify characteristics of the still images or video, or delete still images or video from memory 102.

[0114] Image management module 144, in conjunction with touch screen 112, display controller 156, contact / motion module 130, graphics module 132, text input module 134, and camera module 143, contains executable instructions for arranging, modifying (e.g., editing), or otherwise manipulating, labeling, deleting, presenting (e.g., in a digital slide show or album), and storing still and / or video images.

[0115] Browser module 147, in conjunction with RF circuitry 108, touch screen 112, display controller 156, contact / motion module 130, graphics module 132, and text input module 134, contains executable instructions for browsing the Internet according to user commands, including retrieving, linking to, receiving, and displaying web pages or portions thereof, as well as attachments and other files linked to web pages.

[0116] The calendar module 148 includes executable instructions to cooperate with the RF circuitry 108, the touch screen 112, the display controller 156, the contact / motion module 130, the graphics module 132, the text input module 134, the email client module 140, and the browser module 147 to create, display, modify, and store a calendar and data associated with the calendar (e.g., calendar items, to-do lists, etc.) according to a user's instructions.

[0117] Widget module 149, in conjunction with RF circuitry 108, touch screen 112, display controller 156, touch / motion module 130, graphics module 132, text input module 134, and browser module 147, optionally provides mini-applications (e.g., weather widget 149-1, stock price widget 149-2, calculator widget 149-3, alarm clock widget 149-4, and dictionary widget 149-5) downloaded and used by a user, or mini-applications (e.g., user-created widget 149-6) created by a user. In some embodiments, a widget includes a Hypertext Markup Language (HTML) file, a Cascading Style Sheets (CSS) file, and a JavaScript file. In some embodiments, a widget includes an Extensible Markup Language (XML) file and a JavaScript file (e.g., Yahoo! Widget).

[0118] The widget creator module 150, in conjunction with the RF circuitry 108, the touch screen 112, the display controller 156, the contact / motion module 130, the graphics module 132, the text input module 134, and the browser module 147, is optionally used by a user to create a widget (e.g., turn a user-specified portion of a web page into a widget).

[0119] The search module 151, in cooperation with the touch screen 112, the display controller 156, the contact / motion module 130, the graphics module 132, and the text input module 134, includes executable instructions for searching for text, music, sound, images, video, and / or other files in the memory 102 that match one or more search criteria (e.g., one or more user-specified search terms) in accordance with a user's commands.

[0120] Video and music player module 152 includes executable instructions that cooperate with touchscreen 112, display controller 156, contact / motion module 130, graphics module 132, audio circuitry 110, speaker 111, RF circuitry 108, and browser module 147 to enable a user to download and play pre-recorded music and other sound files stored in one or more file formats, such as MP3 or AAC files, as well as executable instructions for displaying, presenting, or otherwise playing videos (e.g., on touchscreen 112 or on an external display connected via external port 124). In some embodiments, device 100 optionally includes the functionality of an MP3 player, such as an iPod (a trademark of Apple Inc.).

[0121] The note module 153 includes executable instructions for cooperating with the touch screen 112, the display controller 156, the contact / motion module 130, the graphics module 132, and the text input module 134 to create and manage notes, to-do lists, and the like according to user instructions.

[0122] Map module 154, in conjunction with RF circuitry 108, touch screen 112, display controller 156, touch / motion module 130, graphics module 132, text input module 134, GPS module 135, and browser module 147, is used to receive, display, modify, and store maps and data associated with the maps (e.g., driving directions, data regarding businesses and other points of interest at or near a particular location, and other location-based data), optionally in accordance with a user's instructions.

[0123] Online video module 155, in conjunction with touchscreen 112, display controller 156, contact / motion module 130, graphics module 132, audio circuitry 110, speaker 111, RF circuitry 108, text input module 134, email client module 140, and browser module 147, includes instructions that enable a user to access, browse for, receive (e.g., by streaming and / or downloading), and play (e.g., on the touchscreen or on an external display connected via external port 124) particular online videos, send emails with links to particular online videos, and otherwise manage online videos in one or more file formats, such as H.264. In some embodiments, instant messaging module 141 is used to send links to particular online videos, rather than email client module 140. For additional description of online video applications, see U.S. Provisional Patent Application No. 60 / 936,562, entitled "Portable Multifunction Device, Method, and Graphical User Interface for Playing Online Videos," filed June 20, 2007, and U.S. Patent Application No. 11 / 968,067, entitled "Portable Multifunction Device, Method, and Graphical User Interface for Playing Online Videos," filed December 31, 2007, the contents of which are incorporated herein by reference in their entireties.

[0124] The above-identified modules and applications each correspond to a set of executable instructions to perform one or more of the functions previously described and methods described herein (e.g., the computer-implemented methods and other information processing methods described herein). These modules (e.g., sets of instructions) need not be implemented as respective software programs (e.g., computer programs (e.g., including instructions), procedures, or modules), and thus in various embodiments, various subsets of these modules are optionally combined or otherwise reconfigured. For example, a video player module is optionally combined with a music player module into a single module (e.g., video and music player module 152 of FIG. 1A). In some embodiments, memory 102 optionally stores a subset of the above-identified modules and data structures. Additionally, memory 102 optionally stores additional modules and data structures not described above.

[0125] In some embodiments, device 100 is a device in which operation of a predefined set of functions on the device is performed exclusively via a touchscreen and / or touchpad. Using the touchscreen and / or touchpad as the primary input control device for operation of device 100 optionally reduces the number of physical input control devices (push buttons, dials, etc.) on device 100.

[0126] The set of predefined functions performed only through the touchscreen and / or touchpad optionally includes navigation between user interfaces. In some embodiments, the touchpad, when touched by a user, navigates device 100 to a main menu, a home menu, or a root menu from any user interface displayed on device 100. In such embodiments, a "menu button" is implemented using the touchpad. In some other embodiments, the menu button is a physical push button or other physical input control device rather than a touchpad.

[0127] 1B is a block diagram illustrating example components for event processing, according to some embodiments. In some embodiments, memory 102 (FIG. 1A) or 370 (FIG. 3) includes an event sorter 170 (e.g., in operating system 126) and a separate application 136-1 (e.g., any of applications 137-151, 155, 380-390 described above).

[0128] Event sorter 170 receives the event information and determines which application 136-1 to deliver the event information to and application view 191 of application 136-1. Event sorter 170 includes an event monitor 171 and an event dispatcher module 174. In some embodiments, application 136-1 includes application internal state 192 that indicates the current application view(s) that are displayed on touch-sensitive display 112 when the application is active or running. In some embodiments, device / global internal state 157 is used by event sorter 170 to determine which application(s) is currently active, and application internal state 192 is used by event sorter 170 to determine which application view 191 the event information is delivered to.

[0129] In some embodiments, application internal state 192 includes additional information such as one or more of resume information to be used when application 136-1 resumes execution, user interface state information indicating or ready to display information being displayed by application 136-1, state cues that allow a user to return to a previous state or view of application 136-1, and redo / undo cues of previous actions taken by the user.

[0130] Event monitor 171 receives event information from peripherals interface 118. The event information includes information about a sub-event (e.g., a user touch as part of a multi-touch gesture on touch-sensitive display 112). Peripherals interface 118 transmits information it receives from I / O subsystem 106 or sensors such as proximity sensor 166, accelerometer(s) 168, and / or microphone 113 (via audio circuitry 110). Information that peripherals interface 118 receives from I / O subsystem 106 includes information from touch-sensitive display 112 or a touch-sensitive surface.

[0131] In some embodiments, event monitor 171 sends requests to peripherals interface 118 at predetermined intervals. In response, peripherals interface 118 transmits event information. In other embodiments, peripherals interface 118 transmits event information only when there is a significant event (e.g., receipt of an input above a predetermined noise threshold and / or for a predetermined duration).

[0132] In some embodiments, the event sorter 170 also includes a hit view determination module 172 and / or an active event recognizer determination module 173 .

[0133] Hit view determination module 172 provides software procedures that determine where a sub-event occurred within one or more views when touch-sensitive display 112 displays more than one view. A view consists of the controls and other elements that a user can see on the display.

[0134] Another aspect of a user interface associated with an application is the set of views, sometimes referred to herein as application views or user interface windows, in which information is displayed and touch-based gestures occur. The application views (of a particular application) in which the touch is detected optionally correspond to programmatic levels within the application's programmatic or view hierarchy. For example, the lowest level view in which the touch is detected is optionally referred to as the hit view, and the set of events that are recognized as suitable inputs is optionally determined based at least in part on the hit view of the initial touch that initiates the touch gesture.

[0135] Hit view determination module 172 receives information related to sub-events of a touch-based gesture. When an application has multiple views organized in a hierarchy, hit view determination module 172 identifies the hit view as the lowest view in the hierarchy that should process the sub-events. In most situations, the hit view is the lowest level view in which an initiating sub-event occurs (e.g., the first sub-event in a sequence of sub-events that form an event or potential event). Once a hit view is identified by hit view determination module 172, the hit view typically receives all sub-events related to the same touch or input source as the touch or input source identified as the hit view.

[0136] Active event recognizer determination module 173 determines which view(s) in the view hierarchy should receive a particular set of sub-events. In some embodiments, active event recognizer determination module 173 determines that only the hit view should receive a particular set of sub-events. In other embodiments, active event recognizer determination module 173 determines that all views that contain the physical location of the sub-event are actively participating views, and therefore all actively participating views should receive a particular set of sub-events. In other embodiments, even if the touch sub-event is entirely confined to the area associated with one particular view, views higher in the hierarchy still remain actively participating views.

[0137] Event dispatcher module 174 dispatches event information to event recognizers (e.g., event recognizer 180). In embodiments that include active event recognizer determination module 173, event dispatcher module 174 delivers the event information to the event recognizers determined by active event recognizer determination module 173. In some embodiments, event dispatcher module 174 stores event information in an event queue, which is picked up by individual event receivers 182.

[0138] In some embodiments, operating system 126 includes event sorter 170. Alternatively, application 136-1 includes event sorter 170. In yet other embodiments, event sorter 170 is a stand-alone module or is part of another module stored in memory 102, such as contact / motion module 130.

[0139] In some embodiments, application 136-1 includes multiple event handlers 190 and one or more application views 191, each including instructions for handling touch events occurring within a separate view of the application's user interface. Each application view 191 of application 136-1 includes one or more event recognizers 180. Typically, a separate application view 191 includes multiple event recognizers 180. In other embodiments, one or more of the event recognizers 180 are part of a separate module, such as a user interface kit or a higher-level object from which application 136-1 inherits methods and other properties. In some embodiments, a separate event handler 190 includes one or more of a data updater 176, an object updater 177, a GUI updater 178, and / or event data 179 received from event sorter 170. Event handler 190 optionally utilizes or invokes data updater 176, object updater 177, or GUI updater 178 to update application internal state 192. Alternatively, one or more of the application views 191 include one or more respective event handlers 190. Also, in some embodiments, one or more of the data updater 176, the object updater 177, and the GUI updater 178 are included in individual application views 191.

[0140] A separate event recognizer 180 receives event information (e.g., event data 179) from event sorter 170 and identifies events from the event information. Event recognizer 180 includes an event receiver 182 and an event comparator 184. In some embodiments, event recognizer 180 also includes at least a subset of metadata 183 and event delivery instructions 188 (optionally including sub-event delivery instructions).

[0141] The event receiver 182 receives event information from the event sorter 170. The event information includes information about a sub-event, e.g., a touch or a movement of a touch. Depending on the sub-event, the event information also includes additional information, such as the location of the sub-event. When the sub-event involves a movement of a touch, the event information also optionally includes the speed and direction of the sub-event. In some embodiments, the event includes a rotation of the device from one orientation to another (e.g., from portrait to landscape or vice versa), and the event information includes corresponding information about the current orientation of the device (also referred to as the device's pose).

[0142] The event comparator 184 compares the event information to predefined event or sub-event definitions and determines the event or sub-event or determines or updates the state of the event or sub-event based on the comparison. In some embodiments, the event comparator 184 includes an event definition 186. The event definition 186 includes definitions of events (e.g., a predefined set of sub-events), such as event 1 (187-1) and event 2 (187-2). In some embodiments, sub-events within an event (187-1 and / or 187-2) include, for example, touch start, touch end, touch movement, touch cancellation, and multiple touches. In one example, the definition for event 1 (187-1) is a double tap on a displayed object. The double tap includes, for example, a first touch on a displayed object for a given phase (touch start), a first lift off (touch end) for a given phase, a second touch on a displayed object for a given phase (touch start), and a second lift off (touch end) for a given phase. In another example, a definition of event 2 (187-2) is a drag on a displayed object. A drag includes, for example, a touch (or contact) on a displayed object to a predetermined stage, a movement of the touch across the touch-sensitive display 112, and a lift-off of the touch (end of the touch). In some embodiments, the event also includes information regarding one or more associated event handlers 190.

[0143] In some embodiments, event definition 186 includes definitions of the event for individual user interface objects. In some embodiments, event comparator 184 performs a hit test to determine which user interface object is associated with the sub-event. For example, when a touch is detected on touch-sensitive display 112 in an application view in which three user interface objects are displayed on touch-sensitive display 112, event comparator 184 performs a hit test to determine which of the three user interface objects is associated with the touch (sub-event). If each displayed object is associated with a separate event handler 190, event comparator 184 uses the results of the hit test to determine which event handler 190 to activate. For example, event comparator 184 selects the event handler associated with the sub-event and object that triggers the hit test.

[0144] In some embodiments, the definition of an individual event 187 also includes a delay action that delays delivery of the event information until it is determined whether a set of sub-events corresponds to the event type of the event recognizer.

[0145] If the individual event recognizer 180 determines that the sequence of sub-events does not match any of the events in the event definition 186, the individual event recognizer 180 enters an event disabled, event failed, or event finished state and thereafter ignores the next sub-event of the touch-based gesture. In this situation, any other event recognizers that remain active for the hit view continue to track and process sub-events of the ongoing touch gesture.

[0146] In some embodiments, individual event recognizers 180 include metadata 183 with configurable properties, flags, and / or lists that indicate to actively participating event recognizers how the event delivery system should perform sub-event delivery. In some embodiments, metadata 183 includes configurable properties, flags, and / or lists that indicate how event recognizers interact with each other or are allowed to interact with each other. In some embodiments, metadata 183 includes configurable properties, flags, and / or lists that indicate how sub-events are delivered to various levels in a view or programmatic hierarchy.

[0147] In some embodiments, the individual event recognizer 180 activates an event handler 190 associated with an event when one or more particular sub-events of the event are recognized. In some embodiments, the individual event recognizer 180 delivers event information associated with the event to the event handler 190. Activating the event handler 190 is separate from sending (and postponing sending) the sub-events to the individual hit view. In some embodiments, the event recognizer 180 pops a flag associated with the recognized event, and the event handler 190 associated with the flag catches the flag and performs a predefined process.

[0148] In some embodiments, the event delivery instructions 188 include sub-event delivery instructions that deliver event information about a sub-event without activating an event handler. Instead, the sub-event delivery instructions deliver the event information to an event handler associated with a set of sub-events or to an actively participating view. The event handler associated with the set of sub-events or the actively participating view receives the event information and performs a predetermined process.

[0149] In some embodiments, data updater 176 creates and updates data used by application 136-1. For example, data updater 176 updates phone numbers used by contacts module 137 or stores video files used by a video player module. In some embodiments, object updater 177 creates and updates objects used by application 136-1. For example, object updater 177 creates new user interface objects or updates the positions of user interface objects. GUI updater 178 updates the GUI. For example, GUI updater 178 prepares display information and sends the display information to graphics module 132 for display on the touch-sensitive display.

[0150] In some embodiments, event handler(s) 190 includes or has access to data updater 176, object updater 177, and GUI updater 178. In some embodiments, data updater 176, object updater 177, and GUI updater 178 are included in a single module of an individual application 136-1 or application view 191. In other embodiments, they are included in two or more software modules.

[0151] It should be understood that the foregoing description of event processing of a user's touch on a touch-sensitive display also applies to other forms of user input for operating multifunction device 100 using input devices, not all of which are initiated on a touch screen. For example, mouse movements and mouse button presses, contact movements such as tapping, dragging, scrolling on a touchpad, optionally coordinated with single or multiple presses or holds of a keyboard, pen stylus input, device movements, verbal commands, detected eye movements, biometric input, and / or any combination thereof, are optionally utilized as inputs corresponding to sub-events that define the event to be recognized.

[0152] FIG. 2 illustrates portable multifunction device 100 having touch screen 112, according to some embodiments. The touch screen optionally displays one or more graphics in user interface (UI) 200. In this embodiment, as well as other embodiments described below, a user may select one or more of the graphics by performing a gesture on the graphics, for example, using one or more fingers 202 (not drawn to scale) or one or more styluses 203 (not drawn to scale). In some embodiments, selection of one or more graphics is performed when the user breaks contact with the one or more graphics. In some embodiments, the gesture optionally includes one or more taps, one or more swipes (left to right, right to left, upwards and / or downwards), and / or rolling (right to left, left to right, upwards and / or downwards) of a finger in contact with device 100. In some implementations or situations, accidental contact with a graphic does not select the graphic, for example, a swipe gesture sweeping over an application icon optionally does not select the corresponding application when the gesture corresponding to selection is a tap.

[0153] Device 100 also optionally includes one or more physical buttons, such as a “home” button or menu button 204. As previously mentioned, menu button 204 is optionally used to navigate to any application 136 within a set of applications executing on device 100. Alternatively, in some embodiments, the menu button is implemented as a soft key within a GUI displayed on touch screen 112.

[0154] In some embodiments, device 100 includes touch screen 112, menu button 204, push button 206 for powering the device on / off and locking the device, volume control button(s) 208, subscriber identity module (SIM) card slot 210, headset jack 212, and external port 124 for docking / charging. Push button 206 is optionally used to power the device on / off by pressing and holding the button down for a predefined period of time, to lock the device by pressing and releasing the button before the predefined time has elapsed, and / or to unlock the device or initiate an unlocking process. In an alternative embodiment, device 100 also accepts verbal input via microphone 113 to activate or deactivate some functions. Device 100 also optionally includes one or more contact intensity sensors 165 for detecting the intensity of a contact on touch screen 112 and / or one or more tactile output generators 167 for generating a tactile output to a user of device 100.

[0155] FIG. 3 is a block diagram of an exemplary multifunction device having a display and a touch-sensitive surface, according to some embodiments. Device 300 need not be portable. In some embodiments, device 300 is a laptop computer, a desktop computer, a tablet computer, a multimedia player device, a navigation device, an educational device (such as a child's learning toy), a gaming system, or a control device (e.g., a home or commercial controller). Device 300 typically includes one or more processing units (CPUs) 310, one or more network or other communication interfaces 360, memory 370, and one or more communication buses 320 that interconnect these components. Communication bus 320 optionally includes circuitry (sometimes referred to as a chipset) that interconnects and controls communication between system components. Device 300 includes input / output (I / O) interface 330, including display 340, which is typically a touchscreen display. I / O interface 330 also optionally includes a keyboard and / or mouse (or other pointing device) 350 and a touchpad 355, a tactile output generator 357 (e.g., similar to tactile output generator(s) 167 described above with reference to FIG. 1A) for generating tactile output on device 300, and sensors 359 (e.g., light, acceleration, proximity, touch sensing, and / or contact intensity sensors similar to contact intensity sensor(s) 165 described above with reference to FIG. 1A). Memory 370 includes high-speed random access memory, such as DRAM, SRAM, DDR RAM, or other random access solid-state memory devices, and optionally includes non-volatile memory, such as one or more magnetic disk storage devices, optical disk storage devices, flash memory devices, or other non-volatile solid-state storage devices. Memory 370 optionally includes one or more storage devices located remotely from CPU(s) 310.In some embodiments, memory 370 stores programs, modules, and data structures similar to, or a subset of, programs, modules, and data structures stored in memory 102 of portable multifunction device 100 (FIG. 1A). Additionally, memory 370 optionally stores additional programs, modules, and data structures not present in memory 102 of portable multifunction device 100. For example, memory 370 of device 300 optionally stores drawing module 380, presentation module 382, ​​word processing module 384, website creation module 386, disk authoring module 388, and / or spreadsheet module 390, whereas memory 102 of portable multifunction device 100 (FIG. 1A) optionally does not store these modules.

[0156] Each of the above-identified elements of FIG. 3 is optionally stored in one or more of the memory devices mentioned above. Each of the above-identified modules corresponds to an instruction set that performs the functions described above. The above-identified modules or computer programs (e.g., including instruction sets or instructions) need not be implemented as separate software programs (e.g., computer programs (e.g., including instructions)), procedures, or modules, and thus in various embodiments, various subsets of these modules are optionally combined or otherwise reconfigured. In some embodiments, memory 370 optionally stores a subset of the above-identified modules and data structures. Additionally, memory 370 optionally stores additional modules and data structures not described above.

[0157] Attention is now optionally directed to embodiments of user interfaces implemented, for example, on portable multifunction device 100.

[0158] 4A shows an exemplary user interface for a menu of applications on portable multifunction device 100, according to some embodiments. A similar user interface is optionally implemented on device 300. In some embodiments, user interface 400 includes the following elements, or a subset or superset thereof: ● signal strength indicator(s) 402 for wireless communication(s), such as cellular and Wi-Fi signals; ●Time 404, ●Bluetooth indicator 405, ● Battery status indicator 406, Tray 408 with icons of frequently used applications, such as: ○ An icon 416 for the phone module 138, labeled “Phone”, optionally including an indicator 414 of the number of missed calls or voicemail messages; ○ An icon 418 of the email client module 140, labeled “Mail”, optionally including an indicator 410 of the number of unread emails; ○ An icon 420 for the Browser module 147, labeled "Browser"; and ○ An icon 422 for the video and music player module 152, also called the iPod (trademark of Apple Inc.) module 152, labeled "iPod"; and ● Icons of other applications, such as: ○ Icon 424 of IM module 141, labeled "Messages"; ○ Icon 426 of the calendar module 148, labeled "Calendar", ○ Icon 428 of the image management module 144, labeled "Photos"; ○ An icon 430 of the camera module 143, labeled “camera”; ○ Icon 432 of the online video module 155, labeled "Online Video"; Icon 434 of Stock Price Widget 149-2, labeled "Stock Price" ○ Icon 436 of the map module 154, labeled "Map"; ○ Icon 438 of weather widget 149-1, labeled "Weather"; ○ Icon 440 of alarm clock widget 149-4, labeled "Clock"; ○ Icon 442 of Training Support Module 142, labeled "Training Support"; ○ An icon 444 of the Notes module 153, labeled "Notes"; and ○ A settings application or module icon 446 labeled “Settings,” which provides access to settings for the device 100 and its various applications 136 .

[0159] Note that the icon labels shown in FIG. 4A are merely exemplary. For example, icon 422 of video and music player module 152 is labeled "Music" or "Music Player." Other labels are optionally used for the various application icons. In some embodiments, the label for an individual application icon includes the name of the application that corresponds to the individual application icon. In some embodiments, the label of a particular application icon is different from the name of the application that corresponds to that particular application icon.

[0160] 4B shows an example user interface on a device (e.g., device 300 of FIG. 3) that has a touch-sensitive surface 451 (e.g., tablet or touchpad 355 of FIG. 3) that is separate from display 450 (e.g., touchscreen display 112). Device 300 also optionally includes one or more contact intensity sensors (e.g., one or more of sensors 359) that detect the intensity of a contact on touch-sensitive surface 451 and / or one or more tactile output generators 357 that generate a tactile output to a user of device 300.

[0161] Although some of the following examples are given with reference to input on touch screen display 112 (wherein the touch-sensitive surface and display are combined), in some embodiments the device detects input on a touch-sensitive surface that is separate from the display, as shown in FIG. 4B. In some embodiments, the touch-sensitive surface (e.g., 451 in FIG. 4B) has a primary axis (e.g., 452 in FIG. 4B) that corresponds to a primary axis (e.g., 453 in FIG. 4B) on the display (e.g., 450). According to these embodiments, the device detects contact with touch-sensitive surface 451 (e.g., 460 and 462 in FIG. 4B) at locations that correspond to respective locations on the display (e.g., in FIG. 4B, 460 corresponds to 468 and 462 corresponds to 470). In this manner, user input (e.g., contacts 460 and 462 and their movement) detected by the device on the touch-sensitive surface (e.g., 451 in FIG. 4B) is used by the device to operate a user interface on the display (e.g., 450 in FIG. 4B) of the multifunction device when the touch-sensitive surface is separate from the display. It is to be understood that similar methods are optionally used for the other user interfaces described herein.

[0162] In addition, while the following examples are given primarily with reference to finger input (e.g., finger contact, finger tap gesture, finger swipe gesture), it should be understood that in some embodiments, one or more of the finger inputs are replaced with input from another input device (e.g., mouse-based input or stylus input). For example, a swipe gesture is optionally replaced by a mouse click (e.g., instead of a contact) followed by movement of a cursor along the path of the swipe (e.g., instead of moving the contact). As another example, a tap gesture is optionally replaced by a mouse click (e.g., instead of detecting a contact and then ceasing to detect the contact) while the cursor is located over the location of the tap gesture. Similarly, it should be understood that when multiple user inputs are detected simultaneously, multiple computer mice are optionally used simultaneously, or mice and finger contacts are optionally used simultaneously.

[0163] FIG. 5A illustrates an exemplary personal electronic device 500. Device 500 includes a body 502. In some embodiments, device 500 can include some or all of the functionality described with respect to devices 100 and 300 (e.g., FIGS. 1A-4B). In some embodiments, device 500 has a touch-sensitive display screen 504, hereafter touch screen 504. Alternatively, or in addition to touch screen 504, device 500 has a display and a touch-sensitive surface. Similar to devices 100 and 300, in some embodiments, touch screen 504 (or touch-sensitive surface) optionally includes one or more intensity sensors that detect the intensity of a contact (e.g., a touch) being applied. The one or more intensity sensors of touch screen 504 (or touch-sensitive surface) can provide output data that represents the intensity of the touch. A user interface of device 500 can respond to touch(s) based on their intensity, meaning that touches of different intensities can invoke different user interface actions on device 500.

[0164] For exemplary techniques for detecting and processing touch intensity, see, for example, related applications International Patent Application No. PCT / US2013 / 040061, filed May 8, 2013, published as WO 2013 / 169849, entitled "Device, Method, and Graphical User Interface for Displaying User Interface Objects Corresponding to an Application," and International Patent Application No. PCT / US2013 / 069483, filed November 11, 2013, published as WO 2014 / 105276, entitled "Device, Method, and Graphical User Interface for Transitioning Between Touch Input to Display Output Relationships," each of which is incorporated by reference in its entirety herein.

[0165] In some embodiments, device 500 has one or more input mechanisms 506 and 508. Input mechanisms 506 and 508, if included, can be physical. Examples of physical input mechanisms include push buttons and rotatable mechanisms. In some embodiments, device 500 has one or more attachment mechanisms. Such attachment mechanisms, if included, can allow device 500 to be attached to, for example, hats, eyewear, earrings, necklaces, shirts, jackets, bracelets, watch bands, chains, pants, belts, shoes, wallets, backpacks, etc. These attachment mechanisms allow a user to wear device 500.

[0166] FIG. 5B illustrates an exemplary personal electronic device 500. In some embodiments, the device 500 can include some or all of the components described with respect to FIGS. 1A, 1B, and 3. The device 500 has a bus 512 that operably couples an I / O section 514 to one or more computer processors 516 and a memory 518. The I / O section 514 can be connected to a display 504, which can have a touch-sensing component 522 and, optionally, an intensity sensor 524 (e.g., a contact intensity sensor). In addition, the I / O section 514 can be connected to a communication unit 530 that receives application and operating system data using Wi-Fi, Bluetooth, near field communication (NFC), cellular, and / or other wireless communication technologies. The device 500 can include input mechanisms 506 and / or 508. The input mechanism 506 is optionally, for example, a rotatable input device or a depressible and rotatable input device. In some embodiments, input mechanism 508 is optionally a button.

[0167] In some embodiments, the input mechanism 508 is optionally a microphone. The personal electronic device 500 optionally includes various sensors, such as a GPS sensor 532, an accelerometer 534, an orientation sensor 540 (e.g., a compass), a gyroscope 536, a motion sensor 538, and / or combinations thereof, all of which may be operatively connected to the I / O section 514.

[0168] The memory 518 of the personal electronic device 500 can include one or more non-transitory computer-readable storage media for storing computer-executable instructions that, when executed by one or more computer processors 516, can, for example, cause the computer processors to perform the techniques described below, including processes 700, 800, 900, 1100, and 1300 (FIGS. 7-9, 11, and 13). A computer-readable storage medium can be any medium that can tangibly contain or store computer-executable instructions for use by or in connection with an instruction execution system, apparatus, or device. In some embodiments, the storage medium is a transient computer-readable storage medium. In some embodiments, the storage medium is a non-transitory computer-readable storage medium. A non-transitory computer-readable storage medium can include, but is not limited to, a magnetic storage device, an optical storage device, and / or a semiconductor storage device. Examples of such storage devices include magnetic disks, optical disks based on CD, DVD, or Blu-ray technology, and persistent solid-state memory such as flash, solid-state drives, etc. Personal electronic device 500 is not limited to the components and configuration of FIG. 5B and may include other or additional components in multiple configurations.

[0169] As used herein, the term "affordance" refers to a user-interactive graphical user interface object, optionally displayed on a display screen of device 100, 300, and / or 500 (FIGS. 1A, 3, and 5A-5B). For example, images (e.g., icons), buttons, and text (e.g., hyperlinks) each, optionally, constitute an affordance.

[0170] The term "focus selector" as used herein refers to an input element that indicates the current portion of the user interface with which the user is interacting. In some implementations involving a cursor or other location marker, the cursor acts as the "focus selector," such that when an input (e.g., a press input) is detected on a touch-sensitive surface (e.g., touchpad 355 of FIG. 3 or touch-sensitive surface 451 of FIG. 4B) while the cursor is positioned over a particular user interface element (e.g., a button, window, slider, or other user interface element), the particular user interface element is adjusted according to the detected input. In some implementations involving a touchscreen display (e.g., touch-sensitive display system 112 of FIG. 1A or touchscreen 112 of FIG. 4A) that allows direct interaction with user interface elements on the touchscreen display, a detected contact on the touchscreen acts as the "focus selector," such that when an input (e.g., a press input by contact) is detected at the location of a particular user interface element (e.g., a button, window, slider, or other user interface element) on the touchscreen display, the particular user interface element is adjusted according to the detected input. In some implementations, focus is moved from one region of the user interface to another region of the user interface without a corresponding cursor movement or contact movement on the touchscreen display (e.g., by using a tab key or arrow keys to move focus from one button to another), and in these implementations the focus selector moves to follow the movement of focus between various regions of the user interface. Regardless of the specific form that the focus selector takes, the focus selector is generally a user interface element (or contact on a touchscreen display) that is controlled by the user to communicate the user's intended interaction with the user interface (e.g., by indicating to the device which element of the user interface the user intends to interact with).For example, location of a focus selector (e.g., a cursor, touch, or selection box) over an individual button while a press input is detected on a touch-sensitive surface (e.g., a touchpad or touchscreen) indicates that the user intends to activate that individual button (and not other user interface elements shown on the device's display).

[0171] As used herein and in the claims, the term "characteristic intensity" of a contact refers to a characteristic of that contact based on one or more intensities of the contact. In some embodiments, the characteristic intensity is based on a plurality of intensity samples. The characteristic intensity is optionally based on a predefined number of intensity samples, i.e., a set of intensity samples collected during a predefined time (e.g., 0.05, 0.1, 0.2, 0.5, 1, 2, 5, 10 seconds) associated with a predefined event (e.g., after detecting a contact, before detecting a lift-off of the contact, before or after detecting the start of movement of the contact, before detecting an end of the contact, before or after detecting an increase in the intensity of the contact, and / or before or after detecting a decrease in the intensity of the contact). The characteristic intensity of a contact is optionally based on one or more of a maximum intensity of the contact, a mean value of the intensity of the contact, an average value of the intensity of the contact, a top 10 percentile value of the intensity of the contact, a half maximum intensity value of the contact, a 90 percent maximum intensity value of the contact, etc. In some embodiments, the duration of the contact is used in determining the characteristic intensity (e.g., when the characteristic intensity is an average of the intensity of the contact over time). In some embodiments, the characteristic intensity is compared to a set of one or more intensity thresholds to determine whether an action is performed by the user. For example, the set of one or more intensity thresholds optionally includes a first intensity threshold and a second intensity threshold. In this example, a contact having a characteristic intensity not exceeding the first threshold results in a first action, a contact having a characteristic intensity above the first intensity threshold but not exceeding the second intensity threshold results in a second action, and a contact having a characteristic intensity above the second threshold results in a third action. In some embodiments, the comparison between the characteristic intensity and the one or more thresholds is not used to determine whether the first action or the second action should be performed, but rather is used to determine whether one or more actions should be performed (e.g., whether to perform an individual action or to forgo performing an individual action).

[0172] In some embodiments, a portion of the gesture is identified for purposes of determining the characteristic intensity. For example, the touch-sensitive surface optionally receives successive swipe contacts that transition from a start location to an end location where the intensity of the contact increases. In this example, the characteristic intensity of the contact at the end location is optionally based on only a portion of the successive swipe contacts (e.g., only the portion of the swipe contact at the end location) rather than the entire swipe contact. In some embodiments, a smoothing algorithm is optionally applied to the intensity of the swipe contact prior to determining the characteristic intensity of the contact. For example, the smoothing algorithm optionally includes one or more of an unweighted moving average smoothing algorithm, a triangular smoothing algorithm, a median filter smoothing algorithm, and / or an exponential smoothing algorithm. In some circumstances, these smoothing algorithms eliminate narrow spikes or dips in the swipe contact intensity for purposes of determining the characteristic intensity.

[0173] The intensity of the contact on the touch-sensitive surface is optionally characterized against one or more intensity thresholds, such as a contact-detection intensity threshold, a light pressure intensity threshold, a deep pressure intensity threshold, and / or one or more other intensity thresholds. In some embodiments, the light pressure intensity threshold corresponds to an intensity at which the device performs an action normally associated with clicking a physical mouse button or trackpad. In some embodiments, the deep pressure intensity threshold corresponds to an intensity at which the device performs an action different from an action normally associated with clicking a physical mouse button or trackpad. In some embodiments, when a contact is detected having a characteristic intensity below the light pressure intensity threshold (e.g., and above a nominal contact-detection intensity threshold below which the contact is not detected), the device follows the movement of the contact on the touch-sensitive surface and moves the focus selector without performing an action associated with the light pressure intensity threshold or the deep pressure intensity threshold. In general, unless otherwise specified, these intensity thresholds are consistent among various sets of values ​​for a user interface.

[0174] An increase in the characteristic intensity of a contact from an intensity below the light pressure intensity threshold to an intensity between the light pressure intensity threshold and the deep pressure intensity threshold may be referred to as inputting a "light press." An increase in the characteristic intensity of a contact from an intensity below the deep pressure intensity threshold to an intensity above the deep pressure intensity threshold may be referred to as inputting a "deep press." An increase in the characteristic intensity of a contact from an intensity below the contact detection intensity threshold to an intensity between the contact detection intensity threshold and the light pressure intensity threshold may be referred to as detecting a contact on the touch surface. A decrease in the characteristic intensity of a contact from an intensity above the contact detection intensity threshold to an intensity below the contact detection intensity threshold may be referred to as detecting a lift-off of the contact from the touch surface. In some embodiments, the contact detection intensity threshold is zero. In some embodiments, the contact detection intensity threshold is greater than zero.

[0175] In some embodiments described herein, one or more actions are performed in response to detecting a gesture including an individual pressure input or in response to detecting an individual pressure input performed by an individual contact (or multiple contacts), where the individual pressure input is detected based at least in part on detecting an increase in intensity of the contact (or multiple contacts) above a pressure input intensity threshold. In some embodiments, the individual action is performed in response to detecting an increase in intensity of the individual contact above a pressure input intensity threshold (e.g., a "downstroke" of the individual pressure input). In some embodiments, the pressure input includes an increase in intensity of the individual contact above a pressure input intensity threshold followed by a decrease in intensity of the contact below the pressure input intensity threshold, where the individual action is performed in response to detecting a subsequent decrease in intensity of the individual contact below the pressure input intensity threshold (e.g., an "upstroke" of the individual pressure input).

[0176] In some embodiments, the device employs intensity hysteresis to avoid accidental inputs, sometimes referred to as "jitter," and the device defines or selects a hysteresis intensity threshold that has a predefined relationship to the pressure input intensity threshold (e.g., the hysteresis intensity threshold is X intensity units below the pressure input intensity threshold, or the hysteresis intensity threshold is 75%, 90%, or some reasonable percentage of the pressure input intensity threshold). Thus, in some embodiments, the pressure input includes an increase in intensity of a discrete contact above the pressure input intensity threshold, followed by a decrease in intensity of the contact below a hysteresis intensity threshold that corresponds to the pressure input intensity threshold, and a discrete action is performed in response to detecting a subsequent decrease in intensity of the discrete contact below the hysteresis intensity threshold (e.g., an "upstroke" of the discrete pressure input). Similarly, in some embodiments, a pressure input is detected only when the device detects an increase in the intensity of the contact from an intensity below the hysteresis intensity threshold to an intensity above the pressure input intensity threshold, and optionally a subsequent decrease in the intensity of the contact to an intensity below the hysteresis intensity, and a distinct action is performed in response to detecting the pressure input (e.g., an increase in the intensity of the contact or a decrease in the intensity of the contact, as the case may be).

[0177] For ease of explanation, descriptions of operations performed in response to a press input associated with a press input intensity threshold, or a gesture including a press input, are optionally triggered in response to detecting any of an increase in the intensity of a contact above the press input intensity threshold, an increase in the intensity of a contact from an intensity below a hysteresis intensity threshold to an intensity above the press input intensity threshold, a decrease in the intensity of a contact below the press input intensity threshold, and / or a decrease in the intensity of a contact below a hysteresis intensity threshold corresponding to the press input intensity threshold. Further, in examples where an operation is described as being performed in response to detecting a decrease in the intensity of a contact below a press input intensity threshold, the operation is optionally performed in response to detecting a decrease in the intensity of a contact below a hysteresis intensity threshold corresponding to and lower than the press input intensity threshold.

[0178] Attention is now directed to embodiments of user interfaces (“UI”) and associated processes implemented on an electronic device, such as portable multifunction device 100, device 300, or device 500.

[0179] 6A-6BJ illustrate exemplary user interfaces for modifying visual content in media, according to some embodiments. The user interfaces in these figures are used to explain the processes described below, including the processes in FIGS. 7, 8, and 9. Although the examples in FIGS. 6A-6BJ are described with respect to touch input on a touch-sensitive surface, it should be understood that taps, long presses, press-and-holds, swipes, and other touch gestures can be replaced with other inputs directed at the associated user interface element. For example, a tap can be replaced with a mouse click, a swipe can be replaced with a click and drag, a double tap can be replaced with a double click, and / or a long press (and / or press-and-hold) can be replaced with a right click or a click with a modifier key held down. Similarly, air gestures such as pinching two fingers together or touching fingers to a hand can replace a tap, pinching two fingers together followed by movement can replace a touch and drag, a double pinch can replace a double tap, and a long pinch can replace a long tap or tap and hold. In some embodiments, the location within the user interface to which the input is directed is determined based on a direct touch (e.g., a tap, double tap, long press, press and hold, or swipe on a user interface element), although the location to which the input is directed may also be determined based on other indications of user intent, such as the location of a displayed cursor or the location to which the user's gaze is directed.

[0180] 6A illustrates a computer system 600 (e.g., an electronic device) displaying a camera user interface including a live preview 630 that optionally extends from a top of a display of the computer system 600 to a bottom of a display of the computer system 600. In some embodiments, the computer system 600 optionally includes one or more features of device 100, device 300, or device 500. In some embodiments, the computer system 600 is a tablet, a phone, a laptop, a desktop, and / or a camera.

[0181] Live preview 630 is a representation of the field of view ("FOV") of one or more cameras of computer system 600. In some embodiments, live preview 630 is a representation of a partial FOV. In some embodiments, live preview 630 is based on images detected by one or more camera sensors. In some embodiments, computer system 600 captures images using multiple camera sensors and combines them to display live preview 630. In some embodiments, computer system 600 captures images using a single camera sensor and displays live preview 630.

[0182] The camera user interface of Figure 6A includes an indicator region 602 and a control region 606 that are positioned relative to the live preview 630 such that the indicators and controls can be displayed simultaneously with the live preview 630. The camera viewing region 604 does not substantially overlay the indicators and / or controls. As shown in Figure 6A, the camera user interface also includes visual borders 608 that indicate the boundaries between the indicator region 602 and the camera viewing region 604 and between the camera viewing region 604 and the control region 606.

[0183] As shown in FIG. 6A, the indicator area 602 includes indicators such as a flash indicator 602a, a mode setting indicator 602b, and an animated image indicator 602c. The flash indicator 602a indicates whether the flash mode is on (e.g., activated), off (e.g., not activated), or in another mode (e.g., automatic mode). In FIG. 6A, the flash indicator 602a indicates that the flash mode is off, and thus, flash operation is not used when the computer system 600 is capturing media. Furthermore, the mode-setting indicator 602b, when selected, causes the computer system 600 to replace the camera mode control 620 with a camera setting control for setting multiple settings of the currently selected camera mode (e.g., photo camera mode in FIG. 6A). The animated image indicator 602c indicates whether the camera is configured to capture a single image or multiple images (e.g., in response to detecting a request to capture media). In some embodiments, the indicator area 602 comprises an optionally colored (eg, gray, semi-transparent) overlay superimposed on the live preview 630.

[0184] As shown in FIG. 6A, the camera viewing area 604 includes a live preview 630 and zoom controls (e.g., affordances) 622. The zoom controls 622 include a 0.5× zoom control 622a, a 1× zoom control 622b, and a 2× zoom control 622c. As shown in FIG. 6A, the 1× zoom control 622b is enlarged relative to the other zoom controls, indicating that the 1× zoom control 622b is selected and that the computer system 600 is displaying the live preview 630 at a “1×” zoom level. In some embodiments, the computer system 600 indicates the 1× zoom control 622b as selected by displaying the 1× zoom control 622b in a different color than the other zoom controls 622.

[0185] As shown in FIG. 6A, the control area 606 includes a camera mode control 620, a shutter control 610, a camera switcher control 614, and a representation of a media collection 612. In FIG. 6A, camera mode controls 620a-620e are displayed, including a panoramic mode control 620a, a portrait mode control 620b, a photo mode control 620c, a video mode control 620d, and a cinematic video mode control 620e. As shown in FIG. 6A, the photo mode control 620c has been selected, which is indicated by the photo mode control 620c being in bold. When the photo mode control 620c is selected, the computer system 600 initiates (e.g., and / or captures) capture of photographic media (e.g., a still image) in response to the computer system 600 detecting an input directed to the shutter control 610. The photographic media captured by the computer system 600 represents a live preview 630 that is displayed when an input is directed to the shutter control 610. In some embodiments, in response to detecting input directed to panoramic mode control 620a, computer system 600 initiates capture of panoramic media (e.g., panoramic photo). In some embodiments, in response to detecting input directed to portrait mode control 620b, computer system 600 initiates capture of portrait media (e.g., still photo, still photo with blur applied). In some embodiments, in response to detecting input directed to video mode control 620d, computer system 600 initiates capture of video media (e.g., video). In some embodiments, indicators and / or controls displayed on the camera user interface are based on the selected mode (e.g., and / or the mode in which computer system 600 is configured to operate based on the selected camera mode).

[0186] In FIG. 6A, a shutter control 610, when activated, causes the computer system 600 to capture media (e.g., a photo when the shutter control 610 is activated in FIG. 6A) using one or more camera sensors based on the current state of the live preview 630 and the current state of the camera application (e.g., which camera mode is selected). The captured media is stored locally on the computer system 600 and / or sent to a remote server for storage. A camera switcher control 614, when activated, causes the computer system 600 to switch to show different camera views in the live preview 630, such as by switching between a rear camera sensor and a front camera sensor. The representation of the media collection 612 shown in FIG. 6A is a representation of media (e.g., images, videos) most recently captured by the computer system 600. In some embodiments, in response to detecting an input to the media collection 612, the computer system 600 displays a user interface similar to the user interface shown in FIG. 7 (described below). In some embodiments, the indicator area 602 comprises an optionally colored (eg, gray, semi-transparent) overlay superimposed on the live preview 630.

[0187] As discussed above, Figures 6A-6BJ illustrate exemplary user interfaces for modifying visual content, according to some embodiments. In particular, Figures 6A-6AC illustrate exemplary embodiments in which a synthetic (e.g., simulated, computer-generated) depth of field effect is applied to the visual content of currently captured media. The synthetic depth of field effect is applied automatically (e.g., without responding to one or more inputs) and / or in response to user input. When the synthetic depth of field effect is applied automatically, the computer system 600 makes one or more decisions based on a set of criteria to determine how the synthetic depth of field effect is applied, and applies the synthetic depth of field effect (e.g., without detecting an input to apply the synthetic depth of field effect). When the synthetic depth of field effect is applied in response to user input, the computer system 600 detects the input and applies the synthetic depth of field effect based on the type of input detected.

[0188] As shown in Figure 6A, computer system 600 displays a live preview 630 that includes John 632 and Jane 634. As shown by live preview 630, John 632 is located closer to one or more rear cameras of computer system 600 than Jane 634. The live preview 630 in Figure 6A is displayed without a synthetic depth of field effect applied. However, it should be understood that the live preview 630 in Figure 6A is displayed with a natural depth of field effect.

[0189] As used herein, natural depth of field is different from synthetic depth of field effect. Natural depth of field effect is generated based on the size of the aperture and focal length of one or more cameras capturing the scene, as well as the distance between the subject (e.g., person, animal, object) in the scene and the one or more cameras. Thus, natural depth of field effect is directly limited by the physical specifications (e.g., focal length, size of aperture) of one or more cameras used to capture the scene. However, synthetic depth of field effect is a computer-generated depth of field effect (e.g., via software) that is not strictly limited by the physical specifications of one or more cameras and / or the distance between the subject in the scene and one or more cameras.

[0190] Thus, applying a synthetic depth of field effect can have distinct advantages over only applying a natural depth of field effect to media. For example, applying a synthetic depth of field effect is advantageous over only applying a natural depth of field effect because the synthetic depth of field effect can be applied and adjusted in more ways during the capture of the media (e.g., in real time) (whereas adjusting a natural depth of field effect is limited by the physical specifications of one or more cameras). Additionally, a synthetic depth of field effect provides an advantage because the hardware (e.g., one or more cameras) of the computer system 600 does not need to be switched to apply a particular depth of field effect (e.g., and / or to replace a depth of field effect having one type of tracking with a depth of field effect having another type of tracking during a portion of the video). In some embodiments, types of tracking for depth of field effects include emphasizing a particular subject relative to one or more other subjects in the media (e.g., for the duration of the media, or only for a portion of the duration of the media), emphasizing a subject at a particular location in the media relative to other subjects in the media, etc.

[0191] As shown in Figures 6A-6BJ, the synthetic depth of field effect of the scene (e.g., 630, 640, and / or 660) displayed by the computer system 600 is indicated by shading (e.g., white, gray, black). Portions of the scene shown in darker shading have a greater amount of synthetic blur (e.g., synthetic depth of field effect) than portions of the scene having lighter shading. It should be understood that the shading shown in Figures 6A-6BJ does not represent an exact / precise representation of the synthetic depth of field effect applied to the scene shown in these figures. However, the shading shown in Figures 6A-6BJ is provided to illustrate how the synthetic depth of field effect is applied and / or modified to objects in the scene automatically and / or in response to user input. As shown in Figure 6A, the live preview 630 is not shaded (e.g., is white), which indicates that the live preview 630 has only blur caused by the natural depth of field effect. In FIG. 6A, the computer system 600 detects a right swipe input 650a1 on the live preview 630 and / or a tap input 620e on the cinematic video mode control 650a2.

[0192] In response to detecting right swipe input 650a1 and / or tap input 650a2 in Figure 6B, computer system 600 moves camera mode control 620 to the right such that cinematic video mode control 620e is displayed in the center of the camera user interface. In Figure 6B, computer system 600 displays cinematic video mode control 620e as selected (e.g., in bold) and stops displaying photo mode control 620a as selected. Further, in response to detecting right swipe input 650a, computer system 600 transitions from being configured to operate in photo camera mode to cinematic video camera mode. In some embodiments, the computer system 600 detects a left swipe input while the cinematic video mode control 620e is displayed as selected, and in response to detecting a left swipe input (e.g., in the opposite direction to the right swipe input 650a1), the computer system 600 moves the camera mode control to the left such that the photo mode control 620c is displayed as selected.

[0193] While computer system 600 is operating in a cinematic video camera mode, computer system 600 applies a synthetic depth of field effect. In some embodiments, some camera modes employ a synthetic depth of field effect (e.g., cinematic video camera mode), while other camera modes do not employ a synthetic depth of field effect (e.g., photo mode, portrait mode, video mode). In some embodiments, synthetic depth of field can be manually enabled or disabled for any given camera mode. In FIG. 6B, the applied synthetic depth of field effect emphasizes John 632 relative to Jane 634 (e.g., making John appear more prominent than Jane due to less blur), which can be seen via live preview 630, which shows John 632 and the area around John 632 being shaded lighter than Jane 634 and the area around Jane 634. In particular, John 632 is not shaded in the live preview 630, indicating that John 632 is displayed with only natural blur (if any) produced by the natural depth of field effect of one or more cameras of the computer system 600. Additionally, John 632 is not shaded in the live preview 630, indicating that the synthetic depth of field effect is not having synthetic blur applied to John 632. Jane 634, on the other hand, appears shaded (e.g., darker than John 632) because the computer system 600 is applying synthetic blur to Jane 634 via the synthetic depth of field effect applied in FIG. 6B. In some embodiments, the natural blur is less visually noticeable (or has less blur) than some of the blur displayed when applying a synthetic depth of field effect.

[0194] As shown in FIG. 6B, the computer system 600 displays a primary subject indicator 672a around the head of John 632 and a secondary subject indicator 674b around the head of Jane 634. The primary subject indicator 672a is displayed around the head of John 632 because John 632 has been enhanced via the applied composite depth of field effect. The secondary subject indicator 674b is displayed around the head of Jane 634 because Jane 634 has not been enhanced via the applied composite depth of field effect. Thus, in FIG. 6B, the computer system 600 displays different indicators to distinguish subjects that are enhanced by the composite depth of field effect from subjects that are not enhanced by the composite depth of field effect. In some embodiments, the secondary subject indicator 674b is displayed around the head of Jane 634 because the computer system 600 has sufficient visual content to track and / or focus on (and / or apply a composite depth of field effect to enhance) Jane 632. In some embodiments, if the computer system 600 does not have enough visual content to track and / or focus on Jane 632, then secondary subject indicators are not displayed around Jane 634's head (and / or secondary subject indicators corresponding to Jane 634 are not displayed).

[0195] As shown in Figure 6B, different portions of the scene shown in live preview 630 have different levels of blur applied. For example, the trees and grass in live preview 630 of Figure 6B are shown with less detail than the trees and grass in live preview 630 of Figure 6A, indicating that the background, foreground, and / or different portions of the scene are also blurred (e.g., not just the subjects in the scene). Additionally, portions of the background of the scene in live preview 630 appear blurred (e.g., with darker shading) than the subjects (e.g., John 632 and Jane 634) in live preview 630 after the synthetic depth of field effect has been applied.

[0196] In addition to applying the synthetic depth of field effect, in response to detecting the right swipe input 650a1 and / or the tap input 650a2, the computer system 600 expands the live preview 630 in FIG. 6B so that the live preview 630 in FIG. 6B occupies more area of ​​the computer system 600 than the live preview 630 in FIG. 6A. In response to detecting the right swipe input 650a1 and / or the tap input 650a2, the computer system 600 continues to display the flash indicator 602a and stops displaying the setting mode indicator 602b and the animated image indicator 602c of FIG. 6A in the indicator area 602 in FIG. 6B. As shown in FIG. 6B, the computer system 600 displays an elapsed time indicator 602d in the position where the mode setting indicator 602b was previously displayed in FIG. 6A. Additionally, the computer system 600 displays a depth indicator 602e in place of the animated image indicator 602c. In some embodiments, in response to receiving input directed at depth indicator 602e, computer system 600 displays controls for adjusting the blur effect applied to the captured media (e.g., as described below in FIGS. 6AD-6AH). In some embodiments, computer system 600 updates live preview 630 as the controls for adjusting the blur effect are changed (e.g., using one or more techniques such as those described below in connection with FIGS. 6AD-6AF).

[0197] 6B, in response to detecting right swipe input 650a1 and / or tap input 650a2, computer system 600 also ceases displaying 0.5x zoom control 622a and 2x zoom control 622c and maintains display of 1x zoom control 622b. In some embodiments, computer system 600 continues to display 1x zoom control 622b because a determination is made that the synthetic depth of field effect will only be applied when computer system 600 is displaying a particular zoom level (e.g., 1x) and / or range of zoom levels (e.g., 0.8x zoom to 1.7x zoom). In some embodiments, the computer system 600 continues to display the 1x zoom control 622b because a set of cameras (e.g., a wide-angle camera (e.g., a camera having an f / 1.6 aperture (e.g., and / or an f / 1.4 to f / 8.0 aperture) and a 60° to 120° field of view)) is used to capture cinematic video media at a 1x zoom level (and / or a range of zoom values ​​including the 1x zoom level). In some embodiments, the computer system 600 stops displaying the zoom control 622a and the 2x zoom control 622c because a particular set of cameras (e.g., ultra-wide angle cameras (e.g., cameras with f / 2.4 aperture (e.g., and / or f / 1.4 to f / 8.0 aperture) and a field of view greater than 120°), telephoto cameras (e.g., cameras with f / 2.0 aperture (e.g., and / or f / 1.4 to f / 8.0 aperture) and a field of view between 30° and 60° and / or a field of view less than 60°) do not capture cinematic media at 0.5x and / or 2x zoom levels. In some embodiments, the computer system 600 detects that it is not preferred and / or not optimal (e.g., due to the physical specifications of the particular camera set) to use the particular camera set when applying a synthetic depth of field effect. In FIG. 6B, the computer system 600 detects a rotation 650b1 and a tap input 650b2 directed at the shutter control 610.

[0198] As shown in FIG. 6C, in response to detecting the rotation 650b1, the computer system 600 transitions the camera user interface from portrait to landscape orientation. In particular, FIG. 6C illustrates two computer systems. The computer system 600 is located on the right side of FIG. 6C, and the computer system 690 is located on the left side of FIG. 6C. Both the computer system 600 and the computer system 690 are shown with their respective user interfaces in landscape orientation. In response to the tap input 650b2, the computer system 600 of FIG. 6C captures video and displays a stop control 616. In particular, the computer system 600 of FIG. 6C is shown to indicate that the frame of video being captured (e.g., the live preview 630) is at a one second capture duration (e.g., as indicated by the elapsed time indicator 602d) and / or that one second has elapsed since the tap input 650b2 was received. Computer system 690 is provided to illustrate how a computer system displays frames of video being captured by computer system 600 in FIG. 6C during playback of the video (e.g., after the complete video has been captured by computer system 600). One reason computer system 690 is provided is to illustrate the differences and / or similarities between how frames of video are displayed while the video is being captured and how frames of video are displayed after the video has been captured and played back. In some embodiments, computer system 600 and computer system 690 are the same system (e.g., at different times). In some embodiments, computer system 600 and computer system 690 are different systems (e.g., a file representing the video captured by computer system 600 has been transferred to computer system 690 after the video has been captured).

[0199] As shown in FIG. 6C, computer system 690 presents a media playback user interface that includes a previously captured media representation 640 and an elapsed time indicator 646. As alluded to above, the previously captured media representation 640 is a frame that is displayed during playback of a video being captured by computer system 600 (e.g., a frame captured and shown via live preview 630). Thus, as shown in FIG. 6C, live preview 630 and the previously captured media representation 640 represent the same frame of a video being captured by computer system 600, but are shown at different instances in time (e.g., during capture of the video versus during playback of the video). Thus, the previously captured media representation 640 is shown during a one second capture duration (and / or one second mark) of the video (e.g., as indicated by elapsed time indicator 646). Thus, elapsed time indicator 602d and elapsed time indicator 646 are displayed at the same elapsed time (e.g., one second) for the video.

[0200] 6C also includes a graph 680 including activity trackers 680a, 680b, and 680c. Displayed within activity tracker 680a is John's activity level 680a1 (e.g., the activity level of John 632). Displayed within activity tracker 680b is Jane's activity level 680b1 (e.g., the activity level of Jane 634). John's activity level 680a1 and Jane's activity level 680b2 are activity levels detected and registered by computer system 600 in real time to correspond to the activity levels of John 632 and Jane 634. Additionally, John's activity level 680a1 does not represent an absolute activity level of John 632, and Jane's activity level 680b2 does not represent an absolute activity level of Jane 634. Rather, John's activity level 680a1 represents the relative activity of John 632 compared to the activity level of Jane 634, and Jane's activity level 680a1 represents the relative activity of Jane 634 compared to the activity level of John 632. Furthermore, the activity levels shown in FIG. 6E represent activity levels detected / processed by computer system 600 in real time, which may lag behind the actual characteristics used to determine the activity level of a subject in a scene (e.g., the subject's physical / visual characteristics to determine whether the subject is talking, moving, gazing in a particular direction, obscured by one or more other objects in the scene, etc.). As shown in FIG. 6C, activity tracker 680c does not include an activity level because dog 638 was not captured by computer system 600 (e.g., not displayed in live preview 630) before the one second elapsed time indicated by elapsed time indicator 602d.With reference to FIG. 6W, when a dog 638 (e.g., dog 638 displayed in live preview 630 of FIG. 6W) is captured by computer system 600, activity tracker 680c (e.g., FIG. 6C) includes dog activity level 680c1 (e.g., activity level of dog 638). The activity level displayed in graph 680 represents the subject's activity level at a particular time (e.g., 0:00-0:45) within the video being captured by computer system 600. As shown in FIG. 6C, John's activity level 680a1 is higher than Jane's activity level 680b1 (e.g., as shown by John's activity level 680a1 occupying more area than Jane's activity level 680b1). 6C , John's activity level 680a1 is higher because John 632 is closer to one or more cameras of computer system 600 (e.g., capturing the scene shown in live preview 630) and John 632 is currently speaking (e.g., as indicated by John 632's mouth being higher). Additionally, Jane's activity level 680b1 is lower because Jane 634 is farther away from one or more cameras of computer system 600 and Jane 634 is not speaking (e.g., as indicated by Jane 634's mouth being closed).

[0201] In Figure 6C, in response to detecting tap input 650b2, computer system 600 begins capturing video and a determination is made that John 632 meets the set of automatic selection criteria (e.g., based on John 632's activity level). Specifically, John 632 meets the set of automatic selection criteria because he had a higher activity level than Jane 634 during the duration the video was captured (e.g., as indicated by John's activity level 680a1 being higher than Jane's activity level 680b1 between 0 and 1 seconds). As shown in Figure 6C, since a determination is made that John 632 meets the set of automatic selection criteria, computer system 600 applies a synthetic depth of field effect to frames of the video being captured for the 1 second capture duration. 6C , the applied synthetic depth of field effect emphasizes John 632 relative to Jane 634 such that John 632 appears less blurry (e.g., as indicated by John 632 having a lighter shade than Jane 634). Additionally, the computer system 600 displays a primary subject indicator 672a around the head of John 632 because John 632 is emphasized by the synthetic depth of field effect, and a secondary subject indicator 674b around the head of Jane 634 because Jane 634 is not emphasized by the synthetic depth of field effect.

[0202] As shown in FIG. 6C, a graph 680 is provided to indicate which object is being highlighted by the synthetic depth of field effect at a particular time. As shown in FIG. 6C, the graph 680 includes a media capture line 680d1 and a media playback line 680d2. The media capture line 680d1 indicates the object being highlighted by the synthetic depth of field effect at a particular time during the capture of the video (e.g., by the computer system 600). Additionally, the media playback line 680d2 indicates the object being highlighted by the synthetic depth of field effect at a particular time during the playback of the video (e.g., by the computer system 690). When the media capture line 680d1 is at (or near) the centerline of an individual activity tracker (e.g., the media capture line 680d1 is on the centerline of John's activity tracker 680a in FIG. 6C), the computer system 600 is applying a synthetic depth of field effect to highlight the individual object relative to other objects in the FOV at a particular time. Similarly, when the media playback line 680d2 is at (or near) the centerline of an individual activity tracker (e.g., the media playback line 680d2 is on the centerline of John's activity tracker 680a in FIG. 6C), the computer system 600 applies a synthetic depth of field effect to emphasize the individual subject relative to other subjects in the FOV at a particular time. Thus, a computer system 600 displaying a live preview 630 with a synthetic depth of field effect that emphasizes John 632 relative to Jane 634 is indicated by a media capture line 680d1 that is at the center of John's activity tracker 680a. And a computer system 690 displaying a previously captured media representation 640 with a synthetic depth of field effect that emphasizes John 632 relative to Jane 634 is indicated by a media playback line 680d2 that is at the center of John's activity tracker 680a.At certain times on the graph 680 where the media capture line 680d1 or the media playback line 680d2 are not at the center of the individual media trackers (e.g., graph 680 of FIG. 6F from 2 seconds to 3 seconds in the media), the computer system shifts the synthetic depth of field effect so that the new object is emphasized over the individual objects in the media.

[0203] 6D-6G illustrate an example embodiment in which computer system 600 automatically modifies a synthetic depth of field effect to emphasize Jane 634 relative to John 632. As shown in FIG. 6D, computer system 600 displays a scene (e.g., representing a frame of the video) shown in live preview 630 at 2 seconds into the capture of the video (e.g., as indicated by elapsed time indicator 602d). Live preview 630 shows John 632's eyes looking out of one or more cameras in FIG. 6D, which is a change from John 632's eyes in live preview 630 of FIG. 6C. Thus, John 632's gaze has changed from being directed toward one or more cameras of computer system 600 in FIG. 6C to being directed away from one or more cameras of computer system 600 in FIG. 6D. A subject's gaze being directed toward one or more cameras of computer system 600 can increase the subject's activity level, which increases the probability that the subject meets the automatic selection criteria. However, a subject's gaze being directed away from one or more cameras of computer system 600 may decrease the subject's activity, which decreases the likelihood that the subject will meet the automatic selection criteria. Thus, in FIG. 6D, John 632's activity level begins to decrease along with the probability that John 632 will continue to meet the set of automatic selection criteria. In addition to the change in gaze, John 632 has stopped speaking in FIG. 6D, and Jane 634 has started speaking in FIG. 6D. However, computer system 600 has not made a determination that Jane 634 has met the set of automatic selection criteria because computer system 600 is detecting the subject's activity level in real-time (e.g., as the video is being captured) and more information (e.g., data, visual content) is needed to make this determination.As shown in Figure 6D, computer system 600 continues to apply a synthetic depth of field effect to emphasize John 632 relative to Jane 634 because no determination has been made that Jane 634 meets the set of automatic selection criteria within the time frame of the video (e.g., computer system 600 is still relying on the determination made regarding John meeting the set of automatic selection criteria described above in Figure 6C). Notably, John's activity level 680a1 continues to be greater than Jane's activity level 680b2 in graph 680 of Figure 6D to indicate that computer system 600 has not detected a relative change in the activity levels of John 632 and Jane 634.

[0204] In contrast to computer system 600 of FIG. 6D, computer system 690 of FIG. 6D is playing a video previously captured by computer system 600. Thus, computer system 690 has enough information to make a determination that Jane 634 meets the set of automatic selection criteria. This is at least because computer system 690 has more (or all) of the information corresponding to the captured video. Thus, because computer system 690 has access to information in the previously captured video, computer system 690 can make a determination regarding whether a subject meets the set of automatic criteria within a particular time frame of the video. In FIG. 6D, computer system 690 makes a determination that Jane 634 meets the automatic selection criteria within a time frame of the video, and based on this determination, automatically applies a synthetic depth of field effect to highlight Jane 634 relative to John 632. However, as shown in Figures 6D-6G, computer system 690 displays an animation of previously captured media representation 640 to transition smoothly from emphasizing John 632 relative to Jane 634 to emphasizing Jane 634 relative to John 632 (e.g., instead of a more abrupt transition) As part of the animation, computer system 690 gradually displays John 632 in a blurrier manner and gradually displays Jane 634 in a blurrier manner, such that Jane 634 is emphasized relative to John 632 in Figure 6G (e.g., the difference in blur is approximately the same when John 632 is emphasized relative to Jane 634 in Figure 6B).

[0205] As shown in FIG. 6E, the computer system 600 displays the scene shown in the live preview 630 at 3 seconds during the capture of the video (e.g., as indicated by the elapsed time indicator 602d). The live preview 630 continues to show the eyes of John 632 looking from one or more cameras of FIG. 6E (e.g., unchanged from the live preview 630 of FIG. 6D). In FIG. 6E, the computer system 600 has not made a determination that Jane 634 meets the set of automatic selection criteria because the computer system 600 needs more information (e.g., data, content) to make this determination. As shown in FIG. 6D, because a determination has not been made that Jane 634 meets the set of automatic selection criteria, the computer system 600 continues to apply a synthetic depth of field effect to emphasize John 632 relative to Jane 634.

[0206] As shown in FIG. 6F, computer system 600 displays the scene shown in live preview 630 during the capture video. Although elapsed time indicator 602d shows 3 seconds in FIG. 6F, live preview 630 in FIG. 6F is displayed after live preview 630 in FIG. 6E is displayed. In FIG. 6F, computer system 600 makes a determination that Jane 634 meets a set of automatic selection criteria (e.g., because computer system 600 has sufficient information in FIG. 6F). Based on this determination, computer system 600 automatically modifies the synthetic depth of field effect to emphasize Jane 634 relative to John 632, and displays an animation of John 632 with more blur and Jane 634 with less blur in FIGs. 6F-6G.

[0207] In particular, the animation displayed by computer system 600 in Figures 6F-6G includes a more abrupt and less smooth transition compared to the transition including animation by computer system 690 in Figures 6E-6G. This is at least because computer system 690 was able to determine that a set of automatic selection criteria was met and that a change in the composite depth of field effect to emphasize Jane 634 relative to John 632 must occur by 4 seconds into the playback / capture of the video before computer system 600 can make this determination (e.g., for computer system 600's live preview 630 to update to show the complete change in the composite depth of field effect in Figure 6G). In Figure 6G, media capture line 680d1 and media playback line 680d2 of graph 680 provide context for the comparison of the animations displayed by computer systems 600 and 690. Media capture line 680d1 moves from John's activity tracker 680a to the woman's activity tracker 680b at a later time than media playback line 680d2. Further, the media capture line 680d1 ramps down faster (e.g., the shorter and more abrupt animation of Figures 6F-6G displayed by the computer system 600) than the media playback line 680d2 (e.g., the longer and smoother animation of Figures 6E-6G displayed by the computer system 600).

[0208] As shown in Figure 6G, computer system 600 and computer system 690 apply a synthetic depth of field effect (e.g., when the shading of live preview 630 matches the shading of previously captured media representation 640) to highlight Jane 634 relative to John 632. As shown in Figure 6G, along with applying the synthetic depth of field effect to highlight Jane 634 relative to John 632, computer system 600 stops displaying primary subject indicator 672a around John 632's head and secondary subject indicator 674b around Jane 632's head, and displays primary subject indicator 672b around Jane 634's head and secondary subject indicator 674a around John 634's head. Primary subject indicator 672b indicates that Jane 634 is now highlighted by the synthetic depth of field effect, and secondary subject indicator 674b indicates that John 632 is not highlighted by the synthetic depth of field effect. As shown in Figures 6F-6G, primary object indicator 672a of Figure 6F and primary object indicator 672b of Figure 6G have the same visual appearance (e.g., focus brackets, same shape, and / or same object). Similarly, secondary object indicator 674a of Figure 6G and secondary object indicator 674b of Figure 6F have the same visual appearance (e.g., rectangular, same shape, and / or same object). However, the primary object indicator and secondary object indicator do not have the same visual appearance (e.g., 672a-672b compared to 674a-674b of Figures 6F-6G). In some embodiments, the computer system 600 stops displaying the primary subject indicator 672a around John 632's head and the secondary subject indicator 674b around Jane 634's head, and / or displays the primary subject indicator 672b around Jane 634's head and the secondary subject indicator 674a around John 632's head during the animation of the transition of the change in the application of the synthetic depth of field effect.

[0209] In some embodiments, computer system 600 and computer system 690 display the respective animations differently than the animations illustrated and discussed above in connection with FIGS. 6AD-6AG. In some embodiments, computer system 600 determines that an automatic change of the composite depth of field effect should occur (e.g., computer system 600 makes this determination 4 seconds into the capture of the video). In some embodiments, computer system 600 automatically displays an animation of the change of the composite depth of field effect (e.g., an animation that plays between 4 and 5 times during the capture of the video) when it is determined that an automatic change of the composite depth of field effect should occur. In some embodiments, the displayed animation is fully completed such that live preview 630 is updated to indicate completion of the change of the composite depth of field effect some time after the determination is made (e.g., 5 seconds into the capture of the video). In some embodiments, computer system 690 determines that an automatic change to the composite depth of field effect should occur at the time (e.g., 4 seconds) that computer system 600 made this determination while capturing the live video (e.g., computer system 690 makes this determination at 3 seconds into the playback of the video). In some embodiments, computer system 690 displays an animation of the change to the composite depth of field effect (e.g., an animation displayed between 3 and 4 seconds into the playback of the video) when computer system 690 determined that an automatic change to the composite depth of field effect should occur. In some embodiments, the animation of the change to the composite depth of field effect displayed by computer system 690 is fully completed such that the previously captured media representation 640 is updated to indicate completion of the change to the composite depth of field effect at the time (e.g., 4 seconds) that computer system 600 made its determination while capturing the live video.In some embodiments, the animation displayed by computer system 690 is the same length as the animation displayed by computer system 600 (e.g., both animations are 1-5 seconds). In some embodiments, the animation displayed by computer system 690 is fully completed at a time that corresponds to a time in the video that is earlier than the time that the animation displayed by computer system 600 is fully completed.

[0210] 6H-6K illustrate an exemplary embodiment in which computer system 600 automatically modifies a synthetic depth of field effect to emphasize John 632 relative to Jane 634. As shown in FIG. 6H, computer system 600 displays a scene (e.g., representing a frame of the video) shown in live preview 630 at 6 seconds into the capture of the video (e.g., as indicated by elapsed time indicator 602d). Live preview 630 in FIG. 6H indicates that John 632's head has moved (e.g., to the side), indicating that John 632 is moving within the field of view of one or more cameras. An increase in the subject's movement within the field of view of one or more cameras can increase the subject's activity level, which increases the probability that the subject meets the automatic selection criteria. Conversely, a decrease in the subject's movement within the field of view of one or more cameras can decrease the subject's activity level, which decreases the probability that the subject meets the automatic selection criteria. Additionally, Jane 634 has stopped speaking (e.g., as indicated by Jane 634's mouth being closed in FIG. 6H). As shown in FIG. 6H, computer system 600 continues to apply a synthetic depth of field effect to highlight Jane 634 relative to John 632 because computer system 600 does not have sufficient information to make a determination that Jane 634 meets the set of automatic selection criteria (e.g., for reasons similar to those described above in connection with FIG. 6D).

[0211] In contrast to computer system 600 of FIG. 6H, computer system 690 makes a determination that Jane 634 meets a set of automatic selection criteria within a particular time frame of the video (e.g., for reasons similar to those described above in connection with FIGS. 6D-6G) and, based on this determination, automatically modifies the synthetic depth of field effect to emphasize John 632 relative to Jane 634. As shown in FIGS. 6H-6K, computer system 690 displays an animation of previously captured media representation 640 that smoothly transitions from an emphasis of Jane 634 relative to John 632 to an emphasis of John 632 relative to Jane 634. As part of the animation, computer system 690 gradually displays Jane 634 as more blurred and John 632 as less blurred, such that John 632 is emphasized relative to Jane 634 in FIG. 6K (e.g., using one or more similar techniques described above in connection with FIGS. 6D-6G).

[0212] As shown in FIG. 6I, the computer system 600 displays the scene shown in the live preview 630 at 7 seconds into the capture of the video (e.g., as indicated by the elapsed time indicator 602d). The live preview 630 continues to show that John 632 is moving within the FOV (e.g., John 632's head is in a different position in FIG. 6I than in FIG. 6H). In FIG. 6I, the computer system 600 has not made a determination that John 632 meets the set of automatic selection criteria because more information is needed to make this determination. As shown in FIG. 6I, the computer system 600 continues to apply a synthetic depth of field effect to emphasize Jane 634 relative to John 632 because a determination has not been made that John 632 meets the set of automatic selection criteria (e.g., relying on the determination made in FIG. 6F).

[0213] As shown in FIG. 6J, the computer system 600 displays the scene shown in the live preview 630 during the captured video, and the computer system 600 continues to indicate that John 632 is moving within the FOV. After the live preview 630 of FIG. 6I is displayed while the elapsed time indicator 602d indicates 7 seconds, the live preview 630 of FIG. 6J is displayed. In FIG. 6J, the computer system 600 makes a determination that John 632 meets a set of automatic selection criteria (e.g., for reasons similar to those described above in connection with FIGS. 6F-6G). Based on this determination, the computer system 600 automatically modifies the synthetic depth of field effect to emphasize John 632 relative to Jane 634, and displays an animation of John 632 appearing blurred with decreasing and John 632 appearing blurred with increasing (e.g., using one or more techniques, for reasons similar to those described above in connection with FIGS. 6F-6G). As shown in Figure 6G, along with applying a synthetic depth of field effect to emphasize John 632 relative to Jane 634, the computer system 600 displays a primary subject indicator 672a around the head of John 632 and a secondary subject indicator 674b around the head of Jane 634 (e.g., using one or more techniques, for reasons similar to those discussed above in connection with Figures 6F-6G). The media capture line 680d1 and media playback line 680d2 of the graph 680 of Figures 6G-6J are also updated and displayed for reasons similar to those discussed above in connection with Figures 6F-6G.

[0214] 6L-6M illustrate an example embodiment in which computer system 600 does not modify a previously applied synthetic depth of field effect. As shown in FIG. 6L, computer system 600 displays the scene shown in live preview 630 at 10 seconds into the capture of the video (e.g., as indicated by elapsed time indicator 602d), where John 632 is wiping his face with towel 642. As shown in FIG. 6L, towel 642 covers (and / or hides) John 632's face. In some embodiments, towel 642 covers John 632's face such that computer system 600 cannot detect John 632's face within the field of view of one or more cameras (e.g., using one or more face detection techniques). As shown in FIG. 6M, computer system 600 displays the scene shown in live preview 630 at 11 seconds, where live preview 630 indicates that John 632 has removed towel 642 of FIG. 6L from his face. Thus, in FIG. 6M, John 632's face is no longer covered.

[0215] In Figures 6L-6M, computer system 600 and computer system 690 make individual determinations that John 632's face has been covered and / or obscured (e.g., and / or the individual computer systems have failed to detect John 632's face) for less than a predetermined period of time (e.g., 2-60 seconds). In Figures 6L-6M, because of these individual determinations, computer system 600 and computer system 690 continue to individually apply the previously applied composite depth of field effect (e.g., to emphasize John 632 relative to Jane 634 in Figures 6H-6K) regardless of whether towel 642 obscures John 632's face. As shown in Figure 6L, John 632 is emphasized relative to Jane 634 in both live preview 630 and previously captured media representation 640, even when towel 642 obscures John 632's face. As shown in Figures 6L-6M, computer system 600 continues to display primary subject indicator 672a and secondary subject indicator 674a because computer system 600 continues to apply the synthetic depth of field effect that was previously applied in Figure 6L before John 632 covered his face with towel 642. In some embodiments, the determinations made by computer system 690 in Figures 6L-6M are made earlier in terms of the elapsed time of the video than the determinations made by computer system 600 (e.g., for reasons similar to those discussed above in connection with Figures 6D-6G).

[0216] 6N-6T illustrate an example embodiment in which computer system 600 modifies a synthetic depth of field effect in response to a first type of user input (e.g., a user-specified change). As shown in FIG. 6O, computer system 600 displays a scene (e.g., representing a frame of the video) shown in live preview 630 at 12 seconds into the capture of the video (e.g., as indicated by elapsed time indicator 602d). In FIG. 6N, computer system 600 continues to apply a synthetic depth of field effect that emphasizes John 632 over Jane 634 (e.g., as indicated by the shading of live preview 630 in FIG. 6N) to the content being captured by one or more cameras of computer system 600. In FIG. 6O, computer system 600 detects a single tap input 650o on Jane 634.

[0217] In FIG. 6P, in response to detecting a single tap input 650o, the computer system 600 modifies the composite depth of field effect to emphasize Jane 634 over John 632 (e.g., as indicated by the shading in the live preview 630 of FIG. 6P). In response to detecting a single tap input 650o, the computer system 600 makes an immediate change to the composite depth of field effect and does not display a transitional animation indicating that the composite depth of field effect is being changed (e.g., as indicated by the live preview 630 of FIG. 6P displayed at 12 seconds into the video capture). Thus, the live preview 630 is updated to reflect a user-specified change to the composite depth of field effect (e.g., a change that occurs in response to detecting an input) unlike the live preview 630 being updated to reflect an automatic change to the composite depth of field effect. When a user-specified change to the composite depth of field effect occurs, the live preview 630 is updated immediately (e.g., and / or a change to the application of the composite depth of field occurs immediately). However, when the automatic change of the composite depth of field effect occurs, the live preview 630 is updated more gradually (e.g., an animation of the transition between the current and new composite depth of field effects is displayed, as described in connection with FIGS. 6D-6K). This is also illustrated by the graph 680. In the graph 680, the media capture line 680d1 is drawn at a right angle at 12 seconds to reflect how an immediate change of a user-specified change of the composite depth of field effect occurs (e.g., in response to a single tap input 650o), and the media capture line 680d1 is drawn with a curve to reflect how a smoother automatic change of the composite depth of field effect occurs between 3 and 10 seconds and between 12 seconds.

[0218] Returning to Figures 6N-6P, the computer system 690 displays the previously captured media representation 640 with an animation of the user-specified change in the synthetic depth of field effect (e.g., occurring in response to detecting a single tap input 650o) (e.g., during playback of the captured video). As shown in Figures 6N-6P, the computer system 690 provides a smoother transition when displaying the previously captured media representation 640 with the user-specified change in the synthetic depth of field effect because the computer system 690 has information indicating that the user-specified change will occur (e.g., for reasons similar to those described above in connection with Figures 6D-6K). Thus, in Figure 6N, the previously captured media representation 640 differs from the live preview 630 in that the previously captured representation media 640 has begun to show the change in the synthetic depth of field effect, and the live preview 630 does not. Notably, in Figure 6O, the computer system 690 of the previously captured media representation 640 represents the change in the synthetic depth of field effect in its final state. In Figure 6O, the computer system 690 completes the synthetic depth of field effect modification to emphasize Jane 634 relative to John 632 in the frame in which the single tap input 650o was received (e.g., the blur of the previously captured media representation 640 in Figure 6O appears the same as in the live preview 630 in Figure 6P). Thus, the computer system 690 can display the user-specified modification in the frame corresponding to when the input that caused the user-specified modification was received. Further, a comparison of the media capture line 680d1 and the media playback line 680d2 shows how the user-specified modification affects the visual content during playback of the video (e.g., via the live preview 630 and the previously captured media representation 640) differently than during media capture.As shown by graph 680, the media playback line 680d2 exhibits a smoother and / or longer transition than the media capture line 680d1 (e.g., producing a right angle at 12 seconds) to modify the composite depth of field effect in response to detecting a single tap input 650o.

[0219] With reference to FIG. 6Q, the live preview 630 (and previously captured media representation 640) is displayed with a user-specified composite depth of field effect change initiated via single tap input 650o even though John's activity level 680a1 is greater than Jane's activity level 680b1 in FIG. 6Q. When a user-specified changed composite depth of field effect occurs, the computer system 600 uses a modified set of automatic selection criteria. The modified set of automatic criteria is different from the set of criteria used to effect the automatic change of the composite depth of field effect described above in FIGS. 6B-6K (e.g., that occurred before a user-specified request to change the composite depth of field effect was received and before the single tap input 650o was detected). In some embodiments, the modified set of automatic selection criteria has a higher threshold for automatically changing the composite depth of field effect than the set of criteria used to effect the automatic change of the composite depth of field effect described above in FIGS. 6B-6K. In some embodiments, John 632 must speak louder, move more, move closer to the camera, look directly into the camera, etc. for a longer period of time in order for computer system 600 to automatically modify the synthetic depth of field effect to emphasize John 632 over Jane 634. In some embodiments, after modifying the application of the synthetic depth of field effect in response to detecting a single tap input 650o, computer system 600 does not modify the application of the synthetic depth of field effect for a predetermined period of time regardless of the subject's activity level (e.g., unless the subject's face is detected for the predetermined period of time).

[0220] As shown in FIG. 6Q, Jane 634 has begun to walk out of the field of view of one or more cameras (e.g., walking out of the scene as shown by the live preview 630 in FIG. 6Q). Looking at FIGS. 6P-6Q, Jane 634 is highlighted relative to John 632 in the live preview 630 (and previously captured media representation 640), but Jane 634 is moving within the field of view of one or more cameras. This indicates that a synthetic depth of field effect applied to highlight an object relative to other objects follows and / or tracks the highlighted object. Additionally, the object indicator (e.g., as shown by primary object indicator 672b in FIGS. 6P-6Q) moves with each of the respective objects that the individual object indicators surround. In some embodiments, in response to detecting an input at a location of the live preview 630 that is not on the object, the applied synthetic depth of field effect does not follow and / or track the object.

[0221] In FIG. 6R, Jane 634 is not within the field of view of one or more cameras (e.g., has walked out of the scene). In FIG. 6R, a determination is made that John 632 meets a revised set of automatic selection criteria (e.g., because Jane 634 is out of frame and / or computer system 600 has not detected activity from Jane 634, as indicated by Jane's activity level 680b1). As shown in FIG. 6R, computer system 600 automatically modifies the synthetic depth of field effect to emphasize John 632 (e.g., John 632 is displayed with only natural blur (e.g., no shading), while other portions of live preview 630 include an amount of synthetic blur (e.g., shading)). Computer system 600 automatically modifies the synthetic depth of field effect to emphasize John 632 relative to other portions of live preview 630 because a determination is made that John 632 meets a revised set of automatic selection criteria and / or because Jane has not had an activity level for a predetermined period of time (e.g., 1 second).

[0222] FIG. 6R1 illustrates an example embodiment of the position of Jane 634 relative to John 632 within the FOV of computer system 600. In FIG. 6R1, a live preview 630 is displayed at the 17 second mark using one or more similar techniques described above in connection with FIG. 6R. In FIG. 6R1, a boundary 601 indicates the size of the FOV, and one or more cameras of computer system 600 may capture visual content inside boundary 601 (e.g., within region 603 that includes live preview 630). As illustrated in FIG. 6R1, Jane 634 is within region 603. Thus, although Jane 634 is being captured by one or more cameras, Jane 634 is not positioned sufficiently within region 603 to be captured by one or more cameras such that Jane 634 appears in live preview 630. As shown in FIG. 6R1, when Jane 634 is located within region 603 but outside of the content in the FOV used to display live preview 630, computer system 600 continues to track Jane 634 for a predetermined period of time (e.g., 0.1-5 seconds). In some embodiments, if computer system 600 (or another computer system) determines that it is unable to capture Jane 634 within the visual content corresponding to live preview 630 while Jane 634 is located within region 603 but outside of the content in the FOV used to display live preview 630 (as shown in FIG. 6R1), computer system 600 does not track Jane 634 after the predetermined period of time. In some embodiments, a neural network (e.g., as discussed in FIG. 12) still tracks Jane after a period of time, and computer system 600 can provide one or more representations of Jane 634 (e.g., an old representation and / or a previously captured representation of Jane 634) for a second predetermined period of time. In some embodiments, after a second predetermined period of time, the computer system 600 automatically switches to highlighting and / or tracking another object and / or focal plane within the captured visual content in the FOV corresponding to the live preview 630.In some embodiments, when Jane 634 is located outside of region 603 (e.g., outside of boundary 601), computer system 600 does not track Jane 634 (e.g., and / or does not store an identifier corresponding thereto). In some embodiments, when Jane 634 is located within region 603 and inside the content within the FOV used to display the live preview, computer system 600 tracks Jane 634 regardless of the predetermined period of time. In some embodiments, computer system 600 automatically switches to highlighting and / or tracking another object (e.g., “John” and / or the focal plane) that is within the visual content captured within the FOV corresponding to live preview 630 based on information computer system 600 has about a user that is within region 603 but outside of the content within the FOV used to display the live preview (e.g., the period of time that Jane 632 was within region 603 and / or outside the FOV for the content used to display live preview 630, and / or whether Jane 634 is moving toward and / or away from the content used to display live preview 630 while Jane 634 is within region 603). This allows computer system 600 to more quickly switch the highlighting to an object that falls within the portion of the FOV used to display the live preview. This is because computer system 600 (and, optionally, the neural network that makes the automatic emphasis decision) has more time to track the object and observe the object's behavior that occurs within region 603 but outside the FOV used to display the live preview to determine the relative importance of the object compared to other objects that can be emphasized compared to a situation where computer system 600 does not have an opportunity to observe the object's behavior before the object enters the portion of the FOV used to display the live preview.

[0223] As shown in Figure 6S, Jane 634 has moved back within the field of view of one or more cameras (e.g., standing in the scene as shown by live preview 630 of Figure 6S). In Figure 6S, live preview 630 continues to be displayed with a synthetic depth of field effect that emphasizes John 632 relative to Jane 634, due to the single tap input 650o of Figure 6O being a first type of input. In particular, computer system 600 treats the change in the synthetic depth of field effect to emphasize Jane 634 relative to John 632 as a temporary user-specified change to the application of the synthetic depth of field effect because the single tap input 650 of Figure 6O is a first type of input. If a temporary user-specified change to the application compounded depth of field effect occurs, computer system 600 does not automatically reapply the application of the temporary change to the compounded depth of field effect to the compounded depth of field effect after the automatic change to the compounded depth of field effect occurs (e.g., regardless of how long Jane 634 steps outside of the visual content within the FOV corresponding to live preview 630). Thus, computer system 600 continues to apply the compounded depth of field effect to emphasize John 632 relative to other portions of live preview 630 because the single tap input 650o of FIG. 6O was a first type of input and an automatic change to the compounded depth of field effect (e.g., the change described in FIG. 6P) occurred after the single tap input 650o was detected.

[0224] As shown in Figure 6T, the live preview 630 continues to be displayed with a synthetic depth of field effect that emphasizes John 632 relative to Jane 634, even though four seconds have passed since the live preview 630 of Figure 6S was displayed (e.g., as shown by 602d in Figures 6S-6T). In Figure 6T, the computer system 600 continues to apply a synthetic depth of field effect that emphasizes John 632 relative to Jane 634 because the single tap input 650o of Figure 6O was a first type of input and an automatic change to the synthetic depth of field effect (e.g., the change described in Figure 6P) occurred after the single tap input 650o was detected.

[0225] 6U-6Y are exemplary embodiments in which computer system 600 modifies the synthetic depth of field effect in response to a second type of user input (e.g., a user-specified change). As shown in FIG. 6U, computer system 600's live preview 630 continues to be displayed with a synthetic depth of field effect that emphasizes John 632 relative to Jane 634, even though 10 seconds have passed since live preview 630 of FIG. 6S was displayed (e.g., as shown by 602d in FIG. 6S-6T). In FIG. 6U, live preview 630 is displayed with a synthetic depth of field effect that emphasizes John 632 relative to Jane 634 for similar reasons as described above in connection with FIG. 6S-6T. In FIG. 6U, computer system 600 detects a double tap input 650u.

[0226] As shown in Figure 6V, in response to detecting the double tap input 650u, the computer system 600 immediately changes the composite depth of field effect to emphasize Jane 634 over John 632 (e.g., as indicated by the shading in the live preview 630 of Figure 6V). In response to detecting the double tap input 650u, the computer system 600 makes an immediate change to the composite depth of field effect and does not display a transitional animation indicating the change in the composite depth of field effect (e.g., as indicated by 680d1 at 30 seconds, for reasons similar to those discussed above in connection with Figure 6P).

[0227] In FIG. 6V, the computer system 600 displays a primary subject indicator 678b around Jane's 634 head and a secondary subject indicator 674a around John's 632 head. In particular, the primary subject indicator 678b is different from the primary subject indicator 672b displayed in response to detecting the single tap input 650o because each respective indicator is displayed in response to detecting a different type of input. In particular, the primary subject indicator 678b is displayed in FIG. 6V because a determination is made that a second type of input (e.g., the double tap input 650u of FIG. 6U) is detected, and the primary subject indicator 672b is displayed in FIG. 6P because a determination is made that a first type of input (e.g., the single tap input 650o of FIG. 6O) is detected. Furthermore, the computer system 600 displays a different subject indicator because a different type of tracking is applied when a second type of input is received than when a first type of input is received. As described above in connection with FIGS. 6O-6P, the computer system 600 makes temporary changes to the composite depth of field effect that is applied when a first type of input (e.g., single tap input 650o of FIG. 6O) is received. As described above in connection with FIGS. 6O-6P, the computer system 600 does not automatically reapply the application of the temporary changes to the composite depth of field effect after an automatic change to the composite depth of field effect is made. However, when a second type of input (e.g., double tap input 650u of FIG. 6U) is received, the computer system 600 makes user-specified changes to the applied composite depth of field effect. If the computer system 600 makes user-specified changes to the applied composite depth of field effect, the computer system 600 automatically reapplies the application of the user-specified changes to the composite depth of field effect after an automatic change to the composite depth of field effect is made (e.g., as further described below in connection with FIG. 6Y).As shown in Figure 6V, because the computer system 600 determines that the double tap input 650v is a second type of input, the computer system 600 displays a tracking indicator 694a (e.g., "AF Tracking Lock"). The tracking indicator 694a indicates that the autofocus settings (e.g., and / or currently applied synthetic depth of field) will not be automatically changed by the computer system 600. The tracking indicator 694a is displayed in the camera user interface simultaneously with the live preview 630 of Figure 6V.

[0228] Returning to Figures 6T-6V, computer system 690 displays (e.g., during playback of the captured video) the previously captured media representation 640 along with an animation of the user-specified change in the synthetic depth-of-field effect (e.g., that occurred in response to detecting double-tap input 650u). As shown in Figures 6T-6V, computer system 690 provides a smoother transition (e.g., when displaying live preview 630 of Figures 6T-6V) when displaying the previously captured media representation 640 along with the user-specified change in the synthetic depth-of-field effect because computer system 690 has information indicating that the user-specified change will be made (e.g., for reasons similar to those discussed above in connection with Figures 6N-6P).

[0229] As shown by the live preview 630 in FIG. 6V, Jane 634 begins to walk out of the field of view of one or more cameras (e.g., walks out of the scene as shown by the live preview 630 in FIG. 6Q), and the synthetic depth of field effect moves with Jane 634 (e.g., as shown in FIGS. 6U-6T, for reasons similar to those described in connection with FIGS. 6P-6Q). In FIG. 6W, Jane 634 is no longer in the field of view of one or more cameras (e.g., walks out of the scene). In FIG. 6W, a determination is made that John 632 meets the revised set of automatic selection criteria (e.g., because Jane 634 is outside the FOV, Jane 634's face cannot be detected by the computer system 600, and / or the computer system 600 has not detected activity from Jane 634, as shown by Jane's activity level 680). As shown in FIG. 6W, the computer system 600 automatically modifies the synthetic depth of field effect to emphasize John 632 (e.g., John 632 appears with only natural blur (e.g., no shading) relative to dog 638, who is in the field of view of one or more cameras). The computer system 600 automatically modifies the synthetic depth of field effect to emphasize John 632 relative to dog 638 (e.g., for similar reasons and using similar techniques as disclosed above in connection with FIG. 6W). As shown in FIG. 6W, because the computer system 600 has applied a synthetic depth of field effect to emphasize John 632 relative to dog 638, primary subject indicator 672a appears around the head of John 632 and secondary subject indicator 674c appears around the head of dog 638.

[0230] 6X, the computer system 600 modifies the synthetic depth of field effect to emphasize the dog 638 relative to John 632 because a determination was made that the dog 638 meets the set of automatic selection criteria (e.g., as indicated by the dog's activity level 680c1 exceeding John's activity level 680a1 at approximately 34 seconds on the graph 680). Here, the dog 638 met the set of automatic selection criteria because Jane 634 was not within the field of view of one or more cameras, and did not meet the revised set of criteria. Further, because a determination was made that the dog 638 meets the set of automatic selection criteria, the computer system 600 displays a primary subject indicator 672c around the head of the dog 638 and a secondary subject indicator 674a around the head of John 632.

[0231] As shown in FIG. 6Y, Jane 634 has returned within the field of view of one or more cameras (e.g., standing within the scene shown by the live preview 630 of FIG. 6Y). In FIG. 6Y, the computer system 600 modifies the composite depth of field effect to emphasize Jane 634 relative to other objects (e.g., John 632, dog 638) within the field of view of one or more cameras. In particular, the computer system 600 modifies the composite depth of field effect to emphasize Jane 634 relative to other objects because the user-specified changes to the composite depth of field effect were applied in response to detecting the double-tap input 650u. That is, the computer system 600 modifies the composite depth of field effect to emphasize Jane 634 relative to other objects in FIG. 6Y, regardless of whether an automatic change to the composite depth of field effect was applied after a permanent change to the composite depth of field effect was made (e.g., in response to detecting the double-tap input 650u). As shown in FIG. 6Y, the computer system 600 displays primary subject indicator 678b around the head of Jane 634 and secondary subject indicators 674a and 674c around the heads of John 632 and dog 638, respectively, because a synthetic depth of field effect has been applied to enhance Jane 634 relative to other subjects. In some embodiments, in FIG. 6Y, the computer system 600 applies a synthetic depth of field effect to enhance Jane 634 relative to other subjects based on a determination that Jane 634 is inside and / or inside region 603 of FIG. 6R1 for less than a predetermined period of time (e.g., 0.5 seconds to 5 seconds). In some embodiments, based on a determination that Jane 634 is outside and / or inside region 603 of FIG. 6R1 for more than a predetermined period of time, the computer system 600 does not apply a synthetic depth of field effect to enhance Jane 634 relative to other subjects.

[0232] 6Z-6AB are example embodiments in which computer system 600 modifies a synthetic depth of field effect in response to a third type of user input (e.g., a user-specified change). As shown in FIG. 6Z, live preview 630 is displayed with a synthetic depth of field effect that emphasizes Jane 634 relative to other objects in the media. In FIG. 6Z, computer system 600 detects a press and hold input 650z on dog 638. In some embodiments, press and hold input 650z is detected at another location on live preview 630 (e.g., a location not occupied by John 632, Jane 634, and dog 638, a location that does not correspond to the location of the objects, etc.).

[0233] In FIG. 6AA, in response to detecting a press and hold input 650z on dog 638, computer system 600 modifies the synthetic depth of field effect to emphasize a focal plane of one or more cameras' fields of view (e.g., because the press and hold input is a third type of input that is different from the first and second types of inputs). The emphasized focal plane includes locations, objects, and / or objects that correspond to the locations, objects, and / or objects at which the press and hold input 650z was detected. Because dog 638 is located within the focal plane, dog 638 is emphasized relative to other objects in live preview 630 (e.g., as indicated by dog ​​638 having no shading). Furthermore, because John 632 is closer to the emphasized focal plane than Jane 634 (e.g., as indicated by the shading in live preview 630), John 632 appears less blurred than Jane 634. In response to detecting the press and hold input 650z, the computer system 600 displays a focus indicator 676 at a location corresponding to the location where the press and hold input 650z was detected. Additionally, in response to detecting the press and hold input 650z, the computer system 600 displays secondary subject indicators 674a and 674b around the heads of John 632 and Jane 634, respectively. In FIG. 6AA, the focus indicator 676 is displayed to indicate that the focal plane is being enhanced by the synthetic depth of field effect. In some embodiments, the focus indicator 676 is displayed because the dog 638 is in the focal plane and is currently being enhanced. However, in some embodiments, the secondary subject indicator 674c is displayed around the head of the dog 638.

[0234] In Figure 6AB, the live preview 630 shows John 632, Jane 634, and dog 638 moving away from the currently highlighted focal plane (e.g., as indicated by focus indicator 676). As shown in Figure 6AB, John 632, Jane 634, and dog 638 are displayed with a composite amount of blur because they are not within the currently highlighted focal plane. In some embodiments, one or more portions of the live preview 630 that are within the focal plane are highlighted (e.g., while the focal plane is highlighted in response to detecting a press and hold input 650z). In Figure 6AB, the computer system 600 detects a tap input 650ab on the stop control 616.

[0235] 6AC-6AQ illustrate an exemplary embodiment in which the video captured in FIGS. 6B-6AB is displayed and edited (e.g., in response to detecting tap input 650b2). In FIG. 6AC, in response to detecting tap input 650ab, computer system 600 stops capturing video and saves the captured video (e.g., captured in FIGS. 6B-6AB). As shown in FIG. 6C, in response to detecting tap input 650ab, computer system 600 updates media collection 624 to display a representation of the captured video (captured in FIGS. 6B-6AB). In some embodiments, computer system 600 detects one or more inputs and navigates to a cinematic video editing user interface shown in FIG. 6AD. In some embodiments, the one or more inputs include an input directed to media collection 624. In some embodiments, in response to detecting an input on media collection 624, a representation of the captured video is displayed and controls for editing the captured video are displayed. In some embodiments, the one or more inputs include an input on a control for editing the captured video. In some embodiments, in response to detecting an input directed to a control for editing the captured video, the computer system 600 displays the cinematic video editing user interface of FIG.

[0236] 6AD illustrates a computer system 600 displaying a cinematic video editing user interface including a control area 662, a media representation 660, a media navigation element 664, and a media editing mode control 684. The control area 662 is disposed above the media representation 660 and includes a done control 662a, a redo control 662b1, an undo control 662b2, a cinematic video control 662c, a synthetic depth of field effect (SDOFE) control 662d, a depth indicator control 662e, a mute control 662f, and a cancel control 662g. In some embodiments, in response to detecting an input directed at the done control 662a, the computer system 600 saves a representation of the media that was edited while the cinematic video editing user interface was displayed. In some embodiments, the computer system 600 displays the done control 662a as not selectable when no changes and / or modifications have been made to the media (e.g., the media represented by the media representation 660). In some embodiments, the computer system 600 displays the done control 662a as selectable when at least one change and / or modification has been made to the media using the cinematic video editing user interface. In some embodiments, when the done control 662a is not selectable, the computer system 600 does not save a representation of the media in response to detecting input directed to the done control 662a. In some embodiments, in response to detecting input directed to the redo control 662b1, the computer system 600 reverses the most recent excessive action. In some embodiments, in response to detecting input directed to the undo control 662b2, the computer system 600 undoes the most recent edit made to the media (and in some embodiments, reserves all edits).In some embodiments, in response to detecting an input directed to the cinema video control 662c, the computer system 600 performs one or more operations as described below in conjunction with Figures 6AP-6AQ. In some embodiments, the SDOFE control 662d indicates that the computer system 600 is displaying and / or is currently configured to display a frame of media via the media representation 660 and a synthetic depth of field effect has been manually applied to the frame (e.g., a user-specified change to the synthetic depth of field effect as described above in conjunction with Figures 6O-6AB). In some embodiments, the SDOFE control 662d indicates that the computer system 600 is displaying and / or is currently configured to display a frame of media via the media representation 660 and a synthetic depth of field effect has been automatically applied to the frame (e.g., an automatic change to the synthetic depth of field effect as described above in conjunction with Figures 6B-6N). In some embodiments, in response to detecting input directed to the SDOFE control 662d, the computer system 600 stops displaying the media using user-specified changes to the composite depth of field effect in the media while continuing to display the media using the automatic changes to the composite depth of field effect. In some embodiments, in response to detecting input directed to the SDOFE 662d, the computer system 600 modifies the media representation 660 such that one or more user-specified changes to the composite depth of field effect are not applied to one or more frames of the media while maintaining the application of the automatic changes to the composite depth of field effect (e.g., as described further below in connection with FIGS. 6AZ-6BC). In some embodiments, in response to detecting input directed to the SDOFE control 662d, the computer system 600 modifies the media representation 660 such that one or more automatic changes to the composite depth of field effect are not applied to one or more frames of the media while maintaining the user-specified changes to the application of the composite depth of field effect (e.g., as described in connection with FIGS. 6O-6AB).In some embodiments, in response to detecting input directed at the depth indicator control 662e, the computer system 600 performs one or more operations such as those described above in connection with Figures 6AD-6AG. In some embodiments, in response to detecting input directed at the mute control 662f, the computer system 600 toggles a setting (e.g., on / off) that configures the computer system 600 to output sound while playing media. In some embodiments, in response to detecting input directed at the cancel control 662g, the computer system 600 displays a confirmation screen to cancel one or more edits made to the media.

[0237] As shown in FIG. 6AD, media representation 660 is a representation of a frame of the video captured in FIGS. 6B-6AB (the "captured video"). In FIG. 6AD, media representation 660 is the first frame of the video, captured before live preview 630 of FIG. 6B was captured (e.g., live preview 630 was captured during 0:00). Notably, media representation 660 includes a primary subject indicator 672a around the head of John 632 and a secondary subject indicator 674b around the head of Jane 634, because media representation 660 is displayed with a synthetic depth of field effect applied to emphasize John 632 relative to Jane 634 (e.g., for reasons similar to those discussed above in connection with FIG. 6B). Thus, computer system 600 displays subject indicators (e.g., primary subject indicator and / or secondary subject indicator) during the capture of the video (e.g., live preview 630) and while displaying a representation of the previously captured video (e.g., media representation 660). As illustrated herein, computer system 600 displays a subject indicator while media is not being played (e.g., media representation 660 of FIG. 6B) and during playback of media (e.g., media representation 660 of FIG. 6AK, described below). In some embodiments, computer system 600 does not display a subject indicator (and / or any subject indicators) while media is not being played and during playback of media (e.g., previously captured media representation 640).

[0238] As shown in Figure 6AD, the media editing mode controls 684 include a cinematic video mode edit control 684a, a visual property edit mode control 684b, a filter edit mode control 684c, and an aspect ratio edit mode control 684d. As shown in Figure 6AD, the cinematic video mode edit control 684a is displayed as selected (e.g., as indicated by a selection indicator 684a1 displayed below the cinematic video mode edit control 684a in Figure 6AD), ​​indicating that a cinematic video editing user interface is displayed. In some embodiments, in response to detecting an input directed to the filter edit mode control 684c or the aspect ratio edit mode control 684d, the computer system 600 displays one or more controls corresponding to the selected control (e.g., the control to which the input is directed) to edit one or more frames of the video. In some embodiments, in response to detecting input directed at the filter edit mode control 684c or the aspect ratio edit mode control 684d, one or more user interface objects displayed within the cinematic video editing media user interface cease to be displayed.

[0239] As shown in FIG. 6AD, media navigation elements 664 include a scrubber area 664a, an effects area 664b, and a playback control 668a. Scrubber area 664a includes multiple representations of frames in the captured video, a playhead 664a1, a start crop control 664a2, and an end crop control 664a3. As shown in FIG. 6AD, playhead 664a1 is displayed at a location corresponding to the start of the representation of the first frame of the captured video (e.g., the left-most frame in scrubber area 664a). Because playhead 664a1 is displayed at a location corresponding to the start of the representation of the first frame (e.g., 0 seconds of the captured video), the media representation 660 of FIG. 6A is a representation of the first frame of the captured video (e.g., the time in the video corresponding to the location of playhead 664a1). The start crop control 664a2 and the end crop control 664a3 indicate the portion of the captured video that will be cropped and saved in response to the computer system 600 receiving a request to save the edited media (e.g., selection of the done control 662a). In particular, the portion of the video that will be cropped is the portion of the captured video that is between the start crop control 664a2 and the end crop control 664a3 (and / or from the time in the video that corresponds to the location of the start crop control 664a2 in the scrubber area 664a to the time in the captured video that corresponds to the location of the end crop control 664a3 in the scrubber area 664a).

[0240] As shown in FIG. 6AD, the effect area 664b includes a time bar 664b1 and modification indicators 686a, 686b, 688c, 686d, 688e, 686f, 686g, and 688h ("modification indicators"). The time bar 664b1 has a plurality of tick marks, each tick mark corresponding to a time in the captured video. The tick marks displayed on the time bar 664b1 cover at least a portion of the total length of the captured video. In FIG. 6AD, each modification indicator is displayed near (e.g., on and / or adjacent to) a tick mark on the time bar 664b1 that corresponds to a time in the captured video at which the computer system 600 modified the application of a synthetic depth of field effect that was being applied to the visual content of the video being captured. In FIG. 6AD, the effect area 664b is copied onto the graph 680 ("Effect Area 664b-Zoomed") to show how the change indicators correspond to changes in the application of the synthetic depth of field effect being applied to the visual content of the video. In some embodiments, one or more change indicators are displayed at the beginning, end, and middle (average) positions (e.g., relative to the tick marks of the time bar 664b1) relative to when the actual application of the synthetic depth of field effect being applied to the visual content was changed (e.g., while the video was being captured and / or after the video was captured). In some embodiments, each of the change indicators is displayed below an individual representation of a frame in the scrubber area 664a that corresponds to the time when the synthetic depth of field effect was applied to the content representing the individual frame. In some embodiments, the individual representations of the frames in the scrubber area are displayed with the synthetic depth of field effect that was applied during the time when the individual frames in the scrubber area were captured (e.g., such that the frames in the scrubber area include blur). In some embodiments, the representation of the frame does not include blur and / or shows a synthetic depth of field effect being applied.

[0241] In particular, change indicators 686a, 686b, 686d, 686f, and 686g ("automatic change indicators") indicate that a change in the application of the synthetic depth of field effect has been made automatically by computer system 600. Table 1 (Change Indicator Correspondence Table) is provided below to quickly summarize the connection of each of the change indicators in FIG. 6AD to the captured video. [Table 1]

[0242] As shown in FIG. 6AD, automatic change indicators are represented with change indicators indicated using X's and user-specified change indicators are represented with change indicators indicated using O's. The automatic change indicators are represented differently from the user-specified change indicators because the automatic change indicators have a different visual appearance than the user-specified change indicators. Additionally, each of the user-specified change indicators is displayed with a transition indicator (e.g., 688c1, 688e1, and / or 688h1) that extends from the user-specified change to the next change (e.g., the change to the immediate right of the user-specified change and / or the change to the right edge of the effects area 664b). In some embodiments, the transition indicators represent a discrete period during which the media the user-specified change is applied, a frame of media that occurs during the discrete period. In some embodiments, one or more other techniques (e.g., using different colors, sizes, changes, text, locations, etc.) can be used to distinguish the automatic change indicators from the user-specified change indicators. In some embodiments, the user-specified change indicators are displayed and the automatic change indicators are not displayed, and / or vice versa. In some embodiments, the computer system 600 includes a selectable option (e.g., SDOFE control 662d) for stopping display of the automatic change indicators and / or the user-specified change indicators while maintaining display of the user-specified change indicators, and / or vice versa. In some embodiments, user-specified change indicators that occur during video capture are displayed differently (e.g., displayed with a different visual appearance) than user-specified change indicators that occur after the video is captured (e.g., during video editing, etc.). In FIG. 6AD, the computer system 600 detects a tap input 650ad on the depth indicator control 662e.

[0243] As shown in FIG. 6AE, in response to detecting the tap input 650ad, the computer system 600 displays a depth control 682 to the left of the media editing mode control 684 (e.g., upward in portrait orientation when the computer system 600 is in portrait orientation). The depth control 682 is a slider displayed with a depth control value 682a (e.g., displayed in the depth indicator control 662e of FIG. 6AD). In some embodiments, in response to detecting the tap input 650ad, the computer system 600 stops displaying the scrubber region 664a and the effects region 664b (e.g., the scrubber region 664a and the effects region 664b are not displayed while the depth control 682 is not displayed and / or are displayed while the depth control 682 is displayed). In FIG. 6AE, the computer system 600 detects a right swipe input 650ae on the depth control 682.

[0244] In FIG. 6AF, in response to detecting right swipe input 650ae, computer system 600 changes depth control value 682a from a 4.5 f-stop value to a 1.4 f-stop value, which increases the blur applied to portions of media representation 660 that do not include (e.g., are not in focus) John 632, who is currently highlighted (e.g., is in focus) by the composite depth of field effect applied to the frame corresponding to media representation 660 in FIG. 6AF. In FIG. 6AF, John 632 is not displayed with an additional amount of blur (e.g., is not darker compared to John 632 in FIG. 6AE) in response to detecting right swipe input 650ae, while Jane 634 and background and foreground portions of media representation 660 are displayed with an additional amount of blur (e.g., are darker compared to how each individual portion was blurred in FIG. 6AE). Thus, an adjustment to depth control 682 causes the composite depth of field effect applied to be adjusted. In some embodiments, an adjustment to depth control 682 causes an adjustment only to a representation of a frame of the captured video that is displayed via media representation 660 when the adjustment is performed. In some embodiments, an adjustment to depth control 682 causes an adjustment to a frame of the captured video (e.g., all of the frames and / or a majority of the frames), regardless of whether a composite depth of field effect was applied to the frame of the captured video (e.g., a global change) or not. In some embodiments, an adjustment to depth control 682 causes an adjustment to a frame of the captured video to which the same application of a composite depth of field effect was applied (e.g., a frame of the video in which John 632 is highlighted by the composite depth of field effect in FIG. 6AF, and / or a frame of the video that corresponds to and / or occurs after the change in the composite depth of field effect of media representation 660 of FIG. 6AF but before a different change in the composite depth of field effect (e.g., between 0 and 3 seconds in FIG. 6AF)).In FIG. 6AF, the computer system 600 detects a tap input 650af1 on the depth control 682 and / or a left swipe input 650af2 on the depth control 682.

[0245] 6AF1, in response to detecting the tap input 650af1, the computer system 600 stops displaying the depth control 682 and continues to display the media representation 660 with the same amount of blur that it had before the tap input 650af1 was detected. Additionally, the computer system 600 updates the display of the depth indicator control 682 (e.g., in response to detecting the right swipe input 650ae) such that the depth control 662e includes the previously set value (e.g., 1.4). In some embodiments, the computer system 600 updates the display of the depth indicator control 662e to include the value (e.g., 1.4) selected in response to detecting the right swipe input 650ae.

[0246] As shown in FIG. 6AG, in response to detecting the left swipe input 650af2, the computer system 600 changes the depth control value 682a from a 1.4 f-stop value to a 4.5 f-stop value, reducing the blur applied to the unfocused portions of the media representation 660 (e.g., indicated by the lighter shading compared to FIG. 6AF). In some embodiments, the techniques described herein related to the depth control 682 also function on the depth indicator 602e (e.g., before / during capture of media, as discussed above in connection with FIG. 6B). In FIG. 6AG, the computer system 600 detects a tap input 650ag on the depth indicator control 662e. As shown in FIG. 6AH, in response to detecting the tap input 650ag, the computer system 600 stops displaying the depth control 682 and continues to display the media representation 660 with the same amount of blur it had before the tap input 650ag was detected. Additionally, the computer system 600 updates the display of the depth indicator control 682 so that the depth control 662e includes the previously set value (e.g., 4.5) (e.g., in response to detecting the left swipe input 650af2). As shown in FIG. 6AH, the computer system 600 detects a tap input 650ah on the media playback control 668a. In response to detecting the tap input 650ah, the computer system 600 begins playing the captured video.

[0247] 6AI-AO illustrate an exemplary embodiment in which user-specified modifications are made in a captured video. In FIG. 6AI, a computer system 600 is playing the captured video, which is indicated by the pause playback control 668b of FIG. 6AH being displayed and the media playback control 668a being stopped being displayed. As shown in FIG. 6AI, a playhead 664a1 is displayed in a location corresponding to a frame displayed at 7 seconds into the duration of the captured video (indicated by an elapsed time indicator 664c displayed above the playhead 664a1), and the media representation 660 has been updated to be a representation of a frame displayed at 7 seconds into the duration of the captured video. In particular, the media representation 660 corresponds to (e.g., represents the same frame as) the live preview 630 of FIG. 6K, and an automatic modification to the synthetic depth of field effect has been applied to emphasize John 632 relative to Jane 634. Thus, the media representation 660 of Figure 6AI includes a primary subject indicator 672a around the head of John 632 and a secondary subject indicator 674b around the head of Jane 634 to reflect the applied synthetic depth of field effect. In Figure 6AI, the computer system 600 detects a single tap input 650ai on Jane 634 at the 7 second mark during playback of the media.

[0248] In Fig. 6AJ, in response to detecting the single tap input 650ai, the computer system 600 modifies the synthetic depth of field effect to emphasize Jane 634 relative to John 632. As shown in Fig. 6AJ, the synthetic depth of field effect has been applied to a representation of a frame of video that appears at the 8 second mark in the captured video (e.g., as indicated by elapsed time indicator 664c). Although Fig. 6AJ shows a representation of a frame of video that occurs after the single tap input 650ai is detected, the computer system 600 modifies the synthetic depth of field effect to all of the frames of edited media to which it has been applied between the 5 second mark in the captured video (e.g., when the single tap input 650ai is detected) and the 12 second mark (e.g., when the next change to the synthetic depth of field effect occurs in the captured video, as indicated by user-specified change representation 688c). The edited media playback line 680d3 of the graph 680 also shows when and how the synthetic depth of field effect was changed in response to detecting the single tap input 650ai. As shown by the graph 680, the edited media playback line 680d3 is separate from the media playback line 680d2 and shows that the computer system 600 changed the application of the synthetic depth of field effect in response to detecting the single tap input 650ai and when the change occurred. In particular, since the computer system 600 replaces the automatic change indicator 686b of FIG. 6AI with the user-specified change indicator 688i in response to detecting the single tap input 650ai, the edited media playback line 680d3 transitions to be positioned on the activity tracker 680b (e.g., "Jane's Tracker") between the 5-second mark and the 12-second mark.

[0249] As shown in FIG. 6AJ, in response to detecting the single tap input 650ai, the computer system 600 stops displaying the automatic change indicator 686b of FIG. 6AI and displays the user-specified change indicator 688i (e.g., along with the transition indicator 688i1) at the location where the automatic change indicator 688b was displayed. Thus, in some embodiments, the user-specified change during the editing of the media may supersede the automatic and / or user-specified change that occurred during the capture of the media and / or during the editing of the media. In some embodiments, the computer system 600 detects a separate input on a representation of a frame on the video that does not correspond to a separate time in the video where a change in the synthetic depth of field effect occurred, and in response to detecting the separate input, the computer system 600 displays an additional user-specified change indicator. In some embodiments, the computer system 600 displays the additional user-specified change indicator while continuing to display the other change indicators. In some embodiments, in response to detecting the separate input, the computer system 600 changes the application of the synthetic field of view (e.g., based on the input) to multiple frames of the video beginning at a separate time in the video. In some embodiments, in response to detecting a single tap input 650ai, the computer system 600 displays an animation of the transition indicator 688i1 gradually filling (e.g., gradually increasing in size by expanding from the right edge of the transition indicator) from the position of the user-specified change indicator 688i to the next change indicator (e.g., user-specified change indicator 688c). In FIG. 6AJ, the computer system 600 detects a tap input 650aj on the pause play control 668b. In response to detecting the tap input 650aj, the computer system 600 pauses the playback of the media.

[0250] As shown in Figure 6AK, media representation 660 is displayed with a representation of a frame corresponding to the 10 second mark of the video (e.g., as indicated by playhead 664a1 and elapsed time indicator 664c). In addition, a play control 668a is displayed at the location where a pause play control 668b was previously displayed in Figure 6AJ. In Figure 6AK, media representation 660 is a representation of the same frame in the captured media to which live preview 630 of Figure 6AL corresponds. In particular, media representation 660 of Figure 6AK differs from live preview 630 of Figure 6AL because media representation 660 is a frame with a synthetic depth of field effect applied to emphasize Jane 634 relative to John 632, and live preview 630 is a frame with a synthetic depth of field effect applied to emphasize John 632 relative to Jane 634. When computer system 600 modifies the application of a depth of field effect due to an input detected on a frame of video (e.g., a representation of a frame of video), computer system 600 also modifies the application of a depth of field effect applied to a frame of video that occurs after the frame of video in which the input was received. In Figure 6AK, computer system 600 detects a tap input 650ak on user-specified modification indicator 688h.

[0251] As shown in FIG. 6AL, in response to detecting the tap input 650ak, the computer system 600 displays the playhead 664a1 over the user-specified change indicator 688h. With the playhead 664a1 over the user-specified change indicator 688h, the playhead 664a1 is displayed at a location corresponding to the time when the user-specified change occurred in the captured video (e.g., the user-specified change represented by the user-specified change indicator 688h). In response to detecting the tap input 650ak, the computer system 600 updates the media representation 660 to be a representation of the frame displayed when the user-specified change occurred (e.g., as shown by the media representation 660 of FIG. 6AL, which is the live preview 630 of FIG. 6Z with a synthetic depth of field effect applied to enhance the focal plane and / or live preview 630 of FIG. 6AA). In FIG. 6AL, the computer system 600 detects a double tap input 650al.

[0252] 6AM, in response to detecting the double tap input 650al, the computer system 600 modifies the synthetic depth of field effect to emphasize John 632 relative to Jane 634. Additionally, the computer system 600 displays a primary subject indicator 678a around the head of John 632 and secondary subject indicators 674b-674c around the heads of Jane 634 and dog 638, respectively. Because the double tap input 650al is a double tap input, the computer system 600 applies a synthetic depth of field effect to emphasize John 632 relative to Jane 634, and prevents the computer system 600 from automatically modifying the applied synthetic depth of field effect as long as it is able to detect John 632 (e.g., John 632's face) in the visual content of the captured video (e.g., using one or more of the techniques described above in connection with detecting the double tap input 650u). In particular, the computer system 600 performs the same actions in response to detecting the same types of inputs (e.g., modifying the synthetic depth of field effect in the same manner and displaying the same types of indicators) regardless of whether the computer system 600 is capturing media and / or editing media (e.g., performing the same actions described above in response to detecting a single tap input 650o, 650ai, in response to detecting a double tap input 650u, 650al, in response to detecting a press and hold input). As shown by the graph 680, the edited media playback line 680d3 is separated from the media playback line 680d2 after the 4 second mark to show that the computer system 600 modified the application of the synthetic depth of field effect in response to detecting the double tap input 650al and when a change occurred.Specifically, after the 42 second mark (e.g., the frame of media during which the double tap input 650al was detected), the edited media playback line 680d3 is changed such that it is on the activity tracker 680a (e.g., "John's tracker") to represent that John 632 is highlighted and tracked (and not the selected focal plane) in the edited media. In some embodiments, in response to detecting the double tap input 650al, the computer system 600 replaces the user-specified change indicator 688h with a new user-specified change indicator.

[0253] Figure 6AN illustrates a computer system 600 displaying a media representation 660 that includes a representation of a captured video occurring after the previously captured media representation 660 of Figure 6AM. As shown in Figure 6AN, the computer system 600 applies a synthetic depth of field effect to emphasize John 632 relative to Jane 634 in the representation of the media shown by media representation 660 (e.g., media representation 660 differs from the live preview 630 of Figure 6AB for reasons similar to those discussed above in connection with Figure 6AK).

[0254] 6AO-6AP show an exemplary embodiment in which an option for removing changes in the application of a synthetic depth of field effect is displayed. In FIG. 6AN, the computer system 600 detects a tap input 650an on the user-specified change indicator 688h. As shown in FIG. 6AO, in response to detecting the tap input 650an, the computer system 600 displays a delete option 688h2 adjacent to the user-specified change indicator 688h and de-emphasizes (e.g., grays out) the scrubber region 664a and the effects region 664b. Here, the computer system 600 de-emphasizes (e.g., grays out) the scrubber region 664a and the effects region 664b to indicate that other portions (e.g., portions not including the delete option 669h1) are unavailable, inactive, and / or unresponsive to user input. When the user attempts to select the delete option 688h2, the computer system 600 renders other portions unavailable, inactive, and / or unresponsive to user input to avoid the possibility of the user causing the computer system to perform unintended actions. In some embodiments, in response to detecting an input at a location that does not correspond to the delete option 688h2, the computer system 600 re-emphasizes the scrubber region 664a and the effects region 664b and / or ceases displaying the delete option 688h2. In FIG. 6AO, the computer system 600 detects a tap input 650ao on the delete option 688h2. As shown in FIG. 6AP, in response to detecting the tap input 650ao, the computer system 600 changes the application of the synthetic depth of field effect from emphasizing John 632 over Jane 634 and re-emphasizes the scrubber region 664a and the effects region 664b (e.g., activates the scrubber region 664a and the effects region 664b). When the computer system 600 changes the application of the synthetic depth of field effect from emphasizing John 632 relative to Jane 634, the computer system 600 reverts to applying the synthetic depth of field effect that would have been applied if the removed user-specified change had not been made.Thus, in Figure 6AP, the computer system 600 updates the media presentation 660 to emphasize Jane 634 relative to John 632 since a permanent change in the application of the synthetic depth of field effect has been applied in response to detecting a double tap input 650u (e.g., using one or more techniques such as those described above in connection with Figures 6U-6Y). As shown by graph 680, the edited media playback line 680d3 has been altered to indicate that the computer system 600 has altered the application of the synthetic depth of field effect in response to detecting a tap input 650an, and when the change was made. In Figure 6AP, the computer system 600 detects a tap input 650ap1 on the cinematic video control 662c.

[0255] As shown in FIG. 6AQ, in response to detecting the tap input 650ap1, the computer system 600 displays the cinematic video control 662c in an inactive state and stops applying the synthetic depth of field effect to the captured video in the media editing user interface (e.g., as indicated by the media representation 660 having no shading). In some embodiments, in response to detecting the tap input 650ap1, the computer system 600 displays the change indicators as not selectable (e.g., grayed out) or stops displaying one or more of the change indicators. In some embodiments, in response to detecting an input directed at the cinematic video control 662c of FIG. 6AQ, the computer system 600 reapplies the synthetic depth of field effect to the captured video in the media editing user interface. In some embodiments, in response to detecting a tap input on the completion control 662a, the computer system 600 saves a version of the captured video without the synthetic depth of field effect applied (e.g., a version of the captured video having only natural blur for one or more and / or all of the frames in the video). In some embodiments, in response to detecting the tap input 650ap1, the computer system 600 stops displaying the effects region 664b in region 664d. In some embodiments, the computer system 600 moves the scrubber region 664a downward, and a portion of the scrubber region 664a is moved downward into region 664d. In some embodiments, in response to detecting the tap input 650ap1, the computer system 600 increases the size of the media representation 660 and / or the scrubber region 664a. In some embodiments, in response to detecting the tap input 650ap1, the computer system 600 de-highlights the effects region 664b and / or displays the effects region 664b as inactive.

[0256] 6AR illustrates an example embodiment in which the playhead 664a1 is dragged across the scrubber region 664a such that the playhead 664a1 snaps to a location corresponding to a change indicator. As shown in FIG. 6AR, a right swipe input 650ar is detected at location 654a, and the computer system 600 indicates that the playhead 664a1 is at location 654a because the location 654a is not within a first predetermined distance from a location corresponding to a user-specified change indicator 654c (the "change indicator location") (e.g., the playhead 664a1 is not displayed at the change indicator location). When a right swipe input 650ar is detected at location 654b, the computer system 600 displays the playhead 664a1 at the change location (e.g., above the user-specified change indicator 688c), which is in front of the location 654b, since a determination has been made that the location 654b is within a first predetermined distance from the change indicator location (e.g., a determination has been made that the playhead 664a1 is not displayed at the change indicator location). As shown in FIG. 6AR, when the playhead 664a1 is displayed at the change location, the computer system emits an output 656 (e.g., a haptic output (e.g., vibration), sound). When a right swipe input 650ar is detected at location 654c, the computer system 600 continues to display the playhead 664a1 at the change location, since a determination has been made that the location 654c is not within a second predetermined distance from the change indicator location (e.g., a determination has been made that the playhead 664a1 is displayed at the change indicator location). When a right swipe input 650ar is detected at location 654d, the computer system 600 displays the playhead 664a1 at location 654d because a determination is made that location 654d is within a second predetermined distance from the change indicator location (e.g., a determination is made that the playhead 664a1 will be displayed at the change indicator location).Thus, in some embodiments, the playhead snaps to a location associated with the change indicator when the playhead is near the change indicator. Further, in some embodiments, the playhead remains at the location associated with the change indicator until the playhead is a certain distance away from the change indicator. In some embodiments, the first predetermined distance and / or the second predetermined distance is a non-zero distance and / or a distance that is greater than a certain number of tick marks (e.g., 2-5 tick marks) away from the change location.

[0257] 6AS-6AU illustrate an exemplary embodiment in which computer system 600 is transitioned from being configured to operate in a cinematic video camera mode to being configured to operate in a portrait camera mode. As shown in FIG. 6AS, computer system 600 is configured to operate in a cinematic video camera mode (e.g., as indicated by cinematic video mode control 620e being in an active state), and while configured to operate in the cinematic video camera mode, computer system 600 displays a camera user interface using one or more techniques such as those described above in connection with FIG. 6B. In particular, as shown in FIG. 6AS, computer system 600 applies a synthetic depth of field effect to visual content being captured by one or more cameras of computer system 600 to emphasize John 632 relative to Jane 634 (e.g., as indicated by the shading in live preview 630 of FIG. 6AS). As shown in FIG. 6AS, computer system 600 displays primary subject indicator 672a around John 632's head and secondary subject indicator 674b around Jane 634's head. In FIG. 6AS, the computer system 600 detects a left swipe input 650 on the camera mode control 620 .

[0258] As shown in FIG. 6AT, in response to detecting the left swipe input 650as, the computer system 600 moves the camera mode control 620 to the left so that the portrait mode control 620b is displayed in the center of the camera user interface. In FIG. 6AT, the computer system 600 displays the portrait mode control 620b as selected (e.g., in bold) and stops displaying the cinematic video mode control 620e (e.g., indicating that the cinematic video mode control 620e is not selected). Further, in response to detecting the left swipe input 650as, the computer system 600 transitions from being configured to operate in a cinematic video camera mode to a portrait camera mode. As shown in FIG. 6AT, in response to detecting the left swipe input 650as, the computer system 600 compresses the live preview 630, such that the live preview 630 in FIG. 6AT is smaller and has a different aspect ratio than the live preview 630 in FIG. 6AS. In addition to shortening the live preview 630, the computer system 600 is updated to include a lighting effects control 618. The lighting effects control 618 indicates that natural lighting effects are being applied to the live preview 630 (e.g., as indicated by a displayed natural lighting control 618a and natural lighting indicator 618a1). In some embodiments, when natural lighting effects are applied to the live preview 630, blur effects and / or lighting effects are used / applied when capturing media. In some embodiments, adjustments to the lighting effects control 618 are also reflected in the live preview 630.

[0259] As shown in FIG. 6AT, the computer system 600 does not display any subject indicators (e.g., primary subject indicator 672a, secondary subject indicator 674b) to indicate whether an individual subject is emphasized / not emphasized. While operating in portrait camera mode, the computer system 600 does not apply a synthetic depth of field effect to emphasize one subject relative to another. However, while operating in portrait camera mode, the computer system 600 applies a blur effect and / or lighting effect based on the selected natural light control 618a (e.g., as indicated by the shading of the live preview 630 of FIG. 6AT). In FIG. 6AT, the computer system 600 detects a press and hold input 650at on the live preview 630.

[0260] As shown in FIG. 6AU, in response to detecting the press and hold input 650at, the computer system 600 displays focus and exposure controls 696 including an exposure control indicator 696a1. While displaying the focus and exposure controls 696, the computer system 600 also displays a focus setting indicator 602c ("AE / AF lock") within the indicator area 694c, which indicates that the computer system 600 will not allow the auto exposure and auto focus settings to be automatically changed. In FIG. 6AU, in response to detecting the press and hold input 650at, the computer system 600 blurs a portion of the display such that the computer system 600 focuses on a location corresponding to the location where the press and hold input 650at was received and blurs other portions of the area. In some embodiments, in response to detecting a swipe input on the live preview 630, the computer system 600 adjusts the exposure settings based on the magnitude and direction of the swipe input.

[0261] In response to detecting the press and hold input, computer system 600 is configured to focus on a particular location within the FOV, regardless of whether computer system 600 is operating in a cinematic camera mode (e.g., as described above in connection with detecting press and hold input 650z of FIGS. 6Z-6AA) or a portrait camera mode (e.g., as described above in connection with left swipe input 650as of FIGS. 6AS-6AU). Furthermore, the visual appearance of focus and exposure control 696 of FIG. 6AU appears similar to focus indicator 676 of FIG. 6AA. However, focus and exposure control 696 includes exposure control indicator 696a1, but not focus indicator 676. Furthermore, exposure control indicator 696a1 of FIG. 6AU is also different from focus control indicator 694b. The exposure control indicator 696a1 indicates that the computer system 600 has locked the focus setting (e.g., the bokeh effect applied in FIG. 6AU) and the exposure setting, while the focus control indicator 694b indicates that the computer system 600 has only locked the focus setting (e.g., the synthetic depth of field effect applied in FIG. 6AA). Thus, while the computer system 600 is operating in a cinematic video camera mode, the computer system 600 displays controls that indicate that the computer system 600 is configured to focus on a particular location and that allow the computer system 600 to adjust and / or lock the exposure setting used to capture media (e.g., as described above in connection with FIGS. 6Z-6AA). Additionally, while the computer system 600 is operating in a portrait camera mode, the computer system 600 displays controls that indicate that the computer system 600 is configured to focus on a particular location and that allow the computer system 600 to adjust and / or lock the exposure setting used to capture media (e.g., as described above in connection with FIGS. 6AS-6AU).

[0262] 6AV-6AY illustrate an example embodiment in which automatic modifications to apply a synthetic depth of field effect are removed during editing of media. Returning to FIG. 6AP, computer system 600 detects one or more inputs including a tap input 650ap2 on a cancel control 662g (e.g., as an alternative to detecting tap input 650ap1 as described above in connection with FIG. 6AP). Referring to FIG. 6AV, in response to detecting one or more inputs including a tap input 650ap2, computer system 600 discards previous modifications made to the media (e.g., modifications to the application of one or more synthetic depth of field effects as described above in connection with FIG. 6AD-6AP). In other words, computer system 600 resets the media to the state it was in before the media was edited and / or after the media was captured in FIG. 6AD-6AP. Thus, in Figure 6AV, computer system 600 re-displays the cinematic video editing user interface of Figure 6AD including, among other things, change indicators 686a, 686b, 688c, 686d, 688e, 686f, 686g, and 688h (the automatic and user-specified composite depth of field changes described above in connection with Figures 6A-6AC). In Figure 6AV, computer system 600 detects a tap input 650av on automatic change indicator 686b.

[0263] As shown in Figure 6AW, in response to detecting a tap input 650av, the computer system 600 updates the media representation 660 to a representation of a frame of the media occurring at the 7 second mark in the media (e.g., the frame of the media corresponding to the occurrence of the automatic change to synthetic depth of field indicated by the automatic change indicator 686b). As shown by the media representation 660 of Figure 6AW, the computer system 600 automatically applies a synthetic depth of field effect to emphasize John 632 relative to Jane 634 at the 7 second mark in the media. In Figure 6AW, the computer system 600 detects a tap input 650aw (or press and hold input) on the automatic change indicator 686b. As shown in Figure 6AX, in response to detecting a tap input 650aw, the computer system 600 displays a delete option 686b2 adjacent to the auto change indicator 686b and de-emphasizes (e.g., grays out) the scrubber region 664a and the effects region 664b (e.g., using one or more similar techniques as described above in connection with Figures 6AN-6AO). In Figure 6AX, the computer system 600 detects a tap input 650ax on the delete option 686b2.

[0264] As shown in FIG. 6AY, in response to detecting tap input 650ax, computer system 600 removes automatic change indicator 686b of FIG. 6AX and the automatic changes to the composite depth of field effect applied at the 7 second mark in the media. As part of removing the automatic changes to the composite depth of field effect, computer system 600 updates media representation 660 to show Jane 634 highlighted relative to John 632 at the 7 second mark in the media. Now, Jane 634 is highlighted relative to John 632 because the automatic depth of field effect corresponding to automatic change indicator 686a (e.g., the most recent composite depth of field effect applied prior to the 7 second mark) is currently applied to a frame of the media occurring at the 7 second mark in the media (e.g., as described in connection with FIG. 6D-6G). It should further be appreciated that the automatic composite depth of field effect corresponding to the automatic change indicator 686a is applied to other frames of media captured between the time corresponding to the automatic change indicator 686a (e.g., 4 seconds) and the time corresponding to the user-specified change indicator 688c (e.g., 12 seconds). Thus, when the automatic change indicator 686b is removed, the computer system 600 applies the composite depth of field effect corresponding to the automatic change indicator 686a to frames of media to which the composite depth of field effect corresponding to the automatic change indicator 686b was previously applied. As shown by graph 680 in FIG. 6AY, edited media playback line 680d3 is separated from media playback line 680d2 between the 6 second mark and the 10 second mark to show the changes to the synthetic depth of field effect that occur in response to detecting tap input 650ax (e.g., edited media playback line 680d3 is on activity tracker 680b “Jane's Tracker” between the 6 second mark and the 10 second mark in FIG. 6AY, which is different from the position of edited media playback line 680d3 in the corresponding time frame in FIG. 6AX).

[0265] 6AZ-6BC illustrate an exemplary embodiment in which computer system 600 detects one or more inputs on SDOFE control 662d. In FIG. 6AY, computer system 600 detects tap input 650ay on user-specified change indicator 688h. As shown in FIG. 6AZ, computer system 600 moves playhead 664a1 right from the 7 second mark to the 42 second mark and updates media representation 660 to show a frame of media corresponding to the 42 second mark (e.g., the frame corresponding to user-specified change indicator 688h). As shown in FIG. 6AZ, media representation 660 has a synthetic depth of field effect applied to emphasize the focal plane (e.g., as described above in connection with FIG. 6Z-6AB). In FIG. 6AZ, because dog 638 is located within the focal plane (e.g., as indicated by focus indicator 676), dog 638 is emphasized relative to other subjects within media representation 660 (e.g., as indicated by dog ​​638 having no shading within media representation 660). Further, because John 632 is closer to the emphasized focal plane than Jane 634 (e.g., as indicated by the shading of media representation 660), John 632 appears less blurred than Jane 634. In FIGURE 6AZ, computer system 600 detects a tap input 650az on SDOFE control 662d.

[0266] As shown in Figure 6BA, in response to detecting tap input 650az, computer system 600 stops applying depth of field effect changes corresponding to the user-specified changes in the edited media (e.g., user-specified change indicators 688c, 688e, and 688h of Figure 6AZ). Further, because computer system 600 is configured to not apply previously applied user-specified composite depth of field effect changes (e.g., in response to detecting tap input 650az), in response to detecting tap input 650az, computer system 600 stops displaying user-specified change indicators 688c, 688e, and 688h, as well as transition indicators 688c1, 688e1, and 688h1. In particular, computer system 600 removes user-specified change indicators 688c and 688e without replacing them with other change indicators. However, at the 42 second mark, computer system 600 replaces user-specified change indicator 688h of FIG. 6AZ with automatic change indicator 686ba of FIG. 6BA. Thus, computer system 600 may remove the user-specified change to the composite depth of field effect and insert an automatic change to the composite depth of field effect (e.g., using one or more techniques described below in connection with FIG. 12) based on a determination that an automatic change to the composite depth of field effect should be made. Here, this separate determination (e.g., a determination that an automatic change to the composite depth of field effect should be made) was made because activity level 680a1 ("John's activity level") increased at the 42 second mark relative to activity level 680b1 ("Jane's activity level") and activity level 680c1 (the dog's activity level). Thus, as shown by media representation 660, based on this individual determination, and because the user-specified changes are no longer applied at the 42 second mark, the computer system 600 automatically applies a synthetic depth of field effect to highlight John 632 relative to Jane 634 and dog 638 at the 42 second mark in the video.In some embodiments, this separate determination is made while capturing media (e.g., and / or before the user-specified modifications are removed) (e.g., as described below in connection with FIG. 12). In some embodiments, this separate determination is saved during media capture so that it can be available to be applied (or reapplied) once the user-specified modifications are removed (e.g., as described below in connection with FIG. 12). In some embodiments, the user-specified modifications can override saved automatic modifications to the composite depth-of-field effect (e.g., as described below in connection with FIG. 12). In some embodiments, this separate determination is made after the user-specified modifications are removed. In FIG. 6BA, computer system 600 detects a left swipe gesture 650ba on playhead 664a1.

[0267] As shown in Figure 6BB, in response to detecting left swipe gesture 650ba, computer system 600 moves playhead 664a1 left from a location corresponding to 42 seconds in the media to a location corresponding to 34 seconds in the media. As shown in Figure 6BB, in response to detecting left swipe gesture 650ba, computer system 600 updates media representation 660 to show a frame of media corresponding to 34 seconds in the media. At the 34 second mark, computer system 600 applies a compositing effect depth that emphasizes John 632 relative to wagon 628 (e.g., as described above in connection with Figure 6W). In some embodiments, in response to detecting input 650bb1 on SDOFE control 662d, computer system 600 reapplies the user-specified depth of field change to the representation of the media and redisplays user-specified change indicators 688c, 688e, and 688h and transition indicators 688c1, 688e1, and 688h1 (e.g., the edited media and cinematic video editing user interface return to the state shown in Figure 6AZ and / or the state before tap input 650az was detected). In Figure 6BB, computer system 600 detects input 650bb2 on wagon 628.

[0268] As shown in FIG. 6BC, in response to detecting the input 650bb2 and based on a determination that the input 650bb2 is a press and hold input, the computer system 600 modifies the synthetic depth of field effect to emphasize the focal plane at the location of the press and hold input 650bb2 (starting at the 42 second mark in the media). Additionally, the computer system 600 displays a user-specified change indicator 688j and a transition indicator 688j1 at a location in the effects area 664b that corresponds to the 42 second mark in the media. As shown in FIG. 6BC, in response to detecting the input 650bb2 and based on a determination that the input 650bb2 is a press and hold input, the computer system 600 also displays a focus setting indicator 694bc ("AF Lock-5M") that includes an indication of the distance (e.g., "5M") between the computer system 600 and the currently selected focal plane (e.g., the focal plane selected by the input 650bb2). After applying the composite depth of field effect to highlight the focal plane in FIG. 6BC, the media representation 660 shows the wagon 628 highlighted relative to John 632 and Jane 634. Here, the wagon 628 is highlighted relative to John 632 and Jane 634 in the media representation 660 because the wagon 628 is located in the highlighted focal plane. In particular, the computer system 600 ceases to display the automatic change indicators 686g and 686ba of FIG. 6BB because a determination was made that no automatic change to the composite depth of field effect corresponding to the automatic change indicator 686g was required. Returning to FIG. 6W, an automatic change to the composite depth of field effect corresponding to the automatic change indicator 686g was made because a determination was made that Jane 634 (e.g., the currently highlighted subject) was outside the field of view of one or more cameras of the computer system 600. However, Jane 634 is no longer highlighted by the composite depth of field effect immediately prior to the time corresponding to the automatic change indicator 686g.Thus, in FIG. 6BC, because Jane 634 is no longer highlighted, computer system 600 removes the automatic changes to the composite depth of field effect made because the currently highlighted subject (e.g., Jane 634) could not be detected within the field of view of one or more cameras of computer system 600. Computer system 600 removes automatic change indicator 686ba for similar reasons (e.g., because the user specified that the focal plane is highlighted, the computer system determines that it does not need to implement changes to highlight the subject in the media via application of a composite depth of field effect). Thus, as shown in FIGS. 6BB-6BC, computer system 600 can remove changes to the composite depth of field effect in response to user-specified changes to the composite depth of field effect during editing of the captured media. In Figure 6BC, media representation 661bc1 (e.g., a frame of edited media at the 36 second mark) and media representation 661bc2 (e.g., a frame of edited media at the 42 second mark) are provided to indicate (e.g., also indicated by edited media play line 680d3) that user-specified changes to the composite depth of field effect that enhance the focal plane have been applied to frames of media occurring after the time that input 650bb2 was detected in the video (e.g., changes to the composite depth of field effect corresponding to auto change indicators 686g and 686ba in Figure 6BB are no longer applied). As shown in media representations 661bc1 and 661bc2, objects (e.g., John 632, Jane 634, and / or dog 638) that are not in the focal plane (e.g., as indicated by focus indicator 676) are not enhanced.

[0269] As shown in Figure 6BC, in response to input 650bb2, computer system 600 transitions SDOFE control 662d from an inactive state (e.g., Figure 6BB) to an active state (Figure 6BC). Thus, in Figure 6BC, computer system 600 is configured to apply user-specified changes to the composite depth of field effect. However, in Figure 6BC, user-specified changes to the composite depth of field effect (e.g., user-specified changes made in response to detecting input 650bb2) were made while SDOFE control 662d was inactive (and / or while the computer system was not configured to apply user-specified changes to the composite depth of field effect), so user-specified change indicators 688c, 688e, and 688h of Figure 6AZ are not applied. 6BC, the user-specified modifications added in response to detecting input 650bb2 override any previous user-specified modifications to the composite depth of field effect (e.g., modifications applied before the computer system was not configured to apply user-specified modifications to the composite depth of field effect). In some embodiments, instead of overriding the previous user-specified modifications, computer system 600 displays user-specified modification indicators 688c, 688e, and 688h along with user-specified modification indicator 688j and applies modifications to the composite depth of field effect that correspond to user-specified modification indicators 688c, 688e, 688h, and 688j.

[0270] FIG. 6BC1 illustrates an alternative situation to the situation described in some embodiments of FIG. 6BC. In FIG. 6BC, when computer system 600 detects an input corresponding to a selection of an object for which the computer system has determined that the computer system does not have sufficient data to track the object through at least a predetermined portion of the video (e.g., through multiple frames in the video) (e.g., in response to input 650bb2, which is a tap input in FIG. 6BB-FIG. 6BC), in FIG. 6BC1, computer system 600 detects an input corresponding to a selection of an object for which the device has determined that the device has sufficient data to track the object through at least a predetermined portion of the video. Thus, in FIG. 6BC1, in response to detecting input 650bb2 and based on a determination that input 650bb2 is a tap input, a determination is made that the user has requested focus on wagon 628 that is not being tracked by computer system 600 (e.g., there is no focus indicator displayed around wagon 628 in FIG. 6BB (e.g., 674a and / or 674b)) and for which there is sufficient data to track the object through at least a predetermined portion of the video. Since a determination is made that the wagon 628 is not being tracked by the computer system 600 and that the user is requesting focus on the wagon 628, the computer system 600 displays the user interface of FIG. 6BC1 including a tracking progress indicator 694bc1, a tracking focus indicator 674d, a cancel control 688n3, a temporary user specific change indicator 688n, and a temporary transition indicator 688n1 to indicate that the request is being processed. As shown in FIG. 6BC1, in response to detecting the input 650bb2 and based on a determination that the input 650bb2 is a tap input, the computer system 600 also de-emphasizes the scrubber region 664a and affects region 664b to indicate that the request to focus on the wagon 628 is being processed.In Fig. 6BC1, computer system 600 proc...

Claims

1. 1. A method comprising:

1. A computer system in communication with one or more cameras, a display generating component, and one or more input devices, comprising: via the display generation component, a user interface, a representation of a video including a plurality of frames, the representation including a first object, a second object, and a third object; a first user interface object indicating that the first subject is being enhanced with a synthetic depth of field effect that modifies visual information captured by the one or more cameras to emphasize the first subject in the plurality of frames relative to the second subject, the first user interface object being displayed at a position corresponding to at least a portion of the first subject, and the first user interface object moving as the first subject moves within the video; a second user interface object indicating that the second subject is not highlighted, the second user interface object having a different color and / or shape than the first user interface object, and wherein the second user interface object moves as the second subject moves within the video; and displaying a user interface including a third user interface object indicating that the third subject is not highlighted, the third user interface object having a same color and / or shape as the second user interface object, the third user interface object having a different color and / or shape than the first user interface object, and the third user interface object moving as the third subject moves within the video; detecting, while displaying the user interface including the representation of the video and the first user interface object, a gesture via the one or more input devices corresponding to a selection of the second object in the representation of the video; in response to detecting the gesture corresponding to a selection of the second object in the representation of the video; modifying the synthetic depth of field effect to modify the visual information captured by the one or more cameras to emphasize the second object relative to the first object in the plurality of frames; displaying a fourth user interface object indicating that the second subject is being enhanced by the modified synthetic depth of field effect that modifies the visual information captured by the one or more cameras to emphasize the second subject in the plurality of frames relative to the first subject, the fourth user interface object being displayed at a position corresponding to at least a portion of the second subject, the fourth user interface object moving as the second subject moves within the video, and the fourth user interface object having the same color and / or shape as the first user interface object; continuing to display the third user interface object; and ceasing display of the first user interface object; displaying a fifth user interface object indicating that the first subject is not highlighted, the fifth user interface object having the same color and / or shape as the second user interface object and the third user interface object, and the fifth user interface object moving as the first subject moves within the video; the first user interface object and the fourth user interface object have a first color, and the second user interface object, the third user interface object and the fifth user interface object have a second color different from the first color; and / or The method, wherein the first user interface object and the fourth user interface object have a first shape, and the second user interface object, the third user interface object and the fifth user interface object have a second shape that is different from the first shape.

2. The method of claim 1 , wherein the gesture corresponding to a selection of the second object is detected while the one or more cameras are capturing the visual information.

3. The method of claim 1 , wherein the gesture corresponding to selection of the second subject is detected during playback of the video after capture of the video has ended.

4. The method of claim 1 , wherein the gesture corresponding to the selection of the second object is a first single-tap gesture.

5. The method of claim 1 , wherein the gesture corresponding to the selection of the second object is a first multi-tap gesture.

6. The method of claim 1 , wherein the gesture corresponding to the selection of the second object is a first press-and-hold gesture.

7. modifying the visual information captured by the one or more cameras by modifying the synthetic depth of field effect to emphasize the second object in the plurality of frames relative to the first object; In accordance with a determination that the gesture corresponding to a selection of the second object is a first type of gesture, modifying the visual information captured by the one or more cameras to emphasize the second object until a first criterion is met; and modifying the visual information captured by the one or more cameras to emphasize the second object according to a determination that the gesture corresponding to the selection of the second object is a second type of gesture that is different from the first type of gesture, until a second criterion that is different from the first criterion is satisfied.

8. the first type of gesture is a second single tap gesture; The second type of gesture is a second multi-tap gesture. The method of claim 7.

9. detecting a gesture of the first type of gesture directed at the second object while the visual information captured by the one or more cameras is altered to emphasize the second object until a first criterion is met; in response to detecting the gesture of the first type of gesture directed at the second object, modifying the visual information captured by the one or more cameras to emphasize the second object until a second criterion is met; The method of claim 7 further comprising:

10. modifying the visual information captured by the one or more cameras by modifying the synthetic depth of field effect to emphasize the second object in the plurality of frames relative to the first object; 2. The method of claim 1, further comprising: modifying the visual information captured by the one or more cameras to emphasize the second subject by applying the synthetic depth of field effect to a fixed focal plane within the plurality of frames in accordance with a determination that the gesture corresponding to a selection of the second subject is a third type gesture.

11. displaying an indication of a distance to the fixed focal plane in response to a determination that the gesture corresponding to a selection of the second object is the third type of gesture; The method of claim 10 further comprising:

12. while displaying the fourth user interface object and not displaying the first user interface object. displaying the first user interface object and ceasing to display the fourth user interface object in accordance with a determination that the first subject in the plurality of frames satisfies a set of automatic selection criteria; The method of claim 1 further comprising:

13. in accordance with a determination that the gesture corresponding to a selection of the second object is a fourth type of gesture, the set of automatic selection criteria is a first set of automatic selection criteria; in accordance with a determination that the gesture corresponding to a selection of the second object is a fifth type gesture different from the fourth type gesture, the set of automatic selection criteria being a second set of automatic selection criteria different from the first set of automatic selection criteria; The method of claim 12.

14. prior to detecting the gesture corresponding to a selection of the second object, the set of automatic selection criteria includes a criterion that is satisfied when a first distinct object in the representation of the video satisfies a first selection confidence threshold; in response to detecting the gesture corresponding to a selection of the second object, the set of automatic selection criteria includes a criterion that is met when the first individual object in the representation of the video satisfies a second selection confidence threshold that is higher than the first selection confidence threshold. The method of claim 12.

15. 2. The method of claim 1 , wherein the synthetic depth of field effect, which modifies the visual information captured by the one or more cameras to emphasize the second object in the multiple frames relative to the first object, changes over time as the second object moves within the field of view of the one or more cameras.

16. the user interface including a video navigation user interface element, the method further comprising:

2. The method of claim 1 , comprising, in response to detecting the gesture corresponding to selection of the second object while displaying the video navigation user interface element, displaying a user interface object within the video navigation user interface element indicating that a user-specified change occurred at a time within the video.

17. The user interface object indicating that the user-specified change has occurred, in response to a determination that the gesture corresponding to the selection of the second object is a sixth type of gesture, a fourth visual appearance; and and a fifth visual appearance different from the fourth visual appearance in accordance with a determination that the gesture corresponding to the selection of the second object is a seventh type gesture different from the sixth type gesture.

18. Displaying the fourth user interface object includes: displaying the fourth user interface object having a sixth visual appearance in accordance with a determination that the gesture corresponding to a selection of the second object is a gesture of an eighth type; and and displaying the fourth user interface object having a seventh visual appearance different from the sixth visual appearance in accordance with a determination that the gesture corresponding to selection of the second subject is a ninth type gesture different from the eighth type gesture.

19. the user interface being a media capture user interface, the method further comprising: after detecting the gesture corresponding to a selection of the second object, detecting one or more gestures via the one or more input devices while displaying the user interface; In response to detecting the one or more gestures, a media editing user interface comprising: a second representation of the video comprising a third plurality of frames, the second representation including the first subject and the second subject; and displaying a media editing user interface including: a sixth user interface object indicating that the first subject is enhanced with a synthetic depth of field effect that modifies visual information captured by the one or more cameras to emphasize the first subject in the plurality of frames relative to the second subject; and detecting, while displaying the media editing user interface, a second gesture via the one or more input devices corresponding to a selection of the second object in the second representation of the video; in response to detecting the second gesture corresponding to a selection of the second object in the second representation of the video; modifying the synthetic depth of field effect to modify the visual information captured by the one or more cameras to emphasize the second object relative to the first object in the third plurality of frames; and displaying a seventh user interface object indicating that the second subject is emphasized by the modified synthetic depth of field effect that modifies the visual information captured by the one or more cameras to emphasize the second subject in the third plurality of frames relative to the first subject.

20. detecting a first gesture directed at the representation of the video after detecting the gesture corresponding to a selection of the second subject and modifying the visual information captured by the one or more cameras to modify the synthetic depth of field effect to emphasize the second subject in the plurality of frames relative to the first subject; modifying the modified synthetic depth of field effect to modify the visual information captured by the one or more cameras in response to detecting the first gesture directed at the representation of the video; The method of claim 1 further comprising:

21. The method of claim 1 , wherein the user interface includes selectable user-interface objects for modifying the compounded depth of field effect that, when selected, modify the compounded depth of field effect.

22. the user interface includes selectable user interface objects for controlling a video capture mode; the selectable user interface object for controlling the video capture mode is displayed with a status indication indicating that the video capture mode is active; The method further comprising: while displaying the user interface including the representation of the video, the first user interface object and the selectable user interface object for controlling the video capture mode are displayed with the status indication indicating that the video capture mode is active, and applying the synthetic depth of field effect that modifies the visual information captured by the one or more cameras to emphasize the first subject relative to the second subject in the plurality of frames; detecting a gesture directed at the selectable user interface object for controlling the video capture mode while applying the synthetic depth of field effect that modifies the visual information captured by the one or more cameras to emphasize the first subject relative to the second subject in the plurality of frames; and in response to detecting the gesture directed at the selectable user interface object for controlling the video capture mode, ceasing application of the synthetic depth of field effect that modifies the visual information captured by the one or more cameras to emphasize the first subject in the plurality of frames relative to the second subject. The method of claim 1.

23. Prior to detecting the gesture directed at the selectable user interface object for controlling the video capture mode, the representation is displayed with a first amount of blur, the method further comprising:

23. The method of claim 22, comprising, in response to detecting the gesture directed at the selectable user interface object for controlling the video capture mode, displaying, via the display generation component, the representation of the video with a second amount of blur less than the first amount of blur.

24. configuring a focus setting of one or more cameras to focus on the second subject in the representation of the video in response to detecting the gesture corresponding to selection of the second subject, wherein the computer system is not configured to automatically change the focus setting of the one or more cameras for at least a predetermined period of time; detecting a second gesture directed toward the representation of the video while the computer system is configured to focus on the second object in the representation of the video; in response to detecting the second gesture directed at the representation of the video, enabling the computer system to automatically change the focus setting of the one or more cameras for at least the predetermined period of time; The method of claim 1 further comprising:

25. the representation of the video includes a representation of a subset of content from a first portion of a field of view of one or more cameras; the field of view of the one or more cameras extends beyond the first portion of the field of view to a second portion of the field of view of the one or more cameras that is not included in the representation; a determination as to which object to enhance is based on information from the second portion of the field of view of the one or more cameras in the video; The method of claim 1.

26. 26. The method of claim 25, wherein the determination regarding which object to enhance includes automatically selecting a second distinct object to enhance before the second distinct object is visible within the first portion of the field of view.

27. The determination of which object to enhance may include: detecting when the second individual object moves out of the first portion of the field of view while the second individual object is highlighted; in response to detecting that the second individual object has moved out of the first portion of the field of view; automatically selecting a different object to be enhanced in accordance with a determination that the second distinct object has moved out of the second portion of the field of view; 27. The method of claim 26, comprising: refraining from selecting a different object to be enhanced for at least a predetermined period of time pursuant to a determination that the second distinct object remains within the second portion of the field of view.

28. A computer program product causing a computer system configured to communicate with one or more cameras, a display generating component, and one or more input devices to carry out the method of any one of claims 1 to 27.

29. 1. A computer system comprising: A memory for storing a computer program according to claim 28; A computer system, comprising: one or more processors capable of executing a computer program stored in the memory; and the computer system configured to communicate with one or more cameras, a display generating component, and one or more input devices.

30. A computer system configured to communicate with one or more cameras, a display generating component, and one or more input devices, the computer system Means for carrying out the method according to any one of claims 1 to 27. A computer system comprising:

Images