User interface for camera effects

Abstract

The present disclosure generally relates to user interfaces. In some examples, the electronic device transitions between user interfaces for capturing photographs based on data received from a first camera and a second camera. In some examples, the electronic device provides enhanced zoom capabilities that produce visually satisfactory results for the displayed digital viewfinder and for the captured videos. In some examples, the electronic device provides user interfaces for transitioning the digital viewfinder between a first camera with digital zoom applied and a second camera without digital zoom. In some examples, the electronic device prepares to capture media at various magnification levels. In some examples, the electronic device has enhanced capabilities for navigating through multiple values.

Description

Technology Field

[0001] Cross-reference regarding related applications

[0002] The present application is in conjunction with the following concurrently pending provisional patent applications: U.S. Patent Application No. 62 / 349,059, filed June 12, 2016, with the title "USER INTERFACE FOR CAMERA EFFECTS"; Danish Patent Application No. PA201670627, filed August 16, 2016, with the title "USER INTERFACE FOR CAMERA EFFECTS"; U.S. Patent Application No. 62 / 384,140, ​​filed September 6, 2016, with the title "USER INTERFACE FOR CAMERA EFFECTS"; and U.S. Patent Application No. 62 / 397,860, filed September 21, 2016, with the title "USER INTERFACE FOR CAMERA EFFECTS". This relates to Danish patent application No. PA201670753, filed September 22, 2016, with the title of the invention "USER INTERFACE FOR CAMERA EFFECTS"; and Danish patent application No. PA201670755, filed September 22, 2016, with the title of the invention "USER INTERFACE FOR CAMERA EFFECT". The contents of these applications are incorporated herein by reference in their entirety.

[0003] Technology field

[0004] The present disclosure generally relates to a computer user interface of an electronic device, in particular to a device having an embedded camera. Background Technology

[0005] The use of electronic devices for recording video and taking photos has increased significantly in recent years. Exemplary electronic devices for recording video and taking photos include smartphones and handheld cameras. Such devices often include a viewfinder that the user can use to preview before taking a photo or recording a video.

[0006] However, some technologies for managing camera effects using electronic devices are generally cumbersome and inefficient. For example, modifying visual effects within the viewfinder to make captured images and recorded videos display visual effects often requires extensive user input and is inaccurate. For instance, some existing technologies use complex and time-consuming user interfaces that may involve multiple key presses and keystrokes. These technologies require more time than necessary, wasting user time and device energy. This latter consideration is particularly important for battery-operated devices.

[0007] Accordingly, the present technology provides electronic devices having faster and more efficient methods and interfaces for managing camera effects. These methods and interfaces optionally complement or replace other methods for managing camera effects. Such methods and interfaces reduce the cognitive burden on the user and create a more efficient human-machine interface. In the case of battery-operated computing devices, such methods and interfaces conserve power and increase the time between battery charges. In some examples, the technologies provide simulated optical effects and captured images within camera viewfinders without requiring additional hardware components. In some examples, the technologies provide the ability to rapidly transition between user interfaces for capturing photos based on data received from a first camera and a second camera with limited user input. In some examples, the technologies efficiently provide enhanced zoom capabilities that produce visually satisfactory results for the displayed digital viewfinder and the captured videos. In some examples, the technologies efficiently provide user interfaces for transitioning the digital viewfinder between a first camera with digital zoom applied and a second camera without digital zoom. These technologies reduce the number of required user inputs and conserve battery power.

[0008] According to some embodiments, a method is performed in an electronic device having a first camera, a second camera, and a display. The method comprises: displaying a digital viewfinder on the display, the viewfinder including a preview based on data received from the first camera; and while displaying the digital viewfinder: applying a simulated optical effect to the preview displayed in the digital viewfinder, upon a determination that a set of one or more conditions is satisfied—wherein a first condition of the set of one or more conditions is satisfied when a subject is detected within a predetermined distance from the device—wherein the simulated optical effect is based on data received from the first camera and the second camera—; and displaying the preview in the digital viewfinder without applying the simulated optical effect, upon a determination that a set of one or more conditions is not satisfied.

[0009] According to some embodiments, a non-transient computer-readable storage medium is described. The non-transient computer-readable storage medium stores one or more programs configured to be executed by one or more processors of an electronic device having a first camera, a second camera, and a display, and one or more programs include: displaying a digital viewfinder on the display, which includes a preview based on data received from the first camera; and while displaying the digital viewfinder: applying a simulated optical effect to the preview displayed in the digital viewfinder upon a determination that a set of one or more conditions is satisfied—wherein a first condition of the set of one or more conditions is satisfied when a subject is detected within a predetermined distance from the device—wherein the simulated optical effect is based on data received from the first camera and the second camera; and, upon a determination that a set of one or more conditions is not satisfied, displaying the preview in the digital viewfinder without applying the simulated optical effect.

[0010] According to some embodiments, an electronic device is described. The electronic device comprises: a first camera; a second camera; a display; one or more processors; and a memory for storing one or more programs configured to be executed by one or more processors, wherein one or more programs include: a digital viewfinder on the display that includes a preview based on data received from the first camera; and while displaying the digital viewfinder:, upon a determination that a set of one or more conditions is satisfied—wherein a first condition of the set of one or more conditions is satisfied when a subject is detected within a predetermined distance from the device—a simulated optical effect is applied to the preview displayed in the digital viewfinder—wherein the simulated optical effect is based on data received from the first camera and the second camera—; and, upon a determination that a set of one or more conditions is not satisfied, a preview in the digital viewfinder without applying the simulated optical effect.

[0011] According to some embodiments, an electronic device is described. The electronic device comprises: a first camera; a second camera; and a display; means for displaying a digital viewfinder on the display, including a preview based on data received from the first camera; and means for displaying the digital viewfinder while: according to a determination that a set of one or more conditions is satisfied—a first condition among the set of one or more conditions is satisfied when a subject is detected within a predetermined distance from the device—means for applying a simulated optical effect to the preview displayed in the digital viewfinder—the simulated optical effect is based on data received from the first camera and the second camera—; and according to a determination that a set of one or more conditions is not satisfied, means for displaying the preview in the digital viewfinder without applying the simulated optical effect.

[0012] According to some embodiments, a temporary computer-readable storage medium is described. The temporary computer-readable storage medium stores one or more programs configured to be executed by one or more processors of an electronic device having a first camera, a second camera, and a display, and one or more programs include: displaying a digital viewfinder on the display, which includes a preview based on data received from the first camera; and while displaying the digital viewfinder: applying a simulated optical effect to the preview displayed in the digital viewfinder upon a determination that a set of one or more conditions is satisfied—wherein a first condition of the set of one or more conditions is satisfied when a subject is detected within a predetermined distance from the device—wherein the simulated optical effect is based on data received from the first camera and the second camera; and, upon a determination that a set of one or more conditions is not satisfied, displaying the preview in the digital viewfinder without applying the simulated optical effect.

[0013] According to some embodiments, a method is performed in an electronic device having a first camera, a second camera, and a display. The method comprises: a user interface for capturing photographs based on data received from a first camera, including displaying a digital viewfinder at a first magnification on the display; and simultaneously displaying an affordance for modifying the magnification of photographs captured by the device using one or more of the first and second cameras; detecting activation of the affordance; stopping displaying the user interface for capturing photographs based on data received from the first camera on the display in response to detecting activation of the affordance; and displaying the user interface for capturing photographs based on data received from a second camera, including displaying a digital viewfinder at a second magnification greater than the first magnification on the display.

[0014] According to some embodiments, a non-transient computer-readable storage medium is described. The non-transient computer-readable storage medium stores one or more programs configured to be executed by one or more processors of an electronic device having a first camera, a second camera, and a display, and one or more programs include: a user interface for capturing photographs based on data received from the first camera, including: displaying a digital viewfinder at a first magnification on the display; and instructions for simultaneously displaying an affordance for modifying the magnification of photographs captured by the device using one or more of the first and second cameras; detecting the activation of the affordance; and in response to detecting the activation of the affordance, stopping the display of the user interface for capturing photographs based on data received from the first camera on the display; and displaying a user interface for capturing photographs based on data received from the second camera on the display, including displaying a digital viewfinder at a second magnification greater than the first magnification on the display.

[0015] According to some embodiments, an electronic device is described. The electronic device comprises: a first camera; a second camera; a display; one or more processors; and a memory for storing one or more programs configured to be executed by one or more processors, wherein one or more programs include: a user interface for capturing photographs based on data received from the first camera, comprising: displaying a digital viewfinder at a first magnification on the display; and instructions for simultaneously displaying an affordance for modifying the magnification of photographs captured by the device using one or more of the first and second cameras; detecting the activation of the affordance; and in response to detecting the activation of the affordance, stopping the display of the user interface for capturing photographs based on data received from the first camera on the display; and displaying the user interface for capturing photographs based on data received from the second camera on the display, comprising displaying a digital viewfinder at a second magnification greater than the first magnification.

[0016] According to some embodiments, an electronic device is described. The electronic device comprises: a first camera; a second camera; and a display; on the display: a user interface for capturing photographs based on data received from the first camera, including displaying a digital viewfinder at a first magnification; and means for simultaneously displaying affordances for modifying the magnification of photographs captured by the device using one or more of the first and second cameras; means for detecting activation of the affordances; in response to detecting activation of the affordances: means for stopping displaying on the display a user interface for capturing photographs based on data received from the first camera; and means for displaying on the display a user interface for capturing photographs based on data received from the second camera, including displaying a digital viewfinder at a second magnification greater than the first magnification.

[0017] According to some embodiments, a temporary computer-readable storage medium is described. The temporary computer-readable storage medium stores one or more programs configured to be executed by one or more processors of an electronic device having a first camera, a second camera, and a display, and one or more programs include: a user interface for capturing photographs based on data received from the first camera, including: displaying a digital viewfinder at a first magnification on the display; and instructions for simultaneously displaying an affordance for modifying the magnification of photographs captured by the device using one or more of the first and second cameras; detecting the activation of the affordance; and in response to detecting the activation of the affordance, stopping the display of the user interface for capturing photographs based on data received from the first camera on the display; and displaying a user interface for capturing photographs based on data received from the second camera on the display, including displaying a digital viewfinder at a second magnification greater than the first magnification.

[0018] According to some embodiments, a method is performed in an electronic device having one or more cameras and a display. The method comprises: displaying a digital viewfinder on the display based on data received from one or more cameras; detecting a gesture progressing at a gesture rate while displaying the digital viewfinder, wherein the gesture corresponds to an instruction to zoom the digital viewfinder from a first magnification level to a third magnification level; and, in response to detecting the gesture, zooming the digital viewfinder from a first magnification level to a second magnification level and from a second magnification level to a third magnification level, wherein the zooming step comprises: zooming the digital viewfinder at a first speed slower than the gesture speed during which the gesture is progressing during a first part of the gesture; and zooming the digital viewfinder at a second speed faster than the gesture speed during which the gesture is progressing during a second part of the gesture occurring after the first part of the gesture.

[0019] According to some embodiments, a non-transient computer-readable storage medium is described. A non-transient computer-readable storage medium for storing one or more programs configured to be executed by one or more processors of an electronic device having one or more cameras and displays, wherein one or more programs include: displaying a digital viewfinder based on data received from one or more cameras on the display; detecting a gesture progressing at a gesture speed while displaying the digital viewfinder, wherein the gesture corresponds to an instruction to zoom the digital viewfinder from a first magnification level to a third magnification level; and, in response to detecting the gesture, instructions for zooming the digital viewfinder from a first magnification level to a second magnification level and from a second magnification level to a third magnification level, wherein zooming includes: zooming the digital viewfinder at a first speed slower than the gesture speed during which the gesture is progressing during a first part of the gesture; and zooming the digital viewfinder at a second speed faster than the gesture speed during which the gesture is progressing during a second part of the gesture occurring after the first part of the gesture.

[0020] According to some embodiments, an electronic device is described. The electronic device comprises: one or more cameras; a display; one or more processors; and a memory for storing one or more programs configured to be executed by one or more processors, wherein one or more programs include: displaying a digital viewfinder on the display based on data received from one or more cameras; detecting a gesture proceeding at a gesture speed while displaying the digital viewfinder, wherein the gesture corresponds to an instruction to zoom the digital viewfinder from a first magnification level to a third magnification level; and, in response to detecting the gesture, instructions for zooming the digital viewfinder from a first magnification level to a second magnification level and from a second magnification level to a third magnification level, wherein zooming includes: zooming the digital viewfinder at a first speed slower than the gesture speed at which the gesture is proceeding during a first part of the gesture; and zooming the digital viewfinder at a second speed faster than the gesture speed at which the gesture is proceeding during a second part of the gesture occurring after the first part of the gesture.

[0021] According to some embodiments, an electronic device is described. The electronic device comprises: one or more cameras; and a display; on the display: a digital viewfinder based on data received from one or more cameras; while displaying the digital viewfinder, detecting a gesture proceeding at a gesture speed—the gesture corresponds to an instruction to zoom the digital viewfinder from a first magnification level to a third magnification level—; and means for zooming the digital viewfinder from a first magnification level to a second magnification level and from a second magnification level to a third magnification level in response to detecting the gesture, wherein zooming comprises: zooming the digital viewfinder at a first speed slower than the gesture speed at which the gesture proceeds during a first part of the gesture; and zooming the digital viewfinder at a second speed faster than the gesture speed at which the gesture proceeds during a second part of the gesture occurring after the first part of the gesture.

[0022] According to some embodiments, a temporary computer-readable storage medium is described. A temporary computer-readable storage medium for storing one or more programs configured to be executed by one or more processors of an electronic device having one or more cameras and displays, wherein one or more programs include: displaying a digital viewfinder based on data received from one or more cameras on the display; detecting a gesture progressing at a gesture speed while displaying the digital viewfinder, wherein the gesture corresponds to an instruction to zoom the digital viewfinder from a first magnification level to a third magnification level; and, in response to detecting the gesture, instructions for zooming the digital viewfinder from a first magnification level to a second magnification level and from a second magnification level to a third magnification level, wherein zooming includes: zooming the digital viewfinder at a first speed slower than the gesture speed during which the gesture is progressing during a first part of the gesture; and zooming the digital viewfinder at a second speed faster than the gesture speed during which the gesture is progressing during a second part of the gesture occurring after the first part of the gesture.

[0023] According to some embodiments, a method is performed in an electronic device having a display. The method comprises: displaying a digital viewfinder on the display; detecting a gesture corresponding to an instruction to zoom the digital viewfinder from a first magnification level to a second magnification level different from the first magnification level; determining whether a set of one or more conditions is satisfied—the first condition among the set of one or more conditions is satisfied when the difference between the second magnification level and the third magnification level is less than a predetermined threshold—; and, in accordance with the determination that a set of one or more conditions is satisfied, zooming the digital viewfinder from the first magnification level to the third magnification level.

[0024] According to some embodiments, a non-transient computer-readable storage medium is described. The non-transient computer-readable storage medium stores one or more programs configured to be executed by one or more processors of an electronic device having a display, and one or more programs include: displaying a digital viewfinder on the display; detecting a gesture corresponding to an instruction to zoom the digital viewfinder from a first magnification level to a second magnification level different from the first magnification level; determining whether a set of one or more conditions is satisfied—the first condition among the set of one or more conditions is satisfied when the difference between the second magnification level and the third magnification level is less than a predetermined threshold—; and instructions for zooming the digital viewfinder from the first magnification level to the third magnification level upon the determination that the set of one or more conditions is satisfied.

[0025] According to some embodiments, an electronic device is described. The electronic device comprises: a display; one or more processors; and a memory for storing one or more programs configured to be executed by one or more processors, wherein one or more programs include: displaying a digital viewfinder on the display; detecting a gesture corresponding to an instruction to zoom the digital viewfinder from a first magnification level to a second magnification level different from the first magnification level; determining whether a set of one or more conditions is satisfied—the first condition among the set of one or more conditions is satisfied when the difference between the second magnification level and the third magnification level is less than a predetermined threshold—; and instructions for zooming the digital viewfinder from the first magnification level to the third magnification level upon the determination that a set of one or more conditions is satisfied.

[0026] According to some embodiments, an electronic device is described. The electronic device comprises: a display; and means for displaying a digital viewfinder on the display; means for detecting a gesture corresponding to an instruction to zoom the digital viewfinder from a first magnification level to a second magnification level different from the first magnification level; means for determining whether a set of one or more conditions is satisfied—the first condition among the set of one or more conditions is satisfied when the difference between the second magnification level and the third magnification level is less than a predetermined threshold—; and means for zooming the digital viewfinder from the first magnification level to the third magnification level according to the determination that a set of one or more conditions is satisfied.

[0027] According to some embodiments, a temporary computer-readable storage medium is described. The temporary computer-readable storage medium stores one or more programs configured to be executed by one or more processors of an electronic device having a display, and one or more programs include: displaying a digital viewfinder on the display; detecting a gesture corresponding to an instruction to zoom the digital viewfinder from a first magnification level to a second magnification level different from the first magnification level; determining whether a set of one or more conditions is satisfied—the first condition among the set of one or more conditions is satisfied when the difference between the second magnification level and the third magnification level is less than a predetermined threshold—; and instructions for zooming the digital viewfinder from the first magnification level to the third magnification level upon the determination that the set of one or more conditions is satisfied.

[0028] According to some embodiments, a method is performed in an electronic device having one or more input devices and a display. The method comprises: a digital viewfinder for capturing media with one or more cameras at a first magnification level on the display; and simultaneously displaying a magnification affordance; detecting a first gesture at a position corresponding to the magnification affordance through one or more input devices while simultaneously displaying the digital viewfinder and the magnification affordance; preparing to capture media with one or more cameras at a second magnification level different from the first magnification level according to a determination that the first gesture is of a first type; and preparing to capture media with one or more cameras at a dynamically-selected magnification level different from the first magnification level according to a determination that the first gesture is of a second type different from the first type, wherein the dynamically-selected magnification level is selected based on the magnitude of the first gesture.

[0029] According to some embodiments, a non-transient computer-readable storage medium is described. The non-transient computer-readable storage medium stores one or more programs configured to be executed by one or more processors of an electronic device having one or more cameras, one or more input devices, and a display, wherein one or more programs include instructions for: on the display: a digital viewfinder for capturing media with one or more cameras at a first magnification level; and simultaneously displaying a magnification affordance; while simultaneously displaying the digital viewfinder and the magnification affordance, through one or more input devices, detecting a first gesture at a position corresponding to the magnification affordance; preparing to capture media with one or more cameras at a second magnification level different from the first magnification level according to a determination that the first gesture is of a first type; and preparing to capture media with one or more cameras at a dynamically-selected magnification level different from the first magnification level according to a determination that the first gesture is of a second type different from the first type, wherein the dynamically-selected magnification level is selected based on the magnitude of the first gesture.

[0030] According to some embodiments, an electronic device is described. The electronic device comprises: one or more cameras; one or more input devices; a display; one or more processors; and a memory for storing one or more programs configured to be executed by one or more processors, wherein one or more programs include: on the display: a digital viewfinder for capturing media with one or more cameras at a first magnification level; and simultaneously displaying a magnification affordance; while simultaneously displaying the digital viewfinder and the magnification affordance, through one or more input devices, a first gesture at a position corresponding to the magnification affordance; and, upon determining that the first gesture is of a first type, prepare to capture media with one or more cameras at a second magnification level different from the first magnification level; and, upon determining that the first gesture is of a second type different from the first type, prepare to capture media with one or more cameras at a dynamically-selected magnification level different from the first magnification level, wherein the dynamically-selected magnification level is selected based on the magnitude of the first gesture.

[0031] According to some embodiments, an electronic device is described. The electronic device comprises: one or more cameras; one or more input devices; a display; and on the display: a digital viewfinder for capturing media with one or more cameras at a first magnification level; and means for simultaneously displaying a magnification affordance; means for detecting a first gesture at a position corresponding to the magnification affordance through one or more input devices while simultaneously displaying the digital viewfinder and the magnification affordance; means for preparing to capture media with one or more cameras at a second magnification level different from the first magnification level according to a determination that the first gesture is of a first type; and means for preparing to capture media with one or more cameras at a dynamically-selected magnification level different from the first magnification level according to a determination that the first gesture is of a second type different from the first type, wherein the dynamically-selected magnification level is selected based on the magnitude of the first gesture.

[0032] According to some embodiments, a transient computer-readable storage medium is described. A non-transient computer-readable storage medium stores one or more programs configured to be executed by one or more processors of an electronic device having one or more cameras, one or more input devices, and a display, wherein one or more programs include instructions for: on the display: a digital viewfinder for capturing media with one or more cameras at a first magnification level; and simultaneously displaying a magnification affordance; while simultaneously displaying the digital viewfinder and the magnification affordance, through one or more input devices, detecting a first gesture at a position corresponding to the magnification affordance; preparing to capture media with one or more cameras at a second magnification level different from the first magnification level according to a determination that the first gesture is of a first type; and preparing to capture media with one or more cameras at a dynamically-selected magnification level different from the first magnification level according to a determination that the first gesture is of a second type different from the first type, wherein the dynamically-selected magnification level is selected based on the magnitude of the first gesture.

[0033] According to some embodiments, a method is performed in an electronic device having one or more cameras, one or more input devices, and a display. The method comprises: displaying a digital viewfinder based on data received from one or more cameras, wherein the digital viewfinder includes a representation of one or more objects within the field of view of one or more cameras; detecting a first gesture through one or more input devices while displaying the digital viewfinder; and, upon a determination that a first set of one or more conditions is satisfied, wherein the first condition of the first set of one or more conditions is satisfied when the first gesture is at a first position, updating the display of the digital viewfinder to focus on a representation of each object corresponding to the position of the first gesture on one or more input devices among one or more objects within the field of view of one or more cameras at a second magnification level different from a first magnification level, without preparing to capture media with one or more cameras. and, upon determining that a second set of one or more conditions is satisfied—wherein the first condition of the second set of one or more conditions is satisfied when the first gesture is in a second position different from the first position—the method includes the step of preparing to capture media with one or more cameras at a second magnification level different from the first magnification level.

[0034] According to some embodiments, a non-transient computer-readable storage medium is described. The non-transient computer-readable storage medium stores one or more programs configured to be executed by one or more processors of an electronic device having one or more cameras, one or more input devices, and a display, wherein the one or more programs: display a digital viewfinder based on data received from one or more cameras, wherein the digital viewfinder includes a representation of one or more objects within the field of view of one or more cameras; while displaying the digital viewfinder, detect a first gesture through one or more input devices; and, upon a determination that a first set of one or more conditions is satisfied, wherein the first condition of the first set of one or more conditions is satisfied when the first gesture is in a first position, update the display of the digital viewfinder to focus on a representation of each object corresponding to the position of the first gesture on one or more input devices among one or more objects within the field of view of one or more cameras at a second magnification level different from a first magnification level, without preparing to capture the media with one or more cameras; Based on the determination that a second set of one or more conditions is satisfied—wherein the first condition of the second set of one or more conditions is satisfied when the first gesture is in a second position different from the first position—it includes commands for preparing to capture media with one or more cameras at a second magnification level different from the first magnification level.

[0035] According to some embodiments, an electronic device is described. The electronic device comprises: one or more cameras; one or more input devices; a display; one or more processors; and a memory for storing one or more programs configured to be executed by one or more processors, wherein one or more programs: display a digital viewfinder based on data received from one or more cameras, wherein the digital viewfinder includes a representation of one or more objects within the field of view of one or more cameras; while displaying the digital viewfinder, detect a first gesture through one or more input devices; and, upon a determination that a first set of one or more conditions is satisfied, wherein the first condition of the first set of one or more conditions is satisfied when the first gesture is at a first position, update the display of the digital viewfinder to focus on a representation of each object corresponding to the position of the first gesture on one or more input devices among one or more objects within the field of view of one or more cameras at a second magnification level different from a first magnification level, without preparing to capture media with one or more cameras; Based on the determination that a second set of one or more conditions is satisfied—wherein the first condition of the second set of one or more conditions is satisfied when the first gesture is in a second position different from the first position—it includes commands for preparing to capture media with one or more cameras at a second magnification level different from the first magnification level.

[0036] According to some embodiments, an electronic device is described. The electronic device comprises: one or more cameras; one or more input devices; a display; and while the device is ready to capture media with one or more cameras at a first magnification level: means for displaying a digital viewfinder on the display based on data received from one or more cameras, the digital viewfinder includes a representation of one or more objects within the field of view of one or more cameras; means for detecting a first gesture through one or more input devices while displaying the digital viewfinder; means for updating the display of the digital viewfinder to focus on a representation of each object corresponding to the position of the first gesture on one or more input devices, among one or more objects within the field of view of one or more cameras, without being ready to capture media with one or more cameras at a second magnification level different from the first magnification level, upon a determination that a first set of one or more conditions is satisfied, the first condition of the first set of one or more conditions is satisfied when the first gesture is at a first position; and, upon determination that a second set of one or more conditions is satisfied—wherein the first condition of the second set of one or more conditions is satisfied when the first gesture is in a second position different from the first position—, means for preparing to capture media with one or more cameras at a second magnification level different from the first magnification level are included.

[0037] According to some embodiments, a transient computer-readable storage medium is described. A non-transient computer-readable storage medium for storing one or more programs configured to be executed by one or more processors of an electronic device having one or more cameras, one or more input devices, and a display, wherein the one or more programs: display a digital viewfinder based on data received from one or more cameras, wherein the digital viewfinder includes a representation of one or more objects within the field of view of one or more cameras; while displaying the digital viewfinder, detect a first gesture through one or more input devices; and, upon a determination that a first set of one or more conditions is satisfied, wherein the first condition of the first set of one or more conditions is satisfied when the first gesture is in a first position, update the display of the digital viewfinder to focus on a representation of each object corresponding to the position of the first gesture on one or more input devices among one or more objects within the field of view of one or more cameras at a second magnification level different from a first magnification level, without preparing to capture the media with one or more cameras; Based on the determination that a second set of one or more conditions is satisfied—wherein the first condition of the second set of one or more conditions is satisfied when the first gesture is in a second position different from the first position—it includes commands for preparing to capture media with one or more cameras at a second magnification level different from the first magnification level.

[0038] According to some embodiments, a method is performed in an electronic device having a display and one or more input devices. The method comprises: displaying on the display an adjustable control unit for selecting a value from a plurality of values ​​ranging from a minimum value to a maximum value; receiving an input from one or more input devices, comprising a movement detected through one or more input devices while displaying the adjustable control unit, wherein the movement is limited by a first input boundary and a second input boundary and the input is located closer to the first input boundary than to the second input boundary; and in response to receiving the input: navigating through a plurality of values ​​based on the magnitude of the movement and a first acceleration factor, depending on a determination that the movement rate of the input satisfies a first movement-rate criterion, wherein the first movement-rate criterion includes a first requirement that the movement rate of the input exceeds a first movement-rate threshold for the first movement-rate criterion to be satisfied, and depending that the movement of the input includes a movement toward the first input boundary. The method includes the step of navigating through a plurality of values ​​based on the magnitude of the movement and a second acceleration factor different from the first acceleration factor, in accordance with the determination that the movement speed of the input satisfies the movement-speed criteria of the first set and the determination that the movement of the input includes movement toward the second input boundary.

[0039] According to some embodiments, a non-transient computer-readable storage medium is described. The non-transient computer-readable storage medium stores one or more programs configured to be executed by one or more processors of an electronic device having one or more input devices and a display, and one or more programs: display on the display an adjustable control unit for selecting a value from a plurality of values ​​from a minimum value to a maximum value; while displaying the adjustable control unit, receive an input from one or more input devices including a movement detected through one or more input devices, wherein the movement is limited by a first input boundary and a second input boundary and the input is located closer to the first input boundary than to the second input boundary; in response to receiving the input: according to a determination that the movement speed of the input satisfies a first movement-speed criterion, wherein the first movement-speed criterion includes a first requirement that the movement speed of the input exceeds a first movement-speed threshold for the first movement-speed criterion to be satisfied, and navigate through a plurality of values ​​based on the magnitude of the movement and a first acceleration factor, as the movement of the input includes a movement toward the first input boundary; Instructions for navigating through a plurality of values ​​based on the magnitude of the movement and a second acceleration factor different from the first acceleration factor, depending on the determination that the movement speed of the input satisfies the movement-speed criteria of the first set and the determination that the movement of the input includes movement toward the second input boundary.

[0040] According to some embodiments, an electronic device is described. The electronic device comprises: one or more input devices; a display; one or more processors; and a memory for storing one or more programs configured to be executed by one or more processors, wherein the one or more programs include: means for displaying on the display an adjustable control unit for selecting a value from a plurality of values ​​ranging from a minimum value to a maximum value; means for receiving an input from one or more input devices, comprising a movement detected through one or more input devices while displaying the adjustable control unit, wherein the movement is limited by a first input boundary and a second input boundary and the input is located closer to the first input boundary than to the second input boundary; and in response to receiving the input: means for navigating through a plurality of values ​​based on the magnitude of the movement and a first acceleration factor, depending on a determination that the movement speed of the input satisfies a first movement-speed criterion, wherein the first movement-speed criterion includes a first requirement that the movement speed of the input exceeds a first movement-speed threshold for the first movement-speed criterion to be satisfied, and depending on whether the movement of the input includes a movement toward the first input boundary. Instructions for navigating through a plurality of values ​​based on the magnitude of the movement and a second acceleration factor different from the first acceleration factor, depending on the determination that the movement speed of the input satisfies the movement-speed criteria of the first set and the determination that the movement of the input includes movement toward the second input boundary.

[0041] According to some embodiments, a transient computer-readable storage medium is described. The non-transient computer-readable storage medium stores one or more programs configured to be executed by one or more processors of an electronic device having one or more input devices and a display, and one or more programs: display on the display an adjustable control unit for selecting a value from a plurality of values ​​from a minimum value to a maximum value; while displaying the adjustable control unit, receive an input from one or more input devices including a movement detected through one or more input devices, wherein the movement is limited by a first input boundary and a second input boundary and the input is located closer to the first input boundary than to the second input boundary; in response to receiving the input: according to a determination that the movement speed of the input satisfies a first movement-speed criterion, wherein the first movement-speed criterion includes a first requirement that the movement speed of the input exceeds a first movement-speed threshold for the first movement-speed criterion to be satisfied, and navigate through a plurality of values ​​based on the magnitude of the movement and a first acceleration factor, depending on whether the movement of the input includes a movement toward the first input boundary; Instructions for navigating through a plurality of values ​​based on the magnitude of the movement and a second acceleration factor different from the first acceleration factor, depending on the determination that the movement speed of the input satisfies the movement-speed criteria of the first set and the determination that the movement of the input includes movement toward the second input boundary.

[0042] Executable instructions for performing these functions are optionally contained in a non-transient computer-readable storage medium or other computer program product configured for execution by one or more processors. Executable instructions for performing these functions are optionally contained in a transient computer-readable storage medium or other computer program product configured for execution by one or more processors.

[0043] Therefore, devices are provided with faster and more efficient methods and interfaces for managing camera effects, thereby increasing the effectiveness, efficiency, and user satisfaction of these devices. These methods and interfaces can complement or replace other methods for managing camera effects. Brief explanation of the drawing

[0044] For a better understanding of the various embodiments described, specific details for carrying out the invention below should be referenced in relation to the drawings below, in which similar reference numerals indicate corresponding parts throughout the drawings. FIG. 1a is a block diagram illustrating a portable multifunctional device having a touch-sensitive display according to some embodiments. FIG. 1b is a block diagram illustrating exemplary components for event processing according to some embodiments. FIG. 2 illustrates a portable multifunctional device having a touch screen according to some embodiments. FIG. 3 is a block diagram of an exemplary multifunctional device having a display and a touch-sensitive surface according to some embodiments. FIG. 4a illustrates an exemplary user interface for a menu of applications on a portable multifunction device according to some embodiments. FIG. 4b illustrates an exemplary user interface for a multifunctional device having a touch-sensitive surface separate from the display, according to some embodiments. FIG. 5a illustrates a personal electronic device according to some embodiments. FIG. 5b is a block diagram illustrating a personal electronic device according to some embodiments. FIGS. 5c and 5d illustrate exemplary components of a personal electronic device having a touch-sensitive display and intensity sensors according to some embodiments. FIGS. 5e through 5h illustrate exemplary components and user interfaces of a personal electronic device according to some embodiments. FIGS. 6a through 6q illustrate exemplary devices and user interfaces for managing camera effects according to some embodiments. FIGS. 7a and 7b are flowcharts illustrating a method for managing camera effects according to some embodiments. FIGS. 8a through 8h illustrate exemplary devices and user interfaces for managing camera effects according to some embodiments. FIG. 9 is a flowchart illustrating a method for managing camera effects according to some embodiments. FIGS. 10a through 10t illustrate exemplary devices and user interfaces for managing camera effects according to some embodiments. FIG. 11 is a flowchart illustrating a method for managing camera effects according to some embodiments. FIGS. 12a through 12i illustrate exemplary devices and user interfaces for managing camera effects according to some embodiments. FIG. 13 is a flowchart illustrating a method for managing camera effects according to some embodiments. FIGS. 14 to 17 are functional block diagrams according to some embodiments. FIGS. 18a through 18an illustrate exemplary devices and user interfaces for managing camera user interfaces according to some embodiments. FIGS. 19a and FIGS. 19b are flowcharts illustrating a method for managing camera user interfaces according to some embodiments. FIGS. 20a through 20r illustrate exemplary devices and user interfaces for managing camera user interfaces according to some embodiments. FIGS. 21a and FIGS. 21b are flowcharts illustrating a method for managing camera user interfaces according to some embodiments. FIGS. 22a through 22j illustrate exemplary devices and user interfaces for navigating through a plurality of values ​​according to some embodiments. FIGS. 23a and FIGS. 23b are flowcharts illustrating a method for navigating through a plurality of values ​​according to some embodiments. FIGS. 24 to 26 are functional block diagrams according to some embodiments. Specific details for implementing the invention

[0045] The following description describes exemplary methods, parameters, etc. However, it should be recognized that such description is not intended to limit the scope of the present disclosure but is instead provided as an explanation of exemplary embodiments.

[0046] Efficient device packaging enables the design and manufacture of desirable and highly portable electronic devices. However, some electronic device components complicate the design of smaller devices, particularly thinner ones. Camera sensors and related components constitute one example: they involve physical components organized along an optical train suitable for thicker designs. For instance, consider that a camera's ability to perform variable optical zoom (e.g., CCD sensors and associated lenses) depends on an array of movable (e.g., motorized) lens(s) within the optical train. When integrated into cellular phones, the conventional orientation of camera components conflicts with the overall phone form factor: the camera's optical train typically runs along the thickness of the device. The use of cameras in thinner designs—e.g., fixed focal length cameras—introduces different problems. Specifically, fixed focal length cameras do not possess variable optical zoom capabilities. While performing digital zoom is still possible, digital zoom affects image quality. Another problem with traditional cellular phone cameras is that the size of the entrance pupil on the camera lens is relatively small compared to traditional camera systems such as SLRs. As a result of the small entrance pupil of the camera lens, some artistic photographic effects achievable with traditional SLR cameras, such as the bokeh effect, cannot be achieved simply using traditional mobile phone cameras.

[0047] The embodiments described herein include electronic devices that utilize a plurality of cameras to provide enhanced camera capabilities. In some embodiments, a plurality of fixed-focal-length cameras are used with variable digital magnification to mimic optical zoom capabilities. In some embodiments, a plurality of fixed-focal-length cameras are used to mimic or simulate bokeh effects. The described embodiments also include complementary user interfaces that enable these enhanced camera capabilities.

[0048] At the same time, the described embodiments improve the performance of the device's camera optical capabilities while allowing for the efficient packaging and manufacturing of thin and lightweight devices. The use of fixed focal length cameras is beneficial when they are thinner and smaller than their variable focal length counterparts. The use of multiple cameras not only provides the user with the ability to optically zoom but also provides the user with the ability to capture more satisfying photos by simulating bokeh effects. Intuitive user interfaces create a more efficient human-machine interface by enabling users to utilize the benefits of multiple on-board cameras without placing an excessive cognitive burden on the user. In battery-operated embodiments, the described embodiments also conserve power and increase runtime between battery charges because simulating optical zoom using fixed focal length cameras avoids battery consumption caused by motorized lenses used in conventional variable optical zoom cameras.

[0049] In the following, FIGS. 1a, 1b, 2, 3, 4a, 4b, and 5a through 5h provide descriptions of exemplary devices for performing techniques for managing camera effects. FIGS. 6a through 6q illustrate exemplary devices and user interfaces for managing camera effects. FIGS. 7a and 7b are flowcharts illustrating methods for managing camera effects according to some embodiments. The devices and user interfaces of FIGS. 6a through 6q are used to illustrate the processes described below, including the processes of FIGS. 7a and 7b. FIGS. 8a through 8h illustrate exemplary user interfaces for managing camera effects. FIG. 9 is a flowchart illustrating methods for managing camera effects according to some embodiments. The user interfaces of FIGS. 8a through 8h are used to illustrate the processes described below, including the processes of FIG. 9. FIGS. 10a through 10t illustrate exemplary devices and user interfaces for managing camera effects. FIG. 11 is a flowchart illustrating methods for managing camera effects according to some embodiments. The devices and user interfaces of FIGS. 10a through 10t are used to illustrate the processes described below, including the processes of FIG. 11. FIGS. 12a through 12i illustrate exemplary devices and user interfaces for managing camera effects. FIG. 13 is a flowchart illustrating methods for managing camera effects according to some embodiments. The user interfaces of FIGS. 12a through 12i are used to illustrate the processes described below, including the processes of FIG. 13. FIGS. 18a through 18an illustrate exemplary devices and user interfaces for managing camera user interfaces.FIGS. 19a and 19b are flowcharts illustrating methods for managing camera user interfaces according to some embodiments. The devices and user interfaces of FIGS. 18a through 18an are used to illustrate the processes described below, including the processes of FIGS. 19a and 19b. FIGS. 20a through 20r illustrate exemplary devices and user interfaces for managing camera user interfaces. FIGS. 21a and 21b are flowcharts illustrating methods for managing camera user interfaces according to some embodiments. The devices and user interfaces of FIGS. 20a through 20r are used to illustrate the processes described below, including the processes of FIGS. 21a and 21b. FIGS. 22a through 22j illustrate exemplary devices and user interfaces for navigating through a plurality of values. FIGS. 23a and 23b are flowcharts illustrating methods for navigating through a plurality of values ​​according to some embodiments. The devices and user interfaces of FIGS. 22a through 22j are used to illustrate the processes described below, including the processes of FIGS. 23a and 23b.

[0050] Although the following description uses terms such as "first," "second," etc., to describe various elements, these elements should not be limited by such terms. These terms are used solely to distinguish one element from another. For example, without departing from the scope of the various embodiments described, the first touch may be referred to as the second touch, and similarly, the second touch may be referred to as the first touch. Both the first touch and the second touch are touches, but they are not the same touch.

[0051] The terms used in the description of the various embodiments described herein are for the purpose of describing specific embodiments only and are not intended to be limiting. As used in the description of the various described embodiments and in the appended claims, the singular forms (“a,” “an,” and “the”) are likewise intended to include the plural forms unless the context clearly indicates otherwise. Furthermore, it will be understood that the term “and / or” as used herein refers to and encompasses any and all possible combinations of one or more of the enumerated associated items. It will be further understood that the terms “include,” “including,” “comprise,” and / or “comprising,” when used herein, specify the presence of the mentioned features, integers, steps, actions, elements, and / or components, but do not exclude the presence or addition of one or more other features, integers, steps, actions, elements, components, and / or groups thereof.

[0052] The term "if" is optionally interpreted, depending on the context, to mean "when" or "upon" or "in response to determining" or "in response to detecting". Similarly, the phrase "when determined" or "when [the mentioned state or event] is detected" is optionally interpreted, depending on the context, to mean "when determined" or "in response to determining" or "when [the mentioned state or event] is detected" or "in response to detecting [the mentioned state or event]".

[0053] Examples of electronic devices, user interfaces for such devices, and associated processes for using such devices are described. In some embodiments, the device is a portable communication device, such as a mobile phone, that also includes other functions such as PDA and / or music player functions. Exemplary examples of portable multifunction devices include, without limitation, iPhone®, iPod Touch®, and iPad® devices from Apple Inc., Cupertino, California, USA. Other portable electronic devices, such as laptops or tablet computers having touch-sensitive surfaces (e.g., touchscreen displays and / or touchpads), are optionally used. In some embodiments, it should also be understood that the device is not a portable communication device but a desktop computer having touch-sensitive surfaces (e.g., touchscreen displays and / or touchpads).

[0054] In the following discussion, an electronic device comprising a display and a touch-sensitive surface is described. However, it should be understood that the electronic device optionally includes one or more other physical user interface devices, such as a physical keyboard, mouse, and / or joystick.

[0055] The device typically supports various applications such as one or more of the following: drawing applications, presentation applications, word processing applications, website creation applications, disk authoring applications, spreadsheet applications, gaming applications, phone applications, video conferencing applications, email applications, instant messaging applications, exercise assistance applications, photo management applications, digital camera applications, digital video camera applications, web browsing applications, digital music player applications, and / or digital video player applications.

[0056] Various applications running on the device optionally use at least one universal physical user interface device, such as a touch-sensitive surface. One or more functions of the touch-sensitive surface, as well as corresponding information displayed on the device, are optionally coordinated and / or modified from one application to the next and / or within individual applications. In this way, the universal physical architecture of the device (such as a touch-sensitive surface) optionally supports various applications using user interfaces that are intuitive and transparent to the user.

[0057] Now, attention is drawn to embodiments of portable devices having touch-sensitive displays. FIG. 1a is a block diagram illustrating a portable multifunction device (100) having a touch-sensitive display system (112) according to some embodiments. The touch-sensitive display (112) is sometimes referred to as a "touch screen" for convenience and is sometimes known or referred to as a "touch-sensitive display system." The device (100) includes a memory (102) (optionally comprising one or more computer-readable storage media), a memory controller (122), one or more processing units (CPUs) (120), a peripheral interface (118), an RF circuit (108), an audio circuit (110), a speaker (111), a microphone (113), an input / output (I / O) subsystem (106), other input control devices (116), and an external port (124). The device (100) optionally includes one or more light sensors (164). The device (100) optionally includes one or more contact intensity sensors (165) for detecting the intensity of contacts on the device (100) (e.g., a touch-sensitive surface such as the touch-sensitive display system (112) of the device (100). The device (100) optionally includes one or more tactile output generators (167) for generating tactile outputs on the device (100) (e.g., generating tactile outputs on a touch-sensitive surface such as the touch-sensitive display system (112) of the device (100) or the touchpad (355) of the device (300). These components optionally communicate via one or more communication buses or signal lines (103).

[0058] As used in the specification and claims, the term “intensity” of contact on a touch-sensitive surface refers to the force or pressure (force per unit area) of contact (e.g., finger contact) on a touch-sensitive surface, or a substitute (proxy) for the force or pressure of contact on a touch-sensitive surface. The intensity of contact has a range of values ​​including at least four distinct values ​​and, more typically, hundreds (e.g., at least 256) distinct values. The intensity of contact is optionally determined (or measured) using various approaches and various sensors or combinations of sensors. For example, one or more force sensors below or adjacent to the touch-sensitive surface are optionally used to measure force at various points on the touch-sensitive surface. In some embodiments, force measurements from multiple force sensors are combined (e.g., weighted average) to determine the estimated force of contact. Similarly, a pressure-sensitive tip of a stylus is optionally used to determine the pressure of the stylus on the touch-sensitive surface. Alternatively, the size of the contact area detected on the touch-sensitive surface and / or variations thereof, the capacitance of the touch-sensitive surface near the contact and / or variations thereof, and / or the resistance of the touch-sensitive surface near the contact and / or variations thereof are optionally used as substitutes for the force or pressure of the contact on the touch-sensitive surface. In some embodiments, substitute measurements for the contact force or pressure are used directly to determine whether an intensity threshold has been exceeded (e.g., the intensity threshold is described in units corresponding to the substitute measurements). In some embodiments, substitute measurements for the contact force or pressure are converted into an estimated force or pressure, and the estimated force or pressure is used to determine whether an intensity threshold has been exceeded (e.g., the intensity threshold is a pressure threshold measured in units of pressure).Using the intensity of contact as an attribute of user input enables user access to additional device functions that might not otherwise be accessible to the user on a reduced-size device having a limited physical area for displaying affordances (e.g., on a touch-sensitive display) and / or receiving user input (e.g., through a touch-sensitive display, a touch-sensitive surface, or a physical / mechanical control unit such as a knob or button).

[0059] As used in the specification and claims, the term “tactile output” refers to a physical displacement of the device relative to its previous position, a physical displacement of a component of the device (e.g., a touch-sensitive surface) relative to another component of the device (e.g., a housing), or a displacement of a component relative to the center of mass of the device to be detected by the user using the user’s touch. For example, in a situation where the device or a component of the device comes into contact with a touch-sensitive surface of the user (e.g., a finger, a palm, or other part of the user’s hand), the tactile output generated by the physical displacement will be interpreted by the user as a tactile sensation corresponding to a perceived change in the physical properties of the device or the component of the device. For example, movement of a touch-sensitive surface (e.g., a touch-sensitive display or a trackpad) is optionally interpreted by the user as a “down click” or “up click” of a physical actuator button. In some cases, the user will feel tactile sensations such as a "down click" or "up click" even when there is no movement of a physical actuator button associated with a touch-sensitive surface that is physically pressed (e.g., displaced) by the user's movement. As another example, movement of the touch-sensitive surface is optionally interpreted or perceived by the user as "roughness" of the touch-sensitive surface, even when there is no change in the smoothness of the touch-sensitive surface. While these interpretations of touch by the user will be influenced by the user's individualized sensory perception, there are many touch sensations that are universal for the majority of users.Therefore, when a tactile output is described as corresponding to a specific sensory perception of a user (e.g., "up click," "down click," "roughness"), unless otherwise noted, the generated tactile output corresponds to a physical displacement of the device or its component that generates the described sensory perception for a typical (or average) user.

[0060] It should be understood that the device (100) is merely an example of a portable multifunctional device, and that the device (100) may optionally have more or fewer components than illustrated, optionally combine two or more components, or optionally have different configurations or arrangements of components. The various components illustrated in FIG. 1a are implemented in hardware, software, or a combination of both hardware and software, including one or more signal processing circuits and / or ASICs (application-specific integrated circuits).

[0061] The memory (102) optionally includes high-speed random access memory and optionally includes one or more non-volatile memories such as magnetic disk storage devices, flash memory devices, or other non-volatile solid-state memory devices. The memory controller (122) optionally controls access to the memory (102) by other components of the device (100).

[0062] A peripheral interface (118) may be used to connect the input and output peripherals of the device to the CPU (120) and memory (102). One or more processors (120) drive or execute various software programs and / or sets of instructions stored in memory (102) to perform various functions for the device (100) and to process data. In some embodiments, the peripheral interface (118), CPU (120), and memory controller (122) are optionally implemented on a single chip, such as chip (104). In some other embodiments, they are optionally implemented on separate chips.

[0063] The RF (radio frequency) circuit (108) receives and transmits RF signals, also referred to as electromagnetic signals. The RF circuit (108) converts electrical signals into / from electromagnetic signals and communicates with communication networks and other communication devices through the electromagnetic signals. The RF circuit (108) includes, optionally, well-known circuits for performing these functions, including but not limited to antenna systems, RF transceivers, one or more amplifiers, tuners, one or more oscillators, digital signal processors, CODEC chipsets, SIM (subscriber identity module) cards, memory, etc. The RF circuit (108) optionally communicates with networks, such as the Internet, also referred to as the World Wide Web (WWW), intranets, and / or wireless networks, such as cellular telephone networks, wireless LANs (local area networks) and / or MANs (metropolitan area networks), and other devices by wireless communication. The RF circuit section (108) includes a well-known circuit section for detecting near field communication (NFC) fields, for example, by a short-range communication radio, optionally.무선 통신은, 선택적으로, GSM(Global System for Mobile Communications), EDGE(Enhanced Data GSM Environment), HSDPA(high-speed downlink packet access), HSUPA(high-speed uplink packet access), EV-DO(Evolution, Data-Only), HSPA, HSPA+, DC-HSPDA(Dual-Cell HSPA), LTE(long term evolution), NFC, W-CDMA(wideband code division multiple access), CDMA(code division multiple access), TDMA(time division multiple access), 블루투스(Bluetooth), BTLE(Bluetooth Low Energy), Wi-Fi(Wireless Fidelity)(예컨대, IEEE 802.11a, IEEE 802.11b, IEEE 802.11g, IEEE 802.11n, 및 / 또는 IEEE 802.Any of a plurality of communication standards, protocols, and technologies are used, including but not limited to 11ac), VoIP (voice over Internet Protocol), Wi-MAX, email protocols (e.g., IMAP (Internet message access protocol) and / or POP (post office protocol)), instant messaging (e.g., XMPP (extensible messaging and presence protocol), SIMPLE (Session Initiation Protocol for Instant Messaging and Presence Leveraging Extensions), IMPS (Instant Messaging and Presence Service)), and / or SMS (Short Message Service), or any other suitable communication protocols, including communication protocols not yet developed as of the filing date of this document.

[0064] The audio circuit (110), speaker (111), and microphone (113) provide an audio interface between the user and the device (100). The audio circuit (110) receives audio data from the peripheral interface (118), converts the audio data into an electrical signal, and transmits the electrical signal to the speaker (111). The speaker (111) converts the electrical signal into a sound wave that can be heard by a human. The audio circuit (110) also receives the electrical signal converted from the sound wave by the microphone (113). The audio circuit (110) converts the electrical signal into audio data and transmits the audio data to the peripheral interface (118) for processing. The audio data is optionally retrieved from the memory (102) and / or RF circuit (108) by the peripheral interface (118) and / or transmitted to the memory (102) and / or RF circuit (108). In some embodiments, the audio circuit (110) also includes a headset jack (e.g., 212 in FIG. 2). The headset jack provides an interface between the audio circuit (110) and detachable audio input / output peripherals, such as output-only headphones, or a headset having both an output (e.g., headphones for one or both ears) and an input (e.g., a microphone).

[0065] The I / O subsystem (106) combines input / output peripherals on the device (100), such as a touch screen (112) and other input control devices (116), into a peripheral interface (118). The I / O subsystem (106) optionally includes a display controller (156), a light sensor controller (158), an intensity sensor controller (159), a haptic feedback controller (161), and one or more input controllers (160) for other input or control devices. One or more input controllers (160) receive / transmit electrical signals from / to other input or control devices (116). Other input or control devices (116) optionally include physical buttons (e.g., push buttons, rocker buttons, etc.), dials, slider switches, joysticks, click wheels, etc. In some alternative embodiments, the input controller(s) (160) are optionally coupled to any of a keyboard, an infrared port, a USB port, and a pointer device such as a mouse (or are not coupled to any of them). One or more buttons (e.g., 208 in FIG. 2) optionally include up / down buttons for volume control of the speaker (111) and / or microphone (113). One or more buttons optionally include push buttons (e.g., 206 in FIG. 2).

[0066] A quick press of the push button optionally unlocks the touchscreen (112) or initiates a process of using gestures on the touchscreen to unlock the device, as described in U.S. Patent Application No. 11 / 322,549, filed December 23, 2005, “Unlocking a Device by Performing Gestures on an Unlock Image” (U.S. Patent No. 7,657,849), the entirety of which is incorporated herein by reference. A longer press of the push button (e.g., 206) optionally turns the device (100) on or off. The functionality of one or more buttons is optionally customizable. The touchscreen (112) is used to implement virtual or soft buttons and one or more soft keyboards.

[0067] A touch-sensitive display (112) provides an input interface and an output interface between the device and the user. A display controller (156) receives and / or transmits electrical signals from / to the touch screen (112). The touch screen (112) displays a visual output to the user. The visual output optionally includes graphics, text, icons, videos, and any combination thereof (collectively referred to as “graphics”). In some embodiments, some or all of the visual output optionally corresponds to user interface objects.

[0068] The touch screen (112) has a touch-sensitive surface, a sensor, or a set of sensors that receive input from a user based on haptic and / or tactile contact. The touch screen (112) and the display controller (156) detect contact (and any movement or interruption of contact) on the touch screen (112) (along with any associated modules and / or sets of instructions in memory (102)) and convert the detected contact into an interaction with user interface objects (e.g., one or more soft keys, icons, web pages, or images) displayed on the touch screen (112). In an exemplary embodiment, the point of contact between the touch screen (112) and the user corresponds to the user's finger.

[0069] The touch screen (112) optionally uses liquid crystal display (LCD) technology, light emitting polymer display (LPD) technology, or light emitting diode (LED) technology, but other display technologies are used in other embodiments. The touch screen (112) and the display controller (156) detect contact and any movement or interruption thereof using any of a plurality of touch sensing technologies currently known or subsequently developed, which include, but are not limited to, capacitive, resistive, infrared, and surface acoustic wave technologies, as well as other proximity sensor arrays or other elements for determining one or more contact points with the touch screen (112). In an exemplary embodiment, projected mutual capacitance sensing technology, such as that found in the iPhone® and iPod Touch® from Apple Inc., Cupertino, California, USA, is used.

[0070] In some embodiments of the touch screen (112), the touch-sensitive display is optionally similar to the multi-touch-sensitive touchpads described in the following U.S. Patents No. 6,323,846 (Westerman et al.), No. 6,570,557 (Westerman et al.), and / or No. 6,677,932 (Westerman), and / or U.S. Patent Publication No. 2002 / 0015024A1, the full text of which is incorporated herein by reference. However, while the touch screen (112) displays a visual output from the device (100), the touch-sensitive touchpads do not provide a visual output.

[0071] Touch-sensitive displays in some embodiments of the touch screen (112) are described in the following applications: (1) U.S. Patent Application No. 11 / 381,313, filed May 2, 2006, “Multipoint Touch Surface Controller”; (2) U.S. Patent Application No. 10 / 840,862, filed May 6, 2004, “Multipoint Touchscreen”; (3) U.S. Patent Application No. 10 / 903,964, filed July 30, 2004, “Gestures For Touch Sensitive Input Devices”; (4) U.S. Patent Application No. 11 / 048,264, filed January 31, 2005, “Gestures For Touch Sensitive Input Devices”; (5) U.S. Patent Application No. 11 / 038,590, filed January 18, 2005, "Mode-Based Graphical User Interfaces For Touch Sensitive Input Devices"; (6) U.S. Patent Application No. 11 / 228,758, filed September 16, 2005, "Virtual Input Device Placement On A Touch Screen User Interface"; (7) U.S. Patent Application No. 11 / 228,700, filed September 16, 2005, "Operation Of A Computer With A Touch Screen Interface"; (8) U.S. Patent Application No. 11 / 228,737, filed September 16, 2005, "Activating Virtual Keys Of A Touch-Screen Virtual Keyboard"; and (9) U.S. Patent Application No. 11 / 367,749, filed March 3, 2006, “Multi-Functional Hand-Held Device”. The full text of all of these applications is incorporated herein by reference.

[0072] The touch screen (112) optionally has a video resolution greater than 100 dpi. In some embodiments, the touch screen has a video resolution of approximately 160 dpi. The user optionally contacts the touch screen (112) using any suitable object or accessory, such as a stylus, a finger, etc. In some embodiments, the user interface is designed to operate primarily using finger-based contacts and gestures, which may be less precise than stylus-based input due to the larger contact area of ​​the finger on the touch screen. In some embodiments, the device converts approximate finger-based input into precise pointer / cursor positions or commands to perform actions desired by the user.

[0073] In some embodiments, in addition to the touch screen, the device (100) optionally includes a touchpad (not shown) for enabling or disabling certain functions. In some embodiments, the touchpad is a touch-sensitive area of ​​the device that does not display a visual output, unlike the touch screen. The touchpad is optionally a touch-sensitive surface distinct from the touch screen (112) or an extension of a touch-sensitive surface formed by the touch screen.

[0074] The device (100) also includes a power system (162) for supplying power to various components. The power system (162) optionally includes a power management system, one or more power sources (e.g., battery, alternating current (AC)), a recharge system, a power fault detection circuit, a power converter or inverter, a power status indicator (e.g., a light-emitting diode (LED)), and any other components associated with the generation, management, and distribution of power within the portable devices.

[0075] The device (100) also optionally includes one or more light sensors (164). FIG. 1a illustrates a light sensor coupled to a light sensor controller (158) within an I / O subsystem (106). The light sensor (164) optionally includes charge-coupled device (CCD) or complementary metal-oxide semiconductor (CMOS) phototransistors. The light sensor (164) receives light from the surrounding environment projected through one or more lenses and converts the light into data representing an image. Together with the imaging module (143) (also referred to as a camera module), the light sensor (164) optionally captures still images or video. In some embodiments, the light sensor is positioned on the back of the device (100) opposite the touch screen display (112) on the front of the device, so that the touch screen display can be used as a viewfinder for acquiring still and / or video images. In some embodiments, the light sensor is positioned on the front of the device so that, optionally, an image of the user is obtained for the video conference while the user is viewing other video conference participants on the touchscreen display. In some embodiments, the position of the light sensor (164) can be changed by the user (e.g., by rotating the lens and sensor within the device housing) so that a single light sensor (164) is used for both video conference and still and / or video image acquisition with the touchscreen display.

[0076] The device (100) also optionally includes one or more contact intensity sensors (165). FIG. 1a illustrates a contact intensity sensor coupled to an intensity sensor controller (159) within an I / O subsystem (106). The contact intensity sensor (165) optionally includes one or more piezoresistive strain gauges, capacitive force sensors, electrical force sensors, piezoelectric force sensors, optical force sensors, capacitive touch-sensitive surfaces, or other intensity sensors (e.g., sensors used to measure the force (or pressure) of contact on a touch-sensitive surface). The contact intensity sensor (165) receives contact intensity information (e.g., pressure information or a surrogate for pressure information) from the surrounding environment. In some embodiments, at least one contact intensity sensor is located (collocated) with or near a touch-sensitive surface (e.g., a touch-sensitive display system (112)). In some embodiments, at least one contact intensity sensor is located on the back of the device (100) opposite the touch screen display (112) located on the front of the device (100).

[0077] The device (100) also optionally includes one or more proximity sensors (166). FIG. 1a illustrates a proximity sensor (166) coupled to a peripheral interface (118). Alternatively, the proximity sensor (166) is optionally coupled to an input controller (160) within an I / O subsystem (106). The proximity sensor (166) is optionally U.S. Patent Applications 11 / 241,839, "Proximity Detector In Handheld Device"; 11 / 240,788, "Proximity Detector In Handheld Device"; 11 / 620,702, "Using Ambient Light Sensor To Augment Proximity Sensor Output"; 11 / 586,862, "Automated Response To And Sensing Of User Activity In Portable Devices"; and as described in Patent No. 11 / 638,251, “Methods And Systems For Automatic Configuration Of Peripherals,” the full text of which is incorporated herein by reference. In some embodiments, the proximity sensor turns off and disables the touchscreen (112) when the multifunction device is positioned near the user’s ear (e.g., when the user is making a phone call).

[0078] The device (100) also optionally includes one or more haptic output generators (167). FIG. 1a illustrates a haptic output generator coupled to a haptic feedback controller (161) within an I / O subsystem (106). The haptic output generator (167) optionally includes one or more electroacoustic devices, such as speakers or other audio components, and / or electromechanical devices that convert energy into linear motion, such as motors, solenoids, electroactive polymers, piezoelectric actuators, electrostatic actuators, or other haptic output generating components (e.g., components that convert electrical signals into haptic outputs on the device). A contact intensity sensor (165) receives haptic feedback generation commands from a haptic feedback module (133) and generates haptic outputs on the device (100) that can be detected by a user of the device (100). In some embodiments, at least one tactile output generator is positioned with or near a touch-sensitive surface (e.g., a touch-sensitive display system (112)) and optionally generates a tactile output by moving the touch-sensitive surface vertically (e.g., into / outside the surface of the device (100)) or laterally (e.g., back and forth in the same plane as the surface of the device (100). In some embodiments, at least one tactile output generator sensor is positioned on the back of the device (100) opposite the touch screen display (112) positioned on the front of the device (100).

[0079] The device (100) also optionally includes one or more accelerometers (168). FIG. 1a illustrates an accelerometer (168) coupled to a peripheral interface (118). Alternatively, the accelerometer (168) is optionally coupled to an input controller (160) within an I / O subsystem (106). The accelerometer (168) is optionally operated as described in U.S. Patent Publication No. 20050190059, “Acceleration-based Theft Detection System for Portable Electronic devices” and U.S. Patent Publication No. 20060017692, “Methods And Apparatuses For Operating A Portable Device Based On An Accelerometer”, the full text of which is incorporated herein by reference. In some embodiments, information is displayed on a touchscreen display in portrait view or landscape view based on the analysis of data received from one or more accelerometers. The device (100) optionally includes, in addition to the accelerometer(s) (168), a magnetometer (not shown) and a GPS (or GLONASS or other global navigation system) receiver (not shown) for obtaining information about the position and orientation (e.g., vertical or horizontal) of the device (100).

[0080] In some embodiments, software components stored in memory (102) include an operating system (126), a communication module (or set of instructions) (128), a touch / motion module (or set of instructions) (130), a graphics module (or set of instructions) (132), a text input module (or set of instructions) (134), a GPS module (or set of instructions) (135), and applications (or sets of instructions) (136). Furthermore, in some embodiments, memory (102 in FIG. 1a or 370 in FIG. 3) stores a device / global internal state (157) as illustrated in FIG. 1a and FIG. 3. The device / global internal state (157) includes an active application state indicating which applications are currently active, if present; a display state indicating which applications, views, or other information occupy various areas of the touch screen display (112); and a sensor state including information obtained from various sensors of the device and input control devices (116). and includes one or more of location information regarding the location and / or orientation of the device.

[0081] An operating system (126) (e.g., an embedded operating system such as Darwin, RTXC, LINUX, UNIX, OS X, iOS, WINDOWS, or VxWorks) includes various software components and / or drivers for controlling and managing general system tasks (e.g., memory management, storage device control, power management, etc.) and facilitates communication between various hardware and software components.

[0082] The communication module (128) facilitates communication with other devices through one or more external ports (124) and also includes various software components for processing data received by the RF circuit (108) and / or the external ports (124). The external ports (124) (e.g., USB (Universal Serial Bus), FireWire, etc.) are configured to connect directly to other devices or indirectly through a network (e.g., Internet, wireless LAN, etc.). In some embodiments, the external ports are multi-pin (e.g., 30-pin) connectors identical to or similar to and / or compatible with the 30-pin connector used in iPod® (trademark of Apple Inc.) devices.

[0083] The contact / motion module (130) optionally detects contact with the touch screen (112) and other touch-sensitive devices (e.g., a touchpad or a physical click wheel) (together with the display controller (156)). The contact / motion module (130) includes various software components for performing various operations related to the detection of contact, such as determining whether contact has occurred (e.g., detecting a finger-down event), determining the intensity of the contact (e.g., force or pressure of the contact, or a substitute for force or pressure of the contact), determining whether there is movement of the contact and tracking movement across the touch-sensitive surface (e.g., detecting one or more finger-dragging events), and determining whether contact has ceased (e.g., detecting a finger-up event or a cessation of contact). The contact / motion module (130) receives contact data from a touch-sensitive surface. Determining the movement of a contact point represented by a series of contact data includes, optionally, determining the speed (magnitude), velocity (magnitude and direction), and / or acceleration (change in magnitude and / or direction) of the contact point. These actions are, optionally, applied to single contacts (e.g., one-finger contacts) or multiple simultaneous contacts (e.g., "multitouch" / multiple-finger contacts). In some embodiments, the contact / motion module (130) and the display controller (156) detect contact on the touchpad.

[0084] In some embodiments, the contact / motion module (130) uses one or more sets of intensity thresholds to determine whether an action has been performed by a user (e.g., whether the user has “clicked” an icon). In some embodiments, at least a subset of intensity thresholds is determined by software parameters (e.g., intensity thresholds are not determined by activation thresholds of specific physical actuators and can be adjusted without changing the physical hardware of the device (100)). For example, the mouse “click” threshold of a trackpad or touchscreen display can be set to any of a wide range of predefined threshold values ​​without changing the trackpad or touchscreen display hardware. Additionally, in some embodiments, the user of the device is provided with software settings for adjusting one or more of the sets of intensity thresholds (e.g., by adjusting individual intensity thresholds and / or by adjusting multiple intensity thresholds at once as a system-level click “intensity” parameter).

[0085] The contact / motion module (130) optionally detects a gesture input by a user. Different gestures on a touch-sensitive surface have different contact patterns (e.g., different motions, timings, and / or intensity of the detected contacts). Accordingly, a gesture is optionally detected by detecting a specific contact pattern. For example, detecting a finger tap gesture involves detecting a finger-down event and then detecting a finger-up (lift-off) event at the same location (or substantially the same location) as the finger-down event (e.g., at the location of an icon). As another example, detecting a finger swipe gesture on a touch-sensitive surface involves detecting a finger-down event, then detecting one or more finger-dragging events, and subsequently detecting a finger-up (lift-off) event.

[0086] The graphics module (132) includes various known software components for rendering and displaying graphics on a touch screen (112) or other display, including components for changing the visual effects (e.g., brightness, transparency, saturation, contrast, or other visual attributes) of the graphics being displayed. As used herein, the term “graphics” includes any object that can be displayed to a user, including, without limitation, text, web pages, icons (e.g., user interface objects including soft keys), digital images, videos, animations, etc.

[0087] In some embodiments, the graphics module (132) stores data representing the graphics to be used. Each graphics is optionally assigned a corresponding code. The graphics module (132) receives one or more codes specifying the graphics to be displayed from applications, etc., along with coordinate data and other graphic attribute data if necessary, and then generates screen image data and outputs it to the display controller (156).

[0088] The haptic feedback module (133) includes various software components for generating commands used by haptic output generator(s) (167) to generate haptic outputs at one or more locations on the device (100) in response to user interactions with the device (100).

[0089] Optionally, a text input module (134), which is a component of the graphics module (132), provides soft keyboards for inputting text into various applications (e.g., contacts (137), email (140), IM (141), browser (147), and any other application requiring text input).

[0090] The GPS module (135) determines the location of the device and provides this information for use in various applications (e.g., to a phone (138) for use in location-based dialing; to a camera (143) as photo / video metadata; and to applications providing location-based services such as weather widgets, local yellow page widgets and map / navigation widgets).

[0091] Applications (136) optionally include the following modules (or sets of instructions), or a subset or superset thereof:

[0092] Contact module (137) (sometimes referred to as address book or contact list);

[0093] Phone module (138);

[0094] Video conferencing module (139);

[0095] Email client module (140);

[0096] Instant Messaging (IM) Module (141);

[0097] Exercise support module (142);

[0098] Camera module (143) for still and / or video images;

[0099] Image management module (144);

[0100] Video player module;

[0101] Music player module;

[0102] Browser module (147);

[0103] Calendar module (148);

[0104] Widget modules (149) optionally including one or more of a weather widget (149-1), a stock widget (149-2), a calculator widget (149-3), an alarm clock widget (149-4), a dictionary widget (149-5), and other widgets obtained by the user, as well as user-generated widgets (149-6);

[0105] A widget generator module (150) for creating user-generated widgets (149-6);

[0106] Search module (151);

[0107] A video and music player module (152) that integrates a video player module and a music player module;

[0108] Memo module (153);

[0109] Map module (154); and / or

[0110] Online video module (155).

[0111] Examples of other applications (136) optionally stored in memory (102) include other word processing applications, other image editing applications, drawing applications, presentation applications, JAVA-enabled applications, encryption, digital rights management, speech recognition and speech replication.

[0112] Together with a touch screen (112), a display controller (156), a touch / motion module (130), a graphics module (132), and a text input module (134), a contact module (137) is optionally used to manage an address book or a list of contacts (e.g., stored in the application internal state (192) of the contact module (137) in memory (102) or memory (370): this includes: adding name(s) to an address book; deleting name(s) from an address book; associating phone numbers(s), email addresses(s), physical addresses(s), or other information with names; associating images with names; classifying and sorting names; providing phone numbers or email addresses to initiate and / or facilitate communication via telephone (138), a video conferencing module (139), email (140), or IM (141), etc.

[0113] Together with the RF circuit section (108), audio circuit section (110), speaker (111), microphone (113), touch screen (112), display controller (156), contact / motion module (130), graphic module (132), and text input module (134), the telephone module (138) is optionally used to input a sequence of characters corresponding to a telephone number, access one or more telephone numbers within the contact module (137), modify the input telephone number, dial individual telephone numbers, have a conversation, and disconnect or disconnect when the conversation is completed. As described above, wireless communication optionally uses any of a plurality of communication standards, protocols, and technologies.

[0114] Along with an RF circuit (108), an audio circuit (110), a speaker (111), a microphone (113), a touch screen (112), a display controller (156), a light sensor (164), a light sensor controller (158), a contact / motion module (130), a graphics module (132), a text input module (134), a contact module (137), and a telephone module (138), the video conferencing module (139) includes executable commands to initiate, conduct, and end a video conference between a user and one or more other participants according to user instructions.

[0115] Together with the RF circuit section (108), touch screen (112), display controller (156), contact / motion module (130), graphics module (132), and text input module (134), the email client module (140) includes executable commands to compose, send, receive, and manage emails in response to user instructions. Together with the image management module (144), the email client module (140) makes it very easy to create and send emails containing still or video images captured by the camera module (143).

[0116] Together with an RF circuit (108), a touch screen (112), a display controller (156), a contact / motion module (130), a graphics module (132), and a text input module (134), the instant messaging module (141) includes executable commands to input a sequence of characters corresponding to an instant message, modify previously input characters, transmit individual instant messages (e.g., using a Short Message Service (SMS) or Multimedia Message Service (MMS) protocol for telephone-based instant messages, or using XMPP, SIMPLE, or IMPS for internet-based instant messages), receive instant messages, and view received instant messages. In some embodiments, the transmitted and / or received instant messages optionally include graphics, photos, audio files, video files, and / or other attachments as supported by MMS and / or EMS (Enhanced Messaging Service). As used herein, "instant messaging" refers to both telephone-based messages (e.g., messages transmitted using SMS or MMS) and internet-based messages (e.g., messages transmitted using XMPP, SIMPLE, or IMPS).

[0117] Together with an RF circuit section (108), a touch screen (112), a display controller (156), a contact / motion module (130), a graphics module (132), a text input module (134), a GPS module (135), a map module (154), and a music player module, the exercise support module (142) includes executable commands to devise exercises (e.g., with time, distance, and / or calorie consumption goals); communicate with exercise sensors (sports devices); receive exercise sensor data; calibrate sensors used to monitor exercises; select and play music for exercises; and display, store, and transmit exercise data.

[0118] Together with a touch screen (112), a display controller (156), light sensor(s) (164), a light sensor controller (158), a contact / motion module (130), a graphics module (132), and an image management module (144), the camera module (143) includes executable commands to capture still images or video (including a video stream) and store them in memory (102), modify the characteristics of the still images or video, or delete the still images or video from memory (102).

[0119] Together with the touch screen (112), display controller (156), touch / motion module (130), graphics module (132), text input module (134) and camera module (143), the image management module (144) includes executable commands for arranging, modifying (e.g., editing), or otherwise manipulating, labeling, deleting, presenting (e.g., in a digital slideshow or album), and saving still and / or video images.

[0120] Together with the RF circuit section (108), touch screen (112), display controller (156), contact / motion module (130), graphics module (132) and text input module (134), the browser module (147) includes executable commands for browsing the internet according to user instructions, including searching for web pages or parts thereof, as well as attachments and other files linked to web pages, linking to them, receiving, and displaying them.

[0121] Together with the RF circuit section (108), touch screen (112), display controller (156), contact / motion module (130), graphics module (132), text input module (134), email client module (140), and browser module (147), the calendar module (148) includes executable commands to create, display, modify, and save calendars and data associated with calendars (e.g., calendar entries, to-do lists, etc.) according to user instructions.

[0122] Along with the RF circuit (108), touch screen (112), display controller (156), touch / motion module (130), graphics module (132), text input module (134) and browser module (147), the widget modules (149) are mini-applications that are optionally downloaded and used by the user (e.g., weather widget (149-1), stock widget (149-2), calculator widget (149-3), alarm clock widget (149-4) and dictionary widget (149-5)), or created by the user (e.g., user-generated widget (149-6)). In some embodiments, the widgets include HTML (Hypertext Markup Language) files, CSS (Cascading Style Sheets) files, and JavaScript files. In some embodiments, the widgets include XML (Extensible Markup Language) files and JavaScript files (e.g., Yahoo! widgets).

[0123] Together with the RF circuit section (108), touch screen (112), display controller (156), contact / motion module (130), graphics module (132), text input module (134) and browser module (147), the widget generator module (150) is optionally used to generate widgets by the user (e.g., changing a user-specific part of a web page into a widget).

[0124] Together with a touch screen (112), a display controller (156), a touch / motion module (130), a graphics module (132), and a text input module (134), the search module (151) includes executable commands to search for text, music, sound, images, videos, and / or other files in memory (102) that match one or more search criteria (e.g., one or more user-specific search terms) according to user instructions.

[0125] Together with a touch screen (112), a display controller (156), a contact / motion module (130), a graphics module (132), an audio circuit (110), a speaker (111), an RF circuit (108), and a browser module (147), the video and music player module (152) includes executable commands that enable a user to download and play recorded music and other sound files stored in one or more file formats, such as MP3 or AAC files, and executable commands that enable videos to be displayed, shown, or otherwise played (e.g., on the touch screen (112) or on an externally connected display via an external port (124). In some embodiments, the device (100) optionally includes the function of an MP3 player such as an iPod (a trademark of Apple Inc.).

[0126] Together with the touch screen (112), display controller (156), contact / motion module (130), graphics module (132) and text input module (134), the memo module (153) includes executable commands that generate and manage memos, to-do lists, etc., according to user instructions.

[0127] Together with the RF circuit section (108), touch screen (112), display controller (156), contact / motion module (130), graphics module (132), text input module (134), GPS module (135), and browser module (147), the map module (154) is optionally used to receive, display, modify, and store maps and data associated with the maps (e.g., driving direction; data regarding stores and other points of interest at or near a specific location; and other location-based data) according to user instructions.

[0128] Together with a touch screen (112), a display controller (156), a touch / motion module (130), a graphics module (132), an audio circuit (110), a speaker (111), an RF circuit (108), a text input module (134), an email client module (140), and a browser module (147), the online video module (155) includes commands that allow a user to access online videos of one or more file formats such as H.264, browse them, receive them (e.g., by streaming and / or downloading), play them (e.g., on a touch screen or on an external connected display via an external port (124), send an email with a link to a specific online video, or otherwise manage them. In some embodiments, an instant messaging module (141) rather than an email client module (140) is used to send a link to a specific online video. Further descriptions of online video applications can be found in U.S. Provisional Application No. 60 / 936,562, filed June 20, 2007, “Portable Multifunction Device, Method, and Graphical User Interface for Playing Online Videos” and U.S. Patent Application No. 11 / 968,067, filed December 31, 2007, “Portable Multifunction Device, Method, and Graphical User Interface for Playing Online Videos,” the contents of which are incorporated herein by reference in their entirety.

[0129] Each of the previously identified modules and applications corresponds to a set of executable instructions for performing one or more of the functions described above and the methods described in this application (e.g., computer implementation methods and other information processing methods described herein). These modules (e.g., sets of instructions) do not need to be implemented as separate software programs, procedures, or modules, and thus various subsets of these modules are optionally combined or otherwise rearranged in various embodiments. For example, a video player module is optionally combined with a music player module within a single module (e.g., the video and music player module (152) of FIG. 1a). In some embodiments, memory (102) optionally stores a subset of the identified modules and data structures. Additionally, memory (102) optionally stores additional modules and data structures not described above.

[0130] In some embodiments, the device (100) is a device in which the operation of a predefined set of functions on the device is performed exclusively through a touch screen and / or a touchpad. By using the touch screen and / or a touchpad as the primary input control device for the operation of the device (100), the number of physical input control devices (such as push buttons, dials, etc.) on the device (100) is optionally reduced.

[0131] A predefined set of functions performed exclusively via a touchscreen and / or touchpad optionally includes navigation between user interfaces. In some embodiments, the touchpad, when touched by a user, navigates the device (100) to a main, home, or root menu from any user interface displayed on the device (100). In these embodiments, a "menu button" is implemented using the touchpad. In some other embodiments, the menu button is a physical push button or other physical input control device instead of the touchpad.

[0132] FIG. 1b is a block diagram illustrating exemplary components for event processing according to some embodiments. In some embodiments, memory (102 in FIG. 1a or 370 in FIG. 3) includes an event classifier (170) (e.g., in an operating system (126)) and individual applications (136-1) (e.g., any of the aforementioned applications (137 to 151, 155, 380 to 390)).

[0133] An event classifier (170) receives event information and determines an application (136-1) to which the event information will be delivered, and an application view (191) of the application (136-1). The event classifier (170) includes an event monitor (171) and an event dispatcher module (174). In some embodiments, the application (136-1) includes an application internal state (192) representing the current application view(s) displayed on a touch-sensitive display (112) when the application is active or running. In some embodiments, a device / global internal state (157) is used by the event classifier (170) to determine which application(s) are currently active, and the application internal state (192) is used by the event classifier (170) to determine the application views (191) to which the event information will be delivered.

[0134] In some embodiments, the application internal state (192) includes additional information such as resumption information to be used when the application (136-1) resumes execution, user interface state information indicating information that is being displayed or is ready to be displayed by the application (136-1), a state queue to enable the user to return to a previous state or view of the application (136-1), and one or more of a redo / undo queue of previous actions taken by the user.

[0135] The event monitor (171) receives event information from the peripheral interface (118). The event information includes information about sub-events (e.g., user touch on the touch-sensitive display (112) as part of a multi-touch gesture). The peripheral interface (118) transmits information received from the I / O subsystem (106) or sensors, such as a proximity sensor (166), accelerometer(s) (168), and / or a microphone (113) (via the audio circuit section (110)). The information received by the peripheral interface (118) from the I / O subsystem (106) includes information from the touch-sensitive display (112) or the touch-sensitive surface.

[0136] In some embodiments, the event monitor (171) transmits requests to the peripheral interface (118) at predetermined intervals. In response, the peripheral interface (118) transmits event information. In other embodiments, the peripheral interface (118) transmits event information only when there is a significant event (e.g., receiving an input that exceeds a predetermined noise threshold and / or an input that exceeds a predetermined duration).

[0137] In some embodiments, the event classifier (170) also includes a hit view determination module (172) and / or an active event recognizer determination module (173).

[0138] The hit view determination module (172) provides software procedures for determining where a sub-event occurred within one or more views when the touch-sensitive display (112) displays two or more views. The views consist of control units and other elements that a user can see on the display.

[0139] Another aspect of the user interface associated with an application is a set of views, sometimes referred to herein as application views or user interface windows, where information is displayed and touch-based gestures occur. The application views (of individual applications) where a touch is detected optionally correspond to program levels within the application's program or view hierarchy. For example, the lowest level view where a touch is detected is optionally referred to as a hit view, and the set of events recognized as appropriate inputs is optionally determined at least partially based on the hit view of the initial touch that initiates the touch-based gesture.

[0140] The hit view determination module (172) receives information related to sub-events of a touch-based gesture. If the application has multiple views organized in a hierarchy, the hit view determination module (172) identifies the hit view as the lowest level view in the hierarchy that must handle the sub-events. In most situations, the hit view is the lowest level view where the initiating sub-event (e.g., the first sub-event in a sequence of sub-events forming an event or potential event) occurs. Once the hit view is identified by the hit view determination module (172), the hit view typically receives all sub-events related to the same touch or input source that caused it to be identified as the hit view.

[0141] The active event recognizer determination module (173) determines which view or views within the view hierarchy should receive a specific sequence of sub-events. In some embodiments, the active event recognizer determination module (173) determines that only the hit view should receive a specific sequence of sub-events. In other embodiments, the active event recognizer determination module (173) determines that all views containing the physical location of the sub-event are actively involved views, and accordingly determines that all actively involved views should receive a specific sequence of sub-events. In other embodiments, even if the touch sub-events are limited to an area associated entirely with one specific view, the upper views within the hierarchy will still be maintained as actively involved views.

[0142] The event dispatcher module (174) dispatches event information to an event recognizer (e.g., event recognizer (180)). In embodiments comprising an active event recognizer determination module (173), the event dispatcher module (174) transmits event information to an event recognizer determined by the active event recognizer determination module (173). In some embodiments, the event dispatcher module (174) stores event information in an event queue, whereby the event information is retrieved by individual event receivers (182).

[0143] In some embodiments, the operating system (126) includes an event classifier (170). Alternatively, the application (136-1) includes an event classifier (170). In other embodiments, the event classifier (170) is a standalone module or is part of another module stored in memory (102), such as the contact / motion module (130).

[0144] In some embodiments, the application (136-1) includes a plurality of event handlers (190) and one or more application views (191), each of which includes instructions for handling touch events occurring within individual views of the application's user interface. Each application view (191) of the application (136-1) includes one or more event recognizers (180). Typically, each application view (191) includes a plurality of event recognizers (180). In other embodiments, one or more of the event recognizers (180) are part of a separate module, such as a user interface kit (not shown) or a higher-level object to which the application (136-1) inherits methods and other attributes. In some embodiments, each event handler (190) includes one or more of event data (179) received from a data updater (176), an object updater (177), a GUI updater (178), and / or an event classifier (170). The event handler (190) optionally updates the application internal state (192) by using or calling a data updater (176), an object updater (177), or a GUI updater (178). Alternatively, one or more of the application views (191) include one or more individual event handlers (190). Also, in some embodiments, one or more of the data updater (176), the object updater (177), and the GUI updater (178) are included within the individual application view (191).

[0145] Each individual event recognizer (180) receives event information (e.g., event data (179)) from an event classifier (170) and identifies an event from the event information. The event recognizer (180) includes an event receiver (182) and an event comparator (184). In some embodiments, the event recognizer (180) also includes at least metadata (183) and a subset of event forwarding commands (188) (optionally including sub-event forwarding commands).

[0146] The event receiver (182) receives event information from the event classifier (170). The event information includes information regarding sub-events, for example, touch or touch movement. Depending on the sub-event, the event information also includes additional information, such as the location of the sub-event. If the sub-event is related to a motion of touch, the event information also optionally includes the speed and direction of the sub-event. In some embodiments, the events include rotation of the device from one orientation to another (e.g., from a vertical orientation to a horizontal orientation, or vice versa), and the event information includes corresponding information regarding the current orientation of the device (also referred to as the device orientation).

[0147] The event comparator (184) compares event information with predefined event or sub-event definitions and, based on the comparison, determines an event or sub-event, or determines or updates the state of an event or sub-event. In some embodiments, the event comparator (184) includes event definitions (186). The event definitions (186) include definitions of events (e.g., predefined sequences of sub-events), e.g., event 1 (187-1), event 2 (187-2), etc. In some embodiments, sub-events within event (187) include, e.g., touch start, touch end, touch move, touch cancel, and multiple touches. In one example, the definition for event 1 (187-1) is a double tap on a displayed object. A double tap includes, for example, a first touch (touch start) on a displayed object during a predetermined phase, a first lift-off (touch end) during a predetermined phase, a second touch (touch start) on a displayed object during a predetermined phase, and a second lift-off (touch end) during a predetermined phase. In another example, the definition of event 2 (187-2) is dragging on a displayed object. Dragging includes, for example, a touch (or contact) on a displayed object during a predetermined phase, the movement of the touch across the touch-sensitive display (112), and the lift-off (touch end) of the touch. In some embodiments, the event also includes information about one or more associated event handlers (190).

[0148] In some embodiments, the event definition (187) includes the definition of an event for an individual user interface object. In some embodiments, the event comparator (184) performs a hit test to determine which user interface object is associated with a sub-event. For example, in an application view where three user interface objects are displayed on a touch-sensitive display (112), if a touch is detected on the touch-sensitive display (112), the event comparator (184) performs a hit test to determine which of the three user interface objects is associated with the touch (sub-event). If each displayed object is associated with an individual event handler (190), the event comparator uses the result of the hit test to determine which event handler (190) should be activated. For example, the event comparator (184) selects the object that triggers the hit test and the event handler associated with the sub-event.

[0149] In some embodiments, the definition of an individual event (187) also includes delayed operations that delay the transmission of event information until it is determined whether the sequence of sub-events corresponds to or does not correspond to the event type of the event recognizer.

[0150] If an individual event recognizer (180) determines that a series of sub-events does not match any of the events in the event definitions (186), the individual event recognizer (180) enters an event impossible, event failed, or event terminated state, and then the individual event recognizer ignores subsequent sub-events of the touch-based gesture. In this situation, if any, other event recognizers that remain active for the hit view continue to track and process the sub-events of the ongoing touch-based gesture.

[0151] In some embodiments, individual event recognizers (180) include metadata (183) having configurable attributes, flags, and / or lists indicating how the event delivery system should perform sub-event delivery to active participating event recognizers. In some embodiments, metadata (183) includes configurable attributes, flags, and / or lists indicating how event recognizers interact with each other or can interact. In some embodiments, metadata (183) includes configurable attributes, flags, and / or lists indicating whether sub-events are delivered to various levels in a view or program hierarchy.

[0152] In some embodiments, an individual event recognizer (180) activates an event handler (190) associated with an event when one or more specific sub-events of an event are recognized. In some embodiments, an individual event recognizer (180) transmits event information associated with an event to the event handler (190). Activating the event handler (190) is separate from transmitting (and delay transmitting) sub-events to individual hit views. In some embodiments, the event recognizer (180) sends a flag associated with the recognized event, and the event handler (190) associated with the flag catches the flag and performs a predefined process.

[0153] In some embodiments, the event forwarding commands (188) include sub-event forwarding commands that convey event information regarding a sub-event without activating an event handler. Instead, the sub-event forwarding commands convey event information to event handlers or active participation views associated with a series of sub-events. The event handlers associated with a series of sub-events or active participation views receive the event information and perform a predetermined process.

[0154] In some embodiments, the data updater (176) creates and updates data used in the application (136-1). For example, the data updater (176) updates phone numbers used in the contact module (137) or stores video files used in the video player module. In some embodiments, the object updater (177) creates and updates objects used in the application (136-1). For example, the object updater (177) creates new user interface objects or updates the location of user interface objects. The GUI updater (178) updates the GUI. For example, the GUI updater (178) prepares display information for a display on a touch-sensitive display and transmits it to the graphics module (132).

[0155] In some embodiments, the event handler(s) (190) include or access the data updater (176), object updater (177), and GUI updater (178). In some embodiments, the data updater (176), object updater (177), and GUI updater (178) are included within a single module of an individual application (136-1) or application view (191). In other embodiments, they are included within two or more software modules.

[0156] It should be understood that the foregoing discussion regarding the event processing of user touches on touch-sensitive displays also applies to other forms of user inputs for operating multifunctional devices (100) having input devices, but not all of them are initiated on touch screens. For example, mouse movements and mouse button presses optionally coupled with single or multiple keyboard presses or holds; tactile movements such as taps, drags, scrolls, etc. on a touchpad; pen stylus inputs; device movements; verbal commands; detected eye movements; biometric inputs; and / or any combination thereof are optionally used as inputs corresponding to sub-events defining the event to be recognized.

[0157] FIG. 2 illustrates a portable multifunction device (100) having a touch screen (112) according to some embodiments. The touch screen optionally displays one or more graphics within a user interface (UI) (200). In this embodiment, as well as in other embodiments described below, the user is made able to select one or more of the graphics by performing a gesture on the graphics using, for example, one or more fingers (202) (not shown in scale in the drawing) or one or more styluses (203) (not shown in scale in the drawing). In some embodiments, the selection of one or more graphics occurs when the user stops contacting one or more graphics. In some embodiments, the gesture optionally includes one or more taps of a finger in contact with the device (100), one or more swipes (from left to right, from right to left, up and / or down), and / or rolling (from right to left, from left to right, up and / or down). In some embodiments or situations, unintended contact with the graphics does not select the graphics. For example, when the gesture corresponding to the selection is a tap, a swipe gesture that sweeps over an application icon optionally does not select the corresponding application.

[0158] The device (100) also optionally includes one or more physical buttons, such as a “Home” or menu button (204). As previously described, the menu button (204) is optionally used to navigate to any application (136) within a set of applications optionally run on the device (100). Alternatively, in some embodiments, the menu button is implemented as a soft key in a GUI displayed on a touch screen (112).

[0159] In some embodiments, the device (100) includes a touchscreen (112), a menu button (204), a push button (206) for turning the device on / off and locking the device, volume control button(s) (208), a subscriber identification module (SIM) card slot (210), a headset jack (212), and an external docking / charging port (124). The push button (206) is optionally used to turn the device on / off by pressing the button and holding the button pressed for a preset time interval; to lock the device by pressing the button and releasing the button before the preset time interval elapses; and / or to unlock the device or initiate an unlocking process. In an alternative embodiment, the device (100) also accepts verbal input for enabling or disabling some functions via a microphone (113). The device (100) also optionally includes one or more contact intensity sensors (165) for detecting the intensity of contacts on the touch screen (112) and / or one or more tactile output generators (167) for generating tactile outputs for a user of the device (100).

[0160] FIG. 3 is a block diagram of an exemplary multifunctional device having a display and a touch-sensitive surface according to some embodiments. The device (300) does not need to be portable. In some embodiments, the device (300) is a laptop computer, a desktop computer, a tablet computer, a multimedia player device, a navigation device, an educational device (such as a children's learning toy), a gaming system, or a control device (e.g., a home or industrial controller). The device (300) typically includes one or more processing units (CPUs) (310), one or more network or other communication interfaces (360), memory (370), and one or more communication buses (320) for interconnecting these components. The communication buses (320) optionally include circuitry (sometimes referred to as chipsets) that interconnects system components and controls communication between them. The device (300) includes an input / output (I / O) interface (330) including a display (340) which is typically a touch screen display. The I / O interface (330) also optionally includes a keyboard and / or mouse (or other pointing device) (350) and a touchpad (355), a haptic output generator (357) for generating haptic outputs on the device (300) (e.g., similar to the haptic output generator(s) (167) described above with reference to FIG. 1a), and sensors (359) (e.g., a light sensor, an accelerometer, a proximity sensor, a touch-sensitive sensor, and / or a touch intensity sensor similar to the contact intensity sensor(s) (165) described above with reference to FIG. 1a). The memory (370) includes high-speed random access memory such as DRAM, SRAM, DDR RAM, or other random access solid-state memory devices; optionally includes one or more non-volatile memories such as magnetic disk storage devices, optical disk storage devices, flash memory devices, or other non-volatile solid-state storage devices.The memory (370) optionally includes one or more storage devices located remotely from the CPU(s) (310). In some embodiments, the memory (370) stores programs, modules, and data structures, or a subset thereof, similar to the programs, modules, and data structures stored in the memory (102) of the portable multifunction device (100) (Fig. 1a). Additionally, the memory (370) optionally stores additional programs, modules, and data structures that are not present in the memory (102) of the portable multifunction device (100). For example, the memory (370) of the device (300) optionally stores a drawing module (380), a presentation module (382), a word processing module (384), a website creation module (386), a disk authoring module (388), and / or a spreadsheet module (390), whereas the memory (102) of the portable multifunction device (100) (Fig. 1a) optionally does not store these modules.

[0161] Each of the previously identified elements in FIG. 3 is optionally stored in one or more of the aforementioned memory devices. Each of the previously identified modules corresponds to a set of instructions for performing the aforementioned function. The previously identified modules or programs (e.g., sets of instructions) do not need to be implemented as separate software programs, procedures, or modules, and thus, in various embodiments, various subsets of these modules are optionally combined or otherwise rearranged. In some embodiments, memory (370) optionally stores a subset of the previously identified modules and data structures. Additionally, memory (370) optionally stores additional modules and data structures not mentioned.

[0162] Now, let us look at examples of user interfaces that are optionally implemented on a portable multifunctional device (100), for example.

[0163] FIG. 4a illustrates an exemplary user interface for a menu of applications on a portable multifunction device (100) according to some embodiments. Similar user interfaces are optionally implemented on the device (300). In some embodiments, the user interface (400) includes the following elements, or a subset or superset thereof:

[0164] Signal strength indicator(s) (402) for wireless communication(s) such as cellular and Wi-Fi signals;

[0165] Time (404);

[0166] Bluetooth indicator (405);

[0167] Battery status indicator (406);

[0168] Tray (408) having icons for frequently used applications such as the following:

[0169] o Optionally, an icon (416) for a phone module (138) labeled "Phone" including an indicator (414) of the number of missed calls or voicemail messages;

[0170] o Optionally, an icon (418) for an email client module (140) labeled "Mail" including an indicator (410) of the number of unread emails;

[0171] o An icon (420) for a browser module (147) labeled "Browser"; and

[0172] o An icon (422) for a video and music player module (152) labeled “iPod,” also referred to as an iPod (trademark of Apple Inc.) module (152); and

[0173] Icons for other applications such as the following:

[0174] o An icon (424) for an IM module (141) labeled "Message";

[0175] o An icon (426) for a calendar module (148) labeled "Calendar";

[0176] o An icon (428) for an image management module (144) labeled "Photo";

[0177] o An icon (430) for a camera module (143) labeled "camera";

[0178] o An icon (432) for an online video module (155) labeled "Online Video";

[0179] o Icon (434) for a stock widget (149-2) labeled "Stock";

[0180] o An icon (436) for a map module (154) labeled "Map";

[0181] o An icon (438) for a weather widget (149-1) labeled "Weather";

[0182] o An icon (440) for an alarm clock widget (149-4) labeled "Clock";

[0183] o An icon (442) for an exercise support module (142) labeled "Exercise Support";

[0184] o An icon (444) for a memo module (153) labeled "Memo"; and

[0185] o An icon (446) for a settings application or module labeled "Settings" that provides access to settings for the device (100) and its various applications (136).

[0186] It should be noted that the icon labels illustrated in FIG. 4a are merely exemplary. For example, the icon (422) for the video and music player module (152) is labeled "Music" or "Music Player". Other labels are optionally used for various application icons. In some embodiments, the label for an individual application icon includes the name of the application corresponding to the individual application icon. In some embodiments, the label for a specific application icon is separate from the name of the application corresponding to the specific application icon.

[0187] FIG. 4b illustrates an exemplary user interface on a device (e.g., device (300) of FIG. 3) having a touch-sensitive surface (451) (e.g., tablet or touchpad (355) of FIG. 3) separate from a display (450) (e.g., touch screen display (112)). The device (300) also optionally includes one or more contact intensity sensors (e.g., one or more of sensors (359)) for detecting the intensity of contacts on the touch-sensitive surface (451) and / or one or more tactile output generators (357) for generating tactile outputs for a user of the device (300).

[0188] Some subsequent examples will be provided with reference to inputs on a touch screen display (112) (combining a touch-sensitive surface and a display), but in some embodiments, the device detects inputs on a touch-sensitive surface separate from the display, as shown in FIG. 4b. In some embodiments, the touch-sensitive surface (e.g., 451 in FIG. 4b) has a main axis (e.g., 452 in FIG. 4b) corresponding to a main axis (e.g., 453 in FIG. 4b) on the display (e.g., 450). According to these embodiments, the device detects contacts (e.g., 460 and 462 in FIG. 4b) with the touch-sensitive surface (451) at locations corresponding to individual locations on the display (e.g., in FIG. 4b, 460 corresponds to 468 and 462 corresponds to 470). In this way, user inputs (e.g., contacts (460, 462) and their movements) detected by the device on a touch-sensitive surface (e.g., 451 in FIG. 4b) are used by the device to manipulate a user interface on the display of a multifunction device (e.g., 450 in FIG. 4b) when the touch-sensitive surface is separate from the display. It should be understood that similar methods are optionally used for other user interfaces described herein.

[0189] Additionally, it should be understood that while the following examples are given primarily with reference to finger inputs (e.g., finger contacts, finger tap gestures, finger swipe gestures), in some embodiments, one or more of the finger inputs are replaced by input from other input devices (e.g., mouse-based input or stylus input). For example, a swipe gesture is optionally replaced by a mouse click (e.g., instead of a contact) and subsequent cursor movement along the path of the swipe (e.g., instead of the movement of the contact). As another example, a tap gesture is optionally replaced by a mouse click while the cursor is positioned over the location of the tap gesture (e.g., instead of detecting the contact and subsequently the contact being stopped). Similarly, when multiple user inputs are detected simultaneously, it should be understood that multiple computer mice are optionally used simultaneously, or that a mouse and finger contacts are optionally used simultaneously.

[0190] FIG. 5a illustrates an exemplary personal electronic device (500). The device (500) comprises a body (502). In some embodiments, the device (500) may include some or all of the features described in relation to the devices (100, 300) (e.g., FIG. 1a through 4b). In some embodiments, the device (500) has a touch-sensitive display screen (504) (hereinafter, touch screen (504)). Alternatively or additionally to the touch screen (504), the device (500) has a display and a touch-sensitive surface. As with the devices (100, 300), in some embodiments, the touch screen (504) (or touch-sensitive surface) optionally includes one or more intensity sensors for detecting the intensity of applied contacts (e.g., touches). One or more intensity sensors of the touch screen (504) (or touch-sensitive surface) may provide output data indicating the intensity of the touches. The user interface of the device (500) may respond to touches based on the intensity of the touches, which means that touches of different intensities may trigger different user interface actions on the device (500).

[0191] Exemplary techniques for detecting and processing touch intensity can be found, for example, in related applications: International Patent Application No. PCT / US2013 / 040061 filed May 8, 2013, with the title "Device, Method, and Graphical User Interface for Displaying User Interface Objects Corresponding to an Application" (published as WIPO Publication No. WO / 2013 / 169849), and International Patent Application No. PCT / US2013 / 069483 filed November 11, 2013, with the title "Device, Method, and Graphical User Interface for Transitioning Between Touch Input to Display Output Relationships" (published as WIPO Publication No. WO / 2014 / 105276), each of which is incorporated herein by reference in its entirety.

[0192] In some embodiments, the device (500) has one or more input mechanisms (506, 508). The input mechanisms (506, 508) (if included) may be physical. Examples of physical input mechanisms include push buttons and rotatable mechanisms. In some embodiments, the device (500) has one or more attachment mechanisms. These attachment mechanisms (if included) allow the device (500) to be attached, for example, to a hat, glasses, earrings, a necklace, a shirt, a jacket, a bracelet, a watch chain, a chain, pants, a belt, shoes, a wallet, a backpack, etc. These attachment mechanisms allow the device (500) to be worn by a user.

[0193] FIG. 5b illustrates an exemplary personal electronic device (500). In some embodiments, the device (500) may include some or all of the components described in FIG. 1a, FIG. 1b, and FIG. 3. The device (500) has a bus (512) that operably couples an I / O section (514) with one or more computer processors (516) and memory (518). The I / O section (514) may be connected to a display (504), which may have a touch-sensitive component (522) and optionally, a intensity sensor (524) (e.g., a contact intensity sensor). Additionally, the I / O section (514) may be connected to a communication unit (530) to receive application and operating system data using Wi-Fi, Bluetooth, Near Field Communication (NFC), cellular, and / or other wireless communication technologies. The device (500) may include input mechanisms (506 and / or 508). The input mechanism (506) is optionally a rotatable input device or, for example, a pushable and rotatable input device. In some examples, the input mechanism (508) is optionally a button.

[0194] In some examples, the input mechanism (508) is optionally a microphone. The personal electronic device (500) optionally includes various sensors such as a GPS sensor (532), an accelerometer (534), a direction sensor (540) (e.g., a compass), a gyroscope (536), a motion sensor (538), and / or a combination thereof, all of which can be operably connected to the I / O section (514).

[0195] The memory (518) of the personal electronic device (500) may include one or more non-transient computer-readable storage media for storing computer-executable instructions, and the computer-executable instructions, when executed by one or more computer processors (516), may cause the computer processors to perform the techniques described below, including processes (700 (Figs. 7a and 7b), 900 (Fig. 9), 1100 (Fig. 11), 1300 (Fig. 13), 1900 (Figs. 19a and 19b), 2100 (Figs. 21a and 21b), and 2300 (Figs. 23a and 23b)). The personal electronic device (500) is not limited to the components and configurations of Fig. 5b and may include other or additional components in a number of configurations.

[0196] As used herein, the term “affordance” refers to a user-interactive graphical user interface object displayed on the display screen of the devices (100, 300, and / or 500) (Figs. 1, 3, and 5). For example, an image (e.g., an icon), a button, and text (e.g., a hyperlink) each optionally constitute an affordance.

[0197] As used herein, the term “focus selector” refers to an input element representing the current part of a user interface that is interacting with the user. In some embodiments comprising a cursor or other location marker, the cursor functions as a “focus selector” so that when an input (e.g., a press input) is detected on a touch-sensitive surface (e.g., the touchpad (355) of FIG. 3 or the touch-sensitive surface (451) of FIG. 4b) while the cursor is over a specific user interface element (e.g., a button, a window, a slider, or other user interface element), the specific user interface element is adjusted according to the detected input. In some embodiments comprising a touch screen display (e.g., the touch-sensitive display system (112) of FIG. 1a or the touch screen (112) of FIG. 4a) that enables direct interaction with user interface elements on the touch screen display, when an input (e.g., a press input by contact) is detected on the touch screen display at the location of a specific user interface element (e.g., a button, a window, a slider, or other user interface element), the contact detected on the touch screen functions as a “focus selector” so that the specific user interface element is adjusted according to the detected input. In some embodiments, the focus is moved from one area of ​​the user interface to another area of ​​the user interface without moving the corresponding cursor or contact on the touch screen display (e.g., by using a tab key or an arrow key to move the focus from one button to another); in these embodiments, the focus selector moves according to the movement of the focus between different areas of the user interface.Regardless of the specific form the focus selector has, a focus selector is generally a user interface element (or a contact on a touchscreen display) controlled by the user to convey the user's intended interaction with the user interface (e.g., by displaying on the device the element of the user interface that the user wishes to interact with). For example, while a press input is detected on a touch-sensitive surface (e.g., a touchpad or a touchscreen), the position of a focus selector (e.g., a cursor, a touch, or a selection box) over an individual button will indicate that the user intends to activate the individual button (unlike other user interface elements shown on the device's display).

[0198] As used in the specification and claims, the term “characteristic intensity” of a contact refers to a characteristic of the contact based on one or more intensities of the contact. In some embodiments, the characteristic intensity is based on a plurality of intensity samples. The characteristic intensity is optionally based on a predefined number of intensity samples, or a set of intensity samples collected for a predetermined period (e.g., 0.05, 0.1, 0.2, 0.5, 1, 2, 5, 10 seconds) for a predefined event (e.g., after detecting contact, before detecting lift-off of contact, before or after detecting the start of movement of contact, before detecting the end of contact, before or after detecting an increase in the intensity of contact, and / or before or after detecting a decrease in the intensity of contact). The characteristic intensity of the contact is optionally based on one or more of the following: the maximum value of the contact intensities, the mean value of the contact intensities, the average value of the contact intensities, the top 10 percentile value of the contact intensities, half the value of the maximum value of the contact intensities, 90 percent the value of the maximum value of the contact intensities, etc. In some embodiments, the duration of the contact is used to determine the characteristic intensity (e.g., when the characteristic intensity is the average of the contact intensities over time). In some embodiments, to determine whether an action was performed by a user, the characteristic intensity is compared to a set of one or more intensity thresholds. For example, the set of one or more intensity thresholds optionally includes a first intensity threshold and a second intensity threshold. In this example, as a result of contact having a characteristic strength that does not exceed a first threshold, a first operation is performed; as a result of contact having a characteristic strength that exceeds the first strength threshold but does not exceed the second strength threshold, a second operation is performed; and as a result of contact having a characteristic strength that exceeds the second threshold, a third operation is performed.In some embodiments, the comparison between the characteristic intensity and one or more thresholds is used to determine whether to perform one or more operations (e.g., whether to perform individual operations or to defer performing individual operations), rather than to determine whether to perform a first operation or a second operation.

[0199] FIG. 5c illustrates detecting multiple contacts (552A to 552E) on a touch-sensitive display screen (504) using multiple intensity sensors (524A to 524D). FIG. 5c further includes intensity diagrams showing current intensity measurements of the intensity sensors (524A to 524D) for intensity units. In this example, the intensity measurements of the intensity sensors (524A, 524D) are each 9 intensity units, and the intensity measurements of the intensity sensors (524B, 524C) are each 7 intensity units. In some embodiments, the total intensity is the sum of the intensity measurements of the multiple intensity sensors (524A to 524D), which is 32 intensity units in this example. In some embodiments, an individual intensity is assigned to each contact, which is a part of the total intensity. FIG. 5d illustrates the assignment of total intensity to contacts (552A through 552E) based on their respective distances from the center of force (554). In this example, contacts (552A, 552B, 552E) are each assigned a contact intensity of 8 intensity units of the total intensity, and contacts (552C, 552D) are each assigned a contact intensity of 4 intensity units of the total intensity. More generally, in some embodiments, each contact (j) is assigned an individual intensity (Ij) which is a part of the total intensity (A) according to a predefined mathematical function Ij = A₀(Dj / ΣDi), where Dj is the distance of each contact (j) to the center of force, and ΣDi is the sum of the distances of all individual contacts to the center of force (e.g., i=1 through the last). The operations described with reference to FIGS. 5c and 5d may be performed using an electronic device similar or identical to the device (100, 300, or 500). In some embodiments, the characteristic intensity of the contact is based on one or more intensities of the contact. In some embodiments, a single characteristic intensity (e.g., a single characteristic intensity of a single contact) is determined using intensity sensors.It should be noted that the century diagrams are not part of the displayed user interface and are included in Figs. 5c and 5d to assist the reader.

[0200] In some embodiments, a portion of a gesture is identified to determine a characteristic intensity. For example, a touch-sensitive surface optionally receives a successive swipe contact that transitions from a starting position to an ending position (where the intensity of the contact increases). In this example, the characteristic intensity of the contact at the ending position is optionally based on only a portion of the successive swipe contact (e.g., only the portion of the swipe contact at the ending position) rather than the entire swipe contact. In some embodiments, a smoothing algorithm is optionally applied to the swipe contact intensities before determining the characteristic intensity of the contact. For example, the smoothing algorithm optionally includes one or more of an unweighted sliding-average smoothing algorithm, a triangular smoothing algorithm, a median filter smoothing algorithm, and / or an exponential smoothing algorithm. In some situations, these smoothing algorithms remove narrow spikes or dips in the swipe contact intensities to determine the characteristic intensity.

[0201] The intensity of contact on a touch-sensitive surface is optionally characterized for one or more intensity thresholds, such as a contact-detection intensity threshold, a light press intensity threshold, a deep press intensity threshold, and / or one or more other intensity thresholds. In some embodiments, the light press intensity threshold corresponds to the intensity at which the device would perform actions typically associated with clicking a button or trackpad of a physical mouse. In some embodiments, the deep press intensity threshold corresponds to the intensity at which the device would perform actions different from those typically associated with clicking a button or trackpad of a physical mouse. In some embodiments, when contact is detected at a characteristic intensity below the light press intensity threshold (e.g., and above the nominal contact-detection intensity threshold (at which point contact is no longer detected)), the device will move a focus selector according to the movement of contact on the touch-sensitive surface without performing the action associated with the light press intensity threshold or the deep press intensity threshold. Generally, unless otherwise noted, these intensity thresholds are consistent across different sets of user interface drawings.

[0202] An increase in the characteristic intensity of contact from an intensity below the light press intensity threshold to an intensity between the light press intensity threshold and the deep press intensity threshold is sometimes referred to as a "light press" input. An increase in the characteristic intensity of contact from an intensity below the deep press intensity threshold to an intensity above the deep press intensity threshold is sometimes referred to as a "deep press" input. An increase in the characteristic intensity of contact from an intensity below the contact-detection intensity threshold to an intensity between the contact-detection intensity threshold and the light press intensity threshold is sometimes referred to as detecting contact on the touch surface. A decrease in the characteristic intensity of contact from an intensity above the contact-detection intensity threshold to an intensity below the contact-detection intensity threshold is sometimes referred to as detecting lift-off of contact from the touch surface. In some embodiments, the contact-detection intensity threshold is zero (0). In some embodiments, the contact-detection intensity threshold is greater than zero.

[0203] In some embodiments described herein, one or more actions are performed in response to detecting a gesture comprising individual press inputs or in response to detecting individual press inputs performed by individual contacts (or multiple contacts), wherein individual press inputs are detected at least partially based on detecting an increase in the intensity of a contact (or multiple contacts) exceeding a press-input intensity threshold. In some embodiments, individual actions are performed in response to detecting an increase in the intensity of an individual contact exceeding a press-input intensity threshold (e.g., a "down stroke" of an individual press input). In some embodiments, the press inputs include an increase in the intensity of an individual contact exceeding a press-input intensity threshold and a subsequent decrease in the intensity of a contact below a press-input intensity threshold, and individual actions are performed in response to detecting a subsequent decrease in the intensity of an individual contact below a press-input intensity threshold (e.g., an "up stroke" of an individual press input).

[0204] FIGS. 5e to 5h show the light press intensity threshold of FIG. 5e (e.g., "IT L From an intensity less than ") the deep pressing intensity threshold of Fig. 5h (e.g., "IT DThe detection of a gesture including a press input corresponding to an increase in the intensity of contact (562) to an intensity exceeding ) is illustrated. On a displayed user interface (570) comprising application icons (572A to 572D) displayed in a predefined area (574), while a cursor (576) is displayed over an application icon (572B) corresponding to App 2, a gesture performed using contact (562) is detected on a touch-sensitive surface (560). In some embodiments, the gesture is detected on a touch-sensitive display (504). Intensity sensors detect the intensity of contacts on the touch-sensitive surface (560). The device detects that the intensity of the contact (562) is a deep press intensity threshold (e.g., "IT D It determines that the peak has been reached by exceeding ")." Contact (562) is maintained on the touch-sensitive surface (560). In response to the detection of a gesture, and during the gesture, a deep press intensity threshold (e.g., "IT D In accordance with a contact (562) having an intensity exceeding "), scaled-down representations (578A to 578C) (e.g., thumbnails) of recently opened documents for App 2 are displayed, as illustrated in FIGS. 5f to 5h. In some embodiments, the intensity compared to one or more intensity thresholds is a characteristic intensity of the contact. It should be noted that an intensity diagram for the contact (562) is not part of the displayed user interface and is included in FIGS. 5e to 5h to aid the reader.

[0205] In some embodiments, the display of the expressions (578A through 578C) includes animation. For example, as shown in FIG. 5f, expression (578A) is initially displayed in close proximity to the application icon (572B). As the animation progresses, as shown in FIG. 5g, expression (578A) moves upward and expression (578B) is displayed in close proximity to the application icon (572B). Subsequently, as shown in FIG. 5h, expression (578A) moves upward, expression (578B) moves upward toward expression (578A), and expression (578C) is displayed in close proximity to the application icon (572B). The expressions (578A through 578C) form an array over the icon (572B). In some embodiments, as shown in FIG. 5f and FIG. 5g, the animation proceeds according to the intensity of the contact (562), where the intensity of the contact (562) is a deep press intensity threshold (e.g., "IT D As it increases toward "), expressions (578A to 578C) appear and move upward. In some embodiments, the intensity on which the animation progress is based is the characteristic intensity of the contact. The operations described with reference to FIGS. 5e to 5h may be performed using an electronic device similar or identical to the device (100, 300, or 500).

[0206] In some embodiments, the device employs intensity hysteresis to avoid sudden inputs sometimes referred to as “jitter,” wherein the device defines or selects a hysteresis intensity threshold having a predefined relationship to a press-input intensity threshold (e.g., the hysteresis intensity threshold is X intensity units lower than the press-input intensity threshold, or the hysteresis intensity threshold is 75%, 90%, or any suitable ratio of the press-input intensity threshold). Thus, in some embodiments, the press input comprises an increase in the intensity of individual contacts above the press-input intensity threshold and a subsequent decrease in the intensity of contacts below the hysteresis intensity threshold corresponding to the press-input intensity threshold, and the individual action is performed in response to detecting a subsequent decrease in the intensity of individual contacts below the hysteresis intensity threshold (e.g., an “upstroke” of individual press inputs). Similarly, in some embodiments, a press input is detected only when the device detects an increase in contact intensity from an intensity below a hysteresis intensity threshold to an intensity above a press-input intensity threshold, and optionally, a subsequent decrease in contact intensity to an intensity below a hysteresis intensity, and individual actions are performed in response to the detection of a press input (e.g., an increase or decrease in contact intensity due to the surrounding environment).

[0207] For the sake of convenience of explanation, the description of actions performed in response to a press input associated with a press-input intensity threshold or in response to a gesture including a press input is optionally triggered in response to detecting any one of an increase in contact intensity above the press-input intensity threshold, an increase in contact intensity from an intensity below the hysteresis intensity threshold to an intensity above the press-input intensity threshold, a decrease in contact intensity below the press-input intensity threshold, and / or a decrease in contact intensity below the hysteresis intensity threshold corresponding to the press-input intensity threshold. Additionally, in examples where the action is described as being performed in response to detecting a decrease in contact intensity below the press-input intensity threshold, the action is optionally performed in response to detecting a decrease in contact intensity below the hysteresis intensity threshold corresponding to the press-input intensity threshold and lower than that.

[0208] Now, let us look at examples of user interfaces ("UI") and associated processes that can be implemented on electronic devices such as portable multifunctional devices (100), devices (300), or devices (500).

[0209] FIGS. 6a through 6q illustrate exemplary devices and user interfaces for simulating optical effects according to some embodiments. The user interfaces of these figures are used to illustrate the simulated optical effect processes described below, including the processes of FIGS. 7a and 7b.

[0210] FIG. 6a illustrates an exemplary electronic device (600) having a first camera (602) and a second camera (604) positioned on the rear surface of the electronic device, for example. In some examples, the first camera (602) and the second camera (604) have fixed but different focal lengths. In some examples, the focal length, field of view, and / or optical magnification properties of the optical system are fixed for each of the cameras (e.g., 602, 604). In some embodiments, in addition to having different fixed focal lengths, the cameras (e.g., 602, 604) have different fixed fields of view and different fixed optical magnification properties.

[0211] In some embodiments, the first camera (602) has a first field of view and the second camera (604) has a second field of view, and the first field of view and the second field of view overlap. In some embodiments, the first camera (602) and the second camera (604) are spaced apart so that the parallax between images detected (e.g., captured) by the cameras is used to determine distances to objects represented by different parts of a digital viewfinder that displays image data from one or more of the cameras (602) and cameras (604). In some embodiments, the first camera (602) and the second camera (604) are positioned on the surface of an electronic device (600), and the optical axes of the cameras (602, 604) are arranged so that they are parallel or substantially parallel. In some examples, the first camera (602) and the second camera (604) capture overlapping fields of view, for example, at least 50% overlap, at least 90% overlap, or more than that. In some examples, the first camera (602) has a wider field of view than the second camera (604). In some examples, the second camera has a wider field of view than the first camera. If the wide-angle camera (e.g., a camera with a wide-angle lens) has a wider field of view than the telephoto camera (e.g., a camera with a telephoto lens), objects at 1X magnification of the wide-angle camera appear further away than at 1X magnification of the telephoto camera. When the wide-angle camera and the telephoto camera have overlapping fields of view such that the field of view of the telephoto camera is centered on the field of view of the wide-angle camera, the image captured by the telephoto camera at the 1X magnification level will appear to be the optical zoom of the corresponding image captured by the wide-angle camera at the 1X magnification level in some situations (e.g., when the subject of the image is at least 1 meter away).

[0212] FIG. 6b illustrates the front view of an exemplary electronic device (600) comprising a display (612). The electronic device (600) displays a digital viewfinder (614) on the display (612) that includes a preview based on data received from a first camera (602). In some embodiments, objects displayed within the digital viewfinder (e.g., 611A, 611B, 615) are located at varying distances from the camera (and / or the electronic device (600)). In some embodiments, as illustrated in FIG. 6b through 6h, the data is displayed within the viewfinder without applying simulated optical effects, such as bokeh simulated optical effects. In some embodiments, the electronic device displays a digital viewfinder (614) on a display (612) in response to the electronic device (600) receiving user input—for example, detecting a tap gesture at a location on a touch-sensitive surface corresponding to a camera application affordance (e.g., 430 in FIG. 4a).

[0213] In some embodiments, the electronic device (600) displays a camera mode selection menu (619) on the display (612) that includes affordances corresponding to various selectable camera modes. In response to the electronic device (600) receiving a signal corresponding to the selection of a camera mode, the electronic device (600) configures a camera application for the selected camera mode. For example, FIG. 6b illustrates an active “photo” camera mode, or photo mode. In some examples, the electronic display displays a camera shutter affordance (617) on the display (612) (e.g., simultaneously with the digital viewfinder (614)), which, when activated, allows the electronic device (600) to capture an image by storing data from, for example, a first camera and / or a second camera in memory. In some examples, the captured image corresponds to a preview displayed in a digital viewfinder (614) (e.g., when the electronic device (600) detects the activation of the camera shutter affordance (617).

[0214] FIG. 6c illustrates that an electronic device (600) receives user input (622) corresponding to a command to initiate a camera mode change. In FIG. 6c, the electronic device (600) receives user input on a “Portrait” mode menu item displayed on a display (612). As a result, the electronic device (600) changes the camera capture mode to “Portrait” mode. In some examples, the “Portrait” mode, or Portrait mode, corresponds to a simulated optical effect mode. In some embodiments, the simulated optical effect mode is a mode in which a simulated optical effect is applied to a digital viewfinder when a set of one or more conditions is satisfied, as described below. In some embodiments, the menu name, label, or affordance for the camera mode corresponding to the simulated optical effect is changed.

[0215] FIG. 6d illustrates the result of receiving user input (622) in FIG. 6c when the electronic device (600) transitions from a photo mode as shown in FIG. 6b to a portrait mode. Once the electronic device (600) is in portrait mode, a portrait menu label is distinguished from the remaining menu items so that the user can easily identify when a mode change has occurred and which mode is selected. In some embodiments, the distinction may be, for example, through highlighting, bolding, different font sizes, changing font types, or any other mechanism to distinguish the selected mode from the non-selected modes.

[0216] In FIG. 6e, while displaying the digital viewfinder, the electronic device (600) determines whether one or more sets of conditions are satisfied. In some examples, one of the sets of conditions is satisfied when a subject is detected. In the example illustrated in FIG. 6e, the subject is not detected because, for example, the subject is too far away and the electronic device (600) cannot distinguish the subject from the rest of the objects in the scene. In some examples, as illustrated in FIG. 6e, upon the determination that one or more sets of conditions are not satisfied, the electronic device displays a graphic indication (642) of the unsatisfied condition on the display. In some examples, as illustrated in FIG. 6e, the electronic device does not detect the subject (for example, the camera focus is 10 m or more) and instructs the user (for example, using the graphic indication) to place the subject within an acceptable distance (for example, within 8 feet and 2.5 m). In some examples, affordances are displayed within the viewfinder to allow the user to disable or enable such instructions. In some examples, upon determination that a set of one or more conditions is satisfied, the electronic device forgoes displaying a graphic indication (642) on the display that instructs the user. Thus, in some examples, the electronic device does not instruct the user when user action is not helpful (or required) to apply the simulated optical effect.

[0217] In some examples, the electronic device detects a subject, but if the subject is too far away (e.g., the focus is between 2.5 m and 10 m), the electronic device instructs the user (e.g., using a graphical display) to move closer to the camera (e.g., within 8 feet). In some examples, the electronic device determines that the amount of light is too low (e.g., 400 lux or less) and instructs the user (e.g., using a graphical display) to provide more light. In some examples, affordances are displayed within the viewfinder to allow the user to disable or enable such instructions. In some examples, upon determination that a set of one or more conditions is met: the electronic device (600) withholds displaying a graphical display instructing the user on the display. Thus, in some examples, the electronic device does not instruct the user when user action does not help apply the simulated optical effect.

[0218] As illustrated in FIGS. 6e and 6f, in some examples, the electronic device (600) fails to detect a subject. In some examples, as a result of failing to detect a subject, the electronic device (600) displays one or more visual markers (636) (e.g., visual boundaries) located at the center of the digital viewfinder within the digital viewfinder (614) on the display, as illustrated in FIG. 6f. In some examples, as a result of not detecting subjects, the electronic device (600) displays one or more visual markers (e.g., visual boundaries) located at the center of the digital viewfinder within the digital viewfinder (614) on the display. In some examples, one or more visual markers (636) indicate to the user an area within the scene that will be focused on or otherwise acted upon by the electronic device.

[0219] As illustrated in FIG. 6g, one of the sets of one or more conditions is satisfied when the electronic device detects a subject within a predetermined distance from the electronic device (600) (e.g., the distance from the subject to the first camera or the second camera). In the example of FIG. 6g, one or more of the sets of conditions are not satisfied, and therefore the electronic device does not apply simulated optical effects to the preview displayed in the digital viewfinder (614). In some embodiments, the electronic device (600) automatically determines the distance to the subject (e.g., without user intervention or user input). For example, the electronic device (600) repeatedly (or continuously) tracks the subject and determines the distance to the subject. In some embodiments, the determination of the distance to the subject is based on a depth map generated based on parallax effects (e.g., using the first camera and the second camera). In some embodiments, the determination of the distance to the subject is based on the focal length of either the first camera or the second camera (or both). In some examples, the first condition among a set of one or more conditions includes determining whether the focal length is 8 feet or more, whether the focal length is within 8 feet and 2.5 m, or whether the amount of light is 400 or more. In some embodiments, the determination of whether the first condition is satisfied is based on data from one camera sensor (e.g., focal length). In some embodiments, the determination of whether the first condition is satisfied is based on data from both the first camera and the second camera. In some embodiments, the electronic device (600) displays a visual marker (636) to indicate that the electronic device (600) has detected a subject within the digital viewfinder (614) (e.g., around the subject, around a part of the subject, or around the head and shoulder area of ​​the person who is the subject).In some embodiments, the electronic device does not display one or more visual markers (e.g., 636) even when a subject is detected.

[0220] As illustrated in FIG. 6h, in some examples, a condition among a set of one or more conditions is satisfied when the electronic device detects an amount of detected light (e.g., in the first camera, in the second camera) that exceeds a minimum light threshold. In this example, the detected light (corresponding to darkness (660)) does not exceed the minimum light threshold and is too low for portrait mode. In some examples, if the amount of light is insufficient for portrait mode (e.g., does not exceed the minimum light threshold), the electronic device (600) displays to the user on the display an indication (642) that insufficient light is present. In some embodiments, the minimum light threshold is 100 lux, 200 lux, 300 lux, 400 lux, 500 lux, 600 lux, 700 lux, or some other threshold value determined based on the capabilities of the camera(s) to function in low light environments. Accordingly, in some examples, the simulated optical effect is applied based on the amount of light detected. In some examples, the electronic device (600) instructs the user to improve the light conditions by not applying the simulated optical effect when the light conditions are not optimal.

[0221] As illustrated in FIG. 6e, FIG. 6g, and FIG. 6h, upon determining that one or more sets of conditions are not satisfied, the electronic device (600) displays a graphic indication (642) of the unsatisfied conditions on the display. In some examples, the electronic device (600) does not detect the subject (e.g., the focus is greater than 10 m), and as illustrated in FIG. 6e, instructs the user (e.g., using a graphic indication) to place the subject within an acceptable distance (e.g., within 8 feet and 2.5 m). In some examples, the electronic device (600) detects the subject, but the subject is too far away (e.g., the focus is between 10 m and 2.5 m), and the electronic device (600) instructs the user (e.g., using a graphic indication) to move closer to the camera (e.g., within 8 feet), as illustrated in FIG. 6g. In some examples, the electronic device (600) determines that the amount of light is too low (e.g., 400 lux or less) and instructs the user to provide more light (e.g., using a graphical display), as illustrated in FIG. 6h. In some examples, affordances are displayed within the viewfinder to allow the user to disable or enable such instructions. In some examples, upon determining that a set of one or more conditions is satisfied, the electronic device withholds displaying a graphical display (642) instructing the user on the display. Thus, in some examples, the electronic device (600) does not instruct the user when user action does not help to apply the simulated optical effect.

[0222] Table A below illustrates exemplary results when the electronic device (600) is operating in portrait mode. The entries in the first column are optical effects (e.g., depth effect) while the electronic device is operating in portrait mode, Bokeh ) specifies whether it is applied to a preview displayed within a digital viewfinder (e.g., 614). The entries in the second column represent the state of a graphic display (e.g., 675 in FIG. 6j) that changes visually (e.g., color, translucency, hue, contrast) based on whether an optical effect is applied, in some embodiments. In some embodiments, the graphic display (e.g., 675 in FIG. 6j) is displayed regardless of whether an optical effect is applied or not. In some embodiments, the graphic display (e.g., 675 in FIG. 6j) is displayed when an optical effect is applied and is not displayed when an optical effect is not applied. In some examples, the graphic display (e.g., 675 in FIG. 6j) is highlighted when an optical effect is applied and is not highlighted when an optical effect is not applied.

[0223] Additionally, the entries in the third column of Table A represent conditions that can be met while the electronic device is operating in portrait mode. The entries in the fourth column represent a graphic display (e.g., 642, instructing the user) that is displayed on the display within the digital viewfinder as a result of the detected conditions in the third column. In some embodiments, the entries in the fourth column suggest steps that the user must perform to cause the electronic device to apply an optical effect by the device (600) satisfying one or more conditions (e.g., optical effect conditions). In some examples, the electronic device determines that the amount of light is too low (e.g., less than 400 lux) and instructs the user to provide more light (e.g., using the graphic display (642)), thereby causing the electronic device to satisfy the optical effect conditions. The entries in column 5 specify whether (and types thereof) one or more visual markers (e.g., 636 in FIG. 6j) are displayed in the digital viewfinder when the conditions of the corresponding row in column 3 are met. In some examples, for optical effect conditions to be met, one or more of the following conditions (e.g., all) must be met: (1) the focus must not be less than the minimum value (e.g., 50 cm), (2) the focus must not be further than the maximum value (e.g., 2.5 m), and (3) the detected light must not be less than the value (e.g., 400 lux).

[0224] [Table A]

[0225]

[0226] As illustrated in FIG. 6i, upon determination that a set of one or more conditions is satisfied, the electronic device (600) applies a simulated optical effect (680) (e.g., bokeh simulated optical effect) to a preview displayed in a digital viewfinder, wherein the simulated optical effect is based on data received from a first camera and a second camera. In this example, the simulated optical effect (680) is applied to objects in the background of the scene (e.g., trees) and not to objects in the foreground of the scene (e.g., subjects).

[0227] As illustrated in FIG. 6j, in some examples, upon a determination that a set of one or more conditions is satisfied, the electronic device (600) displays one or more visual markers (636) around the subject (or part of the subject) on the display. In some examples, the visual characteristics of the one or more visual markers (636) are updated in response to a determination that a set of one or more conditions is satisfied. For example, the one or more visual markers (636) illustrated in FIG. 6g indicate that the electronic device (600) has detected the subject within the digital viewfinder, and in response to a determination that a set of one or more conditions is satisfied, the electronic device updates the characteristics (e.g., size, position, color) of the one or more visual markers to provide the user with an indication that a set of one or more conditions is satisfied, and optionally, that a simulated optical effect has been applied (or will be applied). In some embodiments, the one or more visual markers (636) are not displayed even when a set of one or more conditions is satisfied and a simulated optical effect is applied.

[0228] As illustrated in FIGS. 6b through 6h, in some examples, upon determination that a set of one or more conditions is not satisfied, the electronic device (600) displays a preview in the digital viewfinder on the display without applying a simulated optical effect. As illustrated in FIGS. 6i and 6j, in some examples, the simulated optical effect is a simulated bokeh (680). In some embodiments, a non-limiting list of possible simulated optical effects includes a bokeh simulated optical effect, a simulated color filter, and a simulated gamma adjustment. In some embodiments, the electronic device applies a simulated optical effect such that a first part of the preview in the digital viewfinder (e.g., 680) has a simulated bokeh effect and a second part of the digital viewfinder (e.g., 615) (different from the first part) does not have a simulated bokeh effect. Therefore, in some examples, digital viewfinders mimic the optical bokeh effect commonly seen in the viewfinders of SLR cameras (and images captured by SLR cameras).

[0229] As illustrated in FIGS. 6i and 6j, in some examples, upon determination that a set of one or more conditions is satisfied, the electronic device (600) applies a simulated optical effect (680) (e.g., bokeh simulated optical effect) to a preview displayed in a digital viewfinder (614), wherein the simulated optical effect is based on data received from a first camera (602) and a second camera (604). In some examples, as illustrated in FIG. 6i, the electronic device (600) applies the simulated optical effect to a preview displayed in a digital viewfinder (614) without displaying an indication that the simulated optical effect has been applied and without displaying any visual markers. In some examples, as illustrated in FIG. 6j, the electronic device (600) applies the simulated optical effect to a preview displayed in a digital viewfinder (614) and displays an indication (675) that the simulated optical effect has been applied and one or more visual markers (636).

[0230] In some embodiments, the preview in the digital viewfinder (614) is not based on the second camera before the electronic device (600) applies a simulated optical effect to the preview in the digital viewfinder (614). In some examples, the displayed viewfinder (614) is based only on the first camera (602) before a set of one or more conditions is satisfied. In some examples, the displayed viewfinder (614) is based on both the first camera (602) and the second camera (604) after a set of one or more conditions is satisfied. Thus, in some examples, the electronic device conserves power by using only one camera when neither camera is needed, but uses two (or more) cameras when additional cameras provide an advantage (e.g., a visual advantage).

[0231] In some embodiments, as illustrated in FIG. 6k, the electronic device (600) applies simulated optical effects differently to different parts (651, 652) of the preview within the digital viewfinder. In some embodiments, the simulated optical effect (e.g., bokeh effect) is applied differently to different parts of the preview based on (or as a function thereof) the distance from the electronic device (600) to objects in different parts of the preview. For example, a first part of the preview (e.g., 652) will appear to have a first degree of blurring, and a second part of the preview (e.g., 651, representing an object further from the electronic device (600) than represented by the first part) will appear to have a second degree of blurring stronger than the first degree of blurring. Thus, a preview of a scene with varying depths will have varying blur intensities (e.g., degrees of blurring) throughout the preview. In some embodiments, as illustrated in FIG. 6k, the device (600) does not display a graphic indication (e.g., 675, text including “depth effect”) that a simulated optical effect (e.g., simulated bokeh effect) is being applied.

[0232] In some embodiments, as illustrated in FIG. 6k, a first portion (651) of the preview depicts a first object, and the first object is at a first distance from the electronic device (600), and a second portion (652) of the preview depicts a second object, and the second object is at a second distance (different from the first distance) from the electronic device (600). In some embodiments, applying a simulated optical effect to the preview (614) includes applying a simulated optical effect to the first portion (e.g., 652) with a first size, and applying a simulated optical effect to the second portion (e.g., 651) with a second size that is different from (e.g., larger than) the first size. Thus, in some embodiments, a simulated optical effect of varying intensities is applied to different portions of the preview within the digital viewfinder, which represents the distance from the objects to the viewer of the preview.

[0233] In some embodiments, as illustrated in FIG. 6k, applying a simulated optical effect causes a first part of the digital viewfinder (614) (e.g., 651, 652) to exhibit an effect such as bokeh, while a second part of the digital viewfinder (e.g., 615, different from the first part) does not exhibit such an effect. In some embodiments, the simulated optical effect is repeatedly updated based on data from the first camera and the second camera and is repeatedly applied to the digital viewfinder. In some embodiments, since the simulated optical effect is based on which part of the camera's field of view is selected as the focus point, the simulated optical effect changes when the distance of an object at the focus point changes or when the user selects a new focus point. For example, the simulated optical effect initially causes the first part of the first preview image displayed in the digital viewfinder (614) to show the effect (and the second part not), and the updated simulated optical effect causes the third part of the second preview image displayed in the digital viewfinder (614) (different from the first part) to show the effect (and the fourth part of the second preview image not). In some examples, the simulated optical effect is applied to the first part of the preview images displayed in the viewfinder and is not applied to the second part of the preview images displayed in the viewfinder (different from the first part). In some examples, the simulated optical effect is applied to the first part of the first preview image displayed in the viewfinder (and the second part not), and is applied to the third part of the second preview image displayed in the viewfinder (different from the first part) (and the fourth part not). As a result, the viewfinder shows the simulated optical effect. These simulated optical effects are also maintained for images captured while the simulated optical effects are applied to the viewfinder.

[0234] In some embodiments, the electronic device (600) generates a depth map based on data received from the first camera (602) and the second camera (604), and the simulated optical effect is based on the depth map. In some examples, the electronic device (600) generates a depth map using images captured by the first camera (602) and the second camera (604) by using a parallax effect in which the observed difference in the position of an object from two different viewpoints (e.g., two cameras) is greater for objects closer to the viewpoints and smaller for objects farther from the viewpoints. In some examples, the depth map includes information indicating distances from the electronic device (600) to various elements (e.g., pixels, objects) depicted within the digital viewfinder (e.g., based on the overlapping views of the first camera and the second camera).

[0235] In some embodiments, among a set of one or more conditions, a condition is satisfied when the focal length of the first camera (602) (or the second camera (604)) exceeds a minimum distance threshold (e.g., 8 feet). Thus, in some embodiments, the simulated optical effect is applied based on the first camera focusing on a subject that is not too close to the electronic device (600).

[0236] In some embodiments, among a set of one or more conditions, a condition is satisfied when the focal length of the first camera (602) (or the second camera (604)) does not exceed a maximum distance threshold (e.g., 2.5 meters). Accordingly, in some embodiments, the simulated optical effect is applied based on the first camera (602) focusing on a subject that is not too far from the electronic device (600).

[0237] In some embodiments, one or more sets of conditions are based on lighting conditions. In some embodiments, a sixth condition among the one or more sets of conditions is satisfied when the amount of light detected (e.g., in the first camera (602), in the second camera (604)) does not exceed a maximum light threshold (e.g., 1000 lux, 2000 lux, 3000 lux, or some other threshold determined based on the capabilities of the camera(s) to function in high light environments). Accordingly, in some examples, the electronic device (600) encourages the user to improve the light conditions by not applying simulated optical effects when the light conditions are not optimal.

[0238] In some embodiments, the determination by the electronic device (600) as to whether one or more sets of conditions are satisfied is based on data from the first camera. In some embodiments, data from the second camera is not used to determine whether one or more sets of conditions are satisfied. In some embodiments, data from both the first camera and the second camera are used to determine whether one or more sets of conditions are satisfied.

[0239] In some embodiments, the determination by the electronic device (600) as to whether one or more sets of conditions are satisfied is based on data from the second camera. In some examples, data from the first camera is not used to determine whether one or more sets of conditions are satisfied. In some examples, data from both the first camera and the second camera is used to determine whether one or more sets of conditions are satisfied.

[0240] In some embodiments, as illustrated in FIG. 6l and FIG. 6m, in response to detecting a subject (615) (e.g., within or outside a suitable distance), the electronic device (600) displays one or more visual markers (636) (e.g., visual boundaries) identifying the subject on a digital viewfinder (614) on a display. In some embodiments, the visual characteristics of one or more visual markers (e.g., the color of the visual markers, the size of the visual markers, the position of the visual markers, and the distance between the visual markers) are based on whether one or more sets of conditions are satisfied. In some embodiments, one or more visual markers are bounding boxes. In some embodiments, upon (or in response to) a determination that one or more sets of conditions are satisfied, the electronic device (600) changes the visual characteristics of one or more visual markers to indicate to the user that one or more sets of conditions are satisfied. In some examples, changing the visual display involves animating one or more visual markers (e.g., bounding boxes) so that one or more visual markers bounce. Accordingly, in some examples, the electronic device (600) notifies the user of whether one or more sets of conditions are satisfied based on the visual characteristics of one or more visual markers. In some examples, the electronic device (600) notifies the user of whether one or more sets of conditions are satisfied through the visual characteristics of the visual markers.

[0241] In some embodiments, as illustrated in FIG. 6n, upon detecting a plurality of subjects (e.g., using a first camera (602) and a second camera (604)), the electronic device (600) displays a plurality of one or more visual markers (636A to 636D) (e.g., visual boundaries) corresponding to the plurality of subjects. Thus, in some embodiments, the electronic device (600) notifies the user which subjects are being tracked (and / or are being considered when determining whether a set of one or more conditions is satisfied). In some embodiments, as illustrated in FIG. 6o, the device (600) does not display visual markers (e.g., visual markers (636)) but applies simulated optical effects (e.g., simulated bokeh effects) and graphic displays (e.g., 675, text including "depth effect").

[0242] In some embodiments, as illustrated in FIG. 6p, depending on the determination that a set of one or more conditions is satisfied, the electronic device (600) changes the visual characteristics (e.g., color of the visual markers, size of the visual markers, position of the visual markers, distance between the visual markers) of one or more visual markers (e.g., visual boundaries) before applying the simulated optical effect. For example, in FIG. 6p, the electronic device displays one or more virtual markers (e.g., 636E) having specific visual characteristics (e.g., first color, first position, first size) and transitions one or more visual markers (e.g., 636F) to different visual characteristics (e.g., second color, second position, second size) before applying the simulated optical effect. In some embodiments, as illustrated in FIG. 6q, upon determination that a set of one or more conditions is satisfied (e.g., focal length greater than 8 feet, focal length within 8 feet and 2.5 m, light greater than 400 lux; in some embodiments, the conditions are based on data from one camera sensor (e.g., focal length data); and in some embodiments, the conditions are based on data from both camera sensors), the electronic device applies a simulated optical effect (e.g., bokeh simulated optical effect) to a preview displayed in a digital viewfinder (614). As illustrated in FIG. 6q, as a result, trees are blurred and people are not blurred.

[0243] In some embodiments, as illustrated in the transition between FIG. 6g and FIG. 6j, upon a determination that one or more sets of conditions are satisfied (or are not satisfied), the electronic device changes the visual characteristics of one or more visual markers (e.g., from 636 in FIG. 6g having a first color, a first position, a first size, to 636 in FIG. 6j having a second color different from the first color). In some examples, upon a determination that one or more sets of conditions are satisfied, the electronic device changes the color or visual texture of one or more visual markers (636). Thus, in some examples, the change in visual characteristics indicates to the user that one or more sets of conditions are satisfied. In some examples, upon a subsequent determination that one or more sets of conditions are no longer satisfied (after one or more sets of conditions were previously satisfied), the electronic device changes the first visual characteristics of one or more visual markers again (e.g., 636 changes the second color back to the first color). Accordingly, in some examples, the electronic device (600) notifies the user whether one or more sets of conditions are satisfied.

[0244] In some embodiments, depending on detecting a subject (e.g., within or outside an appropriate distance), the electronic device (600) displays one or more visual markers (e.g., visual boundaries) identifying the subject within a digital viewfinder on the display. In some embodiments, a second characteristic of one or more visual markers (e.g., different from a first characteristic) is based on the characteristics of the subject (e.g., physical characteristics of the subject, size, distance to the subject, location of the subject). Thus, in some embodiments, the electronic device (600) indicates to the user which subject is being considered for satisfying one or more sets of conditions. As illustrated in FIG. 6l, one or more visual markers (636) surround a portion of the subject (e.g., from the buttocks to the head, from the shoulders to the head). When the subject moves further away from the electronic device (600), as illustrated in FIG. 6m, one or more visual markers (636) are displayed proportionally smaller to compensate for the change in the size of the subject within the digital viewfinder (614).

[0245] In some embodiments, as illustrated in FIG. 6j, when applying a simulated optical effect (e.g., bokeh simulated optical effect) to a preview displayed within a digital viewfinder (614), the electronic device (600) displays a graphic indication (e.g., 675, text including "depth effect") on the display (e.g., within the digital viewfinder (614) and outside the digital viewfinder (614)) that the simulated optical effect is being applied to the preview displayed within the digital viewfinder (614). Thus, the user can quickly understand that the simulated optical effect has been applied. In some embodiments, when not applying the simulated optical effect, the electronic device (600) does not display a graphic indication (e.g., text including "depth effect") on the display that the simulated optical effect is being applied to the preview displayed within the digital viewfinder (e.g., withholds display). Accordingly, in some examples, the electronic device (600) notifies the user that one or more sets of conditions are satisfied, and in some examples, the electronic device (600) notifies the user that one or more sets of conditions are not satisfied.

[0246] In some embodiments, the electronic device (600) detects user input requesting to capture an image (e.g., using a camera application). In response to detecting user input requesting to capture an image, if a set of one or more conditions is determined not to be satisfied, the electronic device (600) captures an image without simulated optical effects (e.g., based on data from the first camera (602) and not based on data from the second camera (604), or based on data from the second camera (604) and not based on data from the first camera (602). In some examples, the user activates a shutter affordance (617) displayed on a display while a set of one or more conditions is not satisfied, and the electronic device (600) captures an image using data from the first camera (or the second camera) without applying simulated optical effects to the data from the first camera (e.g., storing it in memory). In some embodiments, in response to detecting user input requesting to capture an image, and upon determining that a set of one or more conditions is satisfied, the electronic device (600) captures an image with simulated optical effects (e.g., with simulated optical effects applied to the image) (e.g., based on data from the first camera (602) and the second camera (604)). In some embodiments, the user activates a shutter affordance (617) displayed on a display while a set of one or more conditions is satisfied, and the electronic device (600) captures an image using data from the first camera (and / or the second camera) (e.g., stored in memory), wherein the simulated optical effects are applied to the data.

[0247] In some embodiments, while the electronic device (600) displays a preview in the digital viewfinder (614) without applying simulated optical effects, the electronic device (600) detects a change in the scene in front of one or more of the cameras (e.g., movement of the first camera, movement of objects / people in the scene, and / or change in lighting in the scene, in the field of view of the first camera). In response to the electronic device (600) detecting a change in the scene, and upon determining that the change in the scene has satisfied a set of one or more conditions (e.g., focal length greater than 8 feet, focal length within 8 feet and 2.5 m, light greater than 400 lux), the electronic device (600) applies simulated optical effects (e.g., bokeh simulated optical effects, simulated color filters, simulated gamma adjustments) to the preview displayed in the digital viewfinder (614). In accordance with the determination that a change in scene does not satisfy one or more sets of conditions (e.g., focal length greater than 8 feet, focal length within 8 feet and 2.5 m, light greater than 400 lux), the electronic device (600) maintains the display of the preview in the digital viewfinder without applying simulated optical effects (e.g., bokeh simulated optical effects, simulated color filters, simulated gamma adjustment).

[0248] FIGS. 7a and 7b are flowcharts illustrating a method for managing simulated optical effects using an electronic device according to some embodiments. The method (700) is performed in an electronic device (e.g., 100, 300, 500, 600) having a first camera, a second camera, and a display. Some operations of the method (700) are optionally combined, the order of some operations is optionally changed, and some operations are optionally omitted.

[0249] In block (702), the electronic device displays a digital viewfinder (e.g., 614) on a display (e.g., 612) that includes a preview based on data received from a first camera (e.g., 602). In some examples, the data is displayed in the viewfinder (e.g., 614) without applying simulated optical effects, such as bokeh simulated optical effects.

[0250] In blocks (704 and 706), while displaying a digital viewfinder (e.g., 614): upon determining that a set of one or more conditions is satisfied (e.g., focal length greater than 8 feet, focal length within 8 feet and 2.5 m, light greater than 400 lux), an electronic device (e.g., 600) applies a simulated optical effect (e.g., bokeh simulated optical effect) to a preview displayed in a digital viewfinder (e.g., 614 in FIG. 6i) in block (726), wherein the simulated optical effect is based on data received from a first camera (e.g., 602) and a second camera (e.g., 604). Thus, by applying the simulated optical effect to the preview, the electronic device informs the user that a set of one or more conditions is satisfied and informs the user of how the captured images will look, thereby appropriately prompting the user to capture an image (with the simulated optical effect applied). In some embodiments, one or more conditions are based on data from one camera (e.g., focal length data). In some embodiments, one or more conditions are based on data from both sensors. In some examples, a first condition among a set of one or more conditions is satisfied when a subject (e.g., 615) is detected within a predetermined distance from the device (e.g., distance from the subject (e.g., 615) to the first or second cameras (602, 604).

[0251] In block (732) of FIG. 7b, while displaying the digital viewfinder, upon determining that one or more sets of conditions in block (720) (e.g., focal length greater than 8 feet, focal length within 8 feet and 2.5 m, light greater than 400 lux) are not met, the electronic device displays a preview in the digital viewfinder (e.g., 614 in FIG. 6b) without applying simulated optical effects (e.g., bokeh simulated optical effects, simulated color filters, simulated gamma adjustment) in block (722). Thus, by displaying the preview without applying simulated optical effects, the electronic device informs the user that one or more sets of conditions are not met and informs the user of how the captured images will look (without simulated optical effects), thereby prompting the user to take action to satisfy one or more conditions (to apply simulated optical effects). In some embodiments, a set of one or more conditions is based on data from one sensor (e.g., focal length data). In some embodiments, a set of one or more conditions is based on data from both sensors.

[0252] In some embodiments, the simulated optical effect causes a first part of the digital viewfinder (e.g., 651, 652 in FIG. 6k) to exhibit an effect such as bokeh, while a second part of the digital viewfinder (e.g., 614) (e.g., 615 in FIG. 6k, different from the first part) does not exhibit such an effect. In some examples, the simulated optical effect is repeatedly updated based on data from a first camera (e.g., 602) and a second camera (e.g., 604) and is repeatedly applied to the digital viewfinder (e.g., 614). Thus, by repeatedly updating the simulated optical effect and applying it to the digital viewfinder, the electronic device informs the user of how the captured image will look at any given time (e.g., live or near live), thereby prompting the user to appropriately capture the image (with the simulated optical effect applied). For example, the simulated optical effect causes the first part (e.g., 651, 652) of the first preview image initially displayed in the viewfinder to show the effect (and the second part not), and the updated simulated optical effect causes the third part (different from the first part) of the second preview image displayed in the viewfinder to show the effect (and the fourth part of the second preview image not).

[0253] In some embodiments, a simulated optical effect (e.g., as illustrated in 680) is applied to a first portion (e.g., 651) of preview images displayed in the viewfinder and is not applied to a second portion (e.g., 652) of preview images displayed in the viewfinder (different from the first portion). In some examples, a simulated optical effect is applied to a first portion of a first preview image displayed in the viewfinder (and not to a second portion), and is applied to a third portion (different from the first portion) of a second preview image displayed in the viewfinder (and not to a fourth portion). As a result, the viewfinder exhibits a simulated bokeh effect. This simulated bokeh effect is also maintained for images captured while the simulated optical effect is applied to the viewfinder.

[0254] In some embodiments, the first camera (e.g., 602) and the second camera (e.g., 604) have fixed but different focal lengths. In some examples, the focal length, field of view, and optical magnification properties of the optical system are fixed for each of the cameras, but the fixed focal length is different between the first camera (e.g., 602) and the second camera (e.g., 604).

[0255] According to some embodiments, before applying simulated optical effects to a preview in a digital viewfinder (e.g., 614), the preview in the digital viewfinder (e.g., 614 in FIG. 6b) is not based on the second camera (e.g., 604) (e.g., not based on both cameras). In some examples, the displayed viewfinder (e.g., 614 in FIG. 6b) is based only on the first camera (e.g., 602) before a set of one or more conditions is satisfied. Thus, in some examples, the electronic device conserves battery power by not basing the preview on the second camera before applying simulated optical effects. In some examples, the displayed viewfinder (e.g., 614 in FIG. 6i through 6k) is based on both the first camera (e.g., 602) and the second camera (e.g., 604) after a set of one or more conditions is satisfied.

[0256] According to some embodiments, in block (728), the simulated optical effect is simulated bokeh. In some embodiments, an electronic device (e.g., 600) applies a simulated optical effect such that a first part (e.g., 651, 652, 680) of the preview within the digital viewfinder (e.g., 614) has a simulated bokeh effect, and a second part (e.g., 615) of the digital viewfinder (e.g., 614) (different from the first part) does not have a simulated bokeh effect. Thus, in some examples, the digital viewfinder (e.g., 614) mimics the optical bokeh effect typically seen in the viewfinders of SLR cameras (and images captured by SLR cameras).

[0257] According to some embodiments, in block (730), the simulated optical effect is applied differently to different parts of the preview within the digital viewfinder (e.g., 614 in FIG. 6k). In some embodiments, the bokeh effect is applied differently to different parts of the preview based on (or as a function thereof) the distance from the electronic device (e.g., 600) to objects in different parts of the preview. For example, a first part of the preview (e.g., 651 in FIG. 6k) will appear to have (or have) a first degree of blurring, and a second part of the preview (e.g., 652 in FIG. 6k) (representing an object further from the electronic device (e.g., 600) than represented by the first part) will appear to have (or have) a second degree of blurring stronger than the first degree of blurring. Thus, in some examples, a preview of a scene with varying depths will have varying blur intensities (e.g., degrees of blurring) throughout the preview. In some examples, while the electronic viewfinder indicates parts having varying blur intensities, the photograph captured by the electronic device in response to detecting the activation of the camera shutter affordance (617) will also indicate corresponding varying blur intensities.

[0258] According to some embodiments, a first part of the preview (e.g., 651 in FIG. 6k) depicts a first object (e.g., the object represented by 651), wherein the first object is at a first distance from an electronic device (e.g., 600). Additionally, a second part of the preview (e.g., 652 in FIG. 6k) depicts a second object (e.g., the object represented by 652), wherein the second object is at a second distance from an electronic device (e.g., 600). In some embodiments, the electronic device (e.g., 600) applying a simulated optical effect to the preview includes applying a simulated optical effect to the first part (e.g., 651) with a first size, and applying a simulated optical effect to the second part (e.g., 652) with a second size that is different from (e.g., larger than) the first size. Therefore, in some examples, simulated optical effects of varying intensities are applied to different parts of the preview within the digital viewfinder (e.g., 614), which represent the distance from the objects to the viewer of the preview.

[0259] According to some embodiments, a first camera (e.g., 602) has a first field of view and a second camera (e.g., 604) has a second field of view, and the first field of view and the second field of view overlap. In some examples, the first camera (e.g., 602) and the second camera (e.g., 604) are spaced apart so that the parallax between images captured by the cameras is used to determine the depths of objects (e.g., 611A, 611B in FIG. 6b) represented by different parts of the digital viewfinder (e.g., 614) (e.g., 611A, 611B in FIG. 6b) (e.g., by an electronic device). In some embodiments, the first camera (e.g., 602) and the second camera (e.g., 604) are positioned on the surface of an electronic device (e.g., 600), and the optical axes of the cameras are arranged so that they are parallel. In some examples, the first camera (e.g., 602) and the second camera (e.g., 604) capture overlapping fields of view, e.g., at least 50% overlap, at least 90% overlap, or more. In some examples, the first camera (e.g., 602) has a wider field of view than the second camera (e.g., 604). In some examples, the second camera (e.g., 604) has a wider field of view than the first camera (e.g., 602). If the wide-angle camera (e.g., a camera with a wide-angle lens) has a wider field of view than the telephoto camera (e.g., a camera with a telephoto lens), objects appear further away at 1X magnification of the wide-angle camera than at 1X magnification of the telephoto camera. When the wide-angle camera and the telephoto camera have overlapping fields of view such that the field of view of the telephoto camera is centered on the field of view of the wide-angle camera, the image captured by the telephoto camera at the 1X magnification level will appear to be the optical zoom of the corresponding image captured by the wide-angle camera at the 1X magnification level in some situations (e.g., when the subject of the image is at least 1 meter away).

[0260] According to some embodiments, an electronic device (e.g., 600) generates a depth map based on data received from a first camera (e.g., 602) and a second camera (e.g., 604), and simulated optical effects are based on the depth map. In some examples, the electronic device (e.g., 600) generates a depth map using images captured by the first camera (e.g., 602) and the second camera (e.g., 604) by using a parallax effect in which the observed difference in the position of an object from two different viewpoints (e.g., two cameras) is greater for objects closer to the viewpoints and smaller for objects farther from the viewpoints. In some examples, the depth map includes information indicating distances from an electronic device (e.g., 600) to various elements (e.g., pixels, objects, parts) depicted within a digital viewfinder (e.g., 614) (e.g., based on the overlapping fields of view of a first camera (e.g., 602) and a second camera (e.g., 604)).

[0261] According to some embodiments, an electronic device (e.g., 600) automatically determines the distance to a subject (e.g., 615) (e.g., without user intervention, without user input). For example, the electronic device (e.g., 600) repeatedly (or continuously) tracks the subject (e.g., 615) and determines the distance to the subject (e.g., 615). In some examples, the determination of the distance to the subject is based on a depth map generated based on parallax effects. In some examples, the determination of the distance to the subject is based on the focal length of either (or both) the first camera (e.g., 602) or the second camera (e.g., 604). In some examples, applying simulated optical effects includes applying a blur or bokeh effect to background objects depicted within the electronic viewfinder and not applying a blur or bokeh effect to the subject depicted within the electronic viewfinder.

[0262] According to some embodiments, in block (708), a second condition among a set of one or more conditions is satisfied when the focal length of the first camera (e.g., 602) (or the second camera (e.g., 604)) exceeds a minimum distance threshold (e.g., 8 feet). Thus, in some examples, the electronic device applies a simulated optical effect based on the first camera (e.g., 602) focusing on a subject (e.g., 615) that is not too close to the electronic device (e.g., 600).

[0263] According to some embodiments, in block (710), a third condition among a set of one or more conditions is satisfied when the focal length of the first camera (or the second camera (e.g., 604)) does not exceed a maximum distance threshold (e.g., 2.5 meters). Thus, in some examples, the simulated optical effect is applied based on the first camera (e.g., 602) focusing on a subject (e.g., 615) that is not too far from the electronic device (e.g., 600).

[0264] According to some embodiments, in block (712), a fourth condition among a set of one or more conditions is satisfied when the subject (e.g., 615) is detected beyond a predetermined minimum distance from the device. Thus, in some examples, the simulated optical effect is applied based on the subject (e.g., 615) not being too close to the electronic device (e.g., 600).

[0265] According to some embodiments, in block (714), a fifth condition among a set of one or more conditions is satisfied when the amount of light detected (e.g., in the first camera (602), in the second camera (604)) (corresponding to darkness (660)) exceeds a minimum light threshold (e.g., 100 lux, 200 lux, 300 lux, 400 lux, 500 lux, 600 lux, 700 lux, or some other reasonable threshold determined based on the capabilities of the camera(s) to function in low light environments). Thus, in some examples, a simulated optical effect is applied based on the amount of light detected. In some examples, the electronic device (e.g., 600) encourages the user to improve the light conditions by not applying the simulated optical effect when the light conditions are not optimal.

[0266] According to some embodiments, in block (716), a sixth condition among a set of one or more conditions is satisfied when the amount of light detected (e.g., in the first camera (602), in the second camera (604)) does not exceed a maximum light threshold (e.g., 1000 lux, 2000 lux, 3000 lux, or some other reasonable threshold determined based on the capabilities of the camera(s) to function in high light environments). In some examples, the electronic device (e.g., 600) encourages the user to improve the light conditions by not applying simulated optical effects when the light conditions are not optimal.

[0267] According to some embodiments, the determination of whether a set of one or more conditions is satisfied is based on data from the first camera (e.g., 602). In some examples, data from the second camera (e.g., 604) is not used to determine whether a set of one or more conditions is satisfied, thereby conserving battery power. In some examples, data from both the first camera (e.g., 602) and the second camera (e.g., 604) is used to determine whether a set of one or more conditions is satisfied, thereby providing more accurate metrics.

[0268] According to some embodiments, the determination of whether one or more sets of conditions are satisfied is based on data from the second camera (e.g., 604). In some embodiments, data from the first camera (e.g., 602) is not used to determine whether one or more sets of conditions are satisfied. In some embodiments, data from both the first camera (e.g., 602) and the second camera (e.g., 604) are used to determine whether one or more sets of conditions are satisfied.

[0269] According to some embodiments, in block (724), upon determination that one or more sets of conditions are not satisfied: a graphic indication of the unsatisfied conditions (e.g., 642) is displayed on the display (e.g., 612). In some examples, the electronic device (e.g., 600) does not detect the subject (e.g., 615) (e.g., the focus is greater than 10 m), and instructs the user (e.g., using the graphic indication (e.g., 642)) to place the subject (e.g., 615) within an acceptable distance (e.g., within 8 feet and 2.5 m).

[0270] According to some embodiments, an electronic device (e.g., 600) detects a subject (e.g., 615), but the subject (e.g., 615) is too far away (e.g., the focus is between 10 m and 2.5 m), and the electronic device (e.g., 600) instructs the user to move closer to the camera (e.g., within 8 feet) (e.g., using the graphic display (642) of FIG. 6g). In some embodiments, the electronic device (e.g., 600) determines that the amount of light is too low (e.g., 400 lux or less) and instructs the user to provide more light (e.g., using the graphic display (642) of FIG. 6h). In some embodiments, affordances are displayed in the viewfinder to allow the user to disable or enable such instructions (e.g., based on detecting the activation of the affordances). In some examples, upon determination that a set of one or more conditions is satisfied, the electronic device (e.g., 600) withholds displaying a graphic indication (e.g., 641) instructing the user on a display (e.g., 612). Thus, in some examples, the electronic device (e.g., 600) does not instruct the user when user action does not help to apply a simulated optical effect (e.g., 680). Thus, the electronic device prompts the user to take action to satisfy the conditions by providing the user with a visual indication (e.g., using a graphic indication (642)) that it has been automatically determined that the conditions are not satisfied.

[0271] According to some embodiments, in response to detecting a subject (e.g., 615) (e.g., within or outside an appropriate distance), an electronic device (e.g., 600) displays one or more visual markers (e.g., 636) (e.g., visual boundaries) identifying the subject (e.g., 615) on a digital viewfinder on a display (e.g., 612). A first visual characteristic of one or more visual markers (e.g., 636) (e.g., the color of the visual markers, the size of the visual markers, the position of the visual markers, the distance between the visual markers) is based on whether a set of one or more conditions is satisfied. In some examples, one or more visual markers (e.g., 636) are bounding boxes. In some examples, upon (or in response to) a determination that a set of one or more conditions is satisfied, an electronic device (e.g., 600) changes the visual properties of one or more visual markers (e.g., 636) to indicate to the user that a set of one or more conditions is satisfied. Thus, by changing the visual properties of one or more visual markers (636), the electronic device informs the user that the electronic device has automatically detected that a set of one or more conditions is satisfied and appropriately prompts the user to capture an image (with simulated optical effects applied).

[0272] According to some embodiments, changing a visual display involves animating one or more visual markers (e.g., 636) (e.g., bounding box) so that the visual characteristics of one or more visual markers (e.g., 636, 636E, 636F) change, such as the position, size, and / or color changing repeatedly (e.g., repeatedly, multiple times). Accordingly, in some examples, an electronic device (e.g., 600) notifies a user whether a set of one or more conditions is satisfied.

[0273] According to some embodiments, upon a determination that a set of one or more conditions is satisfied, an electronic device (e.g., 600) changes a first visual characteristic (e.g., the color of the visual markers, the size of the visual markers, the position of the visual markers, the distance between the visual markers) of one or more visual markers (e.g., 636) (e.g., visual boundaries). Thus, in some examples, the change in the visual characteristic indicates to the user that a set of one or more conditions is satisfied. In some examples, upon a subsequent determination that a set of one or more conditions is no longer satisfied (after a set of one or more conditions was previously satisfied), the electronic device (e.g., 600) changes the first visual characteristic of one or more visual markers (e.g., 636) again. Thus, in some examples, the electronic device (e.g., 600) notifies the user whether a set of one or more conditions is satisfied.

[0274] According to some embodiments, upon detecting a subject (e.g., 615) (e.g., within or outside an appropriate distance), an electronic device (e.g., 600) displays one or more visual markers (e.g., 636) (e.g., visual boundaries) identifying the subject (e.g., 615) within a digital viewfinder (e.g., 614) on a display (e.g., 612). A second characteristic (e.g., different from a first characteristic) of one or more visual markers (e.g., 636) is based on a characteristic (e.g., physical characteristics of the subject (615), size, distance to the subject (615), location of the subject (615)). Thus, in some examples, the electronic device (e.g., 600) indicates to the user which subject (e.g., 615) is being considered for satisfying one or more sets of conditions.

[0275] According to some embodiments, upon failure to detect a subject (e.g., 615), an electronic device (e.g., 600) displays one or more visual markers (e.g., 636 in FIG. 6f) (e.g., visual boundaries) located at the center of the digital viewfinder (e.g., 614) within a digital viewfinder (e.g., 614) on a display (e.g., 612). In some examples, upon failure to detect subjects, an electronic device (e.g., 600) displays one or more visual markers (e.g., 636 in FIG. 6f) (e.g., visual boundaries) located at the center of the digital viewfinder (e.g., 614) within a digital viewfinder (e.g., 614) on a display (e.g., 612).

[0276] According to some embodiments, upon detecting a plurality of subjects (e.g., using a first camera (602) and a second camera (604)), an electronic device (e.g., 600) displays a plurality of one or more visual markers (e.g., 636A to 636D in FIG. 6n) (e.g., visual boundaries) corresponding to the plurality of subjects within a digital viewfinder (e.g., 614) on a display (e.g., 612). Accordingly, in some examples, the electronic device (e.g., 600) notifies the user which subjects are being tracked (and / or are being considered when determining whether a set of one or more conditions is satisfied).

[0277] According to some embodiments, when applying a simulated optical effect (e.g., bokeh simulated optical effect) to a preview displayed within a digital viewfinder (e.g., 614), an electronic device (e.g., 600) displays a graphic indication (e.g., 675) (e.g., text including “depth effect”) on a display (e.g., 612) (e.g., within the digital viewfinder (614)) that the simulated optical effect is being applied to the preview displayed within the digital viewfinder (e.g., 614). Accordingly, the electronic device prompts the user to appropriately capture an image (with the simulated optical effect applied) by providing the user with a visual indication (e.g., indication (675)) that one or more sets of conditions have been automatically determined to be satisfied. By displaying a preview in a digital viewfinder (e.g., 614) without applying a simulated optical effect (e.g., 680), the electronic device (e.g., 600) withholds from displaying a graphic indication (e.g., 675) (e.g., text including “depth effect”) on a display (e.g., 612) (e.g., within the digital viewfinder (614)) that a simulated optical effect is being applied to the preview displayed in the digital viewfinder (e.g., 614). Thus, in some examples, the electronic device (e.g., 600) notifies the user whether one or more sets of conditions are satisfied or not satisfied. Thus, the electronic device prompts the user to take action to ensure that one or more sets of conditions are satisfied before taking a photograph or recording a video by providing the user with a visual indication that one or more sets of conditions have been automatically determined not to be satisfied (e.g., not displaying the indication (675)).

[0278] According to some embodiments, upon a determination that a set of one or more conditions is not satisfied (and in response to a user request), an electronic device (e.g., 600) captures an image without simulated optical effects (e.g., based on data from the first camera (602) and not based on the second camera (604), or based on data from the second camera (604) and not based on the first camera (602)). In some examples, the user activates a shutter affordance (e.g., 617) displayed on a display (e.g., 612) while a set of one or more conditions is not satisfied, and in response, the electronic device (e.g., 600) captures an image using data from the first camera (e.g., 602) (or the second camera (e.g., 604)) without applying simulated optical effects to the data (e.g., storing it in memory). Therefore, the electronic device informs the user of the attributes of the image data to be captured and stored in response to additional user input (e.g., an image capture request) by not applying simulated optical effects to the captured images when one or more sets of conditions are not met.

[0279] According to some embodiments, upon a determination that a set of one or more conditions is satisfied (and in response to a user request), an electronic device (e.g., 600) captures an image with simulated optical effects (e.g., 680) (e.g., based on data from a first camera (602) and a second camera (604)). In some examples, the user activates a shutter affordance displayed on a display (e.g., 612) while a set of one or more conditions is satisfied, and in response, the electronic device (e.g., 600) captures an image using data from a first camera (e.g., 602) (and / or a second camera (e.g., 604)) (e.g., storing it in memory), wherein the simulated optical effects are applied to the data.

[0280] According to some embodiments, while a preview is displayed in a digital viewfinder (e.g., 614) without applying simulated optical effects, an electronic device (e.g., 600) detects a change in the scene in front of the cameras (e.g., due to movement of the camera, movement of objects / people in the scene, and / or change in lighting in the scene). In response to detecting a change in the scene: upon determining that the change in the scene has satisfied a set of one or more conditions (e.g., focal length greater than 8 feet, focal length within 8 feet and 2.5 m, light greater than 400 lux), the electronic device (e.g., 600) applies simulated optical effects (e.g., bokeh simulated optical effects) to the preview displayed in the digital viewfinder (e.g., 614). Accordingly, the electronic device, by updating the digital viewfinder to apply simulated optical effects, informs the user that one or more sets of conditions have been met and informs the user of how the captured image will look (e.g., live or near live), thereby prompting the user to appropriately capture the image (with simulated optical effects applied). When it is determined that a change in the scene has not satisfied one or more sets of conditions (e.g., focal length greater than 8 feet, focal length within 8 feet and 2.5 m, light greater than 400 lux), the electronic device (e.g., 600) maintains the display of the preview in the digital viewfinder (e.g., 614) without applying simulated optical effects (e.g., bokeh simulated optical effects, simulated color filters, simulated gamma adjustment).

[0281] It should be noted that the details of the processes described above with respect to method (700) (e.g., FIG. 7a and FIG. 7b) are also applicable in a similar manner to the methods described below. For example, methods (900, 1100, 1300, 1900, 2100, 2300) optionally include one or more of the characteristics of the various methods described above in relation to method (700). For example, the electronic viewfinder (614) of method (700) is similar to the electronic viewfinder of methods (900, 1100, 1300, 1900, 2100, 2300). For brevity, these details are not repeated below.

[0282] FIGS. 8a through 8h illustrate exemplary devices and user interfaces for managing camera effects. The user interfaces in these figures are used to illustrate the processes described below, including the processes of FIG. 9.

[0283] FIG. 8a illustrates an electronic device (800) having a first camera (802) and a second camera (804) (e.g., on the rear surface of the electronic device (800)). In some examples, the first camera (802) and the second camera (804) have fixed but different focal lengths. In some examples, the focal length, field of view, and / or optical magnification properties of the optical system are fixed for each of the cameras. In some embodiments, in addition to having different fixed focal lengths, the cameras (e.g., 802, 804) have different fixed fields of view and different fixed optical magnification properties.

[0284] In some embodiments, the first camera (802) has a first field of view and the second camera (804) has a second field of view, and the first field of view and the second field of view overlap. In some embodiments, the first camera (802) and the second camera (804) are spaced apart so that the parallax between images captured by the cameras (e.g., 802, 804) is used to determine the depths of objects represented by different parts of the digital viewfinder. In some embodiments, the first camera (802) and the second camera (804) are positioned on the surface of the electronic device (800), and the optical axes of the cameras (e.g., 802, 804) are arranged so that they are parallel. In some embodiments, the first camera (802) and the second camera (804) capture overlapping fields of view, e.g., fields of view that overlap by at least 50%, fields of view that overlap by at least 90%, or fields of view that overlap by more than that. In some examples, the first camera (802) has a wider field of view than the second camera (804). In some examples, the second camera (804) has a wider field of view than the first camera (802). When a wide-angle camera (e.g., a camera with a wide-angle lens) has a wider field of view than a telephoto camera (e.g., a camera with a telephoto lens), objects at 1X magnification of the wide-angle camera appear further away than at 1X magnification of the telephoto camera. When the wide-angle camera and the telephoto camera have overlapping fields of view such that the field of view of the telephoto camera is centered approximately on the field of view of the wide-angle camera, the image captured by the telephoto camera at the 1X magnification level will appear, in some situations (e.g., when the subject of the image is at least 1 meter away), to be an optical zoom of the corresponding image captured by the wide-angle camera at the 1X magnification level.

[0285] As illustrated in FIG. 8b, the electronic device simultaneously displays on a display (812) a user interface (814) for capturing photos based on data received from a first camera (802), including displaying a digital viewfinder (814A) at a first magnification (e.g., 1x), (e.g., a live or nearly live preview image, not based on a second camera), and affordances (e.g., icons, text representations indicating magnification levels) (e.g., 816) for modifying the magnification of photos captured by the device using one or more of the first (802) and second cameras (804). In some examples, the magnification is 1x, and the digital viewfinder (814A) displays images corresponding to each camera without applying digital zoom. In some examples, the user interface for capturing photos based on data received from the first camera does not use data received from the second camera for capturing photos.

[0286] The electronic device detects the activation of an affordance (e.g., 816) (e.g., based on detecting a tap gesture (818)). In some examples, detecting the activation of the affordance includes detecting a tap gesture (818) at a location on a touch-sensitive surface of the electronic device (800) corresponding to the location of the affordance.

[0287] As illustrated in FIG. 8c, in response to detecting the activation of an affordance (e.g., 818), the electronic device (800) stops displaying a user interface (814) for capturing photos based on data received from the first camera (802) on a display (812), and the electronic device (800) displays a user interface (820) for capturing photos based on data received from the second camera (804), including displaying a digital viewfinder (820A) on the display (812) at a second magnification (e.g., 2x) greater than the first magnification. In some examples, the user interface for capturing photos based on data received from the second camera (804) does not use data received from the first camera (802) for capturing photos. Accordingly, in some examples, the activation of affordance (818) causes the electronic device to replace the digital viewfinder (814A) (based on the first camera) with the viewfinder (820A) (based on the second camera).

[0288] In some embodiments, the digital viewfinder (820A) of the user interface for capturing photos based on the second camera (804) completely replaces the digital viewfinder (814A) of the user interface for capturing photos based on the first camera (802).

[0289] In some embodiments, the electronic device provides a zoom control mechanism that allows the user to zoom in and zoom out. As illustrated in FIG. 8d, in some embodiments, the electronic device detects user input (840) (e.g., a pinch gesture, a drag gesture on an affordance (e.g., affordance (816)), or a swipe input within an area surrounding the affordance) within a digital viewfinder (e.g., 814A, 820A). In some examples, the electronic device (800) includes a touch-sensitive surface, and the user input is received at a location on the touch-sensitive surface corresponding to the digital viewfinder (e.g., 814A, 820A). Thus, the electronic device is referred to as detecting user input (840) within the digital viewfinder (e.g., 814A, 820A). As illustrated in FIG. 8e, the electronic device displays a zoom control unit (850) (e.g., a slider) on the display (812) (e.g., simultaneously with the affordance (816)) in response to detecting user input (840), and in some embodiments, performs zooming of the digital viewfinder (e.g., 814A, 820A) according to the user input (840). In some embodiments, as illustrated in FIG. 8d, the continuous zoom control unit (850) is not displayed on the display (812) before detecting user input (840). Thus, in some embodiments, the electronic device provides the user with an additional mechanism (e.g., a continuous zoom control unit) for zooming the digital viewfinder in response to detecting a gesture for zooming.

[0290] In some embodiments, the electronic device displays a zoom control unit in response to detecting a pinch gesture. In some examples, as illustrated in FIG. 8f, user input corresponds to a pinch (or de-pinch) gesture (e.g., 860) within the digital viewfinder (e.g., 814A, 820A). In some examples, as also illustrated in FIG. 8g, the electronic device (800) performs zooming of the digital viewfinder (e.g., 814A, 820A) in response to the pinch gesture (e.g., 860) and also displays a continuous zoom control unit (850).

[0291] In some embodiments, the electronic device (800) displays a zoom control unit (850) in response to detecting a drag gesture. In some examples, user input corresponds to a drag gesture within a digital viewfinder (e.g., 814A, 820A). In some examples, the electronic device (800) includes a touch-sensitive surface, wherein user input is a drag gesture at a location on the touch-sensitive surface corresponding to an affordance. Thus, in some examples, the electronic device (800) detects user input corresponding to dragging an affordance (e.g., 816, 1x / 2x indicator) and, in response, displays a zoom control unit (e.g., simultaneously with the affordance (816)).

[0292] In some embodiments, the electronic device (800) displays a zoom control unit in response to detecting a swipe gesture. In some embodiments, user input corresponds to a swipe gesture within a digital viewfinder (e.g., 814A, 820A). In some examples, the electronic device includes a touch-sensitive surface, wherein the user input is a swipe gesture at a location on the touch-sensitive surface corresponding to the digital viewfinder. In some examples, the electronic device detects user input corresponding to a swipe gesture on the digital viewfinder and, in response, displays a zoom control unit (e.g., simultaneously with affordance (816)).

[0293] In some embodiments, as shown in FIG. 8h, the zoom control unit (850) is a slider. In some embodiments, the zoom control unit (850) includes a plurality of positions (e.g., 862, 864) corresponding to a plurality of magnification levels.

[0294] In some embodiments, as illustrated in FIG. 8h, the zoom control unit (850) includes a plurality of positions (e.g., 862, 864) corresponding to a plurality of magnification levels, wherein a first position (862) among the plurality of positions corresponds to a first optical magnification level (e.g., based on a first camera without any digital zoom) and a second position (864) among the plurality of positions corresponds to a second optical magnification level different from the first optical magnification level (e.g., based on a second camera without any digital zoom).

[0295] In some embodiments, the zoom control unit acts as a joystick-type control unit. In some embodiments, the affordance (816) acts as a joystick-type control unit. In some embodiments, the electronic device (800) detects a gesture corresponding to the zoom control unit (e.g., at a location on a touch-sensitive surface corresponding to the zoom control unit) or the affordance (816) (e.g., at a location on a touch-sensitive surface corresponding to the affordance (816)), and the gesture has a direction and a length. In response to detecting the gesture and depending on the direction being a first direction, the electronic device (800) performs a zoom-out of the digital viewfinder (e.g., 814A, 820A) at a speed based on the size of the gesture (e.g., a distance moved from a specific location on the touch-sensitive surface, or a distance moved from an initial contact point on the touch-sensitive surface) (e.g., at an increasing speed). The electronic device (800) performs zoom-in of the digital viewfinder at a speed based on the magnitude of the gesture (e.g., at an increasing speed) in response to the detection of a gesture and depending on whether the direction is a second direction different from the first direction. In some embodiments, the zoom control unit acts as a joystick-type control unit, wherein detecting a drag gesture in one direction zooms out the viewfinder at an increasing speed based on the magnitude of the gesture, and dragging in the other direction (e.g. opposite to the first direction) zooms in the viewfinder at an increasing speed based on the magnitude of the gesture.

[0296] In some embodiments, the affordance (816) for modifying the magnification is displayed according to a determination that the electronic device includes a plurality of cameras (e.g., 802, 804) having overlapping fields of view. In some examples, the cameras (e.g., 802, 804) are arranged so that the cameras have parallel optical axes or substantially parallel optical axes. In some examples, according to a determination that the electronic device does not include a plurality of cameras having overlapping fields of view, the electronic device withholds the affordance (816) for modifying the magnification.

[0297] In some embodiments, the electronic device (800) detects a second activation of the affordance (816) for modifying the magnification. In some examples, detecting the activation of the affordance includes detecting a tap gesture at a location on a touch-sensitive surface corresponding to the location of the affordance. In response to detecting the second activation of the affordance (816) for modifying the magnification, the electronic device stops displaying a user interface (820) for capturing photos based on data received from the second camera (802) on the display (812), and the electronic device displays a user interface (814) for capturing photos based on data received from the first camera (802), including displaying a digital viewfinder (814A) at a first magnification on the display (812).

[0298] In some embodiments, the zoom control unit (850) fades out (e.g., visually on the display) in response to the device (800) detecting an input lift-off signal associated with user input within the digital viewfinder (e.g., 814A, 820A). In some embodiments, the displayed affordance (816) for adjusting the magnification does not fade out in response to the detection of an input lift-off signal associated with user input within the digital viewfinder (e.g., 814A, 820A). In some examples, the electronic device determines that user input has ended by detecting the lift-off of a touch performed, for example, on a touch-sensitive surface, and in response, fades out the display of the zoom control unit (850).

[0299] In some embodiments, displaying a zoom control unit (850) on a display (e.g., simultaneously with a digital viewfinder) includes replacing the display of an affordance (816) for modifying the magnification with the display of the zoom control unit.

[0300] FIG. 9 is a flowchart illustrating a method for managing camera effects according to some embodiments. The method (900) is performed in an electronic device (e.g., 100, 300, 500, 600, 800) having a first camera, a second camera, and a display. Some operations of the method (900) are optionally combined, the order of some operations is optionally changed, and some operations are optionally omitted.

[0301] In blocks (902 to 906), the electronic device (e.g., 800) simultaneously displays on a display (e.g., 812): a user interface (e.g., 814) for capturing photographs based on data received from a first camera (e.g., 802), including displaying a digital viewfinder (e.g., 814A) at a first magnification (e.g., a live or nearly live preview image, not based on a second camera (e.g., 804)). The electronic device (e.g., 800) further displays affordances (e.g., 816) (e.g., an icon, a text representation indicating a magnification level) for modifying the magnification of photographs captured by the device using one or more of the first and second cameras (e.g., 802, 804). In some examples, the magnification is 1x, and the digital viewfinder (e.g., 814A) displays images corresponding to each camera without digital zoom.

[0302] In block (908), an electronic device (e.g., 800) detects the activation of an affordance (e.g., 816). In some examples, detecting the activation of the affordance (e.g., 816) includes detecting a tap gesture (e.g., 818) at a location on a touch-sensitive surface corresponding to the location of the affordance (e.g., 816).

[0303] In block (910), in response to detecting the activation of an affordance (e.g., 816): the electronic device (e.g., 800) stops displaying a user interface (e.g., 814) for capturing photos based on data received from a first camera (e.g., 802) on a display (e.g., 812) in block (912), and in block (914), the electronic device (e.g., 800) displays a user interface (e.g., 820) for capturing photos based on data received from a second camera (e.g., 804), including displaying a digital viewfinder (e.g., 820A) on a display (e.g., 812) at a second magnification greater than a first magnification. Accordingly, in some examples, by transitioning user interfaces (of the first camera to the second camera) in response to detecting the activation of an affordance (e.g., 816), the electronic device informs the user of the internal state of the electronic device (e.g., which camera will be used when a picture is taken) and also informs the user of how the captured image will look before the image is captured (e.g., magnification, quality, field of view). In some examples, a user interface (e.g., 814) for capturing pictures based on data received from the first camera (e.g., 802) does not use data received from the second camera (e.g., 804) for capturing pictures.

[0304] According to some embodiments, a user interface (e.g., 820) for capturing photographs based on data received from a second camera (e.g., 804) does not use data received from a first camera (e.g., 802) for capturing photographs. In some examples, a digital viewfinder (e.g., 820A) of a user interface (e.g., 820) for capturing photographs based on the second camera (e.g., 804) completely replaces a digital viewfinder (e.g., 814A) of a user interface (e.g., 814) for capturing photographs based on the first camera (e.g., 802). In some examples, the first camera (e.g., 802) and the second camera (e.g., 804) have fixed but different focal lengths. In some examples, the focal length, field of view, and optical zoom properties of the optical system are fixed for each of the cameras, but the fixed focal length is different between the first camera (e.g., 802) and the second camera (e.g., 804).

[0305] According to some embodiments, an electronic device (e.g., 800) detects user input (e.g., 818, 840, 860) (e.g., a tap gesture, a pinch gesture, a drag gesture of the affordance (816), or a swipe input within an area surrounding the affordance) within a digital viewfinder (e.g., 814A, 820A). In response to detecting user input: the electronic device (e.g., 800) displays a zoom control unit (e.g., 850) (e.g., a slider) on a display (e.g., 812) (e.g., simultaneously with the digital viewfinder). Thus, by displaying the zoom control unit (e.g., 850) in response to user input, the electronic device provides the user with an additional (e.g., more accurate) mechanism (e.g., a continuous zoom control unit) for zooming the digital viewfinder. In some embodiments, the zoom control unit (e.g., 850) is not displayed on the display (e.g., 812 in FIGS. 8b through 8d) before detecting user input. In some embodiments, the electronic device (e.g., 800) performs zooming of the digital viewfinder (e.g., 814A, 820A) according to user input (e.g., 818, 840, 860). Thus, in some examples, the electronic device (e.g., 800) provides the user with an additional mechanism (e.g., zoom control unit (850)) for zooming the digital viewfinder (e.g., 814A, 820A). In some examples, an electronic device (e.g., 800) includes a touch-sensitive surface, and user input (e.g., 818, 840, 860) is received at a location on the touch-sensitive surface corresponding to a digital viewfinder (e.g., 814A, 820A). Thus, the electronic device (e.g., 800) is referred to as detecting user input within the digital viewfinder (e.g., 814A, 820A).

[0306] According to some embodiments, user input corresponds to a pinch gesture (e.g., 860) within a digital viewfinder (e.g., 814A, 820A). In some examples, an electronic device (e.g., 800) includes a touch-sensitive surface, and user input is a pinch gesture (e.g., 860) at a location on the touch-sensitive surface corresponding to the digital viewfinder (e.g., 814A, 820A).

[0307] According to some embodiments, user input corresponds to a drag gesture within the digital viewfinder (e.g., 814A, 820A). In some examples, the electronic device (e.g., 800) includes a touch-sensitive surface, and the user input is a drag gesture at a location on the touch-sensitive surface corresponding to an affordance (e.g., 816). In some examples, the electronic device (e.g., 800) detects user input corresponding to dragging the affordance (e.g., 816) (e.g., 1x / 2x indicator), and in response, the electronic device (e.g., 800) displays a zoom control unit (e.g., 850). Thus, by displaying the zoom control unit (e.g., 850) in response to user input, the electronic device provides the user with an additional (e.g., more precise) mechanism (e.g., a continuous zoom control unit) for zooming the digital viewfinder.

[0308] According to some embodiments, user input corresponds to a swipe gesture within a digital viewfinder (e.g., 814A, 820A). In some examples, an electronic device (e.g., 800) includes a touch-sensitive surface, wherein user input is a swipe gesture at a location on the touch-sensitive surface corresponding to the digital viewfinder (e.g., 814A, 820A). In some examples, the electronic device (e.g., 800) detects user input corresponding to a swipe gesture on the digital viewfinder (e.g., 814A, 820A) and, in response, displays a zoom control unit (e.g., 850).

[0309] According to some embodiments, the zoom control unit (e.g., 850) includes a zoom indicator affordance (e.g., as described with reference to 1040 in FIGS. 10a through 10t). In some examples, the zoom control unit (e.g., 850) includes a plurality of positions corresponding to a plurality of magnification levels.

[0310] According to some embodiments, a zoom control unit (e.g., 850) comprises a plurality of positions (e.g., 862, 864) corresponding to a plurality of magnification levels, wherein a first position (e.g., 862) among the plurality of positions corresponds to a first optical magnification level (e.g., based on a first camera (e.g., 802) without any digital zoom) and a second position (e.g., 864) among the plurality of positions (e.g., 862, 864) corresponds to a second optical magnification level different from the first optical magnification level (e.g., based on a second camera (e.g., 804) without any digital zoom). Thus, by providing a zoom control unit comprising positions corresponding to two optical levels (e.g., of each of the two cameras), the electronic device provides an efficient user-machine interface for transitioning between two cameras.

[0311] According to some embodiments, an electronic device (e.g., 800) detects a gesture (e.g., 818, 840, 860) corresponding to a zoom control unit (e.g., 850) at a position on a touch-sensitive surface corresponding to a zoom control unit (e.g., 850), and the gesture has a direction and a length. In response to detecting a gesture corresponding to a zoom control unit (e.g., 850) and depending on the direction being a first direction, the electronic device (e.g., 800) performs zoom out of a digital viewfinder (e.g., 814A, 820A) at a speed (e.g., increasing speed) based on the size of the gesture (e.g., a distance moved from a specific position on the touch-sensitive surface, or a distance moved from an initial contact point on the touch-sensitive surface). In response to detecting a gesture corresponding to the zoom control unit (e.g., 850) and depending on whether the direction is a second direction different from the first direction, the electronic device (e.g., 800) performs zoom in on the digital viewfinder (e.g., 814A, 820A) at a speed based on the size of the gesture (e.g., increasing speed). In some embodiments, the zoom control unit (e.g., 850) acts as a joystick-type control unit, wherein detecting a drag gesture in one direction zooms out the viewfinder at a speed based on the size of the gesture, and dragging in the other direction (e.g., opposite to the first direction) zooms in the viewfinder (e.g., 814A, 820A) at a speed based on the size of the gesture. Therefore, by performing zoom operations at varying speeds based on the magnitudes of the gestures, the electronic device optimizes the user-machine interface by reducing the number of user inputs (e.g., a single gesture) that the user must provide not only to instruct the electronic device to perform the zoom operation but also to instruct the speed at which the zoom operation should be performed.

[0312] According to some embodiments, an affordance for modifying magnification (e.g., 816) is displayed based on the determination that the electronic device (e.g., 800) includes a plurality of cameras having overlapping fields of view. In some examples, the cameras are arranged so that the cameras have parallel optical axes. In some examples, based on the determination that the electronic device (e.g., 800) does not include a plurality of cameras having overlapping fields of view, the electronic device withholds the affordance (e.g., 816).

[0313] According to some embodiments, an electronic device (e.g., 800) detects a second activation of an affordance (e.g., 816) for modifying the scale. In some examples, detecting the activation of the affordance (e.g., 816) includes detecting a tap gesture (e.g., 818) at a location on a touch-sensitive surface corresponding to the location of the affordance (e.g., 816). In response to detecting a second activation of an affordance (e.g., 816) for modifying the magnification: the electronic device (e.g., 800) stops displaying a user interface (e.g., 820) for capturing photos based on data received from a second camera (e.g., 804) on a display (e.g., 812), and the electronic device (e.g., 800) displays a user interface (e.g., 814) for capturing photos based on data received from a first camera (e.g., 802), including displaying a digital viewfinder (e.g., 814A) at a first magnification on a display (e.g., 812). Accordingly, in some examples, by transitioning user interfaces (of the second camera to the first camera) in response to detecting a second activation of an affordance (e.g., 816), the electronic device informs the user of the internal state of the electronic device (e.g., which camera will be used when a picture is taken) and also informs the user of how the captured image will look before the image is captured (e.g., magnification, quality, field of view).

[0314] According to some embodiments, a displayed zoom control unit (e.g., 850) fades out in response to detecting an input lift-off signal associated with user input in a digital viewfinder (e.g., 814A, 820A), wherein a displayed affordance (e.g., 816) for modifying magnification is not faded out in response to detecting an input lift-off signal associated with user input in a digital viewfinder (e.g., 814A, 820A). In some examples, an electronic device (e.g., 800) determines that user input has ended by detecting a lift-off of a touch, for example, performed on a touch-sensitive surface, and in response, the electronic device (e.g., 800) fades out the display of the zoom control unit (e.g., 850).

[0315] According to some embodiments, displaying a zoom control unit (e.g., 850) on a display (e.g., 812) (simultaneously with a digital viewfinder (e.g., 814A, 820A)) includes replacing the display of an affordance (e.g., 816) for modifying the magnification with the display of the zoom control unit (e.g., 850).

[0316] It should be noted that the details of the processes described above with respect to method (900) (e.g., FIG. 9) are also applicable in a similar manner to the methods described below. For example, methods (700, 1100, 1300, 1900, 2100, 2300) optionally include one or more of the characteristics of the various methods described above in relation to method (900). For example, the electronic viewfinder of method (900) is similar to the electronic viewfinder of methods (700, 1100, 1300, 1900, 2100, 2300). For brevity, these details are not repeated below.

[0317] FIGS. 10a through 10t illustrate exemplary devices and user interfaces for zooming a digital viewfinder according to some embodiments. The user interfaces of these figures are used to illustrate the processes described below, including the processes of FIG. 11.

[0318] FIG. 10a illustrates an exemplary electronic device (1000). In some embodiments, the electronic device (1000) includes a first camera (1002) and a second camera (1004) (e.g., on the rear surface of the electronic device (1000)). In some embodiments, the first camera (1002) and the second camera (1004) have fixed but different focal lengths. In some embodiments, the focal length, field of view, and / or optical magnification properties of the optical system are fixed for each of the cameras. In some embodiments, in addition to having different fixed focal lengths, the cameras (e.g., 1002, 1004) have different fixed fields of view and different fixed optical magnification properties.

[0319] As illustrated in FIG. 10b, the electronic device (1000) displays on the display a digital viewfinder (1014) based on data received from one or more cameras (e.g., a live or nearly live preview image from any one camera). In some examples, the digital viewfinder (1014) displays data based on only one of the first and second cameras (e.g., 1002, 1004).

[0320] As illustrated in FIGS. 10c through 10h, the user performs a drag gesture on the zoom indicator affordance (1040) to change the magnification of the digital viewfinder (1014). The zoom indicator affordance (1040) moves with the gesture. In contrast, the magnification of the digital viewfinder (1014) proceeds at different speeds, initially lagging behind the gesture and later catching up with the gesture. As illustrated in FIGS. 10c to 10h, while displaying the digital viewfinder (1014), the electronic device (1000) detects a gesture (1010) proceeding at a gesture speed (1016) (e.g., a drag gesture on a touch-sensitive surface, a drag gesture at a position corresponding to the zoom control unit (1030)), and the gesture corresponds to an instruction to zoom the digital viewfinder (1014) from a first magnification level (e.g., 1x, corresponding to a position (1022) on the zoom control unit (1030) as illustrated in FIG. 10c) to a third magnification level (e.g., 10x, corresponding to a position (1026) on the zoom control unit (1030) as illustrated in FIG. 10h).In response to detecting a gesture, the electronic device (1000) zooms the digital viewfinder (1014) from a first magnification level (e.g., 1x, as shown in FIG. 10c) to a second magnification level (e.g., 3x, corresponding to a position (1024) on the zoom control unit (1030), as shown in FIG. 10e), and from the second magnification level (e.g., 3x, corresponding to a position (1024) on the zoom control unit (1030), as shown in FIG. 10e) to a third magnification level (e.g., 10x, corresponding to a position (1026) on the zoom control unit (1030), as shown in FIG. 10h), wherein during a first part of the gesture (e.g., the part of the gesture as the gesture progresses from FIG. 10c to FIG. 10d), the electronic device moves at a first speed (e.g., average) slower than the speed at which the gesture is progressing. The digital viewfinder is zoomed at a speed) and during the second part of the gesture that occurs after the first part of the gesture (e.g., the part of the gesture when the gesture proceeds from FIG. 10d to 10h), the electronic device zooms the digital viewfinder at a second speed (e.g., average speed) that is faster than the speed at which the gesture is proceeding.

[0321] In some examples, the electronic device receives a request to record video before detecting a gesture (e.g., detecting a tap gesture at a position corresponding to a camera shutter affordance (1017)), and in response to the request to record video, the electronic device records the video in memory, and the video recording starts before the gesture is detected and ends after the gesture is terminated. In some examples, the recorded video includes a zoom corresponding to the zoom performed in the digital viewfinder in response to the gesture. In some examples, representations of images displayed in the viewfinder, including the performed zoom, are stored in memory as part of the video. In some examples, the size of the digital viewfinder on the display is maintained while the digital viewfinder is zoomed (e.g., the content within the digital viewfinder is zoomed).

[0322] In some embodiments, as described in detail below and illustrated in FIGS. 10c through 10h: (1) during the first part of the gesture: (a) the gesture progresses from a position (1022) corresponding to 1x magnification to a position (1024) corresponding to 3x magnification, and (b) the magnification level of the digital viewfinder changes from 1x magnification to 2x magnification; (2) during the second part of the gesture: (a) the gesture progresses from a position (1024) corresponding to 3x magnification to a position (1026) corresponding to 10x magnification, and (b) the magnification level of the digital viewfinder changes from 2x magnification to 10x magnification. Thus, (1) during the first part of the gesture, the magnification level lags behind the gesture, and (2) during the second part of the gesture, the magnification level catches up with the gesture. In some embodiments, progressive zooming is also performed when an input corresponding to a request to switch between individual zoom levels (e.g., a tap on a 1x / 2x button as described above with respect to method (800)) is received.

[0323] In some embodiments, during the first part of the gesture, the magnification level lags behind the gesture. In some embodiments, as illustrated in FIG. 10c and FIG. 10d, during a first part of the gesture, the gesture progresses from a first state (e.g., a position (1022) on the zoom control unit (1030)) to a second state (e.g., a position (1024) on the zoom control unit (1030)), wherein the first state corresponds to a first magnification level (e.g., 1x, corresponding to a position (1022) on the zoom control unit (1030) as illustrated in FIG. 10c) (optional, the first state of the gesture is a state in which contact is detected at a position corresponding to a part of the zoom control unit (1030) corresponding to the first magnification level), and the second state corresponds to a second magnification level higher than the first magnification level (e.g., 3x, corresponding to a position (1024) on the zoom control unit (1030) as illustrated in FIG. 10e) (e.g., the gesture is in the second state for at least a predetermined period If maintained, the magnification level will stop at a second magnification level, and optionally, the second state of the gesture is a state in which contact is detected at a position corresponding to a part of the zoom control unit (e.g., 1030) corresponding to the second magnification level), the electronic device zooms the digital viewfinder from a first magnification level (e.g., 1x, corresponding to a position (1022) on the zoom control unit (1030) as shown in FIG. 10c) to an intermediate magnification level (e.g., 2x, corresponding to a position (1028) on the zoom control unit (1030) as shown in FIG. 10d), the intermediate magnification level is higher than the first magnification level (e.g., 1x, corresponding to a position (1022) on the zoom control unit (1030) as shown in FIG. 10c) and corresponds to a second magnification level (e.g., 1024 on the zoom control unit (1030) as shown in FIG. 10e). Lower than 3x (for example, the magnification level lags behind the gesture).

[0324] In some embodiments, during the second part of the gesture, the magnification level catches up with the gesture. In some embodiments, as illustrated in FIG. 10d through FIG. 10h, during a second part of the gesture, the gesture progresses from a second state (e.g., a position (1024) on the zoom control unit (1030)) to a third state (e.g., a position (1026) on the zoom control unit (1030)), wherein the third state corresponds to a third magnification level (e.g., 10x, corresponding to a position (1026) on the zoom control unit (1030) as illustrated in FIG. 10h), and the third magnification level is higher than a second magnification level (e.g., 3x, corresponding to a position (1024) on the zoom control unit (1030) as illustrated in FIG. 10e) and an intermediate magnification level (e.g., 2x, corresponding to a position (1028) on the zoom control unit (1030) as illustrated in FIG. 10d) (e.g., the gesture is at least for a predetermined period of time, the second If maintained in the state, the magnification level will stop at the second magnification level, and optionally, the third state of the gesture is a state in which contact is detected at a position corresponding to a part of the zoom control unit (e.g., 1030) corresponding to the third magnification level), the electronic device zooms the digital viewfinder from an intermediate magnification level (e.g., 2x, corresponding to a position (1028) on the zoom control unit (1030) as shown in FIG. 10d) lower than the second magnification level (e.g., 3x, corresponding to a position (1024) on the zoom control unit (1030) as shown in FIG. 10e) to the third magnification level (e.g., 10x, corresponding to a position (1026) on the zoom control unit (1030) as shown in FIG. 10h). Accordingly, in some embodiments, during the second part of the gesture, the magnification level catches up with the gesture and changes from an intermediate magnification level to a third magnification level, where the intermediate magnification level is lower than the second magnification level.

[0325] In some embodiments, as illustrated in FIGS. 10c to 10f, a first part of a gesture (e.g., as illustrated in FIGS. 10c and 10d) comprises a movement of one or more contacts (e.g., 1010) on a touch-sensitive surface (e.g., a drag input or a D-pinch input on a touch-sensitive display), and the speed at which the first part of the gesture proceeds is based on the movement speed of one or more contacts (e.g., 1010) (e.g., 1016). A second part of the gesture comprises a continued movement of one or more contacts on a touch-sensitive surface (e.g., a continuation of a drag input or a D-pinch input on a touch-sensitive display, as illustrated in FIGS. 10d to 10f), and the speed at which the second part of the gesture proceeds is based on the movement speed of one or more contacts (e.g., 1010) (e.g., 1016). During the second part of the gesture, the movement of one or more contacts is stopped (e.g., as illustrated in FIG. 10g and FIG. 10h), while one or more contacts (e.g., 1010) continue to be detected on a touch-sensitive surface, and the electronic device (1000) continues to zoom the zoom digital viewfinder (1014) after the movement of one or more contacts (e.g., 1010) is stopped. In some embodiments, when the movement of the contacts is stopped, the zoom lags behind the movement of the contacts for at least a portion of the gesture and then catches up.

[0326] In some embodiments, continuing to zoom the digital viewfinder after the movement of one or more contacts (e.g., 1010) has stopped involves gradually decreasing the rate at which the magnification level is increasing. In some embodiments, as the current magnification level approaches a third magnification level (e.g., 10x, as illustrated in FIG. 10h) corresponding to the position where one or more contacts stopped moving (e.g., corresponding to position (1026) on the zoom control unit (1030)), the electronic device decreases the rate at which the zoom is increasing.

[0327] In some embodiments, zooming the digital viewfinder at a speed slower than the speed at which the gesture is proceeding involves gradually increasing the speed at which the magnification level increases as the contact (e.g., 1010) moves away from the starting position on the touch-sensitive surface (e.g., corresponding to the position (1022) on the zoom control unit (1030)). In some embodiments, the magnification level gradually eases into each speed at which the magnification level changes, and then gradually eases out from the speed at which the magnification level changes, thereby providing a smoother zoom effect.

[0328] In some embodiments, as illustrated in FIGS. 10b through 10i, the electronic device (1000) simultaneously displays, on a display (1012), a digital viewfinder (1014), a zoom control unit (1030) (e.g., an adjustable zoom control unit such as a zoom slider) - a plurality of positions following the zoom control unit (1030) correspond to a plurality of magnification levels (e.g., 1x, 1.1x, 1.2x, 1.3x, etc.), and a zoom indicator affordance (1040) (e.g., a draggable circle or square on the zoom slider). In response to detecting a gesture (e.g., contact (1010)), the electronic device (100) updates the display of the zoom indicator affordance (1040) to transition from a first position (e.g., position (1022) on the zoom control unit (1030)) among a plurality of positions to a second position (e.g., position (1026) on the zoom control unit (1030)) among a plurality of positions at a gesture speed (1016), wherein the first position corresponds to a first magnification level among a plurality of magnification levels (e.g., 1x, corresponding to position (1022) on the zoom control unit (1030) as shown in FIG. 10c) and the second position corresponds to a third magnification level among a plurality of magnification levels (e.g., 10x, corresponding to position (1026) on the zoom control unit (1030) as shown in FIG. 10h). Accordingly, in some embodiments, the electronic device enables the user to perform a zoom operation by dragging a zoom indicator affordance (1040) along a zoom control unit (1030).

[0329] In some embodiments, zooming the digital viewfinder from a first magnification level (e.g., 1x, corresponding to position (1022) on the zoom control unit (1030) as shown in FIG. 10c) to a third magnification level (e.g., 10x, corresponding to position (1026) on the zoom control unit (1030) as shown in FIG. 10h) involves zooming the digital viewfinder while smoothing the speed at which the zoom occurs with respect to the speed at which the gesture proceeds by limiting the zoom speed or the rate of change of the zoom speed. Thus, the electronic device provides a more visually satisfying (e.g., less distracting) zoom experience for videos in the viewfinder and for videos recorded in memory (e.g., when the electronic device is performing a video recording operation while the gesture is detected). In some examples, the electronic device zooms the digital viewfinder while smoothing the speed at which the zoom occurs by limiting the zoom speed (e.g., the maximum zoom speed). In some examples, the electronic device zooms the digital viewfinder while smoothing the speed at which the zoom occurs by limiting the rate of change of the zoom speed. In some examples, the electronic device zooms the digital viewfinder while smoothing the speed at which the zoom occurs by limiting both the zoom speed and the rate of change of the zoom speed.

[0330] In some embodiments, as illustrated in FIGS. 101 to 100, during a third part of a gesture that occurs prior to a first part of a gesture, the digital viewfinder (e.g., 1014) is zoomed at a third speed corresponding to the speed of the gesture being performed (during the third part of the gesture). Thus, when the gesture is below a threshold gesture speed, the zoom speed is matched to the speed gesture, allowing the user to directly control the zoom speed for the videos being recorded in memory.

[0331] In some examples, during the first part of the gesture at a first time, the electronic device (1000) zooms the digital viewfinder (1014) at a first speed while the first gesture speed of the gesture exceeds a threshold gesture speed. In some examples, this occurs during the first part of the gesture, and assuming the first speed is the maximum zoom speed and the threshold gesture is the gesture speed corresponding to the first speed, the gesture is fast and ahead of the zoom. In some embodiments, during the second part of the gesture at a second time, the electronic device (1000) zooms the digital viewfinder (1014) at a first speed while the second gesture speed of the gesture does not exceed a threshold gesture speed. For example, towards the end of the second part of the gesture, the gesture slows down or stops and the zoom catches up to the maximum zoom speed. Thus, in some examples, the digital viewfinder (1014) reaches the maximum zoom speed (and reaches its peak therein), which helps to smooth the zoom (e.g., while video is being recorded). Therefore, electronic devices provide a more visually satisfying zoom experience for videos in the viewfinder and for videos recorded in memory.

[0332] In some embodiments, as illustrated in FIG. 10p, following the electronic device (1000) detecting a gesture and subsequently zooming the digital viewfinder from a first magnification level to a third magnification level, the electronic device (1000) detects a tap gesture (1080) (e.g., a touch gesture) at a position (e.g., 1082) corresponding to a third position among a plurality of positions (e.g., a position on a touch-sensitive display corresponding to the third position), wherein the third position corresponds to a fourth magnification level among a plurality of magnification levels (e.g., 2x, corresponding to a position (1082) on a zoom control unit). In response to the detection of the tap gesture, the electronic device zooms the digital viewfinder (1014) from the third magnification level to the fourth magnification level (e.g., 2x), as illustrated in FIG. 10p. In some embodiments, the zoom is limited to a maximum zoom speed. In some examples, the rate of change of zoom speed is limited to the maximum zoom-change rate. Therefore, by limiting jagged zooms, electronic devices provide a more visually satisfying zoom experience in the viewfinder and for videos recorded in memory.

[0333] In some embodiments, in response to detecting a gesture as illustrated in FIGS. 10c through 10h, the electronic device displays a graphic scale level indicator (1090) (e.g., including text indicating the current scale level) on the display indicating the current scale level. Thus, the electronic device informs the user of the current scale level.

[0334] In some embodiments, after the graphic magnification level indicator (1090) is displayed for a predetermined period after the digital viewfinder zoom is stopped, the display of the graphic magnification level indicator on the display is stopped. In some examples, the graphic magnification level indicator is displayed while zooming the digital viewfinder and for a predetermined period after zooming the digital viewfinder. In some examples, the graphic zoom indicator fades out after a second predetermined amount of time has elapsed.

[0335] In some embodiments, as illustrated in FIG. 10j and FIG. 10k, after the zoom control unit (1030) is displayed for a second predetermined period after the zoom of the digital viewfinder is stopped, the electronic device (1000) stops displaying the zoom control unit (1030) on the display. In some examples, the zoom control unit (1030) is displayed only during the zooming of the digital viewfinder (1014) and for a predetermined period after the zooming of the digital viewfinder (1014). In some examples, the zoom control unit fades out after a second predetermined amount of time has elapsed.

[0336] In some embodiments, the electronic device (1000) displays a zoom control unit (1030) on the display (e.g., continuously) while displaying the digital viewfinder (1014) (e.g., the zoom control unit is continuous). Thus, the zoom control unit (1030) is available to the user without the user needing to provide additional input.

[0337] In some embodiments, the electronic device detects a pinch gesture on the digital viewfinder (1014). For example, the electronic device includes a touch-sensitive surface, and the pinch gesture is detected at a location corresponding to the digital viewfinder. In response to the detection of the pinch gesture, the electronic device zooms the digital viewfinder at a speed corresponding to the speed at which the pinch gesture is progressing throughout the pinch gesture (for example, without limiting the rate of change of the zoom to smooth the speed at which the zoom occurs against the speed at which the gesture progresses). Thus, when the electronic device detects a pinch gesture corresponding to the zoom operation, the electronic device does not smooth the speed of the zoom. Thus, the zoom resulting from the detection of the pinch gesture modifies the magnification level through direct manipulation, so that changes in the magnification level begin when the contacts start moving and end when the contacts stop moving.

[0338] In some embodiments, as illustrated in FIG. 10q and FIG. 10r, displaying the zoom control unit (1030) involves displaying the zoom control unit vertically on the display. In some examples, the zoom control unit is straight. Thus, the zoom control unit (1030) is displayed in an orientation convenient for the user to access.

[0339] In some embodiments, as illustrated in FIG. 10p and FIG. 10s, displaying the zoom control unit (1030) includes displaying the zoom control unit horizontally on the display. In some examples, the zoom control unit is a straight line. Thus, the zoom control unit is displayed in an orientation convenient for the user to access.

[0340] In some embodiments, as illustrated in FIG. 10t, multiple positions corresponding to multiple magnification levels are positioned along the zoom control unit (1092) so that the magnification levels are not linearly distributed. In some embodiments, multiple positions corresponding to multiple magnification levels are positioned along the zoom control unit (1090) so that the magnification levels are linearly distributed. The examples illustrated in FIG. 10t are exemplary, and the hashes and magnification levels are provided for illustrative purposes.

[0341] In some embodiments, as illustrated in FIG. 10t, the distance along the zoom control unit between the position (1094) corresponding to the lowest magnification level (e.g., 1x magnification) and the position (1098) corresponding to a magnification that is twice the lowest magnification level (e.g., 2x magnification) is extended to more than 25% of the total distance (length) of the zoom control unit and less than 45% of the total distance (length) of the zoom control unit (e.g., 30% of the total distance of the zoom control unit) (e.g., 1096).

[0342] In some embodiments, as illustrated in FIG. 10t, locations (e.g., 1093, 1095, 1094, 1098) following a zoom control unit (e.g., 1090, 1092) corresponding to optical magnification levels are visually distinguished from locations (e.g., 1097, 1099) following a zoom control unit corresponding to non-optical magnification levels (e.g., snap points). In some examples, the zoom control unit (e.g., 1090, 1092) includes markers for 1x and 2x magnification levels corresponding to the optical zooms of the first and second cameras of the electronic device.

[0343] In some embodiments, tapping at a position corresponding to an optical magnification level transitions the display from the current magnification level to an optical magnification level. In some embodiments, a third position among a plurality of positions corresponds to an optical magnification level. In some embodiments, as described above, the smoothed zoom effect is used in conjunction with other zoom controls, such as the zoom controls described with reference to method (900) and method (1300).

[0344] FIG. 11 is a flowchart illustrating a method for managing camera effects according to some embodiments. The method (1100) is performed in an electronic device (e.g., 100, 300, 500, 600, 800, 1000) having a first camera, a second camera, and a display. Some operations of the method (900) are optionally combined, the order of some operations is optionally changed, and some operations are optionally omitted.

[0345] In block (1102), an electronic device (e.g., 1000) displays on a display (e.g., 1012): a digital viewfinder (e.g., 1014) (e.g., a live or nearly live preview image from any one sensor) based on data received from one or more cameras (e.g., 1002, 1004). In some examples, the digital viewfinder (e.g., 1014) displays data based on only one of the first and second cameras (e.g., 1002, 1004).

[0346] In block (1104), while displaying a digital viewfinder (e.g., 1014), an electronic device (e.g., 1000) detects a gesture (e.g., 1010) (a drag gesture on a touch-sensitive surface) proceeding at a gesture speed (e.g., 1016), and the gesture (e.g., 1010) corresponds to an instruction to zoom the digital viewfinder (e.g., 1014) from a first magnification level to a third magnification level.

[0347] In block (1106), in response to detecting a gesture (e.g., 1010), the electronic device (e.g., 1000) zooms the digital viewfinder (e.g., 1014) from a first magnification level to a second magnification level and from the second magnification level to a third magnification level, zooming being: in block (1108), during a first part of the gesture, the electronic device (e.g., 1000) zooms the digital viewfinder (e.g., 1014) at a first speed (e.g., average speed) slower than the gesture speed (e.g., 1016) at which the gesture is proceeding; and in block (1112), during a second part of the gesture occurring after the first part of the gesture, the electronic device (e.g., 1000) zooms the digital viewfinder (e.g., 1014) at a second speed (e.g., average speed) faster than the gesture speed (e.g., 1016) at which the gesture is proceeding. 1014) includes zooming. Thus, by zooming the digital viewfinder at a first speed slower than the gesture speed (during the first part of the gesture), the electronic device performs smooth, cinematic zooms with reduced (or eliminated) abrupt zooms in the viewfinder (and in recorded videos), even when the user provides inaccurate or fast gestures for zooming. Similarly, by zooming the digital viewfinder at a second speed faster than the gesture speed (during the second part of the gesture), the electronic device performs smooth, cinematic zooms while keeping up with the user's gesture to achieve the user's requested zoom.

[0348] In some examples, the first camera (e.g., 1002) and the second camera (e.g., 1004) have fixed but different focal lengths. In some examples, the focal length, field of view, and optical zoom properties of the optical system are fixed for each of the cameras (e.g., 1002, 1004), but the fixed focal length differs between the first camera (e.g., 1002) and the second camera (e.g., 1004). In some examples, the electronic device (e.g., 1000) receives a request to record video before detecting a gesture, and in response, the electronic device (e.g., 1000) records video in memory, and video recording begins before the gesture is detected and ends after the gesture is terminated. In some examples, the recorded video includes a zoom corresponding to the zoom performed in the digital viewfinder (e.g., 1014). In some examples, the same (or similar) images displayed in the viewfinder are stored in memory for the video.

[0349] In block (1110), during the first part of the gesture: the gesture progresses from a first state to a second state - the first state corresponds to a first magnification level and the second state corresponds to a second magnification level higher than the first magnification level (e.g., if the gesture is maintained in the second state for at least a predetermined period, the magnification level will stop at the second magnification level) -, the electronic device (e.g., 1000) zooms the digital viewfinder (e.g., 1014) from the first magnification level to an intermediate magnification level higher than the first magnification level and lower than the second magnification level (e.g., the magnification level lags behind the gesture). Therefore, by zooming the digital viewfinder to an intermediate magnification level smaller than the second magnification level (corresponding to the second state) (during the first part of the gesture), the electronic device performs smooth, cinematic zooms in which abrupt zooms in the viewfinder (and in recorded videos) are reduced (or eliminated), even when the user provides inaccurate or rapid gestures for zooming.

[0350] In block (1114), during the second part of the gesture: the gesture progresses from the second state to the third state—the third state corresponds to a third magnification level higher than the second magnification level and the intermediate magnification level (e.g., if the gesture is maintained in the second state for at least a predetermined period, the magnification level will stop at the second magnification level)—the electronic device (e.g., 1000) zooms the digital viewfinder (e.g., 1014) from the intermediate magnification level lower than the second magnification level to the third magnification level (e.g., the magnification level changes from the intermediate magnification level to the third magnification level, where the intermediate magnification level is lower than the second magnification level). Thus, by zooming the digital viewfinder to the third magnification level (corresponding to the third state) (during the second part of the gesture), the electronic device performs smooth, cinematic zooms while keeping up with the user's gesture to achieve the user's requested zoom.

[0351] In some embodiments, a first state of the gesture is a state in which contact (e.g., 1010) is detected at a position corresponding to a part of the zoom control unit (e.g., 1030) corresponding to a first magnification level. In some embodiments, a second state of the gesture (e.g., 1010) is a state in which contact is detected at a position corresponding to a part of the zoom control unit (e.g., 1030) corresponding to a second magnification level. In some embodiments, a third state of the gesture (e.g., 1010) is a state in which contact is detected at a position corresponding to a part of the zoom control unit (e.g., 1030) corresponding to a third magnification level.

[0352] According to some embodiments, a first part of the gesture comprises the movement of one or more contacts (e.g., 1010) on a touch-sensitive surface (e.g., a drag input or a de-pinch input on a touch-sensitive display (e.g., 1012)), and the speed at which the first part of the gesture proceeds is based on the movement speed of the one or more contacts (e.g., 1010). Thus, since the speed of the gesture is based on the movement speed of the contacts, electronic devices provide a user-machine interface that performs intuitive zoom actions based on the contact inputs. A second part of the gesture comprises the continued movement of one or more contacts (e.g., 1010) on a touch-sensitive surface (e.g., the continuation of a drag input or a D-pinch input on a touch-sensitive display), the speed at which the second part of the gesture proceeds is based on the speed of movement of one or more contacts (e.g., 1010), and during the second part of the gesture, the movement of one or more contacts (e.g., 1010) is stopped while one or more contacts (e.g., 1010) are continuously detected on the touch-sensitive surface. In some examples, the electronic device (1000) continues to zoom a digital viewfinder (e.g., 1014) after the movement of one or more contacts (e.g., 1010) is stopped (e.g., when the movement of the contacts (e.g., 1010) stops, the zoom lags behind the movement of the contacts (e.g., 1010) for at least part of the gesture and then catches up).

[0353] According to some embodiments, continuing to zoom the digital viewfinder (e.g., 1014) after the movement of one or more contacts (e.g., 1010) has stopped comprises gradually decreasing the rate at which the magnification level is increasing (e.g., decreasing the rate at which the zoom is increasing as the current magnification level approaches a third magnification level corresponding to the position where one or more contacts (e.g., 1010) stopped moving). Thus, by managing the speed of magnification based on the cessation (or slowing) of the movement of the contacts, the electronic device performs smooth, cinematic-style reductions in zoom while achieving the user's requested zoom, even when the gesture involves abrupt changes.

[0354] According to some embodiments, zooming a digital viewfinder (e.g., 1014) at a speed slower than the speed at which the gesture is proceeding (e.g., 1012) involves gradually increasing the speed at which the magnification level increases as the contact moves away from a starting position on a touch-sensitive surface (e.g., so that the magnification level gradually matches each speed at which the magnification level changes, and then gradually moves away from the speed at which the magnification level changes to provide a smoother zoom effect). Thus, by managing the speed of magnification based on the movement of the contacts away from the starting position, the electronic device performs smooth, cinematic increases in zoom, even when the gesture involves abrupt changes.

[0355] According to some embodiments, an electronic device (e.g., 1000) simultaneously displays, on a display (e.g., 1012), a digital viewfinder (e.g., 1014): a zoom control unit (e.g., 1030) (e.g., an adjustable zoom control unit (e.g., 1030) such as a zoom slider) - a plurality of positions following the zoom control unit (e.g., 1030) correspond to a plurality of magnification levels - and a zoom indicator affordance (e.g., 1040) (e.g., a draggable circle / square / any shape on the zoom slider). In response to an electronic device (e.g., 1000) detecting a gesture, the electronic device (e.g., 1000) updates the display of a zoom indicator affordance (e.g., 1040) to transition from a first position among a plurality of positions to a second position among a plurality of positions at a gesture speed (e.g., 1012), wherein the first position corresponds to a first magnification level among a plurality of magnification levels and the second position corresponds to a third magnification level among a plurality of magnification levels. Thus, the electronic device (e.g., 1000) enables a user to perform a zoom operation by dragging the zoom indicator affordance (e.g., 1040) along a zoom control unit (e.g., 1030).

[0356] According to some embodiments, zooming a digital viewfinder (e.g., 1014) from a first magnification level to a third magnification level involves zooming the digital viewfinder (e.g., 1014) while smoothing the speed at which the zoom occurs with respect to the speed at which the gesture proceeds by limiting the zoom speed or the rate of change of the zoom speed. Thus, by managing the speed of magnification, the electronic device performs smooth, cinematic zooms even when the gesture involves abrupt changes or is fast. Thus, the electronic device (e.g., 1000) provides a more visually satisfying zoom experience in the viewfinder and for videos recorded in memory. In some examples, the electronic device (e.g., 1000) zooms the digital viewfinder (e.g., 1014) while smoothing the speed at which the zoom occurs by limiting the zoom speed (e.g., the maximum zoom speed). In some examples, an electronic device (e.g., 1000) zooms a digital viewfinder (e.g., 1014) while smoothing the speed at which the zoom occurs by limiting the rate of change of the zoom speed. In some examples, an electronic device (e.g., 1000) zooms a digital viewfinder (e.g., 1014) while smoothing the speed at which the zoom occurs by limiting both the zoom speed and the rate of change of the zoom speed.

[0357] According to some embodiments, during a third part of a gesture occurring prior to a first part of the gesture, the electronic device (e.g., 1000) zooms the digital viewfinder (e.g., 1014) at a third speed corresponding to the speed of the gesture (e.g., 1012) at which the gesture is proceeding. Thus, the electronic device (e.g., 1000) provides a more visually satisfying zoom experience in the viewfinder and for videos recorded in memory.

[0358] According to some examples, during the first part of the gesture at the first time, the electronic device (e.g., 1000) zooms the digital viewfinder (e.g., 1014) at the first speed while the first gesture speed of the gesture (e.g., 1016) exceeds the threshold gesture speed (where, assuming the first speed is the maximum zoom speed and the threshold gesture is the gesture speed corresponding to the first speed, the gesture is fast and ahead of the zoom), and during the second part of the gesture at the second time, the electronic device (e.g., 1000) zooms the digital viewfinder (e.g., 1014) at the first speed while the second gesture speed of the gesture (e.g., 1016) does not exceed the threshold gesture speed (where the gesture has slowed down or stopped and the zoom is catching up to the maximum zoom speed). Therefore, by limiting the zooming of the digital viewfinder to the maximum zoom speed, the electronic device performs smooth, cinematic zooms with reduced (or eliminated) high-speed zooms in the viewfinder (and in recorded videos), even when the user provides inaccurate or rapid gestures for zooming. Thus, in some examples, the digital viewfinder (e.g., 1014) reaches the maximum zoom speed (e.g., reaching the maximum value here), which helps to smooth out the zooms that occur while the video is being recorded. Thus, the electronic device (e.g., 1000) provides a more visually satisfying zoom experience in the viewfinder and in the videos recorded in memory.

[0359] According to some embodiments, following the detection of a gesture (e.g., 1010) and following the zooming of a digital viewfinder (e.g., 1014) from a first magnification level to a third magnification level: an electronic device (e.g., 1000) detects a tap gesture (e.g., 1080, touch gesture) at a position corresponding to a third position among a plurality of positions (e.g., a position on a touch-sensitive display (e.g., 1012) corresponding to the third position), wherein the third position corresponds to a fourth magnification level among a plurality of magnification levels. In response to the detection of the tap gesture (e.g., 1080), the electronic device (e.g., 1000) zooms the digital viewfinder (e.g., 1014) from a third magnification level to a fourth magnification level.

[0360] According to some embodiments, the zoom is limited to a maximum zoom speed. In some examples, the rate of change of the zoom speed is limited to a maximum zoom-rate of change. Thus, the electronic device (e.g., 1000) provides a more visually satisfying zoom experience in the viewfinder and for videos recorded in memory by limiting jagged zooms.

[0361] According to some embodiments, in response to detecting a gesture, an electronic device (e.g., 1000) displays a graphic scale level indicator (e.g., 1090) (e.g., including a text display of the current scale level) on a display (e.g., 1012) indicating the current scale level. Thus, the electronic device (e.g., 1000) informs the user of the current scale level.

[0362] According to some embodiments, after a graphic zoom level indicator is displayed for a predetermined period after the zoom of the digital viewfinder (e.g., 1014) is stopped, the electronic device (e.g., 1000) stops displaying the graphic zoom level indicator on the display (e.g., 1012). Thus, by stopping the display of the graphic zoom level indicator when there is a possibility that the user will need to access the graphic zoom level indicator (e.g., after a predetermined period), the electronic device provides a less intrusive user interface (and, e.g., the viewfinder), which results in an efficient user-machine interface. In some examples, the graphic zoom level indicator (e.g., 1090) is displayed while zooming the digital viewfinder (e.g., 1014) and for a predetermined period after zooming the digital viewfinder (e.g., 1014). In some examples, the graphic zoom indicator fades out after a second predetermined amount of time has elapsed.

[0363] According to some embodiments, after the zoom control unit (e.g., 1030) is displayed for a second predetermined period after the zoom of the digital viewfinder (e.g., 1014) has stopped, the electronic device (e.g., 1000) stops displaying the zoom control unit (e.g., 1030) on the display (e.g., 1012). In some embodiments, the zoom control unit (e.g., 1030) is displayed only during the zoom of the digital viewfinder (e.g., 1014) and for a predetermined period after the zoom of the digital viewfinder (e.g., 1014). In some embodiments, the zoom control unit (e.g., 1030) fades out after a second predetermined amount of time has elapsed.

[0364] According to some embodiments, an electronic device (e.g., 1000) displays a zoom control unit (e.g., 1030) on a display (e.g., 1012) while displaying a digital viewfinder (e.g., 1014) (e.g., the zoom control unit (e.g., 1030) is continuous). Thus, the zoom control unit (e.g., 1030) is available to the user without the user needing to provide additional input.

[0365] According to some embodiments, an electronic device (e.g., 1000) detects a pinch gesture on a digital viewfinder (e.g., 1014) (e.g., the electronic device (e.g., 1000) includes a touch-sensitive surface and the pinch gesture is detected at a location corresponding to the digital viewfinder (e.g., 1014). In response to detecting the pinch gesture: the electronic device (e.g., 1000) zooms the digital viewfinder (e.g., 1014) at a speed corresponding to the speed at which the pinch gesture is progressing throughout the pinch gesture (e.g., without limiting the rate of change of the zoom to smooth the speed at which the zoom occurs with respect to the speed at which the gesture progresses). Accordingly, by zooming the digital viewfinder (e.g., 1014) at a speed corresponding to the speed of the gesture, the electronic device provides the user with a mechanism to bypass the aforementioned zoom-management techniques, thereby providing the user with an option to directly manipulate the zoom of the viewfinder (and recorded videos), including zooms with high speed and rapid changes. Accordingly, when the electronic device (e.g., 1000) detects a pinch gesture corresponding to a zoom operation, the electronic device (e.g., 1000) does not smooth the zoom speed, so that the zoom during pinching adjusts the magnification level by direct manipulation, so that changes in the magnification level start when the contacts (e.g., 1010) begin to move and end when the contacts (e.g., 1010) stop moving.

[0366] According to some embodiments, a plurality of positions corresponding to a plurality of magnification levels are positioned along a zoom control unit (e.g., 1092, 1030) so that the magnification levels are not linearly distributed.

[0367] According to some embodiments, the distance along the zoom control unit (e.g., 1030) between the lowest magnification level (e.g., 1x magnification) and the magnification that is twice the lowest magnification level (e.g., 2x magnification) is extended to more than 25% of the total distance of the zoom control unit and less than 45% of the total distance of the zoom control unit (e.g., 1030) (e.g., 30% of the total distance of the zoom control unit (e.g., 1030)).

[0368] According to some embodiments, locations following a zoom control unit (e.g., 1030) corresponding to optical magnification levels are visually distinguishable from locations following a zoom control unit (e.g., 1030) corresponding to non-optical magnification levels (e.g., snap points). In some examples, the zoom control unit (e.g., 1030) includes markers for 1x and 2x magnification levels corresponding to the optical zooms of the first camera and the second camera of the electronic device (e.g., 1000). Thus, by providing visually distinguishable locations following a zoom control unit corresponding to optical magnification levels (compared to non-optical magnification levels), the electronic device informs the user about the optical magnification levels and provides (e.g.) higher quality image characteristics, thereby reducing the need for the user to provide multiple inputs to attempt changing zoom magnification levels in order to achieve a high-quality image.

[0369] According to some embodiments, a third position among a plurality of positions corresponds to an optical magnification level.

[0370] According to some embodiments, displaying a zoom control unit (e.g., 1030) includes displaying the zoom control unit (e.g., 1030 in FIG. 10q and FIG. 10r) vertically on a display (e.g., 1012). In some examples, the zoom control unit (e.g., 1030) is a straight line. Thus, the zoom control unit (e.g., 1030, 1092) is displayed in an orientation convenient for the user to access.

[0371] According to some embodiments, displaying a zoom control unit (e.g., 1030) includes displaying the zoom control unit (e.g., 1030 in FIG. 10b and FIG. 10s) horizontally on a display (e.g., 1012). In some examples, the zoom control unit (e.g., 1030, 1092) is a straight line. Thus, the zoom control unit (e.g., 1030) is displayed in an orientation convenient for the user to access.

[0372] It should be noted that the details of the processes described above with respect to method (1100) (e.g., FIG. 11) are also applicable in a similar manner to the methods described below. For example, methods (700, 900, 1300, 1900, 2100, 2300) optionally include one or more of the characteristics of the various methods described above in relation to method (1100). For example, the electronic viewfinder of method (1100) is similar to the electronic viewfinder of methods (700, 900, 1300, 1900, 2100, 2300). For brevity, these details are not repeated below.

[0373] FIGS. 12a through 12i illustrate exemplary devices and user interfaces for managing camera effects according to some embodiments. The user interfaces of these figures are used to illustrate the processes described below, including the processes of FIG. 13.

[0374] FIG. 12a illustrates an exemplary electronic device (1200) having a first camera (1202) and optionally, a second camera (1204) on the rear surface of the electronic device (1200). In some examples, the first camera (1202) and the second camera (1204) have fixed but different focal lengths. In some examples, the focal length, field of view, and / or optical magnification properties of the optical system are fixed for each of the cameras. In some embodiments, in addition to having different fixed focal lengths, the cameras (e.g., 1202, 1204) have different fixed fields of view and different fixed optical magnification properties.

[0375] In some embodi...

Claims

Claim 1 As a method, in an electronic device having one or more cameras, one or more input devices, and a display: while the electronic device is ready to capture media with the one or more cameras at a first magnification level, on the display: a digital viewfinder based on data received from the one or more cameras, wherein the digital viewfinder includes a representation of one or more objects within the field of view of the one or more cameras; while displaying the digital viewfinder, a first gesture is detected through the one or more input devices; according to a determination that a first set of one or more conditions is satisfied, wherein the first condition of the first set of one or more conditions is satisfied when the first gesture is at a first position, and the second condition of the first set of one or more conditions is satisfied when a zoom control unit is not displayed at a position corresponding to the first position, and among the one or more objects within the field of view of the one or more cameras, without being ready to capture media with the one or more cameras at a second magnification level different from the first magnification level, the one or more objects corresponding to the position of the first gesture on the one or more input devices A method comprising: focusing one or more cameras on the representation of each object; and preparing to capture media with the one or more cameras at a second magnification level different from the first magnification level, according to a determination that the first gesture is at the first position and the zoom control unit is displayed on the display at a position corresponding to the first position. Claim 2 A method according to claim 1, wherein the step of preparing to capture media with one or more cameras at the second magnification level includes the step of updating the display of the digital viewfinder to show a preview at the second magnification level. Claim 3 A method according to claim 1, wherein the step of displaying the digital viewfinder while the electronic device is ready to capture media with the one or more cameras at the first magnification level comprises the step of displaying representations of the one or more objects at the first magnification level on the display. Claim 4 A method according to claim 1, further comprising the step of preparing to capture media with the one or more cameras at a third magnification level based on the size of the first gesture, upon a determination that a third set of one or more conditions is satisfied—wherein the first condition of the third set of one or more conditions is satisfied when the first gesture is at a third position different from the first position. Claim 5 A method according to claim 1, further comprising the step of changing the camera capture mode of the electronic device, according to a determination that a fourth set of one or more conditions is satisfied—wherein the first condition of the fourth set of one or more conditions is satisfied when the first gesture is in the first position. Claim 6 In paragraph 5, the electronic device comprises: a first camera capture mode—the electronic device is configured to be prepared to capture media within a first range of magnification levels while in the first camera capture mode—a second camera capture mode—the electronic device is configured to be prepared to capture media within a second range of magnification levels while in the second camera capture mode, said second range of magnification levels is within the first range of magnification levels—a third camera capture mode—the electronic device is configured to be prepared to capture media within a third range of magnification levels while in the third camera capture mode, said third range of magnification levels is within the second range of magnification levels—, and a fourth camera capture mode—the electronic device is configured to be prepared to capture media at a first predetermined magnification level and a second predetermined magnification level while in the fourth camera capture mode, said first predetermined magnification level and said second predetermined magnification level are said A method configured to change between one or more of the second range of scale levels. Claim 7 A method according to claim 1, further comprising the step of changing the camera capture mode of the electronic device to a mode corresponding to the position of the first gesture, upon a determination that a fifth set of one or more conditions is satisfied—wherein the first condition of the fifth set of one or more conditions is satisfied when the first gesture is at a fourth position different from the first position. Claim 8 A method according to claim 7, further comprising the step of changing the camera capture mode of the electronic device based on the directional component of the first gesture, according to a determination that a sixth set of one or more conditions is satisfied—wherein the first condition of the sixth set of one or more conditions is satisfied when the first gesture is at the fourth position. Claim 9 A method according to claim 1, further comprising the step of displaying the zoom control unit on the display, upon determining that a seventh set of one or more conditions is satisfied—wherein the first condition of the seventh set of one or more conditions is satisfied when the first gesture is in a second position. Claim 10 A method according to claim 1, further comprising the step of locking a focus or exposure setting based on the characteristics of each object corresponding to the position of the first gesture on the one or more input devices among the one or more objects within the field of view of the one or more cameras, upon a determination that one or more sets of eight conditions are satisfied—wherein the first condition of the one or more sets of eight conditions is satisfied when the first gesture is at the first position. Claim 11 A method according to claim 1, further comprising the step of preparing to capture media with the one or more cameras at a fifth magnification level based on the size of the first gesture, according to a determination that a ninth set of one or more conditions is satisfied—wherein the first condition of the ninth set of one or more conditions is satisfied when the first gesture is in a fifth position, and the second condition of the ninth set of one or more conditions is satisfied when the zoom dial is displayed on the display. Claim 12 The method of claim 1 further comprises the step of preparing to capture media using a first exposure with one or more cameras while the focus or exposure setting is locked, and the method further comprises the step of preparing to capture media using a second exposure with one or more cameras, upon a determination that a tenth set of one or more conditions is satisfied—wherein the first condition of the tenth set of one or more conditions is satisfied when the first gesture is at the first position—wherein the second exposure is based on the size of the first gesture. Claim 13 A non-transient computer-readable storage medium for storing one or more programs configured to be executed by one or more processors of an electronic device having one or more cameras, one or more input devices, and a display, wherein the one or more programs include instructions for performing the method of any one of claims 1 to 12. Claim 14 An electronic device comprising: one or more cameras; one or more input devices; a display; one or more processors; and a memory for storing one or more programs configured to be executed by the one or more processors, wherein the one or more programs include instructions for performing the method of any one of claims 1 to 12.

Images