Device and method for capture of expanded digital image and bidirectional action with expanded digital image

Electronic devices with touch-sensitive surfaces and cameras group images into sequences for enhanced capture and interaction, addressing the limitations of conventional methods by allowing intuitive editing and manipulation of image sequences.

JP2025134723APending Publication Date: 2025-09-17APPLE INC
View PDF 8 Cites 0 Cited by

Patent Information

Application Number
JP2025090050
Authority / Receiving Office
JP · JP
Patent Type
Applications
Current Assignee / Owner
Priority Date
2015-09-23
Filing Date
2025-05-29
Publication Date
2025-09-17

AI Technical Summary

Technical Problem

Conventional methods for capturing and interacting with still and video images fail to effectively capture and manage the moments before and after a shutter button press, requiring significant editing to remove less interesting moments.

Method used

Electronic devices with touch-sensitive surfaces and cameras that group images into sequences before and after a shutter press, allowing interactive manipulation and editing of these sequences through gestures and inputs.

Benefits of technology

Enhances the capture and interaction with moments by providing improved methods and interfaces for capturing and editing image sequences, reducing the need for extensive post-processing.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure 2025134723000001_ABST
    Figure 2025134723000001_ABST
Patent Text Reader

Abstract

To provide a method that acquires a static image before or after pressing a shutter button.SOLUTION: A method comprises: displaying 902 a live preview on a display in an electronic device that has the display and a camera; detecting 908 activation of a shutter button in first time during displaying the live preview; acquiring 910 a representative image that represents a first image sequence according to detecting activation of the shutter button; acquiring a plurality of images after acquiring the representative image; displaying indication of capturing an image in the live preview during acquiring the representative image and the plurality of images; and grouping images that are acquired being proximate in time to the first time into the first image sequence.SELECTED DRAWING: Figure 9A
Need to check novelty before this filing date? Find Prior Art

Description

[Technical Field]

[0001] This application relates generally to electronic devices with touch-sensitive surfaces, including, but not limited to, electronic devices with touch-sensitive surfaces that capture, display, and / or otherwise manipulate digital content photographed or recorded by a camera. [Background technology]

[0002] In recent years, the use of electronic devices to capture, view, edit, and share digital content has increased significantly. Users frequently record digital content (e.g., images and / or videos) with their portable electronic devices (e.g., smartphones, tablets, and dedicated digital cameras), view and edit the digital content with image management applications (e.g., Photos from Apple Inc., Cupertino, California) and / or digital content management applications (e.g., iTunes® from Apple Inc., Cupertino, California), and share the digital content with others through instant messaging, email, social media applications, and other communication applications.

[0003] Portable electronic devices typically capture two types of digital content: still images and video. A still image is typically captured by simply pressing a shutter button. A still image captures a single instant without blur, but the details of the moments before and after are lost. Video captures a long period of time and may contain both interesting and less interesting moments. It typically requires significant editing to remove the less interesting moments. Summary of the Invention

[0004] Thus, there is a need for electronic devices that provide improved methods and interfaces for capturing and interacting with camera-captured or video-recorded moments, optionally complementing or replacing conventional methods for capturing and interacting with still and video images.

[0005] The devices of the present disclosure take photography beyond still images by providing new and improved ways for capturing and interacting with moments. In some embodiments, the device is a desktop computer. In some embodiments, the device is portable (e.g., a notebook computer, a tablet computer, or a handheld device). In some embodiments, the device is a personal electronic device (e.g., a wearable electronic device such as a wristwatch). In some embodiments, the device has a touchpad. In some embodiments, the device has a touch-sensitive display (also known as a "touchscreen" or "touchscreen display"). In some embodiments, the device has a graphical user interface (GUI), one or more processors, memory, and one or more modules, programs, or sets of instructions stored in the memory for performing multiple functions. In some embodiments, a user interacts with the GUI primarily through stylus and / or finger contacts and gestures on the touch-sensitive surface. In some embodiments, the functionality optionally includes image editing, drawing, presenting, word processing, spreadsheet creation, game playing, making phone calls, video conferencing, emailing, instant messaging, training support, digital photography, digital videography, web browsing, digital music playback, transcription, and / or digital video playback. Executable instructions for performing these functionality are optionally contained in a non-transitory computer-readable storage medium or other computer program product configured to be executed by one or more processors.

[0006] According to some embodiments, a method is performed on an electronic device including a display and a camera. The method includes displaying a live preview on the display while in a first media capture mode for the camera. The method further includes, while displaying the live preview, detecting activation of a shutter button at a first time, and, in response to detecting the activation of the shutter button at the first time, grouping a plurality of images acquired by the camera in a temporal vicinity of the activation of the shutter button at the first time into a first image sequence. The first image sequence includes a plurality of images acquired by the camera before detecting the activation of the shutter button at the first time, a representative image representative of the first image sequence and acquired by the camera after one or more of the other images in the first image sequence, and a plurality of images acquired by the camera after acquiring the representative image.

[0007] According to some embodiments, a method is performed on an electronic device having a display and a touch-sensitive surface. The method includes displaying a representative image on the display. The representative image is an image in a sequence of images taken by a camera. The image sequence includes one or more images acquired by the camera after capturing the representative image. The image sequence also includes one or more images acquired by the camera before capturing the representative image. The method includes detecting a first portion of a first input while displaying the representative image on the display, and in response to detecting the first portion of the first input, replacing the display of the representative image with a sequential display of one or more images acquired by the camera after capturing the representative image. The method further includes detecting a second portion of the first input after detecting the first portion of the first input, and in response to detecting the second portion of the first input, sequentially displaying one or more images acquired by the camera before capturing the representative image, the representative image, and one or more images acquired by the camera after capturing the representative image.

[0008] According to some embodiments, a method is performed on an electronic device having a display and a touch-sensitive surface. The method includes displaying a representative image on the display. The representative image is an image in a sequence of images taken by a camera. The image sequence includes one or more images acquired by the camera after acquiring the representative image. The image sequence includes one or more images acquired by the camera before acquiring the representative image. The method further includes detecting a first portion of a first input while displaying the representative image on the display. The method further includes, in response to detecting the first portion of the first input, transitioning from displaying the representative image to displaying each previous image in the sequence of images, each previous image being acquired by the camera before acquiring the representative image. After transitioning from displaying the representative image to displaying each previous image in response to detecting the first portion of the first input, the method further includes, after transitioning from displaying the representative image to displaying each previous image in sequence, displaying, starting with each previous image, at least a portion of one or more images acquired by the camera before acquiring the representative image and at least a portion of one or more images acquired by the camera after acquiring the representative image.

[0009] According to some embodiments, a method is performed in an electronic device including a display, a touch-sensitive surface, and one or more sensors for detecting an intensity of contact with the touch-sensitive surface. The method includes displaying a representative image on the display. The representative image is an image in a sequence of images taken by a camera. The image sequence includes one or more images acquired by the camera after capturing the representative image. The method further includes detecting a first input while displaying the representative image on the display, the first input including detecting that a characteristic intensity of the contact on the touch-sensitive surface has increased to a first intensity greater than a first intensity threshold. In response to detecting that the characteristic intensity of the contact has increased, the method further includes stepping through one or more images acquired by the camera after capturing the representative image in a first direction at a rate determined at least in part based on the first intensity. The method further includes, after stepping through one or more images acquired by the camera after capturing the representative image at a rate determined based at least in part on the first intensity, detecting that the intensity of the contact has decreased to a second intensity less than the first intensity. The method further includes, in response to detecting a decrease in the characteristic intensity of the contact to a second intensity, continuing to move in a first direction at a second rate through one or more images acquired by the camera after acquiring the representative image in accordance with a determination that the second intensity is above the first intensity threshold. The second rate is determined based at least in part on the second intensity, and the second rate is slower than the first rate. The method further includes, in response to detecting a decrease in the characteristic intensity of the contact to the second intensity, in accordance with a determination that the second intensity is below the first intensity threshold, moving in a second direction opposite the first direction through one or more images acquired by the camera after acquiring the representative image in accordance with a determination that the second intensity is below the first intensity threshold.

[0010] According to some embodiments, a method is performed on an electronic device having a display and a touch-sensitive surface. The method includes storing a plurality of image sequences, each image sequence including a respective representative image taken by a camera, one or more images acquired by the camera after acquiring the respective representative image, and one or more images acquired by the camera before acquiring the respective representative image. The method further includes displaying the first representative image for the first image sequence in a movable first area on the display. The method further includes detecting a drag gesture on the touch-sensitive surface. In accordance with a determination that the drag gesture is in a first direction on the touch-sensitive surface, the method further includes replacing, in the movable first area, the display of the first representative image for the first image sequence with a time-sequential display of at least a portion of one or more images for the first image sequence acquired by the camera after acquiring the first representative image for the first image sequence. The method further includes moving the first area in the first direction.

[0011] According to some embodiments, a method is performed on an electronic device with a display and a touch-sensitive surface. The method includes storing a plurality of image sequences, each image sequence including a respective representative image taken by a camera and one or more images acquired by the camera prior to acquiring the respective representative image. The method further includes displaying the first representative image for a first image sequence in a movable first area on the display. The method further includes detecting a gesture on the touch-sensitive surface, the gesture including a contact movement corresponding to movement on the display in a first direction. In response to detecting the gesture on the touch-sensitive surface, the method further includes moving the first area in a first direction on the display and moving a movable second area in the first direction on the display. In accordance with a determination that a sequence display criterion is met, while moving the second area in the first direction, chronologically displaying in the second area at least a portion of one or more images for a second image sequence that were acquired by the camera prior to acquiring the second representative image for the second image sequence.

[0012] According to some embodiments, a method is performed on an electronic device with a display and a touch-sensitive surface. The method includes storing a plurality of image sequences, each image sequence including a respective representative image taken by a camera, one or more images acquired by the camera after acquiring the respective representative image, and one or more images acquired by the camera before acquiring the respective representative image. The method further includes storing a plurality of images different from the images in the plurality of image sequences, each image in the plurality of images being not part of a sequence of images in the plurality of image sequences. The method further includes displaying a first image on the display and detecting a first input while displaying the first image on the display. The method further includes, in response to detecting the first input, performing a first operation in accordance with a determination that the first image is an image in the first image sequence, the first operation including displaying at least some of the images in the first image sequence in addition to the first image. The method further includes performing a second operation in accordance with a determination that the first image is an image in a plurality of images different from the images in the plurality of image sequences, the second operation including the first image.

[0013] According to some embodiments, a method is performed on an electronic device having a display and a touch-sensitive surface. The method includes displaying a representative image on the display. The representative image is an image in a sequence of images taken by a camera. The image sequence includes one or more images acquired by the camera after capturing the representative image. The image sequence includes one or more images acquired by the camera before capturing the representative image. The method further includes detecting an input to modify the representative image while displaying the representative image on the display. In response to detecting the input to modify the representative image, the method further includes modifying the representative image, the one or more images acquired by the camera after capturing the representative image, and the one or more images acquired by the camera before capturing the representative image in accordance with a determination that the device is in a first editing mode, and modifying the representative image without modifying the one or more images acquired by the camera after capturing the representative image and without modifying the one or more images acquired by the camera before capturing the representative image in accordance with a determination that the device is in a second editing mode different from the first editing mode.

[0014] According to some embodiments, a method is performed on a first electronic device having a display. The method includes displaying on the display a representative image in a user interface of an application configured to communicate with other electronic devices. The representative image is an image in a sequence of images taken by a camera. The image sequence includes one or more images taken by the camera after capturing the representative image. The image sequence includes one or more images captured by the camera before capturing the representative image. The method further includes, while displaying the representative image on the display, detecting, using the application, an input corresponding to a request to transmit or select a representative image for transmission from the first electronic device to a remote second electronic device. The method further includes, in response to detecting an input corresponding to a request to send or select a representative image for sending to the second electronic device, displaying a first set of options for sending at least a portion of the image sequence to the second electronic device in accordance with a determination that the second electronic device is configured to interact with the image sequence as a group, and displaying a second set of options for sending at least a portion of the image sequence to the second electronic device in accordance with a determination that the second electronic device is not configured to interact with the image sequence as a group, the second set of options being different from the first set of options.

[0015] According to some embodiments, a method is performed on an electronic device including a display and a camera. The method includes displaying a live preview of a scene on the display while in a first media capture mode for the camera and performing scene recognition on the scene. The method further includes detecting a single activation of a shutter button at a first time while displaying the live preview of the scene. In response to detecting the single activation of the shutter button at the first time, the method further includes retaining a plurality of images acquired by the camera in a temporal vicinity of the activation of the shutter button at the first time according to a determination that the scene meets action capture criteria based at least in part on the scene recognition performed on the scene, and grouping the plurality of images into a first image sequence. The first image sequence includes a plurality of images acquired by the camera before detecting the activation of the shutter button at the first time, a representative image representative of the first image sequence and acquired by the camera after one or more of the other images in the first image sequence, and a plurality of images acquired by the camera after acquiring the representative image. The method further includes, in response to detecting a single activation of the shutter button at the first time, retaining a single image in a temporal vicinity of the activation of the shutter button at the first time in accordance with a determination that the scene does not meet action capture criteria.

[0016] According to some embodiments, a method is performed on an electronic device having a display and a touch-sensitive surface. The method includes displaying an image on the display. The image is an image in a sequence of images taken by a camera. The image sequence includes a representative image. The image sequence includes one or more images acquired by the camera after acquiring the representative image. The image sequence includes one or more images acquired by the camera before acquiring the representative image. The method further includes detecting a first input while displaying the images in the image sequence on the display. The method further includes displaying a user interface for cropping the image sequence to a subset of less than all of the image sequence in response to detecting the first input. The user interface includes an area including a representation of the images in the image sequence, a user-adjustable start crop icon that defines a start image in the subset of the image sequence via a position of the start crop icon in the area including the representation of the images in the image sequence, and a user-adjustable end crop icon that defines an end image in the subset of the image sequence via a position of the end crop icon in the area including the representation of the images in the image sequence. The start crop icon is positioned in a first position automatically selected by the device in the area including the representation of the images in the image sequence. The end crop icon is located in a second position automatically selected by the device in an area including representations of the images in the image sequence. The method further includes detecting a second input while displaying a user interface for cropping the image sequence. In response to detecting the second input, the method further includes cropping the image sequence into a subset of the image sequence according to the current position of the start crop icon and the current position of the end crop icon.

[0017] According to some embodiments, an electronic device includes a display unit configured to display a live preview, a camera unit configured to capture images, and a processing unit connected to the display unit and the camera unit. The processing unit is configured to display the live preview on the display unit while in a first media capture mode for the camera unit. The processing unit is further configured to: while displaying the live preview, detect activation of a shutter button at a first time, and, in response to detecting activation of the shutter button at the first time, group a plurality of images captured by the camera unit in a temporal vicinity of activation of the shutter button at the first time into a first image sequence. The first image sequence includes a plurality of images captured by the camera unit before detecting activation of the shutter button at the first time, a representative image representative of the first image sequence and captured by the camera unit after one or more other images in the first image sequence, and a plurality of images captured by the camera unit after capturing the representative image.

[0018] According to some embodiments, an electronic device includes a display unit configured to display an image, a touch-sensitive surface unit configured to detect a user input, and a processing unit connected to the display unit and the touch-sensitive surface unit. The processing unit is configured to display a representative image on the display unit. The representative image is an image in a sequence of images taken by a camera. The image sequence includes one or more images acquired by the camera after acquiring the representative image. The image sequence includes one or more images acquired by the camera before acquiring the representative image. The processing unit is further configured to detect a first portion of a first input while displaying the representative image on the display unit. In response to detecting the first portion of the first input, the processing unit is further configured to replace the display of the representative image on the display unit with a sequential display of one or more images acquired by the camera after acquiring the representative image. The processing unit is further configured to detect a second portion of the first input after detecting the first portion of the first input. The processing unit is further configured to, in response to detecting the second portion of the first input, sequentially display on the display unit one or more images acquired by the camera before acquiring the representative image, the representative image, and one or more images acquired by the camera after acquiring the representative image.

[0019] According to some embodiments, an electronic device includes a display unit configured to display an image, a touch-sensitive surface unit configured to detect user input, and a processing unit connected to the display unit and the touch-sensitive surface unit. The processing unit is configured to enable display of a representative image on the display unit. The representative image is an image in a sequence of images taken by a camera. The image sequence includes one or more images acquired by the camera after capturing the representative image. The image sequence includes one or more images acquired by the camera before capturing the representative image. The processing unit is further configured to detect a first portion of a first input while enabling display of the representative image on the display unit. In response to detecting the first portion of the first input, the processing unit is further configured to transition from displaying the representative image to displaying each previous image in the image sequence, where each previous image is captured by the camera before capturing the representative image, and after transitioning from displaying the representative image to displaying each previous image, enable displaying, in sequence, starting with each previous image, at least a portion of one or more images captured by the camera before capturing the representative image and at least a portion of one or more images captured by the camera after capturing the representative image.

[0020] According to some embodiments, an electronic device includes a display unit configured to display an image, a touch-sensitive surface unit configured to detect user input, one or more sensor units configured to detect an intensity of contact with the touch-sensitive surface unit, and a processing unit connected to the display unit, the touch-sensitive surface unit, and the one or more sensor units. The processing unit is configured to enable display of a representative image on the display unit. The representative image is an image in a sequence of images taken by a camera. The image sequence includes one or more images acquired by the camera after capturing the representative image. The processing unit is further configured to detect a first input while enabling display of the representative image on the display unit, the first input including detecting that a characteristic intensity of a contact on the touch-sensitive surface unit has increased to a first intensity greater than a first intensity threshold. In response to detecting that the characteristic intensity of the contact has increased, the processing unit is further configured to advance in a first direction through one or more images captured by the camera after capturing the representative image at a rate determined at least in part based on the first intensity. The processing unit is further configured to, after advancing through one or more images acquired by the camera after acquiring the representative image at a rate determined based on the first intensity, detect that the intensity of the contact has decreased to a second intensity less than the first intensity. In response to detecting that the characteristic intensity of the contact has decreased to the second intensity, the processing unit is further configured to continue advancing through one or more images acquired by the camera after acquiring the representative image at a second rate in the first direction in accordance with a determination that the second intensity is above the first intensity threshold. The second rate is determined at least in part based on the second intensity, and the second rate is slower than the first rate. In response to detecting that the characteristic intensity of the contact has decreased to the second intensity, the processing unit is further configured to, in accordance with a determination that the second intensity is below the first intensity threshold, move through one or more images acquired by the camera after acquiring the representative image in a second direction opposite the first direction at a rate determined at least in part based on the second intensity.

[0021] According to some embodiments, an electronic device comprises a display unit configured to display images, a touch-sensitive surface unit configured to detect user input, a memory unit configured to store the images, and a processing unit connected to the display unit, the memory unit, and the touch-sensitive surface unit. The processing unit is configured to store a plurality of image sequences in the memory unit. Each image sequence includes a respective representative image taken by a camera, one or more images acquired by the camera after acquiring the respective representative image, and one or more images acquired by the camera before acquiring the respective representative image. The processing unit is further configured to display, on the display unit, a first representative image for a first image sequence in a movable first area on the display unit. The processing unit is further configured to detect a drag gesture on the touch-sensitive surface unit. The processing unit is further configured, in accordance with determining that the drag gesture is in a first direction on the touch-sensitive surface unit, to replace, in the movable first area, the display of the first representative image for the first image sequence on the display unit with a time-sequential display of at least a portion of one or more images for the first image sequence acquired by the camera after acquiring the first representative image for the first image sequence, and to move the first area in the first direction on the display unit.

[0022] According to some embodiments, an electronic device comprises a display unit configured to display images, a touch-sensitive surface unit configured to detect user input, and a processing unit connected to the display unit and the touch-sensitive surface unit. The processing unit is configured to store a plurality of image sequences, each image sequence including a respective representative image taken by a camera and one or more images captured by the camera prior to capturing the respective representative image. The processing unit is further configured to enable a first representative image for a first image sequence to be displayed in a movable first area on the display unit. The processing unit is configured to detect a gesture on the touch-sensitive surface unit, the gesture including a movement of a contact corresponding to a movement in a first direction on the display unit. The processing unit is configured to: in response to detecting a gesture on the touch-sensitive surface unit, move the first area in a first direction on the display unit; move the movable second area in the first direction on the display unit; and, in accordance with determining that a sequential display criterion is met, enable, while moving the second area in the first direction, at least a portion of one or more images for the second image sequence that were acquired by the camera before acquiring a second representative image for the second image sequence to be displayed in chronological order in the second area.

[0023] According to some embodiments, an electronic device includes a display unit configured to display images, a touch-sensitive surface unit configured to detect user input, a memory unit configured to store images, and a processing unit connected to the display unit, the memory unit, and the touch-sensitive surface unit. The processing unit is configured to store a plurality of image sequences in the memory unit. Each image sequence includes a respective representative image taken by a camera, one or more images acquired by the camera after acquiring the respective representative image, and one or more images acquired by the camera before acquiring the respective representative image. The processing unit is further configured to store a plurality of images different from images in the plurality of image sequences in the memory unit. Each image in the plurality of images is not part of an image sequence in the plurality of image sequences. The processing unit is further configured to display a first image on the display unit. The processing unit is further configured to detect a first input while displaying the first image on the display unit. The processing unit is further configured to perform a first operation in response to detecting the first input, in accordance with a determination that the first image is an image in the first image sequence, including displaying at least some of the images in the first image sequence in addition to the first image on the display unit. The processing unit is further configured to, in accordance with a determination that the first image is an image in the plurality of images that is different from an image in the sequence of the plurality of images, include the first image and perform a second operation that is different from the first operation.

[0024] According to some embodiments, an electronic device includes a display unit configured to display an image, a touch-sensitive surface unit configured to detect user input, and a processing unit connected to the display unit and the touch-sensitive surface unit. The processing unit is configured to enable display of a representative image on the display unit. The representative image is an image in a sequence of images taken by a camera. The image sequence includes one or more images acquired by the camera after capturing the representative image. The image sequence includes one or more images acquired by the camera before capturing the representative image. The processing unit is further configured to detect an input that modifies the representative image while enabling display of the representative image on the display unit. In response to detecting the input that modifies the representative image, the processing unit is configured to: modify the representative image, the one or more images acquired by the camera after capturing the representative image, and the one or more images acquired by the camera before capturing the representative image in accordance with a determination that the device is in a first editing mode; and modify the representative image without modifying the one or more images acquired by the camera after capturing the representative image and without modifying the one or more images acquired by the camera before capturing the representative image in accordance with a determination that the device is in a second editing mode different from the first editing mode.

[0025] According to some embodiments, the electronic device comprises a display unit configured to display an image and a processing unit connected to the display unit. The processing unit is configured to enable display of the representative image on the display unit in a user interface of an application configured to communicate with other electronic devices. The representative image is an image in a sequence of images taken by a camera. The image sequence includes one or more images acquired by the camera after acquiring the representative image. The image sequence includes one or more images acquired by the camera before acquiring the representative image. The processing unit is further configured, while enabling display of the representative image on the display unit, to detect an input corresponding to a request to transmit or select a representative image for transmission from the electronic device to a remote second electronic device using the application. The processing unit is further configured, in response to detecting an input corresponding to a request to send or select a representative image for sending to the second electronic device, to: enable a first set of options for sending at least a portion of the image sequence to the second electronic device in accordance with a determination that the second electronic device is configured to interact with the image sequence as a group; and to enable a second set of options for sending at least a portion of the image sequence to the second electronic device in accordance with a determination that the second electronic device is not configured to interact with the image sequence as a group, the second set of options being different from the first set of options.

[0026] According to some embodiments, an electronic device includes a display unit configured to display images, a camera unit configured to capture images, and a processing unit connected to the display unit and the camera unit. The processing unit is configured to enable displaying a live preview of a scene on the display unit while in a first media capture mode for the camera unit and to perform scene recognition on the scene. The processing unit is further configured to detect a single activation of the shutter button at a first time while enabling displaying the live preview of the scene. In response to detecting the single activation of the shutter button at the first time, the processing unit is further configured to retain a plurality of images captured by the camera unit in a temporal vicinity of the activation of the shutter button at the first time and group the plurality of images into a first image sequence according to a determination that the scene meets action capture criteria based at least in part on the scene recognition performed on the scene. The first image sequence includes a plurality of images acquired by the camera unit prior to detecting activation of the shutter button at the first time, a representative image representative of the first image sequence and acquired by the camera unit after one or more of the other images in the first image sequence, and a plurality of images acquired by the camera unit after acquiring the representative image. The processing unit is further configured to, in response to detecting the single activation of the shutter button at the first time, retain the single image in a temporal vicinity of the activation of the shutter button at the first time according to a determination that the scene does not meet action capture criteria.

[0027] According to some embodiments, an electronic device comprises a display unit configured to display an image, a touch-sensitive surface unit configured to detect user input, and a processing unit connected to the display unit and the camera unit. The processing unit is configured to enable display of the image on the display unit. The image is an image in a sequence of images taken by a camera. The image sequence includes a representative image. The image sequence includes one or more images acquired by the camera after acquiring the representative image. The image sequence includes one or more images acquired by the camera before acquiring the representative image. The processing unit is further configured to detect a first input while enabling display of the images in the image sequence on the display unit. The processing unit is further configured to enable display of a user interface for trimming the image sequence to a subset of less than all of the image sequence in response to detecting the first input. The user interface includes an area including a representation of images in the image sequence, a user-adjustable start crop icon that defines a start image in the subset of the image sequence via a position of the start crop icon in the area including the representation of the images in the image sequence, and a user-adjustable end crop icon that defines an end image in the subset of the image sequence via a position of the end crop icon in the area including the representation of the images in the image sequence. The start crop icon is located at a first position automatically selected by the device in the area including the representation of the images in the image sequence. The end crop icon is located at a second position automatically selected by the device in the area including the representation of the images in the image sequence. The processing unit is further configured to detect a second input while the user interface for cropping the image sequence is displayable. In response to detecting the second input, the processing unit is further configured to crop the image sequence into the subset of the image sequence according to the current position of the start crop icon and the current position of the end crop icon.

[0028] According to some embodiments, an electronic device comprises a display, a touch-sensitive surface, one or more optional sensors for detecting intensity of contact with the touch-sensitive surface, one or more processors, a memory, and one or more programs, the one or more programs being stored in the memory and configured to be executed by the one or more processors, the one or more programs including instructions for performing or causing to perform operations of any of the methods described herein. According to some embodiments, a computer-readable storage medium has stored therein instructions that, when executed by an electronic device comprising a display, a touch-sensitive surface, and one or more optional sensors for detecting intensity of contact with the touch-sensitive surface, cause the device to perform or carry out operations of any of the methods described herein. According to some embodiments, a graphical user interface on an electronic device comprising a display, a touch-sensitive surface, one or more optional sensors for detecting intensity of contact with the touch-sensitive surface, a memory, and one or more processors for executing the one or more programs stored in the memory includes one or more of the elements displayed in any of the methods described herein, and the elements are updated in response to input as described in any of the methods described herein. According to some embodiments, an electronic device comprises a display, a touch-sensitive surface, and one or more optional sensors for detecting the intensity of contact with the touch-sensitive surface, and means for performing or causing to be performed any of the operations of the methods described herein. According to some embodiments, an information processing apparatus for use in an electronic device comprising a display, a touch-sensitive surface, and one or more optional sensors for detecting the intensity of contact with the touch-sensitive surface comprises means for performing or causing to be performed any of the operations of the methods described herein.

[0029] Thus, an electronic device is provided that provides improved methods and interfaces for capturing and interacting with camera-captured or audio-recorded moments, which may complement or replace conventional methods for capturing and interacting with still and video images. [Brief explanation of the drawings]

[0030] For a better understanding of the various described embodiments, please refer to the following detailed description in conjunction with the following drawings, in which like reference numerals refer to corresponding parts throughout:

[0031] [Figure 1A] 1 is a block diagram illustrating a portable multifunction device with a touch-sensitive display in accordance with some embodiments.

[0032] [Figure 1B] FIG. 1 is a block diagram illustrating exemplary components for event processing according to some embodiments.

[0033] [Figure 2] 1 is a diagram of a portable multifunction device with a touch screen in accordance with some embodiments.

[0034] [Figure 3] FIG. 1 is a block diagram of an exemplary multifunction device with a display and a touch-sensitive surface in accordance with some embodiments.

[0035] [Figure 4A] 1 is a diagram of an exemplary user interface for a menu of applications on a portable multifunction device in accordance with some embodiments.

[0036] [Figure 4B]1 is a diagram of an exemplary user interface for a multifunction device with a touch-sensitive surface separate from a display in accordance with some embodiments.

[0037] [Figure 4C] FIG. 1 illustrates an exemplary dynamic intensity threshold, according to some embodiments. [Figure 4D] FIG. 1 illustrates an exemplary dynamic intensity threshold, according to some embodiments. [Figure 4E] FIG. 1 illustrates an exemplary dynamic intensity threshold, according to some embodiments.

[0038] [Figure 5A] FIG. 1 illustrates an exemplary user interface for capturing a grouped related image sequence according to some embodiments. [Figure 5B] FIG. 1 illustrates an exemplary user interface for capturing a grouped related image sequence according to some embodiments. [Figure 5C] FIG. 1 illustrates an exemplary user interface for capturing a grouped related image sequence according to some embodiments. [Figure 5D] FIG. 1 illustrates an exemplary user interface for capturing a grouped related image sequence according to some embodiments. [Figure 5E] FIG. 1 illustrates an exemplary user interface for capturing a grouped related image sequence according to some embodiments. [Figure 5F] FIG. 1 illustrates an exemplary user interface for capturing a grouped related image sequence according to some embodiments. [Figure 5G] FIG. 1 illustrates an exemplary user interface for capturing a grouped related image sequence according to some embodiments. [Figure 5H]FIG. 1 illustrates an exemplary user interface for capturing a grouped related image sequence according to some embodiments. [Figure 5I] FIG. 1 illustrates an exemplary user interface for capturing a grouped related image sequence according to some embodiments. [Figure 5J] FIG. 1 illustrates an exemplary user interface for capturing a grouped related image sequence according to some embodiments. [Figure 5K] FIG. 1 illustrates an exemplary user interface for capturing a grouped related image sequence according to some embodiments.

[0039] [Figure 6A] FIG. 1 illustrates an exemplary user interface for viewing (or playing) a grouped sequence of related images according to some embodiments. [Figure 6B] FIG. 1 illustrates an exemplary user interface for viewing (or playing) a grouped sequence of related images according to some embodiments. [Figure 6C] FIG. 1 illustrates an exemplary user interface for viewing (or playing) a grouped sequence of related images according to some embodiments. [Figure 6D] FIG. 1 illustrates an exemplary user interface for viewing (or playing) a grouped sequence of related images according to some embodiments. [Figure 6E] FIG. 1 illustrates an exemplary user interface for viewing (or playing) a grouped sequence of related images according to some embodiments. [Figure 6F] FIG. 1 illustrates an exemplary user interface for viewing (or playing) a grouped sequence of related images according to some embodiments. [Figure 6G] FIG. 1 illustrates an exemplary user interface for viewing (or playing) a grouped sequence of related images according to some embodiments. [Figure 6H] FIG. 1 illustrates an exemplary user interface for viewing (or playing) a grouped sequence of related images according to some embodiments. [Figure 6I] FIG. 1 illustrates an exemplary user interface for viewing (or playing) a grouped sequence of related images according to some embodiments. [Figure 6J] FIG. 1 illustrates an exemplary user interface for viewing (or playing) a grouped sequence of related images according to some embodiments. [Figure 6K] FIG. 1 illustrates an exemplary user interface for viewing (or playing) a grouped sequence of related images according to some embodiments. [Figure 6L] FIG. 1 illustrates an exemplary user interface for viewing (or playing) a grouped sequence of related images according to some embodiments. [Figure 6M] FIG. 1 illustrates an exemplary user interface for viewing (or playing) a grouped sequence of related images according to some embodiments. [Figure 6N] FIG. 1 illustrates an exemplary user interface for viewing (or playing) a grouped sequence of related images according to some embodiments. [Figure 6O] FIG. 1 illustrates an exemplary user interface for viewing (or playing) a grouped sequence of related images according to some embodiments. [Figure 6P] FIG. 1 illustrates an exemplary user interface for viewing (or playing) a grouped sequence of related images according to some embodiments. [Figure 6Q] FIG. 1 illustrates an exemplary user interface for viewing (or playing) a grouped sequence of related images according to some embodiments. [Figure 6R] FIG. 1 illustrates an exemplary user interface for viewing (or playing) a grouped sequence of related images according to some embodiments. [Figure 6S] FIG. 1 illustrates an exemplary user interface for viewing (or playing) a grouped sequence of related images according to some embodiments. [Figure 6T] FIG. 1 illustrates an exemplary user interface for viewing (or playing) a grouped sequence of related images according to some embodiments. [Figure 6U] FIG. 1 illustrates an exemplary user interface for viewing (or playing) a grouped sequence of related images according to some embodiments. [Figure 6V] FIG. 1 illustrates an exemplary user interface for viewing (or playing) a grouped sequence of related images according to some embodiments. [Figure 6W] FIG. 1 illustrates an exemplary user interface for viewing (or playing) a grouped sequence of related images according to some embodiments. [Figure 6X] FIG. 1 illustrates an exemplary user interface for viewing (or playing) a grouped sequence of related images according to some embodiments. [Figure 6Y] FIG. 1 illustrates an exemplary user interface for viewing (or playing) a grouped sequence of related images according to some embodiments. [Figure 6Z] FIG. 1 illustrates an exemplary user interface for viewing (or playing) a grouped sequence of related images according to some embodiments. [Figure 6AA] FIG. 1 illustrates an exemplary user interface for viewing (or playing) a grouped sequence of related images according to some embodiments. [Figure 6BB] FIG. 1 illustrates an exemplary user interface for viewing (or playing) a grouped sequence of related images according to some embodiments. [Figure 6CC] FIG. 1 illustrates an exemplary user interface for viewing (or playing) a grouped sequence of related images according to some embodiments. [Figure 6DD]FIG. 1 illustrates an exemplary user interface for viewing (or playing) a grouped sequence of related images according to some embodiments. [Figure 6EE] FIG. 1 illustrates an exemplary user interface for viewing (or playing) a grouped sequence of related images according to some embodiments. [Figure 6FF] FIG. 1 illustrates an exemplary user interface for viewing (or playing) a grouped sequence of related images according to some embodiments.

[0040] [Figure 7A] FIG. 1 illustrates an exemplary user interface for navigating between related image sequences according to some embodiments. [Figure 7B] FIG. 1 illustrates an exemplary user interface for navigating between related image sequences according to some embodiments. [Figure 7C] FIG. 1 illustrates an exemplary user interface for navigating between related image sequences according to some embodiments. [Figure 7D] FIG. 1 illustrates an exemplary user interface for navigating between related image sequences according to some embodiments. [Figure 7E] FIG. 1 illustrates an exemplary user interface for navigating between related image sequences according to some embodiments. [Figure 7F] FIG. 1 illustrates an exemplary user interface for navigating between related image sequences according to some embodiments. [Figure 7G] FIG. 1 illustrates an exemplary user interface for navigating between related image sequences according to some embodiments. [Figure 7H] FIG. 1 illustrates an exemplary user interface for navigating between related image sequences according to some embodiments. [Figure 7I]FIG. 1 illustrates an exemplary user interface for navigating between related image sequences according to some embodiments. [Figure 7J] FIG. 1 illustrates an exemplary user interface for navigating between related image sequences according to some embodiments. [Figure 7K] FIG. 1 illustrates an exemplary user interface for navigating between related image sequences according to some embodiments. [Figure 7L] FIG. 1 illustrates an exemplary user interface for navigating between related image sequences according to some embodiments. [Figure 7M] FIG. 1 illustrates an exemplary user interface for navigating between related image sequences according to some embodiments. [Figure 7N] FIG. 1 illustrates an exemplary user interface for navigating between related image sequences according to some embodiments. [Figure 7O] FIG. 1 illustrates an exemplary user interface for navigating between related image sequences according to some embodiments. [Figure 7P] FIG. 1 illustrates an exemplary user interface for navigating between related image sequences according to some embodiments. [Figure 7Q] FIG. 1 illustrates an exemplary user interface for navigating between related image sequences according to some embodiments. [Figure 7R] FIG. 1 illustrates an exemplary user interface for navigating between related image sequences according to some embodiments. [Figure 7S] FIG. 1 illustrates an exemplary user interface for navigating between related image sequences according to some embodiments. [Figure 7T] FIG. 1 illustrates an exemplary user interface for navigating between related image sequences according to some embodiments. [Figure 7U]FIG. 1 illustrates an exemplary user interface for navigating between related image sequences according to some embodiments. [Figure 7V] FIG. 1 illustrates an exemplary user interface for navigating between related image sequences according to some embodiments. [Figure 7W] FIG. 1 illustrates an exemplary user interface for navigating between related image sequences according to some embodiments. [Figure 7X] FIG. 1 illustrates an exemplary user interface for navigating between related image sequences according to some embodiments. [Figure 7Y] FIG. 1 illustrates an exemplary user interface for navigating between related image sequences according to some embodiments. [Figure 7Z] FIG. 1 illustrates an exemplary user interface for navigating between related image sequences according to some embodiments. [Figure 7AA] FIG. 1 illustrates an exemplary user interface for navigating between related image sequences according to some embodiments. [Figure 7BB] FIG. 1 illustrates an exemplary user interface for navigating between related image sequences according to some embodiments. [Figure 7CC] FIG. 1 illustrates an exemplary user interface for navigating between related image sequences according to some embodiments.

[0041] [Figure 8A] 10A-10C illustrate exemplary user interfaces for performing different actions on related image sequences than on individual images according to some embodiments; [Figure 8B] 10A-10C illustrate exemplary user interfaces for performing different actions on related image sequences than on individual images according to some embodiments; [Figure 8C] 10A-10C illustrate exemplary user interfaces for performing different actions on related image sequences than on individual images according to some embodiments; [Figure 8D] 10A-10C illustrate exemplary user interfaces for performing different actions on related image sequences than on individual images according to some embodiments; [Figure 8E] 10A-10C illustrate exemplary user interfaces for performing different actions on related image sequences than on individual images according to some embodiments; [Figure 8F] 10A-10C illustrate exemplary user interfaces for performing different actions on related image sequences than on individual images according to some embodiments; [Figure 8G] 10A-10C illustrate exemplary user interfaces for performing different actions on related image sequences than on individual images according to some embodiments; [Figure 8H] 10A-10C illustrate exemplary user interfaces for performing different actions on related image sequences than on individual images according to some embodiments; [Figure 8I] 10A-10C illustrate exemplary user interfaces for performing different actions on related image sequences than on individual images according to some embodiments; [Figure 8J] 10A-10C illustrate exemplary user interfaces for performing different actions on related image sequences than on individual images according to some embodiments; [Figure 8K] 10A-10C illustrate exemplary user interfaces for performing different actions on related image sequences than on individual images according to some embodiments; [Figure 8L] 10A-10C illustrate exemplary user interfaces for performing different actions on related image sequences than on individual images according to some embodiments;

[0042] [Figure 9A] 1 is a flow diagram illustrating a method for capturing a grouped sequence of related images according to some embodiments; [Figure 9B] 1 is a flow diagram illustrating a method for capturing a grouped sequence of related images according to some embodiments; [Figure 9C]1 is a flow diagram illustrating a method for capturing a grouped sequence of related images according to some embodiments; [Figure 9D] 1 is a flow diagram illustrating a method for capturing a grouped sequence of related images according to some embodiments; [Figure 9E] 1 is a flow diagram illustrating a method for capturing a grouped sequence of related images according to some embodiments; [Figure 9F] 1 is a flow diagram illustrating a method for capturing a grouped sequence of related images according to some embodiments; [Figure 9G] 1 is a flow diagram illustrating a method for capturing a grouped sequence of related images according to some embodiments;

[0043] [Figure 10A] 1 is a flow diagram illustrating a method for displaying (or playing back) a related image sequence according to some embodiments. [Figure 10B] 1 is a flow diagram illustrating a method for displaying (or playing back) a related image sequence according to some embodiments. [Figure 10C] 1 is a flow diagram illustrating a method for displaying (or playing back) a related image sequence according to some embodiments. [Figure 10D] 1 is a flow diagram illustrating a method for displaying (or playing back) a related image sequence according to some embodiments. [Figure 10E] 1 is a flow diagram illustrating a method for displaying (or playing back) a related image sequence according to some embodiments.

[0044] [Figure 10F] 1 is a flow diagram illustrating a method for displaying (or playing back) a related image sequence according to some embodiments. [Figure 10G] 1 is a flow diagram illustrating a method for displaying (or playing back) a related image sequence according to some embodiments. [Figure 10H] 1 is a flow diagram illustrating a method for displaying (or playing back) a related image sequence according to some embodiments. [Figure 10I]1 is a flow diagram illustrating a method for displaying (or playing back) a related image sequence according to some embodiments.

[0045] [Figure 10J] 1 is a flow diagram illustrating a method for displaying (or playing back) a related image sequence according to some embodiments. [Figure 10K] 1 is a flow diagram illustrating a method for displaying (or playing back) a related image sequence according to some embodiments. [Figure 10L] 1 is a flow diagram illustrating a method for displaying (or playing back) a related image sequence according to some embodiments. [Figure 10M] 1 is a flow diagram illustrating a method for displaying (or playing back) a related image sequence according to some embodiments.

[0046] [Figure 11A] 1 is a flow diagram illustrating a method for navigating between related image sequences according to some embodiments; [Figure 11B] 1 is a flow diagram illustrating a method for navigating between related image sequences according to some embodiments; [Figure 11C] 1 is a flow diagram illustrating a method for navigating between related image sequences according to some embodiments; [Figure 11D] 1 is a flow diagram illustrating a method for navigating between related image sequences according to some embodiments; [Figure 11E] 1 is a flow diagram illustrating a method for navigating between related image sequences according to some embodiments;

[0047] [Figure 11F] 1 is a flow diagram illustrating a method for navigating between related image sequences according to some embodiments; [Figure 11G] 1 is a flow diagram illustrating a method for navigating between related image sequences according to some embodiments; [Figure 11H] 1 is a flow diagram illustrating a method for navigating between related image sequences according to some embodiments; [Figure 11I]1 is a flow diagram illustrating a method for navigating between related image sequences according to some embodiments;

[0048] [Figure 12A] 1 is a flow diagram illustrating a method for performing different operations on a sequence of related images than on individual images, according to some embodiments; [Figure 12B] 1 is a flow diagram illustrating a method for performing different operations on a sequence of related images than on individual images, according to some embodiments;

[0049] [Figure 13] FIG. 1 is a functional block diagram of an electronic device according to some embodiments. [Figure 14] FIG. 1 is a functional block diagram of an electronic device according to some embodiments. [Figure 15] FIG. 1 is a functional block diagram of an electronic device according to some embodiments. [Figure 16] FIG. 1 is a functional block diagram of an electronic device according to some embodiments. [Figure 17] FIG. 1 is a functional block diagram of an electronic device according to some embodiments. [Figure 18] FIG. 1 is a functional block diagram of an electronic device according to some embodiments. [Figure 19] FIG. 1 is a functional block diagram of an electronic device according to some embodiments.

[0050] [Figure 20A] FIG. 10 illustrates an exemplary user interface for modifying images in an image sequence according to some embodiments. [Figure 20B] FIG. 10 illustrates an exemplary user interface for modifying images in an image sequence according to some embodiments. [Figure 20C] FIG. 10 illustrates an exemplary user interface for modifying images in an image sequence according to some embodiments. [Figure 20D]FIG. 10 illustrates an exemplary user interface for modifying images in an image sequence according to some embodiments. [Figure 20E] FIG. 10 illustrates an exemplary user interface for modifying images in an image sequence according to some embodiments. [Figure 20F] FIG. 10 illustrates an exemplary user interface for modifying images in an image sequence according to some embodiments. [Figure 20G] FIG. 10 illustrates an exemplary user interface for modifying images in an image sequence according to some embodiments. [Figure 20H] FIG. 10 illustrates an exemplary user interface for modifying images in an image sequence according to some embodiments. [Figure 20I] FIG. 10 illustrates an exemplary user interface for modifying images in an image sequence according to some embodiments. [Figure 20J] FIG. 10 illustrates an exemplary user interface for modifying images in an image sequence according to some embodiments. [Figure 20K] FIG. 10 illustrates an exemplary user interface for modifying images in an image sequence according to some embodiments. [Figure 20L] FIG. 10 illustrates an exemplary user interface for modifying images in an image sequence according to some embodiments.

[0051] [Figure 21A] FIG. 10 illustrates an exemplary user interface for sending an image from an image sequence to a second electronic device according to some embodiments. [Figure 21B] FIG. 10 illustrates an exemplary user interface for sending an image from an image sequence to a second electronic device according to some embodiments. [Figure 21C] FIG. 10 illustrates an exemplary user interface for sending an image from an image sequence to a second electronic device according to some embodiments. [Figure 21D] FIG. 10 illustrates an exemplary user interface for sending an image from an image sequence to a second electronic device according to some embodiments. [Figure 21E] FIG. 10 illustrates an exemplary user interface for sending an image from an image sequence to a second electronic device according to some embodiments. [Figure 21F] FIG. 10 illustrates an exemplary user interface for sending an image from an image sequence to a second electronic device according to some embodiments. [Figure 21G] FIG. 10 illustrates an exemplary user interface for sending an image from an image sequence to a second electronic device according to some embodiments. [Figure 21H] FIG. 10 illustrates an exemplary user interface for sending an image from an image sequence to a second electronic device according to some embodiments. [Figure 21I] FIG. 10 illustrates an exemplary user interface for sending an image from an image sequence to a second electronic device according to some embodiments. [Figure 21J] FIG. 10 illustrates an exemplary user interface for sending an image from an image sequence to a second electronic device according to some embodiments.

[0052] [Figure 22A] FIG. 1 illustrates an exemplary user interface for capturing a photo (e.g., an augmented photo or a still photo) using scene recognition according to some embodiments. [Figure 22B] FIG. 1 illustrates an exemplary user interface for capturing a photo (e.g., an augmented photo or a still photo) using scene recognition according to some embodiments. [Figure 22C] FIG. 1 illustrates an exemplary user interface for capturing a photo (e.g., an augmented photo or a still photo) using scene recognition according to some embodiments. [Figure 22D]FIG. 1 illustrates an exemplary user interface for capturing a photo (e.g., an augmented photo or a still photo) using scene recognition according to some embodiments.

[0053] [Figure 23A] FIG. 1 illustrates an exemplary user interface for cropping an image sequence (eg, an augmented photo) according to some embodiments. [Figure 23B] FIG. 1 illustrates an exemplary user interface for cropping an image sequence (eg, an augmented photo) according to some embodiments. [Figure 23C] FIG. 1 illustrates an exemplary user interface for cropping an image sequence (eg, an augmented photo) according to some embodiments. [Figure 23D] FIG. 1 illustrates an exemplary user interface for cropping an image sequence (eg, an augmented photo) according to some embodiments. [Figure 23E] FIG. 1 illustrates an exemplary user interface for cropping an image sequence (eg, an augmented photo) according to some embodiments.

[0054] [Figure 24A] 1 is a flow diagram of a method for modifying images in an image sequence according to some embodiments; [Figure 24B] 1 is a flow diagram of a method for modifying images in an image sequence according to some embodiments; [Figure 24C] 1 is a flow diagram of a method for modifying images in an image sequence according to some embodiments; [Figure 24D] 1 is a flow diagram of a method for modifying images in an image sequence according to some embodiments; [Figure 24E] 1 is a flow diagram of a method for modifying images in an image sequence according to some embodiments;

[0055] [Figure 25A]1 is a flow diagram of a method for transmitting images from an image sequence to a second electronic device according to some embodiments. [Figure 25B] 1 is a flow diagram of a method for transmitting images from an image sequence to a second electronic device according to some embodiments. [Figure 25C] 1 is a flow diagram of a method for transmitting images from an image sequence to a second electronic device according to some embodiments.

[0056] [Figure 26A] 1 is a flow diagram of a method for capturing a photograph (e.g., an augmented photograph or a still photograph) using scene recognition according to some embodiments. [Figure 26B] 1 is a flow diagram of a method for capturing a photograph (e.g., an augmented photograph or a still photograph) using scene recognition according to some embodiments. [Figure 26C] 1 is a flow diagram of a method for capturing a photograph (e.g., an augmented photograph or a still photograph) using scene recognition according to some embodiments. [Figure 26D] 1 is a flow diagram of a method for capturing a photograph (e.g., an augmented photograph or a still photograph) using scene recognition according to some embodiments.

[0057] [Figure 27A] 1 is a flow diagram of a method for cropping an image sequence (eg, an augmented photograph) according to some embodiments. [Figure 27B] 1 is a flow diagram of a method for cropping an image sequence (eg, an augmented photograph) according to some embodiments. [Figure 27C] 1 is a flow diagram of a method for cropping an image sequence (eg, an augmented photograph) according to some embodiments. [Figure 27D] 1 is a flow diagram of a method for cropping an image sequence (eg, an augmented photograph) according to some embodiments. [Figure 27E] 1 is a flow diagram of a method for cropping an image sequence (eg, an augmented photograph) according to some embodiments.

[0058] [Figure 28] FIG. 1 is a functional block diagram of an electronic device according to some embodiments. [Figure 29] FIG. 1 is a functional block diagram of an electronic device according to some embodiments. [Figure 30] FIG. 1 is a functional block diagram of an electronic device according to some embodiments. [Figure 31] FIG. 1 is a functional block diagram of an electronic device according to some embodiments. DETAILED DESCRIPTION OF THE INVENTION

[0059] As mentioned above, portable electronic devices typically capture two types of digital content: still images and video. A still image is typically captured by simply pressing a shutter button. A still image captures a single moment without blur, but the details of the moments before and after that moment are lost. Video captures a long period of time and may contain both interesting and less interesting moments. It typically requires significant editing to remove the less interesting moments.

[0060] DETAILED DESCRIPTION OF THE INVENTION New and improved devices and methods for capturing and interacting with moments are described herein.

[0061] In some embodiments, in response to pressing the shutter button, the device groups together an image sequence that includes a representative image (similar to the moment captured in a traditional still image) and images acquired before and after the shutter button was pressed. In this way, pressing the shutter button captures not just a moment, but moments surrounding that moment. In some embodiments, additional information about the moment, such as audio and metadata, is also captured. From a user's perspective, this process makes capturing a moment (a grouped image sequence with a representative image) as simple as capturing a moment (a single still image). The user simply presses the shutter button. For simplicity, the term "augmented photograph" may be used to refer to a grouped image sequence to distinguish it from a single still image.

[0062] In some embodiments, while viewing the representative image, the augmented photograph may "come to life" in response to user input (e.g., a long press or deep press gesture on the augmented photograph) and replay that moment.

[0063] In some embodiments, while navigating between augmented photographs, for each augmented photograph, an image taken just before the representative image of the augmented photograph is shown as the augmented photograph comes into view on the display, and / or an image taken just after the representative image is shown as the augmented photograph leaves the display, thereby providing an augmented view of the moment.

[0064] In some embodiments, while navigating between augmented photographs and traditional still images, augmented photographs are "played" as they come into view and / or leave the display, while for traditional still images, additional information (e.g., location data) and / or animation within the still image is shown when the still image is displayed.

[0065] In some embodiments, the user can modify the representative image in the augmented photograph and have the modifications applied to just the representative image in the augmented photograph or to all of the images in the augmented photograph (e.g., the user can switch between apply to all mode and still image editing mode).

[0066] In some embodiments, when each user sends an augmented photo to another user, each user's device presents different options for sending the augmented photo depending on whether the other user's device supports augmented photos (e.g., if the other user's device supports augmented photos, the option to send the augmented photo as an augmented photo is presented; if the other user's device does not support augmented photos, the option to send only a representative image is presented).

[0067] In some embodiments, the device performs scene recognition (e.g., while in image capture mode). If the scene lends itself to holding an augmented photograph (e.g., the scene includes movement or faces), in response to a shutter button press, the device holds an augmented photograph. If the scene does not lend itself to holding an augmented photograph (e.g., the scene is a photo of a receipt), in response to a shutter button press, the device holds a single still image.

[0068] In some embodiments, a user can trim an image sequence to a subset of the image sequence. The device provides handles for trimming the sequence to an automatically selected position in the sequence (e.g., based on scene recognition). The handles can also be used to manually trim the sequence.

[0069] The following Figures 1A-1B, 2, and 3 provide descriptions of exemplary devices. Figures 4A-4B, 5A-5K, 6A-6FF, 7A-7CC, 8A-8L, 20A-20L, 21A-21J, 22A-22D, and 23A-23E illustrate exemplary user interfaces for capturing, navigating, and performing actions on or associated with related image sequences. Figures 9A-9G are flow diagrams illustrating a method of capturing related image sequences, according to some embodiments. Figures 10A-10M are flow diagrams illustrating a method of displaying (or playing back) related image sequences, according to some embodiments. Figures 11A-11I are flow diagrams illustrating a method of navigating through photos comprising a related image sequence, according to some embodiments. Figures 12A-12B are flow diagrams illustrating a method of performing different actions on photos comprising a related image sequence than on still photos, according to some embodiments. Figures 24A-24E are flow diagrams of a method for modifying images in an image sequence, according to some embodiments. Figures 25A-25C are flow diagrams of a method for transmitting images from an image sequence to a second electronic device, according to some embodiments. Figures 26A-26D are flow diagrams of a method for capturing a photo (e.g., an augmented photo or a still photo) using scene recognition, according to some embodiments. Figures 27A-27E are flow diagrams of a method for cropping an image sequence (e.g., an augmented photo), according to some embodiments. The user interfaces in Figures 5A-5K, 6A-6FF, 7A-7CC, 8A-8L, 20A-20L, 21A-21J, 22A-22D and 23A-23E are used to illustrate the processes in Figures 9A-9G, 10A-10M, 11A-11I, 12A-12B, 24A-24E, 25A-25C, 26A-26D and 27A-27E.

[0070] Exemplary Devices Reference will now be made in detail to the embodiments, examples of which are illustrated in the accompanying drawings. In the following detailed description, numerous specific details are set forth in order to provide a thorough understanding of the various embodiments being described. However, it will be apparent to those skilled in the art that the various embodiments being described may be practiced without these specific details. In other instances, well-known methods, procedures, components, circuits, and networks have not been described in detail as not to unnecessarily obscure aspects of the embodiments.

[0071] In this specification, terms such as "first," "second," etc. are used to describe various elements in some examples, but it will be understood that these elements should not be limited by these terms. These terms are used only to distinguish one element from another. For example, a first contact can be referred to as a second contact, and similarly, a second contact can be referred to as a first contact, without departing from the scope of the various embodiments being described. Although a first contact and a second contact are both contacts, they are not the same contact unless the context clearly dictates otherwise.

[0072] The terminology used in the description of the various embodiments set forth herein is for the purpose of describing particular embodiments only and is not intended to be limiting. When used in the description of the various embodiments set forth and in the appended claims, the singular forms "a," "an," and "the" are intended to include the plural forms as well, unless the context clearly dictates otherwise. As used herein, it should also be understood that the term "and / or" refers to and includes any and all possible combinations of one or more of the associated listed items. It should further be understood that the terms "includes," "including," "comprises," and / or "comprising," as used herein, specify the presence of stated features, integers, steps, operations, elements, and / or components, but do not exclude the presence or addition of one or more other features, integers, steps, operations, elements, components, and / or groups thereof.

[0073] As used herein, the term "if" is optionally interpreted to mean "when," "upon," "in response to determining," or "in response to detecting," depending on the context. Similarly, the phrases "if it is determined" or "if (a stated condition or event) is detected" are optionally interpreted to mean "upon determining," or "in response to determining," or "upon detecting (the stated condition or event)," or "in response to detecting (the stated condition or event)," depending on the context.

[0074] Embodiments of electronic devices, user interfaces for such devices, and associated processes for using such devices are described. In some embodiments, the device is a portable communication device, such as a mobile telephone, that also includes other functions, such as PDA functionality and / or music playback functionality. Exemplary embodiments of portable multifunction devices include, but are not limited to, the iPhone®, iPod Touch®, and iPad® devices from Apple Inc. (Cupertino, California). Other portable electronic devices, such as laptops or tablet computers with touch-sensitive surfaces (e.g., touchscreen displays and / or touchpads), are also optionally used. It should also be understood that in some embodiments, the device is not a portable communication device, but rather a desktop computer with a touch-sensitive surface (e.g., touchscreen displays and / or touchpads).

[0075] In the following description, we describe an electronic device that includes a display and a touch-sensitive surface, but it should be understood that the electronic device optionally includes one or more other physical user-interface devices, such as a physical keyboard, a mouse, and / or a joystick.

[0076] The device typically supports a variety of applications such as one or more of a transcription application, a drawing application, a presentation application, a word processing application, a website creation application, a disc authoring application, a spreadsheet application, a gaming application, a telephone application, a video conferencing application, an email application, an instant messaging application, a training support application, a photo management application, a digital camera application, a digital video camera application, a web browsing application, a digital music playback application, and / or a digital video playback application.

[0077] Various applications running on the device optionally use at least one common physical user-interface device, such as a touch-sensitive surface. One or more features of the touch-sensitive surface and corresponding information displayed on the device are optionally adjusted and / or changed for each application and / or within the corresponding application. In this way, the common physical architecture (such as the touch-sensitive surface) of the device optionally supports various applications with user interfaces that are intuitive and transparent to the user.

[0078] Attention is now directed to embodiments of portable devices with touch-sensitive displays. FIG. 1A is a block diagram illustrating portable multifunction device 100 with touch-sensitive display system 112, according to some embodiments. Touch-sensitive display system 112 may conveniently be referred to as a "touch screen" or simply a touch-sensitive display. Device 100 includes memory 102 (optionally including one or more computer-readable storage media), memory controller 122, one or more processing units (CPUs) 120, peripherals interface 118, RF circuitry 108, audio circuitry 110, speaker 111, microphone 113, input / output (I / O) subsystem 106, other input or control devices 116, and external port 124. Device 100 optionally includes one or more light sensors 164. Device 100 optionally includes one or more intensity sensors 165 for detecting the intensity of a contact on device 100 (e.g., a touch-sensitive surface such as touch-sensitive display system 112 of device 100). Device 100 optionally includes one or more tactile output generators 167 for generating a tactile output on device 100 (e.g., generating a tactile output on a touch-sensitive surface such as touch-sensitive display system 112 of device 100 or touchpad 355 of device 300). These components optionally communicate via one or more communication buses or signal lines 103.

[0079] As used herein and in the claims, the term “tactile output” refers to a physical displacement of a device relative to its previous position, a physical displacement of a component of the device (e.g., a touch-sensitive surface) relative to another component of the device (e.g., a housing), or a displacement of a component relative to the center of mass of the device, that is detected by a user with the user's sense of touch. For example, in a situation where a device or a component of the device is in contact with a touch-sensitive surface of a user (e.g., the fingers, palm, or other part of the user's hand), the tactile output produced by the physical displacement is interpreted by the user as a tactile sensation corresponding to a perceived change in a physical property of the device or a component of the device. For example, movement of a touch-sensitive surface (e.g., a touch-sensitive display or trackpad) is optionally interpreted by the user as a “downclick” or “upclick” of a physical actuator button. In some cases, a user will feel a tactile sensation such as a “downclick” or “upclick” even when there is no movement of a physical actuator button associated with the touch-sensitive surface that is physically pressed (e.g., displaced) by the user's action. As another example, movement of a touch-sensitive surface is optionally interpreted or perceived by a user as "roughness" of the touch-sensitive surface, even when there is no change in the smoothness of the touch-sensitive surface. While such user interpretation of touch depends on the user's personal sensory perception, there are many sensory perceptions of touch that are common to the majority of users. Thus, when a tactile output is described as corresponding to a particular sensory perception of a user (e.g., "upclick," "downclick," "roughness"), unless otherwise specified, the generated tactile output corresponds to a physical displacement of the device, or a component of the device, that produces the described sensory perception for a typical (or average) user.

[0080] It should be understood that device 100 is only one example of a portable multifunction device, and that device 100 optionally has more or fewer components than those shown, optionally combines two or more components, or optionally has a different configuration or arrangement of those components. The various components shown in FIG. 1A are implemented in hardware, software, or a combination of hardware and software, including one or more signal processing circuits and / or application specific integrated circuits.

[0081] Memory 102 optionally includes high-speed random access memory, and optionally also includes non-volatile memory, such as one or more magnetic disk storage devices, flash memory devices, or other non-volatile solid-state memory devices. Access to memory 102 by other components of device 100, such as CPU(s) 120 and peripherals interface 118, is optionally controlled by memory controller 122.

[0082] A peripheral interface 118 can be used to connect input and output peripherals of the device to the CPU(s) 120 and memory 102. The one or more processors 120 operate or execute various software programs and / or instruction sets stored in memory 102 to perform various functions for device 100 and to process data.

[0083] In some embodiments, peripheral interface 118, CPU(s) 120, and memory controller 122 are optionally implemented on a single chip, such as chip 104. In some other embodiments, they are optionally implemented on separate chips.

[0084] RF (radio frequency) circuitry 108 transmits and receives RF signals, also known as electromagnetic signals. RF circuitry 108 converts electrical signals to electromagnetic signals or electromagnetic signals to electrical signals and communicates with communication networks and other communication devices via electromagnetic signals. RF circuitry 108 optionally includes well-known circuitry for performing these functions, including, but not limited to, an antenna system, an RF transceiver, one or more amplifiers, a tuner, one or more oscillators, a digital signal processor, a CODEC chipset, a subscriber identity module (SIM) card, memory, etc. RF circuitry 108 optionally communicates via wireless communication with networks and other devices, such as the Internet, also known as the World Wide Web (WWW), an intranet, and / or a wireless network, such as a cellular telephone network, a wireless local area network (LAN), and / or a metropolitan area network (MAN).The wireless communication optionally uses any of a plurality of communication standards, protocols, and technologies, including Global System for Mobile Communications (GSM), Enhanced Data GSM Environment (EDGE), High Speed ​​Downlink Packet Access (HSDPA), High Speed ​​Uplink Packet Access (HSUPA), Evolution, Data-Only (EV-DO), HSPA, HSPA+, Dual Cell HSPA (DC-HSPA), Long Term Evolution (LTE), Near Field Communication (NFC), Wideband Code Division Multiple Access (W-CDMA), Code Division Multiple Access (CDMA), Time Division Multiple Access (TDMA), Bluetooth®, Wireless Fidelity (Wi-Fi®) (e.g., IEEE 802.11a, IEEE 802.11ac, IEEE 802.11ax, IEEE 802.11b, IEEE 802.11g, and / or IEEE 802.11a. 802.11n), Voice over Internet Protocol (VoIP), Wi-MAX, protocols for email (e.g., Internet Message Access Protocol (IMAP) and / or Post Office Protocol (POP)), instant messaging (e.g., Extensible Messaging and Presence Protocol (XMPP), Session Initiation Protocol for Instant Messaging and Presence Extensions (SIMPLE), Instant Messaging and Presence Service (IMPS)), and / or Short Message Service (SMS), or any other suitable communication protocol, including communication protocols not yet developed as of the filing date of this document.

[0085] Audio circuit 110, speaker 111, and microphone 113 provide an audio interface between a user and device 100. Audio circuit 110 receives audio data from peripherals interface 118, converts the audio data into electrical signals, and transmits the electrical signals to speaker 111. Speaker 111 converts the electrical signals into sound waves audible to humans. Audio circuit 110 also receives electrical signals converted from sound waves by microphone 113. Audio circuit 110 converts the electrical signals into audio data and transmits the audio data to peripherals interface 118 for processing. The audio data is optionally retrieved from and / or transmitted to memory 102 and / or RF circuit 108 by peripherals interface 118. In some embodiments, audio circuit 110 also includes a headset jack (e.g., 212 in FIG. 2 ). The headset jack provides an interface between audio circuitry 110 and a removable audio input / output peripheral, such as an output-only headphone or a headset with both an output (e.g., single or double ear headphones) and an input (e.g., a microphone).

[0086] I / O subsystem 106 connects input / output peripherals on device 100, such as touch-sensitive display system 112 and other input or control devices 116, to peripheral interface 118. I / O subsystem 106 optionally includes display controller 156, light sensor controller 158, intensity sensor controller 159, haptic feedback controller 161, and one or more input controllers 160 for other input or control devices. One or more input controllers 160 receive electrical signals from and send electrical signals to other input or control devices 116. Other input or control devices 116 optionally include physical buttons (e.g., push buttons, rocker buttons, etc.), dials, slider switches, joysticks, click wheels, etc. In some alternative embodiments, input controller(s) 160 are optionally connected to any (or none) of a keyboard, infrared port, USB port, stylus, and / or pointer device such as a mouse. The one or more buttons (e.g., 208 in FIG. 2) optionally include up / down buttons for adjusting the volume of the speaker 111 and / or microphone 113. The one or more buttons optionally include a push button (e.g., 206 in FIG. 2).

[0087] Touch-sensitive display system 112 provides an input and output interface between the device and a user. Display controller 156 receives electrical signals from and / or sends electrical signals to touch-sensitive display system 112. Touch-sensitive display system 112 displays visual output to the user. The visual output optionally includes graphics, text, icons, animation, and any combination thereof (collectively referred to as "graphics"). In some embodiments, some or all of the visual output corresponds to user interface objects. As used herein, the term "affordance" refers to a user-interactive graphic user interface object (e.g., a graphic user interface object configured to respond to input directed at the graphic user interface object). Examples of user-interactive graphic user interface objects include, but are not limited to, a button, a slider, an icon, a selectable menu item, a switch, or other user interface control.

[0088] Touch-sensitive display system 112 has a touch-sensitive surface, sensor, or set of sensors that receive input from a user based on haptic and / or tactile contact. Touch-sensitive display system 112 and display controller 156 (along with any associated modules and / or instruction sets in memory 102) detect contact (and any movement or break in contact) on touch-sensitive display system 112 and translate the detected contact into interaction with user interface objects (e.g., one or more soft keys, icons, web pages, or images) displayed on touch-sensitive display system 112. In one example embodiment, the point of contact between touch-sensitive display system 112 and the user corresponds to the user's finger or stylus.

[0089] Touch-sensitive display system 112 optionally uses LCD (liquid crystal display), LPD (light emitting polymer display), or LED (light emitting diode) technology, although other display technologies are used in other embodiments. Touch-sensitive display system 112 and display controller 156 optionally detect contact and any movement or disruption thereof using any of a number of now known or later developed touch sensing technologies, including, but not limited to, capacitive, resistive, infrared, and surface ultrasonic technologies, as well as other proximity sensor arrays or other elements for determining one or more points of contact with touch-sensitive display system 112. One example embodiment uses projected mutual capacitance sensing technology, such as that found in the iPhone®, iPod Touch®, and iPad® from Apple Inc. (Cupertino, California).

[0090] Touch-sensitive display system 112 optionally has a video resolution greater than 100 dpi. In some embodiments, the touchscreen video resolution exceeds 400 dpi (e.g., 500 dpi, 800 dpi, or higher). A user optionally contacts touch-sensitive display system 112 using any suitable object or accessory, such as a stylus, a finger, or the like. In some embodiments, the user interface is designed to work with finger-based contacts and gestures, which may be less precise than stylus-based input due to the large contact area of ​​a finger on a touchscreen. In some embodiments, the device translates coarse finger-based input into precise pointer / cursor position or commands to perform the user's desired action.

[0091] In some embodiments, in addition to the touchscreen, device 100 optionally includes a touchpad for activating or deactivating certain functions. In some embodiments, the touchpad is a touch-sensitive area of ​​the device that, unlike the touchscreen, does not display visual output. The touchpad is optionally a touch-sensitive surface separate from touch-sensitive display system 112 or an extension of the touch-sensitive surface formed by the touchscreen.

[0092] Device 100 also includes a power system 162 for providing power to the various components. Power system 162 optionally includes a power management system, one or more power sources (e.g., battery, alternating current (AC)), a recharging system, power failure detection circuitry, power converters or inverters, power status indicators (e.g., light emitting diodes (LEDs)), and any other components associated with generating, managing, and distributing electrical power within a portable device.

[0093] Device 100 also optionally includes one or more light sensors 164. FIG. 1A shows a light sensor connected to a light sensor controller 158 in I / O subsystem 106. Light sensor(s) 164 optionally include a charge-coupled device (CCD) or a complementary metal-oxide semiconductor (CMOS) phototransistor. Light sensor(s) 164 receive light from the environment, projected through one or more lenses, and convert the light into data representing an image. In conjunction with imaging module 143 (also referred to as a camera module), light sensor(s) 164 optionally capture still images, augmented photographs, and / or video. In some embodiments, a light sensor is located on the back of device 100, opposite touch-sensitive display system 112 on the front of the device, so that the touchscreen is enabled for use as a viewfinder for still image and / or video capture. In some embodiments, another light sensor is located on the front of the device to capture an image of the user (e.g., for a selfie, for a video conference where the user sees other video conference participants on the touchscreen, etc.).

[0094] Device 100 also optionally includes one or more contact intensity sensors 165. FIG. 1A shows contact intensity sensors connected to intensity sensor controller 159 in I / O subsystem 106. Contact intensity sensor(s) 165 optionally include one or more piezoresistive strain gauges, capacitive force sensors, electric force sensors, piezoelectric force sensors, optical force sensors, capacitive touch-sensitive surfaces, or other intensity sensors (e.g., sensors used to measure the force (or pressure) of a contact on a touch-sensitive surface). Contact intensity sensor(s) 165 receive contact intensity information (e.g., pressure information or a proxy for pressure information) from the environment. In some embodiments, at least one contact intensity sensor is located on or proximate to the touch-sensitive surface (e.g., touch-sensitive display system 112). In some embodiments, at least one contact intensity sensor is located on the back of device 100, opposite touchscreen display system 112, which is located on the front of device 100.

[0095] Device 100 also optionally includes one or more proximity sensors 166. Figure 1A shows proximity sensor 166 connected to peripherals interface 118. Alternatively, proximity sensor 166 is connected to input controller 160 in I / O subsystem 106. In some embodiments, when the multifunction device is placed near the user's ear (e.g., when the user is making a phone call), the proximity sensor is turned off and touch-sensitive display system 112 is disabled.

[0096] Device 100 also optionally includes one or more tactile output generators 167. FIG. 1A shows tactile output generators connected to haptic feedback controller 161 in I / O subsystem 106. Tactile output generator(s) 167 optionally include one or more electroacoustic devices, such as speakers or other audio components, and / or electromechanical devices that convert energy into linear motion, such as motors, solenoids, electroactive polymers, piezoelectric actuators, electrostatic actuators, or other tactile output generating components (e.g., components that convert electrical signals into tactile output on the device). Tactile output generator(s) 167 receive tactile feedback generation instructions from haptic feedback module 133 and generate tactile outputs on device 100 that can be sensed by a user of device 100. In some embodiments, at least one tactile output generator is located on or proximate to a touch-sensitive surface (e.g., touch-sensitive display system 112) and, optionally, generates a tactile output by moving the touch-sensitive surface vertically (e.g., in / out of the surface of device 100) or laterally (e.g., back and forth in the same plane as the surface of device 100). In some embodiments, at least one tactile output generator sensor is located on the back of device 100, opposite touch-sensitive display system 112, which is located on the front of device 100.

[0097] Device 100 also optionally includes one or more accelerometers 168. FIG. 1A shows accelerometer 168 connected to peripherals interface 118. Alternatively, accelerometer 168 is optionally connected to input controller 160 in I / O subsystem 106. In some embodiments, information is displayed on a touchscreen display in portrait or landscape orientation based on analysis of data received from the one or more accelerometers. In addition to accelerometer(s) 168, device 100 optionally includes a magnetometer (not shown) and a GPS (or GLONASS or other global navigation system) receiver (not shown) for obtaining information regarding the location and orientation (e.g., portrait or landscape) of device 100.

[0098] 1A and 3 , memory 102 stores device / global internal state 157. Device / global internal state 157 includes one or more of the following: active application state, which indicates which applications, if any, are currently active; display state, which indicates which applications, views, or other information occupy various regions of touch-sensitive display system 112; sensor state, which includes information obtained from the device's various sensors and other input or control devices 116; and location and / or position information related to the device's location and / or orientation.

[0099] Operating system 126 (e.g., an embedded operating system such as iOS®, Darwin®, RTXC®, LINUX®, UNIX®, OS X®, WINDOWS®, or VxWorks®) includes various software components and / or drivers for controlling and managing common system tasks (e.g., memory management, storage device control, power management, etc.) and facilitating communication between various hardware and software components.

[0100] Communications module 128 facilitates communication with other devices via one or more external ports 124 and includes various software components for processing data received by RF circuitry 108 and / or external port 124. External port 124 (e.g., Universal Serial Bus (USB), FIREWIRE®, etc.) is adapted to connect to other devices directly or indirectly through a network (e.g., the Internet, wireless LAN, etc.). In some embodiments, the external port is a multi-pin (e.g., 30-pin) connector identical to, similar to, and / or compatible with the 30-pin connector used in some iPhone®, iPod Touch®, and iPad® devices from Apple Inc. (Cupertino, California). In some embodiments, the external port is a Lightning® connector identical to, similar to, and / or compatible with the Lightning® connector used in some iPhone®, iPod Touch®, and iPad® devices from Apple Inc. (Cupertino, California).

[0101] Contact / motion module 130 optionally detects contact with touch-sensitive display system 112 (in conjunction with display controller 156) and with other touch-sensitive devices (e.g., a touchpad or physical click wheel). Contact / motion module 130 includes various software components for performing various operations related to detecting contact (e.g., by a finger or stylus), such as determining whether contact has occurred (e.g., detecting a finger down event), determining the intensity of the contact (e.g., the force or pressure of the contact, or a proxy for the force or pressure of the contact), determining whether there is contact movement and tracking of movement across the touch-sensitive surface (e.g., detecting one or more finger drag events), and determining whether the contact has ceased (e.g., detecting a finger up event or an interruption of contact). Contact / motion module 130 receives contact data from the touch-sensitive surface. Determining the movement of a contact point represented by the series of contact data optionally includes determining the speed (magnitude), velocity (magnitude and direction), and / or acceleration (change in magnitude and / or direction) of the contact point. These actions are optionally applied to a single contact (e.g., a single finger contact or a stylus contact) or multiple simultaneous contacts (e.g., "multi-touch" / multiple finger contacts). In some embodiments, contact / motion module 130 and display controller 156 detect contacts on a touchpad.

[0102] Contact / motion module 130 optionally detects gesture input by a user. Different gestures on the touch-sensitive surface have different contact patterns (e.g., different movements, timing, and / or intensity of detected contact). Thus, gestures are optionally detected by detecting particular contact patterns. For example, detecting a finger tap gesture involves detecting a finger down event, followed by detecting a finger up (lift-off) event at the same location (or substantially the same location) as the finger down event (e.g., at the location of an icon). As another example, detecting a finger swipe gesture on the touch-sensitive surface involves detecting a finger down event, followed by detecting one or more finger drag events, followed by detecting a finger up (lift-off) event. Similarly, taps, swipes, drags, and other gestures are optionally detected with respect to a stylus by detecting particular contact patterns with respect to the stylus.

[0103] Graphics module 132 includes various known software components for rendering and displaying graphics on touch-sensitive display system 112 or other display, including components for modifying the visual effects (e.g., brightness, transparency, saturation, contrast, or other visual characteristics) of the displayed graphics. As used herein, the term "graphics" includes any object that can be displayed to a user, including, but not limited to, text, web pages, icons (such as user interface objects including soft keys), digital images, video, animation, etc.

[0104] In some embodiments, graphics module 132 stores data representing the graphics to be used. Each graphic is optionally assigned a corresponding code. Graphics module 132 receives one or more codes specifying the graphics to be displayed, including coordinate data and other graphic characteristic data, as needed, from an application or the like, and then generates screen image data to output to display controller 156.

[0105] The tactile feedback module 133 includes various software components for generating instructions used by the tactile output generator(s) 167 to generate tactile outputs at one or more locations on the device 100 in response to user interaction with the device 100.

[0106] Text input module 134 is optionally a component of graphics module 132 and provides a soft keyboard for entering text in various applications (e.g., contacts 137, email 140, IM 141, browser 147, and any other application requiring text input).

[0107] The GPS module 135 determines the location of the device and provides this information for use in various applications (e.g., to the phone 138 for use in location-based dialing calls, to the camera 143 as photo / video metadata, and to applications that provide location-based services such as a weather widget, a local yellow pages widget, and a maps / navigation widget).

[0108] Application 136 optionally includes the following modules (or sets of instructions), or a subset or superset thereof: • a contacts module 137 (sometimes called an address book or contact list); ●Telephone module 138, ●Videoconferencing module 139, ● an email client module 140; ● Instant messaging (IM) module 141; ●Training support module 142, camera module 143 for still images and / or video footage; ● Image management module 144; ● Browser module 147, ●Calendar module 148, a widget module 149, optionally including one or more of a weather widget 149-1, a stock price widget 149-2, a calculator widget 149-3, an alarm clock widget 149-4, a dictionary widget 149-5, and other widgets obtained by the user, as well as user-created widgets 149-6; a widget creation module 150 for creating user-created widgets 149-6; ● Search module 151, ● A video and music playback module 152, optionally comprising a video playback module and a music playback module; ● Memo module 153, Map module 154, and / or ●Online video module 155.

[0109] Examples of other applications 136 optionally stored in memory 102 include other word processing applications, other image editing applications, drawing applications, presentation applications, JAVA® enabled applications, encryption, digital rights management, voice recognition, and voice duplication.

[0110] In conjunction with touch-sensitive display system 112, display controller 156, contact module 130, graphics module 132, and text input module 134, contact module 137 includes executable instructions (e.g., stored in memory 102 or in application internal state 192 of contact module 137 in memory 370) to manage an address book or contact list, including adding name(s) to the address book, removing name(s) from the address book, associating phone number(s), email address(es), postal address(es), or other information with names, associating images with names, categorizing and sorting names, providing phone numbers and / or email addresses to initiate and / or facilitate communication by telephone 138, video conference 139, email 140, or IM 141, etc.

[0111] Telephone module 138, in conjunction with RF circuitry 108, audio circuitry 110, speaker 111, microphone 113, touch-sensitive display system 112, display controller 156, contact module 130, graphics module 132, and text input module 134, contains executable instructions to enter a series of characters corresponding to a telephone number, access one or more telephone numbers in address book 137, modify an entered telephone number, dial each telephone number, conduct a conversation, and disconnect or hang up when the conversation is completed. As noted above, wireless communication optionally uses any of a number of communication standards, protocols, and technologies.

[0112] In conjunction with RF circuitry 108, audio circuitry 110, speaker 111, microphone 113, touch-sensitive display system 112, display controller 156, light sensor(s) 164, light sensor controller 158, contact module 130, graphics module 132, text input module 134, contact list 137, and telephone module 138, videoconferencing module 139 contains executable instructions for initiating, conducting, and terminating a videoconference between a user and one or more other participants in accordance with the user's instructions.

[0113] In conjunction with RF circuitry 108, touch-sensitive display system 112, display controller 156, contact module 130, graphics module 132, and text input module 134, email client module 140 contains executable instructions for creating, sending, receiving, and managing emails in response to user instructions. In conjunction with image management module 144, email client module 140 makes it very easy to create and send emails with still images or video footage captured by camera module 143.

[0114] In conjunction with RF circuitry 108, touch-sensitive display system 112, display controller 156, contact module 130, graphics module 132, and text input module 134, instant messaging module 141 includes executable instructions for entering text strings corresponding to instant messages, modifying previously entered characters, sending each instant message (e.g., using Short Message Service (SMS) or Multimedia Message Service (MMS) protocols for telephone-based instant messaging, or using XMPP, SIMPLE, Apple Push Notification Service (APNs), or IMPS for Internet-based instant messaging), and receiving and viewing the received instant messages. In some embodiments, the sent and / or received instant messages optionally include graphics, photos (e.g., still images), enhanced photos, audio files, video files, and / or other attachments, as supported by MMS and / or Enhanced Messaging Service (EMS). As used herein, "instant message" refers to both telephone-based messages (e.g., messages sent using SMS or MMS) and Internet-based messages (e.g., messages sent using XMPP, SIMPLE, APNs, or IMPS).

[0115] In conjunction with the RF circuitry 108, the touch-sensitive display system 112, the display controller 156, the contact module 130, the graphics module 132, the text input module 134, the GPS module 135, the map module 154, and the music playback module 146, the training support module 142 includes executable instructions to generate workouts (e.g., with time, distance, and / or calorie burn goals), communicate with training sensors (in the sports device and the smartwatch), receive training sensor data, calibrate sensors used to monitor the workouts, select and play music for the workouts, and display, store, and transmit the workout data.

[0116] Camera module 143, in conjunction with touch-sensitive display system 112, display controller 156, light sensor(s) 164, light sensor controller 158, contact module 130, graphics module 132, and image management module 144, contains executable instructions to capture still images or moving images (including video streams) and store them in memory 102, modify characteristics of the still images or moving images, and / or delete the still images or moving images from memory 102.

[0117] In conjunction with touch-sensitive display system 112, display controller 156, contact module 130, graphics module 132, text input module 134, and camera module 143, image management module 144 includes executable instructions for arranging, modifying (e.g., editing) or otherwise manipulating, labeling, deleting, presenting (e.g., in a digital slide show or album), and storing still images and / or video footage.

[0118] Browser module 147, in conjunction with RF circuitry 108, touch-sensitive display system 112, display system controller 156, contact module 130, graphics module 132, and text input module 134, contains executable instructions for browsing the Internet according to user instructions, including retrieving, linking to, receiving, and displaying web pages or portions thereof, as well as attachments and other files linked to web pages.

[0119] Calendar module 148, in conjunction with RF circuitry 108, touch-sensitive display system 112, display system controller 156, contact module 130, graphics module 132, text input module 134, email client module 140, and browser module 147, includes executable instructions to create, display, modify, and store calendars and data associated with calendars (e.g., calendar entries, to-do lists, etc.) according to user instructions.

[0120] Widget modules 149, in conjunction with RF circuitry 108, touch-sensitive display system 112, display system controller 156, contact module 130, graphics module 132, text input module 134, and browser module 147, are optionally mini-applications downloaded and used by users (e.g., weather widget 149-1, stocks widget 149-2, calculator widget 149-3, alarm clock widget 149-4, and dictionary widget 149-5), or mini-applications created by users (e.g., user-created widget 149-6). In some embodiments, widgets include HTML (HyperText Markup Language) files, CSS (Cascading Style Sheets) files, and JavaScript files. In some embodiments, widgets include XML (Extensible Markup Language) files and JavaScript files (e.g., Yahoo! Widgets).

[0121] In conjunction with RF circuitry 108, touch-sensitive display system 112, display system controller 156, contact module 130, graphics module 132, text input module 134, and browser module 147, widget creation module 150 contains executable instructions for creating widgets (e.g., turning user-specified portions of a web page into widgets).

[0122] Search module 151, in conjunction with touch-sensitive display system 112, display system controller 156, contact module 130, graphics module 132, and text input module 134, contains executable instructions to search memory 102 for text, music, sound, images, video, and / or other files that match one or more search criteria (e.g., one or more user-specified search terms) in accordance with a user's instructions.

[0123] Video and music playback module 152, in conjunction with touch-sensitive display system 112, display system controller 156, contact module 130, graphics module 132, audio circuitry 110, speaker 111, RF circuitry 108, and browser module 147, contains executable instructions that enable a user to download and play pre-recorded music or other sound files stored in one or more file formats, such as MP3 or AAC files, as well as executable instructions to display, present, or otherwise play videos (on touch-sensitive display system 112 or on an external display connected wirelessly or via external port 124). In some embodiments, device 100 optionally includes the functionality of an MP3 player, such as an iPod (a trademark of Apple Inc.).

[0124] In conjunction with touch-sensitive display system 112, display controller 156, contact module 130, graphics module 132, and text input module 134, notes module 153 contains executable instructions for creating and managing notes, to-do lists, and the like according to user instructions.

[0125] Map module 154, in conjunction with RF circuitry 108, touch-sensitive display system 112, display system controller 156, contact module 130, graphics module 132, text input module 134, GPS module 135, and browser module 147, contains executable instructions to receive, display, modify, and store maps and data associated with maps (e.g., driving directions, data about businesses and other points of interest at or near a particular location, and other location-based data) in accordance with user instructions.

[0126] Online video module 155, in conjunction with touch-sensitive display system 112, display system controller 156, contact module 130, graphics module 132, audio circuitry 110, speaker 111, RF circuitry 108, text input module 134, email client module 140, and browser module 147, contains executable instructions that enable a user to access, view, receive (e.g., by streaming and / or downloading), and play (e.g., on touchscreen 112 or wirelessly or on an external display connected via external port 124) online videos in one or more file formats, such as H.264, and send and otherwise manage emails containing links to particular online videos. In some embodiments, instant messaging module 141 is used to send links to particular online videos, rather than email client module 140.

[0127] Each of the above-identified modules and applications corresponds to a set of executable instructions for performing one or more of the functions described above and methods described herein (e.g., computer-implemented methods and other information processing methods described herein). These modules (i.e., sets of instructions) need not be implemented as separate software programs, procedures, or modules; thus, various subsets of these modules are optionally combined or rearranged in various embodiments. In some embodiments, memory 102 optionally stores a subset of the above-identified modules and data structures. Additionally, memory 102 optionally stores additional modules and data structures not described above.

[0128] In some embodiments, device 100 is a device in which operation of a predetermined set of functions on the device is performed exclusively via a touchscreen and / or touchpad. Using the touchscreen and / or touchpad as the primary input control device for operation of device 100 optionally reduces the number of physical input control devices (pushbuttons, dials, etc.) on device 100.

[0129] The predetermined set of functions performed exclusively via the touchscreen and / or touchpad optionally includes navigation between user interfaces. In some embodiments, the touchpad, when touched by a user, navigates device 100 to a main menu, home menu, or root menu from any user interface displayed on device 100. In such embodiments, a "menu button" is implemented using the touchpad. In some other embodiments, the menu button is a physical push button or other physical input control device instead of a touchpad.

[0130] 1B is a block diagram illustrating exemplary components for event processing, according to some embodiments. In some embodiments, memory 102 (FIG. 1A) or 370 (FIG. 3) includes an event sorter 170 (e.g., in operating system 126) and a corresponding application 136-1 (e.g., any of applications 136, 137-155, and 380-390 described above).

[0131] Event sorter 170 receives the event information and determines which application 136-1 and application view 191 of application 136-1 to deliver the event information to. Event sorter 170 includes event monitor 171 and event dispatcher module 174. In some embodiments, application 136-1 includes application internal state 192 that indicates the current application view(s) that are displayed on touch-sensitive display system 112 when the application is active or running. In some embodiments, device / global internal state 157 is used by event sorter 170 to determine which application(s) are currently active, and application internal state 192 is used by event sorter 170 to determine which application(s) are currently active, and application internal state 192 is used by event sorter 170 to determine which application view(s) to deliver the event information to.

[0132] In some embodiments, application internal state 192 includes additional information such as one or more of resume information used when application 136-1 resumes execution, user interface state information indicating information being displayed or ready to be displayed by application 136-1, a state queue to allow the user to return to a previous state or view of application 136-1, and a redo / undo queue of actions previously performed by the user.

[0133] Event monitor 171 receives event information from peripherals interface 118. The event information includes information about sub-events (e.g., a user's touch on touch-sensitive display system 112 as part of a multi-touch gesture). Peripherals interface 118 transmits information it receives from I / O subsystem 106 or sensors such as proximity sensor 166, accelerometer(s) 168, and / or microphone 113 (via audio circuitry 110). The information that peripherals interface 118 receives from I / O subsystem 106 includes information from touch-sensitive display system 112 or a touch-sensitive surface.

[0134] In some embodiments, event monitor 171 sends requests to peripherals interface 118 at predetermined intervals. In response, peripherals interface 118 transmits event information. In other embodiments, peripherals interface 118 transmits event information only when there is a significant event (e.g., receiving an input that exceeds a predetermined noise threshold and / or exceeds a predetermined duration).

[0135] In some embodiments, the event sorter 170 also includes a hit view determination module 172 and / or an active event recognizer determination module 173 .

[0136] Hit view determination module 172 provides software procedures for determining where a sub-event occurred within one or more views when touch-sensitive display system 112 displays more than one view. A view consists of controls and other elements that a user can see on the display.

[0137] Another aspect of a user interface associated with an application is the set of views, sometimes referred to herein as application views or user interface windows, in which information is displayed and touch-based gestures occur. The application view (of each application) in which a touch is detected optionally corresponds to a programmatic level within the application's programmatic or view hierarchy. For example, the lowest-level view in which a touch is detected is optionally referred to as a hit view, and the set of events that are recognized as appropriate inputs is optionally determined based at least in part on the hit view of the initial touch that initiates a touch-based gesture.

[0138] Hit view determination module 172 receives information associated with sub-events of a touch-based gesture. If an application has multiple views organized as a hierarchy, hit view determination module 172 identifies the hit view as the lowest view in the hierarchy that should process the sub-event. In most situations, the hit view is the lowest-level view in which the contributing sub-event occurs (i.e., the first sub-event in the sequence of sub-events that form the event or potential event). Once a hit view is identified by the hit view determination module, the hit view typically receives all sub-events related to the same touch or input source for which it was identified as the hit view.

[0139] Active event recognizer determination module 173 determines which view(s) in the view hierarchy should receive the particular sequence of sub-events. In some embodiments, active event recognizer determination module 173 determines that only the hit view should receive the particular sequence of sub-events. In other embodiments, active event recognizer determination module 173 determines that all views that contain the physical location of the sub-event are actively participating views, and therefore, all actively participating views should receive the particular sequence of sub-events. In other embodiments, even if the touch sub-event is completely confined to the region associated with a particular view, views higher in the hierarchy remain actively participating views.

[0140] Event dispatcher module 174 sends the event information to an event recognizer (e.g., event recognizer 180). In embodiments that include active event recognizer determination module 173, event dispatcher module 174 delivers the event information to the event recognizers determined by active event recognizer determination module 173. In some embodiments, event dispatcher module 174 stores the event information obtained by each event receiver module 182 in an event queue.

[0141] In some embodiments, operating system 126 includes event sorter 170. Alternatively, application 136-1 includes event sorter 170. In still other embodiments, event sorter 170 is a stand-alone module or part of another module stored in memory 102, such as contact / motion module 130.

[0142] In some embodiments, application 136-1 includes multiple event handlers 190 and one or more application views 191, each containing instructions for handling touch events that occur within a respective view of the application's user interface. Each application view 191 of application 136-1 includes one or more event recognizers 180. Typically, each application view 191 includes multiple event recognizers 180. In other embodiments, one or more of the event recognizers 180 are part of a separate module, such as a user interface kit (not shown) or a higher-level object from which application 136-1 inherits methods and other properties. In some embodiments, each event handler 190 includes one or more of a data updater 176, an object updater 177, a GUI updater 178, and / or event data 179 received from event sorter 170. Event handler 190 optionally utilizes or calls data updater 176, object updater 177, or GUI updater 178 to update application internal state 192. Alternatively, one or more of the application views 191 includes one or more corresponding event handlers 190. Also, in some embodiments, one or more of the data updater 176, the object updater 177, and the GUI updater 178 are included in each application view 191.

[0143] Each event recognizer 180 receives event information (e.g., event data 179) from event sorter 170 and identifies an event from the event information. Event recognizer 180 includes an event receiver 182 and an event comparator 184. In some embodiments, event recognizer 180 further includes metadata 183 and at least a subset of event delivery instructions 188 (optionally including sub-event delivery instructions).

[0144] The event receiver 182 receives event information from the event sorter 170. This event information includes information about sub-events, such as information about a touch or a touch movement. Depending on the sub-event, the event information also includes additional information, such as the location of the sub-event. When the sub-event involves a touch movement, the event information also optionally includes the speed and direction of the sub-event. In some embodiments, the event includes a device rotation from one orientation to another (e.g., from portrait to landscape or vice versa), and the event information includes corresponding information about the device's current orientation (also called the device's attitude).

[0145] The event comparator 184 compares the event information with predefined event or sub-event definitions and determines the event or sub-event, or determines or updates the state of the event or sub-event, based on the comparison. In some embodiments, the event comparator 184 includes an event definition 186. The event definition 186 includes a definition of an event (e.g., a predefined sequence of sub-events), such as, for example, Event 1 (187-1), Event 2 (187-2), etc. In some embodiments, sub-events within Event 187 include, for example, touch start, touch end, touch movement, touch cancellation, and multiple touches. In one example, the definition of Event 1 (187-1) is a double tap on a displayed object. The double tap includes, for example, a first touch (touch start) for a predetermined stage on the displayed object, a first lift-off (touch end) for the predetermined stage, a second touch (touch start) for the predetermined stage on the displayed object, and a second lift-off (touch end) for the predetermined stage. In another example, the definition of Event 2 (187-2) is a drag operation on the displayed object. A drag includes, for example, a touch (or contact) to a predetermined stage on a displayed object, a movement of the touch across the touch-sensitive display system 112, and a lift-off of the touch (touch end). In some embodiments, the event also includes information about one or more associated event handlers 190.

[0146] In some embodiments, event definitions 187 include definitions of events for each user interface object. In some embodiments, event comparator 184 performs a hit test to determine the user interface object associated with the sub-event. For example, in an application view in which three user interface objects are displayed on touch-sensitive display system 112, if a touch is detected on touch-sensitive display system 112, event comparator 184 performs a hit test to determine which of the three user interface objects is associated with the touch (sub-event). If each displayed object is associated with a corresponding event handler 190, event comparator 184 uses the results of the hit test to determine which event handler 190 to activate. For example, event comparator 184 selects the event handler associated with the sub-event and the object that triggers the hit test.

[0147] In some embodiments, the definition for each event 187 also includes a delay action that delays delivery of the event information until it is determined whether the sequence of sub-events corresponds to the event recognizer's event type.

[0148] If the respective event recognizer 180 determines that the sequence of sub-events does not match any of the events in the event definition 186, the respective event recognizer 180 enters an event-disabled, event-failed, or event-ended state and thereafter ignores the next sub-event of the touch-based gesture. In this situation, any other event recognizers that remain active for the hit view continue to track and process sub-events of the ongoing touch-based gesture.

[0149] In some embodiments, each event recognizer 180 includes metadata 183 with configurable properties, flags, and / or lists that indicate how the event delivery system performs sub-event delivery to actively participating event recognizers. In some embodiments, metadata 183 includes configurable properties, flags, and / or lists that indicate how event recognizers may or are enabled to interact with each other. In some embodiments, metadata 183 includes configurable properties, flags, and / or lists that indicate whether sub-events are delivered to various levels in the view or programmatic hierarchy.

[0150] In some embodiments, each event recognizer 180 activates an event handler 190 associated with an event when one or more particular sub-events of the event are recognized. In some embodiments, each event recognizer 180 delivers event information associated with the event to the event handler 190. Activating an event handler 190 is distinct from sending (and postponing sending) the sub-events to the corresponding hit view. In some embodiments, the event recognizer 180 throws a flag associated with the recognized event, and the event handler 190 associated with the flag catches the flag and performs a predetermined process.

[0151] In some embodiments, event delivery instructions 188 include sub-event delivery instructions that deliver event information about a sub-event without activating an event handler. Instead, the sub-event delivery instructions deliver the event information to an event handler associated with a set of sub-events or an actively participating view. The event handler associated with the set of sub-events or an actively participating view receives the event information and performs a predetermined process.

[0152] In some embodiments, data updater 176 creates and updates data used by application 136-1. For example, data updater 176 updates phone numbers used by contacts module 137 or stores video files used by video player module 145. In some embodiments, object updater 177 creates and updates objects used by application 136-1. For example, object updater 177 creates new user interface objects or updates the positions of user interface objects. GUI updater 178 updates the GUI. For example, GUI updater 178 creates display information and sends the display information to graphics module 132 for display on the touch-sensitive display.

[0153] In some embodiments, event handler(s) 190 include or have access to data updater 176, object updater 177, and GUI updater 178. In some embodiments, data updater 176, object updater 177, and GUI updater 178 are included in a single module of the respective application 136-1 or application view 191. In other embodiments, they are included in two or more software modules.

[0154] It should be understood that the foregoing description of event processing of a user's touch on a touch-sensitive display also applies to other forms of user input for operating multifunction device 100 using input devices, not all of which are initiated on a touchscreen. For example, mouse movements and mouse button presses, optionally in conjunction with single or multiple keyboard presses or holds, touch movements such as tapping, dragging, scrolling, etc. on a touchpad, pen stylus input, device movement, verbal commands, detected eye movements, biometric input, and / or any combination thereof are optionally utilized as inputs corresponding to sub-events that define the event to be recognized.

[0155] FIG. 2 illustrates portable multifunction device 100 having a touchscreen (e.g., touch-sensitive display system 112 of FIG. 1A ), according to some embodiments. The touchscreen optionally displays one or more graphics within user interface (UI) 200. In this embodiment, as well as other embodiments described below, a user can select one or more of the graphics by making a gesture on the graphics, for example, with one or more fingers 202 (not drawn to scale) or one or more styluses 203 (not drawn to scale). In some embodiments, selection of the one or more graphics occurs when the user breaks contact with the one or more graphics. In some embodiments, the gesture optionally includes one or more taps, one or more swipes (left to right, right to left, upward and / or downward), and / or rolling of a finger in contact with device 100 (right to left, left to right, upward and / or downward). In some implementations or situations, accidental contact with a graphic does not select the graphic, for example, a swipe gesture sweeping over an application icon optionally does not select the corresponding application if the gesture corresponding to selection is a tap.

[0156] Device 100 also optionally includes one or more physical buttons, such as a "home" or menu button 204. As mentioned above, menu button 204 is optionally used for navigation to any application 136 within a set of applications optionally executing on device 100. Alternatively, in some embodiments, the menu button is implemented as a soft key in a GUI displayed on a touchscreen display.

[0157] In some embodiments, device 100 includes a touchscreen display, a menu button 204, a push button 206 for turning power to the device on / off and locking the device, volume control button(s) 208, a subscriber identity module (SIM) card slot 210, a headset jack 212, and a docking / charging external port 124. Push button 206 turns power on / off on the device by pressing and holding the button down for a predetermined time, locks the device by pressing and releasing the button before the predetermined time has elapsed, and / or unlocks the device or initiates the unlocking process. In some embodiments, device 100 also accepts verbal input for activating or deactivating certain functions through microphone 113. Device 100 also optionally includes one or more contact intensity sensors 165 for detecting the intensity of a contact on touch-sensitive display system 112 and / or one or more tactile output generators 167 for generating a tactile output for a user of device 100.

[0158] FIG. 3 is a block diagram of an exemplary multifunction device with a display and a touch-sensitive surface, according to some embodiments. Device 300 need not be portable. In some embodiments, device 300 is a laptop computer, a desktop computer, a tablet computer, a multimedia playback device, a navigation device, an educational device (such as a child's learning toy), a gaming system, or a control device (e.g., a home or commercial controller). Device 300 typically includes one or more processing units (CPUs) 310, one or more network or other communication interfaces 360, memory 370, and one or more communication buses 320 for interconnecting these components. Communication bus 320 optionally includes circuitry (sometimes called a chipset) that interconnects and controls communication between system components. Device 300 includes an input / output (I / O) interface 330 with a display 340, which is typically a touchscreen display. I / O interface 330 also optionally includes a keyboard and / or mouse (or other pointing device) 350 and a touchpad 355, a tactile output generator 357 (e.g., similar to tactile output generator 167 described above with reference to FIG. 1A ) for generating tactile output on device 300, sensors 359 (e.g., optical sensors, acceleration sensors, proximity sensors, touch-sensitive sensors, and / or contact intensity sensors similar to contact intensity sensor 165 described above with reference to FIG. 1A ). Memory 370 includes high-speed random-access memory such as DRAM, SRAM, DDR RAM, or other random-access solid-state memory devices, and optionally includes non-volatile memory such as one or more magnetic disk storage devices, optical disk storage devices, flash memory devices, or other non-volatile solid-state storage devices. Memory 370 optionally includes one or more storage devices located remotely from CPU(s) 310.In some embodiments, memory 370 stores programs, modules, and data structures similar to, or a subset of, the programs, modules, and data structures stored in memory 102 of portable multifunction device 100 (FIG. 1A). Additionally, memory 370 optionally stores additional programs, modules, and data structures not present in memory 102 of portable multifunction device 100. For example, memory 370 of device 300 optionally stores drawing module 380, presentation module 382, ​​word processing module 384, website creation module 386, disk authoring module 388, and / or spreadsheet module 390, while memory 102 of portable multifunction device 100 (FIG. 1A) optionally does not store these modules.

[0159] 3 are optionally stored in one or more of the memory devices mentioned above. Each of the above-identified modules corresponds to an instruction set that performs the functions described above. The above-identified modules or programs (i.e., instruction sets) need not be implemented as separate software programs, procedures, or modules; thus, in various embodiments, various subsets of these modules are optionally combined or otherwise rearranged. In some embodiments, memory 370 optionally stores a subset of the above-identified modules and data structures. Additionally, memory 370 optionally stores additional modules and data structures not described above.

[0160] Attention is now directed to embodiments of a user interface (“UI”) that is optionally implemented on portable multifunction device 100.

[0161] 4A shows an exemplary user interface for a menu of applications on portable multifunction device 100, according to some embodiments. A similar user interface is, optionally, implemented on device 300. In some embodiments, user interface 400 includes the following elements, or a subset or superset thereof: signal strength indicator(s) 402 for wireless communication(s), such as cellular and Wi-Fi signals; ●Time 404, ●Bluetooth indicator 405, ● Battery status indicator 406, A tray 408 containing icons for frequently used applications, such as: an icon 416 for the phone module 138 labeled "Phone," optionally including an indicator 414 of the number of missed calls or voicemail messages; an icon 418 for the email client module 140 labeled "Mail" that optionally includes an indicator 410 of the number of unread emails; ○ An icon 420 for the browser module 147, labeled "Browser", and ○ An icon 422 labeled "iPod" for the video and music playback module 152, also referred to as the iPod (trademark of Apple Inc.) module 152; and ●Icons for other applications, such as: ○ Icon 424 for IM module 141, labeled "Messages"; ○ Icon 426 for the calendar module 148, labeled "Calendar" ○ Icon 428 for the image management module 144, labeled "Photos" ○ An icon 430 for the camera module 143, labeled "camera"; ○ Icon 432 for the online video module 155, labeled "Online Video" Icon 434 for stock widget 149-2, labeled "Stock Prices" ○ Icon 436 for map module 154, labeled "Map" ○ Icon 438 for weather widget 149-1, labeled "Weather" ○ Icon 440 for alarm clock widget 149-4, labeled "Clock" ○ Icon 442 for Training Support Module 142, labeled "Training Support"; ○ An icon 444 for the notes module 153, labeled "Notes," and ○ An icon 446 for a settings application or module that provides access to settings related to the device 100 and its various applications 136.

[0162] 4A are merely exemplary. For example, in some embodiments, icon 422 for video and music player module 152 is labeled "Music" or "Music Player." Other labels are optionally used for various application icons. In some embodiments, the label for each application icon includes the name of the application corresponding to each application icon. In some embodiments, the label for a particular application icon is different from the name of the application corresponding to the particular application icon.

[0163] FIG. 4B shows an example user interface on a device (e.g., device 300 of FIG. 3 ) with touch-sensitive surface 451 (e.g., tablet or touchpad 355 of FIG. 3 ) that is separate from display 450. While many of the following examples are described with reference to input on touchscreen display 112 (where the touch-sensitive surface and display are combined), in some embodiments, the device detects input on a touch-sensitive surface that is separate from the display, as shown in FIG. 4B . In some embodiments, the touch-sensitive surface (e.g., 451 of FIG. 4B ) has a major axis (e.g., 452 of FIG. 4B ) that corresponds to a major axis (e.g., 453 of FIG. 4B ) on the display (e.g., 450). According to these embodiments, the device detects contact with touch-sensitive surface 451 (e.g., 460 and 462 of FIG. 4B ) at locations that correspond to respective locations on the display (e.g., in FIG. 4B , 460 corresponds to 468, and 462 corresponds to 470). In this manner, when the touch-sensitive surface is separate from the display, user input (e.g., contacts 460 and 462, and their movement) detected by the device on the touch-sensitive surface (e.g., 451 in FIG. 4B ) is used by the device to operate a user interface on the display (e.g., 450 in FIG. 4B ) of the multifunction device. It should be understood that similar methods are optionally used for the other user interfaces described herein.

[0164] Furthermore, while the following examples are described primarily with reference to finger input (e.g., finger contacts, finger tap gestures, finger swipe gestures, etc.), it should be understood that in some embodiments, one or more of the finger inputs are replaced with input from another input device (e.g., mouse-based input or stylus input). For example, a swipe gesture is optionally replaced with a mouse click (e.g., instead of a contact), followed by cursor movement along the path of the swipe (e.g., instead of moving the contact). As another example, a tap gesture is optionally replaced with a mouse click while the cursor is positioned over the location of the tap gesture (e.g., instead of detecting a contact and then ceasing contact detection). Similarly, when multiple user inputs are detected simultaneously, it will be understood that multiple computer mice are optionally being used simultaneously, or that a mouse and a finger contact are optionally being used simultaneously.

[0165] As used herein, the term “focus selector” refers to an input element that indicates the current portion of a user interface with which a user is interacting. In some implementations involving a cursor or other location marker, the cursor acts as a “focus selector” when input (e.g., a press input) is detected on a touch-sensitive surface (e.g., touchpad 355 of FIG. 3 or touch-sensitive surface 451 of FIG. 4B ) while the cursor is over a particular user interface element (e.g., a button, window, slider, or other user interface element), and the particular user interface element is adjusted according to the detected input. In some implementations involving a touchscreen display (e.g., touch-sensitive display system 112 of FIG. 1A or the touchscreen of FIG. 4A ) that allows direct interaction with user interface elements on the touchscreen display, contact detected on the touchscreen acts as a “focus selector,” such that when input (e.g., a press input by contact) is detected at the location of a particular user interface element (e.g., a button, window, slider, or other user interface element) on the touchscreen display, the particular user interface element is adjusted according to the detected input. In some implementations, focus is moved from one region of the user interface to another region of the user interface (e.g., by using the tab or arrow keys to move focus from one button to another) without a corresponding cursor movement or movement of contact on the touchscreen display. In these implementations, the focus selector moves to follow the movement of focus between different regions of the user interface. Regardless of the specific form that the focus selector takes, the focus selector is generally a user interface element (or a contact on a touchscreen display) that is controlled by the user to communicate the user's intended interaction with the user interface (e.g., by indicating to the device which element of the user interface the user intends to interact with).For example, location of a focus selector (e.g., cursor, touch, or selection box) over a corresponding button while a press input is detected on a touch-sensitive surface (e.g., a touchpad or touchscreen) indicates that the user intends to activate that corresponding button (and not other user interface elements shown on the device's display).

[0166] As used in this specification and in the claims, the term “intensity” of a contact on a touch-sensitive surface refers to the force or pressure (force per unit area) of a contact (e.g., a finger contact or a stylus contact) on the touch-sensitive surface, or a proxy for the force or pressure of a contact on the touch-sensitive surface. The intensity of a contact has a range of values ​​that includes at least four distinct values ​​and more typically includes hundreds of different values ​​(e.g., at least 256). The intensity of a contact is optionally determined (or measured) using various methods and various sensors or combinations of sensors. For example, one or more force sensors positioned beneath or adjacent to the touch-sensitive surface are optionally used to measure force at various points on the touch-sensitive surface. In some implementations, the force measurements of multiple force sensors are combined (e.g., weighted average or sum) to determine the estimated force of the contact. Similarly, a pressure-sensitive tip of a stylus is optionally used to determine the pressure of the stylus on the touch-sensitive surface. Alternatively, the size and / or change in the contact area detected on the touch-sensitive surface, the capacitance and / or change in the capacitance of the touch-sensitive surface proximate the contact, and / or the resistance and / or change in the capacitance of the touch-sensitive surface proximate the contact are optionally used as a surrogate for the force or pressure of the contact on the touch-sensitive surface. In some implementations, the surrogate measure of the force or pressure of the contact is used directly to determine whether an intensity threshold has been exceeded (e.g., the intensity threshold is stated in units corresponding to the surrogate measure). In some implementations, the surrogate measure of the force or pressure of the contact is converted to an estimated force or pressure, and this estimated force or pressure is used to determine whether an intensity threshold has been exceeded (e.g., the intensity threshold is a pressure threshold measured in units of pressure). Using the intensity of contact as an attribute of user input allows a user to access additional device functionality that may not otherwise be easily accessible by a user in reduced-sized devices with limited area for displaying affordances (e.g., on a touch-sensitive display) and / or receiving user input (e.g., via a touch-sensitive display, touch-sensitive surface, or physical / mechanical controls such as knobs or buttons).

[0167] In some embodiments, contact / motion module 130 uses a set of one or more intensity thresholds for determining whether an action has been performed by a user (e.g., for determining whether a user has “clicked” on an icon). In some embodiments, at least a subset of the intensity thresholds are determined according to software parameters (e.g., the intensity thresholds are not determined by the activation threshold of a particular physical actuator and may be adjusted without modifying the physical hardware of device 100). For example, the mouse “click” threshold of a trackpad or touchscreen display may be set to any of a wide range of pre-defined threshold values ​​without modifying the trackpad or touchscreen display hardware. Furthermore, in some implementations, a user of the device is provided with software settings for adjusting one or more of the set of intensity thresholds (e.g., by adjusting individual intensity thresholds and / or by adjusting multiple intensity thresholds at once via a system-level click “intensity” parameter).

[0168] As used herein and in the claims, the term "characteristic intensity" of a contact refers to a characteristic of that contact based on one or more intensities of the contact. In some embodiments, the characteristic intensity is based on a plurality of intensity samples. The characteristic intensity is optionally based on a predetermined number of intensity samples or a set of intensity samples collected within a predetermined time period (e.g., 0.05, 0.1, 0.2, 0.5, 1, 2, 5, 10 seconds) for a predetermined event (e.g., after detecting the contact, before detecting lift-off of the contact, before or after detecting the start of contact movement, before detecting the end of the contact, before or after detecting an increase in the intensity of the contact, and / or before or after detecting a decrease in the intensity of the contact). The characteristic intensity of the contact is optionally based on one or more of the maximum intensity of the contact, the mean value of the intensity of the contact, the average value of the intensity of the contact, the top 10 percentile of the intensity of the contact, half the maximum intensity of the contact, 90% of the maximum intensity of the contact, etc. In some embodiments, the duration of the contact is used to determine the characteristic intensity (e.g., when the characteristic intensity is an average of the intensity of the contact over time). In some embodiments, the characteristic intensity is compared to a set of one or more intensity thresholds to determine whether an action is performed by the user. For example, the set of one or more intensity thresholds may include a first intensity threshold and a second intensity threshold. In this example, a contact having a characteristic intensity that does not exceed the first threshold results in a first action being performed, a contact having a characteristic intensity that exceeds the first intensity threshold but not the second intensity threshold results in a second action being performed, and a contact having a characteristic intensity that exceeds the second intensity threshold results in a third action being performed. In some embodiments, the comparison between the characteristic intensity and one or more intensity thresholds is not used to determine whether to perform the first or second action, but rather to determine whether to perform one or more actions (e.g., to perform a respective option or to omit performing a respective action).

[0169] In some embodiments, a portion of the gesture is identified for purposes of determining the characteristic intensity. For example, a touch-sensitive surface may receive a continuous swipe contact (e.g., a drag gesture) that transitions from a start position to an end position where the intensity of the contact increases. In this example, the characteristic intensity of the contact at the end position may be based on only a portion of the swipe contact (e.g., only the portion of the swipe contact at the end position) rather than the entire continuous swipe contact. In some embodiments, a smoothing algorithm may be applied to the intensity of the swipe contact before determining the characteristic intensity of the contact. For example, the smoothing algorithm optionally includes one or more of an unweighted moving average smoothing algorithm, a triangular smoothing algorithm, a median filter smoothing algorithm, and / or an exponential smoothing algorithm. In some situations, these smoothing algorithms eliminate small increases or decreases in the intensity of the swipe contact for purposes of determining the characteristic intensity.

[0170] The user interface diagrams described herein optionally include various intensity diagrams that show the current intensity of a contact on the touch-sensitive surface relative to one or more intensity thresholds (e.g., a contact-detection intensity threshold ITO, a light pressure intensity threshold ITL, a deep pressure intensity threshold ITD (e.g., at least initially higher than IL), and / or one or more other intensity thresholds (e.g., an intensity threshold IH that is less than IL)). The intensity diagrams are typically not part of the displayed user interface, but are provided to aid in interpretation of the diagrams. In some embodiments, the light pressure intensity threshold corresponds to an intensity that will cause the device to perform an action typically associated with a physical mouse button or a trackpad click. In some embodiments, the deep pressure intensity threshold corresponds to an intensity that will cause the device to perform an action different from an action typically associated with a physical mouse button or a trackpad click. In some embodiments, if a contact is detected with a characteristic intensity below the light pressure intensity threshold (e.g., and above a slight contact detection intensity threshold IT0 below which the contact is no longer detected), the device moves the focus selector according to the movement of the contact on the touch-sensitive surface without performing any action associated with the light pressure intensity threshold or the deep pressure intensity threshold. Generally, unless otherwise specified, these intensity thresholds are consistent across different sets of user interface diagrams.

[0171] In some embodiments, the device responds to inputs detected by the device according to criteria based on the intensity of contact during the input. For example, for some "light press" inputs, an intensity of contact during the input that exceeds a first intensity threshold triggers a first response. In some embodiments, the device responds to inputs detected by the device according to criteria that include both intensity of contact during the input and time-based criteria. For example, for some "deep press" inputs, an intensity of contact during the input that exceeds a second intensity threshold that is greater than the first intensity threshold for the light press triggers a second response only if a delay time has elapsed between meeting the first intensity threshold and meeting the second intensity threshold. This delay time is typically less than 200 ms in duration (e.g., 40 ms, 100 ms, or 120 ms, depending on the magnitude of the second intensity threshold, with the delay time increasing as the second intensity threshold increases). This delay time helps prevent accidental deep press inputs. As another example, for some "deep press" inputs, there is a period of reduced sensitivity that occurs after the first intensity threshold is met. During the period of time when sensitivity is reduced, the second intensity threshold is increased. This temporary increase in the second intensity threshold also serves to prevent accidental deep pressure inputs. As opposed to other deep pressure inputs, the response to the detection of a deep pressure input is not based on a time-based criterion.

[0172] In some embodiments, one or more of the input intensity thresholds and / or corresponding outputs vary based on one or more factors, such as user settings, contact movement, input timing, running applications, rate at which intensity is applied, number of current inputs, user history, environmental factors (e.g., ambient noise), position of the focus selector, etc. Exemplary factors are described in U.S. Patent Application Publication Nos. 14 / 399,606 and 14 / 624,296, which are incorporated herein by reference in their entireties.

[0173] For example, FIG. 4C illustrates a dynamic intensity threshold 480 that varies over time based in part on the intensity 476 of the touch input over time. The dynamic intensity threshold 480 is the sum of two components: a first component 474 that decays over time after a predetermined delay time p1 after the touch input 476 is first detected, and a second component 478 that tracks the intensity 476 of the touch input over time. The initial high intensity threshold of the first component 474 prevents the accidental triggering of a "deep press" response, while allowing a quick "deep press" response if the touch input 476 provides sufficient intensity. The second component 478 prevents the unintentional triggering of a "deep press" response by slowing the fluctuations in the intensity of the touch input. In some embodiments, when the touch input 476 satisfies the dynamic intensity threshold 480 (e.g., at point 481 in FIG. 4C ), a "deep press" response is triggered.

[0174] FIG. 4D illustrates another dynamic intensity threshold 486 (e.g., intensity threshold ID). FIG. 4D also illustrates two other intensity thresholds: a first intensity threshold IH and a second intensity threshold IL. In FIG. 4D, a touch input 484 satisfies the first intensity threshold IH and the second intensity threshold IL before time p2, but does not produce any response until delay time p2 has elapsed at time 482. FIG. 4D also illustrates that the dynamic intensity threshold 486 decays over time, beginning at time 488 after a predetermined delay time p1 has elapsed since time 482 (when a response associated with the second intensity threshold IL was elicited). This type of dynamic intensity threshold inhibits the accidental elicitation of a response associated with the dynamic intensity threshold ID immediately after or simultaneously with the elicitation of a response associated with a lower intensity threshold, such as the first intensity threshold IH or the second intensity threshold IL.

[0175] 4E illustrates another dynamic intensity threshold 492 (e.g., intensity threshold ID). In FIG. 4E, a response associated with intensity threshold ID is elicited after a delay time p2 from the first detected touch input 490. At the same time, dynamic intensity threshold 492 decays after a predetermined delay time p1 from the first detected touch input 490. Thus, even if the intensity of touch input 490 is below another intensity threshold (e.g., intensity threshold ID), a decrease in the intensity of touch input 490 after eliciting a response associated with intensity threshold ID, followed by an increase in the intensity of touch input 490 without releasing touch input 490, can elicit a response associated with intensity threshold ID (e.g., at time 494).

[0176] An increase in the characteristic intensity of a contact from an intensity below the light pressure intensity threshold ITL to an intensity between the light pressure intensity threshold ITL and the deep pressure intensity threshold ITD may be referred to as a “light press” input. An increase in the characteristic intensity of a contact from an intensity below the deep pressure intensity threshold ITD to an intensity above the deep pressure intensity threshold ITD may be referred to as a “deep press” input. An increase in the characteristic intensity of a contact from an intensity below the contact detection intensity threshold IT0 to an intensity between the contact detection intensity threshold ITL and the light pressure intensity threshold ITL may be referred to as detecting a contact on the touch surface. A decrease in the characteristic intensity of a contact from an intensity above the contact detection intensity threshold IT0 to an intensity below the contact detection intensity threshold IT0 may be referred to as detecting lift-off of the contact from the touch surface. In some embodiments, IT0 is zero. In some embodiments, IT0 is greater than zero. In some figures, shaded circles or ellipses are used to represent the intensity of a contact on the touch-sensitive surface. In some figures, unshaded circles or ellipses are used to represent each contact on the touch-sensitive surface without specifying the intensity of each contact.

[0177] In some embodiments described herein, one or more actions are performed in response to detecting a gesture including a respective pressure input, or in response to detecting a respective pressure input performed on a respective contact (or contacts), where the respective pressure inputs are detected at least in part based on detecting an increase in intensity of the contact (or contacts) above a pressure input intensity threshold. In some embodiments, the respective actions are performed in response to detecting an increase in intensity of the respective contact above a pressure input intensity threshold (e.g., the respective actions are performed by a "downstroke" of the respective pressure input). In some embodiments, the pressure input includes an increase in intensity of the respective contact above a pressure input intensity threshold and a subsequent decrease in intensity of the contact below the pressure input intensity threshold, and the respective actions are performed in response to detecting a subsequent decrease in intensity of the respective contact below the pressure input threshold (e.g., the respective actions are performed by an "upstroke" of the respective pressure input).

[0178] In some embodiments, the device employs intensity hysteresis to avoid accidental inputs, sometimes referred to as “jitter,” and the device defines or selects a hysteresis intensity threshold having a predetermined relationship to the pressure input intensity threshold (e.g., the hysteresis intensity threshold is X intensity units below the pressure input intensity threshold, or the hysteresis intensity threshold is 75%, 90%, or some reasonable percentage of the pressure input intensity threshold). Thus, in some embodiments, the pressure input includes a respective increase in the intensity of the contact above the pressure input intensity threshold and a subsequent decrease in the intensity of the contact below a hysteresis intensity threshold corresponding to the pressure input intensity threshold, and a respective action is performed in response to detecting a subsequent decrease in the intensity of each contact below that hysteresis intensity threshold (e.g., a respective action is performed by an “upstroke” of a respective pressure input). Similarly, in some embodiments, a pressure input is detected only when the device detects an increase in the intensity of the contact from an intensity below the hysteresis intensity threshold to an intensity above the pressure input intensity threshold, and optionally a subsequent decrease in the intensity of the contact to an intensity below the hysteresis intensity, and a respective action is performed in response to detection of that pressure input (e.g., an increase in the intensity of the contact or a decrease in the intensity of the contact, as the case may be).

[0179] For ease of explanation, descriptions of actions performed in response to a pressure input associated with a pressure input intensity threshold or in response to a gesture including that pressure input are optionally triggered in response to detecting an increase in the intensity of contact above the pressure input intensity threshold, an increase in the intensity of contact from an intensity below a hysteresis intensity threshold to an intensity above the pressure input intensity threshold, a decrease in the intensity of contact below the pressure input intensity threshold, or a decrease in the intensity of contact below a hysteresis intensity threshold corresponding to the pressure input intensity threshold. Additionally, in examples described as performing an action in response to detecting a decrease in the intensity of contact below a pressure input intensity threshold, the action is optionally performed in response to detecting a decrease in the intensity of contact below a hysteresis intensity threshold corresponding to and lower than the pressure input intensity threshold. As noted above, in some embodiments, triggering these responses also depends on matching time-based criteria (e.g., a delay time has elapsed between a matching first intensity threshold and a matching second intensity threshold). User Interface and Related Processes

[0180] Attention is now directed to embodiments of user interfaces (“UI”) and associated processing that may be implemented on an electronic device (such as portable multifunction device 100 or device 300) that includes a display, a touch-sensitive surface, and, optionally, one or more sensors that detect the intensity of contact with the touch-sensitive surface.

[0181] 5A-5K show exemplary user interfaces for capturing a grouped related image sequence according to some embodiments. The user interfaces in these figures are used to illustrate the processes described below, including those in FIGS. 9A-9G, 10A-10M, 11A-11I, 12A-12B, 24A-24E, 25A-25C, 26A-26D, and 27A-27E. For ease of explanation, some of the embodiments are described in the context of operations performed on a device including touch-sensitive display system 112. In such embodiments, the focus selector is optionally a respective finger or stylus contact, a representative point corresponding to a finger or stylus contact (e.g., a centroid of or a point associated with a respective contact), or a centroid of two or more contacts detected on touch-sensitive display system 112. However, optionally, on a device with display 450 and a separate touch-sensitive surface 451, similar actions are taken in response to detecting a contact on touch-sensitive surface 451 while displaying the illustrated user interface with a focus selector on display 450.

[0182] FIG. 5A illustrates media capture user interface 500 for displaying a live preview on touchscreen 112. The live preview illustrated in FIG. 5A is a preview of an image acquired from a camera (e.g., camera module 143 with light sensor 164) of portable multifunction device 100. The live preview on media capture user interface 500 displays the image acquired from the camera in real time or near real time (e.g., within the processing time required by portable multifunction device 100 to generate the displayed image). Thus, in the example illustrated in FIG. 5A , the user is viewing a scene of seagull 502 flying in the sky above tree 504, and portable multifunction device 100 is playing back the scene in real time or near real time on touchscreen 112. In some embodiments, the live preview displays the image at a first resolution (e.g., less than the upper resolution limit of the camera).

[0183] In this example, portable multifunction device 100 is configured to be in an enhanced media capture mode (e.g., portable multifunction device 100 is configured to capture enhanced photographs) or another media capture mode (e.g., portable multifunction device 100 is configured to capture still images, video, burst images, or any other type of image) during live preview. In some embodiments, media capture user interface 500 includes affordance 506 for enabling the enhanced media capture mode (e.g., toggling the enhanced media capture mode on / off). In some embodiments, media capture user interface 500 includes a visual indicator that the enhanced media capture mode is off. For example, in FIG. 5A , affordance 506 displays the word “off.”

[0184] In some embodiments, when the enhanced media capture mode is on, portable multifunction device 100 provides a visual indication that the enhanced media capture mode is on (e.g., to indicate that image and / or audio data is being captured while media capture user interface 500 is displayed). For example, as shown in Figures 5C-5H, when the enhanced media capture mode is on, affordance 506 is animated with an animation showing a clock with constantly advancing dial 508.

[0185] In some embodiments, as shown in Figure 5B, portable multifunction device 100 detects a selection of affordance 506 (e.g., detects tap gesture 510 on affordance 506) while the enhanced media capture mode is disabled. In response, portable multifunction device 100 enables the enhanced media capture mode (as shown in Figures 5C-5H by animation of affordance 506).

[0186] Portable multifunction device 100 captures media (e.g., images and / or audio) when the extended media capture mode is on. For example, in FIGS. 5C-5E, the extended video mode is on, so image 512-1 (FIG. 5C), image 512-2 (FIG. 5D), and image 512-3 (FIG. 5E) are captured (e.g., stored in persistent memory). In some embodiments, audio corresponding to the images is also captured (e.g., by microphone 113) and associated with the images (e.g., for later playback with the images, as shown in FIGS. 6E-6I). In some embodiments, other information (e.g., metadata such as time, location, or event data) is captured and associated with the captured images (e.g., for later display, as shown in FIGS. 6J-6M).

[0187] Media capture user interface 500 includes a shutter button 514 (shown as a shutter release icon). As shown in FIG. 5F , media capture user interface 500 is configured to detect activation of shutter button 514 (e.g., via tap gesture 518). In response to detecting activation of shutter button 514, portable multifunction device 100 groups multiple images 512 captured by the camera in the temporal vicinity of activation of shutter button 514 into an image sequence (e.g., a so-called “augmented photograph”). The augmented photograph includes some images 512 taken before tap gesture 518 (e.g., at least some of images 512-1, 512-2, and 512-3, which are stored in persistent memory as described above), a representative image (e.g., image 512-4 of FIG. 5F corresponding to the shutter activation), and some images taken after tap gesture 518 (e.g., image 512-5 of FIG. 5G , image 512-6 of FIG. 5H ).

[0188] In some embodiments, the representative image is similar to a single image captured when the shutter button of a conventional digital camera is activated in still image mode. In some embodiments, the representative image 512-4 corresponds to an image captured at the time the shutter button 514 is activated with a tap gesture 518. In some embodiments, the representative image 512-4 corresponds to an image captured shortly after detecting activation of the shutter button 514, taking into account shutter lag (the time delay between detecting activation of the shutter button and capturing / storing the representative image). In some embodiments, the camera-captured representative image 512-4 is used to represent a sequence of images, for example, in an image presentation mode (as shown in FIG. 6A ).

[0189] As described above, in some embodiments, the live preview displays images at a first resolution. In some embodiments, the image sequence 512 includes images displayed in the live preview at the first resolution, while the representative image 512-4 acquired by the camera has a second resolution that is higher than the first resolution. For example, as shown in FIG. 5I, the image sequence 512 includes (in chronological order) image 512-2, image 512-3, image 512-4, image 512-5, and image 512-6, with image 512-4 being the representative image. In some embodiments, the representative image 512-4 is stored at a higher resolution than image 512-2, image 512-3, image 512-5, or image 512-6.

[0190] As shown in Figures 5F-5H, in some embodiments, after activation of shutter button 514, media capture user interface 500 displays an animation while capturing the remaining images included in the grouped image sequence (e.g., an animation is displayed while portable multifunction device 100 captures representative image 512-4 and images acquired after representative image 512-4). In Figures 5F-5H, media capture user interface 500 displays an animation of shutter button 514 breaking apart and coming back together (e.g., to provide an indication to the user that images and / or audio are still being captured). In some embodiments, the animation is a looping animation that may be extended seamlessly if shutter button 514 remains depressed or is reactivated before the camera finishes capturing images for the image sequence.

[0191] In some embodiments, once the capture of the image sequence is complete, portable multifunction device 100 returns to the functionality described in connection with FIG. 5A, allowing the user to obtain a second image sequence, similar to the capture of the image sequence described above.

[0192] As shown in Figures 5I-5K, in some embodiments, portable multifunction device 100 displays second user interface 520 for editing and / or composing an image sequence (e.g., second user interface 520 is a user interface in an image sequence editing mode). In Figure 5I, images 512 included in the image sequence are those with solid borders, namely, image 512-2, image 512-3, image 512-4, image 512-5, and image 512-6, with image 512-4 being the representative image. Thus, image 512-2 is the first image in the image sequence, and there is one image (image 512-3) between first image 512-2 and representative image 512-4 (although in some embodiments there may be a greater integer number of images, such as 5, 10, or 30 images, between the first image and the representative image). Image 512-6 is the last image in the image sequence, and there is one image (image 512-5) between representative image 512-4 and the last image 512-6 (although in some embodiments there may be a larger integer number of images, such as 5, 10, or 30 images, between the representative image and the last image, and this number need not be the same as the number of images between the first and representative images). The thick border around image 512-4 in Figure 5I indicates that image 512-4 is the representative image.

[0193] As shown in FIG. 5J, second user interface 520 is configured to receive a request to change the representative image in the image sequence (e.g., receive touch gesture 522 on an image other than current representative image 512-4). As shown in FIG. 5K, the device responds to touch gesture 522 by changing the representative image to image 512-3 (image 512-3 has a thick border in FIG. 5K, indicating that image 512-3 is the new representative image). In some embodiments, the number of images between the first image and the representative image and the number of images between the representative image and the last image are fixed, so that portable multifunction device 100 changes the image sequence by adding images to one end and removing (e.g., deleting or not including) images from the image sequence at the other end. For example, in FIG. 5K, image 512-1 is added to the image sequence to maintain a fixed number of images between the first image and the representative image, and image 512-6 is removed from the image sequence to maintain a fixed number of images between the representative image and the last image.

[0194] 6A-6FF illustrate exemplary user interfaces for displaying (or playing) a grouped sequence of related images (sometimes called an augmented photograph) according to some embodiments. The user interfaces in these figures are used to illustrate the processes described below, including those in FIGS. 9A-9G, 10A-10M, 11A-11I, 12A-12B, 24A-24E, 25A-25C, 26A-26D, and 27A-27E. Although the following examples are described in connection with input on a touch-screen display (where the touch-sensitive surface and display are combined, as shown on portable multifunction device 100), in some embodiments, the device detects input on touch-sensitive surface 451 that is separate from display 450, as shown in FIG. 4B.

[0195] 6A illustrates user interface 600. Portable multifunction device 100 displays representative image 602-3 in grouped image sequence 602 in user interface 600. In some embodiments, user interface 600 is a user interface in an image presentation mode. As described below, image sequence 602 includes representative image 602-3, one or more images acquired by the camera after capturing the representative image (e.g., image 602-4 in FIG. 6C and image 602-5 in FIG. 6D), and one or more images acquired by the camera before capturing the representative image (e.g., image 602-1 in FIG. 6E and image 602-2 in FIG. 6F).

[0196] In some embodiments, user interface 600 is a user interface in an image management application (e.g., Photos from Apple Inc., Cupertino, California). As such, in some embodiments, the camera that captured image sequence 602 is part of portable multifunction device 100 (e.g., a camera that includes light sensor 164 in conjunction with imaging module 143 of FIG. 1A). In some embodiments, image sequence 602 was captured with a camera that is not part of portable multifunction device 100 (e.g., image sequence 602 was captured with a camera on another device and then transferred to portable multifunction device 100). In some embodiments, image sequence 602 was obtained in response to detecting activation of a shutter button at a first time, as described herein in connection with FIGS. 5A-5K and method 900 and / or FIGS. 22A-22D and method 2600. In some embodiments, representative image 602-3 corresponds to a representative image captured by a camera as described herein in connection with FIGS. 5A-5K and method 900 and / or FIGS. 22A-22D and method 2600.

[0197] In some embodiments, portable multifunction device 100 stores a plurality of grouped image sequences, some of which were acquired using portable multifunction device 100, and some of which were taken with a camera on a different device and then transferred to portable multifunction device 100. For example, in some situations, a user may acquire (e.g., take, capture) image sequences described in connection with methods 900 / 2600 on multiple devices (e.g., a tablet, laptop, and / or digital camera in addition to portable multifunction device 100) and synchronize or otherwise transfer the image sequences to portable multifunction device 100.

[0198] In some embodiments, user interface 600 is a user interface in a messaging application (e.g., Messages from Apple Inc., Cupertino, California). In some situations, a user may have acquired (e.g., taken, captured) each image sequence on their own portable multifunction device 100 and received different image sequences (e.g., in a messaging application) from different users. Thus, in some embodiments, image sequence 602 is a respective image sequence in a plurality of image sequences stored on portable multifunction device 100, including at least one image sequence acquired using a camera on portable multifunction device 100 and at least one image sequence acquired using a camera on another device different from portable multifunction device 100.

[0199] In some embodiments, representative image 602-3 is displayed in user interface 600 when portable multifunction device 100 is in collection view mode.

[0200] User interface 600 optionally includes another toolbar. For example, as shown, user interface 600 includes an operations toolbar 604 that includes multiple affordances 606 (e.g., a send affordance 606-1 that allows the user to send image sequence 602 to another user using an email application, a messaging application, or other application; an edit affordance 606-2 that launches a user interface for editing image sequence 602; a favorite affordance 606-3 that allows the user to indicate that image sequence 602 is one of the user's favorites; and a delete affordance 606-4 that allows the user to delete image sequence 602). As another example, user interface 600 includes a navigation toolbar 608 that includes multiple other affordances (e.g., an all photos affordance 610-1 that, when activated, navigates to a user interface for navigating the user's photos; and a "done" affordance 610-2 that, when activated, navigates to a different user interface, such as a user interface for retrieving photos).

[0201] Image sequence 602 shown in FIGS. 6A-6V depicts a scene in which cat 612 walks into view, lies down on the ground, stands up, and walks away. At the same time, a chirping bird 614 perches on a tree branch. In reality, such a scene may take several seconds to unfold, but in some embodiments, image sequence 602 is captured over a short time window. For example, in some embodiments, image sequence 602 depicts a moment (e.g., within 0.5, 1.0, 1.5, 2.0, or 2.5 seconds) before and after representative image 602-3 was captured. For example, a user may be intrigued when cat 612 lies down in the grass, inspiring them to capture representative image 602-3. In some embodiments, image sequence 602 includes images taken immediately before and after representative image 602-3 was captured, such that image sequence 602 includes an augmented photograph of the moment that may "come to life" if a user performs certain actions on representative image 602-3, as described herein.

[0202] FIG. 6B illustrates first portion 616-1 of first input 616 detected by portable multifunction device 100 while portable multifunction device 100 displays user interface 600. In particular, portable multifunction device 100 detects first portion 616-1 of first input 616 while portable multifunction device 100 displays representative image 602-3 on user interface 600 displayed on touch screen 112. In some embodiments, the actions illustrated in FIGS. 6B-6O are performed (e.g., triggered) in accordance with a determination that first input 616 meets predefined criteria (e.g., predefined extended photo display criteria). For example, in some embodiments, the actions illustrated in FIGS. 6B-6O are performed (e.g., triggered) when first input 616 or first portion 616-1 is a press and hold gesture as shown in FIGS. 6B-6O. In some embodiments, portable multifunction device 100 includes one or more sensors that detect the intensity of contact with touchscreen 112, and the actions shown in FIGS. 6B-6O are performed (e.g., triggered) when first input 616 has a characteristic intensity that meets (e.g., satisfies) a predefined intensity criterion (e.g., when first input 616 exceeds a light pressure threshold ITL, as shown in intensity diagram 618, which is not part of displayed user interface 600 but is provided to aid in interpretation of the figure). In some embodiments, the actions shown in FIGS. 6B-6O are performed (e.g., triggered) when first input 616 or first portion 616-1 has a predefined path characteristic (e.g., stationary, as in a press and hold gesture, or substantially linear, as in a swipe / drag gesture) and meets (e.g., exceeds) a predefined intensity criterion. For purposes of explanation, the actions shown in FIGS. 6B-6O are described below as being triggered by a long press gesture that exceeds a light pressure threshold ITL, as shown in intensity diagram 618.

[0203] FIG. 6C illustrates portable multifunction device 100's response to a continuation (from FIG. 6B ) of first portion 616-1 of first input 616 detected while portable multifunction device 100 displays user interface 600. In particular, as shown in FIGS. 6B-6D , in response to detecting first portion 616-1 of first input 616, portable multifunction device 100 replaces the display of the representative image in user interface 600 with a display of one or more images captured by the camera after capturing representative image 602-3 in user interface 600. According to some embodiments, the one or more images captured by the camera after capturing representative image 602-3 are displayed in sequence while first portion 616-1 of first input 616 is detected. Thus, FIG. 6C illustrates a display of image 602-4, which is the next image captured after representative image 602-3 in image sequence 602. In image 602-4, cat 612 has rolled over on the ground, but has now stood up and is beginning to walk away. The bird 614 remains perched on the tree. Therefore, the image 602-4 is an image taken after the respective image 602-3.

[0204] FIG. 6D illustrates portable multifunction device 100's response to a continuation (from FIG. 6C) of first portion 616-1 of first input 616 detected while portable multifunction device 100 displays user interface 600. In FIG. 6D, portable multifunction device 100 replaces the display of image 602-4 in user interface 600 with the display of image 602-5 in user interface 600, image 602-5 being the last image captured by the camera after capturing representative image 602-3 in image sequence 602. Thus, FIGS. 6A-6D illustrate an example in which there are two images in image sequence 602 captured after representative image 602-3. However, it should be understood that in various embodiments and / or situations, the image sequence may include various (e.g., an integer) numbers of images captured by the camera after capturing representative image 602-3 (e.g., 2, 5, 10, or 20 images).

[0205] In image 602-5, cat 612 has partially walked out of view, while bird 614 remains perched in a tree (e.g., image 602-5 is an image taken after respective image 602-4). Thus, Figures 6B-6D illustrate an example in which, according to some embodiments, a sufficiently deep long press gesture causes augmented photographs to be displayed forward starting with the representative image, thereby creating the impression of images moving. In some embodiments, unless first input 616 is terminated during first portion 616-1, first portion 616-1 of first input 616 lasts (e.g., has a duration) for the time it takes for all of the images in image sequence 602 captured by the camera after capturing representative image 602-3 to be sequentially replaced. In such an embodiment, the portion of the first input 616 that occurs after the time it takes for all of the images in the image sequence 602 captured by the camera to be sequentially replaced after capturing the representative image 602-3 is not considered part of the first portion 616-1, but is considered a subsequent portion of the first input 616, as described below.

[0206] In some embodiments, one or more images acquired by the camera after acquiring representative image 602-3 are displayed in response to detecting first portion 616-1 of first input 616, in sequence, at a rate based on the intensity of the contact at first portion 616-1 of first input 616, as shown in intensity diagram 618 (e.g., the display rate increases as the intensity of the contact at first portion 616-1 of first input 616 increases, and the display rate decreases as the intensity of the contact at first portion 616-1 of first input 616 decreases). In some embodiments, while sequentially displaying image sequence 602 during first portion 616-1 of first input 616, portable multifunction device 100 dwells on each image in image sequence 602 for a duration proportional (or inversely proportional) to the characteristic intensity of first input 616 while the respective image is displayed. Thus, for example, in such an embodiment, as shown in intensity diagram 618 in each figure, portable multifunction device 100 remains on representative image 602-3 (FIG. 6B) and image 602-4 (FIG. 6C) for a shorter period of time than on image 602-5 (FIG. 6D) because the intensity of first input 616 is higher while displaying representative image 602-3 (FIG. 6B) and image 602-4 (FIG. 6C) than while displaying image 602-5 (FIG. 6D).

[0207] In some embodiments, after this initial display rate dependence on contact intensity at first input 616, subsequent display of image sequence 602 (in response to detecting subsequent portions of first input 616, as described below) occurs at a fixed display rate, independent of the contact intensity at subsequent portions of first input 616. Thus, for example, portable multifunction device 100 remains on image 602-1 ( FIG. 6E ) and image 602-2 ( FIG. 6F ) for the same duration despite differences in intensity at first input 616, as indicated by intensity diagram 618 in each figure.

[0208] 6E-6I , after portable multifunction device 100 displays one or more images captured by the camera after acquiring representative 602-3 in response to detecting first portion 616-1 of first input 616, device 100 loops back and displays the entire image sequence 602 (or displays the entire image sequence 602 as long as first input 616 and / or its intensity is maintained) in response to second portion 616-2 of first input 616. In some embodiments, when image sequence 602 is looped or redisplayed, a cross-fade animation is displayed from the end of image sequence 602 to the beginning of image sequence 602.

[0209] 6E illustrates a situation in which, after detecting first portion 616-1 of first input 616, portable multifunction device 100 detects second portion 616-2 of first input 616 (e.g., portable multifunction device 100 continues to detect sufficient contact and / or intensity in a finger gesture). In response to detecting second portion 616-2 of first input 616, as shown in FIGS. 6E-6I, portable multifunction device 100 sequentially displays within user interface 600 one or more images captured by the camera before capturing representative image 616-3 (e.g., image 616-1 of FIG. 6E and image 616-2 of FIG. 6F), representative image 602-3 (FIG. 6G), and one or more images captured by the camera after capturing the representative image (e.g., image 602-4 of FIG. 6H and image 602-5 of FIG. 6I). Thus, in some embodiments, in response to detecting the second portion 616-2 of the first input 616, the entire image sequence 602 is displayed from the first image to the last image in the sequence (e.g., unless the first input 616 is interrupted).

[0210] In some embodiments, the second portion 616-2 of the first input 616 is contiguous with and immediately follows the first portion 616-1 of the first input 616. In some embodiments, the second portion 616-2 of the first input 616 lasts (e.g., has a duration) for the time it takes to sequentially replace all of the images in the image sequence 602, unless the first input 616 is terminated during the second portion 616-2.

[0211] In image 602-1 (FIG. 6E), cat 612 is just beginning to come into view, and bird 614 has not yet perched in the tree. In image 602-2 (FIG. 6F), cat 612 is fully within view, and bird 614 is perched in the tree. Thus, image 602-2 is an image taken after 602-1, and both images 602-1 and 602-2 were taken before representative image 602-3 (FIG. 6G). (Each image is the same in the various figures in which it appears. For example, image 602-4 is the same in FIGS. 6C and 6H. For the sake of brevity, aspects of these figures will not be repeated where they have been discussed in connection with other figures.)

[0212] In some embodiments, one difference between the sequential display (as shown in FIGS. 6B-6D ) of one or more images captured by the camera after capturing representative image 602-3 during first portion 616-1 of first input 616 and the sequential display (as shown in FIGS. 6E-6I ) of the entire image sequence 602 during second portion 616-2 of first input 616 is that, in response to detecting second portion 616-2 of first input 616, portable multifunction device 100 presents (e.g., via speaker 111) sound 620 corresponding to image sequence 602. This is illustrated in FIGS. 6F-6I by the word “chunk-chunk” being emitted from bird 614. (In this example, the word "droning" does not appear in the image, but is provided in the drawing to illustrate the sound produced by speaker 111.) In some embodiments, in response to detecting second portion 616-2 of first input 616, the entire image sequence 602 is displayed along with corresponding sound 620 recorded when image sequence 602 was acquired. In some embodiments, in response to detecting first portion 616-1 of first input 616, no sound is presented. In some embodiments, if first input 616 is maintained after the first complete playback of image sequence 602 (e.g., in response to detecting second portion 616-2 of first input 616), sound is not presented again during subsequent playback of the sequence in response to continued detection of first input 616 (as described with reference to FIGS. 6J-6M, which show a second playback of the entire image sequence 602). In some embodiments, for a given input, sound is presented only during the first complete playback of image sequence 602. In some embodiments, for a given input, audio is presented only between different subsequent playbacks of image sequence 602 (e.g., the second complete playback of image sequence 602) or between a certain number of predetermined playbacks (e.g., the first and second complete playbacks of image sequence 602).

[0213] In some embodiments, image sequence 602 is displayed sequentially at a fixed rate (e.g., the same rate at which the images were captured, also referred to as "1x" rate) in response to detecting second portion 616-2 of first input 616 (e.g., during the first full playback). For example, in some embodiments, audio is presented at 1x rate during the first full playback, and corresponding image sequence 602 is displayed at 1x rate, so that the playback looks and sounds natural. In some embodiments, 1x rate means that portable multifunction device 100 dwells on each image for substantially the same amount of time that elapsed between capturing each image and the next.

[0214] In some embodiments, the images in image sequence 602 are displayed in sequence at a fixed rate that is independent of the intensity of the contact of first input 616. For example, portable multifunction device 100 remains on image 602-1 ( FIG. 6E ) and image 602-2 ( FIG. 6F ) for the same amount of time despite the different input intensities shown in intensity diagrams 618 for each image. In some embodiments, during second portion 616-2 of first input 616, the rate at which the images in image sequence 602 are displayed in sequence depends on the intensity of the contact of first input 616. For example, the rate increases as the intensity of the contact increases.

[0215] 6J-6M, after portable multifunction device 100 displays image sequence 602 in response to detecting second portion 616-2 of first input 616 (e.g., after the device completes the first full playback of image sequence 602), device 100 loops back and displays the entire image sequence 602 (e.g., for as long as first input 616 and / or its intensity is maintained) in response to third portion 616-3 of first input 616. In some embodiments, when image sequence 602 is looped or displayed again, a cross-fade animation is displayed from the end of image sequence 602 to the beginning of image sequence 602.

[0216] 6J-6M illustrate a situation in which, after detecting second portion 616-2 of first input 616, portable multifunction device 100 detects third portion 616-3 of first input 616 (e.g., portable multifunction device 100 continues to detect sufficient contact and / or intensity in a finger gesture). In response to detecting third portion 616-3 of first input 616, portable multifunction device 100 sequentially displays within user interface 600 one or more images captured by the camera before capturing representative image 602-3 (e.g., image 602-1 of FIG. 6J and image 602-2 of FIG. 6K), representative image 616-3 (FIG. 6L), and one or more images captured by the camera after capturing the representative image (e.g., image 602-4 of FIG. 6M). However, in the illustrated example, first input 616 ends during third portion 616-3, resulting in a different function, as described in more detail below. Thus, in some embodiments, in response to detecting third portion 616-3 of first input 616, the entire image sequence 602, from the first image in the sequence to the last image in the sequence, is displayed until first input 616 is interrupted (e.g., stopped) before completing the display of the entire image sequence 602. In some embodiments, the loop continues as long as first input 616 is maintained, although different features and / or operations are optionally available (or performed) on different loops. For example, as described above, portable multifunction device 100 provides audio during the first complete playback. Similarly, in some embodiments, in response to detecting third portion 616-3 of first input 616 and displaying the second complete playback, portable multifunction device 100 displays metadata 622 corresponding to image sequence 602 (e.g., indicating date, time, location, or any other information associated with image sequence 602).

[0217] As discussed above, FIGS. 6J-6O illustrate an example in which first input 616 is discontinued during third portion 616-3 (e.g., by liftoff, i.e., by a drop in intensity below predefined threshold IT0, as shown in intensity diagram 618 of FIG. 6N). FIGS. 6N-6O illustrate actions taken in response to termination (e.g., discontinuation or stopping) of first input 616 during third portion 616-3, according to some embodiments. In some embodiments, similar actions are taken if first input 616 is terminated during second portion 616-2 or first portion 616-1 of first input 616. In some embodiments, when first input 616 is terminated, portable multifunction device 100 determines whether the currently displayed image occurred before or after representative image 602-3. 6N-6O, if the currently displayed image occurred after (e.g., was taken later than) representative image 602-3, portable multifunction device 100 displays image sequence 602 in reverse chronological order from the currently displayed image (e.g., image 602-4 in FIG. 6N) to representative image 602-3 (e.g., portable multifunction device 100 loops back to representative image 602-3). Conversely, if the currently displayed image occurred before (e.g., was taken earlier than) representative image 602-3, portable multifunction device 100 displays image sequence 602 in chronological order from the currently displayed image to representative image 602-3 (e.g., portable multifunction device 100 loops forward to representative image 602-3).

[0218] In some situations, a grouped image sequence is asymmetric with respect to its representative image, meaning that the number of images that occur before the representative image is not equal to the number of images that occur after it. In some embodiments, portable multifunction device 100 determines whether there are fewer images between the currently displayed image and the representative image in a chronological direction or a reverse chronological direction. Portable multifunction device 100 then sequentially displays (e.g., moves through) the image sequence in the direction with fewer images between the currently displayed image and the representative image.

[0219] 6P-6V illustrate an embodiment in which a user controls the display of images in a grouped image sequence by controlling the intensity of a press and hold gesture 636. FIG. 6P is similar to FIG. 6A and is provided as a starting point for describing the functionality in FIGS. 6Q-6V. In some embodiments, if press and hold gesture 636 meets predetermined criteria, a playback function for image sequence 602 is triggered. For example, if each press and hold input remains below a pressure threshold ITL, portable multifunction device 100 does not replace the display of representative image 602-3 in response to the press and hold gesture (e.g., instead, portable multifunction device 100 performs a different function). In contrast, if press and hold gesture 636 exceeds a light pressure threshold ITL, as shown in FIG. 6Q, portable multifunction device 100 maps the intensity of press and hold gesture 636 (shown in intensity diagram 618) to at least some of the images in image sequence 602. For example, because the playback function for image sequence 602 was triggered in Figure 6Q, portable multifunction device 100 displays representative image 602-3 when the intensity of press and hold gesture 636 is within intensity range 618-3 (Figures 6Q and 6U). Similarly, portable multifunction device 100 displays image 602-1 when the intensity of press and hold gesture 636 is within intensity range 618-1, displays image 602-2 when the intensity of press and hold gesture 636 is within intensity range 618-2 (Figure 6V), displays image 602-4 when the intensity of press and hold gesture 618 is within intensity range 618-4 (Figures 6T and 6R), and displays image 602-5 when the intensity of press and hold gesture 636 is within intensity range 618-5 (Figure 6S). Thus, Figures 6Q-6V show that a user can scrub backward and forward through images in a grouped image sequence (e.g., directly control the displayed images in the grouped image sequence) based on the intensity of the user input (e.g., resulting in a smooth forward and backward animation displaying the replacement of images in the grouped image sequence).

[0220] FIG. 6W illustrates an embodiment in which a user controls the display of images acquired after the representative image in a grouped image sequence 656 by controlling input intensity 654. In the example shown in FIG. 6W, intensity values ​​between a light pressure threshold ITL and a deep pressure threshold ITD correspond to each image acquired after the representative image in the grouped image sequence 656. The intensity diagram shown in FIG. 6W illustrates input intensity 654 associated with a particular image acquired after the representative image in the grouped image sequence 656, as indicated by the arrows. If the input exceeds the light pressure threshold ITL, the user can scrub forward and then backward through the images acquired after the representative image in the grouped image sequence by controlling the input intensity. In some embodiments, if the input exceeds the deep pressure threshold ITD, the grouped image sequence 656 is replaced (e.g., advanced) at a fixed rate (e.g., the device plays the grouped image sequence 656 at a fixed rate and loops back to the starting image after the last image in the grouped image sequence 656 is displayed). FIG. 6W also shows audio 658 and metadata 660 associated with grouped image sequence 656 (eg, and as provided with grouped image sequence 658 as described above).

[0221] Figure 6X illustrates an embodiment that is largely similar to the embodiment described with reference to Figures 6A-6O, but in which device 100 responds to an initial portion of user input differently than the embodiment described with reference to Figures 6A-6O. In particular, in the embodiment illustrated in Figure 6X, in response to detecting a first portion of user input (e.g., a user input similar to the user input described with reference to Figures 6A-6O), device 100 begins playback by either transitioning directly to the first image in the image sequence (e.g., as shown in diagram 656) or by briefly playing the image sequence forward (e.g., by playing a few images forward, as shown in diagram 650) and then crossfading to the first image (e.g., rather than first playing the image sequence forward to the last image in the image sequence).

[0222] 6X, playback during user input 648 is represented by one or more curves (e.g., curve 662 and / or curve 664). According to some embodiments, the solid portions of the curves representing playback during user input 648 represent played-back images, while the dotted portions represent non-played images.

[0223] Thus, for example, in diagram 650, device 100 initially displays representative image 652. In response to user input 648, device 100 plays three images (e.g., alternatively one image or ten images, etc.) forward to image 660, then replaces the display of image 660 with the display of first image 654. According to any of the embodiments described with reference to FIGS. 6A-6O, device 100 then plays the image sequence forward from first image 654 (e.g., looping augmented photos from start to finish, along with sound, metadata, etc., in a subsequent loop). In this manner, device 100 transitions from displaying representative image 652 to displaying first image 654 (or any other respective previous image) by displaying one or more images captured after representative image 652. In some embodiments, device 100 cross-fades and / or blurs representative image 652 and / or one or more of the images captured after the representative image to first image 654.

[0224] As another example, in diagram 656, device 100 initially displays representative image 652. In response to user input 648, device 100 replaces the display of representative image 652 with a display of initial image 654 (or any other respective previous image). According to any of the embodiments described with reference to FIGS. 6A-6O, device 100 then plays the image sequence forward from initial image 654 (e.g., looping augmented photos from start to finish, along with sound, metadata, etc., in a subsequent loop). In this manner, device 100 transitions from displaying representative image 652 to directly displaying initial image 654. In some embodiments, device 100 cross-fades and / or blurs representative image 652 to initial image 654.

[0225] In some embodiments, as shown in diagram 656, the transition from displaying the representative image 652 to displaying the first image 654 (e.g., each previous image) does not include displaying any of the one or more images captured by the camera after capturing the representative image 652 (e.g., the device returns directly to the first image 654).

[0226] In some embodiments, device 100 determines which transition to apply (e.g., the transition shown in diagram 650 or the transition shown in diagram 656) based on a characteristic of user input 648 (e.g., a characteristic contact intensity of a first portion of first input 648). For example, as shown in intensity diagram 668-2, if the first portion of first input 648 exceeds the deep pressure threshold ITD, device 100 transitions according to diagram 656. If the first portion of first input 648 does not exceed the deep pressure threshold ITD, as shown in intensity diagram 668-1, device 100 transitions according to diagram 650.

[0227] In some embodiments, certain images captured during the capture of an image sequence are removed or fused when generating the image sequence. For example, blurry images may be removed (e.g., not included) from the image sequence and / or one or more dark images may be combined to enhance the image quality in the image sequence. In some situations, the removed and / or fused images may result in an image sequence that is not evenly spaced in time. For example, if a camera captures 10 images per second, but three images are fused to form each single image in the image sequence, the time lapse of each single image will be greater than the other images in the image sequence. Thus, in some embodiments, the playback of the image sequence is retimed in response to the removal and / or fusion of images within the image sequence (e.g., in the example above, when playing the image sequence at 1x playback, device 100 will dwell on each single image for 0.3 seconds, or three times longer than it would otherwise).

[0228] According to some embodiments, Figures 6Y-6BB illustrate a user interface that initially displays the first image in an image sequence (e.g., an augmented photograph). The user interface plays the image sequence forward and backward according to the intensity of the user's input contact, such that intensity ranges above a threshold correspond to a forward movement rate through the image sequence, while intensity ranges below the threshold correspond to a reverse movement rate through the image sequence. In some embodiments, the user interface does not loop the image sequence. Thus, once the first image is displayed, a contact with an intensity above the threshold causes the images to play forward at a rate proportional to the contact intensity, stopping when the last image is reached. If the user lightens the contact so that the contact intensity drops below the threshold, the device plays the images backward at a rate based on the contact intensity, stopping when the first image is reached.

[0229] 6Y illustrates user interface 640. In some embodiments, user interface 640 is a lock screen user interface. For example, a user can lock device 100 so that the user can put device 100 in the user's pocket without accidentally interacting with device 100 (e.g., accidentally calling someone). In some embodiments, lock screen user interface 640 is displayed when the user wakes up device 100 (e.g., by pressing a button). In some embodiments, a swipe gesture on touchscreen 112 initiates the process of unlocking device 100.

[0230] Portable multifunction device 100 displays representative image 602-1 of grouped image sequence 602 in user interface 640. In some embodiments, image sequence 602 is an augmented photograph selected by the user for the lock screen (e.g., selected in a settings user interface). In the example shown in FIGS. 6Y-6BB, the image sequence is an augmented photograph depicting a scene in which cat 612 walks into view and lies down on the ground. At the same time, small bird 614 perches on a tree branch. In some embodiments, the image sequence includes one or more images captured after the representative image was captured (e.g., representative image 602-1 is the first image in the image sequence).

[0231] In some embodiments, the user interface 640 also includes quick access information 642, such as time and date information.

[0232] While displaying representative image 602-1 on touchscreen 112, device 100 detects input 644 (e.g., a long press gesture) in which the characteristic intensity of a contact on touchscreen 112 exceeds an intensity threshold. In this example, the intensity threshold is a light pressure threshold ITL. As shown in intensity diagram 618 (FIG. 6Y), input 644 includes a contact that exceeds the light pressure threshold ITL.

[0233] In response to detecting an increase in the characteristic intensity of the contact, the device advances in time sequence through one or more images acquired after acquiring representative image 602-1 at a rate determined at least in part based on the characteristic intensity of the contact of input 644. Thus, for example, the display of representative image 602-1 (FIG. 6Y) is replaced with the display of image 602-2 (FIG. 6Z) at a rate indicated by rate diagram 646 (FIG. 6Y) based on the contact intensity shown in intensity diagram 618 (FIG. 6Y). Image 602-2 is an image in image sequence 602 acquired after representative image 602-1. The display of image 602-2 (FIG. 6Z) is replaced with the display of image 602-3 (FIG. 6AA) at a faster rate indicated by rate diagram 646 (FIG. 6Z) based on the contact intensity shown in intensity diagram 618 (FIG. 6Z). Image 602-3 is an image in image sequence 602 acquired after image 602-2.

[0234] In Figure 6AA, the intensity of the contact of input 644 decreases until it falls below ITL, which in this example is the threshold for playing backward or forward through image sequence 602. As a result, image 602-3 (Figure 6AA) replaces the previous image 602-2 (Figure 6BB) at a receding rate based on the current contact intensity of input 644.

[0235] In some embodiments, the rate shown in rate diagram 646 (FIGS. 6Y-6AA) is proportional to the absolute value of the difference between the ITL and the current touch intensity of the input 644 as shown in intensity diagram 618 (FIGS. 6Y-6AA). The direction of movement is based on whether the current touch intensity is above (e.g., forward movement) or below (e.g., reverse movement) the ITL (or any other suitable threshold).

[0236] In some embodiments, the forward or reverse rate is determined in real time or near real time, such that the user can accelerate or decelerate movement between images (in either the forward or reverse direction) by varying the characteristic intensity of the contact. Thus, in some embodiments, the user can scrub forward and backward through the image sequence 602 (e.g., between the first and last images in the image sequence) by increasing and decreasing the contact intensity of the user input 644.

[0237] According to some embodiments, FIGS. 6CC-6DD are graphs illustrating how movement rate V relates to current contact intensity I of input 644.

[0238] As shown in FIG. 6CC, the threshold for forward / reverse movement is the light pressure threshold ITL in this example. If the current touch intensity of the input 644 is equal to the light pressure threshold ITL, the device 100 does not advance through the image sequence in either chronological or reverse chronological order. Thus, the device 100 maintains the currently displayed image from the image sequence 602 (e.g., the movement rate is equal to 0x, where 1x is the rate at which the images in the image sequence 602 were captured). If the current touch intensity of the input 644 is slightly above the light pressure threshold ITL, the device 100 advances through the image sequence in chronological order at a first rate (e.g., 0.2x). If the current touch intensity of the input 644 is below the light pressure threshold ITL by the same amount, the device 100 advances through the image sequence in reverse chronological order at a first rate (e.g., −0.2x, where the minus sign indicates reverse chronological order or reverse playback).

[0239] In this example, device 100 has a maximum rate Vmax (e.g., plus or minus 2x) that is reached when the current contact intensity of input 644 reaches deep pressure threshold ITD (or any other upper threshold) and hint threshold ITH (or any other suitable lower threshold), respectively. The rate of movement between image sequences is constrained by the maximum inverse rate while contact is detected on the touch-sensitive surface.

[0240] 6DD shows an exemplary response curve in which the movement rate increases exponentially from 0x to Vmax between the light pressure threshold ITL and the deep pressure threshold ITD, above which the movement rate is constant.

[0241] According to some embodiments, in certain circumstances, device 100 will optionally deviate from a movement rate that is based solely on the current touch intensity of input 644. For example, as device 100 approaches the last image while proceeding forward through image sequence 602, device 100 slows its movement rate below the movement rate that would be based solely on the current touch intensity of input 644 (e.g., device 100 slightly “brakes on” as it approaches the end of the image sequence). Similarly, in some embodiments, as device 100 approaches the first image while proceeding backward through image sequence 602, device 100 slows its movement rate below the movement rate that would be based solely on the current touch intensity of input 644 (e.g., device 100 slightly “brakes on” as it proceeds backward and approaches the beginning of the image sequence).

[0242] 6EE-6FF illustrate embodiments in which an image sequence 602 is displayed and / or played in a user interface 680 for a messaging application (e.g., Messages from Apple Inc., Cupertino, California). In some embodiments, the image sequence 602 is a message in a message conversation displayed in a scrollable area 682 of the messaging application (e.g., a user can scroll up or down to view earlier or later messages in area 682). In some embodiments, a representative image 602-3 is displayed initially in the messaging application 680. In some embodiments, the image sequence 602 is displayed (e.g., played) in response to a swipe / drag gesture. In some embodiments, the display of images in the image sequence 602 is controlled by the position of the drag gesture (e.g., a user can scrub forward or backward through the image sequence 602 by moving the drag gesture right or left, respectively). For example, in Figures 6EE-6FF, contact 686 moves from position 686-1 (Figure 6EE) to position 686-2 (Figure 6FF), causing image sequence 602 to advance from representative image 602-3 (Figure 6EE) to image 602-4 (Figure 6FF).

[0243] In some embodiments, a swipe gesture triggers playback of image sequence 602 when the swipe gesture ends (e.g., lift-off). In some embodiments, image sequence 602 is not played during a drag gesture, but is played when the drag gesture ends (e.g., lift-off). In some embodiments, image sequence 602 is played in response to a press and hold gesture (e.g., image sequence 602 in messaging application 680 is played according to any of the embodiments described with reference to FIGS. 6A-6DD). In some embodiments, image sequence 602 in messaging application 680 is played according to any of the embodiments described with reference to FIGS. 7A-7CC.

[0244] In some embodiments, image sequence 602 is displayed (e.g., played) as a scrollable area of ​​a messaging application is scrolled, and the images are, in some circumstances, supplemented (e.g., in speech bubbles) with text messages 684 or other messages sent and received via the messaging application. In some circumstances, a user may have acquired (e.g., taken or captured) each image sequence on their own portable multifunction device 100 and received different image sequences (e.g., in a messaging application) from different users. Thus, in some circumstances, the multiple image sequences stored on portable multifunction device 100 include at least one image sequence acquired using a camera on portable multifunction device 100 and at least one image sequence acquired using a camera on another device different from portable multifunction device 100.

[0245] 7A-7CC show exemplary user interfaces for navigating through related image sequences (sometimes called augmented photographs) according to some embodiments. The user interfaces in these figures are used to illustrate the processes described below, including those in FIGS. 9A-9G, 10A-10M, 11A-11I, 12A-12B, 24A-24E, 25A-25C, 26A-26D, and 27A-27E. Although the following examples are described in connection with input on a touch-screen display (where the touch-sensitive surface and display are combined, as shown on portable multifunction device 100), in some embodiments, the device detects input on touch-sensitive surface 451 that is separate from display 450, as shown in FIG. 4B.

[0246] Portable multifunction device 100 displays user interface 700. User interface 700 optionally includes another toolbar. For example, as shown, user interface 700 includes an operations toolbar 704 that includes a plurality of affordances 706 (e.g., a send affordance 706-1 that allows a user to send first image sequence 702 to another user using an email, messaging, or other application; an edit affordance 706-2 that launches a user interface for editing first image sequence 702; a favorite affordance 706-3 that may allow a user to indicate that first image sequence 702 is one of the user's favorites; and a delete affordance 706-4 that allows a user to delete first image sequence 702). As another example, user interface 700 includes a navigation toolbar 706 that includes a number of different affordances (e.g., an all photos affordance 710-1 that navigates to a user interface for navigating the user's photos; a "Done" affordance 710-2 that navigates to a different user interface, such as a user interface for getting photos).

[0247] 7A-7CC illustrate an example in which portable multifunction device 100 stores multiple image sequences (e.g., first image sequence 702, second image sequence 724, third image sequence 726, and fourth grouped image sequence 760 of FIGS. 7A-7CC). First grouped image sequence 702 includes a first representative image 702-3 (FIG. 7A) captured by a camera, one or more images captured by the camera after capturing first representative image 702-3 (e.g., image 702-4 of FIG. 7C and image 702-5 of FIG. 7D), and one or more images captured by the camera before capturing first representative image 702-3 (e.g., image 702-2 of FIG. 7H and image 702-1 of FIG. 7I). Thus, the chronological order (eg, the order in which the camera captured the images) of the first image sequence 702 is image 702-1, image 702-2, image 702-3, image 702-4, and image 702-5.

[0248] First image sequence 702 depicts a scene in which cat 712 walks into view, lies down on the ground, gets up, and walks away. At the same time, a small bird 714 perches on a tree branch. In reality, such a scene may take several seconds to unfold, but in some embodiments, first image sequence 702 is captured over a short window of time. For example, in some embodiments, any of the image sequences described herein may depict a moment a split second before or after (e.g., within half a second or a second) the capture of the respective representative image. For example, a user may be intrigued when cat 712 lies down in the grass, prompting them to capture first representative image 702-3. In some embodiments, first image sequence 702 includes images taken immediately before and after the capture of first representative image 702-3, such that first image sequence 702 includes an augmented photograph in which the moment may "come to life" if the user performs certain actions on first representative image 702-3, as described herein.

[0249] The second grouped image sequence 724 includes a second representative image 724-3 (FIG. 7F) and at least one more images captured by the camera before capturing the second representative image 724-3 (e.g., image 724-1 of FIG. 7C and image 724-2 of FIG. 7D). The second image sequence 724 includes one or more images captured by the camera after capturing the second representative image 724-3. Thus, the chronological order (e.g., the order in which the images were captured by the camera) of the second image sequence 724 is image 724-1, image 724-2, and image 724-3. The second image sequence 724 depicts a scene in which a seagull 728 is flying in the distance (image 724-1 of FIG. 7C), flies into the foreground (image 724-2 of FIG. 7D), and then begins to fly away again (image 724-3 of FIG. 7F).

[0250] The third grouped image sequence 726 includes a third representative image 726-1 and at least one or more images captured by the camera after capturing the third representative image 726-1 (e.g., image 726-3 in FIG. 7H and image 724-2 in FIG. 7I). The third image sequence 726 also includes one or more images captured by the camera before capturing the third representative image 726-1. Thus, the chronological order (e.g., the order in which the images were captured by the camera) of the third image sequence 726 is image 726-1, image 726-2, and image 726-3. The third image sequence 726 depicts a scene in which a whale 730 breaches the water (image 726-1 in FIG. 7K), swims alongside a boat 732 within view (image 726-2 in FIG. 7I), dives underwater, and disappears from view (image 726-3 in FIG. 7H).

[0251] The fourth grouped image sequence 760 includes a fourth representative image 760-3 and at least one more images captured by the camera prior to capturing the fourth representative image 760-1 (e.g., image 760-1 in FIG. 7V and image 760-2 in FIG. 7W). Thus, the chronological order (e.g., the order in which the images were captured by the camera) of the fourth image sequence 760 is image 760-1, image 760-2, and image 760-3. The fourth image sequence 760 depicts a scene in which a firework tube 762 is launched (image 760-1 in FIG. 7V), flies into the air (image 760-2 in FIG. 7W), and explodes (image 760-3 in FIG. 7X).

[0252] In some embodiments, the first image sequence 702 is captured by the camera before the second image sequence 724, and the first image sequence 702 is captured by the camera after the third image sequence 726.

[0253] In some embodiments, user interface 700 is a user interface for an image management application (e.g., Photos from Apple Inc., Cupertino, California). As such, in some embodiments, the camera that captured first image sequence 702 (and / or second image sequence 724, third image sequence 726, etc.) is part of portable multifunction device 100 (e.g., a camera that includes light sensor 164 in conjunction with imaging module 143 of FIG. 1A). In some embodiments, first image sequence 702 was captured with a camera that is not part of portable multifunction device 100 (e.g., first image sequence 702 was captured with a camera on another device and then transferred to portable multifunction device 100). In some embodiments, first image sequence 702 was acquired in response to detecting activation of a shutter button at a first time, as described herein in connection with FIGS. 5A-5K and method 900 and / or FIGS. 22A-22D and method 2600. In some embodiments, the first representative image 702-3 corresponds to a representative image captured by a camera as described herein in connection with Figures 5A-5K and method 900 and / or Figures 22A-22D and method 2600.

[0254] In some embodiments, some of the plurality of image sequences were acquired using portable multifunction device 100, and some of the plurality of image sequences were taken with a camera on a different device and then transferred to portable multifunction device 100. For example, in some situations, a user may acquire (e.g., take, capture) image sequences described in connection with methods 900 / 2600 on multiple devices (e.g., a tablet, laptop, and / or digital camera in addition to portable multifunction device 100) and synchronize or otherwise transfer the image sequences to portable multifunction device 100.

[0255] In some embodiments, user interface 700 is a user interface for a messaging application (e.g., Messages from Apple Inc., Cupertino, California). In some embodiments, first image sequence 702 is a message in a message conversation displayed in a scrollable area of ​​the messaging application, where first image sequence 702 is displayed as the scrollable area of ​​the messaging application is scrolled, and images, in some situations, are supplemented (e.g., in speech bubbles) with text messages or other messages sent and received via the messaging application. In some situations, a user may have acquired (e.g., taken or captured) each image sequence on their own portable multifunction device 100 and received different image sequences (e.g., in a messaging application) from different users. Thus, in some situations, the multiple image sequences stored on portable multifunction device 100 include at least one image sequence acquired using a camera on portable multifunction device 100 and at least one image sequence acquired using a camera on another device different from portable multifunction device 100.

[0256] In some embodiments, the representative image 702-3 is displayed in the user interface 700 (eg, in a picture management application or messaging application when the user scrolls between the user's pictures or messages).

[0257] 7A illustrates user interface 700. In user interface 700, portable multifunction device 100 displays first representative image 702 in movable first area 734 on touch screen 112. It should be understood that the boundaries of movable first area 734 are not always displayed on touch screen 112, but are provided to aid in the illustration of the figure.

[0258] 7B illustrates portable multifunction device 100 detecting drag gesture 736 (starting at position 736-1) on touch screen 112. In some embodiments, the actions illustrated in FIGS. 7B-7K are performed pursuant to a determination that drag gesture 736 meets predefined criteria (e.g., predefined next-extension photo navigation criteria). For example, in some embodiments, the actions illustrated in FIGS. 7B-7F are performed (e.g., triggered) when drag gesture 736 has predefined path characteristics (e.g., drag gesture 736 is characterized by a horizontal (or vertical) velocity, i.e., the drag gesture is more left-right (or up-down) than up-down (or left-right) in the orientations illustrated in FIGS. 7A-7CC). In some embodiments, portable multifunction device 100 includes one or more sensors that detect the intensity of contact with touchscreen 112, and the actions shown in Figures 7B-7F are performed (e.g., triggered) when drag gesture 736 has a characteristic intensity that meets (e.g., satisfies) predefined intensity criteria (e.g., exceeds a light pressure threshold ITL, as described elsewhere herein). In some embodiments, the actions shown in Figures 7B-7F are performed (e.g., triggered) when drag gesture 736 has predefined path characteristics (e.g., drag gesture 736 is characterized by a lateral velocity) and meets predefined intensity criteria (e.g., exceeds a predefined intensity threshold).

[0259] The user interface 700, in image presentation mode, shows a display of the first representative image 702-3, as shown in Figure 7A. In some embodiments, as shown in Figure 7A, the movable first area 734 is an area that displays images in the first image sequence without displaying images from image sequences other than the first image sequence.

[0260] In Figure 7B, drag gesture 736 is to the left. Accordingly, portable multifunction device 100 moves first area 734 to the left, as shown in Figures 7C-7D. In addition, portable multifunction device 100 replaces the display of first representative image 702-3 in movable first area 734 of user interface 700 with a time-sequential display of at least a portion of one or more images for first image sequence 702 that were captured by the camera after first representative image 702-3 was captured (i.e., image 702-4 of Figure 7C and image 702-5 of Figure 7D). That is, portable multifunction device 100 displays an animated display of first image sequence 702 in the first area.

[0261] In some embodiments, the chronological display in the first area 734 of at least some of the one or more images for the first image sequence 702 captured by the camera after capturing the first representative image follows the movement of the contact in the drag gesture 736. Thus, if the leftward movement of the drag gesture 736 accelerates, the display of the chronological progression of the images in the first area 734 also accelerates. If the leftward movement of the drag gesture 736 decelerates, the display of the chronological progression of the images in the first area 734 also decelerates. If the leftward movement of the drag gesture 736 stops, the display of the chronological progression of the images in the first area 734 also stops. And, if the movement of the drag gesture 736 reverses direction (e.g., from a leftward drag gesture to a rightward drag gesture), the display of the progression of images in the first image sequence 702 in the first area 734 also reverses, and the images are shown in reverse chronological order following the movement of the drag gesture 736 in the reverse direction. More generally, in some embodiments, in each image sequence, the display of a progression of images in each image sequence in each area follows the movement of the contact in the drag gesture.

[0262] 6A-6FF by changing one or more characteristics of drag gesture 736 in a predetermined manner. For example, in some embodiments, if the user stops drag gesture 736 and presses deeper on touch screen 112, portable multifunction device 100 plays first image sequence 702 as described with reference to FIGS. 6A-6FF, even when only a portion of first area 734 is on the display. In some embodiments, portable multifunction device 100 is configured to detect a change or modification in one or more characteristics of drag gesture 736.

[0263] 7C-7D also illustrate that, in some embodiments, portable multifunction device 100 moves second area 738 to the left in accordance with leftward drag gesture 736. In some embodiments, moving second area 738 to the left includes moving at least a portion of second area 738 from the left into touchscreen 112. In some embodiments, movable second area 738 is an area that displays images in second image sequence 724 without displaying images from image sequences other than second image sequence 724 (e.g., first image sequence 702 and third image sequence 726 are not displayed in movable second area 738). In some embodiments, as shown in FIG. 7C, movable second area 738 is adjacent to movable first area 734 (e.g., to the right of movable first area 734). In some embodiments, while moving left through second area 738, portable multifunction device 100 displays in second area 738 at least a portion of one or more images for second image sequence 724 that were acquired by the camera prior to acquiring second representative image 724-3 in chronological order.

[0264] In some embodiments, the movement of the first area 734 corresponds to the movement of the drag gesture 736. For example, in some embodiments, the movement of the first area 734 between Figures 7B and 7C is proportional to the distance between positions 736-1 (Figure 7B) and 736-2 (Figure 7C). Similarly, in some embodiments, the movement of the first area 734 between Figures 7C and 7D is proportional to the distance between positions 736-2 (Figure 7C) and 736-3 (Figure 7D), thereby giving the user the impression of pulling the movable first area 734. In some embodiments, as shown in Figures 7C-7D, moving the first area 734 to the left includes moving at least a portion of the first area 734 left and off the touchscreen 112.

[0265] 7B-7D, the first area 734 and the second area 738 move across the touch screen 112 at the same rate (e.g., the distance moved by the first area 734 and the distance moved by the second area 738 correspond to the distance moved by the drag gesture 736). In some embodiments, as shown in FIGS. 7L-7P, the first area 734 and the second area 738 move at different rates. For example, in FIGS. 7L-7P, the movement of the second area 738 in response to the drag gesture 752 is less than the movement of the first area 734 in response to the drag gesture 752 (e.g., the movement of the first area 734 matches the movement of the drag gesture 752, and the movement of the second area 738 is a fraction, such as 50%, of the movement of the drag gesture 752).

[0266] In some embodiments, the time-sequential display in second area 738 of at least a portion of one or more images for second image sequence 724 captured by the camera prior to capturing second representative image 724-3 follows the movement of the contact during drag gesture 736 (e.g., in a manner similar to that described above with respect to first image sequence 702). For example, during drag gesture 736, the images in first area 734 and the images in second area 738 both advance at the same rate based on the movement of drag gesture 736. In some embodiments, the images in first area 734 and the images in second area 738 advance at different rates during drag gesture 752, for example, as described below with reference to FIGS. 7L-7P. For example, in Figures 7L-7P, the rate at which the image advances in the second area in response to the drag gesture 752 is less than the rate at which the image advances in the first area 734 in response to the drag gesture 752 (e.g., 50% of the rate at which the image advances in the first area 734 in response to the drag gesture 752).

[0267] In some embodiments, as an alternative to the example shown in Figures 7B-7D, while moving the second area 738 to the left, the second area 738 displays only the second representative image 724-3 for the second image sequence without displaying any other images in the second image sequence 724.

[0268] In some embodiments, the user interface 700 includes a next icon 750-1 (e.g., FIG. 7A ) and a previous icon 750-2. In some embodiments, similar to detecting a drag gesture in a first direction, detecting activation of the next icon 750-1 also animates an image from the first image sequence 702 in the first area 734 and an image from the second image sequence 724 in the second area 738. In some embodiments, detecting activation of the next icon 750-1 causes the display of the second representative image 724-3 to replace the display of the first representative image 702-3, without animating an image from the first image sequence 702 in the first area 734 and an image from the second image sequence 724 in the second area 738. In some embodiments, upon detecting activation of the next icon 750-1, the display of the second representative image 724-3 replaces the display of the first representative image 702-3 without displaying any other images in the first or second image sequences.

[0269] 7B-7D are described in conjunction with left / right movement of drag gesture 736, similar actions are contemplated in conjunction with up / down movement of drag gesture 736 and are intended to be within the scope of the claims unless otherwise specified. For example, in some embodiments, instead of moving second area 738 leftward into touchscreen 112 as an alternative to the example shown in FIGS. 7B-7D , if drag gesture 736 is a leftward or downward gesture, second area 738 is below first area 734 in Z-layer (front-back) order, and as first area 734 is moved leftward (or toward the bottom) out of touchscreen 112, second area 738 appears (e.g., becomes visible).

[0270] As shown in Figure 7F, in some embodiments, after moving second area 738 to the left, portable multifunction device 100 displays second representative image 724-3 in user interface 700, as described in connection with Figures 7B-7D. In some embodiments, display of second representative image 724-3 occurs according to the operations described below in connection with Figures 7E-7F.

[0271] 7E , in some embodiments, portable multifunction device 100 detects the end of drag gesture 736 (e.g., lift-off) while moving through first area 734 and second area 738. In response, portable multifunction device 100 determines whether drag gesture 736 satisfies a next-sequence navigation criterion. For example, in some embodiments, the next-sequence navigation criterion is satisfied when the movement of first area 734 causes first area 734 to move past halfway across touchscreen 112 (e.g., the midpoint of first area 734 moves off of touchscreen 112). 7E , the next sequence navigation criterion is met when the movement of the first area 734 and the movement of the second area 738 causes the boundary 740 between the first area 734 and the second area 738 to pass the midpoint 742 of the touch screen 112 (or any other suitable predefined point, such as the midpoint of the user interface 700 or one-third or one-quarter of the way across the user interface 700, even if not centered within the touch screen 112). In some embodiments, the next sequence navigation criterion is met when the speed of the drag gesture 736 meets a predefined speed criterion (e.g., when the average or instantaneous speed of the drag gesture 736 exceeds a speed threshold). In some embodiments, the next sequence navigation criterion is met when the speed of the drag gesture 736 indicates a “flick” gesture.

[0272] 7F , if the next sequence navigation criteria are met, portable multifunction device 100 moves first area 734 completely off touchscreen 112 (e.g., by moving first area 734 further to the left until first area 734 is completely off touchscreen 112) and moves second area 738 completely into touchscreen 112 (e.g., by moving second area 738 further to the left until second area 738 is completely within touchscreen 112). As a result, portable multifunction device 100 displays second representative image 724-3 ( FIG. 7F ). In this manner, in some embodiments, ending drag gesture 736 when the next sequence navigation criteria are met gives the user the impression that second representative image 724-3 has been snapped onto user interface 700.

[0273] Conversely, in some embodiments, if the next sequence navigation criteria are not met, portable multifunction device 100 moves second area 738 completely off touchscreen 112 (e.g., by moving second area 738 to the right until second area 738 is completely off touchscreen 112) and moves first area 734 completely into touchscreen 112 (e.g., by moving first area 734 to the right until first area 734 is completely within touchscreen 112). As a result, portable multifunction device 100 redisplays first representative image 702-3 (e.g., returning to the view shown in FIG. 7A ). In this way, in some embodiments, terminating drag gesture 736 when the next sequence navigation criteria are not met gives the user the impression that first representative image 702-3 has snapped back onto user interface 700. In some embodiments, first image sequence 702 and second image sequence 724 are displayed in reverse (e.g., in reverse chronological order) while portable multifunction device 100 moves first area 734 completely into touchscreen 112 and second area 738 completely out of touchscreen 112.

[0274] Figures 7G-7K show similar features to Figures 7B-7F, except that Figures 7B-7F show next sequence navigation according to some embodiments, and Figures 7G-7K show previous sequence navigation according to some embodiments.

[0275] 7G illustrates portable multifunction device 100 detecting drag gesture 744 (starting at location 744-1) on touch screen 112. In some embodiments, the actions illustrated in FIGS. 7G-7K occur pursuant to a determination that drag gesture 744 meets predefined criteria (e.g., predefined previous photo navigation criteria). In some embodiments, the predefined criteria for navigating to a previous photo (e.g., a previous grouped image sequence) are similar to the predefined criteria for navigating to a next photo (e.g., a next grouped image sequence) described with reference to FIGS. 7B-7F, except that the two respective drag gestures point in generally opposite directions (or at least in principle opposite directions).

[0276] FIG. 7G is similar to FIG. 7B , except that drag gesture 744 is in the opposite direction to drag gesture 736 ( FIG. 7B ) while portable multifunction device 100 displays first representative image 702-3. That is, in FIG. 7G , drag gesture 744 is to the right. Accordingly, portable multifunction device 100 moves first area 734 to the right, as shown in FIGS. 7H-7I . In addition, portable multifunction device 100 replaces the display of first representative image 702-3 in movable first area 734 of user interface 700 with a reverse-chronological display of at least a portion of one or more images for first image sequence 702 that were captured by the camera prior to capturing first representative image 702-3 (i.e., image 702-2 of FIG. 7H and image 702-1 of FIG. 7I ). In some embodiments, as described above with reference to Figures 7B-7F, in each image sequence, the display of the progression of images in each area in each image sequence follows the movement of the contact in the drag gesture (e.g., from position 744-1 in Figure 7G to position 744-2 in Figure 7H to position 744-3 in Figure 7I).

[0277] 7H-7I also illustrate that, in some embodiments, portable multifunction device 100 moves third area 746 to the right in accordance with rightward drag gesture 744. In some embodiments, moving third area 746 to the right includes moving at least a portion of third area 746 rightward into touchscreen 112. In some embodiments, movable third area 746 is an area that displays images in third image sequence 726 without displaying images from image sequences other than third image sequence 726 (e.g., first image sequence 702 and second image sequence 724 are not displayed in movable third area 746). In some embodiments, as shown in FIG. 7H, movable third area 746 is adjacent to movable first area 734 (e.g., opposite movable second area 738 and to the left of movable first area 734). In some embodiments, while moving to the right through third area 746, portable multifunction device 100 displays in third area 746 at least a portion of one or more images for third image sequence 726 that were acquired by the camera before acquiring third representative image 726-1 in reverse chronological order.

[0278] In some embodiments, the reverse-chronological display in the third area 746 of at least some of the one or more images for the third image sequence 726 captured by the camera after capturing the third representative image 726-1 is performed according to the movement of the contact in the drag gesture 744 (e.g., in a manner similar to that described above with respect to the first image sequence 702). For example, during the drag gesture 744, the images in the first area 734 and the images in the third area 746 both reverse at a rate that is based on the movement of the drag gesture 744.

[0279] In some embodiments, similar to detecting a drag gesture 744 in the second direction, detecting activation of the Previous icon 750-2 ( FIG. 7A ) animates an image from the first sequence 702 into the first area 734 and an image from the third sequence 726 into the third area 744. In some embodiments, detecting activation of the Previous icon 750-2 replaces the display of the third representative image 726-1 with the display of the first representative image 702-3 without animating an image from the first sequence 702 into the first area 734 and without animating an image from the third sequence 726 into the third area 744. In some embodiments, detecting activation of the Previous icon 750-2 replaces the display of the third representative image 726-1 with the display of the first representative image 702-3 without displaying any other images in the first sequence 702 or the third sequence 726.

[0280] In some embodiments, as an alternative to the example shown in Figures 7G-7I, while moving the third area 746 to the right in response to the drag gesture 744, the third area 746 displays only the third representative image 726-1 for the third image sequence 726 without displaying any other images in the third image sequence 726.

[0281] 7G-7I are described in conjunction with left / right movement of the drag gesture 744, similar actions are contemplated in conjunction with up / down movement of the drag gesture and are intended to be within the scope of the claims unless otherwise specified. For example, in some embodiments, as an alternative to the example shown in Figures 7G-7I, if the drag gesture 744 is a rightward or upward gesture, rather than moving the third area 746 left into the touchscreen 112, the third area 746 is below the first area 734 in the Z-layer (front-back) order, and as the first area 734 moves right (or toward the top) out of the touchscreen 112, the third area 746 appears (e.g., becomes visible).

[0282] As shown in Figure 7K, in some embodiments, after moving third area 746 to the right, portable multifunction device 100 displays third representative image 726-1 on user interface 700, as described in connection with Figures 7G-7I. In some embodiments, the display of third representative image 726-1 occurs according to the operations described below in connection with Figures 7J-7K.

[0283] 7J , in some embodiments, portable multifunction device 100 detects the end of drag gesture 744 (e.g., lift-off) while moving through first area 734 and third area 746. In response, portable multifunction device 100 determines whether drag gesture 744 satisfies a pre-sequence navigation criterion. For example, in some embodiments, the pre-sequence navigation criterion is satisfied when movement of first area 734 causes first area 734 to move past halfway across touchscreen 112 (e.g., the midpoint of first area 734 moves off of touchscreen 112). In some embodiments, as shown in FIG. 7J , the pre-sequence navigation criteria is satisfied when movement of the first area 734 and movement of the third area 746 causes the boundary 748 between the first area 734 and the third area 746 to pass the midpoint 742 of the touch screen 112 (or the midpoint of the user interface 700, even if not centered within the touch screen 112, or any other suitable predetermined point).

[0284] 7K , if the pre-sequence navigation criteria are met, portable multifunction device 100 moves first area 734 completely off touchscreen 112 (e.g., by moving first area 734 further to the right until first area 734 is completely off touchscreen 112) and moves third area 746 completely into touchscreen 112 (e.g., by moving third area 746 further to the right until third area 746 is completely within touchscreen 112). As a result, portable multifunction device 100 displays third representative image 726-1 ( FIG. 7K ). In this manner, in some embodiments, ending drag gesture 744 when the pre-sequence navigation criteria are met gives the user the impression that third representative image 726-1 has been snapped onto user interface 700.

[0285] Conversely, in some embodiments, if the pre-sequence navigation criteria are not met, portable multifunction device 100 moves third area 746 completely off touchscreen 112 (e.g., by moving third area 746 to the left until third area 746 is completely off touchscreen 112) and moves first area 734 completely into touchscreen 112 (e.g., by moving first area 734 to the left and back until first area 734 is completely within touchscreen 112). As a result, portable multifunction device 100 redisplays first representative image 702-3 (e.g., returning to the view shown in FIG. 7A ). In this way, in some embodiments, terminating drag gesture 744 when the pre-sequence navigation criteria are not met gives the user the impression that first representative image 702-3 has snapped back onto user interface 700. In some embodiments, first image sequence 702 and third image sequence 726 are displayed in a forward direction (e.g., chronological order) while portable multifunction device 100 moves first area 734 completely into touchscreen 112 and third area 746 completely out of touchscreen 112.

[0286] 7L-7P illustrate embodiments in which a first area 734 and a second area 738 move on the touch screen 112 at different rates in response to a drag gesture 752. FIG. 7L is similar to FIG. 7A and is provided as a starting point for the functionality illustrated in FIGS. 7M-7P. As illustrated in FIGS. 7M-7O, the drag gesture 752 moves from position 752-1 (FIG. 7M), to position 752-2 (FIG. 7N), to position 752-3 (FIG. 7O). In some embodiments, the movement of the first area 734 corresponds to the movement of the drag gesture 752. For example, if the drag gesture 752 moves 1 centimeter (cm), the first area 734 moves by 1 cm. In some embodiments, the second area 738 moves based on the movement of the drag gesture 752, but the distance the second area 738 moves is less than the distance the drag gesture 752 moves. For example, if the drag gesture 752 moves 1 centimeter (cm), the second area 738 moves 0.5 cm.

[0287] In this example, the first area 734 is above the second area 738 (e.g., in the Z layer), causing the second area 738 to gradually appear as the first area 734 moves off the touchscreen 112 in response to a drag gesture 752. At the beginning of the drag gesture 752, the second area 738 is partially but not completely within the touchscreen 112 (e.g., half or three-quarters of the way through the touchscreen 112). As the user slides the first area 734 to the right and off the touchscreen 112, the second area 738 slides its remaining way into the touchscreen 112, such that sliding the first area 734 completely off the touchscreen 112 corresponds to sliding the second area 738 completely into the touchscreen 112. Moving the first area 734 off the touchscreen 112 at a rate different from the rate at which the second area 738 moves into the touchscreen 112 provides the user with an intuitive visual cue as to the direction in which the user navigates in the hierarchy (e.g., Z layer) of the augmented photograph.

[0288] In some embodiments, during the drag gesture 752, the image in the first area 734 and the image in the second area 738 advance at different rates. In some embodiments, the rate at which the image in the first area 734 and the image in the second area 738 advance are both based on the movement of the drag gesture 752. In some embodiments, the image in the first area 734 advances at a higher rate than the rate at which the image in the second area 738 advances. In Figures 7M-7P, the image in the first area 734 advances at twice the rate of the image in the second area 738 in response to the drag gesture 752. For example, as shown in Figures 7N-7O, during the same period, first area 734 advances between two images in first image sequence 702 (702-4 in Figure 7N and 702-5 in Figure 7O), while second area 738 maintains a display of a single image in the second image sequence (724-2 in Figures 7N and 7O). Figure 7P shows that second area 738 has advanced to display representative image 724-3.

[0289] 7Q-7CC illustrate an embodiment in which device 100 slides an augmented photo into the display. As the augmented photo slides into the display, device 100 chronologically plays the image sequence including the augmented photo (e.g., from the first image to the representative image). In some embodiments, as described above, sliding a new augmented photo into the display displaces the currently displayed augmented photo. For example, sliding an augmented photo into the display slides the currently displayed augmented photo out of the display. As another example, sliding an augmented photo into the display covers the currently displayed augmented photo (e.g., in the Z direction). In some embodiments, the currently displayed augmented photo does not play while being displaced (e.g., the device maintains display of the representative image rather than the currently displayed augmented photo). In some embodiments, augmented photos play forward, regardless of whether it is the next or previous augmented photo (e.g., in the camera roll).

[0290] Thus, FIG. 7Q shows device 100 displaying first representative image 702-3 of first image sequence 702 in movable first area 734 on touchscreen 112.

[0291] As shown in Figure 7Q, the device detects a gesture 740 (e.g., a swipe gesture) on the touch screen 112 that includes a leftward movement of the contact. As shown in Figure 7R, in response to the gesture 740, the device 100 moves a first area 734 leftward out of the display and moves a movable second area 738 leftward into the display (e.g., the second area 738 is a movable area adjacent to the first area 734). The arrow in Figure 7R indicates the inertia resulting from the gesture 740 continuing to move the second area 738 into the display. In this example, because the gesture 740 is left, the image sequence (e.g., the second image sequence 724) that slides into the display is the next image sequence (e.g., in the camera roll).

[0292] As shown in FIGS. 7R-7T, while moving second area 738 to the left pursuant to a determination that the sequence display criteria have been met, device 100 forward plays back at least a portion of one or more images for second image sequence 724 that were captured by the camera prior to capturing second representative image 724-3. For example, device 100 begins by displaying the first image 724-1 from second image sequence 724 (FIG. 7R). Device 100 plays back second image sequence 724 (e.g., chronologically) from the first image 724-1 to representative image 724-3 (FIGS. 7S-7T). In some embodiments, playback of second image sequence 724 is timed so that representative image 724-3 appears just as movable area 738 has finished moving into touchscreen 112 (FIG. 7T).

[0293] In some embodiments, the sequence display criteria include navigation criteria (e.g., criteria that indicate that device 100 should complete the transition to the next or previous photo without further user input). For example, device 100 only plays through second image sequence 724 if the user flicks quickly enough and / or drags far enough to transition to the next image sequence (e.g., second image sequence 724). Navigation criteria have been described in detail above with reference to FIG. 7E.

[0294] In some embodiments, when first area 734 slides off the display, device 100 maintains the display of first representative image 702-3 (e.g., statically without replacing the display of first representative image 702-3) while playing at least a portion of second image sequence 724 (e.g., without playing first image sequence 702 while playing second image sequence 724). In this manner, representative image 702-3 is displayed in first area 734 in each of Figures 7Q-7S.

[0295] In some embodiments, a rightward swipe / drag gesture results in similar functionality, except that the previous extended photo (e.g., in the camera roll) slides into the display instead of the next extended photo (e.g., in the camera roll). For example, in FIG. 7U, device 100 detects swipe gesture 742, which is similar to swipe gesture 740, except that swipe gesture 742 is to the right. In FIGS. 7V-7X, the fourth image sequence 760 (which, in this example, is the previous extended photo in the camera roll) plays forward from the first image 760-1 to the representative image 760-3. That is, in some embodiments, regardless of whether the swipe / drag gesture is a previous or next photo navigation gesture, device 100 plays the extended photos forward (e.g., rather than playing previous photos in the camera roll backward, as described above with reference to FIGS. 7G-7K). 7U-7X are otherwise similar to FIGS. 7Q-7T.

[0296] As shown in FIGS. 7Y-7CC, in some embodiments, the sequence display criteria include criteria that are met when device 100 detects a gesture liftoff (e.g., device 100 begins playing a new augmented photo only when the user lifts the user's finger off touchscreen 112). For example, in FIG. 7Y, device 100 detects the start of drag gesture 764 at position 764-1. In FIG. 7Z, the user has just moved drag gesture 764 to position 764-2, thereby causing device 100 to move first image 760-1 of fourth image sequence 760 partially into the display. In FIG. 7AA, the user has just moved drag gesture 764 further to position 764-3, thereby causing device 100 to move first image 760-1 of fourth image sequence 760 further into the display. However, device 100 does not begin playing the fourth image sequence 760 until the user lifts off the drag gesture 764 (FIG. 7BB). This criterion avoids overly irritating the user as they drag the augmented photograph into and out of the display. As shown in FIG. 7CC, in some embodiments, the playback and / or movement of the movable area following the lift-off gesture is timed so that a representative image of the new augmented photograph (e.g., fourth representative image 760-3) is displayed during playback just as the new augmented photograph has finished sliding into the display.

[0297] 8A-8L show exemplary user interfaces for performing different actions on individual images and related image sequences, according to some embodiments. The user interfaces in these figures are used to illustrate the processes described below, including the processes in FIGS. 9A-9G, 10A-10M, 11A-11I, 12A-12B, 24A-24E, 25A-25C, 26A-26D, and 27A-27E. Although the following examples are described in connection with input on a touch-screen display (where the touch-sensitive surface and display are combined, as shown on portable multifunction device 100), in some embodiments, the device detects input on touch-sensitive surface 451 that is separate from display 450, as shown in FIG. 4B.

[0298] 8A-8L illustrate an example in which portable multifunction device 100 stores multiple image sequences, one of which is grouped image sequence 802 (displayed on user interface 800). Some features of user interface 800 are similar to user interface 600 (FIGS. 6A-6W) and user interface 700 (FIGS. 7A-7CC) and will not be repeated here for brevity. Image sequence 802 includes representative image 802-3 (FIG. 8A) acquired by a camera, one or more images acquired by the camera after acquiring representative image 802-3 (e.g., image 802-4 of FIG. 8C and image 802-5 of FIG. 8D), and one or more images acquired by the camera before acquiring representative image 802-3 (e.g., image 802-1 of FIG. 8E and image 802-2 of FIG. 8F). Thus, the chronological order (eg, the order in which the camera captured the images) of image sequence 802 is image 802-1, image 802-2, image 802-3, image 802-4, and image 802-5.

[0299] Image sequence 802 depicts a scene in which cat 812 walks into view, lies down on the ground, gets up, and walks away. At the same time, a small bird 814 perches on a tree branch. In reality, such a scene may take several seconds to unfold, but in some embodiments, image sequence 802 is captured over a short time window. For example, in some embodiments, any of the image sequences described herein may depict a moment a split second before or after (e.g., within 0.5, 1.0, 1.5, 2.0, or 2.5 seconds) the capture of the respective representative image. For example, a user may be intrigued when cat 812 lies down in the grass, prompting them to capture representative image 802-3. In some embodiments, image sequence 802 includes images taken immediately before and after the capture of first representative image 802-3, such that first image sequence 802 includes an augmented photograph that may "come to life" if the user performs certain actions on representative image 802-3, as described herein.

[0300] 8A-8L, portable multifunction device 100 also stores images that are different from the images in the grouped image sequences. For example, portable multifunction device 100 stores image 824 (FIG. 8I), which is not part of an image sequence in the grouped image sequences (e.g., image 824 is a still image).

[0301] In some embodiments, user interface 800 is a user interface in an image management application (e.g., Photos from Apple Inc., Cupertino, California). As such, in some embodiments, the camera that captured image sequence 802 is part of portable multifunction device 100 (e.g., a camera that includes light sensor 164 in conjunction with imaging module 143 of FIG. 1A). In some embodiments, image sequence 802 was captured with a camera that is not part of portable multifunction device 100 (e.g., image sequence 802 was captured with a camera on another device and then transferred to portable multifunction device 100). In some embodiments, image sequence 802 was obtained in response to detecting activation of a shutter button at a first time, as described herein in connection with FIGS. 5A-5K and method 900 and / or FIGS. 22A-22D and method 2600. In some embodiments, representative image 802-3 corresponds to a representative image captured by a camera as described herein in connection with FIGS. 5A-5K and method 900 and / or FIGS. 22A-22D and method 2600.

[0302] In some embodiments, some of the still images and / or image sequences were acquired using portable multifunction device 100, and some of the image sequences were taken with a camera on a different device and then transferred to portable multifunction device 100. For example, in some situations, a user may acquire (e.g., take, capture) image sequences described in connection with methods 900 / 2600 on multiple devices (e.g., a tablet, laptop, and / or digital camera in addition to portable multifunction device 100) and synchronize or otherwise transfer the image sequences to portable multifunction device 100, which stores the additional still images.

[0303] In some embodiments, user interface 800 is a user interface in a messaging application (e.g., Messages from Apple Inc., Cupertino, California). In some embodiments, image sequence 802 and / or still images 824 are messages in a message conversation displayed in a scrollable area of ​​the messaging application, with image sequence 802 being displayed as the scrollable area of ​​the messaging application is scrolled. In some situations, a user may have acquired (e.g., taken or captured) each image sequence on their own portable multifunction device 100 and received different image sequences or different still images (e.g., in a messaging application) from different users. Thus, in some embodiments, the multiple image sequences stored on portable multifunction device 100 include at least one image sequence or still image acquired using a camera on portable multifunction device 100 and at least one image sequence acquired using a camera on another device different from portable multifunction device 100.

[0304] As shown in FIGS. 8A-8L, portable multifunction device 100 detects two similar inputs: first input 816 ( FIGS. 8B-8F ) and second input 836 ( FIGS. 8K-8L ). First input 816 and second input 836 are similar because they share a common set of characteristics (e.g., meet a common set of predefined criteria), such as intensity characteristics (as shown in intensity diagram 818) and path characteristics (e.g., first input 816 and second input 836 are both long press gestures). First input 816 and second input 836 are the same except that first input 816 is detected on an image that is part of an image sequence (e.g., representative image 802-3), while second input 836 is detected on an image that is not part of an image sequence (e.g., still image 824).

[0305] As a result, portable multifunction device 100 takes a first action if first input 816 is detected while displaying representative image 802-3, and takes a different second action if second input 836 is detected while displaying still image 824. In the example shown in Figures 8B-8F, the first action includes displaying at least a portion of image sequence 802 in the manner described with reference to Figures 6A-6FF and methods 1000 / 10000 / 10050. That is, during first portion 816-1 of first input 816, portable multifunction device 100 plays back images captured by the camera after capturing image 802-3 (e.g., displaying image 802-4 of FIG. 8C and displaying image 802-5 of FIG. 8D), and during second portion 816-2 of first input 816, portable multifunction device 100 plays back images captured by the camera before capturing image 802-3 (e.g., displaying image 802-1 of FIG. 8E and displaying image 802-2 of FIG. 8F). In the example shown in FIGS. 8K-8L, the second action includes displaying an animation showing different portions of still image 824. For example, as shown in FIG. 8L, the second action includes an animation that zooms in on a portion of still image 824 (e.g., a portion below or near second input 836). In addition to or instead of zooming in, in some embodiments, the second action includes displaying information about still image 824 (e.g., metadata 822).

[0306] 8G-8I illustrate navigation gesture 844 (e.g., a drag gesture). The navigation gesture is a leftward gesture that starts at position 844-1, moves to position 844-2, and then moves to position 844-3. Thus, in some embodiments, portable multifunction device 100 transitions from displaying image sequence 802 (e.g., by displaying the sequence as described with reference to FIGS. 7A-7CC) to displaying still image 824 (e.g., image 824 slides across touch screen 112 without animating between the image sequence because it is a still photograph rather than an augmented photograph). In some embodiments, when portable multifunction device 100 detects an input similar to navigation gesture 844 on a still image, it transitions to a different image without displaying the images associated with the still image (e.g., because they do not exist).

[0307] 9A-9G show a flow diagram of a method 900 for capturing a grouped sequence of related images according to some embodiments. Method 900 is performed on an electronic device with a display and a camera (e.g., device 300 of FIG. 3 or portable multifunction device 100 of FIG. 1A). In some embodiments, the device includes one or more sensors for detecting the intensity of contact with the touch-sensitive surface. In some embodiments, the display is a touchscreen display, and the touch-sensitive surface is on or integrated into the display. In some embodiments, the display is separate from the touch-sensitive surface. Some operations in method 900 are optionally combined, and / or the order of some operations is optionally changed.

[0308] While in a first media capture mode for the camera, the device displays (902) a live preview on the display (e.g., as shown in FIG. 5A ) (e.g., the device displays images in real time or near real time as they are being captured by the camera). For example, the first media capture mode may be a mode named extended photo mode, moment mode, etc.

[0309] In some embodiments, the first media capture mode is configured to be enabled or disabled by a user of the device (e.g., via a settings interface for the camera) (904). In some embodiments, the device includes at least three media capture modes: (1) a first media capture mode (which may be considered an “extended still image” capture mode) that groups an image sequence in response to detecting shutter button activation, where the image sequence includes images captured before and after shutter button activation, and stores the group of images; (2) a second media capture mode (e.g., a traditional still image capture mode) that stores a single image in response to detecting shutter button activation, similar to the still image mode of a traditional digital camera; and (3) a third media capture mode (e.g., a video capture mode) that stores a video captured after detecting shutter button activation and continues recording the video until the shutter button is activated again. In some embodiments, a user can select whether to enable the media capture mode via a settings interface for the camera, a mode selection button, a mode selection dial, or the like.

[0310] In some embodiments, the live preview is displayed (906) as part of a media capture user interface that includes an affordance for activating a first media capture mode (e.g., affordance 506 in FIGS. 5A-5H ). The affordance is animated while the first media capture mode is enabled (e.g., to indicate that image and / or audio data is being captured while the media capture user interface is displayed) and is not animated while the first media capture mode is disabled. In some embodiments, in response to detecting a selection of the affordance (e.g., a tap gesture on the affordance) while the first media capture mode is disabled, the device activates the first media capture mode, begins capturing media (e.g., images and / or audio), and begins animating the affordance. In some embodiments, capturing media includes recording images and / or audio. In some embodiments, capturing media includes storing the images and / or audio (e.g., to persistent memory).

[0311] While displaying the live preview, the device detects (908) an activation of the shutter button at a first time (e.g., the device detects a press of a physical button at a first time, or detects a gesture on a virtual shutter button on the touch-sensitive display at the first time, such as a tap gesture on a shutter release icon (as shown in FIG. 5F ) or a tap gesture on the live preview (where the live preview acts as a virtual shutter button). In some embodiments, the detected activation is a single activation of the shutter button (e.g., similar to a single activation used in a conventional digital camera to capture a single image in the still image mode of the conventional digital camera).

[0312] In response to detecting activation of the shutter button at the first time, the device groups (910) a plurality of images acquired by the camera in a temporal vicinity of activation of the shutter button at the first time into a first image sequence (e.g., as shown in FIGS. 5I-5K). The first image sequence includes a plurality of images acquired by the camera before detecting activation of the shutter button at the first time, a representative image that is representative of the first image sequence and that the camera acquired after one or more of the other images in the first image sequence, and a plurality of images acquired by the camera after acquiring the representative image.

[0313] In some embodiments, the representative image is acquired by the camera at a first time and is similar to a single image captured when activating its shutter button in still image mode of a conventional digital camera. In some embodiments, the representative image acquired by the camera corresponds to an image acquired at the first time. In some embodiments, the representative image acquired by the camera corresponds to an image acquired shortly after detecting activation of the shutter button at the first time, taking into account shutter lag (the time delay between detecting activation of the shutter button and capturing / storing the representative image). In some embodiments, the representative image acquired by the camera is used to represent a sequence of images, for example, in an image presentation mode.

[0314] In some embodiments, the first image sequence includes a predetermined number of images, such as 5, 10, 15, 20, 25, or 30 images, acquired after acquiring the representative image. In some embodiments, the images acquired after acquiring the representative image are images within a predetermined time after acquiring the representative image (e.g., within 0.5, 1.0, 1.5, 2.0, or 2.5 seconds after acquiring the representative image). In some embodiments, the first image sequence includes a predetermined number of images, such as 5, 10, 15, 20, 25, or 30 images, acquired after activation of the shutter button at a first time. In some embodiments, the images acquired after detecting activation of the shutter button at a first time are images within a predetermined time after the first time (e.g., within 0.5, 1.0, 1.5, 2.0, or 2.5 seconds after the first time). In some embodiments, the images in the first image sequence acquired after acquiring the representative image satisfy predetermined grouping criteria. In some embodiments, the predetermined grouping criteria include selecting a predetermined number of images after the representative image. In some embodiments, the predetermined grouping criteria includes selecting images that fall within a predetermined time range immediately following detection of shutter button activation, hi some embodiments, the predetermined grouping criteria includes selecting images that fall within a predetermined time range immediately following the time the representative image was captured.

[0315] In some embodiments, the first image sequence is stored 912 in memory as a first separate set of images (e.g., stored together in a data structure in non-volatile memory). In some embodiments, a representative image captured by a camera is used to represent the first separate set of images, for example, in an image presentation mode (e.g., FIGS. 6A-6FF, 7A-7CC, and 8A-8L).

[0316] In some embodiments, the live preview displays images at a first resolution, and the first image sequence includes images at the first resolution displayed in the live preview (914) (e.g., the first resolution is lower than the upper resolution limit of the camera). In some embodiments, the representative image acquired by the camera has a second resolution (916) that is higher than the first resolution. In some embodiments, the representative image acquired by the camera has a higher resolution than the other images in the first image sequence. For example, the representative image acquired by the camera is a 12, 18, or 24 megapixel image, and the other images in the first image sequence have a lower resolution corresponding to the resolution displayed in the live preview (e.g., the first resolution). In some embodiments, the representative image acquired by the camera has the same resolution as the other images in the first image sequence.

[0317] In some embodiments, parameters for each image sequence grouped in response to detecting each activation of the shutter button are configurable by a user of the device 918. For example, through a settings interface for the camera, the user can select the number of images in each sequence, which image is the representative image of the sequence (e.g., as shown in FIGS. 5I-5K), and / or other acquisition or display parameters for the image sequence (e.g., the resolution of each image, the resolution of the other images, the frame rate, filter effects, etc.).

[0318] In some embodiments, a plurality of images captured by the camera prior to detecting activation of the shutter button at a first time are stored in memory (e.g., program memory, volatile memory, ring buffer, etc.) in a first form prior to detecting activation of the shutter button at the first time, and are stored in memory (e.g., non-volatile memory / storage) in a second form in response to detecting activation of the shutter button at the first time (920).

[0319] In some embodiments, the number of images captured prior to detecting activation of the shutter button at the first time is a predetermined number of images (e.g., 5, 10, 15, 20, 25, or 30 images) (922).

[0320] In some embodiments, the plurality of images captured prior to detecting activation of the shutter button at the first time are images within a predetermined time before the first time (e.g., images within 0.5, 1.0, 1.5, 2.0, or 2.5 seconds before the first time) (924).

[0321] In some embodiments, the plurality of images captured prior to detecting activation of the shutter button at the first time are images within a predetermined time before the time the representative image was captured (e.g., images within 0.5, 1.0, 1.5, 2.0, or 2.5 seconds before the time the representative image was captured) (926).

[0322] In some embodiments, the plurality of images acquired prior to detecting shutter button activation at a first time are from a time range between the first time and a second time that is prior to the first time, and acquiring the plurality of images prior to detecting shutter button activation at the first time is independent of detecting interaction with the shutter button that is near in time to the second time (other than detecting shutter activation at the first time) (928). For example, the plurality of images acquired prior to detecting shutter button activation at the first time are not acquired in response to detecting interaction with the shutter button that is near in time to the second time (other than detecting shutter activation at the first time). For example, the plurality of images acquired prior to detecting shutter button activation at the first time are not acquired in response to detecting partial (or full) activation of the shutter button at or near the second time.

[0323] In some embodiments, a plurality of images in the first image sequence that were acquired prior to detecting shutter button activation at a first time satisfy one or more predefined grouping criteria (930). In some embodiments, the predefined grouping criteria include selecting a predefined number of images prior to detecting shutter button activation (932). In some embodiments, the predefined grouping criteria include selecting a predefined number of images prior to the representative image (934). In some embodiments, the predefined grouping criteria include selecting images that fall within a predefined time range immediately prior to detecting shutter button activation (936). In some embodiments, the predefined grouping criteria include selecting images that fall within a predefined time range immediately prior to the time the representative image was acquired (938).

[0324] In some embodiments, the live preview is displayed as a portion of a media capture user interface that includes an affordance for activating a first media capture mode, and the shutter button is a software button displayed in the media capture user interface (e.g., shutter button 514 in FIGS. 5A-5H) (940). In response to detecting activation of the shutter button (e.g., tap gesture 518 in FIG. 5F), the device displays an animation associated with the shutter button (e.g., an animation of portions of the shutter button breaking apart and coming back together, as shown in FIGS. 5F-5H) that lasts for a time corresponding to the time after shutter button activation that the camera acquires images for the first image sequence (942) (e.g., to provide an indication to the user that media is still being captured). In some embodiments, the animation is a looping animation that may be extended seamlessly if the shutter button is activated again before the camera finishes acquiring images for the first image sequence.

[0325] In some embodiments, the device begins capturing and storing images upon entering the first media capture mode (independently of detecting shutter button activation) 944. While the device is in the first media capture mode, it deletes (or marks for deletion) 946 images that are not grouped into respective plurality of images in the respective temporal vicinity of the shutter button activation.

[0326] In some embodiments, the device begins capturing and storing images upon displaying the live preview (independently of detecting shutter button activation) 948. While the device is in the first media capture mode, it deletes (or marks for deletion) 950 images that are not grouped into respective plurality of images in the respective temporal vicinity of the shutter button activation.

[0327] In some embodiments, the device acquires and stores images while displaying the live preview independent of detecting shutter button activation (952). While the device is in the first media capture mode, it deletes (or marks for deletion) (954) acquired and stored images that are not grouped into respective plurality of images in the respective temporal vicinity of the shutter button activation.

[0328] In some embodiments, a user can select the length of time to retain images before discarding them if they are not grouped into an image sequence. For example, a user can set the device to retain images displayed in live preview mode for 5, 10, or 20 seconds. For example, assuming a user selects a time length of 5 seconds, images displayed in live preview will be retained for 5 seconds after being displayed in live preview and then discarded (e.g., deleted or marked for deletion) if they are not grouped into an image sequence by activation of the shutter button.

[0329] In some embodiments, in response to detecting activation of the shutter button at a first time, the device associates (956) audio corresponding to the first image sequence (e.g., including audio recorded before detecting activation of the shutter button and audio recorded after detecting activation of the shutter button). In some embodiments, the device includes (or is in communication with) a microphone, and audio detected when capturing the image sequence is stored in memory and linked (or otherwise associated) with the stored first image sequence. For example, FIGS. 6E-6I show playback of an image sequence with corresponding audio.

[0330] In some embodiments, in response to detecting activation of the shutter button at the first time, the device associates (958) metadata corresponding to the first image sequence with the first image sequence (e.g., FIGS. 6J-6M show playback of an image sequence with the corresponding metadata). In some embodiments, metadata for the image sequence, such as time, date, location (e.g., via GPS), weather, music playing when the image sequence was captured (e.g., music identified by the device's music identification software, such as Shazam®, SoundHound®, or Midomi®), local event information (e.g., a sports game that was taking place at the time and location when the first image sequence was captured), post-event information (e.g., the final score), etc., is stored in memory and linked (or otherwise associated) with the stored image sequence.

[0331] In some embodiments, the device automatically removes (960) blurry images from the first image sequence (or deletes or does not display them as part of the sequence).

[0332] In some embodiments, after detecting a shutter button activation at a first time, the device detects a next shutter button activation at a second time (962) (without detecting any shutter button activations between the first and second times). In response to detecting a next shutter button activation at the second time, the device groups a plurality of images acquired by the camera in a temporal vicinity of the shutter button activation at the second time into a second image sequence (964). The second image sequence includes a plurality of images acquired by the camera before detecting the shutter button activation at the second time and a representative image that is representative of the second image sequence and that was acquired by the camera after one or more of the other images in the second image sequence. In some embodiments, capturing an image sequence is done in a manner similar to capturing individual images with a conventional digital camera, making capturing such an image sequence simple and intuitive, even for novice users. In a conventional digital camera, an individual image is captured with each shutter button activation. Here, an image sequence is captured with each shutter button activation. This method of capturing image sequences differs from the method of capturing video with a conventional digital camera, where the first activation of the shutter button starts recording the video, and the second activation of the shutter button stops recording the video.

[0333] In some embodiments, the first and / or last frame in the sequence is changed in accordance with the change in the representative image (e.g., as shown in FIGS. 5I-5K). Thus, in some embodiments, the first image sequence includes a first image in the first image sequence, a first number of images captured between the first and representative images, a last image in the first image sequence, and a second number of images captured between the representative and last images (966). The device detects an input corresponding to a request to change the representative image in the first image sequence (968). In some embodiments, while in the image sequence editing mode, the device detects a gesture (e.g., a drag gesture or a tap gesture) that moves a representative image selection indicator from the current representative image to another image in the first image sequence (e.g., touch gesture 522). In some embodiments, while in the image sequence editing mode, the device detects a gesture (e.g., a drag gesture or a tap gesture) that moves the current representative image out of the representative image selection area and moves another image in the first image sequence into the representative image selection area. In response to detecting an input corresponding to a request to change the representative image in the first image sequence, the device changes the representative image to a corrected representative image in accordance with the detected input, and modifies the grouped images in the first image sequence by adding an image to one end of the first image sequence and deleting an image at the other end of the first image sequence in accordance with the detected input so that the first image sequence has a corrected first image and a corrected last image (970).

[0334] In some embodiments, the number of images between the initial image and the representative image is the same as the number of images between the corrected initial image and the corrected representative image. In some embodiments, the number of images between the representative image and the last image is the same as the number of images between the corrected representative image and the corrected last image. In some embodiments, the added image is temporally near one end of the first image sequence. For example, if the corrected representative image is three images before in the first image sequence, three images (captured immediately before the first image) are added to the beginning of the first sequence (with the earliest of the three images becoming the corrected first image), and three images are deleted from the end of the first sequence.

[0335] In some embodiments, the display is a touch-sensitive display (972). The device receives a request to display a representative image from the first image sequence (974). In response to receiving the request to display the representative image, the device displays the representative image on the touch-sensitive display (976). While displaying the representative image, the device receives a touch input on the touch-sensitive display onto the representative image, the touch input including a characteristic that varies over time (978). For example, the intensity of the touch input varies over time, or the location of the contact in the touch input varies over time (e.g., due to lateral movement of the contact across the touch-sensitive display). In response to receiving the touch input on the representative image on the touch-sensitive display, the device displays (980) images in the first image sequence (e.g., sequentially) at a rate determined based on the change in the characteristic of the touch input over time (e.g., as described with reference to the press and hold gestures of FIGS. 6A-6FF or the navigational drag gestures of FIGS. 7A-7CC).

[0336] It should be understood that the particular order described for the operations in Figures 9A-9G is merely exemplary, and that the described order is not intended to indicate the only order in which the operations may be performed. Those skilled in the art will recognize various ways of reordering the operations described herein. Additionally, it should be noted that other process details described herein with respect to other methods described herein (e.g., methods 1000, 10000, 10050, 1100, 11000, 1200, 2400, 2500, 2600, and 2700) are also applicable in an analogous manner to method 900 described above in connection with Figures 9A-9G. For example, the contacts, gestures, user interface objects, intensity thresholds, animations, and image sequences described above in connection with method 900 optionally have one or more of the characteristics of the contacts, gestures, user interface objects, intensity thresholds, animations, and image sequences described herein in connection with other methods described herein (e.g., methods 1000, 10000, 10050, 1100, 11000, 1200, 2400, 2500, 2600, and 2700). For the sake of brevity, these details will not be repeated here. In addition, it should be noted that other process details described in Appendix A are also applicable in a similar manner to method 900 described above in connection with FIGS. 9A-9G. For example, the acquisition, grouping, and storage operations described above in connection with method 900 optionally have one or more of the characteristics of the capture, crop, store, or retrieval operations for augmented photographs described in Appendix A.

[0337] 10A-10E show a flow diagram of a method 1000 for displaying (or playing) a related image sequence, according to some embodiments. Method 1000 is performed on an electronic device with a display and a touch-sensitive surface (e.g., device 300 of FIG. 3 or portable multifunction device 100 of FIG. 1A). In some embodiments, the device includes one or more sensors for detecting the intensity of contact with the touch-sensitive surface. In some embodiments, the display is a touchscreen display, and the touch-sensitive surface is on or integrated into the display. In some embodiments, the display is separate from the touch-sensitive surface. Some operations of method 1000 are optionally combined, and / or the order of some operations is optionally changed.

[0338] The device displays 1002 a representative image on a display (e.g., while the device is in an image presentation mode (see FIG. 6A )). The representative image is an image in a sequence of images taken by a camera. The image sequence includes one or more images acquired by the camera after acquiring the representative image. The image sequence also includes one or more images acquired by the camera before acquiring the representative image. In some embodiments, the camera that captured the image sequence is part of the electronic device. In some embodiments, the image sequence was captured by a camera that is not part of the electronic device (e.g., the image sequence was captured by a camera on another device and then transferred to the electronic device). In some embodiments, the image sequence was captured in response to detecting activation of a shutter button at a first time, as described herein in connection with FIGS. 5A-5K and method 900 and / or FIGS. 22A-22D and method 2600. In some embodiments, the representative image corresponds to a representative image captured by a camera, as described herein in connection with FIGS. 5A-5K and method 900 and / or FIGS. 22A-22D and method 2600.

[0339] While displaying the representative image on the display, the device detects (1004) a first portion of a first input (e.g., an input on the touch-sensitive surface (see first portion 616-1 of first input 616 in FIGS. 6B-6D )). In some embodiments, the first input is (1006) a press and hold gesture (e.g., a press and hold finger gesture on the representative image on the touch-sensitive display, or a press and hold finger gesture on a trackpad while a cursor or other focus selector is over the representative image on the display). In some embodiments, the first input is a click-and-hold input with a mouse while a cursor or other focus selector is over the representative image on the display. In some embodiments, the device includes one or more sensors on the touch-sensitive surface that detect the intensity of contact, and the first input includes a finger contact that satisfies a first contact intensity criterion (e.g., a finger gesture on a representative image on a touch-sensitive display, or a finger gesture on a trackpad while a cursor or other focus selector is over the representative image on the display, where the finger gesture contact exceeds a light (or deep) pressure intensity threshold over at least a portion of the input) (1008). For example, as shown in FIGS. 6B-6D , the first input 616 is a long press input that exceeds a light pressure intensity threshold ITL.

[0340] In response to detecting the first portion of the first input, the device replaces the display of the representative image with a sequential display of one or more images acquired by the camera after capturing the representative image (1010) (e.g., as shown in FIGS. 6B-6D ). Thus, in some embodiments, in response to detecting the first portion of the first input, one or more images acquired by the camera after capturing the representative image are sequentially displayed. In some embodiments, in response to detecting the first portion of the first input, one or more images acquired by the camera after capturing the representative image are sequentially displayed (1012) at a rate based on the intensity of the contact at the first portion of the first input (e.g., the display rate increases as the intensity of the contact at the first portion of the first input increases, and the display rate decreases as the intensity of the contact at the first portion of the first input decreases). In some embodiments, the rate at which images are sequentially displayed from the representative image to the last image (in response to detecting the first portion of the first input) varies according to the intensity of the contact at the first portion of the first input. In some embodiments, after this initial dependence of the display rate on the contact intensity of the first input, subsequent image sequences (in response to detecting subsequent portions of the first input, as shown in FIGS. 6E-6M ) are displayed at a fixed display rate independent of the contact intensity of the subsequent portions of the first input. In some embodiments, one or more images acquired by the camera after capturing the representative image are displayed sequentially at a fixed rate in response to detecting the first portion of the first input. In some embodiments, the position of progression between image sequences is based on the intensity of the contact (e.g., a particular intensity of contact is mapped to a corresponding amount of progression between image sequences, as shown in FIGS. 6P-6V and 6W ). In some embodiments, this mapping between intensity and animation progression applies when the contact intensity is between ITL and ITD; when the contact intensity is above ITD, the animation between image sequences progresses at a default rate (e.g., 1x real time) or at a rate determined based on the intensity of the contact (e.g., faster for higher intensity contacts and slower for lower intensity contacts).In some embodiments, replacing displaying the representative image with sequentially displaying one or more imag...

Claims

1. An electronic device comprising a display, a camera, one or more processors and a memory, While in a first media capture mode for the camera, displaying a live preview on the display; Detecting activation of a shutter button at a first time while displaying the live preview; in response to detecting activation of the shutter button at the first time; grouping a plurality of images acquired by the camera in a temporal vicinity of the activation of the shutter button at the first time into a first image sequence, the first image sequence comprising: a plurality of images acquired by the camera prior to detecting activation of the shutter button at the first time; a representative image representative of the first sequence of images and acquired by the camera after one or more of the other images in the first sequence of images; a plurality of images acquired by the camera after acquiring the representative image; and A method comprising:

2. The method of claim 1 , wherein the plurality of images captured prior to detecting activation of the shutter button at the first time is a predetermined number of images.

3. The method of claim 1 , wherein the plurality of images captured prior to detecting activation of the shutter button at the first time are images within a predetermined time period before the first time period.

4. The method of claim 1 , wherein the plurality of images captured prior to detecting activation of the shutter button at the first time are images within a predetermined time period prior to the time at which the representative image was captured.

5. 2. The method of claim 1, wherein the plurality of images acquired prior to detecting activation of the shutter button at the first time are from a time range between the first time and a second time that is prior to the first time, and wherein acquiring the plurality of images prior to detecting activation of the shutter button at the first time is independent of detecting an interaction with the shutter button that is temporally proximate to the second time.

6. The method of claim 1 , wherein the plurality of images in the first sequence of images acquired prior to detecting activation of the shutter button at the first time meet one or more predefined grouping criteria.

7. The method of claim 6 , wherein the predetermined grouping criteria includes selecting a predetermined number of images before detecting activation of the shutter button.

8. The method of claim 6 , wherein the predetermined grouping criteria includes selecting a predetermined number of images before the representative image.

9. The method of claim 6 , wherein the predetermined grouping criteria includes selecting images that fall within a predetermined time range immediately prior to detecting activation of the shutter button.

10. The method of claim 6 , wherein the predetermined grouping criteria includes selecting images that fall within a predetermined time range immediately preceding the time at which the representative image was acquired.

11. 11. The method of claim 1, wherein the device begins capturing and storing images upon entering the first media capture mode, and then, while in the first media capture mode, deletes images that are not grouped into respective plurality of images in the temporal vicinity of activation of the shutter button at respective times.

12. 11. The method of claim 1, wherein the device begins capturing and storing images upon displaying the live preview, and then, while in the first media capture mode, deletes images that are not grouped into respective plurality of images in the temporal vicinity of activation of the shutter button at the respective time.

13. 2. The method of claim 1, wherein the device acquires and stores images while displaying the live preview independently of detecting activation of the shutter button, and deletes acquired and stored images while in the first media capture mode that are not grouped into respective plurality of images in a temporal vicinity of activation of the shutter button at respective times.

14. 14. The method of claim 1, wherein the first sequence of images is stored in the memory as a first separate set of images.

15. 15. The method of claim 1, wherein the live preview displays images at a first resolution, and the first image sequence includes images displayed in the live preview at the first resolution.

16. The method of claim 15 , wherein the representative image captured by the camera has a second resolution that is higher than the first resolution.

17. in response to detecting activation of the shutter button at the first time; Associating audio corresponding to the first image sequence with the first image sequence.

17. The method of any one of claims 1 to 16, comprising:

18. in response to detecting activation of the shutter button at the first time; Associating metadata corresponding to the first image sequence with the first image sequence.

18. The method of any one of claims 1 to 17, comprising:

19. The method of claim 1 , wherein the first media capture mode is configured to be enabled or disabled by a user of the device.

20. the live preview is displayed as part of a media capture user interface that includes an affordance for activating the first media capture mode; the affordance is animated while the first media capture mode is enabled; The method of claim 19 , wherein the affordance is not animated while the first media capture mode is disabled.

21. 21. The method of claim 1, wherein parameters for each image sequence grouped in response to detecting a respective activation of the shutter button are configurable by a user of the device.

22. the live preview is displayed as part of a media capture user interface that includes an affordance for activating the first media capture mode; the shutter button is a software button displayed on the media capture user interface; The method comprises: In response to detecting the activation of the shutter button, the camera acquires images for the first image sequence, displaying an animation associated with the shutter button that lasts for a time corresponding to a time after the activation of the shutter button.

22. The method of any one of claims 1 to 21, comprising:

23. 23. The method of any one of claims 1 to 22, wherein the plurality of images acquired by the camera prior to detecting activation of the shutter button at the first time are stored in the memory in a first form prior to detecting activation of the shutter button at the first time, and are stored in the memory in a second form in response to detecting activation of the shutter button at the first time.

24. after detecting an activation of the shutter button at the first time, detecting a next activation of the shutter button at a second time; in response to detecting the next activation of the shutter button at the second time; grouping a plurality of images acquired by the camera in a temporal vicinity of the activation of the shutter button at the second time into a second image sequence, the second image sequence comprising: a plurality of images acquired by the camera prior to detecting activation of the shutter button at the second time; a representative image representative of the second sequence of images and acquired by the camera after one or more of the other images in the second sequence of images; and The method of claim 1 , comprising:

25. 25. The method of any one of claims 1 to 24, comprising automatically excluding blurry images from the first sequence of images.

26. the first sequence of images a first image in the first sequence of images; a first number of images acquired between the initial image and the representative image; a last image in the first sequence of images; a second number of images acquired between the representative image and the last image; Including, The method comprises: detecting an input corresponding to a request to change the representative image in the first sequence of images; in response to detecting the input corresponding to the request to change the representative image in the first sequence of images; changing the representative image to a corrected representative image according to the detected input; modifying the grouped images in the first image sequence by adding an image to one end of the first image sequence and deleting an image at the other end of the first image sequence so that the first image sequence has a corrected first image and a corrected last image according to the detected input; 26. The method of any one of claims 1 to 25, comprising:

27. the display is a touch-sensitive display, and the method comprises: receiving a request to display the representative image from the first sequence of images; displaying the representative image on the touch-sensitive display in response to receiving the request to display the representative image; receiving a touch input on the touch-sensitive display onto the representative image while displaying the representative image, the touch input including a time-varying characteristic; responsive to receiving the touch input onto the representative image on the touch-sensitive display, displaying images in the first sequence of images at a rate determined based on the change in the characteristic of the touch input over time; 27. The method of any one of claims 1 to 26, comprising:

28. The display and A camera and one or more processors; Memory and one or more programs stored in the memory and configured to be executed by the one or more processors, the one or more programs comprising: While in a first media capture mode for the camera, displaying a live preview on the display; Detecting activation of a shutter button at a first time while displaying the live preview; in response to detecting activation of the shutter button at the first time; one or more programs including instructions for grouping into a first image sequence a plurality of images acquired by the camera in a temporal vicinity of the activation of the shutter button at the first time; the first sequence of images a plurality of images acquired by the camera prior to detecting activation of the shutter button at the first time; a representative image representative of the first sequence of images and acquired by the camera after one or more of the other images in the first sequence of images; a plurality of images acquired by the camera after acquiring the representative image; , an electronic device.

29. 1. A computer-readable storage medium storing one or more programs, the one or more programs including instructions that, when executed by an electronic device comprising a display, a camera, a memory, and one or more processors, cause the device to: While in a first media capture mode for the camera, displaying a live preview on the display; Detecting activation of a shutter button at a first time while displaying the live preview; in response to detecting activation of the shutter button at the first time; grouping a plurality of images acquired by the camera in a temporal vicinity of the activation of the shutter button at the first time into a first image sequence, the first image sequence comprising: a plurality of images acquired by the camera prior to detecting activation of the shutter button at the first time; a representative image representative of the first sequence of images and acquired by the camera after one or more of the other images in the first sequence of images; a plurality of images acquired by the camera after acquiring the representative image; including a computer-readable storage medium.

30. The display and A camera and enabled while in a first media capture mode for the camera; displaying a live preview on the display; Detecting activation of a shutter button at a first time while displaying the live preview; in response to detecting activation of the shutter button at the first time; grouping into a first image sequence a plurality of images acquired by the camera in a temporal vicinity of the activation of the shutter button at the first time; the first sequence of images a plurality of images acquired by the camera prior to detecting activation of the shutter button at the first time; a representative image representative of the first sequence of images and acquired by the camera after one or more of the other images in the first sequence of images; a plurality of images acquired by the camera after acquiring the representative image; , an electronic device.

31. 1. An information processing device for use in an electronic device having a display and a camera, comprising: enabled while in a first media capture mode for the camera; displaying a live preview on the display; Detecting activation of a shutter button at a first time while displaying the live preview; in response to detecting activation of the shutter button at the first time; and grouping a plurality of images acquired by the camera in a temporal vicinity of the activation of the shutter button at the first time into a first image sequence, the first image sequence comprising: a plurality of images acquired by the camera prior to detecting activation of the shutter button at the first time; a representative image representative of the first sequence of images and acquired by the camera after one or more of the other images in the first sequence of images; a plurality of images acquired by the camera after acquiring the representative image; An information processing device comprising:

32. The display and A camera and one or more processors; Memory and one or more programs stored in the memory and configured to be executed by the one or more processors, the one or more programs including instructions for performing any of the methods of claims 1 to 27; and An electronic device comprising:

33. 28. A computer-readable storage medium storing one or more programs, the one or more programs including instructions that, when executed by an electronic device having a display and a camera, cause the device to perform any of the methods of claims 1 to 27.

34. 28. A graphical user interface on an electronic device comprising a display, a camera, a memory and one or more processors for executing one or more programs stored in the memory, the graphical user interface comprising a user interface displayed according to any of the methods of claims 1 to 27.

35. The display and A camera and means for carrying out any of the methods according to claims 1 to 27; An electronic device comprising:

36. 1. An information processing device for use in an electronic device having a display and a camera, comprising: Means for carrying out any of the methods of claims 1 to 27. An information processing device comprising:

37. a display unit configured to display a live preview; a camera unit configured to acquire an image; a processing unit connected to the display unit and the camera unit, While in a first media capture mode for the camera unit, displaying the live preview on the display unit; Detecting activation of a shutter button at a first time while displaying the live preview; in response to detecting activation of the shutter button at the first time; and grouping into a first image sequence a plurality of images captured by the camera unit in a temporal vicinity of the activation of the shutter button at the first time; the first sequence of images a plurality of images acquired by the camera unit prior to detecting activation of the shutter button at the first time; a representative image representative of the first sequence of images and acquired by the camera unit after one or more other images in the first sequence of images; a plurality of images acquired by the camera unit after acquiring the representative image; , an electronic device.

38. 38. The electronic device of claim 37, wherein the plurality of images captured prior to detecting activation of the shutter button at the first time is a predetermined number of images.

39. 38. The electronic device of claim 37, wherein the plurality of images captured prior to detecting activation of the shutter button at the first time are images within a predetermined time before the first time.

40. 38. The electronic device of claim 37, wherein the plurality of images captured prior to detecting activation of the shutter button at the first time are images within a predetermined time period prior to the time at which the representative image was captured.

41. 38. The electronic device of claim 37, wherein the plurality of images captured prior to detecting activation of the shutter button at the first time are from a time range between the first time and a second time that is prior to the first time, and wherein capturing the plurality of images prior to detecting activation of the shutter button at the first time is independent of detecting an interaction with the shutter button that is near in time to the second time.

42. 38. The electronic device of claim 37, wherein the images in the first sequence of images acquired prior to detecting activation of the shutter button at the first time satisfy one or more predefined grouping criteria.

43. 43. The electronic device of claim 42, wherein the predetermined grouping criteria includes selecting a predetermined number of images before detecting activation of the shutter button.

44. 43. The electronic device of claim 42, wherein the predetermined grouping criteria includes selecting a predetermined number of images before the representative image.

45. 43. The electronic device of claim 42, wherein the predetermined grouping criteria includes selecting images that fall within a predetermined time range immediately prior to detecting activation of the shutter button.

46. 43. The electronic device of claim 42, wherein the predetermined grouping criteria includes selecting images that fall within a predetermined time range immediately preceding the time at which the representative image was captured.

47. 47. The electronic device of claim 37, wherein the device begins capturing and storing images upon entering the first media capture mode, and then, while in the first media capture mode, deletes images that are not grouped into a respective plurality of images in the temporal vicinity of activation of the shutter button at the respective time.

48. 47. The electronic device of claim 37, wherein the device begins capturing and storing images upon displaying the live preview, and then, while in the first media capture mode, deletes images that are not grouped into respective plurality of images in the temporal vicinity of activation of the shutter button at respective times.

49. 38. The electronic device of claim 37, wherein the device acquires and stores images while displaying the live preview independently of detecting activation of the shutter button, and deletes acquired and stored images while in the first media capture mode that are not grouped into respective plurality of images in the respective temporal vicinity of activation of the shutter button.

50. 50. An electronic device according to any one of claims 37 to 49, wherein the first sequence of images is stored in the memory as a first separate set of images.

51. 51. The electronic device of claim 37, wherein the live preview displays images at a first resolution, and the first image sequence includes images displayed in the live preview at the first resolution.

52. 52. The electronic device of claim 51, wherein the representative image captured by the camera unit has a second resolution that is higher than the first resolution.

53. The processing unit in response to detecting activation of the shutter button at the first time; Associating audio corresponding to the first image sequence with the first image sequence.

53. An electronic device according to any one of claims 37 to 52, configured to:

54. The processing unit in response to detecting activation of the shutter button at the first time; Associating metadata corresponding to the first image sequence with the first image sequence.

54. An electronic device according to any one of claims 37 to 53, configured to:

55. 55. The electronic device of any one of claims 37 to 54, wherein the first media capture mode is configured to be enabled or disabled by a user of the device.

56. the live preview is displayed as part of a media capture user interface that includes an affordance for activating the first media capture mode; the affordance is animated while the first media capture mode is enabled; the affordance is not animated while the first media capture mode is disabled; 56. The electronic device of claim 55.

57. 57. An electronic device according to any one of claims 37 to 56, wherein parameters for each image sequence grouped in response to detecting a respective activation of the shutter button are configurable by a user of the device.

58. the live preview is displayed as part of a media capture user interface that includes an affordance for activating the first media capture mode; the shutter button is a software button displayed on the media capture user interface; The processing unit In response to detecting the activation of the shutter button, the camera unit acquires images for the first image sequence, and displaying an animation associated with the shutter button on the display unit that lasts for a time corresponding to a time after the activation of the shutter button.

58. An electronic device according to any one of claims 37 to 57, configured to:

59. 59. The electronic device of claim 37, wherein the plurality of images captured by the camera unit prior to detecting activation of the shutter button at the first time are stored in the memory in a first form prior to detecting activation of the shutter button at the first time, and are stored in the memory in a second form in response to detecting activation of the shutter button at the first time.

60. The processing unit after detecting an activation of the shutter button at the first time, detecting a next activation of the shutter button at a second time; in response to detecting the next activation of the shutter button at the second time; and grouping a plurality of images acquired by the camera unit in a temporal vicinity of the activation of the shutter button at the second time into a second image sequence, the second image sequence comprising: a plurality of images acquired by the camera unit prior to detecting activation of the shutter button at the second time; a representative image representative of the second sequence of images and acquired by the camera unit after one or more other images in the second sequence of images; 60. The electronic device of any one of claims 37 to 59, comprising:

61. 61. The electronic device of any one of claims 37 to 60, wherein the processing unit is configured to automatically filter out blurry images from the first sequence of images.

62. the first sequence of images a first image in the first sequence of images; a first number of images acquired between the initial image and the representative image; a last image in the first sequence of images; a second number of images acquired between the representative image and the last image; Including, The processing unit detecting an input corresponding to a request to change the representative image in the first sequence of images; in response to detecting the input corresponding to the request to change the representative image in the first sequence of images; changing the representative image to a corrected representative image according to the detected input; modifying the grouped images in the first image sequence by adding an image to one end of the first image sequence and deleting an image at the other end of the first image sequence so that the first image sequence has a corrected first image and a corrected last image according to the detected input; 62. The electronic device of any one of claims 37 to 61 configured to:

63. the display unit is a touch-sensitive display unit, and the processing unit is receiving a request to display the representative image from the first sequence of images; displaying the representative image on the touch-sensitive display unit in response to receiving the request to display the representative image; receiving a touch input onto the representative image on the touch-sensitive display unit while displaying the representative image, the touch input including a time-varying characteristic; responsive to receiving the touch input onto the representative image on the touch-sensitive display unit, displaying images in the first sequence of images on the touch-sensitive display unit at a rate determined based on the change in the characteristic of the touch input over time; 63. The electronic device of any one of claims 37 to 62, configured to:

64. In an electronic device having a display and a touch-sensitive surface, Displaying a representative image on the display, the representative image is an image in a sequence of images taken by a camera; the image sequence includes one or more images acquired by the camera after acquiring the representative image; the image sequence includes one or more images captured by the camera prior to capturing the representative image; detecting a first portion of a first input while displaying the representative image on the display; In response to detecting the first portion of the first input, replacing the display of the representative image with a sequential display of the one or more images captured by the camera after capturing the representative image; detecting a second portion of the first input after detecting the first portion of the first input; In response to detecting the second portion of the first input, sequentially displaying the one or more images captured by the camera before capturing the representative image, the representative image, and the one or more images captured by the camera after capturing the representative image; A method comprising:

65. 65. The method of claim 64, wherein the first input is a press and hold gesture.

66. 66. The method of claim 64 or 65, wherein the device includes one or more sensors for detecting an intensity of contact with the touch-sensitive surface, and the first input includes a finger contact that satisfies a first contact intensity criterion.

67. 67. The method of any one of claims 64 to 66, wherein the one or more images acquired by the camera after acquiring the representative image are displayed in sequence at a rate based on an intensity of contact of the first portion of the first input in response to detecting the first portion of the first input.

68. 67. A method according to any one of claims 64 to 66, wherein the sequence of images is displayed sequentially at a fixed rate in response to detecting the second portion of the first input.

69. Crossfading from sequentially displaying the one or more images acquired by the camera after acquiring the representative image to sequentially displaying the one or more images acquired by the camera before acquiring the representative image.

69. The method of any one of claims 64 to 68, comprising:

70. and presenting audio corresponding to the image sequence in response to detecting the second portion of the first input.

70. The method of any one of claims 64 to 69, comprising:

71. detecting a third portion of the first input after detecting the second portion of the first input; in response to detecting the third portion of the first input, sequentially displaying the one or more images acquired by the camera before acquiring the representative image, the representative image, and the one or more images acquired by the camera after acquiring the representative image; 71. The method of any one of claims 64 to 70, comprising:

72. displaying metadata corresponding to the image sequence in response to detecting the third portion of the first input.

72. The method of claim 71, comprising:

73. Detecting an end of the first input; displaying the representative image in response to detecting an end of the first input; 73. The method of any one of claims 64 to 72, comprising:

74. detecting an end of the first input while displaying a first image in the sequence of images; in response to detecting an end of the first input while displaying the first image in the sequence of images; displaying images in chronological order from the first image to the representative image in accordance with a determination that the first image occurs before the representative image in the sequence of images; pursuant to a determination that the first image occurs after the representative image in the sequence of images, displaying images in reverse chronological order from the first image to the representative image; 73. The method of any one of claims 64 to 72, comprising:

75. The image sequence is configured to be displayed in sequence in either a forward or reverse loop, the method comprising: detecting an end of the first input while displaying a first image in the sequence of images; in response to detecting an end of the first input while displaying the first image in the sequence of images; displaying images in sequence in the forward direction from the first image to the representative image in accordance with a determination that there are fewer images between the first image and the representative image when the loop proceeds in the forward direction; displaying images in sequence in the reverse direction from the first image to the representative image in accordance with a determination that there are fewer images between the first image and the representative image when the loop proceeds in the reverse direction; 73. The method of any one of claims 64 to 72, comprising:

76. 76. A method according to any one of claims 64 to 75, wherein the one or more images acquired by the camera after acquiring the representative image are displayed in sequence according to the intensity levels of each of the first inputs.

77. the first portion of the first input comprises a change in intensity of a contact detected on the touch-sensitive surface, the method comprising: detecting an increase in intensity of the contact by a respective amount to a second intensity while the representative image is displayed and the contact has a first intensity; responsive to detecting the increase in intensity of the contact by the respective amount, replacing the display of the representative image with a display of a first subsequent image that is a respective number of images after the representative image in the sequence of images; displaying the first subsequent image and detecting an increase in intensity of the contact by the respective amount while the contact has the second intensity to a third intensity; responsive to detecting the increase in intensity of the contact by the respective amount from the second intensity to the third intensity, replacing the display of the first subsequent image with a display of a second subsequent image that is the respective number of images after the first subsequent image in the sequence of images; 77. The method of any one of claims 64 to 76, comprising:

78. the first portion of the first input comprises a change in intensity of a contact detected on the touch-sensitive surface, the method comprising: detecting an increase in intensity of the contact by a respective amount to a second intensity while the representative image is displayed and the contact has a first intensity; responsive to detecting the increase in intensity of the contact by the respective amount, replacing the display of the representative image with a display of a first subsequent image that is a respective number of images after the representative image in the sequence of images; displaying the first subsequent image and detecting a change in intensity of the contact by the respective amount while the contact has the second intensity; In response to detecting the change in intensity of the contact by the respective amount, replacing the display of the first subsequent image with a display of a second subsequent image that is the respective number of images after the first subsequent image in the sequence of images in accordance with a determination that the change in intensity of the contact by the respective amount includes an increase in intensity of the contact from the second intensity to a third intensity; replacing the display of the first subsequent image with the display of the representative image in accordance with a determination that the change in intensity of the contact by the respective amount includes a decrease in intensity of the contact from the second intensity to the first intensity; 77. The method of any one of claims 64 to 76, comprising:

79. 79. The method of claim 77 or 78, wherein the respective number of images is based on the magnitude of the respective change in intensity of the contact.

80. when the respective changes in intensity of the contact have a first magnitude, the first sequential image immediately follows the respective image in the image sequence, and the second sequential image immediately follows the first sequential image in the image sequence; 80. The method of any one of claims 77 to 79, wherein if the respective changes in intensity of the contact have a second magnitude greater than the first magnitude, the first sequential image is spaced from the respective image by a respective number of images in the image sequence, and the second sequential image is spaced from the first sequential image by the respective number of images in the image sequence, the respective number of images being one or more images.

81. The display and a touch-sensitive surface; and one or more processors; Memory and and one or more programs, the one or more programs being stored in the memory and configured to be executed by the one or more processors, the one or more programs comprising: Displaying a representative image on the display, the representative image is an image in a sequence of images taken by a camera; the image sequence includes one or more images acquired by the camera after acquiring the representative image; the image sequence includes one or more images captured by the camera prior to capturing the representative image; detecting a first portion of a first input while displaying the representative image on the display; In response to detecting the first portion of the first input, replacing the display of the representative image with a sequential display of the one or more images captured by the camera after capturing the representative image; detecting a second portion of the first input after detecting the first portion of the first input; In response to detecting the second portion of the first input, sequentially displaying the one or more images captured by the camera before capturing the representative image, the representative image, and the one or more images captured by the camera after capturing the representative image; An electronic device containing instructions for performing the steps of:

82. 1. A computer-readable storage medium storing one or more programs, the one or more programs including instructions that, when executed by an electronic device having a display and a touch-sensitive surface, cause the device to: Displaying a representative image on the display, the representative image is an image in a sequence of images taken by a camera; the image sequence includes one or more images acquired by the camera after acquiring the representative image; the image sequence includes one or more images captured by the camera prior to capturing the representative image; detecting a first portion of a first input while displaying the representative image on the display; In response to detecting the first portion of the first input, replacing the display of the representative image with a sequential display of the one or more images captured by the camera after capturing the representative image; detecting a second portion of the first input after detecting the first portion of the first input; In response to detecting the second portion of the first input, sequentially displaying the one or more images captured by the camera before capturing the representative image, the representative image, and the one or more images captured by the camera after capturing the representative image; A computer-readable storage medium that causes the

83. The display and a touch-sensitive surface; and a means for displaying a representative image on the display, the representative image is an image in a sequence of images taken by a camera; the image sequence includes one or more images acquired by the camera after acquiring the representative image; the image sequence includes one or more images acquired by the camera prior to acquiring the representative image; means for detecting a first portion of a first input, the first portion being activated while displaying the representative image on the display; means, enabled in response to detecting the first portion of the first input, for replacing the display of the representative image with a sequential display of the one or more images captured by the camera after capturing the representative image; means for detecting a second portion of the first input, the means being enabled after detecting the first portion of the first input; means, enabled in response to detecting the second portion of the first input, for sequentially displaying the one or more images captured by the camera prior to capturing the representative image, the representative image, and the one or more images captured by the camera after capturing the representative image; An electronic device comprising:

84. 1. An information processing device for use in an electronic device having a display and a touch-sensitive surface, comprising: a means for displaying a representative image on the display, the representative image is an image in a sequence of images taken by a camera; the image sequence includes one or more images acquired by the camera after acquiring the representative image; the image sequence includes one or more images acquired by the camera prior to acquiring the representative image; means for detecting a first portion of a first input, the first portion being activated while displaying the representative image on the display; means, enabled in response to detecting the first portion of the first input, for replacing the display of the representative image with a sequential display of the one or more images captured by the camera after capturing the representative image; means for detecting a second portion of the first input, the means being enabled after detecting the first portion of the first input; means, enabled in response to detecting the second portion of the first input, for sequentially displaying the one or more images captured by the camera prior to capturing the representative image, the representative image, and the one or more images captured by the camera after capturing the representative image; An information processing device comprising:

85. The display and a touch-sensitive surface; and one or more processors; Memory and one or more programs stored in the memory and configured to be executed by the one or more processors, the one or more programs including instructions for performing any of the methods of claims 64 to 80; and An electronic device comprising:

86. 81. A computer-readable storage medium storing one or more programs, the one or more programs including instructions that, when executed by an electronic device with a display and a touch-sensitive surface, cause the device to perform any of the methods recited in claims 64 to 80.

87. 81. A graphical user interface on an electronic device having a display, a touch-sensitive surface, a memory, and one or more processors for executing one or more programs stored in the memory, the graphical user interface including a user interface displayed according to any of the methods of claims 64 to 80.

88. The display and a touch-sensitive surface; and means for carrying out any of the methods of claims 64 to 80; and An electronic device comprising:

89. 1. An information processing device for use in an electronic device having a display and a touch-sensitive surface, comprising: Means for carrying out any of the methods of claims 64 to 80 An information processing device comprising:

90. a display unit configured to display an image; a touch-sensitive surface unit configured to detect user input; a processing unit connected to the display unit and the touch-sensitive surface unit, displaying a representative image on the display unit; the representative image is an image in a sequence of images taken by a camera; the image sequence includes one or more images acquired by the camera after acquiring the representative image; the image sequence includes one or more images captured by the camera prior to capturing the representative image; detecting a first portion of a first input while displaying the representative image on the display unit; in response to detecting the first portion of the first input, replacing on the display unit the display of the representative image with a sequential display of the one or more images captured by the camera after capturing the representative image; detecting a second portion of the first input after detecting the first portion of the first input; In response to detecting the second portion of the first input, displaying, in sequence on the display unit, the one or more images captured by the camera before capturing the representative image, the representative image, and the one or more images captured by the camera after capturing the representative image; a processing unit configured to perform An electronic device comprising:

91. 91. The electronic device of claim 90, wherein the first input is a press and hold gesture.

92. 92. The electronic device of claim 90 or 91, wherein the device includes one or more sensor units connected to the processing unit for detecting an intensity of contact with the touch-sensitive surface unit, and wherein the first input includes a finger contact that satisfies a first contact intensity criterion.

93. 93. The electronic device of any one of claims 90 to 92, wherein the one or more images acquired by the camera after acquiring the representative image are displayed on the display unit in sequence at a rate based on the intensity of contact of the first portion of the input in response to detecting the first portion of the first input.

94. 93. An electronic device according to any one of claims 90 to 92, wherein the sequence of images is displayed on the display unit in sequence at a fixed rate in response to detecting the second portion of the first input.

95. The processing unit 95. The electronic device of claim 90, configured to crossfade from sequentially displaying on the display unit the one or more images acquired by the camera after acquiring the representative image to sequentially displaying on the display unit the one or more images acquired by the camera before acquiring the representative image.

96. The processing unit and presenting audio corresponding to the image sequence in response to detecting the second portion of the first input.

96. An electronic device according to any one of claims 90 to 95, configured to:

97. The processing unit detecting a third portion of the first input after detecting the second portion of the first input; in response to detecting the third portion of the first input, displaying, in sequence on the display unit, the one or more images captured by the camera before capturing the representative image, the representative image, and the one or more images captured by the camera after capturing the representative image; 97. An electronic device according to any one of claims 90 to 96, configured to:

98. The processing unit 98. The electronic device of claim 97, configured to, in response to detecting the third portion of the first input, display metadata corresponding to the image sequence on the display unit.

99. The processing unit Detecting an end of the first input; displaying the representative image on the display unit in response to detecting an end of the first input; 99. The electronic device of any one of claims 90 to 98, configured to:

100. The processing unit detecting an end of the first input while displaying a first image in the sequence of images on the display unit; in response to detecting an end of the first input while displaying the first image in the image sequence on the display unit; displaying images from the first image to the representative image in chronological order on the display unit in accordance with a determination that the first image occurs before the representative image in the sequence of images; displaying images in reverse chronological order from the first image to the representative image on the display unit in accordance with a determination that the first image occurs after the representative image in the sequence of images; 99. The electronic device of any one of claims 90 to 98, configured to:

101. The image sequence is configured to be displayed in sequence on the display unit in either a forward or reverse loop, and the processing unit detecting an end of the first input while displaying a first image in the sequence of images on the display unit; in response to detecting an end of the first input while displaying the first image in the image sequence on the display unit; displaying images on the display unit in sequence in the forward direction from the first image to the representative image in accordance with a determination that there are fewer images between the first image and the representative image when the loop proceeds in the forward direction; displaying images on the display unit in sequence in the reverse direction from the first image to the representative image in accordance with a determination that there are fewer images between the first image and the representative image when the loop proceeds in the reverse direction; 99. The electronic device of any one of claims 90 to 98, configured to:

102. 102. An electronic device according to any one of claims 90 to 101, wherein the one or more images acquired by the camera after acquiring the representative image are displayed in sequence according to the respective intensity levels applied by the first input.

103. the first portion of the first input comprises a change in intensity of a contact detected on the touch-sensitive surface unit, and the processing unit: detecting, while the representative image is displayed on the display unit and the contact has a first intensity, an increase in the intensity of the contact by a respective amount up to a second intensity; responsive to detecting the increase in intensity of the contact by the respective amount, replacing on the display unit the display of the representative image with a display of a first subsequent image that is a respective number of images after the representative image in the sequence of images; displaying the first subsequent image on the display unit and detecting, while the contact has a second intensity, an increase in intensity of the contact by the respective amount to a third intensity; responsive to detecting the increase in intensity of the contact by the respective amount from the second intensity to the third intensity, replacing on the display unit the display of the first subsequent image with the display of a second subsequent image that is the respective number of images after the first subsequent image in the sequence of images; 103. An electronic device according to any one of claims 90 to 102, configured to:

104. the first portion of the first input comprises a change in intensity of a contact detected on the touch-sensitive surface unit, and the processing unit: detecting, while the representative image is displayed on the display unit and the contact has a first intensity, an increase in the intensity of the contact by a respective amount up to a second intensity; responsive to detecting the increase in intensity of the contact by the respective amount, replacing on the display unit the display of the representative image with a display of a first subsequent image that is a respective number of images after the representative image in the sequence of images; displaying the first subsequent image and detecting a change in intensity of the contact by the respective amount while the contact has the second intensity; In response to detecting the change in intensity of the contact by the respective amount, replacing, on the display unit, the display of the first subsequent image with a display of a second subsequent image that is the respective number of images after the first subsequent image in the sequence of images in accordance with a determination that the change in intensity of the contact by the respective amount includes an increase in intensity of the contact from the second intensity to a third intensity; replacing, on the display unit, the display of the first subsequent image with the display of the representative image in accordance with a determination that the change in intensity of the contact by the respective amount includes a decrease in intensity of the contact from the second intensity to the first intensity; 103. An electronic device according to any one of claims 90 to 102, configured to:

105. 105. The electronic device of claim 103 or 104, wherein the respective number images are based on a magnitude of the respective change in intensity of the contact.

106. when the respective changes in intensity of the contact have a first magnitude, the first sequential image immediately follows the respective image in the image sequence, and the second sequential image immediately follows the first sequential image in the image sequence; if the respective changes in intensity of the contact have a second magnitude greater than the first magnitude, the first sequential images are spaced from the respective images by a respective number of images in the image sequence, the second sequential images are spaced from the first sequential image by the respective number of images in the image sequence, and the respective number of images is one or more images; 106. An electronic device according to any one of claims 103 to 105.

107. In an electronic device having a display and a touch-sensitive surface, Displaying a representative image on the display, the representative image is an image in a sequence of images taken by a camera; the image sequence includes one or more images acquired by the camera after acquiring the representative image; the image sequence includes one or more images captured by the camera prior to capturing the representative image; detecting a first portion of a first input while displaying the representative image on the display; In response to detecting the first portion of the first input, transitioning from displaying the representative image to displaying each previous image in the sequence of images, each previous image being captured by the camera prior to capturing the representative image; after transitioning from displaying the representative image to displaying each previous image, displaying, in order starting with each previous image, at least a portion of the one or more images acquired by the camera before acquiring the representative image and at least a portion of the one or more images acquired by the camera after acquiring the representative image; A method comprising:

108. 108. The method of claim 107, wherein transitioning from displaying the representative image to displaying each previous image comprises sequentially displaying at least a portion of the one or more images captured by the camera after capturing the representative image, and then replacing the display of each subsequent image captured after capturing the representative image with the display of each previous image.

109. 108. The method of claim 107, wherein transitioning from displaying the representative image to displaying the respective previous image comprises replacing the display of the representative image with the respective previous image.

110. transitioning from displaying the representative image to displaying each previous image; pursuant to a determination that the first portion of the first input satisfies a first playback criterion, sequentially displaying at least a portion of the one or more images acquired by the camera after acquiring the representative image, and then replacing the display of each subsequent image acquired after acquiring the representative image with the respective previous image; replacing the display of the representative image with the respective previous image in accordance with a determination that the first portion of the first input satisfies a second reproduction criterion different from the first reproduction criterion; 108. The method of claim 107, comprising:

111. the device includes one or more sensors for detecting an intensity of contact with the touch-sensitive surface; the first input comprises a contact on the touch-sensitive surface; the first regeneration criterion includes a criterion that is met if the contact has a characteristic intensity above a first intensity threshold; 111. The method of claim 110, wherein the second regeneration criterion comprises a criterion that is met if the contact has a characteristic intensity above a second intensity threshold that is greater than the first intensity threshold.

112. 112. The method of any one of claims 107 to 111, wherein the first input is a press and hold gesture.

113. 113. A method according to any one of claims 107 to 112, wherein the one or more images acquired by the camera before acquiring the representative image and the one or more images acquired by the camera after acquiring the representative image are displayed in order at a fixed rate starting from the respective previous image.

114. presenting audio corresponding to said image sequence; 114. The method of any one of claims 107 to 113, comprising:

115. detecting a second portion of the first input after detecting the first portion of the first input; In response to detecting the second portion of the first input, sequentially displaying at least a portion of the one or more images captured by the camera before capturing the representative image and at least a portion of the one or more images captured by the camera after capturing the representative image; 115. The method of any one of claims 107 to 114, comprising:

116. 116. The method of claim 115, comprising displaying metadata corresponding to the image sequence in response to detecting the second portion of the first input.

117. Detecting an end of the first input; displaying the representative image in response to detecting an end of the first input; 117. The method of any one of claims 107 to 116, comprising:

118. detecting an end of the first input while displaying a first image in the sequence of images; in response to detecting an end of the first input while displaying the first image in the sequence of images; displaying images in chronological order from the first image to the representative image in accordance with a determination that the first image occurs before the representative image in the sequence of images; pursuant to a determination that the first image occurs after the representative image in the sequence of images, displaying images in reverse chronological order from the first image to the representative image; 117. The method of any one of claims 107 to 116, comprising:

119. The image sequence is configured to be displayed in sequence in either a forward or reverse loop, the method comprising: detecting an end of the first input while displaying a first image in the sequence of images; in response to detecting an end of the first input while displaying the first image in the sequence of images; displaying images in sequence in the forward direction from the first image to the representative image in accordance with a determination that there are fewer images between the first image and the representative image when the loop proceeds in the forward direction; displaying images in sequence in the reverse direction from the first image to the representative image in accordance with a determination that there are fewer images between the first image and the representative image when the loop proceeds in the reverse direction; 117. The method of any one of claims 107 to 116, comprising:

120. The display and a touch-sensitive surface; and one or more processors; Memory and one or more programs stored in the memory and configured to be executed by the one or more processors, the one or more programs comprising: Displaying a representative image on the display, the representative image is an image in a sequence of images taken by a camera; the image sequence includes one or more images acquired by the camera after acquiring the representative image; the image sequence includes one or more images captured by the camera prior to capturing the representative image; detecting a first portion of a first input while displaying the representative image on the display; In response to detecting the first portion of the first input, transitioning from displaying the representative image to displaying each previous image in the sequence of images, each previous image being captured by the camera prior to capturing the representative image; after transitioning from displaying the representative image to displaying each previous image, displaying, in order starting with each previous image, at least a portion of the one or more images acquired by the camera before acquiring the representative image and at least a portion of the one or more images acquired by the camera after acquiring the representative image; one or more programs including instructions for performing An electronic device comprising:

121. 1. A computer-readable storage medium storing one or more programs, the one or more programs including instructions that, when executed by an electronic device having a display and a touch-sensitive surface, cause the device to: Displaying a representative image on the display, the representative image is an image in a sequence of images taken by a camera; the image sequence includes one or more images acquired by the camera after acquiring the representative image; the image sequence includes one or more images captured by the camera prior to capturing the representative image; detecting a first portion of a first input while displaying the representative image on the display; In response to detecting the first portion of the first input, transitioning from displaying the representative image to displaying each previous image in the sequence of images, each previous image being captured by the camera prior to capturing the representative image; after transitioning from displaying the representative image to displaying each previous image, displaying, in order starting with each previous image, at least a portion of the one or more images acquired by the camera before acquiring the representative image and at least a portion of the one or more images acquired by the camera after acquiring the representative image; A computer-readable storage medium that causes the

122. The display and a touch-sensitive surface; and a means for displaying a representative image on the display, the representative image is an image in a sequence of images taken by a camera; the image sequence includes one or more images acquired by the camera after acquiring the representative image; the image sequence includes one or more images acquired by the camera prior to acquiring the representative image; means for detecting a first portion of a first input, the first portion being activated while displaying the representative image on the display; enabled in response to detecting the first portion of the first input. transitioning from displaying the representative image to displaying each previous image in the sequence of images, each previous image being acquired by the camera before acquiring the representative image; after transitioning from displaying the representative image to displaying each previous image, displaying, in order starting with each previous image, at least a portion of the one or more images acquired by the camera before acquiring the representative image and at least a portion of the one or more images acquired by the camera after acquiring the representative image; and a means for performing the steps of An electronic device comprising:

123. 1. An information processing device for use in an electronic device having a display and a touch-sensitive surface, comprising: a means for displaying a representative image on the display, the representative image is an image in a sequence of images taken by a camera; the image sequence includes one or more images acquired by the camera after acquiring the representative image; the image sequence includes one or more images acquired by the camera prior to acquiring the representative image; means for detecting a first portion of a first input, the first portion being activated while displaying the representative image on the display; enabled in response to detecting the first portion of the first input. transitioning from displaying the representative image to displaying each previous image in the sequence of images, each previous image being acquired by the camera before acquiring the representative image; after transitioning from displaying the representative image to displaying each previous image, displaying, in order starting with each previous image, at least a portion of the one or more images acquired by the camera before acquiring the representative image and at least a portion of the one or more images acquired by the camera after acquiring the representative image; and a means for performing the steps of An information processing device comprising:

124. The display and a touch-sensitive surface; and one or more processors; Memory and one or more programs stored in the memory and configured to be executed by the one or more processors, the one or more programs including instructions for performing any of the methods of claims 107 to 119; and An electronic device comprising:

125. 120. A computer-readable storage medium storing one or more programs, the one or more programs including instructions that, when executed by an electronic device with a display and a touch-sensitive surface, cause the device to perform any of the methods recited in claims 107 to 119.

126. 120. A graphical user interface on an electronic device having a display, a touch-sensitive surface, a memory, and one or more processors for executing one or more programs stored in the memory, the graphical user interface including a user interface displayed according to any of the methods of claims 107 to 119.

127. The display and a touch-sensitive surface; and means for carrying out any of the methods of claims 107 to 119; An electronic device comprising:

128. 120. An information processing apparatus for use in an electronic device having a display and a touch-sensitive surface, the information processing apparatus comprising means for performing any of the methods of claims 107 to 119.

129. a display unit configured to display an image; a touch-sensitive surface unit configured to detect user input; a processing unit connected to the display unit and the touch-sensitive surface unit, A representative image can be displayed on the display unit, the representative image is an image in a sequence of images taken by a camera; the image sequence includes one or more images acquired by the camera after acquiring the representative image; the image sequence includes one or more images captured by the camera prior to capturing the representative image; detecting a first portion of a first input while enabling the representative image to be displayed on the display unit; In response to detecting the first portion of the first input, transitioning from displaying the representative image to displaying each previous image in the sequence of images, each previous image being acquired by the camera before acquiring the representative image; After transitioning from displaying the representative image to displaying each of the previous images, enabling displaying, in order starting from each of the previous images, at least a portion of the one or more images acquired by the camera before acquiring the representative image and at least a portion of the one or more images acquired by the camera after acquiring the representative image; a processing unit configured to perform An electronic device comprising:

130. 130. The electronic device of claim 129, wherein transitioning from displaying the representative image to displaying each previous image includes sequentially displaying at least a portion of the one or more images captured by the camera after capturing the representative image, and then allowing the display of each subsequent image captured after capturing the representative image to replace the respective previous image.

131. 130. The electronic device of claim 129, wherein transitioning from displaying the representative image to displaying the respective previous image comprises allowing the display of the representative image to replace the respective previous image.

132. transitioning from displaying the representative image to displaying each previous image; pursuant to a determination that the first portion of the first input satisfies a first playback criterion, sequentially displaying at least a portion of the one or more images captured by the camera after capturing the representative image, and then displaying each subsequent image captured after capturing the representative image to replace the respective previous image; enabling display of the representative image to replace the respective previous image in accordance with a determination that the first portion of the first input satisfies a second reproduction criterion different from the first reproduction criterion; 130. The electronic device of claim 129, comprising:

133. the device includes one or more sensor units for detecting an intensity of contact with the touch-sensitive surface unit; the first input comprises a contact on the touch-sensitive surface unit; the first regeneration criterion includes a criterion that is met if the contact has a characteristic intensity above a first intensity threshold; 133. The electronic device of claim 132, wherein the second regeneration criterion comprises a criterion that is met if the contact has a characteristic intensity above a second intensity threshold that is greater than the first intensity threshold.

134. 134. The electronic device of any one of claims 129 to 133, wherein the first input is a press and hold gesture.

135. 135. An electronic device according to any one of claims 129 to 134, wherein the one or more images acquired by the camera before acquiring the representative image and the one or more images acquired by the camera after acquiring the representative image are displayed in sequence at a fixed rate starting from the respective previous image.

136. The processing unit presenting audio corresponding to said image sequence; 136. An electronic device according to any one of claims 129 to 135, configured to:

137. The processing unit detecting a second portion of the first input after detecting the first portion of the first input; In response to detecting the second portion of the first input, at least a portion of the one or more images acquired by the camera before acquiring the representative image and at least a portion of the one or more images acquired by the camera after acquiring the representative image can be displayed in sequence; 137. An electronic device according to any one of claims 129 to 136, configured to:

138. The processing unit In response to detecting the second portion of the first input, enabling metadata corresponding to the image sequence to be displayed.

138. The electronic device of claim 137 configured to:

139. The processing unit Detecting an end of the first input; enabling the representative image to be displayed in response to detecting the end of the first input; 139. An electronic device according to any one of claims 129 to 138, configured to:

140. The processing unit detecting an end of the first input while enabling a first image in the sequence of images to be displayed; in response to detecting an end of the first input while the first image in the image sequence is being made displayable, pursuant to a determination that the first image occurs before the representative image in the sequence of images, enabling images from the first image to the representative image to be displayed in chronological order; pursuant to a determination that the first image occurs after the representative image in the sequence of images, enabling images from the first image to the representative image to be displayed in reverse chronological order; 139. An electronic device according to any one of claims 129 to 138, configured to:

141. The image sequence is configured to be displayed in a loop, either forward or backward, and the processing unit detecting an end of the first input while enabling a first image in the sequence of images to be displayed; in response to detecting an end of the first input while the first image in the image sequence is being made displayable, enabling sequential display of images in the forward direction from the first image to the representative image in accordance with a determination that there are fewer images between the first image and the representative image when the loop proceeds in the forward direction; enabling sequentially displaying images in the reverse direction from the first image to the representative image in accordance with a determination that there are fewer images between the first image and the representative image when the loop proceeds in the reverse direction; 139. An electronic device according to any one of claims 129 to 138, configured to:

142. 1. An electronic device having a display, a touch-sensitive surface, and one or more sensors for detecting an intensity of contact with the touch-sensitive surface, Displaying a representative image on the display, the representative image is an image in a sequence of images taken by a camera; the image sequence includes one or more images captured by the camera after capturing the representative image; detecting a first input, including detecting that a characteristic intensity of a contact on the touch-sensitive surface has increased to a first intensity greater than a first intensity threshold while displaying the representative image on the display; In response to detecting the increase in the characteristic intensity of the contact, stepping through the one or more images acquired by the camera after acquiring the representative image in a first direction at a rate determined at least in part based on the first intensity; detecting, after advancing through the one or more images acquired by the camera after acquiring the representative image at the rate determined based on the first intensity, that the intensity of the contact has decreased to a second intensity that is less than the first intensity; in response to detecting the decrease in the characteristic intensity of the contact to the second intensity; pursuant to a determination that the second intensity is above the first intensity threshold, continuing to advance in the first direction at a second rate through the one or more images acquired by the camera after acquiring the representative image; the second rate is determined based at least in part on the second intensity; the second rate is slower than the first rate; and pursuant to determining that the second intensity is below the first intensity threshold, moving between the one or more images acquired by the camera after acquiring the representative image in a second direction opposite the first direction at a rate determined at least in part based on the second intensity; A method comprising:

143. 143. The method of claim 142, wherein the first rate is determined based in part on the proximity of a currently displayed image to the end of the image sequence.

144. 144. A method according to claim 142 or 143, wherein the second rate is determined based in part on the proximity of a currently displayed image to the beginning of the sequence of images.

145. 145. The method of any one of claims 142 to 144, wherein the rate of progression through the image sequence is constrained by a maximum rate while the contact is detected on the touch-sensitive surface.

146. 146. The method of any one of claims 142 to 145, wherein intensity values ​​of the characteristic intensity of the contact that are close to the first intensity threshold are associated with rate values ​​that are at least a predetermined amount away from a rate of zero images per second.

147. 147. The method of any one of claims 142 to 146, wherein the rate of movement between the image sequences is constrained by a maximum reverse rate while the contact is detected on the touch-sensitive surface.

148. detecting lift-off of the contact from the touch-sensitive surface; responsive to detecting lift-off of the contact, moving between the images in the second direction at a rate greater than the maximum reversal rate; 148. The method of claim 147, comprising:

149. 149. The method of any one of claims 142 to 148, wherein the images are displayed in sequence at an increasing rate as the characteristic intensity of the contact increases.

150. 149. The method of any one of claims 142 to 148, wherein the images are displayed in sequence at a rate proportional to the difference between the characteristic intensity of the contact and the first intensity threshold.

151. reducing the rate at which images in the image sequence are displayed as the end of the image sequence approaches; 151. The method of any one of claims 142 to 150, comprising:

152. 152. A method according to any one of claims 142 to 151, wherein the image sequence comprises one or more images acquired by the camera prior to acquiring the representative image.

153. 153. The method of any one of claims 142 to 152, wherein the representative image is displayed as a background image on a lock screen of a device, and one or more foreground elements are not changed while the device advances between the one or more images captured after the respective image.

154. 154. The method of any one of claims 142 to 153, wherein the first input is a press and hold gesture.

155. 155. A method according to any one of claims 142 to 154, comprising displaying metadata corresponding to the image sequence.

156. Detecting an end of the first input; displaying the representative image in response to detecting an end of the first input; 156. The method of any one of claims 142 to 155, comprising:

157. detecting an end of the first input while displaying a first image in the sequence of images; in response to detecting an end of the first input while displaying the first image in the sequence of images; displaying images in chronological order from the first image to the representative image in accordance with a determination that the first image occurs before the representative image in the sequence of images; pursuant to a determination that the first image occurs after the representative image in the sequence of images, displaying images in reverse chronological order from the first image to the representative image; 156. The method of any one of claims 142 to 155, comprising:

158. The display and a touch-sensitive surface; and one or more sensors for detecting an intensity of contact with the touch-sensitive surface; one or more processors; Memory and and one or more programs, the one or more programs being stored in the memory and configured to be executed by the one or more processors, the one or more programs comprising: Displaying a representative image on the display, the representative image is an image in a sequence of images taken by a camera; the image sequence includes one or more images captured by the camera after capturing the representative image; detecting a first input, including detecting that a characteristic intensity of a contact on the touch-sensitive surface has increased to a first intensity greater than a first intensity threshold while displaying the representative image on the display; In response to detecting the increase in the characteristic intensity of the contact, proceeding in a first direction through the one or more images acquired by the camera after acquiring the representative image at a rate determined at least in part based on the first intensity; detecting, after advancing through the one or more images acquired by the camera after acquiring the representative image at the rate determined based on the first intensity, that the intensity of the contact has decreased to a second intensity that is less than the first intensity; in response to detecting the decrease in the characteristic intensity of the contact to the second intensity; pursuant to a determination that the second intensity is above the first intensity threshold, continuing to advance in the first direction at a second rate through the one or more images acquired by the camera after acquiring the representative image; the second rate is determined based at least in part on the second intensity; the second rate is slower than the first rate; and pursuant to determining that the second intensity is below the first intensity threshold, moving between the one or more images acquired by the camera after acquiring the representative image in a second direction opposite the first direction at a rate determined at least in part based on the second intensity; including instructions to: Electronic devices.

159. 1. A computer-readable storage medium storing one or more programs, the one or more programs including instructions that, when executed by an electronic device having a display, a touch-sensitive surface, and one or more sensors for detecting an intensity of contact with the touch-sensitive surface, cause the device to: Displaying a representative image on the display, the representative image is an image in a sequence of images taken by a camera; the image sequence includes one or more images captured by the camera after capturing the representative image; detecting a first input, including detecting that a characteristic intensity of a contact on the touch-sensitive surface has increased to a first intensity greater than a first intensity threshold while displaying the representative image on the display; In response to detecting the increase in the characteristic intensity of the contact, stepping through the one or more images acquired by the camera after acquiring the representative image in a first direction at a rate determined at least in part based on the first intensity; detecting, after advancing through the one or more images acquired by the camera after acquiring the representative image at the rate determined based on the first intensity, that the intensity of the contact has decreased to a second intensity that is less than the first intensity; in response to detecting the decrease in the characteristic intensity of the contact to the second intensity; pursuant to a determination that the second intensity is above the first intensity threshold, continuing to advance in the first direction at a second rate through the one or more images acquired by the camera after acquiring the representative image; the second rate is determined based at least in part on the second intensity; the second rate is slower than the first rate; and pursuant to determining that the second intensity is below the first intensity threshold, moving between the one or more images acquired by the camera after acquiring the representative image in a second direction opposite the first direction at a rate determined at least in part based on the second intensity; A computer-readable storage medium that causes the

160. The display and a touch-sensitive surface; and one or more sensors for detecting an intensity of contact with the touch-sensitive surface; a means for displaying a representative image on the display, the representative image is an image in a sequence of images taken by a camera; the image sequence includes one or more images acquired by the camera after acquiring the representative image; means for detecting a first input, enabled while displaying the representative image on the display, comprising detecting that a characteristic intensity of a contact on the touch-sensitive surface has increased to a first intensity greater than a first intensity threshold; means, enabled in response to detecting the increase in the characteristic intensity of the contact, for stepping through the one or more images acquired by the camera after acquiring the representative image in a first direction at a rate determined at least in part based on the first intensity; means for detecting that the intensity of the contact has decreased to a second intensity that is less than the first intensity, the second intensity being enabled after the camera has advanced through the one or more images acquired after acquiring the representative image at the rate determined based on the first intensity; and activated in response to detecting the decrease in the characteristic intensity of the contact to the second intensity. pursuant to a determination that the second intensity is above the first intensity threshold, continuing to advance in the first direction at a second rate through the one or more images acquired by the camera after acquiring the representative image; the second rate is determined based at least in part on the second intensity; the second rate is slower than the first rate; and pursuant to determining that the second intensity is below the first intensity threshold, moving between the one or more images acquired by the camera after acquiring the representative image in a second direction opposite the first direction at a rate determined at least in part based on the second intensity; and a means for performing the steps of An electronic device comprising:

161. 1. An information processing device for use in an electronic device comprising a display, a touch-sensitive surface, and one or more sensors for detecting an intensity of contact with the touch-sensitive surface, a means for displaying a representative image on the display, the representative image is an image in a sequence of images taken by a camera; the image sequence includes one or more images acquired by the camera after acquiring the representative image; means for detecting a first input, enabled while displaying the representative image on the display, comprising detecting that a characteristic intensity of a contact on the touch-sensitive surface has increased to a first intensity greater than a first intensity threshold; means, enabled in response to detecting the increase in the characteristic intensity of the contact, for stepping through the one or more images acquired by the camera after acquiring the representative image in a first direction at a rate determined at least in part based on the first intensity; means for detecting that the intensity of the contact has decreased to a second intensity that is less than the first intensity, the second intensity being enabled after the camera has advanced through the one or more images acquired after acquiring the representative image at the rate determined based on the first intensity; and continuing to advance through the one or more images acquired by the camera after acquiring the representative image in accordance with a determination that the second intensity is above the first intensity threshold, the determination being enabled in response to detecting the decrease in the characteristic intensity of the contact to the second intensity; the second rate is determined based at least in part on the second intensity; the second rate is slower than the first rate; and pursuant to determining that the second intensity is below the first intensity threshold, moving between the one or more images acquired by the camera after acquiring the representative image in a second direction opposite the first direction at a rate determined at least in part based on the second intensity; and a means for performing the steps of An information processing device comprising:

162. The display and a touch-sensitive surface; and one or more sensors for detecting an intensity of contact with the touch-sensitive surface; one or more processors; Memory and one or more programs stored in the memory and configured to be executed by the one or more processors, the one or more programs including instructions for performing any of the methods recited in claims 142 to 157; and An electronic device comprising:

163. 158. A computer-readable storage medium storing one or more programs, the one or more programs including instructions that, when executed by an electronic device having a display, a touch-sensitive surface, and one or more sensors for detecting intensity of contact with the touch-sensitive surface, cause the device to perform any of the methods recited in claims 142-157.

164. 158. A graphical user interface on an electronic device having a display, a touch-sensitive surface, one or more sensors for detecting intensity of contact with the touch-sensitive surface, a memory, and one or more processors for executing one or more programs stored in the memory, the graphical user interface comprising a user interface displayed according to any of the methods of claims 142 to 157.

165. The display and a touch-sensitive surface; and one or more sensors for detecting an intensity of contact with the touch-sensitive surface; means for carrying out any of the methods described in claims 142 to 157; An electronic device comprising:

166. 1. An information processing device for use in an electronic device comprising a display, a touch-sensitive surface, and one or more sensors for detecting an intensity of contact with the touch-sensitive surface, 158. An information processing apparatus comprising means for performing any of the methods described in claims 142 to 157.

167. a display unit configured to display an image; a touch-sensitive surface unit configured to detect user input; one or more sensor units configured to detect an intensity of contact with the touch-sensitive surface unit; a processing unit connected to the display unit, the touch-sensitive surface unit, and the one or more sensor units, the processing unit comprising: A representative image can be displayed on the display unit, the representative image is an image in a sequence of images taken by a camera; the image sequence includes one or more images captured by the camera after capturing the representative image; detecting a first input, including detecting that a characteristic intensity of a contact on the touch-sensitive surface unit has increased to a first intensity greater than a first intensity threshold while enabling the representative image to be displayed on the display unit; In response to detecting the increase in the characteristic intensity of the contact, proceeding in a first direction through the one or more images acquired by the camera after acquiring the representative image at a rate determined at least in part based on the first intensity; detecting, after advancing through the one or more images acquired by the camera after acquiring the representative image at the rate determined based on the first intensity, that the intensity of the contact has decreased to a second intensity that is less than the first intensity; In response to detecting the decrease in the characteristic intensity of the contact to the second intensity, continuing to advance in the first direction at a second rate through the one or more images acquired by the camera after acquiring the representative image in accordance with a determination that the second intensity is above the first intensity threshold; the second rate is determined based at least in part on the second intensity; the second rate is slower than the first rate; and pursuant to determining that the second intensity is below the first intensity threshold, moving between the one or more images acquired by the camera after acquiring the representative image in a second direction opposite the first direction at a rate determined at least in part based on the second intensity; 1. An electronic device configured to:

168. 168. The electronic device of claim 167, wherein the first rate is determined based in part on the proximity of a currently displayed image to the end of the image sequence.

169. 169. An electronic device according to claim 167 or 168, wherein the second rate is determined based in part on the proximity of a currently displayed image to the beginning of the sequence of images.

170. 170. The electronic device of any one of claims 167 to 169, wherein the rate of progression through the image sequence is constrained by a maximum rate during which the contact is detected on the touch-sensitive surface unit.

171. 171. The electronic device of any one of claims 167 to 170, wherein intensity values ​​of the characteristic intensity of the contact that are close to the first intensity threshold are associated with rate values ​​that are at least a predetermined amount away from a rate of zero images per second.

172. 172. The electronic device of claim 167, wherein the rate of movement between the image sequences is constrained by a maximum reverse rate while the contact is detected on the touch-sensitive surface unit.

173. The processing unit detecting lift-off of the contact from the touch-sensitive surface unit; responsive to detecting lift-off of the contact, moving between the images in the second direction at a rate greater than the maximum reversal rate; 173. The electronic device of claim 172 configured to:

174. 174. The electronic device of any one of claims 167 to 173, wherein the images are displayed in sequence at an increasing rate as the characteristic intensity of the contact increases.

175. 174. The electronic device of any one of claims 167 to 173, wherein the images are displayed in sequence at a rate proportional to the difference between the characteristic intensity of the contact and the first intensity threshold.

176. The processing unit reducing the rate at which images in the image sequence are displayed as the end of the image sequence approaches; 176. The electronic device of any one of claims 167 to 175, configured to:

177. 177. The electronic device of any one of claims 167 to 176, wherein the image sequence includes one or more images acquired by the camera prior to acquiring the representative image.

178. 178. The electronic device of any one of claims 167 to 177, wherein the representative image is displayed as a background image on a lock screen of the device, and one or more foreground elements do not change while the device advances through the one or more images captured after the respective image.

179. 179. The electronic device of any one of claims 167 to 178, wherein the first input is a press and hold gesture.

180. 180. An electronic device according to any one of claims 167 to 179, wherein the processing unit is configured to enable display of metadata corresponding to the sequence of images.

181. The processing unit Detecting an end of the first input; enabling the representative image to be displayed in response to detecting the end of the first input; 181. The electronic device of any one of claims 167 to 180, configured to:

182. The processing unit detecting an end of the first input while enabling a first image in the sequence of images to be displayed; in response to detecting an end of the first input while the first image in the image sequence is being made displayable, pursuant to a determination that the first image occurs before the representative image in the sequence of images, enabling images from the first image to the representative image to be displayed in chronological order; pursuant to a determination that the first image occurs after the representative image in the sequence of images, enabling images from the first image to the representative image to be displayed in reverse chronological order; 182. The electronic device of any one of claims 167 to 181, configured to:

183. In an electronic device having a display and a touch-sensitive surface, Storing a plurality of image sequences, each image sequence comprising: Representative images taken by the camera and one or more images acquired by the camera after acquiring each of the representative images; one or more images captured by the camera prior to capturing each of the representative images; displaying a first representative image for a first sequence of images in a movable first area on the display; Detecting a drag gesture on the touch-sensitive surface; in response to determining that the drag gesture is in a first direction on the touch-sensitive surface, replacing, in the movable first area, the display of the first representative image for the first image sequence with a time-series display of at least a portion of one or more images for the first image sequence acquired by the camera after acquiring the first representative image for the first image sequence; moving the first area in the first direction; A method comprising:

184. 184. The method of claim 183, wherein moving the first area in the first direction comprises moving at least a portion of the first area in the first direction off the display.

185. In response to the determination that the drag gesture is in the first direction on the touch-sensitive surface, moving a movable second area in the first direction; displaying, in the second area, in time sequence, at least a portion of one or more images for the second image sequence acquired by the camera prior to acquiring a second representative image for the second image sequence while moving through the second area in the first direction; 185. The method of claim 183 or 184, comprising:

186. 186. The method of claim 185, wherein moving the second area in the first direction comprises moving at least a portion of the second area in the first direction into the display.

187. In response to the determination that the drag gesture is in the first direction on the touch-sensitive surface, displaying the second representative image for the second image sequence in the second area after moving the second area in the first direction.

187. The method of claim 185 or 186, comprising:

188. detecting a change in intensity of an input corresponding to the second representative image for the second image sequence while displaying the second representative image in the second area; responsive to detecting the change in intensity of the input, advancing through the second sequence of images in the second area without moving the second area on the display; 188. The method of claim 187, comprising:

189. Detecting an end of the drag gesture while moving through the first area and the second area; In response to detecting an end of the drag gesture while moving through the first area and the second area, In response to a determination that the drag gesture satisfies a next sequence navigation criterion, moving the first area completely off the display in the first direction; moving the second area completely into the display; and displaying the second representative image for the second image sequence in the second area; 189. The method of any one of claims 185 to 188, comprising:

190. In response to detecting an end of the drag gesture while moving through the first area and the second area, In response to a determination that the drag gesture does not satisfy the next sequence navigation criteria, moving the second area completely off the display in a second direction opposite the first direction; moving the first area completely into the display; displaying the first representative image for the first image sequence in the first area; 190. The method of claim 189, comprising:

191. in response to determining that the drag gesture is in a second direction on the touch-sensitive surface, replacing, in the movable first area, the display of the first representative image for the first image sequence with a reverse-time sequence display of at least a portion of one or more images for the first image sequence acquired by the camera prior to acquiring the first representative image for the first image sequence; moving the first area in the second direction; 191. The method of any one of claims 183 to 190, comprising:

192. 192. The method of claim 191, wherein moving the first area in the second direction comprises moving at least a portion of the first area in the second direction off the display.

193. In response to the determination that the drag gesture is in the second direction on the touch-sensitive surface, moving the third area in the second direction; displaying in reverse chronological order in the third area at least some of the one or more images for the third image sequence acquired by the camera after acquiring a third representative image for the third image sequence while moving through the third area in the second direction; 193. The method of claim 191 or 192, comprising:

194. 194. The method of claim 193, wherein moving the third area in the second direction comprises moving at least a portion of the third area in the second direction into the display.

195. In response to the determination that the drag gesture is in the second direction on the touch-sensitive surface, displaying the third representative image for the third image sequence in the third area after moving the third area in the second direction.

195. The method of claim 193 or 194, comprising:

196. Detecting an end of the drag gesture while moving through the first area and the third area; In response to detecting an end of the drag gesture while moving through the first area and the third area, In response to a determination that the drag gesture satisfies a pre-sequence navigation criterion, moving the first area in the second direction completely off the display; moving the third area completely into the display; displaying the third representative image for the third image sequence in the third area; In response to a determination that the drag gesture does not satisfy the pre-sequence navigation criteria, moving the third area completely off the display in the first direction; moving the first area completely into the display; displaying the first representative image for the first image sequence in the first area; 196. The method of any one of claims 193 to 195, comprising:

197. 197. The method of any one of claims 193 to 196, wherein the first image sequence is acquired by the camera before the second image sequence, and the first image sequence is acquired by the camera after the third image sequence.

198. 198. The method of any one of claims 183 to 197, wherein the first sequence of images are messages in a message conversation displayed in a scrollable area of ​​a messaging application, and the first sequence of images is displayed as the scrollable area of ​​the messaging application is scrolled.

199. The display and a touch-sensitive surface; and one or more processors; Memory and one or more programs stored in the memory and configured to be executed by the one or more processors, the one or more programs comprising: Storing a plurality of image sequences, each image sequence comprising: Representative images taken by the camera and one or more images acquired by the camera after acquiring each of the representative images; one or more images captured by the camera prior to capturing each of the representative images; displaying a first representative image for a first sequence of images in a movable first area on the display; Detecting a drag gesture on the touch-sensitive surface; in response to determining that the drag gesture is in a first direction on the touch-sensitive surface, replacing, in the movable first area, the display of the first representative image for the first image sequence with a time-series display of at least a portion of one or more images for the first image sequence acquired by the camera after acquiring the first representative image for the first image sequence; moving the first area in the first direction; one or more programs including instructions for performing An electronic device comprising:

200. 1. A computer-readable storage medium storing one or more programs, the one or more programs including instructions that, when executed by an electronic device having a display and a touch-sensitive surface, cause the device to: Storing a plurality of image sequences, each image sequence comprising: Representative images taken by the camera and one or more images acquired by the camera after acquiring each of the representative images; one or more images captured by the camera prior to capturing each of the representative images; displaying a first representative image for a first sequence of images in a movable first area on the display; Detecting a drag gesture on the touch-sensitive surface; in response to determining that the drag gesture is in a first direction on the touch-sensitive surface, replacing, in the movable first area, the display of the first representative image for the first image sequence with a time-series display of at least a portion of one or more images for the first image sequence acquired by the camera after acquiring the first representative image for the first image sequence; moving the first area in the first direction; A computer-readable storage medium that causes the

201. The display and a touch-sensitive surface; and means for storing a plurality of image sequences, each image sequence comprising: Representative images taken by the camera and one or more images acquired by the camera after acquiring each of the representative images; one or more images acquired by the camera prior to acquiring each of the representative images; means for displaying a first representative image for a first image sequence in a movable first area on the display; means for detecting a drag gesture on the touch-sensitive surface; enabled in accordance with a determination that the drag gesture is in a first direction on the touch-sensitive surface. replacing, in the movable first area, the display of the first representative image for the first image sequence with a time-series display of at least a portion of one or more images for the first image sequence acquired by the camera after acquiring the first representative image for the first image sequence; moving the first area in the first direction; and a means for performing the steps of An electronic device comprising:

202. 1. An information processing device for use in an electronic device having a display and a touch-sensitive surface, comprising: means for storing a plurality of image sequences, each image sequence comprising: Representative images taken by the camera and one or more images acquired by the camera after acquiring each of the representative images; one or more images acquired by the camera prior to acquiring each of the representative images; means for displaying a first representative image for a first image sequence in a movable first area on the display; means for detecting a drag gesture on the touch-sensitive surface; enabled in accordance with a determination that the drag gesture is in a first direction on the touch-sensitive surface. replacing, in the movable first area, the display of the first representative image for the first image sequence with a time-series display of at least a portion of one or more images for the first image sequence acquired by the camera after acquiring the first representative image for the first image sequence; moving the first area in the first direction; and a means for performing the steps of An information processing device comprising:

203. The display and a touch-sensitive surface; and one or more processors; Memory and one or more programs stored in the memory and configured to be executed by the one or more processors, the one or more programs including instructions for performing any of the methods recited in claims 183 to 198; and An electronic device comprising:

204. 200. A graphical user interface on an electronic device having a display, a touch-sensitive surface, a memory, and one or more processors for executing one or more programs stored in the memory, the graphical user interface including a user interface displayed according to any of the methods of claims 183 to 198.

205. The display and a touch-sensitive surface; and means for performing any of the methods of claims 183 to 198; and An electronic device comprising:

206. a display unit configured to display an image; a touch-sensitive surface unit configured to detect user input; a memory unit configured to store the image; a processing unit connected to the display unit, the memory unit, and the touch-sensitive surface unit, storing a plurality of image sequences in the memory unit, each image sequence comprising: Representative images taken by the camera and one or more images acquired by the camera after acquiring each of the representative images; one or more images captured by the camera prior to capturing each of the representative images; displaying on the display unit a first representative image for a first image sequence in a movable first area on the display unit; Detecting a drag gesture on the touch-sensitive surface unit; in response to determining that the drag gesture is in a first direction on the touch-sensitive surface unit; replacing, in the movable first area, the display of the first representative image for the first image sequence on the display unit with a time-series display of at least a portion of one or more images for the first image sequence acquired by the camera after acquiring the first representative image for the first image sequence; moving the first area in the first direction on the display unit; a processing unit configured to perform An electronic device comprising:

207. 207. The electronic device of claim 206, wherein moving the first area in the first direction comprises moving at least a portion of the first area in the first direction out of the display unit.

208. The processing unit In response to the determination that the drag gesture is in the first direction on the touch-sensitive surface unit, moving a movable second area in the first direction on the display unit; displaying, on the display unit in time sequence in the second area, at least a portion of one or more images for the second image sequence acquired by the camera prior to acquiring a second representative image for the second image sequence while moving in the first direction through the second area; 208. An electronic device according to claim 206 or 207, configured to:

209. 209. The electronic device of claim 208, wherein moving the second area in the first direction comprises moving at least a portion of the second area in the first direction into the display unit.

210. The processing unit In response to the determination that the drag gesture is in the first direction on the touch-sensitive surface unit, displaying, on the display unit, the second representative image for the second image sequence in the second area after moving the second area in the first direction.

210. An electronic device according to claim 208 or 209, configured to:

211. The processing unit detecting a change in intensity of an input corresponding to the second representative image for the second image sequence while displaying the second representative image in the second area; in response to detecting the change in intensity of the input, advancing through the second sequence of images in the second area without moving the second area on the display unit; 211. The electronic device of claim 210 configured to:

212. The processing unit Detecting an end of the drag gesture while moving through the first area and the second area; In response to detecting an end of the drag gesture while moving through the first area and the second area, In response to a determination that the drag gesture satisfies a next sequence navigation criterion, moving the first area completely out of the display unit in the first direction; moving the second area completely into the display unit; displaying the second representative image for the second image sequence in the second area on the display unit; 212. The electronic device of any one of claims 208 to 211, configured to:

213. The processing unit In response to detecting an end of the drag gesture while moving through the first area and the second area, In response to a determination that the drag gesture does not satisfy the next sequence navigation criteria, moving the second area completely out of the display unit in a second direction opposite to the first direction; moving the first area completely into the display unit; displaying, on the display unit, the first representative image for the first image sequence in the first area; 213. The electronic device of claim 212 configured to:

214. The processing unit in response to determining that the drag gesture is in a second direction on the touch-sensitive surface unit; replacing, in the movable first area, the display of the first representative image for the first image sequence with a reverse-chronological display on the display unit of at least a portion of one or more images for the first image sequence acquired by the camera prior to acquiring the first representative image for the first image sequence; moving the first area in the second direction on the display unit; 214. The electronic device of any one of claims 206 to 213, configured to:

215. 215. The electronic device of claim 214, wherein moving the first area in the second direction comprises moving at least a portion of the first area in the second direction out of the display unit.

216. The processing unit In response to the determination that the drag gesture is in the second direction on the touch-sensitive surface unit, moving a third area in the second direction on the display unit; displaying in the third area in reverse chronological order at least some of the one or more images for the third image sequence acquired by the camera after acquiring a third representative image for the third image sequence while moving through the third area in the second direction; 216. An electronic device according to claim 214 or 215, configured to:

217. 217. The electronic device of claim 216, wherein moving the third area in the second direction comprises moving at least a portion of the third area in the second direction into the display unit.

218. The processing unit In response to the determination that the drag gesture is in the second direction on the touch-sensitive surface unit, 218. An electronic device as described in claim 216 or 217, configured to display the third representative image for the third image sequence in the third area on the display unit after the third area is moved in the second direction.

219. The processing unit Detecting an end of the drag gesture while moving through the first area and the third area; In response to detecting an end of the drag gesture while moving through the first area and the third area, In response to a determination that the drag gesture satisfies a pre-sequence navigation criterion, moving the first area in the second direction completely out of the display unit; moving the third area completely into the display unit; displaying the third representative image for the third image sequence in the third area; pursuant to a determination that the drag gesture satisfies the pre-sequence navigation criteria; moving the third area completely out of the display unit in the first direction; moving the first area completely into the display unit; displaying, on the display unit, the first representative image for the first image sequence in the first area; 219. The electronic device of any one of claims 216 to 218, configured to:

220. 220. The electronic device of any one of claims 216 to 219, wherein the first image sequence is acquired by the camera before the second image sequence, and the first image sequence is acquired by the camera after the third image sequence.

221. 221. The electronic device of claim 206, wherein the first sequence of images are messages in a message conversation displayed in a scrollable area of ​​a messaging application, and the first sequence of images is displayed as the scrollable area of ​​the messaging application is scrolled.

222. In an electronic device having a display and a touch-sensitive surface, Storing a plurality of image sequences, each image sequence comprising: Representative images taken by the camera and one or more images captured by the camera prior to capturing each of the representative images; displaying a first representative image for a first sequence of images in a movable first area on the display; detecting a gesture on the touch-sensitive surface, the gesture comprising a movement of a contact corresponding to a movement on the display in a first direction; in response to detecting the gesture on the touch-sensitive surface, moving the first area in the first direction on the display; moving a movable second area in the first direction on the display; pursuant to a determination that a sequence display criterion is satisfied, displaying in the second area in chronological order at least a portion of the one or more images for the second image sequence that were acquired by the camera prior to acquiring a second representative image for the second image sequence while moving through the second area in the first direction; A method comprising:

223. in response to detecting the gesture on the touch-sensitive surface, displaying the second representative image for the second image sequence in the movable second area on the display while moving the second area in the first direction in accordance with a determination that the sequence display criterion is not satisfied.

223. The method of claim 222, comprising:

224. The method of claim 222 or 223, wherein the sequence display criteria include a criterion that the contact lifts off before displaying in chronological order in the second area at least some of the one or more images for the second image sequence acquired by the camera before acquiring the second representative image.

225. 225. A method according to any one of claims 222 to 224, wherein moving the movable second area in the first direction on the display includes displaying in the second area each previous image acquired before acquiring the second representative image.

226. the sequence indication criteria includes detecting lift-off of the contact, the method comprising: in response to detecting lift-off of the contact, continuing to move the movable second area in the first direction and continuing to move the movable first area in the first direction, wherein the images from the second image sequence are displayed at a rate such that when the movable second area stops moving in the first direction, the second representative image is displayed in the movable second area.

226. The method of any one of claims 222 to 225, comprising:

227. 227. A method according to any one of claims 222 to 226, comprising displaying a simulated parallax effect for an image within the movable first region while moving the movable first region, so that the image within the movable first region shifts relative to the frame of the movable first region.

228. 228. The method of any one of claims 222 to 227, comprising displaying a simulated parallax effect for an image within the movable second region while moving the movable second region while the contact is detected on the touch-sensitive surface, such that the image within the movable second region shifts relative to a frame of the movable second region.

229. 229. A method according to any one of claims 222 to 228, wherein each image sequence comprises one or more images acquired by the camera after acquiring the representative image.

230. 230. The method of any one of claims 222 to 229, wherein moving the first area in the first direction comprises moving at least a portion of the first area in the first direction off the display.

231. 231. The method of any one of claims 222 to 230, wherein moving the second area in the first direction comprises moving at least a portion of the second area in the first direction into the display.

232. 232. A method according to any one of claims 222 to 231, comprising displaying the second representative image for the second image sequence in the second area after moving the second area in the first direction.

233. detecting a change in intensity of an input corresponding to the second representative image for the second image sequence while displaying the second representative image in the second area; responsive to detecting the change in intensity of the input, advancing through the second sequence of images in the second area without moving the second area on the display; 233. The method of claim 232, comprising:

234. Detecting an end of the gesture while moving through the first area and the second area; In response to detecting an end of the gesture while moving through the first area and the second area, In response to a determination that the gesture satisfies a next sequence navigation criterion, moving the first area completely off the display in the first direction; moving the second area completely into the display; and displaying the second representative image for the second image sequence in the second area; 234. The method of any one of claims 222 to 233, comprising:

235. In response to detecting an end of the gesture while moving through the first area and the second area, In response to a determination that the gesture does not satisfy the next sequence navigation criteria, moving the second area completely off the display in a second direction opposite the first direction; moving the first area completely into the display; displaying the first representative image for the first image sequence in the first area; 235. The method of claim 234, comprising:

236. 236. The method of any one of claims 222 to 235, wherein the first sequence of images are messages in a message conversation displayed in a scrollable area of ​​a messaging application, and the first sequence of images is displayed as the scrollable area of ​​the messaging application is scrolled.

237. The display and a touch-sensitive surface; and one or more processors; Memory and and one or more programs, the one or more programs being stored in the memory and configured to be executed by the one or more processors, the one or more programs comprising: Storing a plurality of image sequences, each image sequence comprising: Representative images taken by the camera and one or more images captured by the camera prior to capturing each of the representative images; displaying a first representative image for a first sequence of images in a movable first area on the display; detecting a gesture on the touch-sensitive surface, the gesture comprising a movement of a contact corresponding to a movement on the display in a first direction; in response to detecting the gesture on the touch-sensitive surface, moving the first area in the first direction on the display; moving a movable second area in the first direction on the display; pursuant to a determination that a sequence display criterion is satisfied, displaying in the second area in chronological order at least a portion of the one or more images for the second image sequence that were acquired by the camera prior to acquiring a second representative image for the second image sequence while moving through the second area in the first direction; An electronic device containing instructions for performing the steps of:

238. 1. A computer-readable storage medium storing one or more programs, the one or more programs including instructions that, when executed by an electronic device having a display and a touch-sensitive surface, cause the device to: Storing a plurality of image sequences, each image sequence comprising: Representative images taken by the camera and one or more images captured by the camera prior to capturing each of the representative images; displaying a first representative image for a first sequence of images in a movable first area on the display; detecting a gesture on the touch-sensitive surface, the gesture comprising a movement of a contact corresponding to a movement on the display in a first direction; in response to detecting the gesture on the touch-sensitive surface, moving the first area in the first direction on the display; moving a movable second area in the first direction on the display; pursuant to a determination that a sequence display criterion is satisfied, displaying in the second area in chronological order at least a portion of the one or more images for the second image sequence that were acquired by the camera prior to acquiring a second representative image for the second image sequence while moving through the second area in the first direction; A computer-readable storage medium that causes the

239. The display and a touch-sensitive surface; and means for storing a plurality of image sequences, each image sequence comprising: Representative images taken by the camera and one or more images acquired by the camera prior to acquiring each of the representative images; means for displaying a first representative image for a first image sequence in a movable first area on the display; means for detecting a gesture on the touch-sensitive surface, the gesture comprising a movement of a contact corresponding to a movement on the display in a first direction; enabled in response to detecting the gesture on the touch-sensitive surface. moving the first area in the first direction on the display; moving a movable second area in the first direction on the display; pursuant to a determination that a sequence display criterion is satisfied, displaying in the second area in chronological order at least a portion of the one or more images for the second image sequence that were acquired by the camera prior to acquiring a second representative image for the second image sequence while moving through the second area in the first direction; and a means for performing the steps of An electronic device comprising:

240. 1. An information processing device for use in an electronic device having a display and a touch-sensitive surface, comprising: means for storing a plurality of image sequences, each image sequence comprising: Representative images taken by the camera and one or more images acquired by the camera prior to acquiring each of the representative images; means for displaying a first representative image for a first image sequence in a movable first area on the display; means for detecting a gesture on the touch-sensitive surface, the gesture comprising a movement of a contact corresponding to a movement on the display in a first direction; enabled in response to detecting the gesture on the touch-sensitive surface. moving the first area in the first direction on the display; moving a movable second area in the first direction on the display; pursuant to a determination that a sequence display criterion is satisfied, displaying in the second area in chronological order at least a portion of the one or more images for the second image sequence that were acquired by the camera prior to acquiring a second representative image for the second image sequence while moving through the second area in the first direction; and a means for performing the steps of An information processing device comprising:

241. The display and a touch-sensitive surface; and one or more processors; Memory and one or more programs stored in the memory and configured to be executed by the one or more processors, the one or more programs including instructions for performing any of the methods recited in claims 222 to 236; and An electronic device comprising:

242. 237. A computer-readable storage medium storing one or more programs, the one or more programs including instructions that, when executed by an electronic device with a display and a touch-sensitive surface, cause the device to perform any of the methods recited in claims 222 to 236.

243. 237. A graphical user interface on an electronic device having a display, a touch-sensitive surface, a memory, and one or more processors for executing one or more programs stored in the memory, the graphical user interface including a user interface displayed according to any of the methods of claims 222 to 236.

244. The display and a touch-sensitive surface; and means for carrying out any of the methods described in claims 222 to 236; and An electronic device comprising:

245. 1. An information processing device for use in an electronic device having a display and a touch-sensitive surface, comprising: Means for carrying out any of the methods of claims 222 to 236. An information processing device comprising:

246. a display unit configured to display an image; a touch-sensitive surface unit configured to detect user input; a processing unit connected to the display unit and the touch-sensitive surface unit, Storing a plurality of image sequences, each image sequence comprising: Representative images taken by the camera and one or more images captured by the camera prior to capturing each of the representative images; making a first representative image for a first image sequence displayable in a movable first area on the display unit; detecting a gesture on the touch-sensitive surface unit, the gesture comprising a movement of a contact corresponding to a movement in a first direction on the display unit; in response to detecting the gesture on the touch-sensitive surface unit; moving the first area in the first direction on the display unit; moving a movable second area in the first direction on the display unit; According to a determination that a sequence display criterion is satisfied, enabling at least a portion of the one or more images for the second image sequence acquired by the camera prior to acquiring a second representative image for the second image sequence while moving through the second area in the first direction to be displayed in chronological order in the second area; a processing unit configured to perform An electronic device comprising:

247. The processing unit in response to detecting the gesture on the touch-sensitive surface unit; and displaying the second representative image for the second image sequence in the movable second area on the display unit while moving the second area in the first direction in accordance with a determination that the sequence display criterion is not satisfied.

247. The electronic device of claim 246, configured to:

248. The electronic device of claim 246 or 247, wherein the sequence display criteria include a criterion that the contact lifts off before at least some of the one or more images for the second image sequence acquired by the camera before acquiring the second representative image can be displayed in chronological order in the second area.

249. 249. An electronic device according to any one of claims 246 to 248, wherein moving the movable second area in the first direction on the display unit comprises enabling each previous image acquired before acquiring the second representative image to be displayed in the second area.

250. The sequence indication criteria includes detecting lift-off of the contact, and the processing unit: in response to detecting lift-off of the contact, continuing to move the movable second area in the first direction and continuing to move the movable first area in the first direction, wherein the images from the second image sequence are displayed at a rate such that when the movable second area stops moving in the first direction, the second representative image is displayed in the movable second area.

250. An electronic device according to any one of claims 246 to 249, configured to:

251. 251. The electronic device of any one of claims 246 to 250, wherein the processing unit is configured to: display a simulated parallax effect for an image within the movable first region while moving the movable first region, such that the image within the movable first region shifts relative to the frame of the movable first region.

252. 252. The electronic device of any one of claims 246 to 251, wherein the processing unit is configured to: display a simulated parallax effect for an image within the movable second region while the movable second region is moved while the contact is detected on the touch-sensitive surface unit surface, such that the image within the movable second region shifts relative to a frame of the movable second region.

253. 253. An electronic device according to any one of claims 246 to 252, wherein each image sequence comprises one or more images captured by the camera after capturing the representative image.

254. 254. The electronic device of any one of claims 246 to 253, wherein moving the first area in the first direction comprises moving at least a portion of the first area in the first direction out of the display unit.

255. 255. The electronic device of any one of claims 246 to 254, wherein moving the second area in the first direction comprises moving at least a portion of the second area in the first direction into the display unit.

256. 256. The electronic device of any one of claims 246 to 255, wherein the processing unit is configured to enable the second representative image for the second image sequence to be displayed in the second area after the second area has been moved in the first direction.

257. The processing unit detecting a change in intensity of an input corresponding to the second representative image for the second image sequence while allowing the second representative image to be displayed in the second area; in response to detecting the change in intensity of the input, advancing through the second sequence of images in the second area without moving the second area on the display unit; 257. The electronic device of claim 256, configured to:

258. The processing unit Detecting an end of the gesture while moving through the first area and the second area; In response to detecting an end of the gesture while moving through the first area and the second area, In response to a determination that the gesture satisfies a next sequence navigation criterion, moving the first area completely out of the display unit in the first direction; moving the second area completely into the display unit; enabling the second representative image for the second image sequence to be displayed in the second area; 258. The electronic device of any one of claims 246 to 257, configured to:

259. The processing unit In response to detecting an end of the gesture while moving through the first area and the second area, In response to a determination that the gesture does not satisfy the next sequence navigation criteria, moving the second area completely out of the display unit in a second direction opposite to the first direction; moving the first area completely into the display unit; enabling the first representative image for the first image sequence to be displayed in the first area; 259. The electronic device of claim 258, configured to:

260. 260. The electronic device of any one of claims 246 to 259, wherein the first sequence of images are messages in a message conversation displayed in a scrollable area of ​​a messaging application, and the first sequence of images is displayed as the scrollable area of ​​the messaging application is scrolled.

261. In an electronic device having a display and a touch-sensitive surface, Storing a plurality of image sequences, each image sequence comprising: Representative images taken by the camera and one or more images acquired by the camera after acquiring each of the representative images; one or more images captured by the camera prior to capturing each of the representative images; storing a plurality of images different from the images in the plurality of image sequences, each image in the plurality of images not being part of a sequence of images in the plurality of image sequences; displaying a first image on the display; detecting a first input while displaying the first image on the display; In response to detecting the first input, performing a first operation including displaying at least some of the images in the first image sequence in addition to the first image in accordance with a determination that the first image is an image in a first image sequence; performing a second action, different from the first action, involving the first image in accordance with a determination that the first image is an image in the plurality of images that is different from the image in the plurality of image sequences; A method comprising:

262. the first input is a press and hold gesture; the first operation displays at least a portion of the first sequence of images; 262. The method of claim 261, wherein the second action displays information about the first image together with the first image.

263. the first input is a press and hold gesture; the first operation displays at least a portion of the first sequence of images; 262. The method of claim 261, wherein the second action displays an animation showing different portions of the first image.

264. the device includes one or more sensors for detecting an intensity of contact with the touch-sensitive surface; the first input includes a finger contact that satisfies a first contact intensity criterion; the first operation displays at least a portion of the first sequence of images; 262. The method of claim 261, wherein the second action displays information about the first image together with the first image.

265. the device includes one or more sensors for detecting an intensity of contact with the touch-sensitive surface; the first input includes a finger contact that satisfies a first contact intensity criterion; the first operation displays at least a portion of the first sequence of images; 262. The method of claim 261, wherein the second action displays an animation showing different portions of the first image.

266. the first input is a drag gesture; transitioning from displaying the first image to displaying a second image, the second image not being an image in the first image sequence, during which the first operation displays at least a portion of the images in the first image sequence; 262. The method of claim 261, wherein the second operation transitions from displaying the first image to displaying a third image, the third image not being an image in the first image sequence.

267. The display and a touch-sensitive surface; and one or more processors; Memory and one or more programs stored in the memory and configured to be executed by the one or more processors, the one or more programs comprising: Storing a plurality of image sequences, each image sequence comprising: Representative images taken by the camera and one or more images acquired by the camera after acquiring each of the representative images; one or more images captured by the camera prior to capturing each of the representative images; storing a plurality of images different from the images in the plurality of image sequences, each image in the plurality of images not being part of a sequence of images in the plurality of image sequences; displaying a first image on the display; detecting a first input while displaying the first image on the display; In response to detecting the first input, performing a first operation including displaying at least some of the images in the first image sequence in addition to the first image in accordance with a determination that the first image is an image in a first image sequence; performing a second action, different from the first action, involving the first image in accordance with a determination that the first image is an image in the plurality of images that is different from the image in the plurality of image sequences; one or more programs including instructions for performing An electronic device comprising:

268. 1. A computer-readable storage medium storing one or more programs, the one or more programs including instructions that, when executed by an electronic device having a display and a touch-sensitive surface, cause the device to: Storing a plurality of image sequences, each image sequence comprising: Representative images taken by the camera and one or more images acquired by the camera after acquiring each of the representative images; one or more images captured by the camera prior to capturing each of the representative images; storing a plurality of images different from the images in the plurality of image sequences, each image in the plurality of images not being part of a sequence of images in the plurality of image sequences; displaying a first image on the display; detecting a first input while displaying the first image on the display; In response to detecting the first input, performing a first operation including displaying at least some of the images in the first image sequence in addition to the first image in accordance with a determination that the first image is an image in a first image sequence; performing a second action, different from the first action, involving the first image in accordance with a determination that the first image is an image in the plurality of images that is different from the image in the plurality of image sequences; A computer-readable storage medium that causes the

269. The display and a touch-sensitive surface; and means for storing a plurality of image sequences, each image sequence comprising: Representative images taken by the camera and one or more images acquired by the camera after acquiring each of the representative images; one or more images acquired by the camera prior to acquiring each of the representative images; means for storing a plurality of images different from the images in the plurality of sequences of images, each image in the plurality of images not being part of a sequence of images in the plurality of sequences of images; means for displaying a first image on the display; means for detecting a first input, the first input being activated while displaying the first image on the display; enabled in response to detecting the first input; performing a first operation including displaying at least some of the images in the first image sequence in addition to the first image in accordance with a determination that the first image is an image in a first image sequence; performing a second action, different from the first action, involving the first image in accordance with a determination that the first image is an image in the plurality of images that is different from the image in the plurality of image sequences; and a means for performing the steps of An electronic device comprising:

270. 1. An information processing device for use in an electronic device having a display and a touch-sensitive surface, comprising: means for storing a plurality of image sequences, each image sequence comprising: Representative images taken by the camera and one or more images acquired by the camera after acquiring each of the representative images; one or more images acquired by the camera prior to acquiring each of the representative images; means for storing a plurality of images different from the images in the plurality of sequences of images, each image in the plurality of images not being part of a sequence of images in the plurality of sequences of images; means for displaying a first image on the display; means for detecting a first input, the first input being activated while displaying the first image on the display; enabled in response to detecting the first input; performing a first operation including displaying at least some of the images in the first image sequence in addition to the first image in accordance with a determination that the first image is an image in a first image sequence; performing a second action, different from the first action, involving the first image in accordance with a determination that the first image is an image in the plurality of images that is different from the image in the plurality of image sequences; and a means for performing the steps of An information processing device comprising:

271. The display and a touch-sensitive surface; and one or more processors; Memory and one or more programs stored in the memory and configured to be executed by the one or more processors, the one or more programs including instructions for performing any of the methods recited in claims 261 to 266; and An electronic device comprising:

272. 267. A computer-readable storage medium storing one or more programs, the one or more programs including instructions that, when executed by an electronic device with a display and a touch-sensitive surface, cause the device to perform any of the methods recited in claims 261 to 266.

273. 267. A graphical user interface on an electronic device having a display, a touch-sensitive surface, a memory, and one or more processors for executing one or more programs stored in the memory, the graphical user interface comprising a user interface displayed according to any of the methods of claims 261 to 266.

274. The display and a touch-sensitive surface; and means for carrying out any of the methods described in claims 261 to 266; An electronic device comprising:

275. 267. An information processing apparatus for use in an electronic device having a display and a touch-sensitive surface, the information processing apparatus comprising means for performing any of the methods described in claims 261 to 266.

276. a display unit configured to display an image; a touch-sensitive surface unit configured to detect user input; a memory unit configured to store the image; a processing unit connected to the display unit, the memory unit, and the touch-sensitive surface unit, storing a plurality of image sequences in the memory unit, each image sequence comprising: Representative images taken by the camera and one or more images acquired by the camera after acquiring each of the representative images; one or more images captured by the camera prior to capturing each of the representative images; storing in the memory unit a plurality of images different from the images in the plurality of sequences of images, each image in the plurality of images not being part of a sequence of images in the plurality of sequences of images; displaying a first image on the display unit; detecting a first input while displaying the first image on the display unit; In response to detecting the first input, performing a first operation including, in accordance with a determination that the first image is an image in a first image sequence, displaying on the display unit at least some of the images in the first image sequence in addition to the first image; performing a second action, different from the first action, involving the first image in accordance with a determination that the first image is an image in the plurality of images that is different from the image in the plurality of image sequences; a processing unit configured to perform An electronic device comprising:

277. the first input is a press and hold gesture; the first operation displays at least a portion of the first sequence of images; 277. The electronic device of claim 276, wherein the second action displays the first image along with information about the first image on the display unit.

278. the first input is a press and hold gesture; the first operation displays at least a portion of the first sequence of images; 277. The electronic device of claim 276, wherein the second action displays an animation on the display unit showing different portions of the first image.

279. the device includes one or more sensor units for detecting an intensity of contact with the touch-sensitive surface unit; the first input includes a finger contact that satisfies a first contact intensity criterion; the first operation displays at least a portion of the first sequence of images; 277. The electronic device of claim 276, wherein the second action displays the first image along with information about the first image on the display unit.

280. the device includes one or more sensor units for detecting an intensity of contact with the touch-sensitive surface unit; the first input includes a finger contact that satisfies a first contact intensity criterion; the first operation displays at least a portion of the first sequence of images; 277. The electronic device of claim 276, wherein the second action displays an animation on the display unit showing different portions of the first image.

281. the first input is a drag gesture; the first operation displays at least some of the images in the first sequence of images on the display unit during a transition from displaying the first image to displaying a second image, the second image not being an image in the first sequence of images; 277. The electronic device of claim 276, wherein the second operation transitions from displaying the first image to displaying a third image, the third image not being an image in the first image sequence.

282. In an electronic device having a display and a touch-sensitive surface, Displaying a representative image on the display, the representative image is an image in a sequence of images taken by a camera; the image sequence includes one or more images acquired by the camera after acquiring the representative image; the image sequence includes one or more images captured by the camera prior to capturing the representative image; detecting an input that modifies the representative image while displaying the representative image on the display; In response to detecting the input to modify the representative image, modifying the representative image, the one or more images acquired by the camera after acquiring the representative image, and the one or more images acquired by the camera before acquiring the representative image in accordance with determining that the device is in a first editing mode; modifying the representative image without modifying the one or more images acquired by the camera after capturing the representative image and without modifying the one or more images acquired by the camera before capturing the representative image in accordance with a determination that the device is in a second editing mode different from the first editing mode; A method comprising:

283. After modifying the representative image, without modifying the one or more images acquired by the camera after acquiring the representative image and without modifying the one or more images acquired by the camera before acquiring the representative image, displaying the modified representative image on the display; detecting a first portion of a second input while displaying the modified representative image on the display; In response to detecting the first portion of the second input, replacing a display of the modified representative image with an ordered display of at least some of the one or more images captured by the camera after capturing the representative image; detecting a second portion of the second input after detecting the first portion of the second input; in response to detecting the second portion of the second input, sequentially displaying at least a portion of the one or more images acquired by the camera prior to acquiring the representative image, the unmodified representative image, and at least a portion of the one or more images acquired by the camera after acquiring the representative image; 283. The method of claim 282, comprising:

284. After modifying the representative image, without modifying the one or more images acquired by the camera after acquiring the representative image and without modifying the one or more images acquired by the camera before acquiring the representative image, displaying the modified representative image on the display; detecting a second input while displaying the modified representative image on the display; In response to detecting a second input, sequentially displaying at least a portion of the one or more images acquired by the camera before acquiring the representative image, the unmodified representative image, and at least a portion of the one or more images acquired by the camera after acquiring the representative image; 283. The method of claim 282, comprising:

285. After modifying the representative image, without modifying the one or more images acquired by the camera after acquiring the representative image and without modifying the one or more images acquired by the camera before acquiring the representative image, displaying the modified representative image on the display; detecting a first portion of a second input while displaying the modified representative image on the display; In response to detecting the first portion of the second input, replacing a display of the modified representative image with an ordered display of at least some of the one or more images captured by the camera after capturing the representative image; detecting a second portion of the second input after detecting the first portion of the second input; in response to detecting the second portion of the second input, sequentially displaying at least a portion of the one or more images acquired by the camera prior to acquiring the representative image, the modified representative image, and at least a portion of the one or more images acquired by the camera after acquiring the representative image; 283. The method of claim 282, comprising:

286. After modifying the representative image, without modifying the one or more images acquired by the camera after acquiring the representative image and without modifying the one or more images acquired by the camera before acquiring the representative image, displaying the modified representative image on the display; detecting a second input while displaying the modified representative image on the display; In response to detecting the second input, sequentially displaying at least a portion of the one or more images acquired by the camera before acquiring the representative image, the corrected representative image, and at least a portion of the one or more images acquired by the camera after acquiring the representative image; 283. The method of claim 282, comprising:

287. After modifying the representative image, without modifying the one or more images acquired by the camera after acquiring the representative image and without modifying the one or more images acquired by the camera before acquiring the representative image, displaying the modified representative image on the display; detecting a first portion of a second input while displaying the modified representative image on the display; In response to detecting the first portion of the second input, replacing a display of the modified representative image with an ordered display of at least some of the one or more images captured by the camera after capturing the representative image; detecting a second portion of the second input after detecting the first portion of the second input; In response to detecting the second portion of the second input, sequentially displaying at least a portion of one or more images captured by a camera before capturing the representative image and at least a portion of one or more images captured by a camera after capturing the representative image; 283. The method of claim 282, comprising:

288. After modifying the representative image, without modifying the one or more images acquired by the camera after acquiring the representative image and without modifying the one or more images acquired by the camera before acquiring the representative image, displaying the modified representative image on the display; detecting a second input while displaying the modified representative image on the display; In response to detecting the second input, sequentially displaying at least a portion of one or more images acquired by the camera before acquiring the representative image and at least a portion of one or more images acquired by the camera after acquiring the representative image; 283. The method of claim 282, comprising:

289. detecting a second input corresponding to a request to delete the one or more images acquired by the camera before acquiring the representative image and the one or more images acquired by the camera after acquiring the representative image; In response to detecting the second input, deleting the one or more images acquired by the camera before acquiring the representative image and the one or more images acquired by the camera after acquiring the representative image; 289. The method of any one of claims 282 to 288, comprising:

290. After modifying the representative image, the one or more images acquired by the camera after acquiring the representative image, and the one or more images acquired by the camera before acquiring the representative image, displaying the modified representative image on the display; detecting a first portion of a second input while displaying the modified representative image on the display; In response to detecting the first portion of the second input, replacing the display of the modified representative image with an ordered display of at least a portion of the modified one or more images captured by the camera after capturing the representative image; detecting a second portion of the second input after detecting the first portion of the second input; in response to detecting the second portion of the second input, sequentially displaying at least a portion of the modified one or more images acquired by the camera prior to acquiring the representative image, the modified representative image, and at least a portion of the modified one or more images acquired by the camera after acquiring the representative image; 289. The method of any one of claims 282 to 289, comprising:

291. After modifying the representative image, the one or more images acquired by the camera after acquiring the representative image, and the one or more images acquired by the camera before acquiring the representative image, displaying the modified representative image on the display; detecting a second input while displaying the modified representative image on the display; In response to detecting the second input, sequentially displaying at least a portion of the one or more corrected images acquired by the camera before acquiring the representative image, the corrected representative image, and at least a portion of the one or more corrected images acquired by the camera after acquiring the representative image; 289. The method of any one of claims 282 to 289, comprising:

292. The display and a touch-sensitive surface; and one or more processors; Memory and one or more programs stored in the memory and configured to be executed by the one or more processors, the one or more programs comprising: Displaying a representative image on the display, the representative image is an image in a sequence of images taken by a camera; the image sequence includes one or more images acquired by the camera after acquiring the representative image; the image sequence includes one or more images captured by the camera prior to capturing the representative image; detecting an input that modifies the representative image while displaying the representative image on the display; In response to detecting the input to modify the representative image, modifying the representative image, the one or more images acquired by the camera after acquiring the representative image, and the one or more images acquired by the camera before acquiring the representative image in accordance with determining that the device is in a first editing mode; modifying the representative image without modifying the one or more images acquired by the camera after capturing the representative image and without modifying the one or more images acquired by the camera before capturing the representative image in accordance with a determination that the device is in a second editing mode different from the first editing mode; one or more programs including instructions for performing An electronic device comprising:

293. 1. A computer-readable storage medium storing one or more programs, the one or more programs including instructions that, when executed by an electronic device having a display and a touch-sensitive surface, cause the device to: Displaying a representative image on the display, the representative image is an image in a sequence of images taken by a camera; the image sequence includes one or more images acquired by the camera after acquiring the representative image; the image sequence includes one or more images captured by the camera prior to capturing the representative image; detecting an input that modifies the representative image while displaying the representative image on the display; In response to detecting the input to modify the representative image, modifying the representative image, the one or more images acquired by the camera after acquiring the representative image, and the one or more images acquired by the camera before acquiring the representative image in accordance with determining that the device is in a first editing mode; modifying the representative image without modifying the one or more images acquired by the camera after capturing the representative image and without modifying the one or more images acquired by the camera before capturing the representative image in accordance with a determination that the device is in a second editing mode different from the first editing mode; A computer-readable storage medium that causes the

294. The display and a touch-sensitive surface; and a means for displaying a representative image on the display, the representative image is an image in a sequence of images taken by a camera; the image sequence includes one or more images acquired by the camera after acquiring the representative image; the image sequence includes one or more images acquired by the camera prior to acquiring the representative image; means for detecting an input that modifies the representative image, the input being activated during display of the representative image on the display; enabled in response to detecting the input to modify the representative image. modifying the representative image, the one or more images acquired by the camera after acquiring the representative image, and the one or more images acquired by the camera before acquiring the representative image in accordance with determining that the device is in a first editing mode; modifying the representative image without modifying the one or more images acquired by the camera after capturing the representative image and without modifying the one or more images acquired by the camera before capturing the representative image in accordance with a determination that the device is in a second editing mode different from the first editing mode; and a means for carrying out the An electronic device comprising:

295. 1. An information processing device for use in an electronic device having a display and a touch-sensitive surface, comprising: a means for displaying a representative image on the display, the representative image is an image in a sequence of images taken by a camera; the image sequence includes one or more images acquired by the camera after acquiring the representative image; the image sequence includes one or more images acquired by the camera prior to acquiring the representative image; means for detecting an input that modifies the representative image, the input being activated during display of the representative image on the display; enabled in response to detecting the input to modify the representative image. modifying the representative image, the one or more images acquired by the camera after acquiring the representative image, and the one or more images acquired by the camera before acquiring the representative image in accordance with determining that the device is in a first editing mode; modifying the representative image without modifying the one or more images acquired by the camera after capturing the representative image and without modifying the one or more images acquired by the camera before capturing the representative image in accordance with a determination that the device is in a second editing mode different from the first editing mode; and a means for carrying out the An information processing device comprising:

296. The display and a touch-sensitive surface; and one or more processors; Memory and one or more programs stored in the memory and configured to be executed by the one or more processors, the one or more programs including instructions for performing any of the methods recited in claims 282 to 291; and An electronic device comprising:

297. 302. A computer-readable storage medium storing one or more programs, the one or more programs including instructions that, when executed by an electronic device with a display and a touch-sensitive surface, cause the device to perform any of the methods recited in claims 282 to 291.

298. 292. A graphical user interface on an electronic device having a display, a touch-sensitive surface, a memory, and one or more processors for executing one or more programs stored in the memory, the graphical user interface including a user interface displayed according to any of the methods of claims 282 to 291.

299. The display and a touch-sensitive surface; and means for carrying out any of the methods described in claims 282 to 291; An electronic device comprising:

300. 1. An information processing device for use in an electronic device having a display and a touch-sensitive surface, comprising:

292. An information processing apparatus comprising means for performing any of the methods described in claims 282 to 291.

301. a display unit configured to display an image; a touch-sensitive surface unit configured to detect user input; a processing unit connected to the display unit and the touch-sensitive surface unit, A representative image can be displayed on the display unit, the representative image is an image in a sequence of images taken by a camera; the image sequence includes one or more images acquired by the camera after acquiring the representative image; the image sequence includes one or more images captured by the camera prior to capturing the representative image; detecting an input that modifies the representative image while allowing the representative image to be displayed on the display unit; In response to detecting the input to modify the representative image, modifying the representative image, the one or more images acquired by the camera after acquiring the representative image, and the one or more images acquired by the camera before acquiring the representative image in accordance with determining that the device is in a first editing mode; modifying the representative image without modifying the one or more images acquired by the camera after capturing the representative image and without modifying the one or more images acquired by the camera before capturing the representative image in accordance with a determination that the device is in a second editing mode different from the first editing mode; a processing unit configured to perform An electronic device comprising:

302. The processing unit After modifying the representative image, without modifying the one or more images acquired by the camera after acquiring the representative image and without modifying the one or more images acquired by the camera before acquiring the representative image, enabling the modified representative image to be displayed on the display unit; detecting a first portion of a second input while enabling display of the modified representative image on the display unit; In response to detecting the first portion of the second input, replacing the display of the modified representative image with an ordered display of at least a portion of the one or more images captured by the camera after capturing the representative image; detecting a second portion of the second input after detecting the first portion of the second input; In response to detecting the second portion of the second input, enabling sequential display of at least a portion of the one or more images captured by the camera prior to capturing the representative image, the unmodified representative image, and at least a portion of the one or more images captured by the camera after capturing the representative image; 302. The electronic device of claim 301 configured to:

303. The processing unit After modifying the representative image, without modifying the one or more images acquired by the camera after acquiring the representative image and without modifying the one or more images acquired by the camera before acquiring the representative image, enabling the modified representative image to be displayed on the display unit; detecting a second input while enabling display of the modified representative image on the display unit; In response to detecting the second input, at least a portion of the one or more images acquired by the camera before acquiring the representative image, the unmodified representative image, and at least a portion of the one or more images acquired by the camera after acquiring the representative image can be displayed in sequence; 302. The electronic device of claim 301 configured to:

304. The processing unit After modifying the representative image, without modifying the one or more images acquired by the camera after acquiring the representative image and without modifying the one or more images acquired by the camera before acquiring the representative image, enabling the modified representative image to be displayed on the display unit; detecting a first portion of a second input while enabling display of the modified representative image on the display unit; In response to detecting the first portion of the second input, replacing the display of the modified representative image with an ordered display of at least a portion of the one or more images captured by the camera after capturing the representative image; detecting a second portion of the second input after detecting the first portion of the second input; In response to detecting the second portion of the second input, enabling sequential display of at least a portion of the one or more images captured by the camera prior to capturing the representative image, the modified representative image, and at least a portion of the one or more images captured by the camera after capturing the representative image; 302. The electronic device of claim 301 configured to:

305. The processing unit After modifying the representative image, without modifying the one or more images acquired by the camera after acquiring the representative image and without modifying the one or more images acquired by the camera before acquiring the representative image, enabling the modified representative image to be displayed on the display unit; detecting a second input while enabling display of the modified representative image on the display unit; In response to detecting the second input, at least a portion of the one or more images acquired by the camera before acquiring the representative image, the corrected representative image, and at least a portion of the one or more images acquired by the camera after acquiring the representative image can be displayed in sequence; 302. The electronic device of claim 301 configured to:

306. The processing unit After modifying the representative image, without modifying the one or more images acquired by the camera after acquiring the representative image and without modifying the one or more images acquired by the camera before acquiring the representative image, enabling the modified representative image to be displayed on the display unit; detecting a first portion of a second input while enabling display of the modified representative image on the display unit; In response to detecting the first portion of the second input, replacing the display of the modified representative image with an ordered display of at least a portion of the one or more images captured by the camera after capturing the representative image; detecting a second portion of the second input after detecting the first portion of the second input; In response to detecting the second portion of the second input, at least a portion of one or more images acquired by the camera before acquiring the representative image and at least a portion of one or more images acquired by the camera after acquiring the representative image can be displayed in sequence; 302. The electronic device of claim 301 configured to:

307. The processing unit After modifying the representative image, without modifying the one or more images acquired by the camera after acquiring the representative image and without modifying the one or more images acquired by the camera before acquiring the representative image, enabling the modified representative image to be displayed on the display unit; detecting a second input while enabling display of the modified representative image on the display unit; In response to detecting the second input, at least a portion of one or more images acquired by the camera before acquiring the representative image and at least a portion of one or more images acquired by the camera after acquiring the representative image can be displayed in sequence; 302. The electronic device of claim 301 configured to:

308. The processing unit detecting a second input corresponding to a request to delete the one or more images acquired by the camera before acquiring the representative image and the one or more images acquired by the camera after acquiring the representative image; In response to detecting the second input, deleting the one or more images acquired by the camera before acquiring the representative image and the one or more images acquired by the camera after acquiring the representative image; 308. The electronic device of any one of claims 301 to 307, configured to:

309. The processing unit After modifying the representative image, the one or more images acquired by the camera after acquiring the representative image, and the one or more images acquired by the camera before acquiring the representative image, enabling the modified representative image to be displayed on the display unit; detecting a first portion of a second input while enabling display of the modified representative image on the display unit; In response to detecting the first portion of the second input, replacing the display of the modified representative image with an ordered display of at least a portion of the one or more images captured by the camera after capturing the representative image; detecting a second portion of the second input after detecting the first portion of the second input; In response to detecting the second portion of the second input, enabling sequential display of at least a portion of the one or more corrected images acquired by the camera before acquiring the representative image, the corrected representative image, and at least a portion of the one or more corrected images acquired by the camera after acquiring the representative image; 309. The electronic device of any one of claims 301 to 308, configured to:

310. The processing unit After modifying the representative image, the one or more images acquired by the camera after acquiring the representative image, and the one or more images acquired by the camera before acquiring the representative image, enabling the modified representative image to be displayed on the display unit; detecting a second input while enabling display of the modified representative image on the display unit; In response to detecting the second input, at least a portion of the one or more corrected images acquired by the camera before acquiring the representative image, the corrected representative image, and at least a portion of the one or more corrected images acquired by the camera after acquiring the representative image can be displayed in sequence; 309. The electronic device of any one of claims 301 to 308, configured to:

311. a first electronic device having a display, Displaying on the display the representative image in a user interface of an application configured to communicate with other electronic devices; the representative image is an image in a sequence of images taken by a camera; the image sequence includes one or more images acquired by the camera after acquiring the representative image; the image sequence includes one or more images captured by the camera prior to capturing the representative image; detecting, while displaying the representative image on the display, an input corresponding to a request to transmit or select the representative image for transmission from the first electronic device to a remote second electronic device using the application; In response to detecting the input corresponding to the request to transmit the representative image to the second electronic device or the request to select the representative image for transmission, displaying a first set of options for transmitting at least a portion of the image sequence to the second electronic device in accordance with a determination that the second electronic device is configured to interact with the image sequence as a group; and displaying a second set of options for transmitting at least a portion of the image sequence to the second electronic device in accordance with a determination that the second electronic device is not configured to interact with the image sequence as a group, the second set of options being different from the first set of options; A method comprising:

312. 312. The method of claim 311, wherein the application configured to communicate with other electronic devices is displayed in response to detecting a selection of an application icon corresponding to the application in a shared user interface.

313. 313. The method of claim 311 or 312, wherein the first set of options for transmitting at least a portion of the image sequence to the second electronic device includes an option to transmit the entire image sequence.

314. 314. The method of any one of claims 311 to 313, wherein the second set of options for transmitting at least a portion of the image sequence to the second electronic device includes an option for transmitting the representative image without transmitting the one or more images acquired by the camera after acquiring the representative image and without transmitting the one or more images acquired by the camera before acquiring the representative image.

315. determining whether the first electronic device is in a first mode that allows transmission of the image sequence; modifying the first set of options for transmitting at least the portion of the image sequence to the second electronic device in accordance with a determination that the first electronic device is not in the first mode that allows transmission of the image sequence as a group; 315. The method of any one of claims 311 to 314, comprising:

316. 316. The method of any one of claims 311 to 315, wherein the second set of options for transmitting at least a portion of the image sequence to the second electronic device includes an option for converting at least the portion of the image sequence to a video format.

317. 317. The method of any one of claims 311 to 316, wherein the first set of options for transmitting at least a portion of the image sequence to the second electronic device includes an option for converting at least the portion of the image sequence to a video format.

318. transmitting audio corresponding to the image sequence in accordance with the determination that the second electronic device is configured to interact with the image sequence as a group.

318. The method of any one of claims 311 to 317, comprising:

319. transmitting metadata corresponding to the first image sequence in accordance with the determination that the second electronic device is configured to interact with the image sequence as a group.

319. The method of any one of claims 311 to 318, comprising:

320. While the representative image is displayed on the display, Detecting a second input; In response to detecting the second input, replacing the display of the representative image with a sequential display of at least some of the images in the image sequence; 320. The method of any one of claims 311 to 319, comprising:

321. the first electronic device comprising a touch-sensitive surface and one or more sensors for detecting an intensity of contact with the touch-sensitive surface; 321. The method of claim 320, wherein the second input comprises a finger contact that satisfies a first contact intensity criterion.

322. The display and one or more processors; Memory and one or more programs stored in the memory and configured to be executed by the one or more processors, the one or more programs comprising: Displaying on the display the representative image in a user interface of an application configured to communicate with other electronic devices; the representative image is an image in a sequence of images taken by a camera; the image sequence includes one or more images acquired by the camera after acquiring the representative image; the image sequence includes one or more images captured by the camera prior to capturing the representative image; detecting, while displaying the representative image on the display, an input corresponding to a request to transmit or select the representative image for transmission from the electronic device to a remote second electronic device using the application; In response to detecting the input corresponding to the request to transmit the representative image to the second electronic device or the request to select the representative image for transmission, displaying a first set of options for transmitting at least a portion of the image sequence to the second electronic device in accordance with a determination that the second electronic device is configured to interact with the image sequence as a group; and displaying a second set of options for transmitting at least a portion of the image sequence to the second electronic device in accordance with a determination that the second electronic device is not configured to interact with the image sequence as a group, the second set of options being different from the first set of options; one or more programs including instructions for performing An electronic device comprising:

323. 1. A computer-readable storage medium storing one or more programs, the one or more programs including instructions that, when executed by an electronic device having a display, cause the device to: Displaying on the display the representative image in a user interface of an application configured to communicate with other electronic devices; the representative image is an image in a sequence of images taken by a camera; the image sequence includes one or more images acquired by the camera after acquiring the representative image; the image sequence includes one or more images captured by the camera prior to capturing the representative image; detecting, while displaying the representative image on the display, an input corresponding to a request to transmit or select the representative image for transmission from the electronic device to a remote second electronic device using the application; In response to detecting the input corresponding to the request to transmit the representative image to the second electronic device or the request to select the representative image for transmission, displaying a first set of options for transmitting at least a portion of the image sequence to the second electronic device in accordance with a determination that the second electronic device is configured to interact with the image sequence as a group; and displaying a second set of options for transmitting at least a portion of the image sequence to the second electronic device in accordance with a determination that the second electronic device is not configured to interact with the image sequence as a group, the second set of options being different from the first set of options; A computer-readable storage medium that causes the

324. The display and means for displaying, on said display, a representative image in a user interface of an application configured to communicate with other electronic devices, the representative image is an image in a sequence of images taken by a camera; the image sequence includes one or more images acquired by the camera after acquiring the representative image; the image sequence includes one or more images acquired by the camera prior to acquiring the representative image; means for detecting an input corresponding to a request to transmit the representative image or to select the representative image for transmission from the electronic device to a remote second electronic device using the application, the input being enabled while the representative image is displayed on the display; enabled in response to detecting the input corresponding to a request to transmit the representative image to the second electronic device or a request to select the representative image for transmission. displaying a first set of options for transmitting at least a portion of the image sequence to the second electronic device in accordance with a determination that the second electronic device is configured to interact with the image sequence as a group; and displaying a second set of options for transmitting at least a portion of the image sequence to the second electronic device in accordance with a determination that the second electronic device is not configured to interact with the image sequence as a group, the second set of options being different from the first set of options; and a means for performing the steps of An electronic device comprising:

325. An information processing apparatus for use in a first electronic device having a display, comprising: means for displaying, on said display, a representative image in a user interface of an application configured to communicate with other electronic devices, the representative image is an image in a sequence of images taken by a camera; the image sequence includes one or more images acquired by the camera after acquiring the representative image; the image sequence includes one or more images acquired by the camera prior to acquiring the representative image; means for detecting an input corresponding to a request to transmit the representative image or to select the representative image for transmission from the first electronic device to a remote second electronic device using the application, the input being enabled while the representative image is displayed on the display; enabled in response to detecting the input corresponding to a request to transmit the representative image to the second electronic device or a request to select the representative image for transmission. displaying a first set of options for transmitting at least a portion of the image sequence to the second electronic device in accordance with a determination that the second electronic device is configured to interact with the image sequence as a group; and displaying a second set of options for transmitting at least a portion of the image sequence to the second electronic device in accordance with a determination that the second electronic device is not configured to interact with the image sequence as a group, the second set of options being different from the first set of options; and a means for performing the steps of An information processing device comprising:

326. The display and one or more processors; Memory and one or more programs stored in the memory and configured to be executed by the one or more processors, the one or more programs including instructions for performing any of the methods recited in claims 311 to 321; and An electronic device comprising:

327. A computer-readable storage medium storing one or more programs, the one or more programs including instructions that, when executed by an electronic device having a display, cause the device to perform any of the methods of claims 311 to 321.

328. A graphical user interface on an electronic device having a display, a memory, and one or more processors for executing one or more programs stored in the memory, the graphical user interface including a user interface displayed according to any of the methods of claims 311 to 321.

329. The display and means for carrying out any of the methods described in claims 311 to 321; An electronic device comprising:

330. 1. An information processing device for use in an electronic device having a display, comprising: Means for carrying out any of the methods of claims 311 to 321. An information processing device comprising:

331. a display unit configured to display an image; a processing unit connected to the display unit, On said display unit, the representative image can be displayed in a user interface of an application configured to communicate with other electronic devices, the representative image is an image in a sequence of images taken by a camera; the image sequence includes one or more images acquired by the camera after acquiring the representative image; the image sequence includes one or more images captured by the camera prior to capturing the representative image; detecting, while the representative image is displayable on the display unit, an input corresponding to a request to transmit or select the representative image for transmission from the electronic device to a remote second electronic device using the application; In response to detecting the input corresponding to the request to transmit the representative image to the second electronic device or the request to select the representative image for transmission, In accordance with determining that the second electronic device is configured to interact with the image sequence as a group, displaying a first set of options for transmitting at least a portion of the image sequence to the second electronic device; enabling displaying a second set of options for transmitting at least a portion of the image sequence to the second electronic device in accordance with determining that the second electronic device is not configured to interact with the image sequence as a group, the second set of options being different from the first set of options; a processing unit configured to perform An electronic device comprising:

332. 332. The electronic device of claim 331, wherein the application configured to communicate with other electronic devices is displayed in response to detecting a selection of an application icon corresponding to the application in a shared user interface.

333. 333. The electronic device of claim 331 or 332, wherein the first set of options for transmitting at least a portion of the image sequence to the second electronic device includes an option to transmit the entire image sequence.

334. 334. The electronic device of any one of claims 331 to 333, wherein the second set of options for transmitting at least a portion of the image sequence to the second electronic device includes an option for transmitting the representative image without transmitting the one or more images acquired by the camera after acquiring the representative image and without transmitting the one or more images acquired by the camera before acquiring the representative image.

335. The processing unit determining whether the electronic device is in a first mode that allows transmission of the image sequence; modifying the first set of options for transmitting at least the portion of the image sequence to the second electronic device in accordance with a determination that the electronic devices are not in the first mode that allows transmission of the image sequence as a group; 335. The electronic device of any one of claims 331 to 334, configured to:

336. 336. The electronic device of any one of claims 331 to 335, wherein the second set of options for transmitting at least a portion of the image sequence to the second electronic device includes an option for converting at least the portion of the image sequence to a video format.

337. 337. The electronic device of any one of claims 331 to 336, wherein the first set of options for transmitting at least a portion of the image sequence to the second electronic device includes an option for converting at least the portion of the image sequence to a video format.

338. The processing unit transmitting audio corresponding to the image sequence in accordance with the determination that the second electronic device is configured to interact with the image sequence as a group.

338. The electronic device of any one of claims 331 to 337, configured to:

339. The processing unit transmitting metadata corresponding to the first image sequence in accordance with the determination that the second electronic device is configured to interact with the image sequence as a group.

339. The electronic device of any one of claims 331 to 338, configured to:

340. The processing unit While the representative image is being displayed on the display unit, Detecting a second input; In response to detecting the second input, the display of the representative image can be replaced with a sequential display of at least some of the images in the image sequence; 340. The electronic device of any one of claims 331 to 339, configured to:

341. the first electronic device comprising a touch-sensitive surface and one or more sensors for detecting an intensity of contact with the touch-sensitive surface; 341. The electronic device of claim 340, wherein the second input comprises a finger contact that satisfies a first contact intensity criterion.

342. An electronic device comprising a display, a camera, one or more processors and a memory, While in a first media capture mode for the camera, displaying a live preview of the scene on said display; performing scene recognition on the scene; Detecting a single activation of a shutter button at a first time while displaying the live preview of the scene; in response to detecting the single activation of the shutter button at the first time; pursuant to a determination that the scene satisfies action capture criteria based at least in part on the scene recognition performed on the scene, retaining a plurality of images acquired by the camera in a temporal vicinity of the activation of the shutter button at the first time, and grouping the plurality of images into a first image sequence, the first image sequence comprising: a plurality of images acquired by the camera prior to detecting activation of the shutter button at the first time; a representative image representative of the first sequence of images and acquired by the camera after one or more of the other images in the first sequence of images; a plurality of images captured by the camera after capturing the representative image; pursuant to a determination that the scene does not meet the action capture criteria, retaining a single image in a temporal vicinity of the activation of the shutter button at the first time; A method comprising:

343. 343. The method of claim 342, wherein the action capture criteria includes recognizing one or more faces in the scene.

344. 344. The method of claim 342 or 343, wherein the action capture criteria includes recognizing movement in the scene.

345. 345. The method of any one of claims 342 to 344, wherein the action capture criteria includes detecting movement of the electronic device above a predetermined threshold value.

346. performing scene recognition on the scene includes recognizing text; 346. The method of any one of claims 342 to 345, wherein the action capture criteria include a criterion that is met if the amount of text in the scene is below a predetermined threshold.

347. performing scene recognition on the scene includes determining an amount of motion in the scene; retaining the plurality of images captured by the camera in a temporal vicinity of the activation of the shutter button at the first time; in accordance with determining that the amount of motion is a first amount, retaining the plurality of images at a first frame rate; in response to determining that the amount of motion is a second amount greater than the first amount, holding the image at a second frame rate greater than the first frame rate; 347. The method of any one of claims 342 to 346, comprising:

348. 348. A method according to any one of claims 342 to 347, wherein the number of images in the retained plurality of images is dependent on movement of the device detected while acquiring the plurality of images.

349. the device includes default image capture parameters for acquiring an image, and the method comprises: determining that the scene includes a single face when in portrait orientation and that the single face occupies more than a predetermined amount of the display; In response to determining that the scene includes the single face when in portrait orientation and that the single face occupies more than a predetermined amount of the display, acquiring the plurality of images with image capture parameters different from the default image capture parameters; 349. The method of any one of claims 342 to 348, comprising:

350. The display and A camera and one or more processors; Memory and and one or more programs, the one or more programs being stored in the memory and configured to be executed by the one or more processors, the one or more programs comprising: While in a first media capture mode for the camera, displaying a live preview of the scene on said display; performing scene recognition on the scene; Detecting a single activation of a shutter button at a first time while displaying the live preview of the scene; in response to detecting the single activation of the shutter button at the first time; pursuant to a determination that the scene satisfies action capture criteria based at least in part on the scene recognition performed on the scene, retaining a plurality of images acquired by the camera in a temporal vicinity of the activation of the shutter button at the first time, and grouping the plurality of images into a first image sequence, the first image sequence comprising: a plurality of images acquired by the camera prior to detecting activation of the shutter button at the first time; a representative image representative of the first sequence of images and acquired by the camera after one or more of the other images in the first sequence of images; a plurality of images captured by the camera after capturing the representative image; pursuant to a determination that the scene does not meet the action capture criteria, retaining a single image in a temporal vicinity of the activation of the shutter button at the first time; An electronic device containing instructions for performing the steps of:

351. 1. A computer-readable storage medium storing one or more programs, the one or more programs including instructions that, when executed by an electronic device having a display and a camera, cause the device to: While in a first media capture mode for the camera, displaying a live preview of the scene on said display; performing scene recognition on the scene; Detecting a single activation of a shutter button at a first time while displaying the live preview of the scene; in response to detecting the single activation of the shutter button at the first time; pursuant to a determination that the scene satisfies action capture criteria based at least in part on the scene recognition performed on the scene, retaining a plurality of images acquired by the camera in a temporal vicinity of the activation of the shutter button at the first time, and grouping the plurality of images into a first image sequence, the first image sequence comprising: a plurality of images acquired by the camera prior to detecting activation of the shutter button at the first time; a representative image representative of the first sequence of images and acquired by the camera after one or more of the other images in the first sequence of images; a plurality of images captured by the camera after capturing the representative image; pursuant to a determination that the scene does not meet the action capture criteria, retaining a single image in a temporal vicinity of the activation of the shutter button at the first time; A computer-readable storage medium that causes the

352. The display and A camera and enabled while in a first media capture mode for the camera; displaying a live preview of the scene on said display; performing scene recognition on the scene; Detecting a single activation of a shutter button at a first time while displaying the live preview of the scene; in response to detecting the single activation of the shutter button at the first time; pursuant to a determination that the scene satisfies action capture criteria based at least in part on the scene recognition performed on the scene, retaining a plurality of images acquired by the camera in a temporal vicinity of the activation of the shutter button at the first time, and grouping the plurality of images into a first image sequence, the first image sequence comprising: a plurality of images acquired by the camera prior to detecting activation of the shutter button at the first time; a representative image representative of the first sequence of images and acquired by the camera after one or more of the other images in the first sequence of images; a plurality of images captured by the camera after capturing the representative image; pursuant to a determination that the scene does not meet the action capture criteria, retaining a single image in a temporal vicinity of the activation of the shutter button at the first time; and a means for performing the steps of An electronic device comprising:

353. 1. An information processing device for use in an electronic device having a display and a camera, comprising: enabled while in a first media capture mode for the camera; displaying a live preview of the scene on said display; performing scene recognition on the scene; Detecting a single activation of a shutter button at a first time while displaying the live preview of the scene; in response to detecting the single activation of the shutter button at the first time; pursuant to a determination that the scene satisfies action capture criteria based at least in part on the scene recognition performed on the scene, retaining a plurality of images acquired by the camera in a temporal vicinity of the activation of the shutter button at the first time, and grouping the plurality of images into a first image sequence, the first image sequence comprising: a plurality of images acquired by the camera prior to detecting activation of the shutter button at the first time; a representative image representative of the first sequence of images and acquired by the camera after one or more of the other images in the first sequence of images; a plurality of images captured by the camera after capturing the representative image; pursuant to a determination that the scene does not meet the action capture criteria, retaining a single image in a temporal vicinity of the activation of the shutter button at the first time; and a means for performing the steps of An information processing device comprising:

354. The display and A camera and one or more processors; Memory and one or more programs stored in the memory and configured to be executed by the one or more processors, the one or more programs including instructions for performing any of the methods recited in claims 342 to 349; and An electronic device comprising:

355. A computer-readable storage medium storing one or more programs, the one or more programs including instructions that, when executed by an electronic device having a display and a camera, cause the device to perform any of the methods recited in claims 342 to 349.

356. A graphical user interface on an electronic device having a display, a camera, a memory, and one or more processors for executing one or more programs stored in the memory, the graphical user interface including a user interface displayed according to any of the methods of claims 342 to 349.

357. The display and A camera and means for carrying out any of the methods described in claims 342 to 349; An electronic device comprising:

358. An information processing apparatus for use in an electronic device having a display and a camera, the information processing apparatus comprising means for performing any of the methods described in claims 342 to 349.

359. a display unit configured to display an image; a camera unit configured to acquire an image; a processing unit connected to the display unit and the camera unit, While in a first media capture mode for the camera unit, enabling a live preview of a scene to be displayed on said display unit; performing scene recognition on the scene; Detecting a single activation of a shutter button at a first time while the live preview of the scene is displayable; in response to detecting the single activation of the shutter button at the first time; pursuant to a determination that the scene satisfies action capture criteria based at least in part on the scene recognition performed on the scene, retaining a plurality of images acquired by the camera unit in a temporal vicinity of the activation of the shutter button at the first time, and grouping the plurality of images into a first image sequence, the first image sequence comprising: a plurality of images acquired by the camera unit prior to detecting activation of the shutter button at the first time; a representative image representative of the first sequence of images and acquired by the camera unit after one or more other images in the first sequence of images; a plurality of images acquired by the camera unit after acquiring the representative image; pursuant to a determination that the scene does not meet the action capture criteria, retaining a single image in a temporal vicinity of the activation of the shutter button at the first time; a processing unit configured to perform An electronic device comprising:

360. 360. The electronic device of claim 359, wherein the action capture criteria includes recognizing one or more faces in the scene.

361. 361. The electronic device of claim 359 or 360, wherein the action capture criteria includes recognizing movement in the scene.

362. 362. The electronic device of any one of claims 359 to 361, wherein the action capture criteria includes detecting movement of the electronic device above a predetermined threshold value.

363. performing scene recognition on the scene includes recognizing text; 363. The electronic device of any one of claims 359 to 362, wherein the action capture criteria include a criterion that is met if the amount of text in the scene is below a predetermined threshold.

364. performing scene recognition on the scene includes determining an amount of motion in the scene; retaining the plurality of images captured by the camera unit in a temporal vicinity of the activation of the shutter button at the first time; in accordance with determining that the amount of motion is a first amount, retaining the plurality of images at a first frame rate; in response to determining that the amount of motion is a second amount greater than the first amount, holding the image at a second frame rate greater than the first frame rate; 364. The electronic device of any one of claims 359 to 363, comprising:

365. 365. The electronic device of any one of claims 359 to 364, wherein the number of images in the retained plurality of images is dependent on movement of the device detected while acquiring the plurality of images.

366. The device includes default image capture parameters for acquiring an image, and the processing unit: determining that the scene includes a single face when in portrait orientation and that the single face occupies more than a predetermined amount of the display unit; In response to determining that the scene includes the single face when in a portrait orientation and that the single face occupies more than a predetermined amount of the display unit, acquiring the plurality of images with image capture parameters different from the default image capture parameters; 366. The electronic device of any one of claims 359 to 365, configured to:

367. In an electronic device having a display and a touch-sensitive surface, Displaying an image on the display, the image is an image in a sequence of images taken by a camera; the image sequence includes a representative image; the image sequence includes one or more images acquired by the camera after acquiring the representative image; the image sequence includes one or more images captured by the camera prior to capturing the representative image; detecting a first input while displaying the images in the sequence of images on the display; In response to detecting the first input, displaying a user interface for trimming the image sequence to a subset of less than all of the image sequence, the user interface comprising: an area containing a representation of an image in the sequence of images; a user-adjustable crop start icon that defines a start image in the subset of the image sequence via the position of the crop start icon in the area containing a representation of an image in the image sequence; a user-adjustable crop end icon that defines an end image in the subset of the image sequence via the position of the crop end icon in the area containing a representation of an image in the image sequence; the start crop icon is located in a first position automatically selected by the device in the area containing a representation of an image in the sequence of images; the end crop icon is located in a second position automatically selected by the device in the area containing a representation of an image in the sequence of images; detecting a second input while displaying the user interface for trimming the image sequence; in response to detecting the second input, trimming the image sequence into the subset of the image sequence according to the current position of the start trimming icon and the current position of the end trimming icon; A method comprising:

368. 368. The method of claim 367, wherein the subset of the image sequence is a set of consecutive images from the starting image to the ending image.

369. 369. The method of claim 367 or 368, wherein the representation of an image between the start trimming icon and the end trimming icon is visually distinct from the other representations in the area containing representations of images in the image sequence.

370. the user interface for trimming the image sequence includes a second area displaying the images in the image sequence; 370. A method according to any one of claims 367 to 369, wherein the second area is displayed simultaneously with the area containing a representation of an image in the sequence of images.

371. 371. The method of any one of claims 367 to 370, wherein the displayed image is the representative image from the sequence of images.

372. 371. The method of any one of claims 367 to 370, wherein the displayed image is a currently selected image from the sequence of images.

373. automatically selecting the starting image in the subset and the corresponding first position of the start crop icon based on one or more characteristics of the images in the sequence of images; automatically selecting the ending image in the subset and the corresponding second position of the start crop icon based on one or more characteristics of the images in the sequence of images; 373. The method of any one of claims 367 to 372, further comprising:

374. the image sequence includes a first image and a last image, and the method further comprises: displaying in the area containing a representation of an image in the image sequence one or more representations of images not included in the image sequence, acquired before the first image in the image sequence and / or acquired after the last image in the image sequence.

374. The method of any one of claims 367 to 373, comprising:

375. detecting an input on the end trimming icon while displaying the user interface for trimming the image sequence before detecting the second input; responsive to detecting the input on the end crop icon, moving the end crop icon from the second position to a third position in the area including a representation of an image in the sequence of images; 375. The method of any one of claims 367 to 374, comprising:

376. the image sequence includes a first image and a last image; the user interface includes a reset affordance, and the method comprises: detecting an input on the reset affordance while displaying the user interface for cropping the image sequence before detecting the second input; In response to detecting the input on the reset affordance, displaying the start crop icon in the area containing representations of images in the image sequence at a position corresponding to defining the first image in the image sequence; displaying the end crop icon in the area containing representations of images in the image sequence at a position corresponding to defining the last image in the image sequence; 376. The method of any one of claims 367 to 375, comprising:

377. In response to detecting the input on the reset affordance, displaying an auto-selection affordance that, when activated, displays the start crop icon in the first position and the end crop icon in the second position in the area containing a representation of an image in the image sequence. The method of claim 376, comprising:

378. removing from the image sequence images that are not included in the subset of the image sequence; 378. The method of any one of claims 367 to 377, comprising:

379. selecting a new representative image for the subset of the image sequence in response to detecting a third input.

379. The method of any one of claims 367 to 378, comprising:

380. displaying on the display a representative image of the subset of the image sequence after cropping the image sequence into the subset of the image sequence according to the current position of the start crop icon and the current position of the end crop icon; detecting a third input while displaying the representative image on the display; responsive to detecting the third input, replacing the display of the representative image with an animated reproduction of the subset of the image sequence; 380. The method of any one of claims 367 to 379, comprising:

381. Disabling the animated playback of the subset of the sequence of images while retaining the subset of images in response to detecting a fourth input; The method of claim 380, comprising:

382. In response to detecting a third input corresponding to a request to edit the representative image, the device Optionally, continuing to edit the representative image while disabling the animated playback of the subset of the image sequence; an option to cancel editing of the representative image; to provide 382. The method of any one of claims 367 to 381, comprising:

383. presenting an affordance for deleting images in the sequence of images other than the representative image; In response to detecting a third input, deleting the one or more images acquired by the camera after acquiring the representative image and the one or more images acquired by the camera before acquiring the representative image; 383. The method of any one of claims 367 to 382, ​​comprising:

384. The display and a touch-sensitive surface; and one or more processors; Memory and 1. An electronic device comprising one or more programs stored in the memory and configured to be executed by the one or more processors, the one or more programs comprising: Displaying an image on the display, the image is an image in a sequence of images taken by a camera; the image sequence includes a representative image; the image sequence includes one or more images acquired by the camera after acquiring the representative image; the image sequence includes one or more images captured by the camera prior to capturing the representative image; detecting a first input while displaying the images in the sequence of images on the display; In response to detecting the first input, displaying the user interface for trimming the image sequence to a subset of less than all of the image sequence, the user interface comprising: an area containing a representation of an image in the sequence of images; a user-adjustable crop start icon that defines a start image in the subset of the image sequence via the position of the crop start icon in the area containing a representation of an image in the image sequence; a user-adjustable crop end icon that defines an end image in the subset of the image sequence via the position of the crop end icon in the area containing a representation of an image in the image sequence; the start crop icon is located in a first position automatically selected by the device in the area containing a representation of an image in the sequence of images; the end crop icon is located in a second position automatically selected by the device in the area containing a representation of an image in the sequence of images; detecting a second input while displaying the user interface for trimming the image sequence; in response to detecting the second input, trimming the image sequence into the subset of the image sequence according to the current position of the start trimming icon and the current position of the end trimming icon; An electronic device containing instructions for performing the steps of:

385. 1. A computer-readable storage medium storing one or more programs, the one or more programs including instructions that, when executed by an electronic device having a display and a touch-sensitive surface, cause the device to: Displaying an image on the display, the image is an image in a sequence of images taken by a camera; the image sequence includes a representative image; the image sequence includes one or more images acquired by the camera after acquiring the representative image; the image sequence includes one or more images captured by the camera prior to capturing the representative image; detecting a first input while displaying the images in the sequence of images on the display; In response to detecting the first input, displaying the user interface for trimming the image sequence to a subset of less than all of the image sequence, the user interface comprising: an area containing a representation of an image in the sequence of images; a user-adjustable crop start icon that defines a start image in the subset of the image sequence via the position of the crop start icon in the area containing a representation of an image in the image sequence; a user-adjustable crop end icon that defines an end image in the subset of the image sequence via the position of the crop end icon in the area containing a representation of an image in the image sequence; the start crop icon is located in a first position automatically selected by the device in the area containing a representation of an image in the sequence of images; the end crop icon is located in a second position automatically selected by the device in the area containing a representation of an image in the sequence of images; detecting a second input while displaying the user interface for trimming the image sequence; in response to detecting the second input, trimming the image sequence into the subset of the image sequence according to the current position of the start trimming icon and the current position of the end trimming icon; A computer-readable storage medium that causes the

386. The display and a touch-sensitive surface; and means for displaying an image on the display, the image is an image in a sequence of images taken by a camera; the image sequence includes a representative image; the image sequence includes one or more images acquired by the camera after acquiring the representative image; the image sequence includes one or more images acquired by the camera prior to acquiring the representative image; means for detecting a first input activated during display of the images in the sequence of images on the display; enabled in response to detecting the first input; means for displaying the user interface for trimming the image sequence to a subset of less than all of the image sequence, the user interface comprising: an area containing a representation of an image in the sequence of images; a user-adjustable crop start icon that defines a start image in the subset of the image sequence via the position of the crop start icon in the area containing a representation of an image in the image sequence; a user-adjustable crop end icon that defines an end image in the subset of the image sequence via the position of the crop end icon in the area containing a representation of an image in the image sequence; the start crop icon is located in a first position automatically selected by the device in the area containing a representation of an image in the sequence of images; the trimming end icon is positioned in a second position automatically selected by the device in the area containing a representation of an image in the image sequence; means for detecting a second input activated while displaying the user interface for cropping the image sequence; means, activated in response to detecting the second input, for trimming the image sequence into the subset of the image sequence according to a current position of the start trimming icon and a current position of the end trimming icon; An electronic device comprising:

387. 1. An information processing device for use in an electronic device having a display and a touch-sensitive surface, comprising: means for displaying an image on the display, the image is an image in a sequence of images taken by a camera; the image sequence includes a representative image; the image sequence includes one or more images acquired by the camera after acquiring the representative image; the image sequence includes one or more images acquired by the camera prior to acquiring the representative image; means for detecting a first input activated during display of the images in the sequence of images on the display; Activated in response to detecting a first input; means for displaying the user interface for trimming the image sequence to a subset of less than all of the image sequence, the user interface comprising: an area containing a representation of an image in the sequence of images; a user-adjustable crop start icon that defines a start image in the subset of the image sequence via the position of the crop start icon in the area containing a representation of an image in the image sequence; a user-adjustable crop end icon that defines an end image in the subset of the image sequence via the position of the crop end icon in the area containing a representation of an image in the image sequence; the start crop icon is located in a first position automatically selected by the device in the area containing a representation of an image in the sequence of images; the trimming end icon is positioned in a second position automatically selected by the device in the area containing a representation of an image in the image sequence; means for detecting a second input activated while displaying the user interface for cropping the image sequence; means, activated in response to detecting the second input, for trimming the image sequence into the subset of the image sequence according to a current position of the start trimming icon and a current position of the end trimming icon; An information processing device comprising:

388. The display and a touch-sensitive surface; and one or more processors; Memory and one or more programs stored in the memory and configured to be executed by the one or more processors, the one or more programs including instructions for performing any of the methods recited in claims 367 to 383; and An electronic device comprising:

389. 384. A computer-readable storage medium storing one or more programs, the one or more programs including instructions that, when executed by an electronic device with a display and a touch-sensitive surface, cause the device to perform any of the methods recited in claims 367 to 383.

390. 384. A graphical user interface on an electronic device having a display, a touch-sensitive surface, a memory, and one or more processors for executing one or more programs stored in the memory, the graphical user interface including a user interface displayed according to any of the methods of claims 367 to 383.

391. The display and a touch-sensitive surface; and means for carrying out any of the methods described in claims 367 to 383; and An electronic device comprising:

392. 1. An information processing device for use in an electronic device having a display and a touch-sensitive surface, comprising: Means for carrying out any of the methods of claims 367 to 383. An information processing device comprising:

393. a display unit configured to display an image; a touch-sensitive surface unit configured to detect user input; a processing unit connected to the display unit and the touch-sensitive surface unit, and enabling an image to be displayed on the display unit, the image is an image in a sequence of images taken by a camera; the image sequence includes a representative image; the image sequence includes one or more images acquired by the camera after acquiring the representative image; the image sequence includes one or more images captured by the camera prior to capturing the representative image; Detecting a first input while enabling the images in the sequence of images to be displayed on the display unit; In response to detecting the first input, and displaying a user interface for trimming the image sequence to a subset of less than all of the image sequence, the user interface comprising: an area containing a representation of an image in the sequence of images; a user-adjustable crop start icon that defines a start image in the subset of the image sequence via the position of the crop start icon in the area containing a representation of an image in the image sequence; a user-adjustable crop end icon that defines an end image in the subset of the image sequence via the position of the crop end icon in the area containing a representation of an image in the image sequence; the start crop icon is located in a first position automatically selected by the device in the area containing a representation of an image in the sequence of images; the end crop icon is located in a second position automatically selected by the device in the area containing a representation of an image in the sequence of images; detecting a second input while the user interface for trimming the image sequence is displayable; and in response to detecting the second input, trimming the image sequence into the subset of the image sequence according to the current position of the start trimming icon and the current position of the end trimming icon; a processing unit configured to perform An electronic device comprising:

394. 394. The electronic device of claim 393, wherein the subset of the image sequence is a consecutive set of images from the starting image to the ending image.

395. 395. An electronic device as described in claim 393 or 394, wherein the representation of an image between the start cropping icon and the end cropping icon is visually distinct from the other representations in the area containing representations of images in the image sequence.

396. the user interface for trimming the image sequence includes a second area displaying the images in the image sequence; 396. An electronic device according to any one of claims 393 to 395, wherein the second area is displayed simultaneously with the area containing a representation of an image in the sequence of images.

397. 397. The electronic device of any one of claims 393 to 396, wherein the displayed image is the representative image from the sequence of images.

398. 397. The electronic device of any one of claims 393 to 396, wherein the displayed image is a currently selected image from the sequence of images.

399. automatically selecting the starting image in the subset and the corresponding first position of the start crop icon based on one or more characteristics of the image in the sequence of images; 399. The electronic device of claim 393, wherein automatically selecting the end image in the subset and the corresponding second position of the start trimming icon is based on one or more characteristics of the images in the sequence of images.

400. the image sequence includes a first image and a last image, and the processing unit: allowing the area containing a representation of an image in the image sequence to display one or more representations of images not included in the image sequence, acquired before the first image in the image sequence and / or acquired after the last image in the image sequence; 400. The electronic device of any one of claims 393 to 399, configured to:

401. The processing unit detecting an input on the end trimming icon while the user interface for trimming the image sequence is displayable before detecting the second input; responsive to detecting the input on the end crop icon, moving the end crop icon from the second position to a third position in the area including a representation of an image in the sequence of images; 401. The electronic device of any one of claims 393 to 400, configured to:

402. the image sequence includes a first image and a last image; the user interface includes a reset affordance, and the processing unit: detecting an input on the reset affordance while allowing the user interface for cropping the image sequence to be displayed before detecting the second input; In response to detecting the input on the reset affordance, making the start crop icon displayable in the area containing a representation of an image in the image sequence at a position corresponding to defining the first image in the image sequence; the trimming end icon being displayable in the area containing a representation of an image in the image sequence at a position corresponding to defining the last image in the image sequence; 3402. The electronic device of any one of claims 393 to 3401, configured to:

403. The processing unit In response to detecting the input on the reset affordance, displaying an auto-selection affordance that, when activated, displays the start crop icon in the first position and the end crop icon in the second position in the area containing a representation of an image in the image sequence; 403. The electronic device of claim 402, further configured to:

404. The processing unit 404. An electronic device according to any one of claims 393 to 403, configured to remove from the sequence of images images that are not included in the subset of the sequence of images.

405. The processing unit 405. An electronic device according to any one of claims 393 to 404, configured to select a new representative image for the subset of the sequence of images in response to detecting a third input.

406. The processing unit after cropping the image sequence into the subset of the image sequence according to the current position of the start cropping icon and the current position of the end cropping icon, allowing a representative image of the subset of the image sequence to be displayed on the display unit; detecting a third input while the representative image is displayable on the display unit; responsive to detecting the third input, replacing the display of the representative image with an animated rendering of the subset of the sequence of images; 406. The electronic device of any one of claims 393 to 405, configured to:

407. The processing unit and disabling the animated playback of the subset of the sequence of images while retaining the subset of images in response to detecting a fourth input.

407. The electronic device of claim 406, configured to:

408. The processing unit In response to detecting a third input corresponding to a request to edit the representative image, the device Optionally, continuing to edit the representative image while disabling the animated playback of the subset of the image sequence; an option to cancel editing of the representative image; to provide 408. The electronic device of any one of claims 393 to 407, configured to:

409. The processing unit presenting an affordance for deleting images in the sequence of images other than the representative image; In response to detecting a third input, deleting the one or more images acquired by the camera after acquiring the representative image and the one or more images acquired by the camera before acquiring the representative image; 409. The electronic device of any one of claims 393 to 408, configured to:

Citation Information

Patent Citations

  • Electronic still camera

    JP1998257371A

  • Electronic camera

    JP2001078137A

  • Image processor, image processing method, program and storage medium

    JP2003092724A

  • Camera and moving picture photographing method

    JP2006080809A

  • Electronic apparatus, imaging device, and reproducing device

    JP2009089348A