Devices, methods, and graphical user interfaces for updating background of home screen user interfaces and wake-up screen user interfaces

Abstract

The present disclosure relates to devices, methods, and graphical user interfaces for updating the context of home screen user interfaces and wake-up screen user interfaces. A method includes detecting a first user input corresponding to a request to display a media library while displaying a wake-up screen with a first media item as a background and a foreground object displayed on the first media item; in response to detecting the first user input, stopping the display of the foreground object; detecting a second user input corresponding to a request to navigate in a media item in the media library; in response to detecting the second user input, replacing the first media item with a second media item in the media library; detecting a third input corresponding to a request to eliminate the media library; and in response to detecting the third user input, re-displaying the foreground object on the display device on a media item from the media library selected as the background of the wake-up screen.

Description

[0001] Related Applications Citations

[0002] This application is a divisional application of the invention patent application with international application number PCT / US2020 / 033997, international application date May 21, 2020, date of entry into the Chinese national phase November 25, 2021, Chinese national application number 202080038847.2, and invention name “Device, method and graphical user interface for updating the background of the main screen user interface and wake-up screen user interface”. Technical Field

[0003] The present invention generally relates to electronic devices with touch-sensitive surfaces, including but not limited to electronic devices with touch-sensitive surfaces that detect a background for updating a home screen user interface and a wake screen user interface. Background Art

[0004] The use of inputs for manipulating user interfaces of electronic devices has become ubiquitous. For example, electronic devices use peripheral-type inputs (e.g., touch screen inputs, mice, keyboards) to affect the display of one or more user interfaces.

[0005] However, many of these inputs provide limited and inefficient control for manipulating the user interface. Therefore, in order for the electronic device to perform a specific operation, repeated, complex and / or cumbersome inputs or input types may be required to manipulate the user interface. Summary of the invention

[0006] Therefore, electronic devices need to have faster and more efficient methods and interfaces for navigating and manipulating user interfaces and their contexts. Such methods and interfaces optionally supplement or replace navigation and manipulation of user interface objects and their contexts. Such methods and interfaces reduce the cognitive burden on users and produce more efficient human-computer interfaces. For battery-powered devices, such methods and interfaces can save power and increase the time between battery charges.

[0007] The above-mentioned defects and other problems associated with the user interface of an electronic device with a touch-sensitive surface can be reduced or eliminated by means of the disclosed device. In some embodiments, the device is a desktop computer. In some embodiments, the device is portable (e.g., a laptop, a tablet computer, or a handheld device). In some embodiments, the device has a touchpad. In some embodiments, the device has a touch-sensitive display (also referred to as a "touch screen" or a "touch screen display"). In some embodiments, the device has a graphical user interface (GUI), one or more processors, a memory, and one or more modules, a program or instruction set stored in the memory for performing multiple functions. In some embodiments, the user interacts with the GUI mainly through stylus and / or finger contact and gestures on the touch-sensitive surface. In some embodiments, these functions optionally include image editing, drawing, presentation, word processing, web page creation, disk editing, spreadsheet production, playing games, making and receiving calls, video conferencing, sending and receiving emails, instant messaging, fitness support, digital photography, digital video recording, web browsing, digital music playback and / or digital video playback. Executable instructions for performing these functions are optionally included in a non-transitory computer-readable storage medium or other computer program product configured for execution by one or more processors.

[0008] According to some embodiments, a method is performed at a device having one or more processors, a non-volatile memory, a display device, and one or more input devices. The method includes: while displaying a wake-up screen user interface on the display device, detecting a first user input via the one or more input devices, the wake-up screen user interface including a first media item used as a background of the wake-up screen user interface and one or more foreground user interface objects displayed above the first media item, the first user input corresponding to a request to display a media library user interface; and in response to detecting the first user input, stopping the display of the one or more foreground user interface objects from the wake-up screen user interface. The method also includes: while displaying the first media item without the one or more foreground user interface objects, detecting a second user input via the one or more input devices, the second user input corresponding to a request to navigate through the media items in the media library user interface; and in response to detecting the second user input, replacing the first media item with the second media item in the media library user interface on the display device. The method also includes: while displaying the second media item, detecting a third input via the one or more input devices, the third input corresponding to a request to eliminate the media library user interface; and in response to detecting the third user input corresponding to the request to eliminate the media library user interface, redisplaying on the display device the one or more foreground user interface objects from the wake screen user interface above the media item from the media library user interface that is selected as the background of the wake screen user interface.

[0009] According to some embodiments, a method is performed at a device having one or more processors, a non-volatile memory, a display device, and one or more input devices. The method includes: detecting a user input via the one or more input devices, the user input corresponding to a request to set a corresponding media item as the background of a wake-up screen user interface of the device; and in response to detecting the user input: according to determining that the user input corresponds to a request to set a first media item as the background of the wake-up screen user interface, setting a second media item different from the first media item as the background of a main screen user interface of the device; and according to determining that the user input corresponds to a request to set a third media item as the background of the wake-up screen user interface, setting a fourth media item different from the third media item as the background of the main screen user interface of the device.

[0010] According to some embodiments, the method is performed at a computing system including a non-volatile memory and one or more processors, wherein the computing system is communicatively coupled to a display device and one or more input devices. The method includes: a device for displaying a wake-up screen user interface via the display device, the wake-up screen user interface including a first media item used as a background of the wake-up screen user interface and one or more user interface objects displayed above the first media item; when displaying the first media item used as the background of the wake-up screen user interface, detecting user input via the one or more input devices, the user input corresponding to a request to edit a media item in a set of media items in a media library, the media library being accessible from the wake-up screen interface, wherein the set of one or more media items includes at least the first media item; and in response to detecting the user input, displaying an editing user interface for adding or removing at least one of the set of one or more media items from the media library via the display device.

[0011] According to some embodiments, an electronic device includes a display, one or more input devices, one or more processors, a non-transitory memory, and one or more programs; the one or more programs are stored in the non-transitory memory and configured to be executed by the one or more processors, and the one or more programs include instructions for performing or causing the execution of the operations of any of the methods described herein. According to some embodiments, a non-transitory computer-readable storage medium has instructions stored therein, which, when executed by one or more processors of an electronic device having a display and one or more input devices, cause the device to perform or cause the execution of the operations of any of the methods described herein. According to some embodiments, a graphical user interface on an electronic device having a display, one or more input devices, a non-transitory memory, and one or more processors configured to execute one or more programs stored in the non-transitory memory includes one or more elements of the elements displayed in any of the above methods, which are updated in response to input, as described in any of the methods described herein. According to some embodiments, an electronic device includes: a display, one or more input devices; and a device for performing or causing the execution of the operations of any of the methods described herein. According to some embodiments, an information processing device used in an electronic device having a display and one or more input devices includes a device for performing or causing the execution of the operations of any of the methods described herein.

[0012] According to some embodiments, a computing system includes one or more processors, non-volatile memory, an interface for communicating with a display device and one or more input devices, and one or more programs; one or more programs are stored in the non-volatile memory and are configured to be executed by one or more processors, and the one or more programs include instructions for performing or causing the execution of the operations of any of the methods described herein. According to some embodiments, a non-volatile computer-readable storage medium has instructions stored therein, which, when executed by one or more processors of a computing system having an interface for communicating with a display device and one or more input devices, cause the computing system to perform or cause the execution of the operations of any of the methods described herein. According to some embodiments, a computing system includes one or more processors, non-volatile memory, an interface for communicating with a display device and one or more input devices, and a device for performing or causing the execution of the operations of any of the methods described herein. BRIEF DESCRIPTION OF THE DRAWINGS

[0013] For a better understanding of the various described embodiments, reference should be made to the following detailed description taken in conjunction with the following drawings, wherein like reference numerals designate corresponding parts throughout the several views.

[0014] For a better understanding of the various described embodiments, reference should be made to the following detailed description taken in conjunction with the following drawings, wherein like reference numerals designate corresponding parts throughout the several views.

[0015] Figure 1A is a block diagram illustrating a portable multifunction device with a touch-sensitive display according to some embodiments.

[0016] Figure 1B is a block diagram illustrating example components for event processing according to some embodiments.

[0017] Figure 2 A portable multifunction device with a touch screen according to some embodiments is shown.

[0018] Figure 3 is a block diagram of an exemplary multifunction device with a display and a touch-sensitive surface according to some embodiments.

[0019] Figure 4A An exemplary user interface for an application menu on a portable multifunction device according to some embodiments is shown.

[0020] Figure 4B An exemplary user interface for a multifunction device having a touch-sensitive surface separate from the display is shown according to some embodiments.

[0021] FIG. 5A to FIG. 5IAn exemplary user interface for accessing and navigating a media library user interface is shown according to some embodiments.

[0022] FIG. 6A to FIG. 6G An exemplary user interface for changing a home screen process applied to a home screen user interface is shown according to some embodiments.

[0023] 7A to 7H An exemplary user interface for adding one or more media items to a media library is shown according to some embodiments.

[0024] FIG. 8A to FIG. 8D A flowchart of a method of accessing and navigating a media library user interface according to some embodiments is shown.

[0025] Fig.9A and 9B A flowchart of a method for updating the background or wallpaper of a home screen user interface based on a request to set a media item as the background or wallpaper of a wake screen user interface is shown according to some embodiments.

[0026] FIG. 10A to FIG. 10AB An exemplary user interface for modifying media items in a media library is shown according to some embodiments.

[0027] FIG. 11A to FIG. 11E A flowchart of a method of modifying media items in a media library according to some embodiments is shown. DETAILED DESCRIPTION

[0028] According to some embodiments, as disclosed herein, a media (wallpaper) library user interface can be accessed from a wake screen user interface to quickly change the background of a wake and / or home screen user interface. In some embodiments, the media library user interface is associated with a media library including a plurality of customizable media items. Therefore, if the current wake screen wallpaper is replaced with another media item from the media library user interface, the previous wallpaper can be easily accessed from the media library user interface. In some specific implementations, when the current wake screen wallpaper is replaced with another media item from the media library user interface, the home screen wallpaper is also updated based on the newly selected media item and the optional home screen processing options.

[0029] According to some embodiments, as disclosed herein, in response to setting a media item as a wake screen background (also sometimes referred to as a wallpaper), the device also updates the home screen background based thereon (and optionally also based on a home screen handling option, such as smart color or smart gradient). In some embodiments, the wallpaper setting user interface displays side-by-side previews of the wake and home screen user interfaces for various media items in the media library, and also includes home screen handling options for changing the appearance of the home screen user interface.

[0030] under, Figure 1A , Figure 1B , Figure 2 , Figure 3 , Figure 4A and Figure 4B A description of an exemplary apparatus is provided. FIG. 5A to FIG. 5I An exemplary user interface for accessing and navigating a media library user interface is shown. FIG. 6A to FIG. 6G An exemplary user interface for changing a home screen process applied to a home screen user interface is shown. 7A to 7H An exemplary user interface for adding one or more media items to a media library is shown. FIG. 10A to FIG. 10AB An exemplary user interface for modifying media items in a media library is shown.

[0031] FIG. 8A to FIG. 8D A flow chart of a method of accessing and navigating a media library user interface is shown. Fig.9A and 9B A flow chart of a method for updating a background or wallpaper of a home screen user interface based on a request to set a media item as the background or wallpaper of a wake screen user interface is shown. FIG. 11A to FIG. 11E A flow chart of a method of modifying a media item in a media library is shown. FIG. 5A to FIG. 5I and Figures 7A to 7H The user interface in FIG. 8A to FIG. 8D process. Figures 6A to 6G The user interface in Fig.9A and Fig. 9B process. FIG. 10A to FIG. 10AB The user interface in FIG. 11A to FIG. 11E process.

[0032] Exemplary Devices

[0033] Reference will now be made in detail to the embodiments, examples of which are illustrated in the accompanying drawings. Many specific details are shown in the following detailed description in order to provide a full understanding of the various described embodiments. However, it will be apparent to one of ordinary skill in the art that the various described embodiments can be practiced without these specific details. In other cases, well-known methods, processes, components, circuits, and networks are not described in detail, so as not to unnecessarily obscure various aspects of the embodiments.

[0034] It will also be understood that, although in some cases, the terms "first", "second", etc. are used to describe various elements in this article, these elements should not be limited by these terms. These terms are only used to distinguish one element from another element. For example, the first contact can be named as the second contact, and similarly, the second contact can be named as the first contact without departing from the scope of the various described embodiments. The first contact and the second contact are both contacts, but they are not the same contact unless the context clearly indicates otherwise.

[0035] The terms used in the description of various described embodiments herein are only for the purpose of describing specific embodiments, and are not intended to be limited. As used in the description of various described embodiments and in the appended claims, the singular forms "one" and "the" are intended to also include plural forms, unless the context clearly indicates otherwise. It will also be understood that the term "and / or" used herein refers to and encompasses any and all possible combinations of one or more items in the associated listed items. It will also be understood that the term "includes", "including", "comprises" and / or "comprising" when used in this specification specifies the presence of stated features, integers, steps, operations, elements and / or parts, but does not exclude the presence or addition of one or more other features, integers, steps, operations, elements, parts and / or their grouping.

[0036] As used herein, the term "if" is optionally interpreted to mean "when" followed by "upon" or "in response to determining" or "in response to detecting," depending on the context. Similarly, the phrases "if it is determined that" or "if [a stated condition or event] is detected" are optionally interpreted to mean "upon determining that" or "in response to determining that" or "upon detecting [a stated condition or event]" or "in response to detecting [a stated condition or event]," depending on the context.

[0037] Embodiments of electronic devices, user interfaces for such devices, and associated processes for using such devices are described herein. In some embodiments, the device is a portable communication device, such as a mobile phone, that also includes other functions, such as a PDA and / or a music player function. Exemplary embodiments of portable multifunction devices include, but are not limited to, the Apple iPod from Apple Inc. (Cupertino, California). iPod and Device. Other portable electronic devices, such as laptops or tablets with touch-sensitive surfaces (e.g., touch screen displays and / or trackpads) are optionally used. It should also be understood that in some embodiments, the device is not a portable communication device, but a desktop computer with a touch-sensitive surface (e.g., touch screen displays and / or trackpads).

[0038] In the following discussion, an electronic device including a display and a touch-sensitive surface is described. However, it should be understood that the electronic device optionally includes one or more other physical user interface devices, such as a physical keyboard, mouse and / or joystick.

[0039] The device typically supports a variety of applications, such as one or more of the following: a drawing application, a presentation application, a word processing application, a website creation application, a disk editing application, a spreadsheet application, a gaming application, a telephony application, a video conferencing application, an email application, an instant messaging application, a fitness support application, a photo management application, a digital camera application, a digital video camera application, a web browsing application, a digital music player application, and / or a digital video player application.

[0040] Various applications executed on the device optionally use at least one common physical user interface device, such as a touch-sensitive surface. One or more functions of the touch-sensitive surface and corresponding information displayed on the device are optionally adjusted and / or varied for different applications, and / or adjusted and / or varied within the respective applications. In this way, the common physical architecture of the device (such as a touch-sensitive surface) optionally supports a variety of applications with a user interface that is intuitive and clear to the user.

[0041] Attention is now turned to embodiments of portable devices having touch-sensitive displays. Figure 1A1 is a block diagram illustrating a portable multifunction device 100 with a touch-sensitive display system 112 according to some embodiments. The touch-sensitive display system 112 is sometimes referred to as a "touch screen" for convenience, and is sometimes simply referred to as a touch-sensitive display. The device 100 includes a memory 102 (which optionally includes one or more computer-readable storage media), a memory controller 122, one or more processing units (CPUs) 120, a peripheral device interface 118, an RF circuit 108, an audio circuit 110, a speaker 111, a microphone 113, an input / output (I / O) subsystem 106, other input, or control devices 116, and an external port 124. The device 100 optionally includes one or more optical sensors 164. The device 100 optionally includes one or more intensity sensors 165 for detecting the intensity of contact on the electronic device 100 (e.g., a touch-sensitive surface, such as the touch-sensitive display system 112 of the device 100). Device 100 optionally includes one or more tactile output generators 163 for generating tactile output on device 100 (e.g., generating tactile output on a touch-sensitive surface such as touch-sensitive display system 112 of device 100 or touch pad 355 of device 300). These components optionally communicate via one or more communication buses or signal lines 103.

[0042] As used in this specification and claims, the term "tactile output" refers to a physical displacement of a device relative to a previous position of the device, a physical displacement of a component of the device (e.g., a touch-sensitive surface) relative to another component of the device (e.g., a housing), or a displacement of a component relative to the center of mass of the device, which will be detected by a user using the user's sense of touch. For example, in the case where a device or a component of the device is in contact with a user's touch-sensitive surface (e.g., a finger, palm, or other part of the user's hand), the tactile output generated by the physical displacement will be interpreted by the user as a tactile sensation corresponding to a perceived change in a physical characteristic of the device or component of the device. For example, movement of a touch-sensitive surface (e.g., a touch-sensitive display or trackpad) is optionally interpreted by the user as a "press click" or "release click" to a physical actuation button. In some cases, the user will feel a tactile sensation, such as a "press click" or "release click", even when the physical actuation button associated with the touch-sensitive surface that is physically pressed (e.g., displaced) by the user's movement does not move. As another example, movement of a touch-sensitive surface may optionally be interpreted or sensed by a user as "roughness" of the touch-sensitive surface even when there is no change in the smoothness of the touch-sensitive surface. While such a user's interpretation of touch will be limited by the user's individualized sensory perceptions, many sensory perceptions of touch are common to most users. Thus, when a tactile output is described as corresponding to a particular sensory perception of a user (e.g., "press click," "release click," "roughness"), unless otherwise stated, the generated tactile output corresponds to a physical displacement of the device or a component thereof that would generate that sensory perception for a typical (or average) user.

[0043] It should be understood that device 100 is merely one example of a portable multifunction device, and that device 100 optionally has more or fewer components than shown, optionally combines two or more components, or optionally has a different configuration or arrangement of the components. Figure 1A The various components shown in the drawings are implemented in hardware, software, firmware, or any combination thereof (including one or more signal processing circuits and / or application specific integrated circuits).

[0044] The memory 102 optionally includes high-speed random access memory, and optionally also includes non-volatile memory, such as one or more disk storage devices, flash memory devices or other non-volatile solid-state memory devices. The access of other components of the device 100 (such as one or more CPUs 120 and peripheral device interface 118) to the memory 102 is optionally controlled by a memory controller 122.

[0045] Peripheral interface 118 may be used to couple the device's input and output peripherals to one or more CPUs 120 and memory 102. One or more CPUs 120 run or execute various software programs and / or instruction sets stored in memory 102 to perform various functions of device 100 and process data.

[0046] In some embodiments, peripherals interface 118, one or more CPUs 120, and memory controller 122 are optionally implemented on a single chip, such as chip 104. In some other embodiments, they are optionally implemented on separate chips.

[0047] RF (radio frequency) circuit 108 receives and transmits RF signals, also referred to as electromagnetic signals. RF circuit 108 converts electrical signals into / from electromagnetic signals and communicates with a communication network and other communication devices via electromagnetic signals. RF circuit 108 optionally includes well-known circuits for performing these functions, including but not limited to an antenna system, an RF transceiver, one or more amplifiers, a tuner, one or more oscillators, a digital signal processor, a codec chipset, a subscriber identity module (SIM) card, memory, and the like. RF circuit 108 optionally communicates with networks and other devices via wireless communications, such as the Internet (also referred to as the World Wide Web (WWW)), an intranet, and / or a wireless network (such as a cellular telephone network, a wireless local area network (LAN), and / or a metropolitan area network (MAN)). The wireless communication optionally uses any of a variety of communication standards, protocols, and technologies, including, but not limited to, Global System for Mobile Communications (GSM), Enhanced Data GSM Environment (EDGE), High Speed ​​Downlink Packet Access (HSDPA), High Speed ​​Uplink Packet Access (HSUPA), Evolution-Data Only (EV-DO), HSPA, HSPA+, Dual Cell HSPA (DC-HSPDA), Long Term Evolution (LTE), Near Field Communication (NFC), Wideband Code Division Multiple Access (W-CDMA), Code Division Multiple Access (CDMA), Time Division Multiple Access (TDMA), Bluetooth, Wireless Fidelity (Wi-Fi) (e.g., IEEE 802.11a, IEEE 802.11ac, IEEE 802.11ax, IEEE 802.11b, IEEE 802.11g and / or IEEE 802.11n), Voice over Internet Protocol (VoIP), Wi-MAX, email protocols (e.g., Internet Message Access Protocol (IMAP) and / or Post Office Protocol (POP)), instant messaging (e.g., Extensible Messaging and Presence Protocol (XMPP), Session Initiation Protocol for Instant Messaging and Presence using Extensions (SIMPLE), Instant Messaging and Presence Service (IMPS), and / or Short Message Service (SMS)), or any other suitable communication protocol including communication protocols that have not been developed on the date of filing of this document.

[0048] The audio circuit 110, speaker 111, and microphone 113 provide an audio interface between a user and the device 100. The audio circuit 110 receives audio data from the peripheral device interface 118, converts the audio data into electrical signals, and transmits the electrical signals to the speaker 111. The speaker 111 converts the electrical signals into sound waves audible to humans. The audio circuit 110 also receives electrical signals converted from sound waves by the microphone 113. The audio circuit 110 converts the electrical signals into audio data and transmits the audio data to the peripheral device interface 118 for processing. The audio data is optionally retrieved from and / or transmitted to the memory 102 and / or the RF circuit 108 by the peripheral device interface 118. In some embodiments, the audio circuit 110 also includes a headset jack (e.g., Figure 2 The headset jack 212 in FIG. 1 ). The headset jack provides an interface between the audio circuit 110 and a removable audio input / output peripheral device, such as an output-only headset or a headset with both output (e.g., a single-ear headset or a dual-ear headset) and input (e.g., a microphone).

[0049] The I / O subsystem 106 couples input / output peripherals on the device 100, such as a touch-sensitive display system 112 and other input or control devices 116, to a peripheral device interface 118. The I / O subsystem 106 optionally includes a display controller 156, an optical sensor controller 158, an intensity sensor controller 159, a tactile feedback controller 161, and one or more input controllers 160 for other input or control devices. The one or more input controllers 160 receive / send electrical signals from / to other input or control devices 116. Other input control devices 116 optionally include physical buttons (e.g., push buttons, rocker buttons, etc.), dials, slide switches, joysticks, click wheels, etc. In some alternative embodiments, the one or more input controllers 160 are optionally coupled to (or not coupled to) any of the following: a keyboard, an infrared port, a USB port, a stylus, and / or a pointer device such as a mouse. One or more buttons (e.g., Figure 2 The buttons 208 in the figure optionally include up / down buttons for volume control of the speaker 111 and / or the microphone 113. The one or more buttons optionally include a push button (e.g., Figure 2 206).

[0050] The touch-sensitive display system 112 provides an input interface and an output interface between the device and the user. The display controller 156 receives electrical signals from the touch-sensitive display system 112 and / or sends electrical signals to the touch-sensitive display system. The touch-sensitive display system 112 displays visual output to the user. The visual output optionally includes graphics, text, icons, videos, and any combination thereof (collectively referred to as "graphics"). In some embodiments, some or all of the visual output corresponds to a user interface object.

[0051] The touch-sensitive display system 112 has a touch-sensitive surface, sensor, or set of sensors that accepts input from a user based on haptic / tactile contact. The touch-sensitive display system 112 and display controller 156 (together with any associated modules and / or instruction sets in memory 102) detect contact (and any movement or interruption of that contact) on the touch-sensitive display system 112 and convert the detected contact into interaction with a user interface object (e.g., one or more soft keys, icons, web pages, or images) displayed on the touch-sensitive display system 112. In an exemplary embodiment, the point of contact between the touch-sensitive display system 112 and the user corresponds to the user's finger or stylus.

[0052] The touch-sensitive display system 112 optionally uses LCD (liquid crystal display) technology, LPD (light emitting polymer display) technology, or LED (light emitting diode) technology, although other display technologies are used in other embodiments. The touch-sensitive display system 112 and display controller 156 optionally use any of a variety of touch sensing technologies now known or later developed, including but not limited to capacitive technology, resistive technology, infrared technology, and surface acoustic wave technology, as well as other proximity sensor arrays or other elements for determining one or more points of contact with the touch-sensitive display system 112 to detect contact and any movement or interruption thereof. In an exemplary embodiment, projected mutual capacitance sensing technology is used, such as the . iPod and Technology found in.

[0053] The touch-sensitive display system 112 optionally has a video resolution of more than 100 dpi. In some embodiments, the touch screen video resolution exceeds 400 dpi (e.g., 500 dpi, 800 dpi or greater). The user optionally uses any suitable object or attachment such as a stylus, finger, etc. to contact the touch-sensitive display system 112. In some embodiments, the user interface is designed to work with finger-based contacts and gestures, which may not be as accurate as stylus-based input due to the larger contact area of ​​the finger on the touch screen. In some embodiments, the device converts rough finger-based input into precise pointer / cursor positions or commands for performing the actions desired by the user.

[0054] In some embodiments, in addition to the touch screen, the device 100 optionally includes a touchpad for activating or deactivating specific functions. In some embodiments, the touchpad is a touch-sensitive area of ​​the device that, unlike the touch screen, does not display visual output. The touchpad is optionally a touch-sensitive surface that is separate from the touch-sensitive display system 112, or an extension of the touch-sensitive surface formed by the touch screen.

[0055] The device 100 also includes a power system 162 for powering the various components. The power system 162 optionally includes a power management system, one or more power sources (e.g., batteries, alternating current (AC)), a recharging system, a power fault detection circuit, a power converter or inverter, a power status indicator (e.g., a light emitting diode (LED)), and any other components associated with the generation, management, and distribution of power in a portable device.

[0056] Device 100 optionally also includes one or more optical sensors 164 . Figure 1A An optical sensor coupled to an optical sensor controller 158 in the I / O subsystem 106 is shown. The optical sensor 164 optionally includes a charge coupled device (CCD) or a complementary metal oxide semiconductor (CMOS) phototransistor. One or more optical sensors 164 receive light projected through one or more lenses from the environment and convert the light into data representing an image. In conjunction with the imaging module 143 (also called a camera module), one or more optical sensors 164 optionally capture static images and / or videos. In some embodiments, the optical sensor is located on the rear of the device 100 opposite to the touch-sensitive display system 112 on the front of the device 100, so that the touch screen can be used as a viewfinder for static image and / or video image acquisition. In some embodiments, another optical sensor is located on the front of the device 100 to obtain an image of the user (e.g., for self-portraits, for video conferencing when the user views other video conference participants on the touch screen, etc.).

[0057] Device 100 optionally also includes one or more contact intensity sensors 165 . Figure 1A A contact force sensor coupled to a force sensor controller 159 in the I / O subsystem 106 is shown. One or more contact force sensors 165 optionally include one or more piezoresistive strain gauges, capacitive force sensors, electrical force sensors, piezoelectric force sensors, optical force sensors, capacitive touch-sensitive surfaces, or other force sensors (e.g., sensors for measuring the force (or pressure) of contact on a touch-sensitive surface). One or more contact force sensors 165 receive contact force information (e.g., pressure information or a surrogate for pressure information) from the environment. In some embodiments, at least one contact force sensor is juxtaposed or adjacent to a touch-sensitive surface (e.g., touch-sensitive display system 112). In some embodiments, at least one contact force sensor is located on the rear of the device 100 opposite to the touch screen display system 112 located on the front of the device 100.

[0058] Device 100 optionally also includes one or more proximity sensors 166 . Figure 1A A proximity sensor 166 is shown coupled to the peripherals interface 118. Alternatively, the proximity sensor 166 is coupled to the input controller 160 in the I / O subsystem 106. In some embodiments, the proximity sensor 166 turns off and disables the touch-sensitive display system 112 when the device 100 is placed near the user's ear (e.g., when the user is on a phone call).

[0059] Device 100 optionally also includes one or more tactile output generators 163. Figure 1A A tactile output generator coupled to a tactile feedback controller 161 in the I / O subsystem 106 is shown. One or more tactile output generators 163 optionally include one or more electroacoustic devices, such as speakers or other audio components, and / or electromechanical devices that convert energy into linear motion, such as motors, solenoids, electroactive polymers, piezoelectric actuators, electrostatic actuators, or other tactile output generating components (e.g., components that convert electrical signals into tactile outputs on the device). One or more tactile output generators 163 receive tactile feedback generation instructions from the tactile feedback module 133 and generate tactile outputs on the device 100 that can be sensed by a user of the device 100. In some embodiments, at least one tactile output generator is arranged in juxtaposition or proximity to a touch-sensitive surface (e.g., touch-sensitive display system 112) and optionally generates tactile outputs by moving the touch-sensitive surface vertically (e.g., inward / outward of the surface of the device 100) or laterally (e.g., backward and forward in the same plane as the surface of the device 100). In some embodiments, at least one tactile output generator sensor is located on a rear portion of the device 100 opposite the touch-sensitive display system 112 located on the front portion of the device 100 .

[0060] The device 100 optionally also includes one or more accelerometers 167, gyroscopes 168, and / or magnetometers 169 (eg, as part of an inertial measurement unit (IMU)) for obtaining information about the position (eg, attitude) of the device. Figure 1A Sensors 167, 168, and 169 are shown coupled to peripheral device interface 118. Alternatively, sensors 167, 168, and 169 are optionally coupled to input controller 160 in I / O subsystem 106. In some embodiments, information is displayed in a portrait view or a landscape view on the touch screen display based on analysis of data received from the one or more accelerometers. Device 100 optionally includes a GPS (or GLONASS or other global navigation system) receiver for obtaining information about the location of device 100.

[0061] In some embodiments, the software components stored in memory 102 include an operating system 126, a communication module (or instruction set) 128, a contact / motion module (or instruction set) 130, a graphics module (or instruction set) 132, a tactile feedback module (or instruction set) 133, a text input module (or instruction set) 134, a global positioning system (GPS) module (or instruction set) 135, and an application (or instruction set) 136. In addition, in some embodiments, memory 102 stores device / global internal state 157, as shown in FIG. 1A and FIG. Figure 3 . The device / global internal state 157 includes one or more of the following: an active application state, which indicates which applications (if any) are currently active; a display state, which indicates what applications, views, or other information occupy various areas of the touch-sensitive display system 112; a sensor state, including information obtained from the device's various sensors and other input or control devices 116; and position and / or orientation information about the device's position and / or posture.

[0062] The operating system 126 (e.g., iOS, DARWIN, RTXC, LINUX, UNIX, OS X, WINDOWS, or an embedded operating system such as VXWORKS) includes various software components and / or drivers for controlling and managing general system tasks (e.g., memory management, storage device control, power management, etc.), and facilitates communication between various hardware and software components.

[0063] The communication module 128 facilitates communication with other devices through the one or more external ports 124, and also includes various software components for processing data received by the RF circuit 108 and / or the external ports 124. The one or more external ports 124 (e.g., Universal Serial Bus (USB), FireWire, etc.) are suitable for coupling directly to other devices, or indirectly through a network (e.g., the Internet, wireless LAN, etc.). In some embodiments, the external port is a device that is compatible with some of Apple Inc. (Cupertino, California). iPod and In some embodiments, the external port is a multi-pin (e.g., 30-pin) connector that is the same as or similar to and / or compatible with the 30-pin connector used in Apple Inc. (Cupertino, California). iPod and A Lightning connector that is the same as or similar to and / or compatible with the Lightning connector used in the device.

[0064] The contact / motion module 130 optionally detects contact with the touch-sensitive display system 112 (in conjunction with the display controller 156) and other touch-sensitive devices (e.g., a touchpad or physical click wheel). The contact / motion module 130 includes software components for performing various operations related to contact detection (e.g., by a finger or stylus), such as determining whether contact has occurred (e.g., detecting a finger press event), determining the strength of the contact (e.g., the force or pressure of the contact, or a substitute for the force or pressure of the contact), determining whether there is movement of the contact and tracking the movement across the touch-sensitive surface (e.g., detecting one or more finger drag events), and determining whether the contact has stopped (e.g., detecting a finger lift event or contact disconnection). The contact / motion module 130 receives contact data from the touch-sensitive surface. Determining the movement of a contact point optionally includes determining a rate (magnitude), velocity (magnitude and direction), and / or acceleration (change in magnitude and / or direction) of the contact point, the movement of which is represented by a series of contact data. These operations are optionally applied to a single point of contact (e.g., a single finger contact or a stylus contact) or multiple points of simultaneous contact (e.g., "multi-touch" / multi-finger contact and / or stylus contact). In some embodiments, the contact / motion module 130 and display controller 156 detect contact on the touch pad.

[0065] The contact / motion module 130 optionally detects gesture input by the user. Different gestures on the touch-sensitive surface have different contact patterns (e.g., different motions, timings, and / or intensities of the detected contacts). Therefore, gestures are optionally detected by detecting specific contact patterns. For example, detecting a single-finger tap gesture includes detecting a finger press event, and then detecting a finger lift (lift-off) event at the same location (or substantially the same location) as the finger press event (e.g., at an icon location). As another example, detecting a finger swipe gesture on the touch-sensitive surface includes detecting a finger press event, then detecting one or more finger drag events, and then detecting a finger lift (lift-off) event. Similarly, taps, swipes, drags, and other gestures of the stylus are optionally detected by detecting a specific contact pattern of the stylus.

[0066] Graphics module 132 includes various known software components for rendering and displaying graphics on touch-sensitive display system 112 or other displays, including components for changing the visual impact (e.g., brightness, transparency, saturation, contrast, or other visual attributes) of displayed graphics. As used herein, the term "graphics" includes any object that can be displayed to a user, including, without limitation, text, web pages, icons (such as user interface objects including soft keys), digital images, videos, animations, etc.

[0067] In some embodiments, the graphics module 132 stores data representing graphics to be used. Each graphic is optionally assigned a corresponding code. The graphics module 132 receives one or more codes for specifying the graphics to be displayed from an application program, etc., and also receives coordinate data and other graphic attribute data together if necessary, and then generates screen image data to be output to the display controller 156.

[0068] Haptic feedback module 133 includes various software components for generating instructions used by one or more tactile output generators 163 to produce tactile output at one or more locations on device 100 in response to user interaction with device 100 .

[0069] Text input module 134, which is optionally a component of graphics module 132, provides a soft keyboard for entering text in various applications (e.g., contacts module 137, email client module 140, IM module 141, browser 147, and any other application requiring text input).

[0070] The GPS module 135 determines the location of the device and provides this information for use in various applications (e.g., to the phone module 138 for location-based dialing; to the camera module 143 as picture / video metadata; and to applications that provide location-based services such as the Weather widget, the Local Yellow Pages widget, and the Maps / Navigation widget).

[0071] The application 136 optionally includes the following modules (or instruction sets) or a subset or superset thereof:

[0072] Contacts module 137 (sometimes called address book or contact list);

[0073] Telephone module 138;

[0074] Video conferencing module 139;

[0075] Email client module 140;

[0076] Instant messaging (IM) module 141;

[0077] Fitness support module 142;

[0078] A camera module 143 for still images and / or video images;

[0079] Image management module 144;

[0080] Browser module 147;

[0081] Calendar module 148;

[0082] A widget module 149, which optionally includes one or more of the following: a weather widget 149-1, a stock widget 149-2, a calculator widget 149-3, an alarm widget 149-4, a dictionary widget 149-5, and other widgets acquired by the user, and a user-created widget 149-6;

[0083] A widget creator module 150 for forming a user-created widget 149-6;

[0084] Search module 151;

[0085] A video and music player module 152, optionally consisting of a video player module and a music player module;

[0086] Memo module 153;

[0087] Map module 154; and / or

[0088] Online video module 155.

[0089] Examples of other applications 136 optionally stored in memory 102 include other word processing applications, other image editing applications, drawing applications, rendering applications, JAVA-enabled applications, encryption, digital rights management, voice recognition, and voice replication.

[0090] In conjunction with the touch-sensitive display system 112, display controller 156, contact module 130, graphics module 132, and text input module 134, the contacts module 137 includes executable instructions for managing an address book or contact list (e.g., stored in the application internal state 192 of the contacts module 137 in memory 102 or memory 370), including: adding names to the address book; deleting names from the address book; associating phone numbers, email addresses, physical addresses, or other information with names; associating images with names; categorizing and classifying names; providing phone numbers or email addresses to initiate and / or facilitate communications via the phone module 138, video conferencing module 139, email client module 140, or IM module 141; and the like.

[0091] In conjunction with RF circuitry 108, audio circuitry 110, speaker 111, microphone 113, touch-sensitive display system 112, display controller 156, contact module 130, graphics module 132, and text input module 134, phone module 138 includes executable instructions for entering a character sequence corresponding to a phone number, accessing one or more phone numbers in address book 137, modifying an entered phone number, dialing a corresponding phone number, conducting a conversation, and disconnecting or hanging up when the conversation is complete. As described above, wireless communications optionally use any of a variety of communication standards, protocols, and technologies.

[0092] In combination with RF circuitry 108, audio circuitry 110, speaker 111, microphone 113, touch-sensitive display system 112, display controller 156, one or more optical sensors 164, optical sensor controller 158, contact module 130, graphics module 132, text input module 134, contact list 137, and telephone module 138, video conferencing module 139 includes executable instructions for initiating, conducting, and terminating a video conference between a user and one or more other participants in accordance with user instructions.

[0093] In conjunction with RF circuit 108, touch-sensitive display system 112, display controller 156, contact module 130, graphics module 132, and text input module 134, email client module 140 includes executable instructions for creating, sending, receiving, and managing emails in response to user instructions. In conjunction with image management module 144, email client module 140 makes it very easy to create and send emails with still images or video images captured by camera module 143.

[0094] In conjunction with the RF circuit 108, the touch-sensitive display system 112, the display controller 156, the contact module 130, the graphics module 132, and the text input module 134, the instant messaging module (IM) 141 includes executable instructions for performing the following operations: inputting a character sequence corresponding to an instant message, modifying previously input characters, transmitting the corresponding instant message (e.g., using a short message service (SMS) or multimedia message service (MMS) protocol for phone-based instant messaging or using XMPP, SIMPLE, Apple Push Notification Service (APNs) or IMPS for Internet-based instant messaging), receiving instant messages, and viewing received instant messages. In some embodiments, the transmitted and / or received instant messages optionally include graphics, photos, audio files, video files, and / or other attachments supported in MMS and / or enhanced messaging services (EMS). As used herein, "instant messaging" refers to both phone-based messages (e.g., messages sent using SMS or MMS) and Internet-based messages (e.g., messages sent using XMPP, SIMPLE, APNs, or IMPS).

[0095] In combination with RF circuitry 108, touch-sensitive display system 112, display controller 156, contact module 130, graphics module 132, text input module 134, GPS module 135, and map module 154, fitness support module 142 includes executable instructions for creating a workout (e.g., with time, distance, and / or calorie burn goals); communicating with fitness sensors (in sports equipment and smart watches); receiving fitness sensor data; calibrating sensors for monitoring fitness; selecting and playing music for a workout; and displaying, storing, and transmitting fitness data.

[0096] In conjunction with touch-sensitive display system 112, display controller 156, one or more optical sensors 164, optical sensor controller 158, contact module 130, graphics module 132, and image management module 144, camera module 143 includes executable instructions for capturing still images or videos (including video streams) and storing them in memory 102, modifying characteristics of still images or videos, and / or deleting still images or videos from memory 102.

[0097] In conjunction with touch-sensitive display system 112, display controller 156, contact module 130, graphics module 132, text input module 134, and camera module 143, image management module 144 includes executable instructions for arranging, modifying (e.g., editing), or otherwise manipulating, labeling, deleting, displaying (e.g., in a digital slide show or album), and storing still images and / or video images.

[0098] In combination with the RF circuit 108, the touch-sensitive display system 112, the display controller 156, the contact module 130, the graphics module 132 and the text input module 134, the browser module 147 includes executable instructions for browsing the Internet (including searching, linking to, receiving, and displaying web pages or portions thereof, as well as attachments and other files linked to web pages) in accordance with user instructions.

[0099] In combination with the RF circuit 108, the touch-sensitive display system 112, the display controller 156, the contact module 130, the graphics module 132, the text input module 134, the email client module 140 and the browser module 147, the calendar module 148 includes executable instructions for creating, displaying, modifying and storing calendars and data associated with calendars (e.g., calendar entries, to-do items, etc.) in accordance with user instructions.

[0100] In conjunction with the RF circuit 108, the touch-sensitive display system 112, the display controller 156, the contact module 130, the graphics module 132, the text input module 134, and the browser module 147, the desktop widget module 149 is a mini-application that is optionally downloaded and used by the user (e.g., the weather desktop widget 149-1, the stock desktop widget 149-2, the calculator desktop widget 149-3, the alarm desktop widget 149-4, and the dictionary desktop widget 149-5), or a mini-application created by the user (e.g., the user-created desktop widget 149-6). In some embodiments, the desktop widget includes an HTML (Hypertext Markup Language) file, a CSS (Cascading Style Sheets) file, and a JavaScript file. In some embodiments, the desktop widget includes an XML (Extensible Markup Language) file and a JavaScript file (e.g., the YAHOO! desktop widget).

[0101] In combination with the RF circuit 108, the touch-sensitive display system 112, the display controller 156, the contact module 130, the graphics module 132, the text input module 134, and the browser module 147, the desktop widget creator module 150 includes executable instructions for creating a desktop widget (e.g., transferring a user-specified portion of a web page to a desktop widget).

[0102] In conjunction with the touch-sensitive display system 112, the display controller 156, the contact module 130, the graphics module 132, and the text input module 134, the search module 151 includes executable instructions for searching the memory 102 for text, music, sound, images, videos, and / or other files that match one or more search criteria (e.g., one or more user-specified search terms) in accordance with user instructions.

[0103] In conjunction with touch-sensitive display system 112, display controller 156, contact module 130, graphics module 132, audio circuitry 110, speaker 111, RF circuitry 108, and browser module 147, video and music player module 152 includes executable instructions that allow a user to download and play back recorded music and other sound files stored in one or more file formats (such as MP3 or AAC files), as well as executable instructions for displaying, presenting, or otherwise playing back video (e.g., on touch-sensitive display system 112 or on an external display wirelessly connected via external port 124). In some embodiments, device 100 optionally includes the functionality of an MP3 player such as an iPod (trademark of Apple Inc.).

[0104] In conjunction with the touch-sensitive display system 112, the display controller 156, the contact module 130, the graphics module 132, and the text input module 134, the memo module 153 includes executable instructions for creating and managing memos, to-do items, etc. according to user instructions.

[0105] In combination with RF circuitry 108, touch-sensitive display system 112, display controller 156, contact module 130, graphics module 132, text input module 134, GPS module 135, and browser module 147, map module 154 includes executable instructions for receiving, displaying, modifying, and storing maps and data associated with the maps (e.g., driving routes; data about stores and other points of interest at or near a particular location; and other location-based data) in accordance with user instructions.

[0106] In conjunction with touch-sensitive display system 112, display controller 156, contact module 130, graphics module 132, audio circuit 110, speaker 111, RF circuit 108, text input module 134, email client module 140, and browser module 147, online video module 155 includes executable instructions that allow a user to access, browse, receive (e.g., by streaming and / or downloading), play back (e.g., on touch screen 112 or on an external display connected wirelessly or via external port 124), send an email with a link to a particular online video, and otherwise manage online videos in one or more file formats such as H.264. In some embodiments, instant messaging module 141 is used instead of email client module 140 to send a link to a particular online video.

[0107] Each module and application identified above corresponds to a set of executable instructions for performing one or more functions and methods described in the present application (e.g., computer-implemented methods and other information processing methods described herein). These modules (i.e., instruction sets) do not have to be implemented with independent software programs, processes or modules, so various subsets of these modules are optionally combined or otherwise rearranged in various embodiments. In some embodiments, memory 102 optionally stores a subset of the above modules and data structures. In addition, memory 102 optionally stores additional modules and data structures not described above.

[0108] In some embodiments, the device 100 is a device on which operation of a predefined set of functions is performed exclusively through a touch screen and / or a touch pad. By using a touch screen and / or a touch pad as the primary input control device for operating the device 100, the number of physical input control devices (e.g., push buttons, dials, etc.) on the device 100 is optionally reduced.

[0109] A predefined set of functions that are performed exclusively through the touch screen and / or trackpad optionally includes navigation between user interfaces. In some embodiments, the trackpad, when touched by the user, navigates the device 100 to a main menu, a home menu, or a root menu from any user interface displayed on the device 100. In such embodiments, a "menu button" is implemented using a trackpad. In some other embodiments, the menu button is a physical push button or other physical input control device, rather than a trackpad.

[0110] Figure 1B 1 is a block diagram illustrating exemplary components for event processing according to some embodiments. In some embodiments, memory 102 ( Figure 1A ) or memory 370 ( Figure 3) includes an event classifier 170 (e.g., in the operating system 126) and a corresponding application 136-1 (e.g., any one of the aforementioned applications 136, 137 to 155, 380 to 390).

[0111] The event classifier 170 receives event information and determines the application 136-1 and the application view 191 of the application 136-1 to which the event information is to be delivered. The event classifier 170 includes an event monitor 171 and an event distributor module 174. In some embodiments, the application 136-1 includes an application internal state 192, which indicates one or more current application views displayed on the touch-sensitive display system 112 when the application is active or executing. In some embodiments, the device / global internal state 157 is used by the event classifier 170 to determine which application(s) is currently active, and the application internal state 192 is used by the event classifier 170 to determine the application view 191 to which the event information is to be delivered.

[0112] In some embodiments, the application internal state 192 includes additional information, such as one or more of the following: resumption information to be used when the application 136-1 resumes execution, user interface state information indicating that information is being displayed or is ready to be displayed by the application 136-1, a state queue for enabling a user to return to a previous state or view of the application 136-1, and a repeat / undo queue of previous actions taken by the user.

[0113] Event monitor 171 receives event information from peripherals interface 118. Event information includes information about sub-events (e.g., a user touch on touch-sensitive display system 112 as part of a multi-touch gesture). Peripherals interface 118 transmits information it receives from I / O subsystem 106 or sensors such as proximity sensor 166, one or more accelerometers 167, one or more gyroscopes 168, one or more magnetometers 169, and / or microphone 113 (through audio circuit 110). The information received by peripherals interface 118 from I / O subsystem 106 includes information from touch-sensitive display system 112 or a touch-sensitive surface.

[0114] In some embodiments, event monitor 171 sends requests to peripheral device interface 118 at predetermined intervals. In response, peripheral device interface 118 transmits event information. In other embodiments, peripheral device interface 118 transmits event information only when there is a significant event (e.g., receiving an input above a predetermined noise threshold and / or receiving an input for more than a predetermined duration).

[0115] In some embodiments, the event classifier 170 also includes a hit view determination module 172 and / or an active event identifier determination module 173.

[0116] When the touch-sensitive display system 112 displays more than one view, the hit view determination module 172 provides software procedures for determining where within one or more views a sub-event has occurred. A view consists of controls and other elements that a user can see on the display.

[0117] Another aspect of the user interface associated with an application is a set of views, sometimes also referred to herein as application views or user interface windows, in which information is displayed and touch-based gestures occur. The application views (of the respective application) in which a touch is detected optionally correspond to a programmatic level within the programmatic or view hierarchy of the application. For example, the lowest level view in which a touch is detected is optionally referred to as a hit view, and the set of events recognized as correct input is optionally determined at least in part based on the hit view of the initial touch that started the touch-based gesture.

[0118] Hit view determination module 172 receives information related to sub-events of touch-based gestures. When an application has multiple views organized in a hierarchy, hit view determination module 172 identifies the hit view as the lowest view in the hierarchy where the sub-events should be processed. In most cases, the hit view is the lowest level view in which the initiating sub-event (i.e., the first sub-event in a sequence of sub-events that form an event or potential event) occurs. Once a hit view is identified by the hit view determination module, the hit view typically receives all sub-events related to the same touch or input source for which it is identified as the hit view.

[0119] Active event recognizer determination module 173 determines which view or views within the view hierarchy should receive a particular sequence of sub-events. In some embodiments, active event recognizer determination module 173 determines that only the hit view should receive a particular sequence of sub-events. In other embodiments, active event recognizer determination module 173 determines that all views that include the physical location of the sub-event are actively participating views, and therefore determines that all actively participating views should receive a particular sequence of sub-events. In other embodiments, even if a touch sub-event is completely confined to an area associated with one particular view, higher views in the hierarchy will still remain as actively participating views.

[0120] Event distributor module 174 distributes the event information to event recognizers (e.g., event recognizer 180). In some embodiments including active event recognizer determination module 173, event distributor module 174 delivers the event information to the event recognizer determined by active event recognizer determination module 173. In some embodiments, event distributor module 174 stores the event information in an event queue, which is retrieved by corresponding event receiver module 182.

[0121] In some embodiments, operating system 126 includes event classifier 170. Additionally, application 136-1 includes event classifier 170. In yet another embodiment, event classifier 170 is a standalone module or a part of another module stored in memory 102, such as contact / motion module 130.

[0122] In some embodiments, application 136-1 includes multiple event handlers 190 and one or more application views 191, each of which includes instructions for handling touch events occurring within a corresponding view of the user interface of the application. Each application view 191 of application 136-1 includes one or more event recognizers 180. Typically, the corresponding application view 191 includes multiple event recognizers 180. In other embodiments, one or more event recognizers in event recognizers 180 are part of an independent module, which is a higher-level object such as a user interface toolkit or application 136-1 from which methods and other properties are inherited. In some embodiments, the corresponding event handler 190 includes one or more of the following: data updater 176, object updater 177, GUI updater 178, and / or event data 179 received from event classifier 170. Event handler 190 optionally utilizes or calls data updater 176, object updater 177, or GUI updater 178 to update application internal state 192. Additionally, one or more of the application views in application view 191 include one or more corresponding event handlers 190. Additionally, in some embodiments, one or more of data updater 176, object updater 177, and GUI updater 178 are included in the corresponding application view 191.

[0123] The corresponding event identifier 180 receives event information (e.g., event data 179) from the event classifier 170 and identifies the event based on the event information. The event identifier 180 includes an event receiver 182 and an event comparator 184. In some embodiments, the event identifier 180 also includes metadata 183 and at least a subset of event delivery instructions 188 (which optionally include sub-event delivery instructions).

[0124] Event receiver 182 receives event information from event classifier 170. Event information includes information about sub-events such as touch or touch movement. Depending on the sub-event, the event information also includes additional information, such as the location of the sub-event. When the sub-event involves the movement of the touch, the event information optionally also includes the speed and direction of the sub-event. In some embodiments, the event includes the device rotating from one orientation to another orientation (for example, from a longitudinal orientation to a transverse orientation, or vice versa), and the event information includes corresponding information about the current orientation of the device (also referred to as the device posture).

[0125] Event comparator 184 compares event information with predefined event or sub-event definitions, and determines an event or sub-event based on the comparison, or determines or updates the state of an event or sub-event. In some embodiments, event comparator 184 includes event definition 186. Event definition 186 includes the definition of an event (e.g., a predefined sequence of sub-events), such as event 1 (187-1), event 2 (187-2), and others. In some embodiments, sub-events in event 187 include, for example, touch start, touch end, touch move, touch cancel, and multi-touch. In one example, the definition of event 1 (187-1) is a double-click on a displayed object. For example, a double-click includes a first touch (touch start) of a predetermined duration on a displayed object, a first lift (touch end) of a predetermined duration, a second touch (touch start) of a predetermined duration on a displayed object, and a second lift (touch end) of a predetermined duration. In another example, the definition of event 2 (187-2) is a drag on a displayed object. For example, dragging includes a touch (or contact) of a predetermined duration on a displayed object, movement of the touch on the touch-sensitive display system 112, and lifting of the touch (touch end). In some embodiments, the event also includes information for one or more associated event handlers 190.

[0126] In some embodiments, event definition 187 includes definitions of events for corresponding user interface objects. In some embodiments, event comparator 184 performs a hit test to determine which user interface object is associated with a sub-event. For example, in an application view displaying three user interface objects on touch-sensitive display system 112, when a touch is detected on touch-sensitive display system 112, event comparator 184 performs a hit test to determine which of the three user interface objects is associated with the touch (sub-event). If each displayed object is associated with a corresponding event handler 190, the event comparator uses the result of the hit test to determine which event handler 190 should be activated. For example, event comparator 184 selects an event handler associated with the sub-event and the object that triggered the hit test.

[0127] In some embodiments, the definition of the corresponding event 187 also includes delay actions that delay the delivery of the event information until it has been determined that the sub-event sequence does or does not correspond to the event type of the event identifier.

[0128] When a corresponding event recognizer 180 determines that a sequence of sub-events does not match any event in event definition 186, the corresponding event recognizer 180 enters an event impossible, event failed, or event ended state, after which subsequent sub-events of the touch-based gesture are ignored. In this case, other event recognizers (if any) that remain active for the hit view continue to track and process sub-events of the ongoing touch-based gesture.

[0129] In some embodiments, the corresponding event recognizers 180 include metadata 183 with configurable properties, flags, and / or lists that indicate how the event delivery system should perform sub-event delivery to actively participating event recognizers. In some embodiments, metadata 183 includes configurable properties, flags, and / or lists that indicate how event recognizers interact or can interact with each other. In some embodiments, metadata 183 includes configurable properties, flags, and / or lists that indicate whether sub-events are delivered to different levels in a view or programmatic hierarchy.

[0130] In some embodiments, when one or more specific sub-events of an event are identified, the corresponding event recognizer 180 activates an event handler 190 associated with the event. In some embodiments, the corresponding event recognizer 180 delivers event information associated with the event to the event handler 190. Activating the event handler 190 is different from sending (and deferred sending) the sub-events to the corresponding hit view. In some embodiments, the event recognizer 180 throws a tag associated with the identified event, and the event handler 190 associated with the tag obtains the tag and performs a predefined process.

[0131] In some embodiments, the event delivery instructions 188 include a sub-event delivery instruction that delivers event information about a sub-event without activating an event handler. Instead, the sub-event delivery instruction delivers the event information to an event handler associated with a sub-event sequence or to an actively participating view. The event handler associated with the sub-event sequence or with an actively participating view receives the event information and performs a predetermined process.

[0132] In some embodiments, data updater 176 creates and updates data used in application 136-1. For example, data updater 176 updates phone numbers used in contact module 137, or stores video files used in video or music player module 152. In some embodiments, object updater 177 creates and updates objects used in application 136-1. For example, object updater 176 creates new user interface objects or updates the position of user interface objects. GUI updater 178 updates the GUI. For example, GUI updater 178 prepares display information and sends the display information to graphics module 132 for display on touch-sensitive display 112.

[0133] In some embodiments, event handler 190 includes or has access to data updater 176, object updater 177, and GUI updater 178. In some embodiments, data updater 176, object updater 177, and GUI updater 178 are included in a single module of the corresponding application 136-1 or application view 191. In other embodiments, they are included in two or more software modules.

[0134] It should be understood that the above discussion of event processing of user touches on a touch-sensitive display also applies to other forms of user input that utilize input devices to operate the multifunction device 100, and not all user input is initiated on the touch screen. For example, mouse movement and mouse button presses, optionally in conjunction with single or multiple keyboard presses or hold; contact movement on a touch pad, such as tapping, dragging, scrolling, etc.; stylus input; movement of the device; verbal commands; detected eye movement; biometric input; and / or any combination thereof are optionally used as input corresponding to sub-events defining the event to be recognized.

[0135] Figure 2 A device having a touch screen (e.g., Figure 1AThe portable multifunction device 100 of the present invention is a touch-sensitive display system 112 of the present invention. The touch screen optionally displays one or more graphics within the user interface (UI) 200. In this embodiment and other embodiments described below, the user can select one or more of the graphics by, for example, making gestures on the graphics using one or more fingers 202 (not drawn to scale in the figure) or one or more styluses 203 (not drawn to scale in the figure). In some embodiments, the selection of one or more graphics will occur when the user breaks contact with the one or more graphics. In some embodiments, the gesture optionally includes one or more taps, one or more swipes (from left to right, from right to left, up and / or down) and / or rolling of the fingers that have been in contact with the device 100 (from right to left, from left to right, up and / or down). In some specific implementations or in some cases, inadvertent contact with the graphics will not select the graphics. For example, when the gesture corresponding to the selection is a tap, a swipe gesture that sweeps over an application icon optionally does not select the corresponding application.

[0136] The device 100 optionally also includes one or more physical buttons, such as a "home" or menu button 204. As previously described, the menu button 204 is optionally used to navigate to any application 136 in a set of applications that are optionally executed on the device 100. Additionally, in some embodiments, the menu button is implemented as a soft key in a GUI displayed on the touch screen display.

[0137] In some embodiments, the device 100 includes a touch screen display 112, a menu button 204, a push button 206 for powering the device on / off and for locking the device, one or more volume adjustment buttons 208, a user identity module (SIM) card slot 210, an earphone jack 212, and a docking / charging external port 124. The push button 206 is optionally used to turn the device on / off by pressing the button and keeping the button in a pressed state for a predefined time interval; lock the device by pressing the button and releasing the button before the predefined time interval passes; and / or unlock the device or initiate an unlocking process. In some embodiments, the device 100 also accepts voice input for activating or deactivating certain functions through a microphone 113. The device 100 also optionally includes one or more contact strength sensors 165 for detecting the strength of contact on the touch-sensitive display system 112 and / or one or more tactile output generators 163 for generating tactile output for a user of the device 100.

[0138] Figure 3300 is a block diagram of an exemplary multi-function device with a display and a touch-sensitive surface according to some embodiments. Device 300 does not have to be portable. In some embodiments, device 300 is a laptop computer, a desktop computer, a tablet computer, a multimedia player device, a navigation device, an educational device (such as a children's learning toy), a game system, or a control device (e.g., a home controller or an industrial controller). Device 300 typically includes one or more processing units (CPUs) 310, one or more network or other communication interfaces 360, a memory 370, and one or more communication buses 320 for interconnecting these components. The communication bus 320 optionally includes circuits (sometimes referred to as a chipset) that interconnect system components and control communications between system components. Device 300 includes an input / output (I / O) interface 330 with a display 340, which is typically a touch screen display. The I / O interface 330 also optionally includes a keyboard and / or a mouse (or other pointing device) 350 and a touchpad 355, a tactile output generator 357 for generating tactile output on the device 300 (e.g., similar to the above reference Figure 1A The one or more tactile output generators 163), sensors 359 (e.g., similar to those described above with reference to Figure 1A The sensors 112 , 164 , 165 , 166 , 167 , 168 and 169 may include touch sensors, optical sensors, contact intensity sensors, proximity sensors, acceleration sensors, gesture sensors and / or magnetic sensors).

[0139] Memory 370 includes high-speed random access memory, such as DRAM, SRAM, DDR RAM, or other random access solid-state memory devices. And optionally includes non-volatile memory, such as one or more magnetic disk storage devices, optical disk storage devices, flash memory devices, or other non-volatile solid-state storage devices. Memory 370 optionally includes one or more storage devices located away from one or more processing units 310. In some embodiments, memory 370 stores data related to portable multifunction device 100 ( Figure 1A ) or a subset thereof. In addition, memory 370 optionally stores additional programs, modules, and data structures not present in memory 102 of portable multifunction device 100. For example, memory 370 of device 300 optionally stores a drawing module 380, a presentation module 382, ​​a word processing module 384, a website creation module 386, a disk editing module 388, and / or a spreadsheet module 390, while portable multifunction device 100 ( Figure 1A )'s memory 102 optionally does not store these modules.

[0140] Figure 3Each element in the above-mentioned identified element is optionally stored in one or more memory devices in the previously mentioned memory device. Each module in the above-mentioned identified module corresponds to the instruction set for performing the above-mentioned functions. The above-mentioned identified module or program (that is, instruction set) need not be implemented as a separate software program, process or module, so the various subsets of these modules are optionally combined or otherwise rearranged in various embodiments. In some embodiments, memory 370 optionally stores the subset of the above-mentioned modules and data structures. In addition, memory 370 optionally stores additional modules and data structures not described above.

[0141] Attention is now turned to an embodiment of a user interface (“UI”) that is optionally implemented on portable multifunction device 100 .

[0142] Figure 4A An exemplary user interface of an application menu on portable multifunction device 100 is shown according to some embodiments. A similar user interface is optionally implemented on device 300. In some embodiments, user interface 400 includes the following elements, or a subset or superset thereof:

[0143] Signal strength indicators 402 for wireless communications such as cellular signals and Wi-Fi signals;

[0144] Time 404;

[0145] Bluetooth indicator 405;

[0146] Battery status indicator 406;

[0147] A tray 408 with icons for commonly used applications, such as:

[0148] o an icon 416 of the phone module 138 labeled “Phone”, which optionally includes an indicator 414 of the number of missed calls or voicemails;

[0149] o an icon 418 of the email client module 140 labeled “Mail”, which optionally includes an indicator 410 of the number of unread emails;

[0150] o an icon 420 labeled "Browser" of the browser module 147; and

[0151] o The video and music player module 152 (also referred to as the iPod (a trademark of Apple Inc. of Cupertino, California)) module 152) is labeled

[0152] An icon 422 for “iPod”; and

[0153] Icons for other apps, such as:

[0154] o Icon 424 labeled "Text" of IM module 141;

[0155] o Icon 426 labeled “Calendar” of calendar module 148;

[0156] o Icon 428 labeled “Photos” of the image management module 144;

[0157] o Icon 430 labeled “Camera” of camera module 143;

[0158] o Icon 434 labeled “Stock Market” of the Stock Market widget 149-2;

[0159] o an icon 436 labeled “MAP” of the map module 154;

[0160] o Icon 438 labeled “Weather” of the Weather widget 149-1;

[0161] o Icon 440 labeled as “clock” of the alarm clock widget 169-6;

[0162] o an icon 442 labeled “Fitness Support” of the fitness support module 142;

[0163] o Icon 444 labeled "Notepad" of the Notepad module 153; and

[0164] o An icon 446 for a settings application or module that provides access to settings for the device 100 and its various applications 136 .

[0165] It should be noted that Figure 4A The icon labels shown in are exemplary only. For example, in some embodiments, icon 422 of video and music player module 152 is labeled "Music" or "Music Player". Other labels are optionally used for various application icons. In some embodiments, the label of the corresponding application icon includes the name of the application corresponding to the corresponding application icon. In some embodiments, the label of a particular application icon is different from the name of the application corresponding to the particular application icon.

[0166] Figure 4B A touch-sensitive surface 451 (eg, Figure 3 A device (e.g., a tablet or touch pad 355) Figure 3Device 300 also optionally includes one or more contact intensity sensors (e.g., one or more of sensors 359) for detecting intensity of contact on touch-sensitive surface 451 and / or one or more tactile output generators 359 for generating tactile output for a user of device 300.

[0167] Figure 4B A touch-sensitive surface 451 (eg, Figure 3 A device (e.g., a tablet or touch pad 355) Figure 3 Although many of the examples that follow will be given with reference to input on a touch screen display 112 (where a touch-sensitive surface and a display are combined), in some embodiments, the device detects input on a touch-sensitive surface that is separate from the display, such as Figure 4B In some embodiments, the touch-sensitive surface (e.g., Figure 4B The touch-sensitive surface 451 in FIG. 4 has a touch-sensitive surface 451 corresponding to the display (eg, Figure 4B 450) on the main axis (e.g., Figure 4B The main axis 453 in the main axis (for example, Figure 4B According to these embodiments, the device detects contact with touch-sensitive surface 451 at a location corresponding to a corresponding location on the display (e.g., Figure 4B 460 and 462) (e.g., in Figure 4B , contact 460 corresponds to position 468 and contact 462 corresponds to position 470). Thus, on a touch-sensitive surface (e.g., Figure 4B 451) and a display of a multifunction device (e.g., Figure 4B When the display 450 in the display 450 is separated, the user input detected by the device on the touch-sensitive surface (e.g., contacts 460 and 462 and their movement) is used by the device to manipulate the user interface on the display. It should be understood that similar methods are optionally used for other user interfaces described herein.

[0168] Additionally, although the following examples are primarily given with reference to finger inputs (e.g., finger contacts, single-finger tap gestures, finger swipe gestures, etc.), it should be understood that in some embodiments, one or more of these finger inputs are replaced by input from another input device (e.g., mouse-based input or stylus input). For example, a swipe gesture is optionally replaced by a mouse click (e.g., instead of contact), followed by movement of the cursor along the path of the swipe (e.g., instead of movement of the contact). As another example, a tap gesture is optionally replaced by a mouse click when the cursor is over the location of the tap gesture (e.g., instead of detecting contact, followed by ceasing to detect contact). Similarly, when multiple user inputs are detected simultaneously, it should be understood that multiple computer mice are optionally used simultaneously, or a mouse and finger contacts are optionally used simultaneously.

[0169] As used herein, the term "focus selector" refers to an input element used to indicate the current portion of a user interface with which a user is interacting. In some implementations that include a cursor or other position marker, the cursor acts as a "focus selector" such that when the cursor is over a particular user interface element (e.g., a button, window, slider, or other user interface element), a focus selector is displayed on a touch-sensitive surface (e.g., Figure 3 Touchpad 355 or Figure 4B In the event that an input (e.g., a press input) is detected on the touch-sensitive surface 451 in the display, the particular user interface element is adjusted according to the detected input. In the case that the touch-sensitive surface 451 in the display includes a touch-screen display (e.g., Figure 1A A touch-sensitive display system 112 or Figure 4AIn some implementations of a touch screen in a user interface, a contact detected on the touch screen acts as a "focus selector" such that when an input (e.g., a press input by the contact) is detected on the touch screen display at the location of a particular user interface element (e.g., a button, window, slider, or other user interface element), the particular user interface element is adjusted in accordance with the detected input. In some implementations, the focus moves from one area of ​​the user interface to another area of ​​the user interface without corresponding movement of a cursor or movement of a contact on the touch screen display (e.g., by using a tab key or arrow keys to move the focus from one button to another); in these implementations, the focus selector moves in accordance with the movement of the focus between different areas of the user interface. Regardless of the specific form the focus selector takes, the focus selector is typically a user interface element (or contact on the touch screen display) that is controlled by the user to convey a user-desired interaction with the user interface (e.g., by indicating to the device an element of the user interface with which the user desires to interact). For example, when a press input is detected on a touch-sensitive surface (e.g., a trackpad or touch screen), the position of a focus selector (e.g., a cursor, contact, or selection box) over a corresponding button will indicate that the user intends to activate the corresponding button (rather than other user interface elements shown on the device display).

[0170] User interface and associated processes

[0171] Attention now turns to embodiments of a user interface ("UI") and related processes that may be implemented on an electronic device, such as a portable multifunction device (PMD) 100 having a display, a touch-sensitive surface, and optionally one or more sensors for detecting intensity of contact with the touch-sensitive surface, or a device 300 having one or more processors, non-volatile memory, a display, and one or more input devices.

[0172] FIG. 5A to FIG. 5I An exemplary user interface for accessing and navigating a media library user interface according to some embodiments is shown. The user interfaces in these figures are used to illustrate the processes described below, including FIG. 8A to FIG. 8D Although some of the examples that follow will be given with reference to input on a touch screen display (in which a touch-sensitive surface and a display are combined), in some embodiments, the device detects input on a touch-sensitive surface 451 that is separate from the display 450, such as Figure 4B In some embodiments, user input is sometimes referred to herein as touch input or touch input gesture.

[0173] Figure 5A and 5BA sequence according to some embodiments is shown, wherein in response to detecting a touch input gesture, the wake screen user interface is replaced by the home screen user interface. Figure 5A As shown, the electronic device displays a wake-up screen user interface 510, which includes a media item 515 used as a background or wallpaper. Wake-up screen user interface 510 also includes multiple foreground user interface objects—authentication indicator 502, time and date indicator 504, notifications 506A and 506B, flashlight enable representation 508A, image capture enable representation 508B, and home screen enable representation 512.

[0174] According to some embodiments, when the electronic device is operating in unlocked mode, the authentication indicator 502 is represented by an open padlock, such as Figure 5A According to some embodiments, when the electronic device is operating in the locked mode, the authentication indicator 502 is represented by a closed padlock. For example, after the electronic device authenticates the user based on the successful entry of a PIN or other alphanumeric code, biometric information (e.g., a 3D face mesh or fingerprint), etc., the electronic device operates in the unlocked mode.

[0175] In some embodiments, when selected (e.g., using a single or double-click gesture, a tap and hold gesture, a deep press gesture, etc.), flashlight enable representation 508A causes the electronic device to maintain display of wake-up screen user interface 510 and illuminate a light-emitting element of the electronic device (e.g., a flash component associated with a camera). In some embodiments, when selected (e.g., using a single or double-click gesture, a tap and hold gesture, a deep press gesture, etc.), image capture enable representation 508B causes the electronic device to replace display of wake-up screen user interface 510 with an image capture user interface that is provided to capture an image using an inward-facing or outward-facing image sensor of the electronic device.

[0176] like Figure 5A As shown, the electronic device detects a touch input gesture 503 corresponding to an upward swipe originating from a location corresponding to home screen affordance 512. In response to detecting Figure 5A The touch input gesture 503 in the electronic device displays Figure 5B In some embodiments, the electronic device enables (or allows) a transition from the wake-up screen user interface 510 to the home screen user interface 520 when in unlock mode. Figure 5B As shown, the electronic device displays a home screen user interface 520 that includes media items 517 used as a background or wallpaper. The home screen user interface 520 also includes a plurality of selectable application icons 522 and a taskbar area 526 having selectable application icons 524A, 524B, 524C, and 524D.

[0177] For example, media item 517 corresponds to a smart gradient generated based on one or more visual attributes of media item 515, which corresponds to Figure 5A Background of the wake-up screen user interface 510 shown. In some embodiments, the one or more visual attributes correspond to a dominant hue / color on a pixel basis across the entire media item 515, an average hue / color across the entire media item 515, an average brightness across the entire media item 515, an average saturation across the entire media item 515, and the like. Thus, continuing with this example, the media item 517 includes multiple strips (vertical, horizontal, diagonal, etc.) associated with different hues of the dominant color within the media item 515. In some embodiments, a smoothing or blending operation is performed between each of the multiple strips. See international application PCT / US2020 / 024644, filed on March 25, 2020, attorney docket number 27753-50291WO1, which is incorporated herein by reference in its entirety for further description of the creation of a reference image-based color gradient (sometimes also referred to herein as a "smart gradient").

[0178] Figure 5C and 5D A sequence is shown according to some embodiments, wherein in response to detecting touch input, the wake screen user interface is replaced by the media library user interface. Figure 5C As shown, the electronic device detects touch input 505 (e.g., a single or double-click gesture, a tap and hold gesture, a deep press, etc.) at a location corresponding to the background of the wake screen user interface 510 (e.g., a location that does not correspond to any foreground user interface object within the wake screen user interface 510). Figure 5C The electronic device displays a touch input 505 in the Figure 5D In some embodiments, the electronic device enables (or allows) a transition from the wake screen user interface 510 to the media library user interface 530 when in unlocked mode.

[0179] like Figure 5D As shown, media library user interface 530 includes media items 515 and multiple foreground user interface objects, which include: completion enable representation 532, which, when selected (for example, using a single or double-click gesture), causes the electronic device to replace media library user interface 530 with wake-up screen user interface 510 without changing the background or wallpaper of wake-up screen user interface 510; setting enable representation 536, which, when selected (for example, using a single or double-click gesture), causes the electronic device to set the user interface with a wallpaper (for example, Fig. 6AThe electronic device includes a wallpaper settings user interface 605 (shown) replacing the media library user interface 530; a plurality of paging points 534 indicating the position of the media item 515 in the plurality of media items in the media library associated with the media library user interface 530; and a wallpaper indicator 535 indicating that the media item 515 is the current background or wallpaper of the wake screen user interface 510. In some embodiments, in response to detecting an upward swipe gesture within the media library user interface 530 (etc.), the electronic device replaces the media library user interface 530 with the wake screen user interface 510 without changing the background or wallpaper of the wake screen user interface 510.

[0180] Figure 5D and 5E A sequence is shown according to some embodiments, wherein in response to detecting a navigation gesture, a first media item is replaced by a second media item within the media library user interface. Figure 5D As shown, the electronic device detects touch input gesture 507 (also sometimes referred to herein as a navigation gesture) corresponding to a right-to-left swipe at a location corresponding to the background of media library user interface 530 (e.g., a location that does not correspond to any foreground user interface object within media library user interface 530). Figure 5D The touch input gesture 507 in the electronic device updates Figure 5E In response to detecting that Figure 5D The electronic device updates multiple paging points 534 and uses the touch input gesture 507 in Figure 5E The “Set Wallpaper” enable representation 538 in the home screen replaces wallpaper indicator 535, which, when selected (e.g., using a single-click or double-click gesture), causes the electronic device to set media item 525 as the background or wallpaper of wake screen user interface 510. According to some embodiments, when “Set Wallpaper” enable representation 538 is selected, the electronic device also sets a media item generated based on media item 525 as the background or wallpaper of home screen user interface 520 (e.g., as described below with reference to method 900, such as smart colors, smart gradients, smart patterns, etc.).

[0181] Figure 5E and 5F A sequence is shown according to some embodiments, wherein in response to detecting a touch input, one or more foreground user interface objects within the media library user interface are stopped from being displayed. Figure 5EAs shown, the electronic device detects touch input 509 (e.g., a single or double-click gesture, a tap and hold gesture, a deep press, etc.) at a location corresponding to the background of media library user interface 530 (e.g., a location that does not correspond to any foreground user interface object within media library user interface 530). Figure 5E The electronic device stops displaying the touch input 509 in the Fig. 5F In some embodiments, the electronic device stops displaying the foreground user interface object within the media library user interface 530 after a determined timeout period (e.g., 10 seconds) expires.

[0182] Fig. 5F and 5G A sequence is shown according to some embodiments in which, in response to detecting a touch input, one or more foreground user interface objects are redisplayed within a media library user interface. Fig. 5F As shown, the electronic device detects touch input 511 (e.g., a single or double-click gesture, a tap and hold gesture, a deep press, etc.) at a location corresponding to the background of the media library user interface 530. Fig. 5F The touch input 511 in the electronic device Figure 5G The foreground user interface object is redisplayed within the media library user interface 530 in .

[0183] Figure 5G and 5H A sequence according to some embodiments is shown, wherein in response to a selection input, the second media item is set as the background of the wake screen user interface, and the media library user interface is replaced by the wake screen user interface. Figure 5G As shown, the electronic device detects touch input 513 (e.g., a tap gesture) at a location corresponding to a "set wallpaper" affordance 538 within media library user interface 530. In response to detecting Figure 5G The electronic device redisplays the touch input 513 in Figure 5H 5. The wake screen user interface 510 includes media items 525 as its background or wallpaper.

[0184] Figure 5H and 5I A sequence according to some embodiments is shown, wherein in response to detecting a touch input gesture, the wake screen user interface is replaced by the home screen user interface. Figure 5H As shown, the electronic device detects a touch input gesture 521 corresponding to an upward swipe originating from a location corresponding to home screen affordance 512. In response to detecting Figure 5H The touch input gesture 521 in the electronic device displays Fig.5IIn some embodiments, the electronic device enables (or allows) a transition from the wake-up screen user interface 510 to the home screen user interface 520 when in unlock mode. Fig.5I As shown, the electronic device displays a home screen user interface 520 that includes media items 527 used as a background or wallpaper.

[0185] For example, media item 527 corresponds to a smart gradient generated based on one or more visual attributes of media item 525, which corresponds to Figure 5H 50291WO1, the wake-up screen user interface 510 of the media item 525. In some embodiments, the one or more visual attributes correspond to a dominant hue / color on a pixel basis across the entire media item 525, an average hue / color across the entire media item 525, an average brightness across the entire media item 525, an average saturation across the entire media item 525, and the like. Thus, continuing with the example, the media item 527 includes multiple strips (vertical, horizontal, diagonal, etc.) associated with different hues of the dominant color within the media item 525. In some embodiments, a smoothing or blending operation is performed between each of the multiple strips. See international application PCT / US2020 / 024644, filed on March 25, 2020, attorney docket number 27753-50291WO1, which is incorporated herein by reference in its entirety for further description of the creation of a reference image-based color gradient (sometimes also referred to herein as a "smart gradient").

[0186] FIG. 6A to FIG. 6G An exemplary user interface for changing a home screen process applied to a home screen user interface according to some embodiments is shown. The user interfaces in these figures are used to illustrate the Fig.9A and Fig. 9B Although some of the examples that follow will be given with reference to input on a touch screen display (in which a touch-sensitive surface and a display are combined), in some embodiments, the device detects input on a touch-sensitive surface 451 that is separate from the display 450, such as Figure 4B In some embodiments, user input is sometimes referred to herein as touch input or touch input gesture.

[0187] Fig. 6A and 6B A sequence is shown according to some embodiments, wherein in response to detecting a selection of a smart color home screen processing option, a home screen user interface preview is updated within a wallpaper settings user interface. Fig. 6AAs shown, the electronic device displays a wallpaper setting user interface 605, which includes an area 607 with multiple wake-up screen user interfaces and home screen user interface preview pairs 610A, 610B, 610C ... (sometimes collectively referred to as "wake-up + home screen preview pair 610" in this document), wherein the wake-up screen user interface and the home screen user interface preview pair 610B are currently displayed. According to some embodiments, the wake-up + home screen preview pair 610 corresponds to the above reference FIG. 5A to FIG. 5I The wallpaper settings user interface 605 also includes selectable home screen handling options 616A, 616B, 616C, 616D, and 616E (also sometimes collectively referred to herein as "home screen handling options 616"), which, when selected (e.g., using a single or double-click gesture), causes the electronic device to update the media items displayed as the background or wallpaper of the home screen user interface within the currently selected wake screen user interface and home screen user interface preview pair (e.g., as shown in FIG. 1 ). Fig. 6A and Figure 6B For example, home screen handling option 616E enables the user to select an image to be used as the background of the home screen user interface that is different from the current image used as the background of the wake screen user interface.

[0188] The wake screen user interface and home screen user interface preview pair 610B includes a media item 612 set as the background or wallpaper of the wake screen user interface based on the currently selected home screen processing option 616B (e.g., smart gradient) and a media item 614A set as the background or wallpaper of the home screen user interface. Fig. 6A As shown, media item 614A corresponds to a smart gradient background or wallpaper generated based on media item 612.

[0189] For example, media item 614A corresponds to a smart gradient generated based on one or more visual attributes of media item 612, which corresponds to the background of the wake-up screen user interface. In some embodiments, the one or more visual attributes correspond to the main hue / color based on pixels throughout the media item 612, the average hue / color across the media item 612, the average brightness across the media item 612, the average saturation across the media item 612, etc. Therefore, continuing with this example, media item 614A includes multiple strips (vertical, horizontal, diagonal, etc.) associated with different hues of the main color within the media item 612. In some embodiments, a smoothing or blending operation is performed between each of the multiple strips. See International Application PCT / US2020 / 024644, filed on March 25, 2020, Attorney Docket No. 27753-50291WO1, which is incorporated herein by reference in its entirety for further description of the creation of a color gradient based on a reference image (sometimes also referred to herein as a "smart gradient").

[0190] Wallpaper setting user interface 605 also includes a chrome area 602, which has: a return enable representation 604, which, when selected (e.g., using a single or double-click gesture), causes the electronic device to replace the display of wallpaper setting user interface 605 with a setting user interface; and an add enable representation 606, which, when selected (e.g., using a single or double-click gesture), causes the electronic device to display a media library add user interface (e.g., similar to a media library add user interface) for adding one or more media items to the media library. Fig. 7A The wallpaper setting user interface 605 also includes an edit affordance 608, which, when selected (e.g., using a single-click or double-click gesture), causes the electronic device to replace the display of the wallpaper setting user interface 605 with a media library editing user interface 630 for editing media items in the media library (e.g., as shown in FIG. 1 ). Fig.6D and Fig. 6E ). Wallpaper settings user interface 605 also includes: a wallpaper indicator 618 that indicates that media item 612 is the current background or wallpaper of the wake screen user interface and that media item 614A is the current background or wallpaper of the home screen user interface; and a home screen affordance 512 that, when selected to have an upward swipe gesture originating therefrom, causes the electronic device to wake up with the home screen user interface (e.g., Fig.5I The home screen user interface 520 in the image may replace the display of the wallpaper setting user interface 605.

[0191] like Fig. 6AAs shown, the electronic device detects a touch input 681 (eg, a tap gesture) at a location corresponding to the home screen processing option 616C (eg, smart color). In response to detecting Fig. 6A In the touch input 681 in the home screen, the electronic device updates the home screen user interface by setting the media item 614B as the background or wallpaper of the home screen user interface based on the currently selected home screen processing option 616C (e.g., smart color). Figure 6B In response to detecting that the wake-up screen user interface and the home screen user interface preview are paired 610B. Fig. 6A The touch input 681 in the electronic device is used Figure 6B The “Set Wallpaper” indication 619 replaces the wallpaper indicator 618, and the “Set Wallpaper” indication, when selected (for example, using a single or double-click gesture), causes the electronic device to set media item 612 as the background or wallpaper of the wake-up screen user interface, and to set media item 614B as the background or wallpaper of the home screen user interface.

[0192] like Figure 6B As shown, media item 614B corresponds to a smart color background or wallpaper generated based on media item 612. For example, media item 614B corresponds to a smart color generated based on one or more visual attributes of media item 612, which corresponds to the background of the wake-up screen user interface. In some embodiments, the one or more visual attributes correspond to the dominant hue / color on a pixel basis across the entire media item 612, the average hue / color across the entire media item 612, the average brightness across the entire media item 612, the average saturation across the entire media item 612, and the like.

[0193] Figure 6B and 6C A sequence is shown according to some embodiments in which a home screen user interface preview is updated in response to detecting a selection of a mirrored home screen processing option. Figure 6B As shown, the electronic device detects a touch input 683 (eg, a tap gesture) at a location corresponding to the home screen processing option 616D (eg, mirroring). In response to detecting Figure 6B , the electronic device updates the home screen user interface by setting the media item 612 as the background or wallpaper of the home screen user interface based on the currently selected home screen processing option 616D (e.g., mirroring). Figure 6C The wake-up screen user interface and the home screen user interface preview in pairing 610B.

[0194] Figure 6C and 6D A sequence according to some embodiments is shown, wherein in response to detecting a navigation gesture, a first wake screen + home screen preview pair is replaced by a second wake screen + home screen preview pair. Figure 6C As shown, the electronic device detects a touch input gesture 685 (also sometimes referred to herein as a navigation gesture) corresponding to a right-to-left swipe gesture within an area 607 including a wake-up+home screen preview pair 610. In response to detecting Figure 6C The touch input gesture 685 in the electronic device Fig.6D Navigate in the wake-up+home screen preview pair 610 in FIG. 6 , so that the wake-up screen user interface and the home screen user interface preview pair 610C are currently displayed.

[0195] The wake screen user interface and home screen user interface preview pair 610C includes a media item 622 set as the background or wallpaper of the wake screen user interface based on the currently selected home screen processing option 616B (e.g., smart gradient) and a media item 624 set as the background or wallpaper of the home screen user interface. Fig.6D As shown, media item 624 corresponds to a smart gradient background or wallpaper generated based on media item 622.

[0196] For example, media item 624 corresponds to a smart gradient generated based on one or more visual attributes of media item 622, which corresponds to the background of the wake-up screen user interface. In some embodiments, the one or more visual attributes correspond to the main hue / color based on pixels throughout the media item 622, the average hue / color across the media item 622, the average brightness across the media item 622, the average saturation across the media item 622, etc. Therefore, continuing with this example, media item 624 includes multiple strips (vertical, horizontal, diagonal, etc.) associated with different hues of the main color within the media item 622. In some embodiments, a smoothing or blending operation is performed between each of the multiple strips. See international application PCT / US2020 / 024644, filed on March 25, 2020, attorney docket number 27753-50291WO1, which is incorporated herein by reference in its entirety for further description of the creation of a color gradient based on a reference image (sometimes also referred to herein as a "smart gradient").

[0197] Fig.6D and 6E A sequence is shown according to some embodiments, wherein the wallpaper setting user interface is replaced by a media library editing user interface. Fig.6D As shown, the electronic device detects touch input 687 (e.g., a tap gesture) at a location corresponding to edit enable indication 608. In response to detecting Fig.6D The touch input 687 of the electronic device is used Fig. 6E The media library editing user interface 630 replaces the display of the wallpaper setting user interface 605.

[0198] like Fig. 6E As shown, the media library editing user interface 630 includes a chrome area 633, which has: an add enable representation 606, which, when selected (e.g., using a single-click or double-click gesture), causes the electronic device to display a media library add user interface (e.g., similar to a media library add user interface) for adding one or more media items to the media library. Fig. 7A and a completion affordance 632, which, when selected (e.g., using a single or double-click gesture), causes the electronic device to replace the media library editing user interface 630 with the wallpaper setting user interface 605. Fig. 6E As shown, the media library editing user interface 630 also includes a plurality of wake-up + home screen preview pairing areas 635A, 635B, 635C, 635D ... (sometimes collectively referred to herein as "wake-up + home screen preview pairing areas 635"), each of which includes a move handle 637 provided for reordering the corresponding wake-up + home screen preview pairings in the media library, and a delete enable indication 639, which, when selected, causes the electronic device to delete the corresponding wake-up + home screen preview pairing from the media library. According to some embodiments, the media library editing user interface 630 includes a plurality of media items in the media library (e.g., such as Fig. 6E In some embodiments, in response to detecting a scroll gesture (e.g., swiping down or up), the electronic device scrolls the wake-up+home screen preview pairing area 635 accordingly.

[0199] The wake+home preview pairing area 635A corresponds to the wake+home preview pairing 610A, which includes a media item 642 set as a wake screen user interface background or wallpaper and a media item 644 set as a home screen user interface background or wallpaper. For example, the media item 644 corresponds to a smart gradient generated based on the media item 642. The wake+home preview pairing area 635A also includes information 634A associated with the media item 642, such as a media item name, metadata (e.g., time, location, etc.), and a media item type (e.g., still image, live image, panorama, square, video, portrait, slow motion, time-lapse, etc.).

[0200] The wake+home preview pairing area 635B corresponds to the wake+home preview pairing 610B, which includes a media item 612 set as a wake screen user interface background or wallpaper and a media item 614A set as a home screen user interface background or wallpaper. For example, the media item 614A corresponds to a smart gradient generated based on the media item 612. The wake+home preview pairing area 635B also includes information 634B associated with the media item 612, such as a media item name, metadata (e.g., time, location, etc.), and a media item type (e.g., still image, live image, panorama, square, video, portrait, slow motion, time-lapse, etc.).

[0201] The wake+home preview pairing area 635C corresponds to the wake+home preview pairing 610C, which includes a media item 622 set as a wake screen user interface background or wallpaper and a media item 624 set as a home screen user interface background or wallpaper. For example, the media item 624 corresponds to a smart gradient generated based on the media item 622. The wake+home preview pairing area 635C also includes information 634C associated with the media item 622, such as a media item name, metadata (e.g., time, location, etc.), and a media item type (e.g., still image, live image, panorama, square, video, portrait, slow motion, time-lapse, etc.).

[0202] According to some embodiments, the wake+home preview pair 610 shown within the media library editing user interface 630 applies the same home screen treatment to the home screen user interface background or wallpaper (e.g., smart gradient). According to some embodiments, the wake+home preview pair 610 shown within the media library editing user interface 630 can apply different home screen treatments to the background or wallpaper of the home screen user interface based on a previously user-selected home screen treatment, a randomly selected home screen treatment, etc.

[0203] like Fig. 6F As shown, the electronic device displays a clipping user interface 660, which is provided to modify the media item 612 to be set as the background or wallpaper of the wake-up screen user interface. For example, the electronic device responds to detecting a corresponding FIG. 6A to FIG. 6D In the wallpaper setting user interface 605 or Fig. 6E In response to user input (e.g., a tap gesture) at the location of the wake screen user interface preview of the wake+home screen preview pairing within the media library editing user interface 630 in , crop user interface 660 is displayed.

[0204] For example, when the electronic device displays the crop user interface 660, the user can move or translate the media item 612, rotate the media item 612, scale or zoom the media item 612, etc. The crop user interface 660 includes: a cancel affordance 662, which, when selected (e.g., using a single or double-click gesture), causes the electronic device to eliminate the crop user interface 660 without applying changes to the media item 612; and a completion affordance 664, which, when selected (e.g., using a single or double-click gesture), causes the electronic device to eliminate the crop user interface 660 and apply the changes made by the user to the media item 612 in the media library. The crop user interface 660 also includes a parallax switch 666A and a multi-frame photo switch 666B.

[0205] According to some embodiments, in response to detecting the selection of the completion affordance 664, the electronic device updates the wake screen user interface to display the changed version of the media item 612 as the background or wallpaper. According to some embodiments, in response to detecting the selection of the completion affordance 664, the electronic device updates the home screen user interface to display the media item generated based on the changed version of the media item 612 as the background or wallpaper when one of the smart color, smart gradient, or smart pattern main processing options is currently selected. Thus, for example, if the user zooms in on the media item 612 while in the crop user interface 660 and then selects the completion affordance 664, the electronic device displays the zoomed-in version of the media item 612 as the wake screen user interface background or wallpaper, and also displays the smart gradient based on the zoomed-in version of the media item 612 as the home screen user interface background or wallpaper.

[0206] like Figure 6G As shown, the electronic device displays a clipping user interface 670, which is provided to modify the media item 612 to be set as the background or wallpaper of the main screen user interface. For example, the electronic device responds to detecting a corresponding FIG. 6A to FIG. 6D In the wallpaper setting user interface 605 or Fig. 6E A user input (e.g., a tap gesture) at a location of a home screen user interface preview paired with a wake-up+home screen preview within the media library editing user interface 630 in , displays a crop user interface 670.

[0207] For example, when the electronic device displays the crop user interface 670, the user can move or translate the media item 612 within the crop user interface 670, rotate the media item 612, scale or zoom the media item 612, etc. Figure 6G As shown, application icons 678 are overlaid on media items 612 corresponding to the background or wallpaper of the home screen user interface.

[0208] The crop user interface 670 includes: a cancel enable representation 672, which, when selected (e.g., using a single or double-click gesture), causes the electronic device to eliminate the crop user interface 670 without applying changes to the media item 612; and a completion enable representation 674, which, when selected (e.g., using a single or double-click gesture), causes the electronic device to eliminate the crop user interface 670 and apply the changes made by the user to the media item 612 in the media library. The crop user interface 670 also includes a color inversion switch 676A and a multi-frame photo switch 676B (e.g., switching between a time-related sequence of two or more image frames and a single image frame therein (such as a keyframe)).

[0209] 7A to 7H An exemplary user interface for adding one or more media items to a media library according to some embodiments is shown. The user interfaces in these figures are used to illustrate the process described below, including FIG. 8A to FIG. 8D Although some of the examples that follow will be given with reference to input on a touch screen display (in which a touch-sensitive surface and a display are combined), in some embodiments, the device detects input on a touch-sensitive surface 451 that is separate from the display 450, such as Figure 4B In some embodiments, user input is sometimes referred to herein as touch input or touch input gesture.

[0210] Fig. 7A and 7B A sequence is shown according to some embodiments in which, in response to detecting a selection of a sharing affordance, a media item selection user interface is replaced by a sharing user interface. Fig. 7A As shown, the electronic device displays a media item selection user interface 710, which includes a currently selected media item 714 (e.g., an image) and a chrome area 703, which has: a return affordance 702, which, when selected, causes the electronic device to display a previous user interface (e.g., a camera roll user interface); and an edit affordance 704, which, when selected (e.g., using a single-click or double-click gesture), causes the electronic device to display a media item editing user interface provided for editing the currently selected media item 714. The media item selection user interface 710 also includes a thumbnail area 711 having a plurality of thumbnails 712A, 712B, 712C, 712D, 712E, ... associated with the media items (e.g., images), wherein the thumbnail 712B is associated with the currently selected media item 714. The media item selection user interface 710 also includes a sharing affordance 706 that, when selected (eg, using a single-click or double-click gesture), causes the electronic device to display a sharing user interface (eg, Fig. 7A and Figure 7B ); a like enable indication 708, which, when selected (e.g., using a single or double-click gesture), causes the electronic device to add the currently selected media item 714 to a favorite album; and a delete enable indication 709, which, when selected (e.g., using a single or double-click gesture), causes the electronic device to delete the currently selected media item 714.

[0211] like Fig. 7A As shown, the electronic device detects touch input 721 (e.g., a tap gesture) at a location corresponding to sharing affordance 706. In response to detecting Fig. 7A The electronic device displays a touch input 721 in the Figure 7B 7B , the sharing user interface 720 includes the currently selected media item 714 and a chrome area 715, which has: a cancel enable indication 707, which, when selected (e.g., using a single-click or double-click gesture), causes the electronic device to eliminate the sharing user interface 720; and an edit enable indication 704, which, when selected (e.g., using a single-click or double-click gesture), causes the electronic device to display a media item editing user interface provided for editing the currently selected media item 714.

[0212] Sharing user interface 720 also includes a media item area 725 that includes a currently selected media item 714 (as indicated by a thick border and a check mark) and a portion of unselected media items 716. Sharing user interface 720 also includes multiple sharing affordances 722, 724A, 724B, 724C, and 724D that are provided to share the currently selected media item (e.g., media item 714) via various communication channels, communication devices, communication methods, applications, and the like. Sharing user interface 720 also includes multiple action affordances 726A, 726B, 726C, and 726D that are provided to perform various actions, operations, and the like on the currently selected media item (e.g., media item 714). In some embodiments, when selected (e.g., using a single or double-click gesture), “Use as Wallpaper” affordance 726B causes the electronic device to use the currently selected media item in sharing user interface 720 (e.g., as indicated by a thick border and a check mark). Figure 7B and Figure 7C In some embodiments, when selected (e.g., using a single click or double click gesture), the “Use as Wallpaper” affordance 726B causes the electronic device to share the media item in the shared user interface 720 (e.g., as shown in the sequence shown). Figure 7G and Figure 7H The wallpaper setting user interface 605 is displayed when multiple media items are selected in the sequence shown.

[0213] Figure 7B and 7C A sequence is shown according to some embodiments, wherein in response to detecting a selection of a wallpaper affordance and based on determining that a single media item has been selected, the sharing user interface is replaced by a media item cropping user interface. Figure 7B As shown, the electronic device detects touch input 723 (e.g., a tap gesture) at a location corresponding to a "use as wallpaper" affordance 726B (sometimes also referred to as a "wallpaper add affordance"). In response to detecting Figure 7B The electronic device displays a cropping user interface 660, which is provided to modify (or crop) the Figure 7C 714 media items in .

[0214] like Figure 7C As shown, the electronic device detects a touch input 727 (e.g., a tap gesture) at a location corresponding to completion indication 664. In response to detecting Figure 7C The electronic device displays a touch input 727 in the Fig.7D , “Add to wallpaper gallery” enable indication 732, “Use as wallpaper” enable indication 734, and cancel enable indication 736 are overlaid on the cropping user interface 660 in . When selected (e.g., using a single or double-click gesture), “Add to wallpaper gallery” enable indication 732 causes the electronic device to add media item 714 (or a modified version thereof) to the media gallery and optionally set media item 714 (or a modified version thereof) as the background or wallpaper of the wake screen user interface. When selected (e.g., using a single or double-click gesture), “Use as wallpaper” enable indication 734 causes the electronic device to set media item 714 (or a modified version thereof) as the background or wallpaper of the wake screen user interface (without adding media item 714 (or a modified version thereof) to the media library). When selected (e.g., using a single or double-click gesture), “Cancel” enable indication 736 causes the electronic device to eliminate cropping user interface 660.

[0215] FIG. 7E to FIG. 7G A sequence is shown according to some embodiments, wherein a second media item is selected within the sharing interface. Fig. 7E As shown, the electronic device detects a touch input gesture 729 (also sometimes referred to herein as a navigation gesture) corresponding to a right-to-left swipe within the media item area 725. In response to detecting Fig. 7E The touch input gesture 729 in the electronic device scrolls through Figure 7FThe media items in the media item area 725 are selected so that the media item area 725 includes a portion of the currently selected media item 714 (as indicated by the thick border and check mark), a portion of the unselected media item 718, and the unselected media item 716.

[0216] like Figure 7F As shown, the electronic device detects a touch input 731 (eg, a tap gesture) at a location corresponding to the media item 716. In response to detecting Figure 7F , media items 714 and 716 are currently selected, as indicated by the thick border and check mark.

[0217] Figure 7G and 7H A sequence is shown according to some embodiments, wherein in response to detecting a selection of a wallpaper affordance and based on determining that a plurality of media items have been selected, the sharing user interface is replaced by a wallpaper setting user interface. Figure 7G As shown, the electronic device detects touch input 733 (e.g., a tap gesture) at a location corresponding to "Use as Wallpaper" affordance 726B (sometimes also referred to as "Add Wallpaper Affordance"). In response to detecting Figure 7G The electronic device displays a touch input 733 in the Figure 7H The wallpaper setting user interface 605 in FIG.

[0218] like Figure 7H As shown, the wake screen user interface and home screen user interface preview pair 610C includes a media item 716 set as the background or wallpaper of the wake screen user interface based on the currently selected home screen processing option 616B (e.g., smart gradient) and a media item 717 set as the background or wallpaper of the home screen user interface. Figure 7H As shown, media item 717 corresponds to a smart gradient background or wallpaper generated based on media item 716. For example, wake screen user interface and home screen user interface preview pair 610B includes media item 714.

[0219] For example, media item 717 corresponds to a smart gradient generated based on one or more visual attributes of media item 716, which corresponds to the background of the wake-up screen user interface. In some embodiments, the one or more visual attributes correspond to the main hue / color based on pixels throughout the media item 716, the average hue / color throughout the media item 716, the average brightness throughout the media item 716, the average saturation throughout the media item 716, etc. Therefore, continuing this example, media item 717 includes multiple strips (vertical, horizontal, diagonal, etc.) associated with different hues of the main color within the media item 716. In some embodiments, a smoothing or blending operation is performed between each of the multiple strips. See International Application PCT / US2020 / 024644, filed on March 25, 2020, Attorney Docket No. 27753-50291WO1, which is incorporated herein by reference in its entirety for further description of the creation of a color gradient based on a reference image (sometimes also referred to herein as a "smart gradient").

[0220] FIG. 8A to FIG. 8D A flowchart of a method 800 for accessing and navigating a media library user interface according to some embodiments is shown. The method 800 is performed in an electronic device (e.g., Figure 1A The portable multifunction device 100 or Figure 3 The method 800 is performed in the device 300 of the embodiment of the present invention. In some embodiments, the display is a touch screen display, and the input device is located on the display or integrated with the display. In some embodiments, the display is separated from the input device. Some operations in the method 800 are optionally combined, and / or the order of some operations is optionally changed.

[0221] As described below, method 800 provides an intuitive way to access media items from a wake-up screen user interface in order to update the background or wallpaper of the wake-up screen user interface and / or the home screen user interface. The method reduces the cognitive burden on the user when updating the background or wallpaper of the wake-up screen user interface and / or the home screen user interface, thereby creating a more efficient human-computer interface. For battery-powered electronic devices, the user is enabled to update the background or wallpaper of the wake-up screen user interface and / or the home screen user interface faster and more efficiently, which saves power and increases the time interval between battery charges.

[0222] While displaying a wake screen user interface on the display, the device detects (802) a first user input via one or more input devices, the first user input corresponding to a request to display a media library user interface, the wake screen user interface including a first media item serving as a background for the wake screen user interface and one or more foreground user interface objects displayed above the first media item. For example, the one or more foreground user interface objects correspond to a lock / unlock indicator, a time and date indicator, a notification, a flashlight and camera enable representation, a home screen enable representation, etc. Figure 5A and Figure 5C As shown, for example, the electronic device displays a wake-up screen user interface 510, which includes a media item 515 (e.g., a first media item) used for a background or wallpaper and a plurality of foreground user interface objects—authentication indicator 502, time and date indicator 504, notifications 506A and 506B, flashlight enable representation 508A, image capture enable representation 508B, and home screen enable representation 512. For example, the first media item corresponds to a real-time image, a still image, a video, etc.

[0223] For example, the first user input corresponds to a voice command, a double-click gesture, a long press, a deep press, etc. Figure 5C As shown, for example, the electronic device detects touch input 505 (e.g., a single or double-click gesture, a tap and hold gesture, a deep press, etc.) at a location corresponding to the background of the wake screen user interface 510 (e.g., a location that does not correspond to any foreground user interface object within the wake screen user interface 510).

[0224] In some embodiments, the background of the wake screen user interface corresponds to a slideshow in which the plurality of media items in the media library user interface include a first media item (e.g., a wake screen slideshow mode). In some embodiments, the background corresponding to the wake screen user interface is randomly selected from the plurality of media items in the media library user interface including the first media item (e.g., a wake screen random mode).

[0225] In some embodiments, in response to detecting the first user input, the device (804): determines whether the device is unlocked; based on determining that the device is locked, maintains display of the wake screen user interface on the display and abandons display of the media library user interface; and based on determining that the device is locked, replaces display of the wake screen user interface on the display with the media library user interface. As an example, after successfully authenticating the user's biometric information (e.g., 3D face mesh, fingerprint, voice signature, etc.), the electronic device operates in the unlocked mode. As another example, after successfully authenticating the user's PIN or alphanumeric password, the electronic device operates in the unlocked mode.

[0226] According to some embodiments, when the electronic device is operating in unlocked mode, the authentication indicator 502 is represented by an open padlock, such as Figure 5A According to some embodiments, when the electronic device is operating in the locked mode, the authentication indicator 502 is represented by a closed padlock. For example, after the electronic device authenticates the user based on the successful entry of a PIN or other alphanumeric code, biometric information (e.g., a face grid or fingerprint), etc., the electronic device operates in the unlocked mode. In some embodiments, the electronic device enables (or allows) a transition from the wake screen user interface 510 to the media library user interface 530, which is represented by the media library user interface 530. Figure 5C and 5D The sequence shown in shows that because the electronic device is operating in the unlocked mode, the electronic device would otherwise maintain the wake screen user interface 510. Limiting the transition from the wake screen user interface to the media library user interface to the unlocked mode provides a sense of security to the user while reducing accidental inputs and also reducing the number and / or duration of user interactions with the device. Reducing the number and / or duration of user interactions with the device reduces wear on the device and reduces power consumption, thereby extending the battery life of the device.

[0227] In response to detecting the first user input, the device stops (806) displaying one or more foreground user interface objects from the wake screen user interface and displays the media library user interface on the display. According to some embodiments, the media library user interface enables a user to quickly update the background or wallpaper of the wake and / or home screen user interface from a library of media items. As an example, in response to detecting Figure 5C The touch input 505 in the electronic device is used Figure 5D The media library user interface 530 in the wake screen user interface replaces the display of the wake screen user interface 510. Accessing the media library user interface from the wake screen user interface provides an efficient mechanism for the user to more quickly change the background or wallpaper of the wake screen user interface and / or the home screen user interface, thereby reducing the number and / or duration of user interactions with the device. Reducing the number and / or duration of user interactions with the device reduces wear on the device and reduces power consumption, thereby extending the battery life of the device.

[0228] In some embodiments, the media items in the media library user interface include (808) a plurality of media items previously selected by a user of the device, and the plurality of media items include the first media item and the second media item. In some embodiments, the media library user interface includes a plurality of media items in a customizable media library. In some embodiments, the plurality of media items corresponds to media items previously selected by the user. Figure 5D and Figure 5EAs shown, the media library user interface 530 includes at least media item 515 (e.g., a first media item) and media item 525 (e.g., a second media item). The media library user interface including the media items selected by the user provides the user with an effective mechanism to more quickly change the background or wallpaper of the wake screen user interface and / or the home screen user interface, thereby reducing the number and / or duration of user interactions with the device. Reducing the number and / or duration of user interactions with the device reduces wear on the device and reduces power consumption, thereby extending the battery life of the device.

[0229] In some embodiments, the media items in the media library user interface include (810) a plurality of media items populated based on media selection criteria, and the plurality of media items include the first media item and the second media item. In some embodiments, the media library user interface includes a plurality of media items in a customizable media library. In some embodiments, the plurality of media items in the customizable media library are populated (without user intervention) based on media item selection criteria such as recently viewed media items, recently captured media items, recently imported media items, frequently viewed media items, etc. Figure 5D and Figure 5E As shown, the media library user interface 530 includes at least media item 515 (e.g., a first media item) and media item 525 (e.g., a second media item). The media library user interface including media items populated based on media selection criteria provides an effective mechanism for the user to more quickly change the background or wallpaper of the wake screen user interface and / or the home screen user interface, thereby reducing the number and / or duration of user interactions with the device. Reducing the number and / or duration of user interactions with the device reduces wear on the device and reduces power consumption, thereby extending the battery life of the device.

[0230] In some embodiments, the device displays (812) the media library user interface on the display, and displays a set of one or more foreground user interface objects above the first media item, wherein the set of one or more foreground user interface objects are different from the one or more foreground user interface objects associated with the wake screen user interface. Figure 5D As shown, the media library user interface 530 includes a media item 515 and multiple foreground user interface objects, including: a completion indication 532; a setting indication 536; multiple paging points 534, which indicate the position of the media item 515 among multiple media items in the media library associated with the media library user interface 530; and a wallpaper indicator 535, which indicates that the media item 515 is the current background or wallpaper of the wake screen user interface 510.

[0231] In some embodiments, a set of one or more foreground user interface objects displayed above the media library user interface includes at least (814): a first enable indication, which, when selected (e.g., using a single-click or double-click gesture), causes the wake-up screen user interface to be redisplayed; and a second enable indication, which, when selected (e.g., using a single-click or double-click gesture), causes the wallpaper setting user interface to be displayed. For example, the first enable indication corresponds to a "Done" button. For example, the first enable indication corresponds to a "Set" or gear button. For example, Figure 5D As shown, media library user interface 530 includes completion affordance 532, which, when selected (e.g., using a single-click or double-click gesture), causes the electronic device to replace media library user interface 530 with wake screen user interface 510 without changing the background or wallpaper of wake screen user interface 510. Figure 5D As shown, the media library user interface 530 also includes a setting enable representation 536, which, when selected (e.g., using a single or double-click gesture), causes the electronic device to set the user interface with a wallpaper (e.g., Fig. 6A The wallpaper settings user interface 605 shown replaces the media library user interface 530. The first enabling representation provides an effective mechanism for the user to more quickly transition from the media library user interface to the wake screen user interface, thereby reducing the number and / or duration of user interactions with the device. Reducing the number and / or duration of user interactions with the device reduces wear and tear on the device and reduces power consumption, thereby extending the battery life of the device. The second enabling representation provides an effective mechanism for the user to more quickly transition from the media library user interface to the wallpaper settings user interface, thereby reducing the number and / or duration of user interactions with the device. Reducing the number and / or duration of user interactions with the device reduces wear and tear on the device and reduces power consumption, thereby extending the battery life of the device.

[0232] In some embodiments, after a predetermined period of inactivity, the device (816) stops displaying the set of one or more foreground user interface objects displayed above the media library user interface. In some embodiments, the predetermined period of inactivity corresponds to a timeout period without detecting user input. For example, referring to Figure 5E and Fig. 5F , after the determined timeout period (e.g., 10 seconds) expires, the electronic device stops displaying the foreground user interface object within the media library user interface 530. As another example, Figure 5E and 5FA sequence is shown in which, in response to detecting touch input 509, one or more foreground user interface objects within the media library user interface 530 are ceased to be displayed. Removing one or more foreground user interface objects within the media library user interface provides a less cluttered user interface for the user to more quickly change the background or wallpaper of the wake screen user interface and / or home screen user interface, thereby reducing the number and / or duration of user interactions with the device. Reducing the number and / or duration of user interactions with the device reduces wear and tear on the device and reduces power consumption, thereby extending the battery life of the device.

[0233] While displaying the first media item without the one or more foreground user interface objects, the device detects (818) a second user input via the one or more input devices, the second user input corresponding to a request to navigate among the media items in the media library user interface. For example, the second user input corresponds to a swipe gesture from left to right or from right to left. In some embodiments, the directionality of the second user input determines the direction in which the user navigates in the customizable wallpaper gallery. For example, the first media item corresponds to a current wake screen wallpaper.

[0234] like Figure 5D As shown, the electronic device detects touch input gesture 507, which corresponds to a right-to-left swipe at a location corresponding to the background of media library user interface 530 (e.g., a location that does not correspond to any foreground user interface object within media library user interface 530). Figure 5D The touch input gesture 507 in the electronic device updates Figure 5E , so that the media item 525 is displayed as the background of the media library user interface 530.

[0235] In response to detecting the second user input, the device replaces (820) the first media item on the display with a second media item in the media library user interface. In some embodiments, the media library user interface also includes a paging point indicating the location of the current wake screen wallpaper in the plurality of media items in the customizable media library. For example, Figure 5D and 5E 5 shows a sequence in which, in response to detecting a navigation gesture 507 (e.g., a right-to-left swipe gesture), a first media item 515 within a media library user interface 530 is replaced by a second media item 525. Continuing with this example, in response to detecting Figure 5D The electronic device updates multiple paging points 534 and uses the touch input gesture 507 in Figure 5E535 is replaced by a “set wallpaper” indication 538 in the wake screen user interface, which, when selected (e.g., using a single or double-click gesture), causes the electronic device to set media item 525 as the background or wallpaper of the wake screen user interface 510. The media library user interface provides an efficient mechanism for the user to more quickly change the background or wallpaper of the wake screen user interface and / or the home screen user interface, thereby reducing the number and / or duration of user interactions with the device. Reducing the number and / or duration of user interactions with the device reduces wear and tear on the device and reduces power consumption, thereby extending the battery life of the device.

[0236] While displaying the second media item, the device detects (822) a third input via one or more input devices, the third input corresponding to a request to dismiss the media library user interface. As an example, the third user input corresponds to an upward swipe gesture from the bottom of the display while displaying the media library user interface. As another example, the third user input corresponds to a selection of a completion affordance within the media library user interface. As yet another example, the third user input corresponds to a selection of a "set wallpaper" affordance within the media library user interface.

[0237] like Figure 5G As shown, the electronic device detects touch input 513 (e.g., a tap gesture) at a location corresponding to a "set wallpaper" affordance 538 within media library user interface 530. In response to detecting Figure 5G The electronic device redisplays the touch input 513 in Figure 5H 5. The wake screen user interface 510 includes media items 525 as its background or wallpaper.

[0238] like Figure 5G As shown, media library user interface 530 includes completion affordance 532, which, when selected (e.g., using a single-click or double-click gesture), causes wake screen user interface 510 to replace media library user interface 530 without setting second media item 525 as the background of wake screen user interface 510. Figure 5G As shown, media library user interface 530 includes a “set wallpaper” affordance 538, which, when selected (e.g., using a single or double-click gesture), causes second media item 525 to replace first media item 515 as the background of wake screen user interface 510. Figure 5G As shown, media library user interface 530 includes a settings affordance 536 that, when selected (eg, using a single or double-click gesture), causes Fig. 6A The wallpaper settings interface 605 is shown replacing the media library user interface 530 .

[0239] In response to detecting the third user input corresponding to the request to eliminate the media library user interface, the device redisplays (823) the one or more foreground user interface objects from the wake screen user interface on the display above the media item from the media library user interface that is selected as the background of the wake screen user interface. According to some embodiments, the media item from the media library user interface that is selected as the background of the wake screen corresponds to one of the first media item or the second media item. In some embodiments, before detecting the third user input, the device detects input to replace the first media item with the second media item as the background of the wake screen user interface. In some embodiments, the device detects the third user input without detecting a previous input to replace the first media item with the second media item as the background of the wake screen user interface. For example, Figure 5G and 5H 5 shows a sequence in which, in response to selection input 513, second media item 525 is set as the background of wake screen user interface 510, and media library user interface 530 is replaced by wake screen user interface 510. Figure 5H As shown, the second media item 525 is the background or wallpaper of the wake screen user interface 510. The media library user interface provides an efficient mechanism for the user to change the background or wallpaper of the wake screen user interface and / or the home screen user interface more quickly, thereby reducing the number and / or duration of user interactions with the device. Reducing the number and / or duration of user interactions with the device reduces wear on the device and reduces power consumption, thereby extending the battery life of the device.

[0240] In some embodiments, the media item selected (824) from the media library user interface as the background of the wake screen user interface corresponds to the second media item. For example, before detecting the third user input, the device detects input to replace the first media item with the second media item as the background of the wake screen user interface. For example, Figure 5G and 5H A sequence is shown in which, in response to selection input 513 setting second media item 525 as the background of wake screen user interface 510 , media library user interface 530 is replaced by wake screen user interface 510 .

[0241] In some embodiments, the media item from the media library user interface that is selected (826) as the background of the wake screen user interface corresponds to the first media item. For example, the device detects the third user input without detecting a previous input to replace the first media item with the second media item as the background of the wake screen user interface. For example, referring to Figure 5EIn response to detecting user input of the selection completion indication 532, the electronic device replaces the display of the media library user interface 530 with the wake screen user interface 510, while maintaining the first media item 515 as the background of the wake screen user interface 510.

[0242] In some embodiments, in response to detecting a third user input corresponding to a request to dismiss the media library user interface, the device modifies (828) (e.g., automatically, without further user input) the background of the home screen user interface based on the media items from the media library user interface that were selected as the background of the wake screen user interface. In some embodiments, the background of the home screen user interface is based on the media items from the media library user interface that were selected as the background of the wake screen user interface and the home screen processing options (e.g., smart color, smart gradient, mirror, etc.).

[0243] For example, after setting the second media item 525 as the background of the wake-up screen interface 510, Figure 5H and 5I 5 shows a sequence in which, in response to detecting a touch input gesture 521, the wake screen user interface 510 is replaced by the home screen user interface 520. Continuing with this example, Fig.5I As shown, home screen user interface 520 includes media item 527 used as a background or wallpaper. For example, media item 527 corresponds to a smart gradient generated based on one or more visual attributes of media item 525, which corresponds to Figure 5H In some embodiments, the one or more visual attributes correspond to the main hue / color based on pixels on the entire media item 525, the average hue / color on the entire media item 525, the average brightness on the entire media item 525, the average saturation on the entire media item 525, etc. Therefore, continuing this example, media item 527 includes multiple strips (vertical, horizontal, diagonal, etc.) associated with different hues of the main color in the media item 525. In some embodiments, a smooth or blending operation is performed between each of the multiple strips. Modifying the background of the main screen user interface based on the media item selected as the background of the wake-up screen user interface from the media library user interface provides an effective mechanism for users to more quickly change the background or wallpaper of the main screen user interface, thereby reducing the number and / or duration of user interactions with the device. Reducing the number and / or duration of user interactions with the device reduces the wear of the device and reduces power consumption, thereby extending the battery life of the device.

[0244] In some embodiments, the device (830): detects a fourth user input via the one or more input devices, the fourth user input corresponding to selecting a corresponding user interface object from the one or more foreground user interface objects; and in response to detecting the fourth user input, performs an operation corresponding to the corresponding user interface object without displaying the media library user interface. As an example, refer to Figure 5C In response to detecting a selection of flashlight indication 508A within wake screen user interface 510 (e.g., using a single or double-click gesture, a tap and hold gesture, a deep press gesture, etc.), the electronic device illuminates a light-emitting element of the electronic device (e.g., a flash component associated with a camera). As another example, referring to Figure 5C In response to detecting selection of a camera enable indication 508B within the wake screen user interface 510 (e.g., using a single or double-click gesture, a tap and hold gesture, a deep press gesture, etc.), the electronic device replaces display of the wake screen user interface 510 with an image capture user interface that is provided to capture an image using an inward-facing or outward-facing image sensor of the electronic device.

[0245] As another example, refer to Figure 5C , the electronic device displays an expanded view of notification 506A in response to detecting a selection of notification 506A within wake screen user interface 510 (e.g., using a single-click or double-click gesture). As yet another example, the electronic device dismisses notification 506B in response to detecting a delete gesture relative to notification 506B within wake screen user interface 510 (e.g., a right-to-left swipe gesture at a position above notification 506B). As yet another example, the electronic device replaces the display of wake screen user interface 510 with home screen user interface 520 in response to detecting an upward swipe gesture relative to home screen affordance 512 within wake screen user interface 510 (e.g., as shown in FIG. 1 ). Figure 5A and Figure 5B 1 and 2. In response to user input directed to different portions of a wake screen user interface, performing two different operations from the wake screen user interface (e.g., accessing the media library user interface or performing an operation associated with a foreground user interface object) provides an efficient mechanism for performing either operation, thereby reducing the number and / or duration of user interactions with the device to perform at least one of the operations. Reducing the number and / or duration of user interactions with the device reduces wear on the device and, for battery-powered devices, extends the battery life of the device.

[0246] In some embodiments, the device (832): detects a fourth user input via the one or more input devices, the fourth user input corresponding to selecting one or more media items; detects a fifth user input via the one or more input devices, the fifth user input corresponding to selecting a sharing enable representation provided to display a sharing interface, the sharing interface including one or more optional operations for performing on the one or more media items; in response to detecting the fifth user input, displays on the display the sharing interface including at least a wallpaper adding enable representation, the wallpaper adding enable representation corresponding to adding the one or more media items to the media library user interface; detects a sixth user input via the one or more input devices, the sixth user input corresponding to selecting the wallpaper adding enable representation; and in response to detecting the sixth user input: based on determining that the fourth user input corresponds to selecting a single media item, displays on the display a cropping user interface, the cropping user interface is provided to perform one or more modification operations on the single media item; and based on determining that the fourth user input corresponds to selecting multiple media items, displays on the display a wallpaper setting user interface, the wallpaper setting user interface including a wake screen user interface and a home screen user interface with a side-by-side preview of one of the multiple media items. For example, Fig. 7A and 7B A sequence is shown in which, in response to detecting a selection to share an affordance 706 when at least a media item 714 is currently selected, a media item selection user interface 710 is replaced by a sharing user interface 720. In response to detecting a selection to add an affordance to the wallpaper based on the number of media items selected, performing two different operations (e.g., accessing a cropping user interface or a wallpaper setting user interface) from the wake screen user interface provides an efficient mechanism to access either of the user interfaces, thereby reducing the number and / or duration of user interactions with the device to access at least one of the user interfaces. Reducing the number and / or duration of user interactions with the device reduces wear on the device and, for battery-powered devices, extends the battery life of the device.

[0247] As an example, Figure 7B and 7C A sequence is shown in which, in response to detecting a selection to add affordance 726A to wallpaper and based on determining that a single media item 714 has been selected, sharing user interface 720 is replaced by cropping user interface 660, which is provided to modify media item 714. For example, while the electronic device displays cropping user interface 660, the user is able to move or translate media item 714, rotate media item 714, scale or zoom media item 714, etc. For example, the one or more modification operations correspond to rotating, moving / translating, scaling / zooming the media item based on a portion of the selected media item that is visible within the cropping user interface, etc.

[0248] As another example, Figure 7G and 7H 1 shows a sequence in which, in response to detecting a selection to add wallpaper affordance 726A and based on determining that multiple media items 714 and 716 have been selected, sharing user interface 720 is replaced by wallpaper setting user interface 605. Figure 7H As shown, the side-by-side wake screen user interface and home screen user interface preview pair 610C includes a media item 716 set as the background or wallpaper of the wake screen user interface based on the currently selected home screen processing option 616B (e.g., smart gradient) and a media item 717 set as the background or wallpaper of the home screen user interface. Figure 7H As shown, media item 717 corresponds to a smart gradient background or wallpaper generated based on media item 716. For example, the wake screen user interface and home screen user interface preview pair 610B include media item 714. For example, the side-by-side preview is associated with a first media item selected from a plurality of selected media items. As another example, the side-by-side preview is associated with a previous media item selected from a plurality of selected media items. As yet another example, the side-by-side preview is associated with a most recently viewed media item from a plurality of selected media items. As yet another example, the side-by-side preview is associated with a most recently captured or imported media item from a plurality of selected media items.

[0249] It should be understood that FIG. 8A to FIG. 8D The specific order in which the operations in the description are described is merely exemplary and is not intended to indicate that the order is the only order in which the operations may be performed. A person of ordinary skill in the art will recognize a variety of ways to reorder the operations described herein. Additionally, it should be noted that the details of other processes described herein in conjunction with other methods described herein (e.g., method 900 and method 1100) are also applicable in a similar manner to the above with respect to FIG. 8A to FIG. 8C Method 800 is described. For example, the user input, user input gesture, media item, wake screen user interface, home screen user interface, media library user interface, background, and preview described above with reference to method 800 optionally have one or more features of the user input, user input gesture, media item, wake screen user interface, home screen user interface, media library user interface, background, and preview described herein with reference to other methods described herein (e.g., methods 900 and 1100). For the sake of brevity, these details are not repeated here.

[0250] The operations in the above information processing method are optionally implemented by running one or more functional modules in an information processing device, such as a general-purpose processor (e.g., Figure 1A , Figure 3 and Figure 5Adescribed) or application-specific chips. In addition, the above reference FIG. 8A to FIG. 8D The described operations are optionally performed by Figure 1A and Figure 1B . For example, the user input, user input gesture, media item, wake screen user interface, home screen user interface, media library user interface, background and preview are optionally implemented by event classifier 170, event recognizer 180 and event handler 190. The event monitor 171 in the event classifier 170 detects contact on the touch-sensitive surface 451, and the event distributor module 174 delivers the event information to the application 136-1. The corresponding event recognizer 180 of the application 136-1 compares the event information with the corresponding event definition 186, and determines whether the first contact at the first position on the touch-sensitive surface corresponds to a predefined event or sub-event, such as a selection of an object on the user interface. When the corresponding predefined event or sub-event is detected, the event recognizer 180 activates the event handler 190 associated with the detection of the event or sub-event. The event handler 190 optionally utilizes or calls the data updater 176 or the object updater 177 to update the application internal state 192. In some embodiments, the event handler 190 accesses the corresponding GUI updater 178 to update the content displayed by the application. Similarly, those skilled in the art will clearly know that based on Figure 1A and Figure 1B How the components depicted in the figure can implement other processes.

[0251] Fig.9A and 9B A flowchart of a method 900 for updating the background or wallpaper of a home screen user interface based on a request to set a media item as the background or wallpaper of a wake screen user interface according to some embodiments is shown. The method 900 is performed in an electronic device (e.g., Figure 1A The portable multifunction device 100 or Figure 3 The method 900 is performed in the device 300 of the embodiment of the present invention. In some embodiments, the display is a touch screen display, and the input device is located on the display or integrated with the display. In some embodiments, the display is separated from the input device. Some operations in the method 900 are optionally combined, and / or the order of some operations is optionally changed.

[0252] As described below, method 900 provides an intuitive way to update the background or wallpaper of the home screen user interface in response to a request to set a media item as the background or wallpaper of the wake screen user interface. The method reduces the cognitive burden on the user when updating the background or wallpaper of the wake screen user interface and / or the home screen user interface, thereby creating a more efficient human-computer interface. For battery-powered electronic devices, users are enabled to update the background or wallpaper of the wake screen user interface and / or the home screen user interface faster and more efficiently, which saves power and increases the time interval between battery charges.

[0253] The device detects (902) a user input via the one or more input devices, the user input corresponding to a request to set a corresponding media item as a background of a wake screen user interface. Figure 5G and 5H A sequence is shown in which, in response to selection input 513, a second media item 525 is set as the background of a wake screen user interface 530, and the media library user interface 530 is replaced by the wake screen user interface 510. As another example, referring to Fig.6D In response to detecting a selection of the “Set Wallpaper” enable indication 619, the electronic device sets the media item 622 as the background or wallpaper of the wake screen user interface.

[0254] In response to detecting the user input, the device (904): based on determining that the user input corresponds to a request to set the first media item as the background of the wake screen user interface, sets a second media item different from the first media item as the background of the main screen user interface of the device; and based on determining that the user input corresponds to a request to set the third media item as the background of the wake screen user interface, sets a fourth media item different from the third media item as the background of the main screen user interface of the device. In response to the request to set the media item as the background or wallpaper of the wake screen user interface, setting the corresponding media item as the background or wallpaper of the main screen user interface provides an effective mechanism for setting the background for both the wake screen user interface and the main screen user interface, thereby reducing the number and / or duration of user interactions with the device, reducing wear on the device. Reducing the number and / or duration of user interactions with the device reduces wear on the device and, for battery-powered devices, extends the battery life of the device.

[0255] For example, after setting the second media item 525 as the background of the wake-up screen interface 510, Figure 5H and 5I 5 shows a sequence in which, in response to detecting a touch input gesture 521, the wake screen user interface 510 is replaced by the home screen user interface 520. Continuing with this example, Fig.5IAs shown, home screen user interface 520 includes media item 527 used as a background or wallpaper. For example, media item 527 corresponds to a smart gradient generated based on one or more visual attributes of media item 525, which corresponds to Figure 5H 525. In some embodiments, the one or more visual attributes correspond to a dominant hue / color on a pixel basis across the entire media item 525, an average hue / color across the entire media item 525, an average brightness across the entire media item 525, an average saturation across the entire media item 525, etc. Thus, continuing with the example, the media item 527 includes a plurality of strips (vertical, horizontal, diagonal, etc.) associated with different hues of the dominant color within the media item 525. In some embodiments, a smoothing or blending operation is performed between each of the plurality of strips.

[0256] As another example, see Figure 6B In response to detecting a selection of “set wallpaper” affordance 619, the electronic device sets media item 612 as the background or wallpaper of the wake-up screen user interface, and also sets media item 614B as the background or wallpaper of the home screen user interface. Figure 6B As shown, media item 614B corresponds to a smart color background or wallpaper generated based on media item 612. For example, media item 614B corresponds to a smart color generated based on one or more visual attributes of media item 612, which corresponds to the background of the wake-up screen user interface. In some embodiments, the one or more visual attributes correspond to the dominant hue / color on a pixel basis across the entire media item 612, the average hue / color across the entire media item 612, the average brightness across the entire media item 612, the average saturation across the entire media item 612, and the like.

[0257] In some embodiments, the second media item is generated based on the first media item (906), and the fourth media item is generated based on the third media item. Generating a media item to be set as the background of the home screen user interface based on the media item set as the background of the wake screen user interface (without user intervention) provides continuity between the backgrounds of the wake and home screen user interfaces, thereby reducing the number and / or duration of user interactions with the device, reducing wear on the device. Reducing the number and / or duration of user interactions with the device reduces wear on the device, and for battery-powered devices, extends the battery life of the device.

[0258] In some embodiments, the second media item corresponds to (908) a first pure color generated based on one or more visual characteristics of the first media item, and the fourth media item corresponds to a second pure color generated based on one or more visual characteristics of the third media item. For example, the one or more visual attributes correspond to a dominant hue / color on a pixel basis over the entire media item, an average hue / color over the entire media item, an average brightness over the entire media item, an average saturation over the entire media item, and the like. A media item corresponding to a pure color is generated based on the media item set as the background of the wake-up screen user interface (without user intervention) to be set as the background of the main screen user interface, providing continuity between the wake-up background and the main screen user interface, thereby reducing the number and / or duration of user interactions with the device, reducing wear on the device. Reducing the number and / or duration of user interactions with the device reduces wear on the device, and for battery-powered devices, extends the battery life of the device.

[0259] For example, refer to Figure 6B , media item 614B corresponds to a smart color background or wallpaper generated based on media item 612. For example, media item 614B corresponds to a smart color generated based on one or more visual attributes of media item 612, which corresponds to the background of the wake screen user interface. In some embodiments, the one or more visual attributes correspond to the dominant hue / color on a pixel basis across the entire media item 612, the average hue / color across the entire media item 612, the average brightness across the entire media item 612, the average saturation across the entire media item 612, and the like.

[0260] In some embodiments, the second media item corresponds to (910) a first color gradient selected based on one or more visual characteristics of the first media item, and the fourth media item corresponds to a second color gradient generated based on one or more visual characteristics of the third media item. For example, the one or more visual attributes correspond to a dominant hue / color based on pixels over the entire media item, an average hue / color over the entire media item, an average brightness over the entire media item, an average saturation over the entire media item, etc. In some embodiments, the first color gradient includes a plurality of stripes (vertical, horizontal, diagonal, etc.) associated with different hues of the dominant color within the first media item. In some embodiments, a smoothing or blending operation is performed between each of the plurality of strips. A media item corresponding to a color gradient is generated based on a media item set as the background of the wake-up screen user interface (without user intervention) to be set as the background of the main screen user interface, providing continuity between the wake-up background and the main screen user interface, thereby reducing the number and / or duration of user interactions with the device, reducing wear on the device. Reducing the number and / or duration of user interactions with the device reduces wear on the device, and for battery-powered devices, extends the battery life of the device.

[0261] For example, refer to Fig. 6A , media item 614A corresponds to a smart gradient background or wallpaper generated based on media item 612. For example, media item 614A corresponds to a smart gradient generated based on one or more visual attributes of media item 612, which corresponds to the background of the wake screen user interface. In some embodiments, the one or more visual attributes correspond to a dominant hue / color on a pixel basis across the entire media item 612, an average hue / color across the entire media item 612, an average brightness across the entire media item 612, an average saturation across the entire media item 612, and the like. Thus, continuing with the example, media item 614A includes multiple strips (vertical, horizontal, diagonal, etc.) associated with different hues of the dominant color within media item 612.

[0262] As another example, see Fig.6D, media item 624 corresponds to a smart gradient background or wallpaper generated based on media item 622. For example, media item 624 corresponds to a smart gradient generated based on one or more visual attributes of media item 622, which corresponds to the background of the wake screen user interface. In some embodiments, the one or more visual attributes correspond to a dominant hue / color on a pixel basis across the entire media item 622, an average hue / color across the entire media item 622, an average brightness across the entire media item 622, an average saturation across the entire media item 622, and the like. Thus, continuing with the example, media item 624 includes multiple strips (vertical, horizontal, diagonal, etc.) associated with different hues of the dominant color within media item 622.

[0263] In some embodiments, the first color gradient is generated (912) using (e.g., using or including only) a subset of colors contained in the first media item, and wherein the second color gradient is generated using (e.g., using or including only) a subset of colors contained in the third media item. For example, the first color gradient corresponds to a hue of a dominant color / color within the first media item, and the second color gradient corresponds to a chroma of a dominant color / color within the second media item.

[0264] In some embodiments, the second media item corresponds to (914) a first pattern generated based on one or more visual characteristics of the first media item, and the fourth media item corresponds to a second pattern generated based on one or more visual characteristics of the third media item. For example, the one or more visual attributes correspond to the dominant hue / color on a pixel basis across the entire media item, the average hue / color across the entire media item, the average brightness across the entire media item, the average saturation across the entire media item, the main features (lines, circles, leaves, surfaces, etc.), etc. As an example, the first pattern corresponds to a predetermined pattern having one or more hues of the dominant colors / colors within the first media item, and the second pattern corresponds to a predetermined pattern having one or more hues of the dominant colors / colors within the second media item. As another example, the first pattern is generated based on the dominant features or shapes and hues of one or more dominant colors / colors within the first media item, and the second pattern is generated based on the dominant features or shapes and hues of one or more dominant colors / colors within the second media item. Generate a media item corresponding to a pattern based on the media item set as the background of the wake-up screen user interface (without user intervention) to set as the background of the home screen user interface, provide continuity between the wake-up background and the home screen user interface, thereby reducing the number and / or duration of user interactions with the device, reducing wear on the device. Reducing the number and / or duration of user interactions with the device reduces wear on the device and, for battery-powered devices, extends the battery life of the device.

[0265] In some embodiments, in response to detecting the user input and according to determining that the user input corresponds to a request to set the first media item as the background of the wake-up screen user interface, the device simultaneously displays (916) on the display a first preview of the first media item used as the background of the wake-up screen user interface and a first preview of the second media item used as the background of the home screen user interface. For example, the previews of the wake-up user interface and the home screen user interface are displayed side by side. For example, one or more application icons are overlaid on the background of the home screen user interface, wherein the one or more application icons correspond to the current application icon on the home screen user interface. In some embodiments, the previews of the wake-up and home screen user interfaces are displayed in a wallpaper setting interface. The wallpaper setting user interface provides users with an effective mechanism for viewing and navigating in the wake-up + home screen preview pairing more quickly, thereby reducing the number and / or duration of user interactions with the device, reducing wear on the device. Reducing the number and / or duration of user interactions with the device reduces wear on the device and reduces power consumption, thereby extending the battery life of the device.

[0266] For example, refer to Fig. 6A , the electronic device displays a wallpaper setting user interface 605 including an area 607 having a plurality of wake-up + home screen preview pairs 610, wherein a wake-up screen user interface and a home screen user interface preview pair 610B are currently displayed. According to some embodiments, the wake-up + home screen preview pair 610 corresponds to the above reference FIG. 5A to FIG. 5I The wake screen user interface and home screen user interface preview pair 610B includes media items 612 set as the background or wallpaper of the wake screen user interface based on the currently selected home screen processing option 616B (e.g., smart gradient) and media items 614A set as the background or wallpaper of the home screen user interface.

[0267] In some embodiments, when the first preview is displayed on the display, the device displays (918) a first enable representation on the display, which, when selected (e.g., using a single-click or double-click gesture), causes the current user interface with the first preview to be replaced with a media library editing user interface, which is provided to edit multiple media items associated with the media library user interface, wherein the media library user interface includes the first media item and the third media item. For example, each row in the editing interface includes a side-by-side preview of the wake+home screen and corresponds to a corresponding media item in the media library. The first enable representation provides the user with an effective mechanism for more quickly transitioning to the media library editing user interface, thereby reducing the number and / or duration of user interactions with the device, reducing wear on the device. Reducing the number and / or duration of user interactions with the device reduces wear on the device and reduces power consumption, thereby extending the battery life of the device.

[0268] For example, refer to Fig.6D , the wallpaper setting user interface 605 includes an edit affordance 608. Continuing with this example, in Fig. 6E In response to detecting the touch input 687, the electronic device selects Fig.6D The editing indicator 608 in the image is displayed to display the media library editing user interface 630. Fig. 6E As shown, the media library editing user interface 630 includes a plurality of wake-up + home screen preview pairing areas 635 associated with corresponding wake-up + home screen preview pairs 610. According to some embodiments, the media library editing user interface 630 includes a plurality of wake-up + home screen preview pairing areas 635 associated with the media items in the media library (e.g., Fig. 6E The wake+home screen preview pairing areas 635 are equal in number to the eight media items in the chrome area 633 in FIG. Continuing with this example, the wake+home screen preview pairing area 635B corresponds to the wake+home screen preview pairing 610B, which includes the media item 612 set as the wake screen user interface background or wallpaper and the media item 614A set as the home screen user interface background or wallpaper.

[0269] In some embodiments, when the first preview is displayed on the display, the device displays (920) a second enable representation on the display, which, when selected (e.g., using a single-click or double-click gesture), causes the current user interface with the first preview to be replaced with a media library addition user interface, which is provided to add one or more media items to multiple media items associated with the media library user interface, wherein the media library user interface includes the first media item and the third media item. In some embodiments, when a media item within the media library addition user interface is selected to be added to the media library user interface, the device displays a cropping user interface (e.g., similar to Fig. 6F 660 in the cropping user interface). For example, the cropping user interface enables the user to rotate, translate / move, or scale / zoom the media item to be added to the media library user interface. For example, the cropping user interface also includes parallax and real-time switching. The second affordance provides the user with an effective mechanism for more quickly transitioning to the media library add user interface, thereby reducing the number and / or duration of user interactions with the device, reducing wear and tear on the device. Reducing the number and / or duration of user interactions with the device reduces wear and tear on the device and reduces power consumption, thereby extending the battery life of the device.

[0270] For example, refer to Fig. 6A The wallpaper setting user interface 605 includes an add affordance 606, which, when selected (e.g., using a single-click or double-click gesture), causes the electronic device to display a media library add user interface (e.g., similar to a media library add user interface) for adding one or more media items to the media library. Fig. 7A 710).

[0271] In some embodiments, the device (922): detects subsequent user input via one or more input devices, the subsequent user input corresponding to a request to set a third media item as the background of the wake screen user interface; and in response to detecting the subsequent user input, simultaneously displays on the display a second preview of the third media item used as the background of the wake screen user interface and a second preview of the fourth media item used as the background of the main screen user interface. For example, the third media item corresponds to a modified version of the first media—cropped, translated, rotated, etc. For example, the third media item is different from the first media item. For example, Figure 6C and 6D A sequence is shown in which, in response to detecting a navigation gesture 685 , the first wake screen+home screen preview pair 610B is replaced by a second wake screen+home screen preview pair 610C.

[0272] It should be understood that Fig.9A and Fig. 9B The specific order in which the operations have been described in the description is merely exemplary and is not intended to indicate that the order is the only order in which the operations may be performed. A person of ordinary skill in the art will recognize a variety of ways to reorder the operations described herein. Additionally, it should be noted that the details of other processes described herein in conjunction with other methods described herein (e.g., methods 800 and 1100) are also applicable in a similar manner to the above with respect to Fig.9A and Fig. 9B Method 900 described. For example, the user input, user input gestures, media items, wake screen user interface, home screen user interface, background, and preview described above with reference to method 900 optionally have one or more features of the user input, and the user input gestures, media items, wake screen user interface, home screen user interface, background, and preview described herein with reference to other methods described herein (e.g., methods 800 and 1100). For the sake of brevity, these details are not repeated here.

[0273] The operations in the above information processing method are optionally implemented by running one or more functional modules in an information processing device, such as a general-purpose processor (e.g., Figure 1A , Figure 3 and Figure 5A described) or application-specific chips. In addition, the above reference Fig.9A and Fig. 9B The operation is optionally performed by Figure 1A and Figure 1B . For example, the user input, user input gesture, media item, wake screen user interface, home screen user interface, background and preview are optionally implemented by event classifier 170, event recognizer 180 and event handler 190. The event monitor 171 in the event classifier 170 detects contact on the touch-sensitive surface 451, and the event distributor module 174 delivers the event information to the application 136-1. The corresponding event recognizer 180 of the application 136-1 compares the event information with the corresponding event definition 186, and determines whether the first contact at the first position on the touch-sensitive surface corresponds to a predefined event or sub-event, such as a selection of an object on the user interface. When the corresponding predefined event or sub-event is detected, the event recognizer 180 activates the event handler 190 associated with the detection of the event or sub-event. The event handler 190 optionally utilizes or calls the data updater 176 or the object updater 177 to update the application internal state 192. In some embodiments, the event handler 190 accesses the corresponding GUI updater 178 to update the content displayed by the application. Similarly, those skilled in the art will clearly know that based on Figure 1A and Figure 1B How the components depicted in the figure can implement other processes.

[0274] FIG. 10A to FIG. 10AB An exemplary user interface for modifying a media item in a media library according to some embodiments is shown. The user interface in these figures is used to illustrate the following description including FIG. 11A to FIG. 11E Although some of the examples that follow will be given with reference to input on a touch screen display (in which a touch-sensitive surface and a display are combined), in some embodiments, the computing system detects input on a touch-sensitive surface 451 that is separate from the display 450, such as Figure 4B In some embodiments, user input is sometimes referred to herein as touch input or touch input gesture. In some embodiments, FIG. 10A to FIG. 10AB The user interface is presented or caused to be displayed by a computing system including non-volatile memory and one or more processors, wherein the computing system is communicatively coupled to a display device and one or more input devices.

[0275] Fig. 10A and 10B A sequence according to some embodiments is shown, wherein in response to detecting a touch input gesture, the wake screen user interface is replaced by the home screen user interface. Fig. 10A As shown, the computing system displays a wake screen user interface 1010 that includes a media item 1015 used as a background or wallpaper. Wake screen user interface 1010 also includes a plurality of foreground user interface objects—authentication indicator 1002, time and date indicator 1004, notifications 1006A and 1006B, flashlight enable representation 1008A, image capture enable representation 1008B, and home screen enable representation 1012.

[0276] According to some embodiments, when the computing system is operating in unlocked mode, the authentication indicator 1002 is represented by an open padlock, such as Fig. 10A According to some embodiments, when the computing system is operating in locked mode, the authentication indicator 1002 is represented by a closed padlock. For example, after the computing system authenticates the user based on successful entry of a PIN or other alphanumeric code, biometric information (e.g., a 3D face mesh or fingerprint), etc., the computing system operates in unlocked mode.

[0277] In some embodiments, when selected (e.g., using a single or double-click gesture, a tap and hold gesture, a deep press gesture, etc.), flashlight enable representation 1008A causes the computing system to illuminate a light-emitting element of the computing system (e.g., a flash component associated with a camera). In some embodiments, when selected (e.g., using a single or double-click gesture, a tap and hold gesture, a deep press gesture, etc.), image capture enable representation 1008B causes the computing system to replace display of wake screen user interface 1010 with an image capture user interface that is provided to capture an image using an inward-facing or outward-facing image sensor of the computing system.

[0278] like Fig. 10A As shown, the computing system detects a touch input gesture 1003 corresponding to an upward swipe originating from a location corresponding to home screen affordance 1012. In response to detecting Fig. 10A The computing system displays a touch input gesture 1003 in FIG. Fig. 10B In some embodiments, the computing system enables (or allows) a transition from the wake screen user interface 1010 to the home screen user interface 1020 while in the unlocked mode. Fig. 10B As shown, the computing system displays a home screen user interface 1020 that includes media items 1017 used as a background or wallpaper. The home screen user interface 1020 also includes a plurality of selectable application icons 1022 and a taskbar area 1026 having selectable application icons 1024A, 1024B, 1024C, and 1024D.

[0279] For example, media item 1017 corresponds to a smart gradient generated based on one or more visual attributes of media item 1015, which corresponds to Fig. 10A The background of the wake screen user interface 1010 is shown. In some embodiments, the one or more visual attributes correspond to the dominant hue / color on a pixel basis across the entire media item 1015, the average hue / color across the entire media item 1015, the average brightness across the entire media item 1015, the average saturation across the entire media item 1015, etc. Thus, continuing with the example, the media item 1017 includes multiple strips (vertical, horizontal, diagonal, etc.) associated with different hues of the dominant color within the media item 1015.

[0280] Fig. 10C and 10D A sequence is shown according to some embodiments, wherein in response to detecting touch input, the wake screen user interface is replaced by the media library user interface. Fig. 10CAs shown, the computing system detects touch input 1005 (e.g., a single or double-click gesture, a tap and hold gesture, a deep press, etc.) at a location corresponding to the background of wake screen user interface 1010 (e.g., a location that does not correspond to any foreground user interface object within wake screen user interface 1010). In response to detecting Fig. 10C The computing system displays a touch input 1005 in the Fig. 10D In some embodiments, the computing system enables (or allows) a transition from the wake screen user interface 1010 to the media library user interface 1030 while in the unlocked mode.

[0281] like Fig. 10D As shown, media library user interface 1030 includes media items 1015 and multiple foreground user interface objects, which include: exit enable representation 1019, which, when selected (e.g., using a single or double-click gesture), causes the computing system to replace media library user interface 1030 with a previous user interface (e.g., wake screen user interface 1010 without changing the background or wallpaper of wake screen user interface 1010); "more" enable representation 1036A, which, when selected (e.g., using a single or double-click gesture), causes the computing system to display an operation menu (e.g., Fig. 10S ); an “Edit” affordance 1036B which, when selected (e.g., using a single or double-click gesture), causes the computing system to use an editing user interface (e.g., Fig.10J 1040) for replacing media library user interface 1030 with an editing user interface 1040 in the media library, the editing user interface being used to at least one of add or remove a media item from a set of one or more media items in the media library; a plurality of paging points 1034 indicating a position of media item 1015 in a plurality of media items in the media library associated with media library user interface 1030; and a wallpaper indicator 1035 indicating that media item 1015 is the current background or wallpaper of wake screen user interface 1010. In some embodiments, in response to detecting an upward swipe gesture within media library user interface 1030 (etc.), the computing system replaces media library user interface 1030 with wake screen user interface 1010 without changing the background or wallpaper of wake screen user interface 1010.

[0282] In some embodiments, the paging points 1034 function as a swipe bar. In some embodiments, the computing system jumps to the beginning of the media items included in the media library user interface in response to detecting a tap gesture (etc.) directed to the leftmost paging point (or an area adjacent thereto). In some embodiments, the computing system jumps to the end of the media items included in the media library user interface in response to detecting a tap gesture (etc.) directed to the rightmost paging point (or an area adjacent thereto).

[0283] Fig. 10D and 10E A sequence is shown according to some embodiments, wherein in response to detecting a navigation gesture, a first media item is replaced by a second media item within the media library user interface. Fig. 10D As shown, the computing system detects touch input gesture 1007 (also sometimes referred to herein as a navigation gesture) corresponding to a right-to-left swipe at a location corresponding to the background of media library user interface 1030 (e.g., a location that does not correspond to any foreground user interface object within media library user interface 1030). In response to detecting Fig. 10D In the touch input gesture 1007, the computing system updates Fig. 10E , so that the media item 1025 is displayed as the background of the media library user interface 1030.

[0284] In response to detecting Fig. 10D The computing system also updates the plurality of paging points 1034 and uses Fig. 10E Wallpaper indicator 1035 is replaced by a “set of wallpapers” affordance 1065 in the wake screen user interface 1010, which, when selected (e.g., using a single-click or double-click gesture), causes the computing system to set media item 1025 as the background or wallpaper of wake screen user interface 1010. According to some embodiments, when “set wallpaper” affordance 1065 is selected, the computing system also sets a media item generated based on media item 1025 as the background or wallpaper of home screen user interface 1020 (e.g., as described above with reference to method 900, such as smart colors, smart gradients, smart patterns, etc.).

[0285] Fig. 10E and 10F A sequence is shown according to some embodiments, wherein in response to detecting a touch input, one or more foreground user interface objects within the media library user interface are stopped from being displayed. Fig. 10EAs shown, the computing system detects touch input 1009 (e.g., a single or double-click gesture, a tap and hold gesture, a deep press, etc.) at a location corresponding to the background of media library user interface 1030 (e.g., a location that does not correspond to any foreground user interface object within media library user interface 1030). In response to detecting Fig. 10E The computing system stops displaying the touch input 1009 in the Fig.10F According to some embodiments, the computing system stops displaying the foreground user interface object within the media library user interface 1030 after a determined timeout period (e.g., 10 seconds) expires.

[0286] Fig.10F and 10G A sequence is shown according to some embodiments in which, in response to detecting a touch input, one or more foreground user interface objects are redisplayed within a media library user interface. Fig.10F As shown, the computing system detects touch input 1011 (e.g., a single or double-click gesture, a tap and hold gesture, a deep press, etc.) at a location corresponding to the background of the media library user interface 1030. In response to detecting Fig.10F The computing system performs touch input 1011 in Figure 10G The foreground user interface object is redisplayed within the media library user interface 1030 in .

[0287] Figure 10G and 10H A sequence according to some embodiments is shown, wherein in response to a selection input, the second media item is set as the background of the wake screen user interface, and the media library user interface is replaced by the wake screen user interface. Figure 10G As shown, the computing system detects touch input 1013 (e.g., a tap gesture) at a location corresponding to a “set wallpaper” affordance 1065 within media library user interface 1030. In response to detecting Figure 10G The computing system redisplays the touch input 1013 in Fig. 10H 100 includes a wake screen user interface 1010 with media items 1025 as its background or wallpaper.

[0288] Fig. 10C and 10I An alternative sequence according to some embodiments is shown, in which in response to detecting touch input, the wake screen user interface is replaced by the media library user interface. Fig. 10CAs shown, the computing system detects touch input 1005 (e.g., a single or double-click gesture, a tap and hold gesture, a deep press, etc.) at a location corresponding to the background of wake screen user interface 1010 (e.g., a location that does not correspond to any foreground user interface object within wake screen user interface 1010). In response to detecting Fig. 10C The computing system displays a touch input 1005 in the Fig.10I 1030 in the media library user interface.

[0289] Fig.10I Another state of the media library user interface 1030 is shown, whereby a single media item (e.g., media item 1015) is currently associated with the media library. Fig.10I , the computing system displays prompt 1071 requesting the user to add a media item to his / her media library. Fig.10I As shown, prompt 1071 includes an exit enable indication 1073, which, when selected (e.g., using a single or double-click gesture), causes the computing system to eliminate prompt 1071.

[0290] Fig.10I and 10J A sequence is shown according to some embodiments, wherein the media library user interface is replaced by an editing user interface for at least one of adding or removing media items from the set of one or more media items in the media library. Fig.10I As shown, the computing system detects touch input 1031 (e.g., a tap gesture) at a location corresponding to “edit” affordance 1036B within media library user interface 1030. In response to detecting Fig.10I The computing system displays a touch input 1031 in the Fig.10J 1040 in the editing user interface.

[0291] like Fig.10J As shown, the editing user interface 1040 includes an indication 1028 of the current number of media items included in the media library and the maximum number of media items that the media library can hold (e.g., 1 media item out of a possible 24 media items). One of ordinary skill in the art will appreciate that the current number of media items associated with the media library and the limit of possible media items associated with the media library are merely examples and may be replaced with other values ​​in various other embodiments.

[0292] Editing user interface 1040 also includes media item 1015 and an indication that media item 1015 corresponds to the current wallpaper or background of wake screen user interface 1010, metadata associated with media item 1015 (e.g., location where media item 1015 was captured, time and date when media item 1015 was captured, etc.), and an indication of the media type or classification associated with media item 1015 (e.g., live image, still image, video, slideshow, etc.). In addition, as Fig.10J As shown, editing user interface 1040 also includes a first editing affordance 1029 (e.g., as shown in FIG. 1 ) for initiating a process for adding one or more media items to the media library. FIG. 10J to FIG. 10N 1021A) and a second edit affordance 1021A for initiating a process for removing media item 1015 from the media library. Fig.10J As shown, the editing user interface 1040 also includes a reorder handle 1023A, which, when selected (eg, using a single or double click and drag gesture), enables a user to reorder the media items included in the media library.

[0293] FIG. 10J to FIG. 10N A sequence is shown according to some embodiments in which two media items are added to the media library. Fig.10J As shown, the computing system detects touch input 1033 (e.g., a single-click or double-click gesture) at a location corresponding to first edit-enabled representation 1029 within editing user interface 1040. In response to detecting Fig.10J The computing system displays a touch input 1033 in the Figure 10K 1050 of the media item picker user interface.

[0294] like Figure 10K As shown, media item picker user interface 1050 includes wallpaper suggestions 1054A, 1054B, and 1054C (sometimes collectively referred to herein as "wallpaper suggestions 1054") that include media items shown with the wallpaper or background having the wake screen user interface having the foreground user interface object overlaid thereon. In some embodiments, the user is able to view additional wallpaper suggestions 1054 by scrolling right within media item picker user interface 1050. Figure 10K As shown, media item picker user interface 1050 also includes selectable media items 1056A, 1056B, 1056C, 1056D, 1056E, 1056F, 1056G, and 1056H (sometimes collectively referred to herein as "media items 1056") that can be used to add to the media library. In some embodiments, the user can view additional selectable media items by scrolling down within media item picker user interface 1050.

[0295] In some embodiments, the computing system selects media items associated with wallpaper suggestion 1054 from the user's camera roll (e.g., a local and / or remotely stored repository of the user's media content) based on predefined logic (such as recently viewed media items, most frequently viewed media items, content / objects within media items relevant to the user (based on semantic segmentation), metadata associated with media items relevant to the user (based on date, location, people / animals identified within media items, etc.), etc. In some embodiments, the media items associated with wallpaper suggestion 1054 are cropped, scaled, and / or similar so that the one or more foreground user interface objects and the time / date associated with the wake screen user interface do not obscure important features of the media items, such as people, faces, landmarks, animals, etc. In some embodiments, the media items associated with wallpaper suggestion 1054 correspond to system wallpaper.

[0296] In some embodiments, the media items associated with wallpaper suggestions 1054 correspond to images that are specifically selected by the OS as good wallpaper candidates based on wallpaper criteria (or machine learning (ML) intelligence) that is different from the criteria used to populate the “Personalized” tab in the media item viewing application (e.g., as shown in FIG. Figure 10U ). For example, the media items associated with wallpaper suggestion 1054 include a different set of media items than the media items suggested in the media item viewing application (e.g., having one or more overlapping media items or mutually exclusive sets of media items). As another example, the media items associated with wallpaper suggestion 1054 are the same as the media items suggested in the media item viewing application, but are cropped differently to fit the wake screen user interface.

[0297] like Figure 10K As shown, media item picker user interface 1050 also includes: a cancel enable indication 1052A, which, when selected (e.g., using a single or double-click gesture), causes the computing system to replace the display of media item picker user interface 1050 with edit user interface 1040; and an add enable indication 1052B, which, when selected (e.g., using a single or double-click gesture), causes the computing system to add the currently selected media item 1056 to the media library. Figure 10K As shown, media item picker user interface 1050 also includes indicator 1058A associated with "All Photos" (currently selected, as shown by the fill within indicator 1058A), and indicator 1058B associated with "Albums". Figure 10K As shown, the media item picker user interface 1050 also includes a search field 10151 that enables the user to search for media items within his / her locally and / or remotely stored media items, camera roll, etc.

[0298] like Figure 10K As shown, the computing system detects touch input 1037 (e.g., a single-click or double-click gesture) at a location corresponding to a media item 1056H within the media item picker user interface 1050. In response to detecting Figure 10K The computing system displays a touch input 1037 in the Fig.10L 1056H and a text indicator 1091 is provided to indicate a count of currently selected media items (eg, one media item currently selected).

[0299] like Fig.10L As shown, the computing system detects touch input 1039 (e.g., a single-click or double-click gesture) at a location corresponding to media item 1056F within media item picker user interface 1050. In response to detecting Fig.10L In response to touch input 1039 in the display, the computing system displays a selection indicator 1059B overlaid on media item 1056F and also updates Figure 10M 1091 (eg, the two media items currently selected).

[0300] like Figure 10M As shown, the computing system detects touch input 1041 (e.g., a single-click or double-click gesture) at a location corresponding to add affordance 1052B within media item picker user interface 1050. In response to detecting Figure 10M The computing system uses touch input 1041 in Fig.10N The editing user interface 1040 in replaces the display of the media item picker user interface 1050 and adds media items 1056F and 1056H to the media library.

[0301] like Fig.10N As shown, the editing user interface 1040 includes an updated indication 1028 of the current number of media items included in the media library and the maximum number of media items that the media library can hold (e.g., 3 media items out of a possible 24 media items). Fig.10N As shown, the editing user interface 1040 also includes the media item 1015 and an indication that the media item 1015 corresponds to the current wallpaper or background of the wake screen user interface 1010, metadata associated with the media item 1015 (e.g., the location where the media item 1015 was captured, the time and date when the media item 1015 was captured, etc.), and an indication of the media type or classification associated with the media item 1015 (e.g., a real-time image, a still image, a video, a slideshow, etc.).

[0302] like Fig.10NAs shown, the editing user interface 1040 also includes: a media item 1056H and metadata associated with the media item 1056H (e.g., the location where the media item 1056H was captured, the time and date when the media item 1015 was captured, etc.) and an indication of a media type or classification associated with the media item 1056H (e.g., a real-time image, a still image, a video, a slideshow, etc.); and a media item 1056F and metadata associated with the media item 1056F (e.g., the location where the media item 1056F was captured, the time and date when the media item 1015 was captured, etc.) and an indication of a media type or classification associated with the media item 1056F (e.g., a real-time image, a still image, a video, a slideshow, etc.). In addition, as shown in FIG. Fig.10N As shown, editing user interface 1040 also includes a first editing affordance 1029 (e.g., FIG. 10J to FIG. 10N ) and second edit affordances 1021A, 1021B, and 1021C for initiating a process for removing corresponding media items 1015, 1056H, and 1056F from the media library, respectively. Fig.10N As shown, the editing user interface 1040 also includes handles 1023A, 1023B, and 1023C for reordering corresponding media items 1015, 1056H, and 1056F within the media library, respectively.

[0303] Fig.10J , Figure 10K and Figures 10O to 10R A sequence is shown according to some embodiments in which a single media item is added to a media library. Figure 10K The computing system displays a touch input 1037 in the Fig.10O 1056H and a text indicator 1091 provided to indicate a count of the currently selected media items (e.g., one media item currently selected). Fig.10O As shown, the computing system detects touch input 1043 (e.g., a single-click or double-click gesture) at a location corresponding to add affordance 1052B within media item picker user interface 1050. In response to detecting Fig.10O The computing system uses touch input 1043 in Figure 10P The cropping user interface 1060 in replaces the display of the media item picker user interface 1050 and adds the media item 1056H to the media library.

[0304] like Figure 10PAs shown, the computing system displays a cropping user interface 1060 provided to modify a media item 1056H. For example, when the computing system displays the cropping user interface 1060, the user can move or translate the media item 1056H, rotate the media item 1056H, scale or view zoom the media item 1056H, etc. The cropping user interface 1060 includes: a cancel affordance 1038A, which, when selected (e.g., using a single or double-click gesture), causes the computing system to eliminate the cropping user interface 1060 without applying changes to the media item 1056H; and a completion affordance 1038B, which, when selected (e.g., using a single or double-click gesture), causes the computing system to eliminate the cropping user interface 1060 and apply the changes made by the user to the media item 1056H. In this example, the cropping user interface 1060 also includes a live / static image toggle 1062A and a perspective toggle 1062B.

[0305] like Figure 10P As shown, the computing system detects touch input 1045 (e.g., a single-click or double-click gesture) at a location corresponding to completion affordance 1038B within cropping user interface 1060. In response to detecting Figure 10P The computing system displays a touch input 1045 in the Figure 10Q The prompt area 1063 on the cropping user interface 1060 in FIG. For example, the prompt area 1063 slides on the cropping user interface 1060 from the bottom edge of the cropping user interface 1060.

[0306] like Figure 10Q As shown, the prompt area 1063 includes: a first enable indication 1064A, which, when selected (for example, using a single-click or double-click gesture), causes the computing system to set the media item 1056H at the wallpaper or background of the wake-up screen user interface 1010 and add the media item 1056H to the media library; a second enable indication 1064B, which, when selected (for example, using a single-click or double-click gesture), causes the computing system to add the media item 1056H to the media library (without setting the media item 1056H at the wallpaper or background of the wake-up screen user interface 1010); and a cancel enable indication 1064C, which, when selected (for example, using a single-click or double-click gesture), causes the computing system to eliminate the prompt area 1063.

[0307] like Figure 10Q As shown, the computing system detects touch input 1047 (e.g., a single-click or double-click gesture) at a location corresponding to first affordance 1064A within prompt area 1063. In response to detecting Figure 10QIn response to detecting touch input 1047 in the wake screen user interface 1010, the computing system sets media item 1056H at the wallpaper or background of the wake screen user interface 1010 and adds media item 1056H to the media library. Figure 10Q The computing system uses touch input 1047 in Figure 10R The media library user interface 1030 in replaces the display of the crop user interface 1060.

[0308] like Figure 10R As shown, media library user interface 1030 includes media items 1056H and multiple foreground user interface objects, which include: exit enable representation 1019, which, when selected (e.g., using a single or double-click gesture), causes the computing system to replace media library user interface 1030 with wake screen user interface 1010 without changing the background or wallpaper of wake screen user interface 1010; "more" enable representation 1036A, which, when selected (e.g., using a single or double-click gesture), causes the computing system to display an operation menu (e.g., Fig. 10S ); an “Edit” affordance 1036B which, when selected (e.g., using a single or double-click gesture), causes the computing system to use an editing user interface (e.g., Fig.10J The wake screen user interface 1010 includes an editing user interface 1040 that replaces the media library user interface 1030, the editing user interface being used to add or remove at least one of media items from a set of one or more media items in the media library; a plurality of paging points 1034 that indicate the position of the media item 1056H among the plurality of media items in the media library associated with the media library user interface 1030; and a wallpaper indicator 1035 that indicates that the media item 1056H is the current background or wallpaper of the wake screen user interface 1010.

[0309] Figure 10R and 10S A sequence is shown according to some embodiments, wherein the computing system displays an operation menu. Figure 10R As shown, the computing system detects touch input 1049 (e.g., a single-click or double-click gesture) at a location corresponding to “more” affordance 1036A within media library user interface 1030. In response to detecting Figure 10R The computing system displays a touch input 1049 in Fig. 10S The operation menu 10141 is overlaid on the media library user interface 1030. For example, the operation menu 10141 slides from the bottom edge of the media library user interface 1030 on the media library user interface 1030.

[0310] like Fig. 10S As shown, the operation menu 10141 includes: an exit enable indication 1067, which, when selected (e.g., using a single-click or double-click gesture), causes the computing system to eliminate the operation menu 10141; and a preview of the media item 1056H and metadata associated with the media item 1056H (e.g., the location at which the media item 1056H was captured, the time and date at which the media item 1015 was captured, etc.), and an indication of the media type or classification associated with the media item 1056H (e.g., a real-time image, a still image, a video, a slideshow, etc.).

[0311] like Fig. 10S As shown, operation menu 10141 also includes: an enable representation 1066A, which, when selected (e.g., using a single or double-click gesture), causes the computing system to display a sharing menu that includes multiple options or modes for sharing media item 1056H; an enable representation 1066B, which, when selected (e.g., using a single or double-click gesture), causes the computing system to display a cropping user interface 1060 (e.g., such as a cropping user interface 1060 provided to modify media item 1056H); Figure 10P ); an affordance 1066C which, when selected (e.g., using a single-click or double-click gesture), causes the computing system to display an editing user interface 1040 (e.g., as shown) provided for modifying media items included in the media library. Fig.10J ); an affordance 1066D which, when selected (e.g., using a single or double-click gesture), causes the computing system to open the media item 1056H within the media item viewing application (e.g., as shown); Figure 10T and an affordance 1066E, which, when selected (eg, using a single-click or double-click gesture), causes the computing system to display a wallpaper setting user interface 1090 (eg, as Figure 10V shown).

[0312] Fig. 10S and 10T A sequence is shown according to some embodiments, wherein an affordance associated with opening a media item within a media item viewing application is selected from the action menu. Fig. 10S As shown, the computing system detects touch input 1053 (e.g., a single-click or double-click gesture) at a location corresponding to affordance 1066D within action menu 10141. Fig. 10S The computing system performs touch input 1053 in Figure 10T The media item 1056H is displayed in the "Album" tab 1070 of the media item viewing application in FIG. Figure 10TAs shown, media item 1056H is displayed within an "Albums" tab 1070 of the media item viewing application along with other media items associated with a "Home" album of media items.

[0313] like Figure 10T As shown, the “Albums” tab 1070 of the media item viewing application includes a plurality of media items 1074A, 1074B, 1074C, 1074D, 1074H, 1074F, 1074G, 1074H, and 1074I associated with a “Home” album of media items. Figure 10T As shown, the “Albums” tab 1070 of the media item viewing application also includes a return affordance 1072A that, when selected (e.g., using a single or double-click gesture), causes the computing system to return to the previous user interface (e.g., Figure 10R 1030) replaces the display of the "Albums" tab 1070 of the media item viewing application; and a selection affordance 1072A provided to select a media item associated with the "home" album of media items. Figure 10T As shown, the "Albums" tab 1070 of the media item viewing application also includes indicators 1076A, 1076B, 1076C, and 1076D corresponding to the Photos, "Personal," Albums, and Search tabs of the media item viewing application, respectively. Figure 10T , the “Albums” tab 1070 of the media item viewing application is currently selected, as indicated by the fill within indicator 1076C.

[0314] Figure 10T and 10U A sequence is shown according to some embodiments, wherein the computing system displays the “Personalized” tab of the media item viewing application. Figure 10T As shown, the computing system detects touch input 1055 (e.g., a single-click or double-click gesture) at a location corresponding to indicator 1076B associated with the "Personal" tab 1080 of the media item viewing application. Figure 10T The touch input 1055 in the computing system displays Figure 10U The media item in the "Personal" tab 1080 of the viewing application.

[0315] like Figure 10U As shown, the “Personal” tab 1080 of the media item viewing application includes a first memory collection 1082 (e.g., associated with other media items taken on the same day in the past few years), and other memory collections 1084A, 1084B, and 1084C. Figure 10UAs shown, the "Personal" tab 1080 of the media item viewing application also includes wallpaper suggestions 1054, which include media items displayed as wallpaper or background of the wake screen user interface with the foreground user interface objects overlaid thereon. In some embodiments, the user can view additional wallpaper suggestions 1054 by scrolling right within the "Personal" tab 1080 of the media item viewing application. Figure 10U , the “Personal” tab 1080 of the media item viewing application is currently selected, as indicated by the fill within indicator 1076B.

[0316] In some embodiments, the computing system selects media items associated with wallpaper suggestion 1054 from the user's camera roll (e.g., a local and / or remotely stored repository of the user's media content) based on predefined logic (such as recently viewed media items, most frequently viewed media items, content / objects within media items relevant to the user (based on semantic segmentation), metadata associated with media items relevant to the user (based on date, location, people / animals identified within media items, etc.), etc. In some embodiments, the media items associated with wallpaper suggestion 1054 are cropped, scaled, and / or similar so that the one or more foreground user interface objects and the time / date associated with the wake screen user interface do not obscure important features of the media items, such as people, faces, landmarks, animals, etc. In some embodiments, the media items associated with wallpaper suggestion 1054 correspond to system wallpaper.

[0317] Figure 10V and 10W A sequence is shown according to some embodiments, wherein an affordance associated with opening a wallpaper settings user interface is selected from an action menu. Figure 10V As shown, the computing system detects touch input 1057 (e.g., a single-click or double-click gesture) at a location corresponding to affordance 1066E within operation menu 10141. In response to detecting Figure 10V The touch input 1057 in the computing system displays Figure 10W Wallpaper setting user interface 1090 in Fig. 6A Wallpaper settings user interface 605 is shown).

[0318] like Figure 10W As shown, the wallpaper setting user interface 1090 includes multiple wake-up screen user interfaces and home screen user interface preview pairs 1094a, 1094b, ... (sometimes collectively referred to herein as "wake-up + home screen preview pairs 1094"). Figure 10W, wake+home screen preview pair 1094A includes media item 1056H as a wallpaper or background for wake screen user interface 1010, and media item 1093 (e.g., a smart gradient generated from media item 1056H) as a wallpaper or background for home screen user interface 1020. In this example, media item 1056H is the current wallpaper or background for wake screen user interface 1010, and home screen handling option 1096C (e.g., the smart gradient option) is currently selected, as indicated by the fill within home screen handling option 1096C.

[0319] According to some embodiments, wake-up + home screen preview pairing 1094 corresponds to the above reference Fig. 10D and Fig. 10E The wallpaper settings user interface 1090 also includes selectable home screen handling options 1096A, 1096B, 1096C, 1096D, and 1096E (also sometimes collectively referred to herein as "home screen handling options 1096"), which, when selected (e.g., using a single or double-click gesture), cause the computing system to update the media items displayed as the background or wallpaper of the home screen user interface 1020 within the currently selected wake screen user interface and home screen user interface preview pair 1094A. For example, the home screen handling option 1096E enables the user to select an image to be used as the background of the home screen user interface that is different from the current image used as the background of the wake screen user interface (e.g., by turning on Figure 10K Media item selector user interface 1050 shown).

[0320] For example, media item 1093 corresponds to a smart gradient generated based on one or more visual attributes of media item 1056H, which corresponds to the background of wake screen user interface 1010. In some embodiments, the one or more visual attributes correspond to the dominant hue / color on a pixel basis across media item 1056H, the average hue / color across media item 1056H, the average brightness across media item 1056H, the average saturation across media item 1056H, etc. Thus, continuing with the example, media item 1093 includes multiple strips (vertical, horizontal, diagonal, etc.) associated with different hues of the dominant color within media item 1056H. In some embodiments, a smoothing or blending operation is performed between each of the multiple strips.

[0321] like Figure 10W As shown, wallpaper setting user interface 1090 also includes: "Select wallpaper" enable representation 1092A, which "Select wallpaper" enable representation when selected (for example, using a single or double-click gesture) causes the computing system to display Figure 10XWallpaper picker user interface 10100 shown; and edit affordance 1092B, which, when selected (e.g., using a single or double-click gesture), causes the computing system to display Fig.10J An editing user interface 1040 is shown for modifying media items included in a media library. Figure 10W As shown, the wallpaper setting user interface 1090 also includes: a return enable representation 1098A, which, when selected (for example, using a single-click or double-click gesture), causes the computing system to display the previous user interface (for example, Figure 10R and a completion affordance 1098B which, when selected (e.g., using a single-click or double-click gesture), causes the computing system to eliminate the wallpaper setting user interface 1090 (e.g., as Figure 10Y and Figure 10Z shown).

[0322] Figure 10W and 10X A sequence is shown according to some embodiments, wherein the computing system displays a wallpaper picker user interface. Figure 10W As shown, the computing system detects touch input 1075 (e.g., a single-click or double-click gesture) at a location corresponding to a "select wallpaper" affordance 1092A within wallpaper setting user interface 1090. In response to detecting Figure 10W The computing system displays a touch input 1075 in Figure 10X Wallpaper picker user interface 10100 in .

[0323] like Figure 10X As shown, the wallpaper picker user interface 10100 includes: a media library area 10102, the media library area having a plurality of preview representations 10111 of media items from the media library, the plurality of preview representations being shown as the background or wallpaper of the wake screen user interface with the foreground user interface object overlaid thereon; and an "add media item" enable representation 10106, the "add media item" enable representation, when selected (e.g., using a single or double-click gesture), causing the computing system to display Fig.10J An editing user interface 1040 is shown for modifying media items included in the media library. Figure 10X As shown, wallpaper picker user interface 10100 also includes system wallpapers 10104A, 10104B, 10104C, and 10104D (sometimes collectively referred to herein as "system wallpapers 10104"), which include media items that are shown as wallpapers or backgrounds of the wake screen user interface. In some embodiments, the user can view additional system wallpapers 10104 by scrolling right within wallpaper picker user interface 10100. Figure 10XAs shown, wallpaper picker user interface 10100 also includes an exit enable representation 1019, which, when selected (e.g., using a single or double-click gesture), causes the computing system user to exit. Figure 10W The wallpaper setting user interface 1090 replaces the wallpaper picker user interface 10100.

[0324] Figure 10X and 10Y A sequence is shown according to some embodiments in which a system wallpaper from the wallpaper picker user interface is selected as a new wallpaper or background for the wake screen user interface. Figure 10X As shown, the computing system detects touch input 1061 (e.g., a single-click or double-click gesture) at a location corresponding to system wallpaper 10104B within wallpaper picker user interface 10100. In response to detecting Figure 10X The computing system displays a touch input 1061 in the Figure 10Y The wallpaper setting user interface 1090 in FIG.

[0325] like Figure 10Y As shown, wallpaper setting user interface 1090 includes wake+home screen preview pair 1094C, where system wallpaper 10104B is set as the wallpaper or background of wake screen user interface 1010, and system wallpaper 10104B is also the wallpaper or background of home screen user interface 1020. In this example, system wallpaper 10104B is the current wallpaper or background of wake screen user interface 1010, and home screen handling option 1096A (e.g., mirroring option) is currently selected, as indicated by the fill within home screen handling option 1096A.

[0326] Figure 10Y and 10Z A sequence according to some embodiments is shown, wherein the wake screen user interface replaces the wallpaper setting user interface. Figure 10Y As shown, the computing system detects touch input 1063 (e.g., a single-click or double-click gesture) at a location corresponding to completion affordance 1098B within wallpaper setting user interface 1090. In response to detecting Figure 10Y The computing system displays a touch input 1063 in Figure 10Z In the wake-up screen user interface 1010, the system wallpaper 10104B is used as the wallpaper or background. Figure 10Z , system wallpaper 10104B is the wallpaper or background of the wake screen user interface 1010 with the foreground user interface objects overlaid thereon.

[0327] Figure 10Z and 10AAA sequence is shown according to some embodiments, wherein in response to detecting touch input, the wake screen user interface is replaced by the media library user interface. Figure 10Z As shown, the computing system detects touch input 10101 (e.g., a single or double-click gesture, a tap and hold gesture, a deep press, etc.) at a location corresponding to the background of wake screen user interface 1010 (e.g., a location that does not correspond to any foreground user interface object within wake screen user interface 1010). In response to detecting Figure 10Z The computing system displays a touch input 10101 in Figure 10AA In some embodiments, the computing system enables (or allows) a transition from the wake screen user interface 1010 to the media library user interface 1030 while in the unlocked mode.

[0328] Figure 10AA and 10AB A sequence is shown according to some embodiments in which, in response to detecting a touch input, one or more foreground user interface objects are redisplayed within a media library user interface. Figure 10AA As shown, the computing system detects touch input 10103 (e.g., a single or double-click gesture, a tap and hold gesture, a deep press, etc.) at a location corresponding to the background of the media library user interface 1030. In response to detecting Figure 10AA The touch input 10103 in the computing system Fig.10AB In some embodiments, when system wallpaper 10104B is set as the wallpaper or background of wake screen user interface 1010, the computing system disables the ability to provide navigation input in media library user interface 1030 to navigate between media items in the media library.

[0329] FIG. 11A to FIG. 11E 1 shows a flowchart of a method 1100 for modifying a media item in a media library according to some embodiments. The method 1100 is performed in a computing system (e.g., Figure 1A The portable multifunction device 100 or Figure 3 The method 1100 may be performed in a device 300 in which the computing system is communicatively coupled to a display device and one or more input devices. In some embodiments, the display device is a touch screen display, and the one or more input devices are located on the display or integrated with the display. In some embodiments, the display device is separated from the one or more input devices. Some operations in method 1100 are optionally combined, and / or the order of some operations is optionally changed.

[0330] As described below, method 1100 provides an intuitive way to modify media items in a media library. The method reduces the cognitive burden on the user when modifying the media library, thereby creating a more efficient human-computer interface. For battery-powered computing systems, enabling users to modify media items in the media library faster and more efficiently saves power and increases the time interval between battery charges.

[0331] The computing system displays (1102) via the display device a wake-up screen user interface, the wake-up screen user interface including a first media item used as a background of the wake-up screen user interface and one or more foreground user interface objects displayed above the first media item; for example, Fig. 10A As shown, the computing system displays a wake screen user interface 1010 that includes a media item 1015 used as a background or wallpaper. Wake screen user interface 1010 also includes multiple foreground user interface objects—authentication indicator 1002, time and date indicator 1004, notifications 1006A and 1006B, flashlight enable representation 1008A, image capture enable representation 1008B, and home screen enable representation 1012. For example, one or more user interface objects correspond to the time and date indicator, notifications, flashlight and camera enable representations, home screen enable representation, etc. (e.g., as shown in FIG. 1 ). Fig. 10A and Fig. 10C For example, the first media item may be a real-time photo, a still photo, a video clip, a slideshow of photos, etc.

[0332] As an example, Fig. 10C and 10D A sequence according to some embodiments is shown, wherein in response to detecting a touch input, the wake screen user interface 1010 is replaced by the media library user interface 1030. In some embodiments, in response to detecting a previous user input corresponding to a voice command, a double-click gesture, a long press, a deep press, etc. when displaying the wake screen user interface, the media library user interface replaces the wake screen user interface. In some embodiments, the media library user interface includes multiple media items in a customizable media library. In some embodiments, the multiple media items are selected by the user. In some embodiments, the multiple media items in the customizable media library are populated based on the most frequently viewed media items in the user's camera roll, the media items recently added to the user's camera roll, etc.

[0333] The media library user interface provides an efficient mechanism for the user to more quickly change the background or wallpaper of the wake screen user interface and / or the home screen user interface, thereby reducing the number and / or duration of user interactions with the device. Reducing the number and / or duration of user interactions with the device reduces wear and tear on the device and reduces power consumption, thereby extending the battery life of the device.

[0334] While displaying the first media item serving as a background for the wake screen user interface, the computing system detects (1104) a user input via the one or more input devices, the user input corresponding to a request to edit a media item from a set of media items in a media library accessible from the wake screen interface, wherein the set of one or more media items includes at least the first media item. As an example, Fig.10I and 10J A sequence according to some embodiments is shown, wherein a media library user interface (1030) is replaced by an editing user interface (1040) for adding or removing at least one of media items from the group of one or more media items in the media library. In some embodiments, the computing system continues to display at least a portion of the first media item before the input is detected. In some embodiments, the computing system continues to display at least a portion of the first media item before and after the input is detected. In some embodiments, the user input corresponds to a selection of an "edit" affordance within the media library user interface.

[0335] In response to detecting the user input, the computing system (1106) displays, via the display device, an editing user interface for at least one of adding or removing the set of one or more media items from the media library. Fig.10J As shown, the editing user interface 1040 includes an indication 1028 of the current number of media items included in the media library and the maximum number of media items that the media library can hold (eg, 1 media item out of a possible 24).

[0336] In some embodiments, the editing user interface (1108) includes at least one of the following: a first editing enable indication and one or more second editing enable indications, the first editing enable indication being used to initiate a process for adding one or more media items to the media library, and the one or more second editing enable indications being used to initiate a process for removing associated media items included in the media library. As an example, Fig.10J As shown, the editing user interface 1040 includes a first editing affordance 1029 (e.g., as shown in FIG. 1 ) for initiating a process for adding one or more media items to the media library. FIG. 10J to FIG. 10N 1021A) and a second edit affordance 1021A for initiating a process for removing media items 1015 from the media library. In some embodiments, the media library edit user interface corresponds to a form that slides on the media library user interface. In some embodiments, the process for removing media items can be automatic or include additional confirmation steps. In some embodiments, the process for adding media items can include a media item picker user interface.

[0337] The editing user interface enables a user to quickly modify media items within the media library, thereby reducing the number and / or duration of user interactions with the device, reducing wear and tear on the device. Reducing the number and / or duration of user interactions with the device reduces wear and tear on the device and, for battery-powered devices, extends the battery life of the device.

[0338] In some embodiments, the computing system (1110) detects a second user input via the one or more input devices, the second user input corresponding to a selection of the first editing-enabled representation; and in response to detecting the second user input, replaces display of the editing user interface with a media item picker user interface that includes representations of one or more media items that can be used to add to the media library. As an example, Fig.10J and 10K A sequence is shown in which the computing system replaces the editing user interface 1040 with the media item picker user interface 1050 in response to selection of the first editing-enabled representation 1029 within the editing user interface 1040.

[0339] In some embodiments, if a single media item is selected from the media item picker user interface, the device then displays a cropping user interface (e.g., Fig.10J , Figure 10K and Figures 10O to 10R In some embodiments, if two or more media items are selected from the media item picker user interface, the computing system redisplays the media library user interface (and abandons displaying the cropping user interface) (e.g., as shown in FIG. 1 ). FIG. 10J to FIG. 10N shown).

[0340] In some embodiments, the media item picker user interface includes (1112) suggested media items for adding to the media library. Figure 10K As shown, media item picker user interface 1050 includes wallpaper suggestions 1054A, 1054B, and 1054C (sometimes collectively referred to herein as "wallpaper suggestions 1054") that include media items shown with the wallpaper or background having the wake screen user interface having the foreground user interface object overlaid thereon. In some embodiments, the user is able to view additional wallpaper suggestions 1054 by scrolling right within media item picker user interface 1050. Figure 10KAs shown, media item picker user interface 1050 also includes selectable media items 1056A, 1056B, 1056C, 1056D, 1056E, 1056F, 1056G, and 1056H (sometimes collectively referred to herein as "media items 1056") that can be used to add to the media library. In some embodiments, the user can view additional selectable media items by scrolling down within media item picker user interface 1050.

[0341] The suggested media items enable the user to quickly add high-quality (e.g., pre-scaled and pre-cropped) media items to the media library, thereby reducing the number and / or duration of user interactions with the device, reducing wear on the device. Reducing the number and / or duration of user interactions with the device reduces wear on the device and, for battery-powered devices, extends the battery life of the device.

[0342] In some embodiments, the computing system selects the suggestion from the user's camera roll (e.g., a local and / or remotely stored repository of the user's media content) based on predefined logic (such as recently viewed media items, most frequently viewed media items, content / objects within media items relevant to the user (based on semantic segmentation), metadata associated with media items relevant to the user (based on date, location, people / animals identified within media items, etc.), etc. In some embodiments, the suggestion is cropped, scaled, etc., so that the one or more foreground user interface objects and time / date associated with the wake screen user interface do not obscure important features of the suggested media items, such as people, faces, landmarks, animals, etc. In some embodiments, the suggestion corresponds to a system wallpaper.

[0343] In some embodiments, the suggestions include images that are specifically selected by the computing system (or an OS associated therewith) as good wallpaper candidates based on wallpaper criteria (or ML intelligence) that are different from the criteria used to populate the "Personal" tab in the image viewing application (e.g., such as Figure 10U For example, the suggestion includes a different group of media items than the media items suggested in the image viewing application (e.g., having one or more overlapping media items or mutually exclusive groups of media items). As another example, the suggestion is the same as the media items suggested in the image viewing application, but is cropped differently to fit the wake screen user interface.

[0344] In some embodiments, the suggested media items are displayed (1114) on a representation of the wake screen user interface that includes the one or more foreground user interface objects associated with the wake screen user interface. Figure 10KAs shown, media item picker user interface 1050 includes wallpaper suggestions 1054 with various media items, which are shown as wallpaper or background of the wake screen user interface with the foreground user interface object overlaid thereon. In some embodiments, the representation is cropped / displayed according to the aspect ratio of the display device. In some embodiments, the representation includes a date and time (which may be the current date and time).

[0345] In some embodiments, the computing system (1116) detects, via the one or more input devices, a third user input that selects a second media item from the media item picker user interface; and in response to detecting the third user input, displays, via the display device, a cropping user interface that is provided to perform one or more modification operations on the second media item, wherein the cropping user interface includes a completion affordance that is provided to remove the cropping user interface. For example, Figure 10P As shown, the computing system displays a cropping user interface 1060 provided to modify a media item 1056H. For example, the one or more modification operations correspond to rotating, moving / translating, and scaling / view zooming the media item based on a portion of the media item visible via the display device. In some embodiments, the cropping user interface includes a real-time / static toggle and a perspective graphical representation.

[0346] In some embodiments, the computing system (1118): detects, via the one or more input devices, a subsequent user input that selects a completion affordance of the cropping user interface; and in response to detecting the subsequent user input, displays, via the display device, a menu that includes a first option corresponding to setting the second media item as the background of the wake screen user interface, and a second option corresponding to adding the second media item to the media library without setting the second media item as the background of the wake screen user interface. For example, Figure 10QAs shown, the computing system displays a prompt area 1063 overlaid on the cropping user interface 1060, and the prompt area includes: a first enable representation 1064A, which, when selected (e.g., using a single or double-click gesture), causes the computing system to set the media item 1056H at the wallpaper or background of the wake screen user interface 1010 and add the media item 1056H to the media library; a second enable representation 1064B, which, when selected (e.g., using a single or double-click gesture), causes the computing system to add the media item 1056H to the media library; and a cancel enable representation 1064C, which, when selected (e.g., using a single or double-click gesture), causes the computing system to eliminate the prompt area 1063. For example, the menu corresponds to a pop-up menu, a slide-over form, etc. In some embodiments, the first option and the second option are selected via separate enable representations or radio buttons. In some embodiments, the first option and the second option are associated with a single toggle.

[0347] In some embodiments, the computing system (1120) detects, via the one or more input devices, a subsequent user input corresponding to a selection of a corresponding second edit-enabled representation of the one or more second edit-enabled representations; and in response to detecting the subsequent user input, initiates a process for removing a media item corresponding to the corresponding second edit-enabled representation from the media library. Fig.10J As shown, the editing user interface 1040 includes a second editing affordance 1021A for initiating the process of removing the media item 1015 from the media library. In some embodiments, each of the existing media items includes a remove button and other metadata / information of the associated media item, such as static / real-time, location, date / time, etc.

[0348] In some embodiments, the computing system (1122): detects, via the one or more input devices, one or more other user inputs selecting one or more media items from the media item picker user interface; based on determining that the number of media items selected by the one or more other user inputs does not exceed the media item limit associated with the media library, adds the one or more media items to the media library; and based on determining that the number of media items selected by the one or more other user inputs does not exceed the media item limit associated with the media library, forgoes adding the one or more media items to the media library and displays, via the display device, a notification that the media library has reached the media item limit. In some embodiments, the notification can be paired with auditory and / or tactile feedback.

[0349] In some embodiments, the computing system (1124): detects another user input via the one or more input devices, the another user input corresponding to selecting a corresponding user interface object from the one or more foreground user interface objects within the wake screen user interface; and in response to detecting the fourth user input, performs an operation corresponding to the corresponding user interface object without displaying the media library user interface. For example, the computing device responds to detecting a flashlight indication (e.g., Fig. 10A 1008A) within wake-up screen user interface 1010 in the wake-up screen, activating the flashlight in response to detecting a selection of a camera enable indication (e.g., Fig. 10A 10a), viewing a notification in response to selection of its representation (e.g., notifications 1006A and 1006B within wake screen user interface 1010 in FIG. 10a), dismissing the notification, displaying an application user interface corresponding to detection of the selection of the notification, Fig. 10A The wake-up screen user interface 1010 in the home screen enable representation 1012) is selected to replace the wake-up screen user interface with the home screen user interface, and so on.

[0350] In some embodiments, while displaying the first media item used as the background of the wake screen user interface, the computing system detects (1126) via one or more input devices another user input corresponding to a request to display an action menu, the action menu including at least one of: an action associated with sharing the first media item, an action associated with editing the first media item, an action associated with displaying the editing user interface for editing the one or more media items included in the media library, an action associated with launching an image viewing application (e.g., with the first media item opened and optionally moving any related photos within the same event, date, location, etc.), and an action associated with displaying a wallpaper editing user interface. For example, Figure 10R and 10S A sequence is shown in which the computing system displays an operations menu 10141 according to some embodiments.

[0351] like Fig. 10SAs shown, operation menu 10141 also includes: an enable representation 1066A, which, when selected (e.g., using a single or double-click gesture), causes the computing system to display a sharing menu that includes multiple options or modes for sharing media item 1056H; an enable representation 1066B, which, when selected (e.g., using a single or double-click gesture), causes the computing system to display a cropping user interface 1060 (e.g., such as a cropping user interface 1060 provided to modify media item 1056H); Figure 10P ); an affordance 1066C which, when selected (e.g., using a single-click or double-click gesture), causes the computing system to display an editing user interface 1040 (e.g., as shown) provided for modifying media items included in the media library. Fig.10J ); an affordance 1066D which, when selected (e.g., using a single or double-click gesture), causes the computing system to open the media item 1056H within the media item viewing application (e.g., as shown); Figure 10T and an affordance 1066E, which, when selected (eg, using a single-click or double-click gesture), causes the computing system to display a wallpaper setting user interface 1090 (eg, as Figure 10V shown).

[0352] In some embodiments, the other input corresponds to a selection of a "more" affordance using the media library user interface (e.g., Figure 10R In some embodiments, the operation menu includes at least one of a share photo affordance, an edit wallpaper affordance, an edit media library affordance, a photo display affordance, and a wallpaper setting affordance. In some embodiments, in response to detecting a selection of the share photo affordance, the computing system displays a share sheet with different options for sharing the first media item, such as one or more social media platforms, email, SMS, etc. In some embodiments, in response to detecting a selection of the edit wallpaper affordance, the computing system displays a media item editing user interface for cropping the first media item and other similar operations (e.g., Figure 10P In some embodiments, in response to detecting a selection of the media library affordance, the computing system displays a user interface for selecting the media library affordance (e.g., Fig.10J In some embodiments, in response to detecting a selection of a display in a photo affordance, the computing system launches a photo application and displays the display in the photo application interface (e.g., Figure 10TIn some embodiments, in response to detecting a selection of a wallpaper setting affordance, the computing system displays a wallpaper setting user interface (e.g., Fig. 6A Wallpaper setting user interface 605 or Figure 10W Wallpaper settings user interface 1090 in.

[0353] In some embodiments, the computing system (1128): detects, via the one or more input devices, a selection of the operation associated with launching the image viewing application; and in response to detecting the selection of the operation associated with launching the image viewing application, displays, via the display device, the first media item and one or more related media items within the image viewing application. For example, Fig. 10S and 10T A sequence is shown according to some embodiments in which an affordance 1066D associated with opening a media item within a media item viewing application is selected from action menu 10141. Figure 10T As shown, media item 1056H is displayed within an "Albums" tab 1070 of the media item viewing application along with other media items associated with a "Home" album of media items.

[0354] In some embodiments, in response to detecting the user input, the computing system (1130): determines whether the computing system is unlocked; based on determining that the computing system is locked, abandons displaying the media library user interface; and based on determining that the computing system is unlocked, replaces the display of the wake screen user interface with the media library user interface on the display device. As an example, the computing system is unlocked by authenticating the user's biometric information. As another example, the computing system is unlocked by authenticating the user's password. In some embodiments, method 1100 optionally also includes maintaining display of the wake screen user interface via the display device.

[0355] Limiting the transition from the wake screen user interface to the media library user interface to the unlock mode provides a sense of security to the user while reducing accidental input and also reducing the number and / or duration of user interactions with the device. Reducing the number and / or duration of user interactions with the device reduces wear and tear on the device and reduces power consumption, thereby extending the battery life of the device.

[0356] In some embodiments, the computing system (1132): detects another user input via the one or more input devices, the another user input corresponding to a request to display a media library user interface; and in response to detecting the another user input, displays the media library user interface via the display device, including: stopping display of the one or more foreground user interface objects from the wake screen user interface; maintaining display of the first media item; and displaying, via the display device, a first enable representation associated with editing a media item included in the media library user interface (e.g., the edit enable representation having the media library user interface). For example, Fig. 10C and 10D A sequence according to some embodiments is shown in which, in response to detecting touch input, wake screen user interface 1010 is replaced by media library user interface 1030.

[0357] like Fig. 10D As shown, media library user interface 1030 includes: "More" enable representation 1036A, which, when selected (e.g., using a single or double-click gesture), causes the computing system to display an operation menu (e.g., Fig. 10S and an “Edit” affordance 1036B, which, when selected (e.g., using a single or double-click gesture), causes the computing system to use an editing user interface (e.g., Fig.10J In some embodiments, the computing device further displays that the first media item corresponds to the current wake-up screen wallpaper (e.g., Fig. 10D Indication of the wallpaper indicator 1035).

[0358] Accessing the media library user interface from the wake screen user interface provides the user with an efficient mechanism to more quickly change the background or wallpaper of the wake screen user interface and / or the home screen user interface, thereby reducing the number and / or duration of user interactions with the device. Reducing the number and / or duration of user interactions with the device reduces wear and tear on the device and reduces power consumption, thereby extending the battery life of the device.

[0359] In some embodiments, the media library user interface also includes (1134) a plurality of paging points associated with the media items included in the media library user interface. Fig. 10DAs shown, the media library user interface 1030 includes a plurality of paging points 1034, which indicate the position of the media item 1015 in the plurality of media items in the media library associated with the media library user interface 1030. In some embodiments, the paging points 1034 are used as a swipe bar. In some embodiments, the computing system jumps to the beginning of the media item included in the media library user interface in response to detecting a tap gesture (etc.) pointing to the leftmost paging point (or an area adjacent thereto). In some embodiments, the computing system jumps to the end of the media item included in the media library user interface in response to detecting a tap gesture (etc.) pointing to the rightmost paging point (or an area adjacent thereto).

[0360] In some embodiments, the computing system (1136) detects, via the one or more input devices, a navigation input (e.g., a substantially horizontal swipe gesture, a voice command, a tap gesture detected adjacent to an edge of the display, etc.) within the media library user interface while displaying the first media item without the one or more foreground user interface objects; and in response to detecting the navigation input within the media library user interface, replaces the first media item with a second media item in the media library user interface via the display device. For example, Fig. 10D and 10E A sequence according to some embodiments is shown in which, in response to detecting a navigation gesture 1007, a first media item 1015 within a media library user interface 1030 is replaced by a second media item 1025.

[0361] The media library user interface provides an efficient mechanism for the user to more quickly change the background or wallpaper of the wake screen user interface and / or the home screen user interface, thereby reducing the number and / or duration of user interactions with the device. Reducing the number and / or duration of user interactions with the device reduces wear and tear on the device and reduces power consumption, thereby extending the battery life of the device.

[0362] In some embodiments, if the media library user interface is empty and a next item input is detected, the computing system keeps the first media item and optionally displays a notification / prompt to add media items to the media library user interface. In some embodiments, if the media library user interface includes only the first media item and a next item input is detected, the computing system keeps the first media item and optionally displays a notification / prompt to add more media items to the media library user interface (e.g., Fig.10I Prompt 1071 shown).

[0363] In some embodiments, if the first media item corresponds to the system wallpaper and a swipe gesture is detected, the computing system retains the first media item (e.g., Figure 10Z to Figure 10ABIn some embodiments, after replacing the first media item with the second media item, the media library user interface includes an affordance for setting the second media item as the wake screen wallpaper. In some embodiments, this also causes the home screen wallpaper to be updated. In some embodiments, the background of the home screen user interface is based on the media item selected as the background of the wake screen user interface from the media library user interface and the home screen processing options (e.g., smart color, smart gradient, mirror, etc.).

[0364] It should be understood that FIG. 11A to FIG. 11E The specific order in which the operations in the description are described is merely exemplary and is not intended to indicate that the order is the only order in which the operations may be performed. A person of ordinary skill in the art will recognize many ways to reorder the operations described herein. Additionally, it should be noted that the details of other processes described herein in conjunction with other methods described herein (e.g., methods 800 and 900) are also applicable in a similar manner to the details of the processes described above in conjunction with FIG. 11A to FIG. 11D Method 1100 is described. For example, the user input, user input gesture, media item, wake screen user interface, home screen user interface, background, and preview described above with reference to method 1100 optionally have one or more features of the user input, user input gesture, media item, wake screen user interface, home screen user interface, background, and preview described herein with reference to other methods described herein (e.g., methods 800 and 900). For the sake of brevity, these details are not repeated here.

[0365] The operations in the above information processing method are optionally implemented by running one or more functional modules in an information processing device, such as a general-purpose processor (e.g., Figure 1A , Figure 3 and Figure 5A described) or application-specific chips. In addition, the above reference FIG. 11A to FIG. 11E The described operations are optionally performed by Figure 1A and Figure 1B. For example, the user input, user input gesture, media item, wake screen user interface, home screen user interface, background and preview are optionally implemented by event classifier 170, event recognizer 180 and event handler 190. The event monitor 171 in the event classifier 170 detects contact on the touch-sensitive surface 451, and the event distributor module 174 delivers the event information to the application 136-1. The corresponding event recognizer 180 of the application 136-1 compares the event information with the corresponding event definition 186, and determines whether the first contact at the first position on the touch-sensitive surface corresponds to a predefined event or sub-event, such as a selection of an object on the user interface. When the corresponding predefined event or sub-event is detected, the event recognizer 180 activates the event handler 190 associated with the detection of the event or sub-event. The event handler 190 optionally utilizes or calls the data updater 176 or the object updater 177 to update the application internal state 192. In some embodiments, the event handler 190 accesses the corresponding GUI updater 178 to update the content displayed by the application. Similarly, those skilled in the art will clearly know that based on Figure 1A and Figure 1B How the components depicted in the figure can implement other processes.

[0366] For the purpose of explanation, the foregoing description is described by reference to specific embodiments. However, the above exemplary discussion is not intended to be exhaustive or to limit the invention to the disclosed precise form. According to the above teachings, many modifications and variations are possible. The embodiments are selected and described in order to best illustrate the principles of the present invention and its practical application, so that other technical personnel in the field can best use the present invention and the various described embodiments with various modifications suitable for the specific purpose contemplated.

Claims

1. A method comprising: At a computing system including non-transitory memory and one or more processors, wherein the computing system is communicatively coupled to a display device and one or more input devices: displaying, via the display device, a wake screen user interface, the wake screen user interface comprising a first media item used as a background for the wake screen user interface and one or more foreground user interface objects displayed over the first media item; detecting, via the one or more input devices, a sequence of one or more user inputs corresponding to a request to edit a media item from a set of media items in a media library accessible from the wake screen interface, wherein: the set of one or more media items including at least the first media item; as well as The sequence of one or more user inputs includes respective user inputs detected while the first media item is displayed as a background of the wake screen user interface; and In response to detecting the sequence of one or more user inputs, an editing user interface for at least one of adding or removing the set of one or more media items from the media library is displayed via the display device.

2. A method according to claim 1, wherein the editing user interface includes at least one of the following: a first editing enable indication and one or more second editing enable indications, wherein the first editing enable indication is used to initiate a process for adding one or more media items to the media library, and the one or more second editing enable indications are used to initiate a process for removing associated media items included in the media library.

3. The method according to claim 2, further comprising: detecting, via the one or more input devices, a second user input corresponding to a selection of the first edit affordance; as well as In response to detecting the second user input, display of the editing user interface is replaced with a media item picker user interface including representations of one or more media items available for addition to the media library. 4 . The method of claim 3 , wherein the media item picker user interface includes suggested media items for adding to the media library.

5. The method of claim 4, wherein the suggested media items are displayed on a representation of the wake screen user interface, the wake screen user interface comprising the one or more foreground user interface objects associated with the wake screen user interface.

6. The method according to claim 3, further comprising: detecting, via the one or more input devices, a third user input selecting a second media item from the media item picker user interface; as well as In response to detecting the third user input, a cropping user interface is displayed via the display device, the cropping user interface being provided for performing one or more modification operations on the second media item, wherein the cropping user interface includes a completion indicator provided for removing the cropping user interface.

7. The method according to claim 6, further comprising: detecting, via the one or more input devices, subsequent user input selecting a completion affordance of the cropping user interface; as well as In response to detecting the subsequent user input, displaying a menu via the display device, the menu including a first option corresponding to setting the second media item as the background of the wake screen user interface and a second option corresponding to adding the second media item to the media library without setting the second media item as the background of the wake screen user interface.

8. The method according to claim 3, further comprising: detecting, via the one or more input devices, one or more other user inputs selecting one or more media items from the media item chooser user interface; adding the one or more media items to the media library based on determining that the number of media items selected by the one or more other user inputs does not exceed a media item limit associated with the media library; as well as Based on determining that the number of media items selected by the one or more other user inputs does not exceed the media item limit associated with the media library, forgoing adding the one or more media items to the media library and displaying, via the display device, a notification that the media library has reached the media item limit.

9. The method according to claim 2, further comprising: detecting, via the one or more input devices, a subsequent user input corresponding to a selection of a respective second edit-enabled representation of the one or more second edit-enabled representations; as well as In response to detecting a subsequent sequence of one or more user inputs, a process is initiated for removing the media item corresponding to the respective second edit-enablement from the media library.

10. The method according to claim 1, further comprising: While displaying the first media item serving as the background of the wake screen user interface, another user input corresponding to a request to display an operation menu is detected via the one or more input devices, the operation menu including at least one operation of: an operation associated with sharing the first media item, an operation associated with editing the first media item, an operation associated with displaying the editing user interface for editing one or more media items included in the media library, an operation associated with launching an image viewing application, and an operation associated with displaying a wallpaper editing user interface.

11. The method according to claim 10, further comprising: detecting, via the one or more input devices, selection of the operation associated with launching the image viewing application; as well as In response to detecting the selection of the operation associated with launching the image viewing application, the first media item and one or more related media items are displayed within the image viewing application via the display device.

12. The method according to claim 1, further comprising: In response to detecting the user input: determining whether the computing system is unlocked; Based on determining that the computing system is locked, abandoning displaying the media library user interface; as well as Based on determining that the computing system is unlocked, replacing display of the wake screen user interface with the media library user interface on the display device.

13. The method according to claim 1, further comprising: detecting, via the one or more input devices, another user input corresponding to a request to display a media library user interface; as well as In response to detecting the other user input, displaying the media library user interface via the display device includes: ceasing display of the one or more foreground user interface objects from the wake screen user interface; maintaining display of the first media item; and A first affordance associated with editing a media item included in the media library user interface is displayed via the display device.

14. The method according to claim 13, further comprising: detecting, via the one or more input devices, navigation input within the media library user interface while displaying the first media item without the one or more foreground user interface objects; as well as In response to detecting the navigation input within the media library user interface, the first media item is replaced with a second media item in the media library user interface via the display device.

15. The method of claim 13, wherein the media library user interface further comprises a plurality of paging points associated with the media items included in the media library user interface.

16. The method according to claim 1, further comprising: detecting, via the one or more input devices, another user input corresponding to selection of a respective user interface object from the one or more foreground user interface objects within the wake screen user interface; and In response to detecting the other user input, an operation corresponding to the corresponding user interface object is performed without displaying the media library user interface.

17. A computing system comprising: an interface for communicating with a display device and one or more input devices; one or more processors; non-transitory memory; and One or more programs, wherein the one or more programs are stored in the non-volatile memory and are configured to be executed by the one or more processors, the one or more programs comprising instructions for executing the method according to any one of claims 1-16.

18. A non-transitory computer-readable storage medium storing one or more programs, the one or more programs comprising instructions that, when executed by a computing system having a function for communicating with a display device and one or more input devices, cause the computing system to perform the method according to any one of claims 1-16.

19. A method comprising: At a device including a display device, one or more input devices, a non-transitory memory, and one or more processors coupled to the non-transitory memory: detecting, via the one or more input devices, a first user input while displaying a wake screen user interface on the display, the wake screen user interface comprising a first media item serving as a background for the wake screen user interface and one or more foreground user interface objects displayed over the first media item, the first user input corresponding to a request to display a media library user interface; in response to detecting the first user input, ceasing to display the one or more foreground user interface objects from the wake screen user interface; detecting, via the one or more input devices, a second user input corresponding to a request to navigate among media items in the media library user interface while displaying the first media item without the one or more foreground user interface objects; in response to detecting the second user input, replacing the first media item with a second media item in the media library user interface on the display device; while displaying the second media item, detecting, via the one or more input devices, a third input corresponding to a request to dismiss the media library user interface; as well as In response to detecting the third user input corresponding to the request to eliminate the media library user interface, redisplaying the one or more foreground user interface objects from the wake screen user interface on the display above the media items from the media library user interface that are selected as the background of the wake screen user interface.

Images