User interface for controlling playback of content and associated systems and methods

Abstract

The invention relates to a user interface for controlling playback of content and associated systems and methods. In some embodiments, an electronic device presents a user interface for controlling playback of a content item. In some embodiments, the user interface includes a plurality of selectable options for controlling playback of respective content items overlaid on the content item. In some embodiments, an electronic device presents a user interface for browsing and switching between content items available for playback.

Description

[0001] This application is a divisional application of the PCT application filed on June 3, 2022, with national application number 202280040569.3 and entitled "User interface for controlling content playback and associated system and method", which has entered the Chinese national phase.

[0002] Cross-references to related applications

[0003] This application claims the benefit of U.S. Provisional Application No. 63 / 197,489, filed June 6, 2021, the contents of which are incorporated herein by reference in their entirety for all purposes. Technical Field

[0004] This specification relates in its entirety to electronic devices that present a user interface for controlling the playback of content items. Background Technology

[0005] In recent years, user interaction with electronic devices has increased significantly. These devices can be such as computers, tablets, televisions, multimedia devices, mobile devices, and so on. In some cases, users want to use electronic devices to control the playback of content items and watch content items available for playback. Summary of the Invention

[0006] Some embodiments described in this disclosure relate to methods for controlling the playback of content items. Some embodiments described in this disclosure relate to methods for browsing and switching between content items available for playback. Enhancing user interaction with electronic devices while performing the above operations improves the user experience and reduces user interaction time, which is particularly important when the input device is battery powered.

[0007] As is widely recognized, the use of personally identifiable information should comply with privacy policies and practices that are generally accepted to meet or exceed industry or governmental requirements for protecting user privacy. Specifically, personally identifiable information data should be managed and processed to minimize the risk of unintentional or unauthorized access or use, and the nature of authorized use should be clearly explained to users. Attached Figure Description

[0008] To better understand the various embodiments described, reference should be made to the following detailed description in conjunction with the accompanying drawings, in which similar reference numerals indicate corresponding parts throughout the drawings.

[0009] Figure 1A This is a block diagram illustrating a portable multi-functional device with a touch-sensitive display according to some embodiments.

[0010] Figure 1B This is a block diagram illustrating exemplary components for event handling according to some implementation schemes.

[0011] Figure 2 A portable multi-functional device with a touchscreen is shown according to some embodiments.

[0012] Figure 3 This is a block diagram of an exemplary multifunctional device having a display and a touch-sensitive surface according to some implementation schemes.

[0013] Figure 4A An exemplary user interface for an application menu on a portable multifunction device according to some implementations is shown.

[0014] Figure 4B An exemplary user interface of a multifunctional device having a touch-sensitive surface separate from the display, according to some embodiments, is shown.

[0015] Figures 5A to 5C A block diagram of an exemplary architecture for a device according to some embodiments of the present disclosure is shown.

[0016] Figures 6A to 6EE An exemplary manner in which an electronic device, according to some embodiments, presents a user interface for controlling the playback of content items is shown.

[0017] Figure 7 This is a flowchart illustrating a method for presenting a user interface for controlling the playback of content items according to some implementation schemes.

[0018] Figures 8A to 8L Exemplary ways in which an electronic device, according to some embodiments, presents a user interface for browsing and switching between content items that can be played back are shown.

[0019] Figure 9 This is a flowchart illustrating a method for presenting a user interface for browsing and switching between content items available for playback, according to some implementation schemes. Detailed Implementation

[0020] Description of the implementation plan

[0021] The following description illustrates exemplary methods, parameters, etc. However, it should be understood that such description is not intended to limit the scope of this disclosure, but is provided as a description of exemplary embodiments.

[0022] In some implementations, the exemplary electronic device plays content items, such as video and / or audio content, within a user interface that includes user interface elements for controlling the playback of the content items. For example, the user interface includes sliders and options for changing the captions, audio, and picture-in-picture settings of the content item being played. Such techniques can reduce the cognitive load on users of the exemplary electronic device and simplify the process of modifying the playback of content items on the electronic device.

[0023] In some specific implementations, the exemplary electronic device presents a user interface for browsing and switching between content items available for playback. For example, the electronic device presents a user interface for browsing content, while simultaneously presenting content items and / or a channel guide user interface with information about content available for playback on the electronic device. Such techniques can reduce the cognitive load on users of the exemplary electronic device and simplify the process of browsing and switching between content items on the electronic device.

[0024] Although the following description uses the terms "first," "second," etc., to describe various elements, these elements should not be limited by the terms. These terms are only used to distinguish one element from another. For example, a first touch may be named a second touch and similarly, a second touch may be named a first touch, without departing from the scope of the various described embodiments. Both the first touch and the second touch are touches, but they are not the same touch.

[0025] The terminology used in the description of the various embodiments herein is for the purpose of describing particular embodiments only and is not intended to be limiting. As used in the description of the various embodiments and the appended claims, the singular forms “a” and “the” are intended to include the plural forms as well, unless the context clearly indicates otherwise. It will also be understood that the term “and / or” as used herein refers to and covers any and all possible combinations of one or more of the associated listed items. It will also be understood that the terms “comprising” and / or “including” as used in this specification specify the presence of the stated features, integers, steps, operations, elements, and / or components, but do not exclude the presence or addition of one or more other features, integers, steps, operations, elements, components, and / or groups thereof.

[0026] Depending on the context, the term "if" may optionally be interpreted as meaning "when," "in response to," or "in response to detection." Similarly, depending on the context, the phrases "if it is determined..." or "if [the stated condition or event] is detected" may optionally be interpreted as meaning "in response to determining..." or "in response to detecting [the stated condition or event]."

[0027] Exemplary device

[0028] This document describes implementations of electronic devices, user interfaces for such devices, and associated processes for using such devices. In some implementations, the device is a portable communication device, such as a mobile phone, that also includes other functionalities such as PDA and / or music player functionality. Exemplary implementations of portable multi-functional devices include, but are not limited to, the iPhone from Apple Inc. (Cupertino, California). ® Devices, iPod Touch ® Devices and iPads ® Device. Optionally, other portable electronic devices may be used, such as laptops or tablets with touch-sensitive surfaces (e.g., touchscreen displays and / or touchpads). It should also be understood that in some embodiments, the device is not a portable communication device, but a desktop computer or television with touch-sensitive surfaces (e.g., touchscreen displays and / or touchpads). In some embodiments, the device does not have a touchscreen display and / or touchpad, but is capable of outputting display information (such as the user interface of this disclosure) for display on a separate display device, and is capable of receiving input information from a separate input device having one or more input mechanisms (such as one or more buttons, touchscreen displays, and / or touchpads). In some embodiments, the device has a display, but is capable of receiving input information from a separate input device having one or more input mechanisms (such as one or more buttons, touchscreen displays, and / or touchpads). In some embodiments, the electronic device is a computer system that communicates with a display generating component (e.g., via wireless communication, via wired communication). The display generating component is configured to provide visual output, such as a display via a CRT display, a display via an LED display, or a display via image projection. In some embodiments, the display generation component is integrated with the computer system. In other embodiments, the display generation component is separate from the computer system. As used herein, "display" content includes displaying content (e.g., video data rendered or decoded by display controller 156) by transmitting data (e.g., image data or video data) to the integrated or external display generation component via a wired or wireless connection to visually generate content.

[0029] In the following discussion, an electronic device including a display and a touch-sensitive surface is described. However, it should be understood that the electronic device optionally includes one or more other physical user interface devices, such as a physical keyboard, mouse, and / or joystick. Additionally, as mentioned above, it should be understood that the described electronic device, display, and touch-sensitive surface are optionally distributed among two or more devices. Therefore, as used in this disclosure, information on or displayed by the electronic device is optionally used to describe information output by the electronic device for display on a separate display device (touch-sensitive or non-touch-sensitive). Similarly, as used in this disclosure, input received on the electronic device (e.g., touch input received on a touch-sensitive surface of the electronic device) is optionally used to describe input received on a separate input device from which the electronic device receives input information.

[0030] The device typically supports a variety of applications, such as one or more of the following: drawing applications, rendering applications, word processing applications, website creation applications, disk editing applications, spreadsheet applications, game applications, phone applications, video conferencing applications, email applications, instant messaging applications, fitness support applications, photo management applications, digital camera applications, digital video camera applications, web browsing applications, digital music player applications, TV channel browsing applications, and / or digital video player applications.

[0031] Various applications running on the device optionally use at least one common physical user interface device, such as a touch-sensitive surface. One or more functions of the touch-sensitive surface and the corresponding information displayed on the device are optionally adjusted and / or varied for different applications, and / or adjusted and / or varied within the respective applications. In this way, the device's common physical architecture (such as the touch-sensitive surface) optionally utilizes a user interface that is intuitive and clear to the user to support various applications.

[0032] Now let’s turn our attention to implementations of portable or non-portable devices with touch-sensitive displays, but the device does not necessarily include a touch-sensitive display or a general display, as described above. Figure 1AThis is a block diagram illustrating a portable or non-portable multi-functional device 100 with a touch-sensitive display 112 according to some embodiments. The touch-sensitive display 112 is sometimes referred to as a “touchscreen” for convenience, and is sometimes referred to as a touch-sensitive display system. Device 100 includes a memory 102 (which optionally includes one or more computer-readable storage media), a memory controller 122, one or more processing units (CPUs) 120, a peripheral interface 118, RF circuitry 108, audio circuitry 110, a speaker 111, a microphone 113, an input / output (I / O) subsystem 106, other input or control devices 116, and an external port 124. Device 100 optionally includes one or more optical sensors 164. Device 100 optionally includes one or more contact strength sensors 165 for detecting the intensity of contact on device 100 (e.g., a touch-sensitive surface, such as the touch-sensitive display system 112 of device 100). Device 100 optionally includes one or more haptic output generators 167 for generating haptic output on device 100 (e.g., generating haptic output on a touch-sensitive surface such as the touch-sensitive display system 112 of device 100 or the touchpad 355 of device 300). These components optionally communicate via one or more communication buses or signal lines 103.

[0033] As used in this specification and claims, the term "intensity" for contact on a tactile surface refers to the force or pressure (force per unit area) of a contact (e.g., finger contact) on a tactile surface, or to a substitute for the force or pressure of a contact on a tactile surface. The intensity of a contact has a range of values ​​that includes at least four different values ​​and more typically hundreds of different values ​​(e.g., at least 256). The intensity of a contact is optionally determined (or measured) using various methods and various sensors or combinations of sensors. For example, one or more force sensors below or adjacent to the tactile surface are optionally used to measure the force at different points on the tactile surface. In some embodiments, force measurements from multiple force sensors are combined (e.g., weighted average) to determine the estimated contact force. Similarly, the pressure-sensitive tip of a stylus is optionally used to determine the pressure of the stylus on the tactile surface. Alternatively, the size and / or variation of the contact area detected on the touch-sensitive surface, the capacitance and / or variation of the touch-sensitive surface near the contact, and / or the resistance and / or variation of the touch-sensitive surface near the contact may optionally be used as substitutes for the force or pressure of the contact on the touch-sensitive surface. In some embodiments, the substitute measurement of the contact force or pressure is used directly to determine whether an intensity threshold has been exceeded (e.g., the intensity threshold is described in units corresponding to the substitute measurement). In some embodiments, the substitute measurement of the contact force or pressure is converted into an estimated force or pressure, and the estimated force or pressure is used to determine whether an intensity threshold has been exceeded (e.g., the intensity threshold is a pressure threshold measured in pressure units). Using the intensity of the contact as an attribute of user input allows the user to access additional device functions that would otherwise be inaccessible to the user on a smaller device with limited physical space, which is used (e.g., on a touch-sensitive display) to display an indication and / or receive user input (e.g., via a touch-sensitive display, touch-sensitive surface, or physical / mechanical controls, such as knobs or buttons).

[0034] As used in this specification and claims, the term "haptic output" refers to a physical displacement of the device relative to a previous position of the device, a physical displacement of a component of the device (e.g., a touch-sensitive surface) relative to another component of the device (e.g., the housing), or a displacement of a component relative to the center of mass of the device, which is detected by the user using the user's tactile sense. For example, when the device or a component of the device comes into contact with a touch-sensitive surface (e.g., a finger, palm, or other part of the user's hand), the haptic output generated by the physical displacement will be interpreted by the user as a tactile sensation corresponding to a perceived change in the physical characteristics of the device or a component of the device. For example, movement of a touch-sensitive surface (e.g., a touch-sensitive display or touchpad) may optionally be interpreted by the user as a "press-click" or "release-click" on a physically actuated button. In some cases, the user will feel a tactile sensation, such as a "press-click" or "release-click," even when a physically actuated button associated with the touch-sensitive surface, which has been physically pressed (e.g., displaced) by the user's movement, has not moved. As another example, even when the smoothness of the tactile surface remains unchanged, movement of the tactile surface can optionally be interpreted or sensed by the user as “roughness” of the tactile surface. While such interpretations of touch by users will be limited by their individualized sensory perceptions, many sensory perceptions of touch are common to most users. Therefore, when a tactile output is described to correspond to a user’s specific sensory perception (e.g., “release click,” “press click,” “roughness”), unless otherwise stated, the generated tactile output corresponds to a physical displacement of the device or its components that will generate the sensory perception described by a typical (or average) user.

[0035] It should be understood that device 100 is merely an example of a portable or non-portable multifunctional device, and device 100 may optionally have more or fewer components than shown, may optionally combine two or more components, or may optionally have different configurations or arrangements of these components. Figure 1A The various components shown are implemented in hardware, software, or a combination of both, including one or more signal processing and / or application-specific integrated circuits (ASICs). Furthermore, Figure 1A The various components shown are optionally implemented on two or more devices; for example, a display and audio circuitry on a display device, a touch-sensitive surface on an input device, and other components on device 100. In such embodiments, device 100 optionally communicates with the display device and / or input device to facilitate system operation as described herein, and the various components relating to display and / or input described herein are retained in device 100 or optionally included in the display and / or input device where appropriate.

[0036] Peripheral interface 118 can be used to couple the device's input and output peripherals to CPU 120 and memory 102. One or more processors 120 run or execute various software programs and / or instruction sets stored in memory 102 to perform various functions of device 100 and process data. In some embodiments, peripheral interface 118, CPU 120, and memory controller 122 are optionally implemented on a single chip, such as chip 104. In some other embodiments, they are optionally implemented on separate chips.

[0037] RF (Radio Frequency) circuit 108 receives and transmits RF signals, also known as electromagnetic signals. RF circuit 108 converts electrical signals into electromagnetic signals and vice versa, and communicates with communication networks and other communication devices via these electromagnetic signals. RF circuit 108 optionally includes well-known circuitry for performing these functions, including but not limited to antenna systems, RF transceivers, one or more amplifiers, tuners, one or more oscillators, digital signal processors, codec chipsets, Subscriber Identity Module (SIM) cards, memory, etc. RF circuit 108 optionally communicates wirelessly with networks and other devices, such as the Internet (also known as the World Wide Web (WWW)), intranets, and / or wireless networks (such as cellular phone networks, wireless local area networks (LANs), and / or metropolitan area networks (MANs)). RF circuit 108 optionally includes well-known circuitry for detecting near-field communication (NFC) fields, such as via near-field communication radio components. Wireless communication may optionally employ any of a variety of communication standards, protocols, and technologies, including but not limited to Global System for Mobile Communications (GSM), Enhanced Data GSM Environment (EDGE), High-Speed ​​Downlink Packet Access (HSDPA), High-Speed ​​Uplink Packet Access (HSUPA), Evolution, Pure Data (EV-DO), HSPA, HSPA+, Dual-Unit HSPA (DC-HSPDA), Long Term Evolution (LTE), Near Field Communication (NFC), Wideband Code Division Multiple Access (W-CDMA), Code Division Multiple Access (CDMA), Time Division Multiple Access (TDMA), Bluetooth, Bluetooth Low Energy (BTLE), and Wi-Fi (e.g., IEEE 802.11a, IEEE 802.11b, IEEE 802.11g, IEEE...). 802.11n and / or IEEE 802.11ac), Voice over Internet Protocol (VoIP), Wi-MAX, email protocols (e.g., Internet Messaging Access Protocol (IMAP) and / or Post Office Protocol (POP)), instant messaging (e.g., Extensible Messaging and Presence Protocol (XMPP), Session Initiation Protocol for Instant Messaging and Presence with Extended Utility (SIMPLE), Instant Messaging and Presence Service (IMPS)), and / or Short Message Service (SMS), or any other suitable communication protocol that has not been developed as of the date of this document submission.

[0038] Audio circuitry 110, speaker 111, and microphone 113 provide an audio interface between the user and device 100. Audio circuitry 110 receives audio data from peripheral interface 118, converts the audio data into electrical signals, and transmits the electrical signals to speaker 111. Speaker 111 converts the electrical signals into sound waves that are audible to humans. Audio circuitry 110 also receives electrical signals converted from sound waves by microphone 113. Audio circuitry 110 converts the electrical signals into audio data and transmits the audio data to peripheral interface 118 for processing. Audio data is optionally retrieved by peripheral interface 118 from and / or transmitted to memory 102 and / or RF circuitry 108. In some embodiments, audio circuitry 110 also includes a headset jack (e.g., ...). Figure 2 (212 in the text). The headset jack provides an interface between the audio circuitry 110 and a removable audio input / output peripheral device, such as an output-only headphone or a headset with both output (e.g., a single-ear headphone or a dual-ear headphone) and input (e.g., a microphone).

[0039] I / O subsystem 106 couples input / output peripherals on device 100, such as touchscreen 112 and other input control devices 116, to peripheral interface 118. I / O subsystem 106 optionally includes display controller 156, optical sensor controller 158, intensity sensor controller 159, haptic feedback controller 161, and one or more input controllers 160 for other input or control devices. The one or more input controllers 160 receive electrical signals from / send electrical signals to the other input control device 116. The other input control device 116 optionally includes physical buttons (e.g., push-buttons, rocker buttons, etc.), dial pads, slide switches, joysticks, click dials, etc. In some embodiments, input controller 160 is optionally coupled to (or not coupled to) any of the following: keyboard, infrared port, USB port, and pointing device such as mouse. One or more buttons (e.g., ... Figure 2 Optionally, 208) includes an increase / decrease button for volume control of speaker 111 and / or microphone 113. The one or more buttons optionally include a push-button (e.g., Figure 2(Ref. 206 in the original text). In some embodiments, the electronic device is a computer system that communicates with one or more input devices (e.g., via wireless communication, via wired communication). In some embodiments, the one or more input devices include a touch-sensitive surface (e.g., a touchpad, as part of a touch-sensitive display). In some embodiments, the one or more input devices include one or more camera sensors (e.g., one or more optical sensors 164 and / or one or more depth camera sensors 175), such as for tracking user gestures (e.g., hand gestures) as input. In some embodiments, the one or more input devices are integrated with the computer system. In some embodiments, the one or more input devices are separate from the computer system.

[0040] A quick press of the push button optionally disengages the touchscreen 112 from its lock or optionally initiates a process of unlocking the device using gestures on the touchscreen, as described in U.S. Patent Application 11 / 322,549 (i.e., U.S. Patent No. 7,657,849), filed December 23, 2005, entitled "Unlocking a Device by Performing Gestures on an Unlock Image," the entire contents of which are incorporated herein by reference. A long press of the push button (e.g., 206) optionally powers the device 100 on or off. The function of one or more buttons is optionally user-customizable. The touchscreen 112 is used to implement virtual buttons or soft buttons and one or more soft keyboards.

[0041] The touch-sensitive display 112 provides input and output interfaces between the device and the user. As described above, the touch operation and display operation of the touch-sensitive display 112 are optionally separated from each other, such that the display device is used for display purposes, while the touch-sensitive surface (whether or not a display) is used for input detection purposes, and the described components and functions are modified accordingly. However, for the sake of brevity, the following description refers to the touch-sensitive display. The display controller 156 receives electrical signals from and / or sends electrical signals to the touch screen 112. The touch screen 112 displays visual output to the user. The visual output optionally includes graphics, text, icons, video, and any combination thereof (collectively, "graphics"). In some embodiments, some or all of the visual output optionally correspond to user interface objects.

[0042] Touchscreen 112 has a touch-sensitive surface, sensor, or sensor array that accepts input from a user based on tactile and / or haptic contact. Touchscreen 112 and display controller 156 (along with any associated modules and / or instruction set in memory 102) detect contact on touchscreen 112 (and any movement or interruption of that contact) and translate the detected contact into interaction with user interface objects (e.g., one or more soft keys, icons, web pages, or images) displayed on touchscreen 112. In an exemplary embodiment, the point of contact between touchscreen 112 and the user corresponds to the user's finger.

[0043] Touchscreen 112 optionally employs LCD (Liquid Crystal Display) technology, LPD (Light Emitting Polymer Display) technology, or LED (Light Emitting Diode) technology, but other display technologies are used in other embodiments. Touchscreen 112 and display controller 156 optionally employ any of a variety of touch sensing technologies now known or to be developed hereafter, along with other proximity sensor arrays or other elements for determining one or more points of contact with touchscreen 112, to detect contact and any movement or interruption thereof. These various touch sensing technologies include, but are not limited to, capacitive, resistive, infrared, and surface acoustic wave technologies. In an exemplary embodiment, projected mutual capacitance sensing technology is used, such as in the iPhone from Apple Inc. (Cupertino, California). ® and iPod Touch ® The technology used.

[0044] In some embodiments of the touchscreen 112, the touch-sensitive display optionally resembles a multi-touch-sensitive touchpad described in the following U.S. patents: 6,323,846 (Westerman et al.), 6,570,557 (Westerman et al.), and / or 6,677,932 (Westerman et al.) and / or U.S. Patent Publication 2002 / 0015024A1, each of which is incorporated herein by reference in its entirety. However, the touchscreen 112 displays visual output from the device 100, while the touch-sensitive touchpad does not provide visual output.

[0045] Touch-sensitive displays in some embodiments of the touchscreen 112 are described in the following applications: (1) U.S. Patent Application No. 11 / 381,313, filed May 2, 2006, “Multipoint Touch Surface Controller”; (2) U.S. Patent Application No. 10 / 840,862, filed May 6, 2004, “Multipoint Touchscreen”; (3) U.S. Patent Application No. 10 / 903,964, filed July 30, 2004, “Gestures For Touch Sensitive Input Devices”; (4) U.S. Patent Application No. 11 / 048,264, filed January 31, 2005, “Gestures For Touch Sensitive Input Devices”; and (5) U.S. Patent Application No. 11 / 038,590, filed January 18, 2005, “Mode-Based Graphical User Interfaces For Touch Sensitive Input”. (6) U.S. Patent Application No. 11 / 228,758, filed September 16, 2005, “Virtual Input Device Placement On A Touch Screen User Interface”; (7) U.S. Patent Application No. 11 / 228,700, filed September 16, 2005, “Operation Of A Computer With A Touch Screen Interface”; (8) U.S. Patent Application No. 11 / 228,737, filed September 16, 2005, “Activating Virtual Keys Of A Touch-Screen Virtual Keyboard”; and (9) U.S. Patent Application No. 11 / 367,749, filed March 3, 2006, “Multi-Functional Hand-Held Device”. The entire contents of all these applications are incorporated herein by reference.

[0046] Touchscreen 112 optionally has a video resolution exceeding 100 dpi. In some embodiments, the touchscreen has a video resolution of approximately 160 dpi. Users optionally use any suitable object or accessory such as a stylus, finger, etc., to interact with touchscreen 112. In some embodiments, the user interface is designed to operate primarily through finger-based touch and gestures, which may be less precise than stylus-based input due to the larger contact area of ​​a finger on the touchscreen. In some embodiments, the device translates coarse finger-based input into precise pointer / cursor positions or commands to perform the user-desired actions.

[0047] In some embodiments, in addition to the touchscreen, device 100 optionally includes a touchpad (not shown) for activating or deactivating specific functions. In some embodiments, the touchpad is a touch-sensitive area of ​​the device that, unlike the touchscreen, does not display visual output. The touchpad is optionally a touch-sensitive surface separate from the touchscreen 112, or an extension of the touch-sensitive surface formed by the touchscreen.

[0048] The device 100 also includes a power system 162 for supplying power to various components. The power system 162 optionally includes a power management system, one or more power sources (e.g., a battery, alternating current (AC)), a recharging system, a power fault detection circuit, a power converter or inverter, a power status indicator (e.g., a light-emitting diode (LED)), and any other components associated with the generation, management, and distribution of power in the portable device.

[0049] The device 100 may optionally also include one or more optical sensors 164. Figure 1AAn optical sensor 164 is shown coupled to an optical sensor controller 158 in the I / O subsystem 106. The optical sensor 164 optionally includes a charge-coupled device (CCD) or a complementary metal-oxide-semiconductor (CMOS) phototransistor. The optical sensor 164 receives light projected through one or more lenses from the environment and converts the light into data representing an image. In conjunction with an imaging module 143 (also called a camera module), the optical sensor 164 optionally captures still images or video. In some embodiments, the optical sensor is located on the rear of the device 100, opposite to a touchscreen display 112 on the front of the device, allowing the touchscreen display to be used as a viewfinder for still image and / or video image acquisition. In some embodiments, the optical sensor is located on the front of the device, allowing images of the user to be optionally acquired for video conferencing while the user views other video conferencing participants on the touchscreen display. In some embodiments, the position of the optical sensor 164 can be changed by the user (e.g., by rotating the lenses and sensors in the device housing), allowing a single optical sensor 164 to be used in conjunction with the touchscreen display for both video conferencing and still image and / or video image acquisition.

[0050] The device 100 may optionally also include one or more contact strength sensors 165. Figure 1A A contact strength sensor is shown coupled to a strength sensor controller 159 in I / O subsystem 106. The contact strength sensor 165 optionally includes one or more piezoresistive strain gauges, capacitive force sensors, electro-force sensors, piezoelectric sensors, optical force sensors, capacitive touch-sensitive surfaces, or other strength sensors (e.g., sensors for measuring the force (or pressure) of contact on a touch-sensitive surface). The contact strength sensor 165 receives contact strength information (e.g., pressure information or a substitute for pressure information) from the environment. In some embodiments, at least one contact strength sensor is arranged juxtaposed with or adjacent to a touch-sensitive surface (e.g., touch-sensitive display system 112). In some embodiments, at least one contact strength sensor is located on the rear of device 100, opposite to the touchscreen display 112 located on the front of device 100.

[0051] The device 100 may optionally also include one or more proximity sensors 166. Figure 1AA proximity sensor 166 coupled to a peripheral device interface 118 is shown. Alternatively, the proximity sensor 166 may optionally be coupled to an input controller 160 in an I / O subsystem 106. The proximity sensor 166 may optionally perform as described in the following U.S. patent applications: 11 / 241,839, entitled "Proximity Detector In Handheld Device"; 11 / 240,788, entitled "Proximity Detector In Handheld Device"; 11 / 620,702, entitled "Using Ambient Light Sensor To Augment Proximity Sensor Output"; 11 / 586,862, entitled "Automated Response To And Sensing Of User Activity In Portable Devices"; and 11 / 638,251, entitled "Methods And Systems For Automatic Configuration Of Peripherals", the entire contents of which are incorporated herein by reference. In some implementations, when the multifunction device is placed near the user's ear (e.g., when the user is making a phone call), the proximity sensor is turned off and the touchscreen 112 is disabled.

[0052] The device 100 may optionally also include one or more tactile output generators 167. Figure 1A A haptic output generator coupled to a haptic feedback controller 161 in I / O subsystem 106 is shown. The haptic output generator 167 optionally includes one or more electroacoustic devices such as speakers or other audio components; and / or electromechanical devices for converting energy into linear motion, such as motors, solenoids, electroactive polymers, piezoelectric actuators, electrostatic actuators, or other haptic output generating components (e.g., components for converting electrical signals into haptic outputs on the device). A contact intensity sensor 165 receives haptic feedback generation instructions from a haptic feedback module 133 and generates a haptic output on device 100 that can be felt by a user of device 100. In some embodiments, at least one haptic output generator is juxtaposed or adjacent to a haptic surface (e.g., haptic display system 112) and optionally generates the haptic output by moving the haptic surface vertically (e.g., in / outward from the surface of device 100) or laterally (e.g., backward and forward in the same plane as the surface of device 100). In some embodiments, at least one haptic output generator sensor is located on the rear of the device 100, opposite to the touch screen display 112 located on the front of the device 100.

[0053] The device 100 optionally also includes one or more accelerometers 168. Figure 1A An accelerometer 168 coupled to a peripheral device interface 118 is shown. Alternatively, the accelerometer 168 may be coupled to an input controller 160 in an I / O subsystem 106. The accelerometer 168 may optionally perform as described in the following U.S. Patent Publications: 20050190059, entitled "Acceleration-based Theft Detection System for Portable Electronic Devices" and 20060017692, entitled "Methods And Apparatuses For Operating A Portable DeviceBased On An Accelerometer," both of which are incorporated herein by reference in their entirety. In some embodiments, information is displayed on a touchscreen display in portrait or landscape view based on analysis of data received from one or more accelerometers. Device 100 may optionally include, in addition to the accelerometer 168, a magnetometer (not shown) and a GPS (or GLONASS or other global navigation system) receiver (not shown) for acquiring information about the position and orientation (e.g., portrait or landscape) of device 100.

[0054] In some embodiments, the software components stored in memory 102 include an operating system 126, a communication module (or instruction set) 128, a contact / motion module (or instruction set) 130, a graphics module (or instruction set) 132, a text input module (or instruction set) 134, a Global Positioning System (GPS) module (or instruction set) 135, and an application program (or instruction set) 136. Furthermore, in some embodiments, memory 102 ( Figure 1A ) or 370 ( Figure 3 Storage device / global internal state 157, such as Figure 1A and Figure 3 As shown in the figure. Device / global internal state 157 includes one or more of the following: active application state, which indicates which applications (if any) are currently active; display state, indicating what applications, views or other information occupy various areas of the touch screen display 112; sensor state, including information obtained from the device's various sensors and input control devices 116; and position information relating to the device's position and / or orientation.

[0055] The operating system 126 (e.g., Darwin, RTXC, LINUX, UNIX, OS X, iOS, WINDOWS, or embedded operating systems such as VxWorks) includes various software components and / or drivers for controlling and managing general system tasks (e.g., memory management, storage device control, power management, etc.) and facilitates communication between various hardware and software components.

[0056] The communication module 128 facilitates communication with other devices via one or more external ports 124 and includes various software components for processing data received by the RF circuitry 108 and / or the external ports 124. The external ports 124 (e.g., Universal Serial Bus (USB), FireWire, etc.) are adapted to be directly coupled to other devices or indirectly coupled via a network (e.g., the Internet, wireless LAN, etc.). In some embodiments, the external port is for use with an iPod. ® The same or similar and / or compatible multi-pin (e.g., 30-pin) connectors used in Apple Inc. devices with a 30-pin connector.

[0057] The contact / motion module 130 optionally detects contact with the touchscreen 112 (in conjunction with the display controller 156) and other touch-sensitive devices (e.g., touchpads or physical click-based rotary dials). The contact / motion module 130 includes various software components for performing various operations related to contact detection, such as determining whether a contact has occurred (e.g., detecting a finger press event), determining the contact intensity (e.g., the force or pressure of the contact, or an alternative to force or pressure), determining whether there is movement of the contact and tracking movement on the touch-sensitive surface (e.g., detecting one or more finger drag events), and determining whether the contact has stopped (e.g., detecting a finger lift event or a contact break). The contact / motion module 130 receives contact data from the touch-sensitive surface. Determining the movement of the contact point optionally includes determining the rate (magnitude), velocity (magnitude and direction), and / or acceleration (change in magnitude and / or direction) of the contact point, the movement of which is represented by a series of contact data. These operations are optionally applied to single-point contact (e.g., single-finger contact) or multi-point simultaneous contact (e.g., "multi-touch" / multiple-finger contact). In some implementations, the contact / motion module 130 and the display controller 156 detect contact on the touchpad.

[0058] In some implementations, the contact / motion module 130 uses a set of one or more intensity thresholds to determine whether an operation has been performed by a user (e.g., determining whether the user has “clicked” an icon). In some implementations, at least a subset of the intensity thresholds is determined based on software parameters (e.g., the intensity thresholds are not determined by the activation threshold of a specific physical actuator and can be adjusted without changing the physical hardware of device 100). For example, the mouse “click” threshold of a touchpad or touchscreen can be set to any threshold in a wide range of predefined thresholds without changing the touchpad or touchscreen display hardware. Additionally, in some specific implementations, the user of the device is provided with software settings for adjusting one or more intensity thresholds in a set (e.g., by adjusting the individual intensity thresholds and / or by adjusting multiple intensity thresholds at once using system-level clicks on the “intensity” parameter).

[0059] The touch / motion module 130 optionally detects gesture input performed by the user. Different gestures on a touch-sensitive surface have different contact patterns (e.g., different movements, timings, and / or intensities of the detected contact). Therefore, gestures are optionally detected by detecting specific contact patterns. For example, detecting a finger tap gesture includes detecting a finger press event, and then detecting a finger lift-off (lift-away) event at the same (or substantially the same) location as the finger press event (e.g., at the location of an icon). As another example, detecting a finger swipe gesture on a touch-sensitive surface includes detecting a finger press event, then detecting one or more finger drag events, and subsequently detecting a finger lift-off (lift-away) event.

[0060] The graphics module 132 includes various known software components for rendering and displaying graphics on the touchscreen 112 or other displays, including components for altering the visual impact of the displayed graphics (e.g., brightness, transparency, saturation, contrast, or other visual properties). As used herein, the term "graphics" includes any object that can be displayed to a user, including but not limited to text, web pages, icons (such as user interface objects including soft keys), digital images, videos, animations, etc.

[0061] In some implementations, the graphics module 132 stores data representing the graphics to be used. Each graphic is optionally assigned a corresponding code. The graphics module 132 receives one or more codes from an application or the like to specify the graphic to be displayed, and, if necessary, also receives coordinate data and other graphic attribute data, and then generates screen image data for output to the display controller 156.

[0062] The haptic feedback module 133 includes various software components for generating instructions which are used by the haptic output generator 167 to generate haptic output at one or more locations on the device 100 in response to user interaction with the device 100.

[0063] Optionally, the text input module 134, a component of the graphics module 132, provides a soft keyboard for entering text in various applications, such as contacts 137, email 140, IM 141, browser 147, and any other application that requires text input.

[0064] GPS module 135 determines the location of the device and provides that information for use in various applications (e.g., to phone 138 for use in location-based dialing; to camera 143 as image / video metadata; and to applications that provide location-based services, such as weather widgets, local yellow pages widgets, and map / navigation widgets).

[0065] Application 136 optionally includes the following modules (or instruction sets) or subsets or supersets thereof:

[0066] ●Contacts module 137 (sometimes called address book or contact list);

[0067] ● Telephone module 138;

[0068] ●Video conferencing module 139;

[0069] ●Email client module 140;

[0070] ●Instant Messaging (IM) module 141;

[0071] ● Fitness support module 142;

[0072] ● Camera module 143 for still images and / or video images;

[0073] ●Image Management Module 144;

[0074] ●Video player module;

[0075] ●Music player module;

[0076] ● Browser module 147;

[0077] ● Calendar module 148;

[0078] ● Widget module 149, which optionally includes one or more of the following: weather widget 149-1, stock market widget 149-2, calculator widget 149-3, alarm clock widget 149-4, dictionary widget 149-5, and other widgets acquired by the user, and user-created widgets 149-6.

[0079] ● Wrapper module 150 for creating user-created widgets 149-6;

[0080] ●Search module 151;

[0081] ● Video and music player module 152, which combines a video player module and a music player module;

[0082] ●Notes module 153;

[0083] ●Map module 154; and / or

[0084] ● Online video module 155.

[0085] Examples of other applications 136 that may be optionally stored in memory 102 include other word processing applications, other image editing applications, drawing applications, rendering applications, Java-enabled applications, encryption, digital rights management, speech recognition, and speech duplication.

[0086] In conjunction with the touchscreen 112, display controller 156, touch / motion module 130, graphics module 132, and text input module 134, the contact module 137 is optionally used to manage an address book or contact list (e.g., in the application internal state 192 of the contact module 137 stored in memory 102 or memory 370), including: adding one or more names to the address book; deleting names from the address book; associating phone numbers, email addresses, physical addresses, or other information with names; associating images with names; categorizing and classifying names; providing phone numbers or email addresses to initiate and / or facilitate communications via telephone 138, video conferencing module 139, email 140, or IM 141; and so on.

[0087] Combining RF circuitry 108, audio circuitry 110, speaker 111, microphone 113, touchscreen 112, display controller 156, contact / motion module 130, graphics module 132, and text input module 134, telephone module 138 is optionally used to input character sequences corresponding to telephone numbers, access one or more telephone numbers in contact module 137, modify entered telephone numbers, dial corresponding telephone numbers, initiate conversations, and disconnect or hang up when a conversation is completed. As described above, wireless communication optionally uses any of a variety of communication standards, protocols, and technologies.

[0088] Combining RF circuitry 108, audio circuitry 110, speaker 111, microphone 113, touchscreen 112, display controller 156, optical sensor 164, optical sensor controller 158, contact / motion module 130, graphics module 132, text input module 134, contact module 137, and telephone module 138, video conferencing module 139 includes executable instructions to initiate, conduct, and terminate video conferences between the user and one or more other participants based on user instructions.

[0089] Incorporating RF circuitry 108, touchscreen 112, display controller 156, touch / motion module 130, graphics module 132, and text input module 134, email client module 140 includes executable instructions for creating, sending, receiving, and managing emails in response to user commands. Combined with image management module 144, email client module 140 makes it very easy to create and send emails containing still images or video images captured by camera module 143.

[0090] In conjunction with RF circuitry 108, touchscreen 112, display controller 156, touch / motion module 130, graphics module 132, and text input module 134, instant messaging module 141 includes executable instructions for: inputting a character sequence corresponding to an instant message, modifying previously input characters, transmitting a corresponding instant message (e.g., using Short Message Service (SMS) or Multimedia Messaging Service (MMS) protocols for telephone-based instant messaging or using XMPP, SIMPLE, or IMPS for internet-based instant messaging), receiving an instant message, and viewing a received instant message. In some embodiments, the transmitted and / or received instant messages optionally include graphics, photographs, audio files, video files, and / or other attachments supported in MMS and / or Enhanced Messaging Services (EMS). As used herein, "instant message" refers to both telephone-based messages (e.g., messages sent using SMS or MMS) and internet-based messages (e.g., messages sent using XMPP, SIMPLE, or IMPS).

[0091] Combining RF circuitry 108, touchscreen 112, display controller 156, touch / motion module 130, graphics module 132, text input module 134, GPS module 135, map module 154, and music player module, fitness support module 142 includes executable instructions for creating fitness (e.g., with time, distance, and / or calorie burning goals); communicating with fitness sensors (executive devices); receiving fitness sensor data; calibrating sensors used to monitor fitness; selecting and playing music for fitness; and displaying, storing, and transmitting fitness data.

[0092] In conjunction with the touchscreen 112, display controller 156, optical sensor 164, optical sensor controller 158, contact / motion module 130, graphics module 132, and image management module 144, camera module 143 includes executable instructions for: capturing still images or videos (including video streams) and storing them in memory 102, modifying the characteristics of still images or videos, or deleting still images or videos from memory 102.

[0093] Incorporating touchscreen 112, display controller 156, touch / motion module 130, graphics module 132, text input module 134, and camera module 143, image management module 144 includes executable instructions for arranging, modifying (e.g., editing), or otherwise manipulating, tagging, deleting, presenting (e.g., in a digital slideshow or album), and storing still images and / or video images.

[0094] Combining RF circuitry 108, touchscreen 112, display controller 156, touch / motion module 130, graphics module 132, and text input module 134, browser module 147 includes executable instructions for browsing the Internet according to user instructions, including searching, linking to, receiving, and displaying web pages or portions thereof, as well as links to attachments and other files on web pages.

[0095] Combining RF circuitry 108, touchscreen 112, display controller 156, touch / motion module 130, graphics module 132, text input module 134, email client module 140, and browser module 147, calendar module 148 includes executable instructions to create, display, modify, and store calendars and associated data (e.g., calendar entries, to-dos, etc.) according to user instructions.

[0096] In conjunction with RF circuitry 108, touchscreen 112, display controller 156, touch / motion module 130, graphics module 132, text input module 134, and browser module 147, widget module 149 is optionally a microapplication downloaded and used by a user (e.g., weather widget 149-1, stock market widget 149-2, calculator widget 149-3, alarm clock widget 149-4, and dictionary widget 149-5) or a user-created microapplication (e.g., user-created widget 149-6). In some embodiments, the widget includes HTML (Hypertext Markup Language) files, CSS (Cascading Style Sheets) files, and JavaScript files. In some embodiments, the widget includes XML (Extensible Markup Language) files and JavaScript files (e.g., Yahoo! widgets).

[0097] In conjunction with RF circuitry 108, touchscreen 112, display controller 156, touch / motion module 130, graphics module 132, text input module 134, and browser module 147, widget creator module 150 can optionally be used by the user to create widgets (e.g., to convert user-specified portions of a webpage into widgets).

[0098] In conjunction with the touchscreen 112, display controller 156, touch / motion module 130, graphics module 132, and text input module 134, the search module 151 includes executable instructions for searching the memory 102 for text, music, sound, images, videos, and / or other files that match one or more search criteria (e.g., one or more user-specified search terms) according to user instructions.

[0099] Incorporating touchscreen 112, display controller 156, touch / motion module 130, graphics module 132, audio circuitry 110, speaker 111, RF circuitry 108, and browser module 147, video and music player module 152 includes executable instructions allowing users to download and play back recorded music and other sound files stored in one or more file formats such as MP3 or AAC files, as well as executable instructions for displaying, presenting, or otherwise playing back video (e.g., on touchscreen 112 or on an external display connected via external port 124). In some embodiments, device 100 optionally includes the functionality of an MP3 player such as an iPod (a trademark of Apple Inc.).

[0100] Incorporating the touchscreen 112, display controller 156, touch / motion module 130, graphics module 132, and text input module 134, the note-taking module 153 includes executable instructions for creating and managing notes, to-do items, etc., according to user instructions.

[0101] Combining RF circuit 108, touch screen 112, display controller 156, contact / motion module 130, graphics module 132, text input module 134, GPS module 135 and browser module 147, map module 154 is optionally used to receive, display, modify and store maps and data associated with the maps (e.g., driving directions, data related to shops and other points of interest at or near a specific location, and other location-based data) according to user instructions.

[0102] Incorporating touchscreen 112, display controller 156, touch / motion module 130, graphics module 132, audio circuitry 110, speaker 111, RF circuitry 108, text input module 134, email client module 140, and browser module 147, the online video module 155 includes instructions for performing the following actions: allowing users to access, browse, receive (e.g., via streaming and / or downloading), play back (e.g., on the touchscreen or on an external display connected via external port 124), send emails with links to specific online videos, and otherwise manage online videos in one or more file formats such as H.264. In some embodiments, an instant messaging module 141 is used instead of the email client module 140 to send links to specific online videos. Further descriptions of the online video application can be found in U.S. Provisional Patent Application No. 60 / 936,562, filed June 20, 2007, entitled “Portable Multifunction Device, Method, and Graphical User Interface for Playing Online Videos,” and U.S. Patent Application No. 11 / 968,067, filed December 31, 2007, entitled “Portable Multifunction Device, Method, and Graphical User Interface for Playing Online Videos,” the contents of which are incorporated herein by reference in their entirety.

[0103] Each of the above modules and applications corresponds to an executable instruction set for performing one or more of the functions described above and the methods described in this patent application (e.g., computer-implemented methods and other information processing methods as described herein). These modules (e.g., instruction sets) need not be implemented as separate software programs, processes, or modules; therefore, various subsets of these modules may optionally be combined or otherwise rearranged in various embodiments. For example, a video player module may optionally be combined with a music player module into a single module (e.g., Figure 1A (e.g., video and music player module 152). In some embodiments, memory 102 optionally stores subgroups of the aforementioned modules and data structures. Additionally, memory 102 optionally stores other modules and data structures not described above.

[0104] In some implementations, device 100 is a device on which the operation of a predefined set of functions is performed solely via a touchscreen and / or touchpad. By using a touchscreen and / or touchpad as the primary input control device for operating device 100, the number of physical input control devices (e.g., push-buttons, dials, etc.) on device 100 is optionally reduced.

[0105] A predefined set of functions, uniquely performed via a touchscreen and / or touchpad, optionally includes navigation between user interfaces. In some embodiments, the touchpad, when touched by a user, navigates device 100 from any user interface displayed on device 100 to the main menu, main desktop menu, or root menu. In such embodiments, a "menu button" is implemented using the touchpad. In some other embodiments, the menu button is a physical push-button or other physical input control device, rather than a touchpad.

[0106] Figure 1B This is a block diagram illustrating exemplary components for event processing according to some embodiments. In some embodiments, memory 102 ( Figure 1A ) or memory 370 ( Figure 3 This includes an event classifier 170 (e.g., in operating system 126) and a corresponding application 136-1 (e.g., any one of the aforementioned applications 137 to 151, 155, 380 to 390).

[0107] Event classifier 170 receives event information and determines the application 136-1 and application view 191 of application 136-1 to which the event information should be delivered. Event classifier 170 includes event monitor 171 and event dispatcher module 174. In some embodiments, application 136-1 includes application internal state 192, which indicates one or more current application views displayed on touch-sensitive display 112 when the application is active or executing. In some embodiments, device / global internal state 157 is used by event classifier 170 to determine which application(s) is currently active, and application internal state 192 is used by event classifier 170 to determine the application view 191 to which the event information should be delivered.

[0108] In some implementations, the application internal state 192 includes additional information such as one or more of the following: recovery information to be used when the application 136-1 resumes execution, user interface state information indicating that information is being displayed or ready to be displayed by the application 136-1, a state queue for enabling the user to return to the previous state or view of the application 136-1, and a repeat / undo queue for the user's previous actions.

[0109] Event monitor 171 receives event information from peripheral interface 118. The event information includes information about sub-events, such as a user touch on touch-sensitive display 112 as part of a multi-touch gesture. Peripheral interface 118 transmits information it receives from I / O subsystem 106 or sensors such as proximity sensor 166, one or more accelerometers 168, and / or microphone 113 (via audio circuitry 110). The information received by peripheral interface 118 from I / O subsystem 106 includes information from touch-sensitive display 112 or touch-sensitive surfaces.

[0110] In some implementations, event monitor 171 sends requests to peripheral device interface 118 at predetermined intervals. In response, peripheral device interface 118 transmits event information. In other implementations, peripheral device interface 118 transmits event information only when a significant event occurs (e.g., receiving input above a predetermined noise threshold and / or receiving input for a predetermined duration).

[0111] In some implementations, the event classifier 170 also includes a hit view determination module 172 and / or an activity event recognizer determination module 173.

[0112] When the touch-sensitive display 112 displays more than one view, the hit view determination module 172 provides a software process for determining where a sub-event has occurred within one or more views. A view consists of controls and other elements that the user can see on the display.

[0113] Another aspect of the user interface associated with an application is a set of views, sometimes referred to herein as application views or user interface windows, in which information is displayed and touch-based gestures occur. The application view (of the corresponding application) in which a touch is detected optionally corresponds to a procedural level within the application's procedural or view hierarchy. For example, the lowest-level view in which a touch is detected is optionally referred to as the hit view, and the set of events identified as correct input is optionally determined at least in part based on the hit view of the initial touch that initiates a touch-based gesture.

[0114] The hit view determination module 172 receives information related to sub-events of touch-based gestures. When an application has multiple views organized in a hierarchical structure, the hit view determination module 172 identifies the hit view as the lowest-level view in the hierarchical structure from which the sub-events should be processed. In most cases, the hit view is the lowest-level view in which the initiating sub-event (e.g., the first sub-event in a sequence of sub-events forming an event or potential event) occurs. Once the hit view is identified by the hit view determination module 172, the hit view typically receives all sub-events related to the same touch or input source to which it was identified as the hit view.

[0115] The activity event recognizer determination module 173 determines which views(s) within the view hierarchy should receive a specific sub-event sequence. In some embodiments, the activity event recognizer determination module 173 determines that only the hit view should receive the specific sub-event sequence. In other embodiments, the activity event recognizer determination module 173 determines that all views including the physical location of the sub-event are actively participating views, and therefore determines that all actively participating views should receive the specific sub-event sequence. In other embodiments, even if the touch sub-event is entirely confined to the area associated with a particular view, higher views in the hierarchy will still remain actively participating views.

[0116] Event assigner module 174 assigns event information to event identifiers (e.g., event identifier 180). In embodiments that include active event identifier determination module 173, event assigner module 174 delivers event information to the event identifier determined by active event identifier determination module 173. In some embodiments, event assigner module 174 stores event information in an event queue, which is retrieved by the corresponding event receiver 182.

[0117] In some embodiments, operating system 126 includes event classifier 170. Alternatively, application 136-1 includes event classifier 170. In yet another embodiment, event classifier 170 is a standalone module or part of another module (such as contact / motion module 130) stored in memory 102.

[0118] In some embodiments, application 136-1 includes a plurality of event handlers 190 and one or more application views 191, each of which includes instructions for handling touch events occurring within a corresponding view of the application's user interface. Each application view 191 of application 136-1 includes one or more event recognizers 180. Typically, a corresponding application view 191 includes a plurality of event recognizers 180. In other embodiments, one or more of the event recognizers 180 are part of a separate module, such as a user interface toolkit (not shown) or a higher-level object from which application 136-1 inherits methods and other properties. In some embodiments, a corresponding event handler 190 includes one or more of the following: a data updater 176, an object updater 177, a GUI updater 178, and / or event data 179 received from an event classifier 170. Event handlers 190 optionally utilize or invoke the data updater 176, the object updater 177, or the GUI updater 178 to update the application's internal state 192. Alternatively, one or more application views in application view 191 include one or more corresponding event handlers 190. Additionally, in some embodiments, one or more of data updater 176, object updater 177, and GUI updater 178 are included in the corresponding application view 191.

[0119] The corresponding event recognizer 180 receives event information (e.g., event data 179) from the event classifier 170 and identifies the event based on the event information. The event recognizer 180 includes an event receiver 182 and an event comparator 184. In some embodiments, the event recognizer 180 also includes at least one subset of metadata 183 and event delivery instructions 188 (which optionally include sub-event delivery instructions).

[0120] Event receiver 182 receives event information from event classifier 170. The event information includes information about sub-events, such as touch or touch movement. Depending on the sub-event, the event information also includes additional information, such as the location of the sub-event. When the sub-event involves touch movement, the event information optionally also includes the rate and direction of the sub-event. In some embodiments, the event includes the device rotating from one orientation to another (e.g., from a longitudinal orientation to a lateral orientation, or vice versa), and the event information includes corresponding information about the device's current orientation (also referred to as device orientation).

[0121] Event comparator 184 compares event information with predefined event or sub-event definitions and determines the event or sub-event based on the comparison, or determines or updates the state of the event or sub-event. In some embodiments, event comparator 184 includes event definition 186. Event definition 186 contains definitions of events (e.g., predefined sequences of sub-events), such as event 1 (187-1), event 2 (187-2), and others. In some embodiments, sub-events in event (187) include, for example, touch start, touch end, touch move, touch cancel, and multi-touch. In one example, event 1 (187-1) is defined as a double-click on a displayed object. For example, a double-click includes a first touch (touch start) of a predetermined duration on the displayed object, a first lift-off of a predetermined duration (touch end), a second touch (touch start) of a predetermined duration on the displayed object, and a second lift-off of a predetermined duration (touch end). In another example, event 2 (187-2) is defined as a drag on a displayed object. For example, dragging includes a touch (or contact) on the displayed object for a predetermined duration, movement of the touch on the touch-sensitive display 112, and lifting the touch (end of touch). In some embodiments, the event also includes information for one or more associated event handlers 190.

[0122] In some implementations, event definition 187 includes definitions of events for corresponding user interface objects. In some implementations, event comparator 184 performs a hit test to determine which user interface object is associated with the sub-event. For example, in an application view displaying three user interface objects on touch-sensitive display 112, when a touch is detected on touch-sensitive display 112, event comparator 184 performs a hit test to determine which of the three user interface objects is associated with the touch (sub-event). If each displayed object is associated with a corresponding event handler 190, the event comparator uses the result of the hit test to determine which event handler 190 should be activated. For example, event comparator 184 selects the event handler associated with the sub-event and the object that triggered the hit test.

[0123] In some implementations, the definition of the corresponding event (187) also includes a delay action that delays the delivery of event information until it has been determined whether the sub-event sequence actually corresponds to or does not correspond to the event type of the event recognizer.

[0124] When the corresponding event recognizer 180 determines that the sub-event sequence does not match any event in event definition 186, the corresponding event recognizer 180 enters an event impossible, event failed, or event ended state, after which subsequent sub-events based on touch gestures are ignored. In this case, other event recognizers (if any) that remain active in the hit view continue to track and process the ongoing sub-events based on touch gestures.

[0125] In some embodiments, the corresponding event recognizer 180 includes metadata 183 having configurable attributes, flags, and / or lists instructing how the event delivery system should perform sub-event delivery to actively participating event recognizers. In some embodiments, the metadata 183 includes configurable attributes, flags, and / or lists instructing how or how event recognizers can interact with each other. In some embodiments, the metadata 183 includes configurable attributes, flags, and / or lists instructing whether sub-events are delivered to different levels in a view or programmatic hierarchy.

[0126] In some implementations, when one or more specific sub-events of an event are identified, the corresponding event recognizer 180 activates the event handler 190 associated with the event. In some implementations, the corresponding event recognizer 180 delivers event information associated with the event to the event handler 190. Activating the event handler 190 is different from sending (and delaying) the sub-events to the corresponding hit view. In some implementations, the event recognizer 180 throws a flag associated with the identified event, and the event handler 190 associated with that flag retrieves the flag and executes a predefined process.

[0127] In some implementations, event delivery instruction 188 includes a sub-event delivery instruction that delivers event information about a sub-event without activating an event handler. Instead, the sub-event delivery instruction delivers the event information to an event handler associated with the sub-event sequence or to an actively participating view. The event handler associated with the sub-event sequence or the actively participating view receives the event information and executes a predetermined process.

[0128] In some implementations, data updater 176 creates and updates data used in application 136-1. For example, data updater 176 updates phone numbers used in contact module 137 or stores video files used in video player module. In some implementations, object updater 177 creates and updates objects used in application 136-1. For example, object updater 177 creates new user interface objects or updates the location of user interface objects. GUI updater 178 updates the GUI. For example, GUI updater 178 prepares display information and sends the display information to graphics module 132 for display on touch-sensitive display.

[0129] In some implementations, event handler 190 includes, or has access to, a data updater 176, an object updater 177, and a GUI updater 178. In some implementations, data updater 176, object updater 177, and GUI updater 178 are included in a single module of the corresponding application 136-1 or application view 191. In other implementations, they are included in two or more software modules.

[0130] It should be understood that the above discussion regarding event handling for user touch on a touch-sensitive display also applies to other forms of user input used to operate the multifunction device 100 using an input device, and not all user input is initiated on the touchscreen. For example, mouse movement and mouse button presses optionally in conjunction with single or multiple keyboard presses or holds; touch movements on the touchpad, such as taps, drags, scrolls, etc.; stylus input; device movement; verbal commands; detected eye movements; biometric input; and / or any combination thereof may optionally be used as input corresponding to sub-events that define the event to be identified.

[0131] Figure 2 A portable or non-portable multifunction device 100 with a touchscreen 112 is shown according to some embodiments. As described above, the multifunction device 100 is described as having various structures shown (such as touchscreen 112, speaker 111, accelerometer 168, microphone 113, etc.); however, it should be understood that these structures optionally reside on separate devices. For example, display-related structures (e.g., display, speaker, etc.) and / or functions optionally reside on separate display devices, input-related structures (e.g., touch-sensitive surface, microphone, accelerometer, etc.) and / or functions optionally reside on separate input devices, and other structures and / or functions optionally reside on the multifunction device 100.

[0132] Touchscreen 112 optionally displays one or more graphics within user interface (UI) 200. In this embodiment and other embodiments described below, a user can select one or more graphics by gesturing over the graphics, for example, using one or more fingers 202 (not drawn to scale in the diagram) or one or more styluses 203 (not drawn to scale in the diagram). In some embodiments, selection of one or more graphics occurs when the user breaks contact with one or more graphics. In some embodiments, gestures optionally include one or more taps, one or more swipes (from left to right, from right to left, up and / or down), and / or scrolling (from right to left, from left to right, up and / or down) of a finger that has been in contact with device 100. In some embodiments or in some cases, unintentional contact with a graphic does not select the graphic. For example, a swipe gesture over an application icon optionally does not select the corresponding application when the gesture corresponding to selection is a tap.

[0133] Device 100 optionally also includes one or more physical buttons, such as a "main desktop" or menu button 204. As previously described, menu button 204 is optionally used to navigate to any application 136 of a set of applications optionally executed on device 100. Alternatively, in some embodiments, the menu button is implemented as a soft key in a GUI displayed on touchscreen 112.

[0134] In some embodiments, device 100 includes a touchscreen 112, a menu button 204, a push-button 206 for powering on / off and locking the device, one or more volume control buttons 208, a SIM card slot 210, a headset jack 212, and a docking / charging external port 124. The push-button 206 is optionally used to power on / off the device by pressing the button and holding it in the pressed state for a predefined time interval; to lock the device by pressing the button and releasing it before the predefined time interval has elapsed; and / or to unlock the device or initiate an unlocking process. In another embodiment, device 100 also accepts voice input via microphone 113 for activating or deactivating certain functions. Device 100 also optionally includes one or more contact strength sensors 165 for detecting the intensity of contact on the touchscreen 112, and / or one or more haptic output generators 167 for generating haptic outputs for a user of device 100.

[0135] Figure 3This is a block diagram of an exemplary multifunctional device having a display and a touch-sensitive surface according to some embodiments. As described above, device 300 includes a display and a touch-sensitive surface, and in some embodiments, optionally communicates with displays and touch-sensitive surfaces on other devices. Additionally, device 300 need not be portable. In some embodiments, device 300 is a laptop computer, desktop computer, tablet computer, multimedia player device (such as a television or set-top box), navigation device, educational device (such as a children's learning toy), gaming system, or control device (e.g., a home or industrial controller). Device 300 typically includes one or more processing units (CPUs) 310, one or more network or other communication interfaces 360, memory 370, and one or more communication buses 320 for interconnecting these components. The communication bus 320 optionally includes circuitry (sometimes referred to as a chipset) that interconnects system components and controls communication between system components. Device 300 includes an input / output (I / O) interface 330 with a display 340, which is typically a touchscreen display. I / O interface 330 may also optionally include keyboard and / or mouse (or other pointing device) 350 and touchpad 355, and haptic output generator 357 for generating haptic output on device 300 (e.g., similar to the reference above). Figure 1A The tactile output generator 167 and sensor 359 (e.g., optical sensor, accelerometer, proximity sensor, touch sensor and / or contact intensity sensor (similar to the above reference)) are described. Figure 1A The contact strength sensor 165 is mentioned above. The memory 370 includes high-speed random access memory, such as DRAM, SRAM, DDR RAM, or other random access solid-state memory devices; and optionally includes non-volatile memory, such as one or more disk storage devices, optical disk storage devices, flash memory devices, or other non-volatile solid-state memory devices. The memory 370 optionally includes one or more storage devices located remotely from the CPU 310. In some embodiments, the memory 370 stores programs, modules, and data structures or subsets thereof, which are similar to portable or non-portable multifunction device 100. Figure 1A The memory 370 stores programs, modules, and data structures in the memory 102 of the portable or non-portable multifunction device 100. Additionally, the memory 370 optionally stores additional programs, modules, and data structures not present in the memory 102 of the portable or non-portable multifunction device 100. For example, the memory 370 of the device 300 optionally stores a drawing module 380, a rendering module 382, ​​a word processing module 384, a website creation module 386, a disk editing module 388, and / or a spreadsheet module 390, while the portable or non-portable multifunction device 100 (… Figure 1A The memory 102 may optionally not store these modules.

[0136] Figure 3 Each of the elements described above is optionally stored in one or more memory devices of the previously mentioned memory devices. Each of the modules described above corresponds to an instruction set for performing the functions described above. The modules or programs (e.g., instruction sets) described above need not be implemented as separate software programs, processes, or modules, and therefore various subsets of these modules are optionally combined or otherwise rearranged in various embodiments. In some embodiments, memory 370 optionally stores a subgroup of the modules and data structures described above. In addition, memory 370 optionally stores additional modules and data structures not described above.

[0137] Now let’s turn our attention to the implementation of the user interface, which is optionally implemented on, for example, a portable multifunction device 100.

[0138] Figure 4A An exemplary user interface for an application menu on a portable multifunction device 100 according to some embodiments is shown. A similar user interface is optionally implemented on device 300. In some embodiments, user interface 400 includes the following elements or a subset or superset thereof:

[0139] ●Signal strength indicator 402 for wireless communications such as cellular signals and Wi-Fi signals;

[0140] ●Time 404;

[0141] ●Bluetooth indicator 405;

[0142] ● Battery status indicator 406;

[0143] ● Tray 408 features icons for commonly used applications, such as:

[0144] ○ The telephone module 138 has an icon 416 labeled "telephone", which optionally includes an indicator 414 indicating the number of missed calls or voicemail messages;

[0145] ○ An icon 418 labeled "Mail" in the email client module 140, which optionally includes an indicator 410 for the number of unread emails;

[0146] ○ The icon 420 labeled "Browser" in browser module 147; and

[0147] ○ The icon 422 marked "iPod" for the video and music player module 152 (also known as the iPod module 152, a trademark of Apple Inc.); and

[0148] ● Icons of other applications, such as:

[0149] ○The icon 424 of the IM module 141 marked as "Message";

[0150] ○The calendar module 148 has an icon 426 labeled "Calendar";

[0151] ○ The icon 428 of the image management module 144 is labeled "Photo".

[0152] ○ The icon 430 of camera module 143, which is labeled "camera";

[0153] ○ The icon 432 of the online video module 155, which is labeled "Online Video";

[0154] ○ The icon 434 labeled "Stock Market" in the Stock Market widget 149-2;

[0155] ○The icon 436 of the map module 154 that is labeled "map";

[0156] ○The weather widget 149-1 has icon 438 labeled "weather";

[0157] ○ The alarm clock widget 149-4 has an icon 440 labeled "clock";

[0158] ○ The icon 442 of the fitness support module 142 is labeled "fitness support";

[0159] ○ The icon 444 labeled "Notes" in Notes module 153; and

[0160] ○ The icon 446, labeled "Settings," is used to set the settings of the device 100 and its various applications 136.

[0161] It should be pointed out that, Figure 4A The icon labels shown are merely exemplary. For example, icon 422 of video and music player module 152 is labeled "Music" or "Music Player". Other labels may be optionally used for various application icons. In some embodiments, the label of a particular application icon includes the name of the application corresponding to that particular application icon. In some embodiments, the label of a particular application icon is different from the name of the application corresponding to that particular application icon.

[0162] Figure 4B A touch-sensitive surface 451 (e.g., separate from the display 450 (e.g., touchscreen display 112)) is shown. Figure 3 Devices such as tablets or touchpads (e.g., 355) Figure 3An exemplary user interface on the device 300. The device 300 also optionally includes one or more contact intensity sensors (e.g., one or more of the sensors 359) for detecting the intensity of contact on the tactile surface 451 and / or one or more tactile output generators 357 for generating tactile outputs for the user of the device 300.

[0163] While some examples of input on a reference touchscreen display 112 (which combines a touch-sensitive surface and a display) are given below, in some implementations the device detects input on a touch-sensitive surface separate from the display, such as... Figure 4B As shown in the diagram. In some embodiments, the touch-sensitive surface (e.g., Figure 4B 451) has a spindle (e.g., on the display (e.g., 450) with the spindle on the display (e.g., 451). Figure 4B The main axis corresponding to 453 in the middle (e.g., Figure 4B (452 in the example). According to these embodiments, the device detects the position corresponding to the corresponding position on the display (e.g., in the example). Figure 4B In the diagram, 460 corresponds to 468 and 462 corresponds to 470) is in contact with the touch-sensitive surface 451 (e.g., Figure 4B (460 and 462 in the text). Thus, when the touch-sensitive surface (e.g., ...) Figure 4B 451 in the middle) and the display of a multi-functional device (e.g., Figure 4B When 450 is separated from the touch-sensitive surface, user input detected by the device on that touch-sensitive surface (e.g., touches 460 and 462 and their movement) is used by the device to manipulate the user interface on the display. It should be understood that similar methods may be optionally used for other user interfaces described herein.

[0164] Additionally, while the examples below are primarily given with reference to finger input (e.g., finger touch, single-finger tap, finger swipe), it should be understood that in some implementations, one or more of these finger inputs may be replaced by input from another input device (e.g., mouse-based input or stylus input). For example, a swipe gesture may optionally be replaced by a mouse click (e.g., instead of a touch), followed by movement of the cursor along the swipe path (e.g., instead of movement of the touch). Similarly, a tap gesture may optionally be replaced by a mouse click while the cursor is over the location of the tap gesture (e.g., instead of detection of touch, followed by cessation of touch detection). Likewise, when multiple user inputs are detected simultaneously, it should be understood that multiple computer mice may optionally be used simultaneously, or mouse and finger touch may optionally be used simultaneously.

[0165] Additionally, while the examples below are primarily given with reference to finger input (e.g., finger touch, single-finger tap, finger swipe), it should be understood that in some implementations, one or more of these finger inputs may be replaced by input from another input device (e.g., mouse-based input or stylus input). For example, a swipe gesture may optionally be replaced by a mouse click (e.g., instead of a touch), followed by movement of the cursor along the swipe path (e.g., instead of movement of the touch). Similarly, a tap gesture may optionally be replaced by a mouse click while the cursor is over the location of the tap gesture (e.g., instead of detection of touch, followed by cessation of touch detection). Likewise, when multiple user inputs are detected simultaneously, it should be understood that multiple computer mice may optionally be used simultaneously, or mouse and finger touch may optionally be used simultaneously.

[0166] As used herein, the term "focus selector" refers to an input element used to indicate the current portion of a user interface with which a user is interacting. In some specific implementations that include a cursor or other positional marker, the cursor acts as a "focus selector," such that when the cursor is over a particular user interface element (e.g., a button, window, slider, or other user interface element), the cursor is positioned on a touch-sensitive surface (e.g., a...). Figure 3 The touchpad 355 or Figure 4B When an input (e.g., a press input) is detected on the touch-sensitive surface 451 of the device, the specific user interface element adjusts according to the detected input. This applies to touchscreen displays (e.g., those enabling direct interaction with user interface elements on a touchscreen display) that include... Figure 1AIn some embodiments of the touch-sensitive display system 112, a touch detected on the touchscreen acts as a "focus selector," causing the specific user interface element to be adjusted based on the detected input when input (e.g., a press input via a touch) is detected at the location of a specific user interface element (e.g., a button, window, slider, or other user interface element) on the touchscreen display. In some embodiments, focus moves from one area of ​​the user interface to another without corresponding movement of the cursor or movement of a touch on the touchscreen display (e.g., moving focus from one button to another using tab keys or arrow keys); in these embodiments, the focus selector moves based on the movement of focus between different areas of the user interface. Regardless of the specific form the focus selector takes, the focus selector is typically a user-controlled user interface element (or a touch on the touchscreen display) that transmits the user's expected interaction with the user interface (e.g., by indicating to the device the user interface element with which the user expects to interact). For example, when a press input is detected on a touch-sensitive surface (e.g., a touchpad or touchscreen), the position of the focus selector (e.g., a cursor, touch, or selection box) above the corresponding button will indicate to the user that they expect to activate the corresponding button (rather than other user interface elements shown on the device's display).

[0167] As used in the specification and claims, the term "characteristic intensity" of a contact refers to a characteristic of the contact based on one or more intensities of the contact. In some embodiments, the characteristic intensity is based on multiple intensity samples. The characteristic intensity is optionally based on a predefined number of intensity samples or a set of intensity samples collected over a predetermined time period (e.g., 0.05 seconds, 0.1 seconds, 0.2 seconds, 0.5 seconds, 1 second, 2 seconds, 5 seconds, 10 seconds) relative to a predefined event (e.g., after contact is detected, before contact is detected to be lifted, before or after contact begins to move, before contact ends, before or after contact intensity is detected to increase, and / or before or after contact intensity decreases). The characteristic intensity of the contact is optionally based on one or more of the following: the maximum value of the contact intensity, the mean value of the contact intensity, the average value of the contact intensity, the value at the top 10% of the contact intensity, the half maximum value of the contact intensity, the 90% maximum value of the contact intensity, etc. In some embodiments, the duration of the contact is used when determining the characteristic intensity (e.g., when the characteristic intensity is the average value of the contact intensity over time). In some implementations, the feature intensity is compared to a set of one or more intensity thresholds to determine whether the user has performed an action. For example, the set of one or more intensity thresholds may optionally include a first intensity threshold and a second intensity threshold. In this example, contact with a feature intensity not exceeding the first threshold results in a first action, contact with a feature intensity exceeding the first intensity threshold but not exceeding the second intensity threshold results in a second action, and contact with a feature intensity exceeding the second threshold results in a third action. In some implementations, a comparison between the feature intensity and one or more thresholds is used to determine whether to perform one or more actions (e.g., whether to perform the corresponding action or abandon its execution) rather than to determine whether to perform the first or second action.

[0168] In some embodiments described herein, one or more operations are performed in response to detecting a gesture including a corresponding press input or in response to detecting a corresponding press input performed using a corresponding contact (or multiple contacts), wherein the corresponding press input is detected at least in part based on detecting that the intensity of the contact (or multiple contacts) increases to above a press input intensity threshold. In some embodiments, the corresponding operation is performed in response to detecting that the intensity of the corresponding contact increases to above a press input intensity threshold (e.g., a "downward stroke" of the corresponding press input). In some embodiments, the press input includes the intensity of the corresponding contact increasing to above a press input intensity threshold and the intensity of the contact subsequently decreasing to below the press input intensity threshold, and the corresponding operation is performed in response to detecting that the intensity of the corresponding contact subsequently decreases to below the press input threshold (e.g., an "upward stroke" of the corresponding press input).

[0169] In some implementations, the device employs intensity hysteresis to avoid unintended inputs sometimes referred to as "jitter," wherein the device defines or selects a hysteresis intensity threshold that has a predefined relationship with a press input intensity threshold (e.g., the hysteresis intensity threshold is X intensity units lower than the press input intensity threshold, or the hysteresis intensity threshold is 75%, 90%, or some reasonable percentage of the press input intensity threshold). Therefore, in some implementations, a press input includes an increase in the intensity of the corresponding contact above the press input intensity threshold and a subsequent decrease in the intensity of that contact below the hysteresis intensity threshold corresponding to the press input intensity threshold, and an operation is performed in response to detecting that the intensity of the corresponding contact subsequently decreases below the hysteresis intensity threshold (e.g., an "upstroke" of the corresponding press input). Similarly, in some implementations, a press input is detected only when the device detects that the contact intensity increases from an intensity equal to or below the hysteresis intensity threshold to an intensity equal to or above the press input intensity threshold and optionally the contact intensity subsequently decreases to an intensity equal to or below the hysteresis intensity threshold, and an operation is performed in response to detecting a press input (e.g., an increase or decrease in contact intensity depending on the environment).

[0170] For ease of explanation, optionally, the description of an operation triggered in response to a press input associated with a press input strength threshold or in response to a gesture including a press input is provided in response to detecting any of the following conditions: the contact strength increases to above the press input strength threshold, the contact strength increases from below a hysteresis strength threshold to above the press input strength threshold, the contact strength decreases to below the press input strength threshold, and / or the contact strength decreases to below the hysteresis strength threshold corresponding to the press input strength threshold. Additionally, in the example where the operation is described as being performed in response to detecting a decrease in contact strength below the press input strength threshold, the operation is optionally performed in response to detecting a decrease in contact strength below a hysteresis strength threshold corresponding to and less than the press input strength threshold.

[0171] Figure 5A A block diagram of an exemplary architecture for device 500 according to some embodiments of this disclosure is shown. Figure 5A In this implementation, media content or other content is optionally received by device 500 via network interface 502, which is optionally a wireless or wired connection. One or more processors 504 optionally execute any number of programs stored in memory 506 or a storage device, the programs optionally including instructions for performing one or more of the methods and / or processes described herein (e.g., methods 700 and 900).

[0172] In some embodiments, the display controller 508 causes various user interfaces of this disclosure to be displayed on the display 514. Additionally, input to the device 500 is optionally provided by a remote controller 510 via a remote controller interface 512, which is optionally a wireless or wired connection. In some embodiments, input to the device 500 is provided by a multifunction device 511 (e.g., a smartphone) running a remote application that configures the multifunction device to simulate remote control functionality, as will be described in more detail below. In some embodiments, the multifunction device 511 corresponds to... Figure 1A and Figure 2 Equipment 100 and Figure 3 One or more of the 300 devices mentioned above. It should be understood that... Figure 5A The implementation scheme does not imply limitation on the features of the device described herein, and other components that are advantageous to other features described herein may also be optionally included. Figure 5A In the architecture. In some implementations, device 500 optionally corresponds to Figure 1A and Figure 2 Multifunctional device 100 and Figure 3 One or more of the devices 300; network interface 502 optionally corresponds to Figure 1A and Figure 2 The RF circuit 108, external port 124, and peripheral device interface 118 are included. Figure 3 One or more of the network communication interfaces 360; the processor 504 optionally corresponds to Figure 1A The processor 120 and Figure 3 One or more of the CPUs 310; the display controller 508 optionally corresponds to Figure 1A The display controller 156 and Figure 3 One or more of the I / O interfaces 330; memory 506 optionally corresponds to Figure 1A The memory 102 and Figure 3 One or more of the memory 370 in the memory; the remote control interface 512 optionally corresponds to Figure 1A The peripheral device interface 118 and I / O subsystem 106 (and / or its components) and Figure 3 One or more of the I / O interfaces 330; the remote control 512 optionally corresponds to and / or includes Figure 1A The system includes a speaker 111, a touch-sensitive display system 112, a microphone 113, an optical sensor 164, a contact intensity sensor 165, a tactile output generator 167, other input control devices 116, an accelerometer 168, a proximity sensor 166, and an I / O subsystem 106. Figure 3 The keyboard / mouse 350, touchpad 355, haptic output generator 357, and contact intensity sensor 359 are included. Figure 4B One or more of the touch-sensitive surfaces 451; and the display 514 optionally corresponds to one or more of the following: Figure 1A and Figure 2 The touch-sensitive display system 112 in the middle, and Figure 3 The monitor in the middle is 340.

[0173] Figure 5B Exemplary structures of a remote controller 510 according to some embodiments of the present disclosure are shown. In some embodiments, the remote controller 510 optionally corresponds to Figure 1A and Figure 2 Multifunctional device 100 and Figure 3One or more devices in device 300. Remote control 510 optionally includes a touch-sensitive surface 451. As described above in this disclosure, touch-sensitive surface 451 is optionally capable of sensing contact and contact intensity (e.g., clicking touch-sensitive surface 451). Furthermore, touch-sensitive surface 451 optionally includes a mechanical actuator for providing physical button click functionality (e.g., touch-sensitive surface 451 is "clickable" to provide a corresponding input to device 500). Remote control 510 also optionally includes buttons 516, 518, 520, 522, 524, 526, 527, and 529. Buttons 516, 518, 520, 522, 524, 526, 527, and 529 are optionally mechanical buttons or mechanical button alternatives capable of sensing contact with or pressing of such buttons to initiate a corresponding action on, for example, device 500. In some implementations, a user's selection of the "Back" button 516 navigates backward through the currently running application or the currently displayed user interface (e.g., back to a user interface that was displayed before the currently displayed user interface), or navigates the device 500 to a user interface at a higher level than the currently displayed user interface. In some implementations, a user's selection of the "TV" button 518 navigates the device 500 from any user interface displayed on the device 500 to the main user interface, main desktop user interface, media browsing user interface, or root user interface (e.g., navigating to the main desktop screen of one or more applications optionally accessible on the device 500, or navigating to the media browsing user interface of the device 500 that includes a representation of media available for viewing via the device 500). In some implementations, selecting the "TV" button 518 causes the electronic device to navigate to a unified media browsing application. In some implementations, the user's selection of the "Play / Pause" button 520 toggles between playing and pausing the currently playing content item on device 500 (e.g., if the content item is playing on device 500 when the "Play / Pause" button 520 is selected, the content item is optionally paused, and if the content item is paused on device 500 when the "Play / Pause" button 520 is selected, the content item is optionally played). In some implementations, the user's selection of the "+" 522 or "-" 524 buttons increases or decreases the volume of the audio reproduced by device 500 (e.g., the volume of the content item currently playing on device 500), respectively. In some implementations, the user's selection of the "Audio Input" button 526 (e.g., optionally a button on the side surface of remote control 510, rather than a button on the surface of remote control 510 including buttons 516, 518, 520, 522, 524, and 527) allows the user to provide audio input (e.g., voice input) to device 500, optionally to a voice assistant on the device.In some embodiments, the remote control 510 includes a microphone via which a user provides audio input to the device 500 when selecting the "Audio Input" button 526. In some embodiments, the remote control 510 includes one or more accelerometers for detecting information about motion of the remote control. In some embodiments, selection of the "Mute" button 527 triggers the on / off switching of audio reproduced by the device 500. In some embodiments, selection of the "Power" button 529 causes the device 500 (and / or external devices coupled to the device 500, such as a display 514) to switch between entering or exiting a low-power state or a power-off state.

[0174] Figure 5C An exemplary personal electronic device 500 is depicted. In some embodiments, device 500 may include a reference retrieval system. Figure 1A , Figure 1B and Figure 3 Some or all of the components described herein. Device 500 has a bus 512 that operatively couples I / O portion 514 to one or more computer processors 516 and memory 518. I / O portion 514 may be connected to display 504, which may have touch-sensitive components 522 and optionally have an intensity sensor 524 (e.g., a contact intensity sensor). Furthermore, I / O portion 514 may be connected to communication unit 530 for receiving application and operating system data using Wi-Fi, Bluetooth, near field communication (NFC), cellular, and / or other wireless communication technologies. Device 500 may include input mechanisms 506 and / or 508. For example, input mechanism 506 may optionally be a rotatable input device or a pressable input device and a rotatable input device. In some examples, input mechanism 508 may optionally be a button.

[0175] In some examples, the input mechanism 508 is optionally a microphone. The personal electronic device 500 optionally includes various sensors, such as a GPS sensor 532, an accelerometer 534, an orientation sensor 540 (e.g., a compass), a gyroscope 536, a motion sensor 538, and / or combinations thereof, all of which are operatively connected to the I / O section 514.

[0176] The memory 518 of the personal electronic device 500 may include one or more non-transitory computer-readable storage media for storing computer-executable instructions, which, when executed by one or more computer processors 516, may cause the computer processors to perform the techniques described below, including those referenced to Figures 6 to 7. Figure 9The process described herein. A computer-readable storage medium can be any medium that can tangibly contain or store computer-executable instructions for use by or in connection with an instruction execution system, apparatus, and device. In some examples, the storage medium is a transient computer-readable storage medium. In some examples, the storage medium is a non-transitory computer-readable storage medium. Non-transitory computer-readable storage media can include, but are not limited to, magnetic storage devices, optical storage devices, and / or semiconductor storage devices. Examples of such storage devices include magnetic disks, optical discs based on CD, DVD, or Blu-ray technology, and persistent solid-state storage such as flash memory, solid-state drives, etc. Personal electronic devices 500 are not limited to Figure 5C It is not the components and configurations of a single entity, but rather other components or additional components that may include a variety of configurations.

[0177] In some embodiments, electronic device 500 includes one or more tactile output generators, wherein the one or more tactile output generators generate different types of tactile output sequences, as described in Table 1 below. In some embodiments, a particular type of tactile output sequence generated by the one or more tactile output generators of the device corresponds to a particular tactile output pattern. For example, a tactile output pattern specifies characteristics of the tactile output, such as the amplitude of the tactile output, the shape of the motion waveform of the tactile output, the frequency of the tactile output, and / or the duration of the tactile output. When a device (e.g., one or more tactile output generators that generate tactile output via a movable mass) generates tactile outputs with different tactile output patterns, the tactile outputs can produce different tactile sensations in a user holding or touching the device. Although the user's senses are based on the user's perception of the tactile output, most users will be able to recognize variations in the waveform, frequency, and amplitude of the tactile output generated by the device.

[0178] Furthermore, in methods described herein where one or more steps depend on the satisfaction of one or more conditions, it should be understood that the method may be repeated in multiple repetitions such that, during the repetitions, all conditions determining the steps in the method are satisfied in different repetitions of the method. For example, if the method requires performing a first step (if the condition is satisfied) and a second step (if the condition is not satisfied), those skilled in the art will know that the stated steps are repeated until both the conditions are satisfied and not satisfied (in no particular order). Thus, a method described as having one or more steps depending on the satisfaction of one or more conditions can be rewritten as a method that repeats until each condition described in the method is satisfied. However, this does not require the system or computer-readable medium to declare that the system or computer-readable medium contains instructions for performing discretionary operations based on the satisfaction of the corresponding one or more conditions, and thus to determine whether possible conditions have been satisfied without explicitly repeating the steps of the method until all conditions determining the steps in the method are satisfied. Those skilled in the art will also understand that, similar to methods having discretionary steps, a system or computer-readable storage medium may repeat the steps of the method multiple times as needed to ensure that all discretionary steps have been performed.

[0179] As used herein, the term "power indication" refers optionally to the power indication in devices 100, 300, and / or 500 ( Figure 1A , Figure 3 and Figures 5A to 5B A user-interactive graphical user interface object displayed on a screen. For example, images (e.g., icons), buttons, and text (e.g., hyperlinks) optionally each constitute a functional representation.

[0180] As used herein, "installed application" refers to a software application that has been downloaded to an electronic device (e.g., device 100, 300, and / or 500) and is ready to be launched on the device (e.g., become open). In some implementations, the downloaded application becomes an installed application by utilizing an installer that extracts program portions from the downloaded software package and integrates the extracted portions with the computer system's operating system.

[0181] As used herein, the terms "open application" or "running application" refer to a software application that maintains state information (e.g., as part of device / global internal state 157 and / or application internal state 192). An open or running application is optionally any of the following types of applications:

[0182] ●The active application currently displayed on the screen of the device that is using the application;

[0183] ● Background applications (or background processes) that are not currently displayed but whose one or more processes are being handled by one or more processors; and

[0184] ● A suspended or hibernating application that is not running but has state information stored in memory (both volatile and non-volatile) that can be used to resume the application's execution.

[0185] As used herein, the term "closed application" refers to a software application that does not retain state information (e.g., the state information of a closed application is not stored in the device's memory). Therefore, closing an application includes stopping and / or removing the application's application process and removing the application's state information from the device's memory. Generally, opening a second application while the first application is running does not close the first application. When the second application is displayed and the first application stops displaying, the first application becomes a background application.

[0186] One or more embodiments disclosed herein optionally include one or more features disclosed in the following patent applications: “User Interfaces For Interacting with Channels that Provide Content that Plays in a Media Browsing Application” (Attorney’s File No. 106843171600 (P42089USP1), filed March 24, 2019, P42090USP1), and “User Interface Specific to Respective Content Items” (Attorney’s File No. 106843171900 (P42092USP1), filed March 24, 2019), each of which is incorporated herein by reference.

[0187] Now let’s turn our attention to the implementation of user interfaces (“UIs”) on electronic devices, such as portable multifunction devices 100, 300 or 500, and the associated processes.

[0188] User interface and related processes

[0189] User interface for controlling the playback of content items

[0190] Users interact with electronic devices in many different ways, including using them to play content items. The embodiments described below provide a way for electronic devices to present a user interface for content playback, which includes options for controlling the playback of content items. Providing an efficient way to control the playback of content items enhances interaction with the device, thereby reducing the amount of time required for the user to modify the playback of the currently playing content item, which extends the battery life of battery-powered devices. Additionally, providing a unified (i.e., cohesive) player across multiple content delivery applications allows users to master a set of user interface elements that work across multiple applications. Again, this unified user experience reduces the amount of time required for the user to modify playback in any application, and thus extends the device's battery life. It should be understood that people use devices. When a person uses a device, that person is optionally referred to as a user of the device.

[0191] Figures 6A to 6EE Exemplary ways in which an electronic device, according to some embodiments, presents a user interface for controlling the playback of content items are illustrated. The embodiments in these figures are used to illustrate the processes described below, including references to... Figure 7 The process described. Although Figures 6A to 6EE The electronic device is shown to be capable of performing the following reference. Figure 7 Various examples of the methods described are provided, but it should be understood that these examples are not intended to be limiting, and electronic devices are capable of operating in a manner not referenced. Figures 6A to 6EE The method described below is to perform the procedure as described in the reference. Figure 7 The one or more processes described above.

[0192] Figures 6A to 6EE Various examples of user interfaces for modifying the playback of content items are shown. For example, an electronic device displays multiple playback control elements overlaid on the currently playing content item.

[0193] Figure 6A An example of an electronic device 500 displaying a television program 602a via a display generation component 504 is shown. Figure 6A In the example, electronic device 500 and input device 510a (e.g., corresponding to...) Figure 5B The input device 510 communicates with the electronic device. Although some examples shown herein illustrate an electronic device communicating with a corresponding one of input device 510a or input device 510b, it should be understood that the examples described with respect to input device 510a can be applied to input device 510b and vice versa.

[0194] In some implementations, television program 602a is an episode of a series available for on-demand streaming via the Internet. In some implementations, electronic device 500 is also capable of presenting content items that are streamed or broadcast live (e.g., as opposed to on-demand availability). In some implementations, in addition to presenting television programs and other series of content, electronic device 500 is also capable of presenting other types of video content, such as movies and sports, as well as audio content, such as music, podcasts, and audiobooks.

[0195] In some implementation schemes, such as Figure 6A As shown, the electronic device detects contact 603a via input device 510a. In some embodiments, this is in response to detection while the electronic device 500 is playing content. Figure 6A As shown in the input, the electronic device 500 updates the user interface to include multiple playback control elements for controlling the playback of the television program 602a, such as... Figure 6B As shown.

[0196] Figure 6B An example of an electronic device 500 presenting a user interface is shown, which includes multiple playback control elements overlaid on the content item currently being played on the electronic device 500 (e.g., television program 602a). In some embodiments, the user interface includes an indication 604a of the season and episode number of the television program, an indication 604b of the episode name, an indication 604c of the name of the television program series, an optional option 606a that, when selected, causes the electronic device 500 to display options for controlling subtitles for the television program 602a, an optional option 606b that, when selected, causes the electronic device 500 to display audio options for playing back audio content associated with the television program 602a, an option 606c that, when selected, displays the television program 602a in a picture-in-picture element, a slider 608a, an information tab 614a, an episode tab 614b, and a next tab 614c. In some embodiments, the slider 608a includes an indication 612a of the current playback position within the television program 602a; an indication 612b of the remaining time of the television program 608a; an indication 610a of the portion of the television program 602a before the current playback position that the electronic device can jump to backward; an indication 610b of the buffered portion 610b of the television program 602a after the current playback position; and an unbuffered portion 610c of the television program 602a after the current playback position. In some embodiments, the electronic device 500 is capable of jumping forward to portions 610b and 610c of the television program 602a. In some embodiments, the electronic device 500 presents the various portions 610a-c of the slider 608a in different colors or shading styles. Figure 6BAs shown, in some implementations, selectable options 606a-c and indicators 604a-c are displayed above slider 608a, and tabs 614a-c are displayed below slider.

[0197] In some implementations, when electronic device 500 (e.g., in response to) Figure 6A When the user interface (shown in the figure) initially displays, including playback control elements, the input focus 613b of the electronic device 500 is initially on the slider 608a. In some embodiments, the input focus 613b of the electronic device 500 indicates the user interface element to which further input will be directed. For clarity and discussion purposes, the figures include visual indicators 613 and 813 of the input focus of the electronic device, but in some embodiments, the electronic device 500 presents different visual indicators of the input focus or does not present any input focus indicator at all. In some embodiments, such as Figure 6B As shown, electronic device 500 detects an upward swipe of contact 603b via input device 510a. In some embodiments, in response to Figure 6B As shown in the figure, the electronic device 500 moves the input focus 613b upward according to the movement of the contact 603b, such as... Figure 6C As shown.

[0198] Figure 6C It shows the response to Figure 6B An example of an updated input focus 613c of an input electronic device 500 is shown. Figure 6C As shown, for example, input focus 613c is now directed to selectable option 606a, which, when selected, causes electronic device 500 to present options for changing the subtitles displayed alongside television program 602a. In some embodiments, if electronic device 500 detects one or more swipes to the right via input device 510a, electronic device 500 moves input focus 613c to selectable option 606b for controlling audio settings of television program 602a or selectable option 606c for viewing television program 602a in picture-in-picture element. Although in Figure 6C It is not explicitly shown, but it should be understood that in some implementations, the slider 608a continues to move forward as the television program 602a continues to play.

[0199] like Figure 6C As shown, in some embodiments, electronic device 500 detects a downward swipe of contact 603c via input device 510a. In some embodiments, in response to detecting including Figure 6C The input sequence shown in the figure updates the position of the input focus 613c in the user interface.

[0200] Figure 6D It shows a response to including Figure 6C The example shown is a user interface updated based on the input sequence. For example, electronic device 500 detects something similar to... Figure 6C The diagram shows multiple (e.g., 2) downward swipes, and in response, updates are made as follows: Figure 6D The user interface shown. In some implementations, in response to a first downward swipe, the electronic device 500 will... Figure 6C The input focus 613c shown moves from option 606a to slider 608a, and in response to a second downward swipe, the electronic device 500 moves the input focus from slider 608a to information tab 614a, as shown. Figure 6D As shown. In some implementations, such as Figure 6D As shown, input focus 613d is on the information tab of the user interface. In some embodiments, in response to detecting that input focus 613d has moved to information tab 614a, electronic device 500 animates the content of information tab 614a (described below) to slide upward from the bottom edge of display generation component 504. In some embodiments, electronic device 500 also animates other indicators 604a-c and control elements 606a-c, 608a, and 614a-c to slide upward, such that the content of information tab 614a is displayed in the user interface at the position where tabs 614a-c were previously displayed and, in some embodiments, where slider 608a was previously displayed (e.g., at...). Figure 6C (In the middle). When the input focus 613d is on the information tab 614a of the user interface, the electronic device 500 presents the content of the information tab 614a, including information about the currently playing television program 602a on the electronic device 500, including an image 616a associated with the television program 602a, an indication 616b of the name of the television program 602a, informational text 616e about the television program 602a, an option 616f to watch additional informational text about the television program 602a, a selectable option 616c that, when selected, causes the electronic device 500 to initiate playback of the television program 602a from the beginning, and a selectable option 616d that, when selected, causes the electronic device 500 to present a user interface including additional information about the television program 602a. In some embodiments, the content of the information tab 614a is presented below tabs 614a-c and slider 608a.

[0201] like Figure 6D As shown, in some embodiments, when the input focus 613d is on the information tab 614a, the electronic device 500 detects a rightward swipe of the touch 603d via the input device 510a. In some embodiments, in response to Figure 6DAs shown in the figure, the electronic device 500 updates the input focus 613d based on the movement of the contact 603d, such as Figure 6E As shown.

[0202] Figure 6E It shows the response to Figure 6D The example shown is a user interface that updates based on input. Figure 6E As shown, the current focus 613e is on the episode tab 614b. In some embodiments, in response to detecting input focus 613e on the episode tab 614b, the electronic device 500 presents representations 618a-d of other episodes included in the television program series 602a. In some embodiments, each representation 618a-d includes an image corresponding to a corresponding episode of the television program series 602a and can be selected to initiate playback of the corresponding episode of the television program series 602a instead of the television program 602a. In some embodiments, the content of the episode tab 614b is displayed in the user interface at the same location where the content of the information tab 614a has been displayed, such as... Figure 6D As shown. Figure 6E As shown, for example, electronic device 500 detects a downward swipe of contact 603e via input device 510a. In some embodiments, in response to Figure 6E As shown in the figure, the electronic device 500 updates the current focus 613e based on the movement of the contact 603e, such as Figure 6F As shown.

[0203] Figure 6F An example of a user interface is shown when the input focus 613f is on a representation 618a of a TV series in the TV show series 602a on the TV show tab of the user interface. In some embodiments, when the input focus 613f is on representation 618a, the electronic device 500 presents an indication 620a of the TV show name corresponding to representation 618a. For example, the indication 620a of the TV show name is displayed near (e.g., below) the TV show representation 618a. In some embodiments, if the electronic device 500 detects a horizontal swipe via the input device 510a, the electronic device 500 updates the position of the input focus 613f to be on a different TV show representation in the TV show tab of the user interface and displays an indication of the name of the TV show corresponding to the representation with the current focus. In some embodiments, representations 618a-d are horizontally scrollable. For example, in response to a leftward swipe using the input device 510a when the current focus 613f is on representation 618a, the electronic device 500 will... Figure 6FThe display of episodes not shown is shown to the left of display 618a, and the display of display 618d is stopped. As another example, in response to a rightward swipe detected when input focus 613f is on display 618d, electronic device 500 will display the display of episodes not currently displayed to the right of display 618d, and the display of display 618a will be stopped.

[0204] Figure 6G An example of the user interface is shown when the current focus 613g is on the next tab 614c of the user interface. In some embodiments, in response to detecting the current focus 613g on the next tab 614c of the user interface, the electronic device 500 displays representations 618e-h of content items in a playback queue associated with the electronic device 500 (e.g., a user account associated with the electronic device). In some embodiments, once the electronic device 500 has finished playing back the television program 602a, the electronic device 500 automatically initiates playback of the next content item in the next queue (e.g., playback of the content item corresponding to representation 618e will begin). In some embodiments, the content items in the next queue are a mix of content types, such as episodes in a drama series, movies, and / or audio content such as music, podcasts, and / or audiobooks. In some embodiments, in response to detecting a selection of one of the representations 618e-h, the electronic device 500 initiates playback of the content item corresponding to the selected representation instead of the television program 602a. In some implementations, the electronic device 500 displays the content of the next tab 614c at the location where the content of the episode tab 614b and the information tab 614a are displayed in the user interface. For example... Figure 6G As shown, in some embodiments, electronic device 500 detects a downward swipe of contact 603g via input device 510a. In some embodiments, in response to Figure 6G As shown in the figure, the electronic device 500 moves the input focus 613g according to the movement of the contact 603g, such as Figure 6H As shown.

[0205] Figure 6H It shows the response to Figure 6GThe diagram illustrates an example of a user interface when the input focus 613h is on one of the representations 618f of content items in the next queue. In some embodiments, when the input focus is on representation 618f, the electronic device 500 presents an indication 620b of the name of the content item associated with representation 618f and updates representation 618f to include an indication of the current playback progress of the electronic device (e.g., the user account associated with the electronic device) within the content item. In some embodiments, if the input focus 613h is on a different representation 618e or 618g-h of the content item, the electronic device 500 will instead display an indication of the name of the content item associated with the corresponding representation 618e or 618g-h to which the input focus is directed and an indication of the playback progress (e.g., if the user account associated with the device 500 has already partially consumed the content item).

[0206] In some implementations, electronic device 500 displays an indication of the current playback position of the user's friends within the content item being played on the electronic device. In some implementations, the user account associated with electronic device 500 is associated with other user accounts that are "friends" of the user of the electronic device (e.g., other user accounts are contacts of the user account associated with device 500 in a contacts application or service accessible from device 500). In some implementations, when users are friends with each other, they are able to see each other's content consumption history and / or activity and / or communicate with each other through services associated with content consumption services or applications accessible to the electronic device.

[0207] For example, in Figure 6IIn this embodiment, electronic device 500 displays an indication 622a in slider 608b of the playback position of a user's friend within television program 602a. In some embodiments, indication 622a indicates the playback position of a content item (e.g., television program A 602a) currently being played by the user's friend, or the playback position of a content item that the friend has stopped or paused (e.g., the friend's most recent playback position in television program A 602a). In some embodiments, indication 622a includes an image associated with the user account of the user's friend. In some embodiments, if the friend has not yet watched any portion of television program 602a, electronic device 500 will abandon displaying the indication 622a of the friend's playback position in slider 608b. In some embodiments, if the friend has already watched the entire television program 602a, electronic device 500 will abandon displaying the indication 622a of the friend's playback position in slider 608b. In some implementations, if multiple friends of a user have watched (at least) a portion of television program 602a, the electronic device 500 will display multiple representations in the slider 608b corresponding to each of the friends who have watched (at least) a portion of television program 602a. For example... Figure 6I As shown, when the input focus 613i is on the slider 608b, the electronic device 500 detects a right swipe via the input device 510b to slide to the playback position associated with the user's friend.

[0208] Figure 6J The electronic device 500 is shown in response to Figure 6I The example shown illustrates how input updates the slider 608b. In some implementations, in response to... Figure 6I As shown in the input diagram, electronic device 500 slides a slider to the playback position associated with the user's friend. In some implementations, as electronic device 500 updates the slider's position, it continues to... Figure 6I The playback position indicated by the input device 510b begins playing television program 602a, and the playback position is not changed based on the position of the slider 608b unless and until a selection is detected via the input device 510b. In some embodiments, when the electronic device 500 updates the position of the slider, the electronic device 500 pauses television program 602a. Figure 6I The playback position is indicated in the input device 510b and is not changed according to the position of the slider 608b unless and until the selection is detected by the input device 510b.

[0209] In some embodiments, when the slider 608b is slid, the electronic device 500 displays a thumbnail 624b associated with the playback position indicated by the slider 608b. Since the current playback position of the slider 608b is the same as the playback position associated with a friend of the user of the electronic device 500, the electronic device 500 displays an image 622a associated with the user's friend as an overlay on the thumbnail 624b. In some embodiments, when the slider is slid, the electronic device 500 displays an indication 622b of the time associated with the playback position of the slider's current position, and an indication 612c of the remaining time in the content item starting from the current playback position of the slider. In some embodiments, since the current position of the slider corresponds to the playback position of a friend of the user of the electronic device, the playback position indication 622b includes an indication of the friend's name.

[0210] In some implementation schemes, such as Figure 6J As shown, electronic device 500 detects another rightward swipe of contact 603j via input device 510b. In some embodiments, in response to Figure 6J As shown in the input diagram, the electronic device 500 will slide the slider to a position outside the playback position of the user's friend, such as... Figure 6K As shown.

[0211] Figure 6K The electronic device 500 is shown in response to Figure 6J The example shown illustrates how input updates the user interface. For example, as... Figure 6K As shown, according to the movement of contact 603j, slider 608b is slid to... Figure 6J The playback position is indicated by the slider 608b after the current playback position. In some embodiments, the slider 608b includes an indication 612d of the playback position time at the current position of the slider 608b, an indication 612e of the remaining time in the content item from the current position of the slider 608b, and an indication 622b of the playback position associated with a friend of the user of the electronic device 500. In some embodiments, once the electronic device 500 has slid to and from the playback position of a friend of the user of the electronic device 500, the electronic device 500 indicates the playback position of the friend of the user of the electronic device 500 with an indication 622b that does not include an image associated with the friend of the user of the electronic device 500.

[0212] In some embodiments, the slider 608b includes a thumbnail 624c corresponding to the playback position indicated by the slider 608b. In some embodiments, the thumbnail 624c includes an image corresponding to the playback position indicated by the slider 608b, such as a still image of the content at that playback position. For example, as... Figure 6KAs shown, thumbnail 624c at least partially covers caption option 606a. In some embodiments, because thumbnail 624c at least partially covers one of the selectable options 606a-c of the user interface, electronic device 500 will stop displaying thumbnail 624b after a predetermined time threshold 626b elapsed since the last input was detected via input device 510b. Figure 6K As shown, for example, if the amount 626c of time 626a that has elapsed since the last input was received is less than a threshold 626b, then the electronic device 500 continues to display the thumbnail 624c. In some embodiments, such as Figure 6L As shown, once the amount 626d of time 626a that has elapsed since (e.g., via input device 510b) received the last input exceeds (e.g., or reaches) a threshold 626b, the electronic device 500 stops. Figure 6K The thumbnail shown in the image 624c displays, such as Figure 6L As shown.

[0213] In some implementations, if the slider 608b is slid to the playback position such that the thumbnail associated with the current position of the slider 608b does not overlap with at least one of the options 606a-c, the electronic device 500 continues to display the thumbnail even after a threshold time period 626b has elapsed since input was received from the input device 510b. For example, in Figure 6M In the middle, the electronic device 500 displays a sliding motion to... Figures 6K to 6L The slider 608b is positioned at different locations. Figure 6M For example, the thumbnail 624d corresponding to the current position of the slider 608b does not overlap with the selectable options 606a-c. Therefore, even though the amount 626e of time 626a that has elapsed since the last input was detected exceeds the time threshold 626b, the electronic device 500 continues to display the thumbnail 624d.

[0214] In some implementation schemes, such as Figure 6N As shown, when electronic device 500 is displaying television program 602a (e.g., not displaying previously referenced content), Figures 6B to 6M The slider or other indicator and control element mentioned above), electronic device 500 detects a click on the left side of the touch surface 451a of input device 510a via contact 603n. In some embodiments, the click via contact 603n corresponds to a request to skip backwards for a predetermined amount of time (e.g., 10, 15, 30 seconds, etc.) in the content item. In some embodiments, in response to Figure 6NAs shown in the input diagram, the electronic device 500 skips backward a predetermined amount of time in the content and displays a slider overlaid on the content without displaying other playback control elements, such as... Figure 6O As shown.

[0215] Figure 6O It shows the response to detection Figure 6N The example shown is a user interface that appears based on the input. Figure 6O As shown, the electronic device 500 displays a slider 608a overlaid on a television program 602a, which in response to... Figure 6N The playback position is updated based on the input shown in the diagram, and playback continues (e.g., skipping backward by a predetermined amount of time). In some implementations, such as Figure 6O As shown, electronic device 500 abandons its response to the detection. Figure 6A The image shows the display of multiple elements that appear when a tap is used to input. For example, as shown... Figure 6B As shown, in response to the detection Figure 6A Upon tapping input, in addition to displaying the slider 608a, the electronic device 500 also displays an indicator 604a for the season and episode number of the TV program, an indicator 604b for the episode name, an indicator 604c for the name of the TV program series, an optional option 606a that, when selected, causes the electronic device 500 to display options for controlling the subtitles of the TV program 602a, an optional option 606b that, when selected, causes the electronic device 500 to display audio options for playing back audio content associated with the TV program 602b, an optional option 606c for displaying the TV program 602a in a picture-in-picture element, an information tab 614a, an episode tab 614b, and a next tab 614c, which are not responsive to... Figure 6N The input is displayed. In some implementations, the response is abandoned. Figure 6N The backward skip input shown in the figure, which displays elements unrelated to skipping, provides a less distracting user interface (e.g., because fewer elements are overlaid on the TV program 602a).

[0216] In some implementations, the user interface elements displayed as overlays on content items being played by an electronic device are controlled and / or provided by an entity associated with the creation of the content item (e.g., a studio, streaming service, publisher, creator, etc.). In some implementations, the user interface elements displayed during content playback vary depending on the content item. For example, Figure 6P An electronic device 500 is shown presenting a movie 602b, with multiple playback control elements shown as overlays on the movie 602b. Figure 6P The multiple playback control elements shown are the same as those referenced above. Figure 6B The playback control elements described are the same or similar, except that, instead of, for example Figure 6B The device 500 displays an information tab 614a, a series tab 614b, and a next tab 614c. An information tab indicator 614d is displayed at the bottom center of the user interface. In some embodiments, movie 602b is associated with an information tab but not with other types of tabs that may be displayed in the user interface; therefore, the device 500 displays the information tab indicator 614d, as shown. Figure 6P As shown. In some implementations, other content items can be associated with individual tabs of different types (e.g., Next, Episode, etc.), which will enable the electronic device 500 to function in a manner similar to... Figure 6P The information tab indicator 614d shown in the diagram is displayed in a manner that alternatively displays the corresponding tab indicator. In some embodiments, if the electronic device 500 detects an input corresponding to a request to move the input focus 613p downwards via the input device 510a, such as a downward swipe of a touch on the touch surface 451a of the input device 510a, the electronic device 500 will present a similar display to the movie 602b. Figure 6D The information items shown are the information items in the text.

[0217] Figure 6Q An example of user interface elements presented by electronic device 500 when presenting sports match 602c is shown. In some embodiments, sports match 602c is broadcast live and / or streamed live to electronic device 500. In some embodiments, because the sports match is live content, there are limitations regarding the distance that electronic device 500 can jump and / or slide backward and / or forward in the playback position. When presenting sports match 602c, electronic device 500 (e.g., in response to...) Figure 6A (The input shown is similar to the input shown in the image) The sports game 602c is displayed as a live indicator 628a, the current score of the sports game 628b, and the above reference. Figure 6BThe selectable options 606a-c, slider 608d, information tab 614a, live content tab 614d, next tab 614c, and more games tab 614f are described. In some embodiments, because there are limitations regarding the distance that the electronic device 500 can skip and / or slide over, the slider 608d includes a region 610d corresponding to the portion of the sports game before the current replay position that the electronic device cannot skip or slide over; a portion 610a of the sports game 602c before the current replay position that the electronic device 500 can skip or slide over; an indication 610f of the portion of the sports game 602c before the current replay position that the electronic device 500 can slide over or jump forward over; and an indication 610g of the portion of the sports game 602c that the electronic device 500 cannot slide over or jump forward over. In some embodiments, the electronic device 500 uses different colors or shades to present different regions 610d-g of the slider 608d to distinguish regions 610d-g from each other. In some implementations, the slider 608d also includes an indication 612j of the current time of the current replay position of the sports game, and an indication 612k of the amount of time remaining in the sports game from the current replay position.

[0218] like Figure 6Q As shown, electronic device 500 detects a downward swipe of touch 603q via input device 510a corresponding to a request to move the current focus 613q downward in the user interface. In some embodiments, in response to Figure 6Q The input shown in the image updates the user interface of the electronic device 500. Figure 6R As shown.

[0219] Figure 6R The electronic device 500 is shown in response to Figure 6Q The example shown illustrates how input updates the user interface. In some embodiments, the electronic device 500 moves the current focus 613r to the information tab 614a and displays the contents of the information tab below the slider 608d and other tabs 614c, 614d, and 614f (e.g., in response to the current focus 613r being on the information tab 614a without a detected selection of the information tab 614a). In some embodiments, the contents of the information tab 614a include an image 616g associated with the sports match 602c, an indication 616h of the name of the sports match 602c (e.g., the two teams participating in the match), an indication 616i of the current score of the sports match, informational text 616j about the sports match 602c, and an option 616k to view additional informational text 616j about the sports match. Figure 6RAs shown, electronic device 500 detects a rightward swipe of contact 603r via input device 510a corresponding to a request to move the current focus 613r to the right. In response to... Figure 6R The input shown in the figure updates the current focus 613r of the electronic device 500. Figure 6S As shown.

[0220] Figure 6S The electronic device 500 is shown in response to Figure 6R The example shown illustrates how input updates the user interface. Figure 6S In the context of the current focus 613s, for example, is on the Live tab 614d, and in response to detecting that the current focus 613s has moved to the Live tab 614d (e.g., no selection of the Live tab 614d is detected), the electronic device 500 displays the content of the Live tab 614d in the user interface. Figure 6R The Live tab 614d is displayed at a location where the information tab is presented (e.g., below other tabs 614a, 614c, and 614f and the slider 608d). In some embodiments, the Live tab 614d is displayed only when the electronic device 500 is presenting content items that are being streamed or broadcast live. In some embodiments, the Live tab 614d includes a representation 618i-L of the content items currently being streamed and / or broadcast live that can be played back on the electronic device. In some embodiments, the representation 614i-L includes an image corresponding to each content item, and a progress bar indicating the portion of the content item that has been broadcast and / or streamed relative to the entire duration of the content item. In some embodiments, the representation 618i-L corresponds to various types of live (e.g., streaming or broadcast) content items, including television programs, movies, sports games, etc. In some embodiments, the progress bar is independent of the content consumption history of the electronic device (e.g., the user account associated with the electronic device). For example, the progress bar does not indicate that the electronic device (e.g., the user account associated with the electronic device) has played any part of the content item in the Live tab 614d. In some embodiments, the progress bar is displayed in representation 618i-L even when the input focus is not directed to representation 618i-L. In some embodiments, in response to detecting a selection of a representation in representation 618i-L, electronic device 500 initiates playback of the content item corresponding to the selected representation 618i-L instead of the sports match 602c (e.g., starting from the playback position indicated by the progress bar).

[0221] like Figure 6S As shown, in some embodiments, the electronic device detects a downward swipe of contact 603s corresponding to a request to move the current focus 613s based on the movement of contact 603s via input device 510a. In response to Figure 6S The input shown in the image updates the user interface of the electronic device 500. Figure 6T As shown.

[0222] Figure 6T The electronic device 500 is shown in response to Figure 6S The image shows an example of how input can be used to update the user interface. For example... Figure 6T As shown, in some embodiments, the current focus 613t is on the corresponding representation 618i of the corresponding live content item in the Live tab 614d of the user interface, without any selection input for that item. For example, representation 618i is a representation of another sports match. In some embodiments, when the current focus 613t is on representation 618i, the electronic device 500 presents indications 630a-f of metadata overlaid on representation 618i. In some embodiments, the metadata indications include indications 630a of the current score of the sports match, indications 630b that the sports match is live, indications 630c of the duration of the match and the league, indications 630d of the channel on which the match is being broadcast or streamed live, a progress bar 630e indicating the replay position of the match currently being broadcast or streamed live, and indications 630f of the match name (e.g., the teams playing). In some embodiments, the electronic device 500 detects a right swipe of contact 603t corresponding to a request to move the current focus 613t to the right via input device 510a. In some implementations, in response to Figure 6T The input shown in the image updates the user interface of the electronic device 500. Figure 6U As shown.

[0223] Figure 6U The electronic device 500 is shown in response to Figure 6T The example shown illustrates how input updates the user interface. In some implementations, electronic device 500 moves the current focus 613u to a representation 618j of a movie that is currently being streamed or broadcast live and can be played back on the electronic device, without requiring input to select representation 618j. For example, when the current focus 613u is on representation 618j, electronic device 500 stops displaying overlays on... Figure 6TThe diagram shows indications of metadata on representation 618i, and indications 630m-p showing metadata overlaid on indication 618j. In some embodiments, indications of metadata overlaid on representation 618j include indication 630p that the movie is live, indication 630n that the movie is being streamed or broadcast live on a channel, and indication 630m that the movie title is being shown. Therefore, in some embodiments, the type of metadata displayed overlaid on representation 618 varies depending on the type of content item corresponding to the representation with the current focus. In some embodiments, if electronic device 500 detects additional input (e.g., no other selection input) corresponding to a request to move the current focus 613u to a different representation 618k or 618L, electronic device 500 will present metadata corresponding to the representation with the current focus, overlaid on the representation with the current focus, and stop displaying metadata associated with any other representation that does not have a current focus. In some embodiments, representations 618i-L can be scrolled horizontally to reveal... Figure 6U Additional notation not shown in the text.

[0224] Figure 6V An example of an electronic device 500 presenting a user interface is shown, where the current focus 613v is on the More Matches tab 614f of the user interface. In some embodiments, if the electronic device 500 is playing a sports match, only the More Matches tab 614f is displayed in the user interface. In some embodiments, if the electronic device is playing live broadcast or live streaming content, only the More Matches tab 614f is displayed in the user interface. Figure 6V As shown, in some implementations, when the current focus 613v is on the More Games tab 614f (e.g., no selection input directed to the Game tab 614f is detected), the electronic device 500 in the user interface... Figure 6U The location where the content of the Live tab 614d is displayed and in Figure 6R The content of the More Matches tab 614f is displayed in the same location as the content of the Information tab 614a (for example, below the other tabs 614a, 614d, and 614c, and below the slider 608d). Figure 6VAs shown, for example, the More Matches tab 614f includes representations 618r-u of other sports matches that can be replayed on the electronic device 500, without displaying representations of other types of live content besides sports matches. In some embodiments, representations 618r and 618s correspond to matches currently being broadcast or streamed live, and representations 618t and 618u correspond to matches that have not yet started being broadcast or streamed live (e.g., but will start and / or be broadcast or streamed live later on the same day and / or at a predetermined time (e.g., 10, 20, 30, 60, 120, 140 minutes) from the current time). In some embodiments, representations 618r and 618s include an indication of the current progress of the matches being streamed or broadcast live (e.g., independent of the content playback of these matches on the electronic device). In some embodiments, in response to detecting the selection of one of the representations 618r-s, the electronic device 500 initiates a replay of the sports match corresponding to the selected representation in the representations 618r-s by replacing the sports match 602c (e.g., starting the replay from the position indicated by the progress bar). In some embodiments, the representation 618t includes an indication 634a of when the match will begin to be streamed or broadcast live and indications 634b-c of the participating teams. In some embodiments, the representation 618u includes elements similar to those of the representation 618t.

[0225] like Figure 6V As shown, in some embodiments, electronic device 500 detects a downward swipe of contact 603V via input device 510a. In some embodiments, in response to Figure 6V As shown in the figure, the electronic device 500 updates the current focus 613V based on the movement of the contact 603V, such as Figure 6W As shown.

[0226] Figure 6W It shows the response to Figure 6VExamples of electronic devices 500 that present an updated user interface in response to input are shown. In some embodiments, the current focus 613w is directed to a display 618s of another sporting event. In some embodiments, when the current focus 613w is directed to the display 618s (e.g., no selection input to the display 618s is detected), the electronic device 500 presents indicators 630g-k overlaid on the display 618s, including an indicator 630h that the sporting event is live, an indicator 603g that the current score of the sporting event is live, an indicator 630k that the current replay position of the match and the league is live, an indicator 630i that the channel showing the match is live, and a progress bar 630j, and an indicator 630L that displays the match name near (e.g., below) the display 618s. In some implementations, if electronic device 500 detects a left or right swipe via input device 510a, electronic device 500 moves the current focus to a different display 618r or 618t-u, and displays metadata corresponding to the display to which the current focus is directed as an overlay on the display to which the current focus is directed. In some implementations, displays 618r-u are horizontally scrollable, and if electronic device 500 scrolls the display, electronic device 500 reveals... Figure 6W Additional representations not shown in the text.

[0227] As previously mentioned, in some implementations, because the sports event 602c is being broadcast or streamed live, there are limitations on the distance that the electronic device 500 can slide forward or backward or jump over. Figure 6X For example, when the current focus 613x is on the slider 608d, the electronic device 500 detects a leftward swipe of the contact 603x via the input device 510a. In some embodiments, in response to Figure 6X The input shown in the diagram allows the electronic device 500 to cause the replay position of the sports match 602c to skip backward or slide by an amount corresponding to the speed, distance, and / or duration of the swipe of the contact 603x, such as... Figure 6Y As shown.

[0228] Figure 6Y It shows that when received Figure 6X The example shown is of an electronic device 500 that presents a sports match 602c after input. In some embodiments, the electronic device 500 is based on... Figure 6XThe current replay position within the sports game is updated based on the speed, distance, and / or duration of movement of the contact 603x, and the slider 608d is updated to include an indication 612L of the current replay position and an indication 612m of the remaining duration of the sports game after the current replay position. In some embodiments, since the duration, distance, and / or speed of movement of the contact 603x corresponds to moving the replay position backward within the allowed skip and slide portion of the content item (e.g., indicated by area 610a of the slider 608d), the electronic device 500 updates the replay position based on the movement of the contact 603x.

[0229] In some implementation schemes, such as Figure 6Y As shown, when the current focus is directed to the slider 608d, the electronic device 500 detects subsequent input via the input device 510, including a leftward swipe of contact 603y. In some embodiments, Figure 6Y The input shown corresponds to a request to further slide the slider 608d to the current playback position. In some embodiments, the movement of contact 603y (e.g., speed, distance, duration, etc.) corresponds to sliding the current playback position back or jumping back to a portion that the electronic device of the sports game 602c cannot reach, represented by area 610d of the slider 608d. In some embodiments, in response to Figure 6Y As shown in the input, the electronic device 500 updates the playback position to the beginning of the part of the sports game that the electronic device 500 can slide or jump to, represented by area 610a of the slider 608d, as... Figure 6Z As shown.

[0230] Figure 6Z It shows that in response to Figure 6Y The electronic device 500 presents the sports match 602c in a user interface updated in response to the input shown. As described above, in some embodiments, instead of jumping back to the portion of the sports match 602c corresponding to the movement (e.g., speed, distance, duration, etc.) of contact 603y, the electronic device 500 updates the playback position to the earliest portion of the sports match 602c that the electronic device 500 can slide back or jump to, since the movement of contact 603y corresponds to a request to slide back or jump a distance beyond the distance that the electronic device 500 can slide back or jump to. In some embodiments, the electronic device 500 presents a visual indication 630a that the electronic device 500 cannot slide back or jump further, while presenting a slider 608d and other indicators and playback control elements overlaid on the sports match 602c.

[0231] Figure 6AAAn example is shown of an electronic device 500 presenting a movie 602d with playback control elements overlaid on the movie 602d. In some embodiments, Figure 6AA The number of playback control elements shown is the same as the one mentioned above. Figure 6B The number of playback control elements is the same. For example, slider 608e is similar to slider 608a because the electronic device 500 can slide or jump to any playback position within the movie 602d. In some embodiments, Figure 6AA The user interface shown includes chapter tabs 614e, instead of the one mentioned above in the references. Figure 6B The aforementioned episode tab 614b is because movies 602d include chapters, unlike television programs 602a which include other episodes. Figure 6AA As shown, in some embodiments, when the current focus 613aa is on the slider 608e, the electronic device 500 detects a downward swipe of contact 603aa via the input device 510a. In some embodiments, in response to including Figure 6AA The input sequence shown in the figure updates the user interface of the electronic device 500, such as... Figure 6BB As shown. For example, electronic device 500 first detects... Figure 6AA The input shown in the diagram is then detected, followed by a right swipe via input device 510a, and in response, the user interface is updated, as shown in the diagram. Figure 6BB As shown.

[0232] Figure 6BB It shows a response to including Figure 6AA The example shown is a user interface that updates based on the input sequence. Figure 6BB As shown, in some embodiments, the current focus 613bb is on the chapter tab 614e of the user interface. For example, in response to detecting the current focus 613bb on the chapter tab 614e of the user interface (e.g., no selection input directed to the chapter tab 614e is detected), the electronic device 500 presents the chapter representations 618m-q of the movie 602d below the tabs 614a, 614e, and 614c and the slider 608e. In some embodiments, the chapter representations 618m-q include images corresponding to each respective chapter (e.g., screenshots from each chapter). In some embodiments, in response to detecting the selection of one of the representations 618m-q of the chapters, the electronic device 500 initiates playback of the movie from the playback position of the chapter corresponding to the selected representation. In some embodiments, if the electronic device 500 detects a horizontal swipe via the input device 510a while the current focus 613bb is on the chapter tab 614e, the electronic device 500 will stop presenting the chapter representations 618m-q and instead display them in the user interface. Figure 6BBThe content corresponding to the tab with the current focus 613bb is displayed at the position indicated by chapter 618m-q (for example, below chapters 614a, 614e, and 614c and the slider 608e). Figure 6BB As shown, when the current focus 613bb is on the chapter tab 614e, the electronic device 500 detects a downward swipe of contact 603bb via the input device 510a. In some embodiments, in response to Figure 6BB The input shown in the image updates the user interface of the electronic device 500. Figure 6CC As shown.

[0233] Figure 6CC The electronic device 500 is shown in response to Figure 6BB The example shown illustrates how input updates the user interface. Figure 6CC As shown, in some embodiments, electronic device 500 moves the current focus 613cc to the corresponding representation 618m of the chapter of movie 602d. In some embodiments, in response to the current focus 613cc being on representation 618m, electronic device 500 displays an indication 632a of the chapter name and / or an identifier of the chapter number near (e.g., below) representation 618m (e.g., no selection input is detected leading to representation 618m). In some embodiments, if electronic device 500 detects a horizontal swipe about input device 510a (e.g., no selection input is detected), electronic device 500 moves the current focus 613cc to a different representation 618m-q of the chapter, stops displaying the indication 632a of the chapter name associated with representation 618m, and displays an indication of the chapter name and / or an identifier of the chapter number associated with representation 618n-q having the current focus (e.g., near representation 618n-q having the current focus). In some implementations, the chapter representation 618m-q is horizontally scrollable, and the electronic device 500 discloses the chapter representation 618m-q in response to a request to scroll it. Figure 6CC Additional notation for chapters not shown in the text.

[0234] In some implementations, the electronic device 500 presents swipes and / or skips unavailable live content (e.g., streaming or broadcast). Figure 6DD An example of an electronic device 500 presenting a news broadcast 602e that cannot be swiped or skipped is shown. In some embodiments, the electronic device 500 presents playback control elements overlaid on the news broadcast 602e. For example, multiple playback control elements are referenced above. Figures 6A to 6CCThe playback control elements are identical or similar. In some embodiments, because it is impossible to swipe or skip within the news broadcast 602e, the electronic device 500 presents a slider 608f including an indication of an area 610e where swiping and skipping are unavailable. In some embodiments, all portions of area 610e are displayed in the same color, pattern, or style. In some embodiments, the slider also includes an indication 612s of the current playback position within the news broadcast 602e and an indication 612t of the duration of the news broadcast 602e between the current playback position and the end of the news broadcast 602e. Figure 6DD As shown, electronic device 500 detects a tap on contact 603dd on the right side of the touch surface 451a of input device 510a via input device 510a. This tap corresponds to a request to skip forward a predetermined amount of time (e.g., 10, 15, 30 seconds, etc.) within news broadcast 602e. In some embodiments, in response to Figure 6DD The input shown in the image updates the user interface of the electronic device 500. Figure 6EE As shown.

[0235] In some implementation schemes, such as Figure 6EE As shown, in response to Figure 6DD As shown in the input diagram, electronic device 500 abandons the attempt to jump forward in news broadcast 602e because jumping is impossible. Additionally, in some embodiments, electronic device 500 displays a visual indication 630b simultaneously with a slider 608f and other indicators and control elements overlaid on news broadcast 602e, indicating that jumping forward in news broadcast is impossible.

[0236] Figure 7 This is a flowchart illustrating a method for presenting a user interface for controlling the playback of content items according to some embodiments. Method 700 is optionally performed on an electronic device (such as device 100, device 300, and device 500), as referenced above. Figures 1A to 1B , Figures 2 to 3 , Figures 4A to 4B and Figures 5A to 5C The operations in method 700 may be optionally combined, and / or the order of some operations may be optionally changed.

[0237] As described below, method 700 provides a manner in which an electronic device, according to some embodiments, presents a user interface for controlling the playback of content items. This method reduces the cognitive burden on the user when interacting with the device's user interface, thereby creating a more efficient human-machine interface. For battery-powered electronic devices, improving the efficiency of user interaction with the user interface saves power and increases the time between battery charging cycles.

[0238] In some embodiments, method 700 is performed at an electronic device (e.g., 500) that communicates with a display generating component and one or more input devices. In some embodiments, the electronic device is a mobile device (e.g., a tablet, smartphone, media player, or wearable device), a computer (e.g., a desktop computer, a laptop computer), or a wearable device (e.g., a watch, a head-mounted device), optionally communicating with one or more of a mouse (e.g., external), a touchpad (optionally integrated or external), a remote control device (e.g., external), another mobile device (e.g., separate from the electronic device), a handheld device (e.g., external), and / or a controller (e.g., external, etc.), or a set-top box communicating with one or more input devices (e.g., a remote control). In some embodiments, the display generating component is a display integrated with the electronic device (optionally a touchscreen display), an external display such as a monitor, projector, television, or a hardware component (optionally integrated or external) for projecting a user interface or making the user interface visible to one or more users.

[0239] In some implementations, such as in Figure 6A In this context, when presenting (e.g., via a display generating component) a content item of a corresponding content type (e.g., audio content (music, podcasts, audiobooks), video content (series of episodes, television programs, movies, video clips, sports events), live (e.g., broadcast or streaming) content, on-demand (e.g., streaming or locally stored) content) (e.g., 602a), electronic device 500 receives (702) input via one or more input devices (e.g., via contact 603a). In some embodiments, the input corresponds to a request to display one or more playback control elements and an option corresponding to additional content associated with the content item. For example, when the set-top box is presenting a content item via a display generating component (e.g., a television, projector, etc.) without presenting playback control elements and / or options corresponding to additional content, a remote control communicating with the set-top box receives selection input.

[0240] In some implementations, such as in Figure 6BIn response to receiving input, the electronic device (e.g., 500) simultaneously displays (704) one or more first playback control elements (e.g., 608a) corresponding to the first content type, based on determining that the corresponding content type is a first content type (706). In some embodiments, the one or more first playback control elements include a slider and / or one or more selectable options that, when selected, cause the electronic device to pause / play, fast forward, and / or rewind content; present caption options for the content item; and / or present audio playback options for the content item. In some embodiments, the type of slider presented depends on the type of content. For example, if the content is on-demand content, the slider is one that allows unrestricted rewinding of the content item, and if the content is broadcast (e.g., wirelessly) or live streaming content, the slider is one that allows the content item to be rewound no more than a predetermined threshold (e.g., 10, 15, 30, 45 seconds, etc., 1, 2, 3, 5 minutes, etc.).

[0241] In some implementations, such as in Figure 6B In response to receiving input, the electronic device (e.g., 500) simultaneously displays (704) a first option (e.g., 614b) corresponding to the first content of the first content type, based on determining that the corresponding content type is a first content type (706). In some embodiments, the first option is displayed in association with a slider (e.g., above and to the left of the slider, or below and to the left of the slider). In some embodiments, in response to detecting a selection of the first option (e.g., or focus), the electronic device presents a representation of the first content corresponding to the first content type. For example, if the first content type is a video-on-demand movie, the first content is a chapter of the movie and / or a video-on-demand content item in the playback queue associated with the electronic device (e.g., a user account associated with the electronic device). As another example, if the first content type is a live broadcast sports game, the first content is other live content (e.g., live content currently available for live playback), scores of the sports game and other sports games, and / or video-on-demand content in the playback queue. As another example, the first content type is supplementary content recommended based on the content item (e.g., content of the same type, content with the same creator, content of the same genre, content liked by other users who like the content item, etc.). In some implementations, in response to detecting a selection (e.g., or focus) of the first option, the electronic device updates the position where one or more playback control elements and the first option are displayed over the content item. For example, in response to detecting a selection (e.g., or focus) of the first option, the electronic device moves one or more playback control elements and the first option upwards and initiates the display of a representation of content corresponding to the first content type overlaid on the content item below the one or more playback control elements and the first option.

[0242] In some implementations, such as in Figure 6P In response to receiving input, the electronic device (e.g., 500) determines that the corresponding content type is a second content type different from the first content type (712), and simultaneously displays (704) one or more second playback control elements (e.g., 608c) corresponding to the second content type; and in some embodiments, some or all of the second playback control elements are the same as the first playback control elements. In some embodiments, some or all of the second playback control elements are different from the first playback control elements. In some embodiments, the first content type and the second content type have completely different characteristics, such as on-demand music and live sports. In some embodiments, the first content type and the second content type have similarities and differences, such as on-demand movies and on-demand television programs.

[0243] In some implementations, such as in Figure 6P In response to receiving input, the electronic device (e.g., 500) determines (712) that the corresponding content type is a second content type different from the first content type, and simultaneously displays (704) a second option (e.g., 614d) corresponding to the second content of the second content type that is different from the first content. In some embodiments, in response to input, the electronic device presents a third option corresponding to a third content different from the first and second content types, regardless of whether the corresponding content type is the first or the second content type. In some embodiments, playback control elements and options are displayed as overlays on content items while the electronic device continues to present the content item. In some embodiments, in response to detecting a selection (e.g., or focus) of the second option, the electronic device updates the position where one or more playback control elements and the second option are displayed as overlays on the content item. For example, in response to detecting a selection (e.g., or focus) of the second option, the electronic device moves one or more playback control elements and the second option upwards and initiates the display of a representation of content corresponding to the second content type overlays on the content item below the one or more playback control elements and the second option.

[0244] The above method of presenting playback control elements and options corresponding to the content type of the content item provides an efficient way to access playback controls and additional content related to the content item being presented. This also reduces the power consumption of electronic devices and extends their battery life by enabling users to use electronic devices more quickly and effectively.

[0245] In some implementations, such as in Figure 6HIn this implementation, based on the determination that the corresponding content type is a first content type (e.g., a TV series content series), the first content corresponding to the first content type includes a second content item (e.g., 618e-h) in a playback queue associated with a user (e.g., a user account) of the electronic device. In some embodiments, the electronic device is configured to play content items in the queue in an automatically queued order. For example, after completing a content item, the electronic device automatically plays the next item in the playback queue. In some embodiments, the playback queue is associated with a user account associated with multiple electronic devices (including the electronic device). In some embodiments, the electronic device adds content items to the playback queue in response to user input that the content item is manually added to the playback queue. In some embodiments, the electronic device automatically adds content items to the playback queue based on the content consumption history of the electronic device (e.g., the user account associated with the electronic device), such as adding episodes in a TV series content series in response to the electronic device (e.g., the user account associated with the electronic device) playing an episode in the playback queue. In some embodiments, in response to detecting input directed to a first option, the electronic device presents a representation of the content items in the playback queue at the location in the user interface where the first option was previously displayed. In some implementations, in response to detecting input that has been directed to (e.g., selected, not currently focused on) a first option, the electronic device displays a representation of a content item in a content playback queue. In some implementations, in response to detecting a selection of a corresponding representation among the representations of content items in the content playback queue, the electronic device initiates playback of the content item corresponding to that representation. In some implementations, the electronic device simultaneously displays representations of content items in the content playback queue along with one or more playback control elements overlaid on the content item and the first option. In some implementations, the electronic device displays an indication that a portion of the content item overlaid on the representation of the corresponding content item in the playback queue with current focus has been consumed by the electronic device (e.g., a user account associated with the electronic device) overlaid on the corresponding representation, and an indication of the name of the content item associated with the corresponding representation. In some implementations, the electronic device abandons displaying an indication that a portion of the content item has been consumed by the electronic device (e.g., a user account associated with the electronic device), and an indication of the name of the content item whose representation does not have current focus on the electronic device. In some implementations, the electronic device stops displaying one or more playback control elements (e.g., sliders) while displaying a representation of content items in the playback queue (or, more generally, content associated with any other options displayed in the user interface, such as a second option, a third option, etc.).In some implementations, when the current focus is on the first option or on one of the representations of a content item in the playback queue (or more generally, when a representation of a content item is presented in the playback queue), in response to detecting a corresponding input (e.g., selection of a “back” or “main desktop” button on an input device), the electronic device stops displaying representations (e.g., as well as options and playback control elements) and continues playing the content item.

[0246] The above-described method of presenting a playback queue associated with the user provides an efficient way to view the next content item to be played while the content is being played. This also reduces power consumption and extends the battery life of electronic devices by enabling users to use them more quickly and efficiently.

[0247] In some implementations, such as in Figure 6D In response to receiving input (e.g., based on determining that the corresponding content type is a first content type, or based on determining that the corresponding content type is a second content type, regardless of whether the corresponding content type is the first or the second content type), the electronic device simultaneously displays a third option (e.g., 614a) corresponding to information about the content item. In some embodiments, the electronic device simultaneously displays the third option and one or more first playback control elements corresponding to the corresponding content type and a first or second option overlaid on the content. In some embodiments, the information about the content item includes one or more of the following: an image corresponding to the content item, a description of the content item, a score for the content item (e.g., if the content item is a sports game), an option to start playing the content item, and an option to view the user interface associated with the content item. In some embodiments, in response to detecting input that is directed to (e.g., current focus without selection, selection) the third option, the electronic device presents information about the content item overlaid on the content item.

[0248] The above method of displaying options corresponding to information about content items provides an efficient way to view information without stopping the playback of content items. This also reduces power consumption and extends the battery life of electronic devices by enabling users to use them more quickly and efficiently.

[0249] In some implementations, such as in Figure 6C In the process of displaying a third option (e.g., 614a) corresponding to information about a content item, the electronic device receives input (e.g., via contact 603c) that is directed to (e.g., current focus without selection, selection) the third option (e.g., without contact 614a) via one or more input devices.

[0250] In some implementations, such as in Figure 6DIn response to receiving input that directs the user to (e.g., current focus without selection, selection) a third option (e.g., 614a), the electronic device simultaneously displays a fourth option (e.g., 616c) and a fifth option (e.g., 616d) along with one or more first playback control elements or one or more second playback control elements (e.g., 608a). The fourth option can be selected to start playback of the content item (e.g., 602a), and the fifth option can be selected to display a user interface associated with the content item (e.g., 602a), which includes additional information associated with the content item (e.g., 602a). In some embodiments, the electronic device stops playback of the content item in response to detecting a selection of the fifth option. In some embodiments, the fourth and fifth options are displayed simultaneously with the first or second option, the third option, and one or more playback control elements overlaid on the content item. In some embodiments, the electronic device simultaneously displays one or more of the following: an image corresponding to the content item, a description of the content item, and a score for the content item (e.g., if the content item is a sports game). In some implementations, the electronic device presents a fourth and fifth option at the location where the third option is displayed in the user interface before detecting input that leads to the third option. For example, before detecting input that leads to the third option, the electronic device displays the third option in the corresponding area of ​​the user interface (e.g., at the bottom), and in response to detecting a selection of the third option, the electronic device displays the fourth and fifth options in the corresponding area and moves other elements covering the content item in the user interface (e.g., moves other elements covering the content item in the user interface upwards).

[0251] The above-described methods of presenting the fourth and fifth options provide an efficient way to start from the beginning of a content item or view the user interface associated with the content item. This also reduces power consumption and extends the battery life of electronic devices by enabling users to use them more quickly and efficiently.

[0252] In some implementations, such as in Figure 6E In this context, a content item (e.g., 602a) is the first episode in a series of episode content. In some implementations, a series of episode content is a television program or another series of episodes that includes a collection of content items within that series.

[0253] In some implementations, such as in Figure 6EIn this context, based on the determination that the corresponding content type is a first content type (e.g., the first type is a series of episodes within a series of episodes), the first content corresponding to the first content type includes a second content item (e.g., 618a to 618d), where the second content item is a series of episodes within a series of episodes, including a second episode within the series that is different from the first episode. In some embodiments, based on the determination that the content item is a series of episodes within a series of episodes, the electronic device presents an option to view other episodes within the series of episodes.

[0254] The above method of presenting options corresponding to other episodes in the series provides an efficient way to browse the series of episodes of an episode while playing the episode. This also reduces power consumption and extends the battery life of electronic devices by enabling users to use them more quickly and efficiently.

[0255] In some implementations, such as in Figure 6D In this context, the corresponding content type is the first content type (e.g., an episode in a series of episodes). In some implementations, such as in... Figure 6D In this embodiment, when the first option (e.g., 614b) is displayed, the electronic device (e.g., 500) receives input (e.g., via contact 603d) directed to (e.g., current focus without selection, selection) the first option (e.g., 614b) via one or more input devices (e.g., 510a). In some embodiments, such as in Figure 6FIn response to receiving input that is directed to (e.g., current focus without selection, selection) a first option (e.g., 614b), an electronic device (e.g., 500) and one or more first playback control elements (e.g., 608a) simultaneously display a representation of a second content item as a series of episodes in the series (e.g., 618a to 618d), wherein a first representation (e.g., 618b) is displayed of a first corresponding second content item to which the current focus (e.g., 613f) of the electronic device is not directed, but no indication of information associated with the first corresponding second content item (e.g., the name of the series) is displayed, and a second representation (e.g., 618a) is displayed of a second corresponding second content item to which the current focus (e.g., 613f) of the electronic device (e.g., 500) is directed, while an indication of information associated with the second corresponding second content item (e.g., 620a) (e.g., the name of the series) is displayed. In some embodiments, in response to detecting input directed to a first option, the electronic device displays representations of other episodes in the episode content series, where the content item is an episode overlaid on the content item at the location where the first option was previously displayed (e.g., while continuing to display the first option). In some embodiments, in response to detecting a selection of one of the representations of other episodes, the electronic device initiates playback of the episode corresponding to the selected representation. In some embodiments, the electronic device presents an indication of the name of the episode corresponding to the representation currently in focus of the electronic device, and does not display the names of episodes corresponding to representations not currently in focus of the electronic device. In some embodiments, the electronic device displays the name of the episode associated with the representation currently in focus in the user interface, near the representation of the episode currently in focus. In some embodiments, the representation of the episode includes an image associated with the episode (e.g., a still image included in the video content of the episode).

[0256] The above-described method of displaying an indication of information associated with the representation having the current focus of the electronic device provides an effective way to present information about the representation while reducing the obscured portions of the content items. This also reduces power consumption and extends the battery life of the electronic device by enabling users to use it more quickly and efficiently.

[0257] In some embodiments, one or more playback control elements include an option that, in response to detecting input directed to (e.g., current focus without selection, selection of the option) to the option, causes the electronic device to present a caption option for the content item. In some embodiments, one or more playback control elements include an option that, in response to detecting input directed to (e.g., current focus without selection, selection of the option) to the option, causes the electronic device to present audio controls for the content item. In some embodiments, one or more playback control elements include an option that, in response to detecting input directed to (e.g., current focus without selection, selection of the option) to the option, causes the electronic device to stop displaying the content item in full-screen mode and present the content item in a picture-in-picture element. In some embodiments, in response to detecting selection of one of the aforementioned options, the electronic device simultaneously presents content associated with the selected option, along with one or more playback control elements and options overlaid on the content item. In some embodiments, one or more playback control elements include an option that, in response to detecting input directed to (e.g., current focus without selection, selection of the option) to the option, causes the electronic device to toggle the inclusion or exclusion of the content item in a content library associated with the electronic device (e.g., the user account of the electronic device). In some implementations, the electronic device also displays content item metadata (e.g., season, name, program name, content item name, sports score, indication that the content is being streamed or broadcast live) simultaneously with playback control elements and options. In some implementations, the electronic device presents additional content associated with the first and second options in response to detecting current focus being directed to one of the first and second options, but does not perform operations associated with caption options, audio control options, PIP options, and library options unless and until a selection of a caption option or audio option is detected. In some implementations, in response to detecting input directed to the first or second option, the electronic device updates the position of elements displayed as overlays on the content item (e.g., all) to present additional content at the location where the first or second option was previously displayed in the user interface, without displaying additional content overlays on other elements over the content, but displaying additional content (if any) associated with caption options, audio control options, PIP options, and library options overlays on the content, without updating the position of other elements overlays on the content. In some implementations, the electronic device displays a first option and / or a second option based on the content type of the content item, but displays one or more of the caption options, audio control options, PIP options, and library options based on the characteristics of the content rather than the content type itself.

[0258] Ad markers have different visual characteristics (e.g., color) depending on whether they have been viewed or are about to appear. In some embodiments, one or more playback control elements include a slider. In some embodiments, the slider includes a visual indication of the playback position of the ad within the content. In some embodiments, the visual indication of the playback position of the ad before the current playback position of the electronic device in the content item is displayed with different visual characteristics (e.g., color, size, translucency, style, etc.) than the visual indication of the playback position of the ad after the current playback position of the electronic device in the content item.

[0259] When the ad time arrives, an ad countdown will appear in the message area at the bottom right.

[0260] In some implementations, in response to detecting that the current playback position of the electronic device within the content item is within a predetermined time threshold (e.g., 5, 10, 15, 30 seconds) of the playback position where the advertisement will play, the electronic device displays a countdown indicator indicating the time before the advertisement begins playing. In some implementations, the countdown indicator is displayed at a predetermined location in the user interface overlaid on the content item (e.g., a bottom corner).

[0261] In some implementations, the electronic device displays a countdown indicator (e.g., at a corresponding predetermined location in the user interface) regardless of whether the electronic device is displaying playback control elements and options overlaid on a content item. In some implementations, the electronic device presents the countdown indicator while displaying playback control elements and options overlaid on a content item, and in response to input to stop the display of playback control elements and options overlaid on a content item, stops the display of playback control elements and options overlaid on a content item, and continues to display the countdown indicator overlaid on the content item.

[0262] In some implementations, based on determining that the current playback position of the electronic device in the content item is greater than a threshold time remaining from the end of the content item (e.g., 1, 2, 3, 5, 10, 15, 30 minutes, etc.), the electronic device approaches a slider included in one or more playback control elements to display a visual indication of the remaining time between the current playback position of the electronic device in the content item and the end of the content item. In some implementations, based on determining that the current playback position of the electronic device in the content item is less than a threshold time remaining from the end of the content item (e.g., 1, 2, 3, 5, 10, 15, 30 minutes, etc.), the electronic device abandons displaying the visual indication of the remaining time between the current playback position of the electronic device in the content item and the end of the content item. In some implementations, based on determining that the distance between the visual indication of the current playback position of the electronic device in the content item on a slider included in one or more playback control elements and the position of a slider corresponding to the end of the content item is greater than a threshold distance (e.g., 50, 100, 200, 500 pixels, etc.), the electronic device approaches a slider to display a visual indication of the remaining time between the current playback position of the electronic device in the content item and the end of the content item. In some implementations, based on the visual indication that the current playback position of the electronic device in a content item on a slider included in one or more playback control elements is less than a threshold distance (e.g., 50, 100, 200, 500 pixels, etc.) from the slider position corresponding to the end of the content item, the electronic device abandons displaying a visual indication of the remaining time between the current playback position of the electronic device in the content item and the end of the content item.

[0263] In some embodiments, when the electronic device presents a content item without displaying one or more playback control elements and options overlaying the content item, the electronic device displays a caption for the content item overlaying the content item at a first position (e.g., bottom). In some embodiments, when the electronic device presents a content item while displaying one or more playback control elements and options overlaying the content item, the electronic device displays one or more playback control elements and options overlaying the content item at a first position (e.g., bottom) and displays a caption for the content item overlaying the content item at a second position (e.g., directly above one or more playback control elements and options).

[0264] In some implementations, such as in Figure 6XIn this context, the corresponding content type is live content (e.g., live media being streamed or broadcast live from a source). In some embodiments, the electronic device cannot jump within a playback location of the live media. In some embodiments, the electronic device can jump within a limited range of playback locations of the live media. In some embodiments, the electronic device can jump to any playback location within the live media. In some embodiments, the live media is a content item currently being broadcast or streamed from its source during a predetermined time period defined by the content source (rather than before or after a time defined by the source). For example, a news broadcast is broadcast by a content source (e.g., a channel) from 10 PM to 11 PM, and the electronic device can access the news broadcast during that time period, with the corresponding portion of the news broadcast available at that time but not at other times.

[0265] In some implementations, such as in Figure 6X In this implementation, when presenting a content item (e.g., 602c), the electronic device (e.g., 500) receives input (e.g., via touch 603x) via one or more input devices corresponding to a request to rewind (or jump forward in) the content item (e.g., 602c) by a certain amount. In some embodiments, the input is directed to a corresponding playback control element associated with the live content (e.g., a slider for the live content). In some embodiments, the corresponding amount corresponds to the speed, duration, distance, etc., of a directional component of the input (e.g., the directional button of the input device for swiping, pressing, and holding).

[0266] In some implementations, when presenting content items (e.g., 602c), in response to receiving input corresponding to a request for rewind content (e.g., Figure 6X In the case of contact 603x), based on a determined amount less than (or equal to) a threshold (e.g., a predetermined threshold), the electronic device 500 will rewind (or jump forward) the content (e.g., 602c) by the corresponding amount, such as in Figure 6Z In some implementations, predetermined thresholds are selected by the content item provider or creator, and different live content items are associated with different predetermined thresholds.

[0267] In some implementations, when presenting a content item (e.g., 602c), in response to receiving an input (e.g., a request corresponding to rewind content (e.g., 602c)) is received. Figure 6Y In the case of contact 603y), if the corresponding amount is determined to be greater than (e.g., a predetermined) threshold, the electronic device (e.g., 500) will abandon rewinding the content by the corresponding amount, such as in Figure 6ZIn some embodiments, the electronic device rewinds content by a threshold amount determined to be greater than a predetermined threshold. In some embodiments, the electronic device does not rewind content and continues playback from the current playback position, based on the determination that the amount is greater than a predetermined threshold. In some embodiments, the electronic device presents a visual indication that skipping the predetermined threshold is not allowed, based on the determination that the amount is greater than (e.g., a predetermined) threshold. In some embodiments, the swipe input includes a horizontal movement component and a selection component, the horizontal movement component causing the electronic device to update the position of the slider based on the horizontal movement, and the selection component causing the electronic device to resume playback of the content item from the position of the slider. In some embodiments, the electronic device limits the movement of the slider indication beyond the threshold even if the movement of the input corresponds to a movement of the slider indication exceeding the threshold.

[0268] The above method of rewinding content items within a predetermined threshold provides an effective way to comply with content item license agreements, which in turn reduces power consumption and extends the battery life of electronic devices by enabling users to use them more quickly and efficiently.

[0269] In some implementations, such as in Figure 6X In this context, the first content type is live content (e.g., live media being streamed or broadcast live from a source). In some embodiments, the electronic device cannot jump within the playback position of the live media. In some embodiments, the electronic device can jump within a limited range of the playback positions of the live media. In some embodiments, the electronic device can jump to any playback position within the live media.

[0270] In some implementations, such as in Figure 6XIn this context, one or more first playback control elements include a slider (e.g., 608d) comprising a first region (e.g., 610d) corresponding to an earlier playback position in a content item (e.g., 602c) that cannot be rewound (e.g., displayed with first visual characteristics (e.g., color, size, translucency, style, pattern, etc.)), a second region (e.g., 610a) corresponding to an earlier playback position in a content item (e.g., 602c) that can be rewound (e.g., displayed with second visual characteristics (e.g., color, size, translucency, style, pattern, etc.) that are optionally different from the first visual characteristics), and a third region (e.g., 610f) corresponding to a future playback position of the content item (e.g., having a buffered portion) (e.g., displayed with third visual characteristics (e.g., color, size, translucency, style, pattern, etc.) that are optionally different from the first and second visual characteristics). In some implementations, the slider further includes a fourth region (e.g., displayed with a fourth visual characteristic (e.g., color, size, translucency, style, pattern, etc.) that is optionally different from the first, second, and third visual characteristics), corresponding to a future playback position of a portion of the content item that has not yet been buffered. In some implementations, if there is no limitation on the distance the electronic device can rewind the content item, the slider only includes a region preceding the current playback position of the electronic device in the content item (e.g., the entire slider corresponding to a playback position preceding the current playback position of the electronic device in the content item has one visual characteristic). In some implementations, the electronic device is capable of updating the slider's indication to a position within the second or third region, but not to a position within the first or fourth region.

[0271] The aforementioned method, which includes different areas of the slider corresponding to the allowed and disallowed sections of the content item, as well as sections after the current playback position, provides an effective way to indicate how far the electronic device can jump back within the content item. This, in turn, reduces power consumption and extends the battery life of the electronic device by enabling users to use it more quickly and efficiently.

[0272] In some implementations, such as in Figure 6DDIn response to input, the electronic device, based on determining that the corresponding content type is live content (e.g., live media from a source live streaming or live broadcast) and determining that a playback position within the content item to be skipped is unavailable, displays a slider (e.g., 608f, included in one or more playback control elements) comprising a first area (e.g., 610e) corresponding to the playback position of a content item before the current playback position of the content item (e.g., 602e) and a second area (e.g., 610h) corresponding to the playback position of a content item (e.g., 602e) after the current playback position of the content item, wherein the first area (e.g., 610e) and the second area (e.g., 610h) of the slider (e.g., 608f) are displayed with the same visual style (e.g., the same color, size, translucency, overall appearance). In some embodiments, the electronic device cannot skip within the playback position of the live media. In some embodiments, the electronic device is able to skip within a limited range of playback positions of the live media. In some implementations, the electronic device is capable of jumping to any playback position within the live media. In some implementations, the slider includes a visual indication of the electronic device's current playback position within the content item. In some implementations, the slider includes a visual indication of the remaining time between the electronic device's current playback position within the content item and the end of the content item. In some implementations, the electronic device cannot update the sliding position indicated by the slider based on sliding input (e.g., the slider's sliding position indicates the current playback position of the content item, which is based on the portion of the content item currently being served by the content source).

[0273] The above-described method of displaying the first and second areas of the slider with the same visual characteristics when skipping is unavailable provides an effective way to indicate to the user that input directed to the slider will not cause the electronic device to skip the playback position within the content item. This also reduces power consumption and extends the battery life of the electronic device by enabling users to use the electronic device more quickly and efficiently.

[0274] In some implementations, such as in Figure 6IIn the display of a corresponding playback control element (e.g., 608b) (e.g., a slider included in one or more playback control elements) corresponding to a specific content item (e.g., 602a), upon determining that a friend of the user of the electronic device (e.g., 500) has consumed (at least) a portion of the content item (e.g., 602a), the corresponding playback control element (e.g., 608b) includes a first visual indication (e.g., 622a) of the current playback position of the content item (e.g., 602a) associated with that portion of the content item (e.g., 602a) consumed by that friend (e.g., at its end), including a graphical representation of that friend. In some embodiments, the graphical representation of the friend is an image or avatar associated with the friend's user account or a contact card entry of an electronic device associated with the friend (e.g., a user account associated with that electronic device). In some embodiments, a "friend" is a user who shares content consumption history. In some implementations, a graphical representation of the friend is displayed at the position of a slider corresponding to the playback position within a recently played content item (e.g., the position where the friend paused or stopped playback, or the position where the friend is currently playing playback). In some implementations, the electronic device presents a first visual indication regardless of whether the friend has completed the content item or only played a subset of the content item. In some implementations, the electronic device presents only the first visual indication if the friend has already viewed a subset of the content item, and abandons presenting the first visual indication if the friend has already viewed the entire content item.

[0275] The above-described method of presenting a visual indication of the current playback position of a content item that is partially associated with a content item consumed by a friend provides an effective way to share a friend's content consumption history with users of electronic devices. This also reduces power consumption and extends the battery life of electronic devices by enabling users to use them more quickly and efficiently.

[0276] In some implementations, such as in Figure 6IIn this implementation, when a corresponding playback control element (e.g., 608b) (e.g., a slider) displays a first visual indication (e.g., 622a) (including a graphical representation of the friend) of the current playback position of a content item associated with a friend (e.g., 602a), an electronic device (e.g., 500) receives a sequence of one or more inputs (e.g., via touch 603i) directed to the corresponding playback control element (e.g., 608b) via one or more input devices (e.g., 510b), including inputs directed to the first visual indication (e.g., 622a) of the current playback position of the content item associated with a portion of the content item consumed by the friend. In some embodiments, the input corresponds to a request to update the playback position of the slider to the playback position associated with the friend. In some embodiments, the sequence of one or more inputs includes an input corresponding to a request to pause a content item that was detected prior to the input corresponding to the request to update the playback position of the slider to the playback position associated with the friend. In some implementations, the sequence of one or more inputs further includes an input corresponding to a request to further update the playback position of the slider, which is detected after an input corresponding to a request to update the playback position of the slider to the playback position associated with a friend.

[0277] In some implementations, such as in Figure 6K In response to receiving one or more inputs (e.g., including...) Figure 6J In the sequence of contacts 603j), the electronic device (e.g., 500) stops displaying a first visual indication (e.g., 602a) of the current playback position of the content item (e.g., 602a) associated with the portion of the content item consumed by the friend (e.g., 603j). Figure 6J (622a) includes a graphical representation of a friend. In some embodiments, when the playback position of the slider is the same as the playback position of a content item associated with a portion of the content item consumed by the friend, the electronic device displays a first visual indication of the current playback position of the content item associated with the portion of the content item consumed by the friend. In some embodiments, in response to detecting an input corresponding to a request to further update the playback position of the slider to a playback position different from the playback position of the content item associated with the portion of the content item consumed by the friend, the electronic device stops displaying the first visual indication of the playback position of the content item associated with the portion of the content item consumed by the friend.

[0278] In some implementations, such as in Figure 6KIn response to receiving a sequence of one or more inputs, an electronic device (e.g., 500) displays, in association with a corresponding playback control element (e.g., 608b), a second visual indication (e.g., 622b) of the current playback position of a content item (e.g., 602a) associated with a portion of a content item consumed by a friend (e.g., 602a), without including a graphical representation of the friend. In some embodiments, the second visual indication of the playback position of the content item associated with a portion of a content item consumed by a friend is an indication of position on a slider that does not include a graphical representation of the friend. In some embodiments, in response to detecting an input corresponding to a request to update the playback position indicated by the slider to the playback position of the content item associated with a portion of a content item consumed by a friend, the electronic device displays a first visual indication of the playback position of the content item associated with a portion of a content item consumed by a friend. The above-described method of displaying a second visual indication of the current playback position of a content item associated with a portion of a content item consumed by a friend, in response to a sequence of one or more inputs, without excluding the graphical representation of a friend, provides an efficient way to reduce the portion of content obscured by the friend's graphical representation while still indicating the current playback position of the content item associated with the portion of the content item consumed by the friend. This also reduces power consumption and extends the battery life of electronic devices by enabling users to use them more quickly and efficiently.

[0279] In some implementations, such as in Figure 6I In the display of a corresponding playback control element (e.g., 608b) that includes a first visual indication (e.g., 622) (or a second visual indication) of the current playback position of a content item (e.g., 602a) associated with a portion of the content item consumed by a friend (e.g., 602a), an electronic device (e.g., 500) receives, via one or more input devices (e.g., 510b), an input (e.g., via touch 603i) directed to the first visual indication (e.g., 622a) (or a second visual indication) of the current playback position of a content item (e.g., 602a) associated with a portion of the content item consumed by a friend (e.g., 602a). In some embodiments, the input corresponds to a request to update the playback position of the slider to the playback position associated with the friend.

[0280] In some implementations, in response to receiving an input that guides to a first visual indication (e.g., via contact 603i), such as in Figure 6IIn this embodiment, an electronic device (e.g., 500) displays a visual indication (e.g., 622b) of a friend's name in association with a corresponding playback control element (e.g., 608b) (e.g., a first visual indication of the current playback position of a content item nearing a portion of the content item consumed by the friend). In some embodiments, if input is received while displaying a second visual indication and the input is directed to the second visual indication, the electronic device displays both the first visual indication and the visual indication of the friend's name in response to receiving the input.

[0281] The aforementioned method of displaying a visual indication of a friend's name in association with the corresponding playback control element provides an effective way to provide more information about the friend. This also reduces power consumption and extends the battery life of electronic devices by enabling users to use them more quickly and efficiently.

[0282] In some implementations, such as in Figure 6N In this context, when presenting a content item (e.g., 602a) without displaying one or more corresponding control elements (e.g., sliders) corresponding to the corresponding content type (e.g., not displaying one or more first playback control elements or one or more second playback control elements and not displaying a first option or a second option), an electronic device (e.g., 500) receives, via one or more input devices, an input (e.g., 603n) corresponding to a request to update the current playback position in the content item (e.g., 602a) by a predetermined amount (e.g., 5, 10, 15, 20, 30 seconds, etc., such as a click input detected in the right (forward jump) or left (backward jump) portion of the input area (e.g., touch-sensitive surface 451) of a remote control device). In some embodiments, this request is a forward or backward jump within the content item.

[0283] In some implementations, such as in Figure 6N In the context of presenting a content item (e.g., 602a) without displaying one or more corresponding control elements (e.g., sliders) corresponding to the corresponding content type (e.g., not displaying one or more first playback control elements or one or more second playback control elements and not displaying a first option or a second option), in response to receiving an input (e.g., 603n) corresponding to a request to update the current playback position in the content item (e.g., 602a) by a predetermined amount, such as in Figure 6N In this process, the electronic device (e.g., 500) updates the current playback position in the content item (e.g., 602a) by a predetermined amount, such as in Figure 6O In some implementations, updating the current playback position in a content item by a predetermined amount includes continuing playback of the content item from the updated playback position.

[0284] In some implementations, such as in Figure 6N In the context of presenting a content item (e.g., 602a) without displaying one or more corresponding control elements (e.g., sliders) corresponding to the corresponding content type (e.g., not displaying one or more first playback control elements or one or more second playback control elements and not displaying a first option or a second option), in response to receiving an input (e.g., 603n) corresponding to a request to update the current playback position in the content item (e.g., 602a) by a predetermined amount, such as... Figure 6N In this implementation, the electronic device (e.g., 500) displays a corresponding control element (e.g., 608a) (e.g., a slider) corresponding to the corresponding content type, without displaying a corresponding option corresponding to the corresponding content. In some embodiments, in response to receiving input corresponding to a request to update the current playback position in the content item by a predetermined amount, the electronic device displays the slider without displaying one or more other playback control elements or other indications or options displayed when displaying one or more playback control elements and a first or second option. For example, even if the content item is a movie, the electronic device abandons the display of chapter options, and even if the content item is an episode in a TV series, the electronic device abandons the display of episode options. As another example, the electronic device abandons the display of information options, subtitle options, audio options, library options, PIP options, and / or metadata associated with the content item. In some embodiments, the electronic device (e.g., automatically, without receiving additional input) stops displaying the slider after a predetermined time threshold (e.g., 5, 10, 15, 20, 30 seconds) has elapsed since the slider was automatically displayed without detecting additional input. In some implementations, in addition to displaying a slider, the electronic device also displays visual indicators associated with the input.

[0285] The above-described method of presenting corresponding control elements without corresponding options in response to input corresponding to a request to update the current playback position in the content item by a predetermined amount provides an effective way to reduce the portion of the content item obscured by playback control elements and options while providing visual feedback to the input. This also reduces power consumption and extends the battery life of electronic devices by enabling users to use them more quickly and efficiently.

[0286] In some implementations, such as in Figure 6JIn this embodiment, when displaying one or more playback control elements (e.g., 608b) corresponding to a specific content type (e.g., one or more first playback control elements or one or more second playback control elements), the electronic device (e.g., 500) receives input (e.g., 603j) directed to the first playback control element (e.g., 608b) (e.g., a slider) corresponding to the specific content type via one or more input devices (e.g., 510b). In some embodiments, the input corresponds to a request to update the playback position indicated by the slider.

[0287] In some implementations, when displaying one or more playback control elements (e.g., 608b) corresponding to a corresponding content type (e.g., one or more first playback control elements or one or more second playback control elements), in response to receiving an input (e.g., 603j) directed to the first playback control element (e.g., 608b) corresponding to the corresponding content type, such as in Figure 6J In this embodiment, an electronic device (e.g., 500) displays a thumbnail (e.g., 624b) corresponding to a corresponding portion of a content item (e.g., 602a) near a first playback control element (e.g., 608b). In some embodiments, the thumbnail includes a static image of the content item at a playback position indicated by a slider according to the input.

[0288] In some implementations, when displaying one or more playback control elements (e.g., 608b) corresponding to a given content type (e.g., one or more first playback control elements or one or more second playback control elements), in response to receiving an input (e.g., 603j) directed to the first playback control element (e.g., 608b) corresponding to the given content type after a predetermined time has elapsed since the display of the self-initiated thumbnail (e.g., 624c) (e.g., 626b, e.g., 5, 10, 15, 20, 30 seconds, etc.) (e.g., no further input detected), such as in Figure 6J In this context, a determined thumbnail (e.g., 624c) is displayed as an overlay on a second playback control element (e.g., 606a) within one or more playback control elements corresponding to the respective content type, such as in... Figure 6K In this context, electronic devices (e.g., 500) stop displaying thumbnails, such as in... Figure 6L In some implementations, the second playback control element is displayed near a slider in the user interface, such as above the slider. In some implementations, if the thumbnail (at least partially) covers the playback control element, the display of the thumbnail times out after a predetermined time threshold.

[0289] In some implementations, when displaying one or more playback control elements (e.g., 608b) corresponding to a given content type (e.g., one or more first playback control elements or one or more second playback control elements), in response to receiving an input (e.g., 603j) directed to the first playback control element (e.g., 608b) corresponding to the given content type after a predetermined time has elapsed since the display of the self-initiated thumbnail (e.g., 624d) (e.g., 626b, e.g., 5, 10, 15, 20, 30 seconds, etc.) (e.g., no further input detected), such as in Figure 6J In accordance with the determination that the thumbnail (e.g., 624d) is not displayed as an overlay on the second playback control element (e.g., 606a) (e.g., or any other control element), the electronic device (e.g., 500) maintains the display of the thumbnail (e.g., 624d), such as in Figure 6M In some implementations, if the thumbnail is not overlaid on a playback control element, the thumbnail display does not time out after a predetermined time threshold. If the thumbnail is displayed (at least partially) over another playback control element, stopping the thumbnail display after a predetermined time provides an efficient way to present playback control elements in the user interface, which in turn reduces power consumption and extends the battery life of the electronic device by enabling users to use the device more quickly and efficiently.

[0290] In some implementations, in response to receiving an input (e.g., Figure 6A In 603a), an electronic device (e.g., 500) displays one or more corresponding playback control elements (e.g., 608a) corresponding to a corresponding content type (e.g., one or more first playback control elements or one or more second playback control elements), such as in Figure 6B In some implementations, the electronic device displays one or more corresponding playback control elements overlaid on the content item.

[0291] In some implementations, such as in Figure 6B In this context, one or more corresponding playback control elements include a slider (e.g., 608a). In some implementations, such as in... Figure 6BIn response to receiving input, the current focus (e.g., 613b) of the electronic device (e.g., 500) is initially directed to the slider (e.g., 608a). In some embodiments, the electronic device simultaneously displays one or more interactive control elements or options above the slider and one or more interactive control elements or options below the slider. For example, the electronic device displays a first option or a second option below the slider and, in response to downward input, moves the current focus from the slider to the first option or the second option. As another example, the electronic device displays audio options, subtitle options, PIP options, and / or library options above the slider and, in response to upward input, moves the current focus from the slider to one of the audio options, subtitle options, PIP options, or library options.

[0292] The aforementioned method of initially directing the current focus of the electronic device to the slider provides an efficient way to guide input to the slider, which in turn reduces power consumption and extends the battery life of the electronic device by enabling users to use it more quickly and efficiently.

[0293] In some implementations, in response to receiving an input (e.g., Figure 6A In 603a), an electronic device (e.g., 500) displays one or more options (e.g., 614a to 614c) corresponding to content of a corresponding content type (e.g., including a first option or a second option and optionally one or more additional options), such as in Figure 6A In some implementations, such as in Figure 6P In this context, one or more options are determined to be an option (e.g., 614d) (e.g., a first option or a second option). The option (e.g., 614d) is displayed along with a first visual characteristic (e.g., and is not selectable and / or cannot be focused on). In some embodiments, displaying an option with a first visual characteristic includes displaying an option centered on the content, where downward-pointing input (e.g., a swipe, selecting a down arrow key, etc.) will perform a corresponding function associated with that option. For example, if the option is a first option, the electronic device displays a representation of the first content in response to detecting downward input. As another example, if the option is a second option, the electronic device displays a representation of the second content in response to detecting downward input.

[0294] In some implementations, such as in Figure 6BIn some embodiments, depending on whether one or more options are multiple options (e.g., 614a to 614c) (e.g., including a first option and / or a second option), multiple options (e.g., 614a to 614c) are displayed with second visual characteristics different from the first visual characteristics (e.g., and are selectable and / or may have a current focus pointing to them). In some embodiments, displaying options with second visual characteristics includes displaying options aligned with the (e.g., left or right) side of the content without an arrow indicating that a downward input (e.g., swipe, selecting a down arrow key, etc.) will perform the corresponding function associated with the option. In some embodiments, if the electronic device displays multiple options, the electronic device performs an action on the option in response to detecting input that is directed to (e.g., without selecting, selecting) the option. In some embodiments, the number of options displayed depends on the type of additional content associated with the available content items. In some embodiments, if an option is displayed below a slider, a downward input detected while the current focus is on the slider moves the current focus to the additional content associated with that option. In some implementations, if multiple options are displayed below a slider, a downward input detected while the current focus is on the slider will move the current focus to that option, and a subsequent downward input will move the current focus to the content associated with that option.

[0295] The above method of displaying one or more options with different visual characteristics, depending on whether there is one option or multiple options, provides an efficient way to perform actions about options and to ensure that options are easily visible to the user when only one option is displayed. This also reduces the power consumption of electronic devices and extends their battery life by enabling users to use electronic devices more quickly and efficiently.

[0296] In some implementations, such as in Figure 6DD In the event that one or more corresponding playback control elements (e.g., 608f) corresponding to a corresponding content type (e.g., one or more first playback control elements or one or more second playback control elements) are displayed, the electronic device (e.g., 500) receives input (e.g., 603dd) via one or more input devices (e.g., 510a) corresponding to a request to perform an action regarding a content item (e.g., 602e), such as in Figure 6DD In some implementations, the action regarding a content item is to skip the current playback position of the electronic device within the content item forward or backward by a corresponding amount or any amount.

[0297] In some implementations, such as in Figure 6DDIn the context of displaying one or more corresponding playback control elements (e.g., 608f) corresponding to a specific content type (e.g., one or more first playback control elements or one or more second playback control elements), in response to receiving input (e.g., 603dd) corresponding to a request to perform an action regarding a content item, such as in Figure 6DD In this context, if an action is determined to be unavailable, the electronic device (e.g., 500) abandons the execution of the action, such as in... Figure 6EE In some implementations, the playback position for skipped content items is unavailable for (e.g., any or some) live media. In some implementations, in response to an input corresponding to a request for the current playback position of the electronic device within a skipped content item, if the playback position within the skipped content item is unavailable, the electronic device abandons the current playback position of the skipped content item.

[0298] In some implementations, such as in Figure 6DD In the context of displaying one or more corresponding playback control elements (e.g., 608f) corresponding to a specific content type (e.g., one or more first playback control elements or one or more second playback control elements), in response to receiving input (e.g., 603dd) corresponding to a request to perform an action regarding a content item, such as in Figure 6DD In some embodiments, an electronic device (e.g., 500) and one or more corresponding playback control elements (e.g., 608f) corresponding to a specific content type (e.g., a first option or a second option) simultaneously display a message indicating that the action is unavailable (e.g., 630b). In some embodiments, the message is displayed at a corresponding predetermined location in the user interface. In some embodiments, based on the determination that an action is available, the electronic device performs the action in response to input without displaying a message indicating that the action is unavailable. In some embodiments, if the action is available, the electronic device performs the action in response to input and presents a visual indication (e.g., a message, an image) confirming the execution of the action. In some embodiments, the visual indication confirming the execution of the action is displayed in the user interface at a corresponding predetermined location where the message indicating that the action is unavailable would be displayed (or displayed for different actions and / or different content items).

[0299] The above method of presenting a message that an action is unavailable provides an effective way to confirm that input has been received without performing the action. This also reduces power consumption and extends the battery life of electronic devices by enabling users to use them more quickly and efficiently.

[0300] In some implementations, in response to receiving an input (e.g., Figure 6AIn 603a), an electronic device (e.g., 500) displays one or more corresponding options (e.g., 614a-c) corresponding to the corresponding content of the corresponding content type, such as in Figure 6B (For example, and simultaneously display one or more corresponding playback control elements corresponding to the corresponding content type overlaid on the content item (e.g., one or more first playback control elements or one or more second playback control elements)).

[0301] In some implementations, such as in Figure 6B In this context, the source (e.g., creator, publisher, distributor, streaming service, network, channel, etc.) of a content item (e.g., 602a) is identified as a first source, and one or more corresponding options are one or more first corresponding options (e.g., 614a to 614c). In some embodiments, the source of the content item is able to set one or more options to be displayed simultaneously with one or more playback control elements overlaid on the content item in response to input. In some embodiments, the one or more options displayed vary depending on the content item provided by the source. For example, a corresponding source may provide one or more first options for a first type of content item and one or more second options for a second type of content item. Examples of types of content items include TV series, movies, fiction, nonfiction, sports, news, etc.

[0302] In some implementations, such as in Figure 6Q In this implementation, the source of a content item is determined to be a second source (e.g., 602c), and one or more corresponding options are one or more second corresponding options (e.g., 614a, 614d, 614c, and 614f). In some implementations, in response to the detection of input, different content sources provide different options to be displayed simultaneously with one or more playback control elements overlaid on the content item. In some implementations, content items of the same type from different sources will have different associated options. For example, a movie from a first source is associated with a first plurality of options, and a movie from a second source is associated with a second plurality of options.

[0303] The above-described method of displaying corresponding options based on the content source provides an effective way to present options related to the presented content. This also reduces power consumption and extends the battery life of electronic devices by enabling users to use them more quickly and efficiently.

[0304] In some implementations, such as in Figure 6BIn this implementation, based on the determination that the corresponding content type is a first content type (e.g., an episode in a series of episode content), one or more corresponding options include information options (e.g., 614a) associated with information about the content item (e.g., 602a) (e.g., the electronic device displays this option in response to detecting input that has been directed to (e.g., currently focused but not selected, selected) the option), episode options (e.g., 614b) associated with episodes in the same series of episode content associated with the same content item (e.g., 602a) (e.g., the electronic device displays a representation of the option in response to detecting input that has been directed to (e.g., currently focused but not selected, selected) the option), and playback queue options (e.g., 614c) associated with multiple third content items in the playback queue of the user of the electronic device (e.g., 500) (e.g., the electronic device displays a representation of the option in response to detecting input that has been directed to (e.g., currently focused but not selected, selected) the option). In some implementations, in response to detecting input that has been directed to (e.g., currently focused but not selected, selected) the corresponding option, the electronic device presents content associated with that option at a corresponding location in the user interface. In some implementations, the electronic device presents the content associated with each option in the same location in the user interface that overlays the content item.

[0305] If the content type is the primary content type, the above-described methods of presenting information options, episode options, and playback queue options provide an effective way to present options related to the content items. This also reduces the power consumption of electronic devices and extends their battery life by enabling users to use them more quickly and efficiently.

[0306] In some implementations, such as in Figure 6AAIn this implementation, based on the determination that the corresponding content type is a second content type (e.g., a movie), one or more corresponding options include information options (e.g., 614a) associated with information about the content item (e.g., the electronic device displays an option in response to detecting an input that leads to (e.g., current focus without selection, selection) an option), chapter options (e.g., 614e) associated with a chapter of the content item (e.g., the electronic device displays a representation of the option in response to detecting an input that leads to (e.g., current focus without selection, selection) an option), and next queue options (e.g., 614c) associated with representations of multiple third content items in the playback queue (e.g., the electronic device displays a representation of the option in response to detecting an input that leads to (e.g., current focus without selection, selection) an option). In some implementations, in response to detecting an input that leads to (e.g., current focus without selection, selection) a corresponding option, the electronic device presents content associated with that option at a corresponding location in the user interface. In some implementations, the electronic device presents content associated with each option at the same location in the user interface overlaid on the content item.

[0307] If the content type is the second content type, the above-described method of presenting information options, chapter options, and playback queue options provides an effective way to present options related to content items. This also reduces the power consumption of electronic devices and extends their battery life by enabling users to use them more quickly and efficiently.

[0308] In some implementations, such as in Figure 6B In this implementation, one or more corresponding options (e.g., 614a to 614c) associated with the corresponding content (e.g., 602a) are displayed in a first area of ​​the user interface that includes the content item (e.g., 602a). In some embodiments, the first area of ​​the user interface that includes the content item is an area overlaid on the content item below the corresponding playback control element (e.g., a slider). In some embodiments, the electronic device displays all options, and in response to detecting input directed to (e.g., current focus without selection, selection) the corresponding option, the electronic device presents the corresponding content associated with the corresponding option in the first area of ​​the user interface.

[0309] In some implementations, such as in Figure 6BIn some embodiments, one or more corresponding options not associated with the corresponding content (e.g., 606a to 606c) are not displayed in the first area of ​​the user interface. In some embodiments, one or more corresponding options unrelated to the corresponding content are displayed in the second area of ​​the user interface. In some embodiments, the user interface does not include one or more corresponding options unrelated to the corresponding content. In some embodiments, the electronic device does not display options unrelated to the content in the first area of ​​the user interface. For example, the electronic device presents options that, in response to detecting input directed to (e.g., without selection, selection of the current focus) a corresponding option, cause the electronic device to display settings and / or playback control elements for the content item in a second area of ​​the user interface, different from the first area. In some embodiments, the second area of ​​the user interface is above the corresponding playback control element (e.g., a slider).

[0310] The above-described method of presenting content-related options in the first area of ​​the user interface provides an efficient way to present content-related options near the corresponding area of ​​the user interface in which the content will be displayed in response to the detection of input that has been directed to the options. This also reduces the power consumption of electronic devices and extends their battery life by enabling users to use them more quickly and efficiently.

[0311] It should be understood that, Figure 7 The specific order in which the operations described herein are presented is merely exemplary and not intended to indicate that the described order is the only possible order in which these operations can be performed. Those skilled in the art will conceive of various ways to reorder the operations described herein. Furthermore, it should be noted that the details of other processes described herein with respect to other methods (e.g., method 900) also apply in a similar manner to the above descriptions of other methods. Figure 7 Method 700 is described above. For example, the manner in which a user interface for controlling playback of content items is presented, as described above with reference to method 700, optionally has one or more characteristics of a manner in which a user interface is presented for browsing and switching between content items available for playback, as described with reference to other methods described herein (e.g., method 900). For the sake of brevity, these details will not be repeated here.

[0312] The operations in the above information processing method are optionally implemented by running one or more functional modules in an information processing device, such as a general-purpose processor (e.g., as opposed to...). Figures 1A to 1B , Figure 3 , Figures 5A to 5C (as described above) or a dedicated chip. Furthermore, see the above references. Figure 7 The operation is optionally performed by Figures 1A to 1BThe components depicted are used to implement this. For example, receiving operation 702 and display operation 704 are optionally implemented by event classifier 170, event recognizer 180, and event handler 190. Event monitor 171 in event classifier 170 detects touch on touchscreen 504, and event dispatcher module 174 transmits event information to application 136-1. The corresponding event recognizer 180 of application 136-1 compares the event information with the corresponding event definition 186 and determines whether the first touch at a first location on the touchscreen corresponds to a predefined event or sub-event, such as a selection of an object on the user interface. When a corresponding predefined event or sub-event is detected, event recognizer 180 activates the event handler 190 associated with the detection of that event or sub-event. Event handler 190 optionally utilizes or invokes data updater 176 or object updater 177 to update the internal state 192 of the application. In some embodiments, event handler 190 accesses the corresponding GUI updater 178 to update the content displayed by the application. Similarly, those skilled in the art will clearly understand how it can be based on Figures 1A to 1B The components described in the text are used to implement other processes.

[0313] User interface for browsing and switching between content items.

[0314] Users interact with electronic devices in many different ways, including using them to play content items. The embodiments described below provide a way for electronic devices to present a user interface for browsing and selecting content items that can be played back on the electronic device. Providing an efficient way to browse and switch between content items enhances interaction with the device, thereby reducing the amount of time required for a user to find the content item to play, which extends the battery life of battery-powered devices. It should be understood that people use devices. When a person uses a device, that person is optionally referred to as a user of the device.

[0315] Figures 8A to 8L Exemplary ways in which an electronic device, according to some embodiments, presents a user interface for browsing and switching between content items available for playback are illustrated. The embodiments in these figures are used to illustrate the processes described below, including references to... Figure 9 The process described. Although Figures 8A to 8L The electronic device is shown to be capable of performing the following reference. Figure 9 Various examples of the methods described are provided, but it should be understood that these examples are not intended to be limiting, and the electronic device is capable of operating without reference to these examples. Figures 8A to 8L The method described below is to perform the procedure as described in the reference. Figure 9 The one or more processes described above.

[0316] Figures 8A to 8LVarious examples of user interfaces for browsing and switching between content items that can be played back on an electronic device are shown. For example, the electronic device may optionally display a representation of a content item while playing the corresponding content item.

[0317] Figure 8A An electronic device 500 is shown that presents playback control elements overlaid on a television program 802a being played on the electronic device 500. In some embodiments, the electronic device 500 presents the playback control elements overlaid on the television program 802a in a manner that includes one or more steps of method 700. In some embodiments, when the electronic device 500 is initially powered on, initially enters content playback mode, and / or initially navigates to the live content tab 810b and does not include playback of the sound of the television program 802a, Figure 8A The user interface shown is presented by electronic device 500. In some embodiments, the user interface includes an indication 804a that the TV program 802a is live (e.g., streaming or broadcast), an indication 804b that the name of the TV program 802a is shown, an option 806a for watching the subtitles for playback of the TV program 802a, an option 806b for watching the audio for playback of the TV program 802a, an option 806c for presenting the TV program 802a in a picture-in-picture element, a slider 808a, an information tab 810a, a live tab 810b, a next tab 810c, and an indication 834 of how to access the channel guide user interface (e.g., by swiping down while the current focus 813a is on the content of one of the tabs 810a-c).

[0318] In some implementations, electronic device 500 presents the content of a Live tab 810b in a user interface, including representations 812a-d of currently streaming or live-broadcast content items that can be played back on electronic device 500. In some implementations, representations 812a-d include playback progress bars 814a-d that indicate portions of content items that have been live-streamed or live-broadcast, regardless of whether the electronic device (e.g., a user account associated with the electronic device) has played any portion of any content item. For example, as... Figure 8AAs shown, the current focus 813a is on representation 812b corresponding to the currently playing television program 802a. In some embodiments, when the current focus 813a is on representation 812b, the electronic device 500 presents an indication 816b of the channel overlaid on the content item on representation 812b that is being streamed or broadcast, and an indication 816a of the name of the content item near (e.g., below) representation 812b. In some embodiments, if the electronic device 500 detects a horizontal swipe about input device 510b, the electronic device 500 updates the current focus to a different representation 812a, 812c, or 812d based on the swipe, displays metadata associated with representation 812a, 812c, or 812d, and stops displaying metadata 816a and metadata 816b. In some embodiments, representations 812a-d are horizontally scrollable, and the electronic device 500 optionally reveals in response to the scrolling. Figure 8A Additional representations not shown. In some embodiments, according to one or more steps of the method 700 described above, electronic device 500 facilitates interaction with indication and control elements overlaid on television program 802a.

[0319] like Figure 8A As shown, electronic device 500 detects selection of representation 812b (e.g., via contact 803a) via input device 510a. In some embodiments, such as Figure 8B As shown, in response to Figure 8A As shown in the input diagram, electronic device 500 initiates playback of the sound associated with television program 802a. In some embodiments, if electronic device 500 detects a selection of different representations 812a, 812c, or 812d, electronic device 500 will initiate playback of the content item (e.g., with sound) associated with the selected representation 812a, 812c, or 812d.

[0320] like Figure 8B As shown, in some embodiments, when the current focus 813b is on the display 812b of the television program 802a, the electronic device 500 detects a downward swipe of the contact 803b via the input device 510b. In some embodiments, in response to Figure 8B The input shown in the figure is presented by the electronic device 500. Figure 8C The Channel Guide user interface shown in the image.

[0321] Figure 8C It shows the response to Figure 8BThe exemplary channel guide user interface shown is presented in response to the input. In some embodiments, the channel guide user interface includes indications 818a-e of various channels (or more generally, sources of live content) accessible to the electronic device and representations 820a-e of content items currently being streamed or broadcast on the channel. In some embodiments, Figure 8C The user interface shown does not include representations of content items that are not currently being streamed or broadcast (e.g., content items that will be streamed or broadcast in the future). In some embodiments, indications 818a-e and representations are displayed as overlays on electronic device 500. Figure 8B On the television program 802a being presented, the program continues to play in the background (e.g., with or without audio). Despite Figure 8C Channel indicators 818a-e are displayed as numerical indicators, but in some embodiments, the electronic device presents the channel image and / or name instead of the channel number. In some embodiments, the channel guide user interface is initially scrolled to the channel (e.g., channel 7) where television program 802a is playing. In some embodiments, the representation 820c of television program 802a is a user interface element indicating that the electronic device 500 is currently playing content associated with representation 820c. In some embodiments, representations 820a-b and 820d-e of content items on other channels are (e.g., static) images associated with the content items. In some embodiments, such as Figure 8C As shown, electronic device 500 detects a downward swipe of contact 803c via input device 510b. In some embodiments, in response to detection... Figure 8C The inputs in the electronic device 500 include the indication of the scrolling channel 818a-e and the representation of the content items on the channel 820a-e, such as... Figure 8D As shown. In some embodiments, the channel indicators 818a-e and the representations 820a-e of content items on the channel scroll at different speeds (e.g., because the indicators 818a-e and the representations 820a-e are different sizes, or because in some embodiments, there is a different number of indicators 818a-e than the number of representations 820a-e displayed at a given time).

[0322] Figure 8D The electronic device 500 is shown in response to Figure 8C The example shown illustrates how input updates the channel guide user interface. Figure 8DAs shown, in some embodiments, electronic device 500 scrolls the channel indications 818b-f and the representations 820b-f of content items on the channel, such that the representation 820d of channel 8 indicated by indication 818d has current focus. In some embodiments, electronic device 500 continues to play back television program 802a while and after scrolling the indications 818b-f and representations 820b-f. In some embodiments, the representation 820c of television program 802a played on electronic device 500 is an indication of what television program 802a is currently playing. In some embodiments, the representation 820c of television program 802a played on electronic device 802a is an image associated with television program 802a. In some embodiments, the representation 820d with current focus is a live video preview of a content item (e.g., without audio). In some embodiments, electronic device 500 initially presents a static image in representation 820d until the live video preview is buffered on electronic device. In some embodiments, representations 820b, 820e, and 820f include static images associated with content items corresponding to each representation 820b, 820e, and 820f. In some embodiments, in response to detecting a selection of one of the representations 820a-e, the electronic device 500 stops displaying the channel guide user interface and presents content corresponding to the selected representation.

[0323] Figure 8E An example of a channel guide user interface according to some implementation schemes is shown. In some implementation schemes, in response to... Figure 8B The input shown in the image is used to display Figure 8E The user interface in the system. In some implementations, Figure 8E The user interface shown includes genre filtering tabs 822a-g, channel (or more generally, source of live content) indicators 824a-d, and indicators 826a-d of the content item currently playing on a channel available to the electronic device 500. In some embodiments, in response to detecting a selection of one of the indicators 826a-d, the electronic device 500 stops displaying the channel guide user interface and initiates playback (e.g., with audio) of the content item corresponding to the selected indicator. For example, in Figure 8E In this implementation, the Sports tab 822c is currently selected, therefore the user interface includes representations 826a-d of the sports content currently playing on channels accessible to the electronic device 500. In some embodiments, the channel representations 824a-d scroll vertically with the representations 826a-d of the content on those channels. In some embodiments, the Sports tab 822c of the channel guide user interface does not include all channels available to the electronic device 500. In some embodiments, the Sports tab 822c includes only the channels currently playing sports content (e.g., and excludes channels that are not currently playing sports content).

[0324] For example, such as Figure 8E As shown, the current focus 813e is on representation 824c of channel C and representation 826c of the content item currently playing on channel C. In some embodiments, representation 826c includes an image 828a corresponding to the content item, a name 828b of the content item, an indication 828c of the portion and / or progress of the content item associated with it (e.g., the current game and / or the current season in a match) and the league, and an indication 828d of the next sports-related content item to be played on channel C. In some embodiments, other representations 826a-b and representation 826d include the associated image, name, and indications of the portion and league. In some embodiments, representation 826c with only the current focus 813e includes an indication 828d of the next sports-related content item on the channel. In some embodiments, indication 828d includes an indication of the name of the content item and an indication of when the content item will be available (e.g., via broadcast or streaming). In some embodiments, the content item corresponding to indication 828d is not necessarily the next content item to be played on the channel after the currently playing content item. For example, there may be one or more content items that do not belong to the sports genre between the currently playing content item and the content item corresponding to instruction 828d, and an instruction indicating that 826c will not include those content items. In some implementations, the content item corresponding to instruction 828d is the next content item on the channel, regardless of the genre of that content item (e.g., the genre could be something other than sports, such as movies or news). Figure 8E As shown, electronic device 500 detects an upward swipe of contact 803e via input device 510a. In some embodiments, in response to Figure 8E The input shown in the image updates the user interface of the electronic device 500. Figure 8F As shown.

[0325] Figure 8F It shows according to Figure 8E The example shown illustrates the input used to update the channel guide user interface. For example, as... Figure 8FAs shown, electronic device 500 presents a user interface where the current focus 813f is on representation 824b of channel B and representation 826b of content items playing on channel B. In some embodiments, when the current focus 813f is on representation 826b, electronic device 500 updates representation 826b to include an indication 828e of upcoming content items on channel B. In some embodiments, indication 828e is an indication of the next sports-related content item on channel B (e.g., even if other non-sports-related content items exist before the next sports-related content item). In some embodiments, indication 828e is an indication of the next content item on channel B, even if that next content item is not in a sports genre.

[0326] Figure 8G An example of an electronic device 500 presenting a Movies tab of a Channel Guide user interface (e.g., in response to selection of tab 822e) is shown. In some embodiments, the Movies tab of the Channel Guide user interface includes indications 824e-h of the channel on which a currently streaming or broadcast movie can be played on the electronic device 500, and indications 826e-h of the movie currently being streamed or broadcast live. In some embodiments, the user interface does not include indications of channels on which no movie is currently playing. For example, indication 826f is associated with a corresponding movie currently being streamed or broadcast live on channel F. In some embodiments, indication 826f includes a thumbnail 828g associated with the corresponding movie, indication 828h of the name of the corresponding movie, and indication 828i of the current playback position of the corresponding movie being streamed or broadcast live (e.g., regardless of how the user or electronic device consumes the content item). In some embodiments, indications 826e, 826g, and 826h include elements similar to those included in indication 826f. In some implementations, because the current focus 813g is on representation 826f, the electronic device 500 displays representation 826f with indication 828f of the upcoming content item on channel F. In some implementations, the upcoming content item is the next movie on channel F (e.g., even if there is a non-movie content item that will be broadcast or streamed before the next movie). In some implementations, the upcoming content item is the next content item played on channel F, even if it is not a movie.

[0327] In some implementations, when displaying the genre filtering page of the channel guide, such as in Figures 8E to 8GIn this embodiment, electronic device 500 displays a representation of the currently playing content item, which has the same width regardless of the duration of the content item. In some implementations, when the "All" tab 822a of the channel guide is displayed, electronic device 500 presents representations of the currently playing content item and upcoming content items from multiple genres, with the representations having widths corresponding to the durations of the content items associated with them.

[0328] Figure 8H An example of an electronic device 500 is shown, displaying an "All" tab 822a of a channel guide user interface (e.g., in response to selection of tab 822a). In some embodiments, the user interface includes indications 824i-L of channels available for playback on the electronic device 500. In some embodiments, the user interface also includes indications 826j-n of content items currently and in the future broadcast or live streaming on the channels. In some embodiments, indications 826j-n correspond to content items of multiple genres, rather than as... Figures 8E to 8G The user interfaces shown are all from the same genre. In some embodiments, the width of indicators 826j-n corresponds to the duration of a content item. For example, the width of indicator 826m corresponds to a content item at least one hour long (e.g., because in some embodiments, the width of indicator 826m is wider than the width of the area displaying the user interface for indicator 826j-n), and indicator 826L corresponds to a content item at least half an hour long (e.g., because in some embodiments, the width of indicator 826L is wider than the width of the area displaying the user interface for indicator 826j-n). In some embodiments, indicators 826j-k and 826m-n for the currently playing content item include thumbnails representing the content item corresponding to the indicator, and the indicator 826L for the upcoming content item does not include a thumbnail. In some embodiments, in response to detecting a selection of one of the indicators 826j-n, electronic device 500 initiates playback of the content item currently playing on the channel of the content item corresponding to the selected indicator 826j-n (e.g., and stops the display of the channel guide user interface).

[0329] In some implementations, representation 826j-n is horizontally scrollable to reveal additional representations of content items to be played after the currently displayed content item in the user interface. In some implementations, in response to a request to scroll representation 826j-n, electronic device 500 will indicate that the scrolling corresponds to a predetermined time period, regardless of the duration (e.g., 15 minutes, 20 minutes, 30 minutes, 1 hour, etc.) of the content item corresponding to representation 826j-n with the current focus 813h. For example, as Figure 8HAs shown, when the current focus 813h is directed to a representation 826m corresponding to a content item at least one hour long (e.g., the first 30-minute portion of the representation) (e.g., the width of representation 826m is the full width of the area where representations 826j-n are displayed), electronic device 500 detects a rightward swipe of contact 803h corresponding to a request to horizontally scroll representations 826j-n to the right via input device 510a. In some embodiments, in response to Figure 8H The input shown in the diagram indicates that the electronic device 500 will represent a predetermined amount of time corresponding to the 826j-n scrolling, such as... Figure 8I As shown.

[0330] Figure 8I It shows the response to Figure 8H The example shown is a channel guide user interface that scrolls after input is received. In some implementations, although the current focus 813h is guided to [the desired channel] when input is received. Figure 8H The representation is 826m, but the electronic device 500 will still scroll the representation 826j-q by a predetermined amount, even if that amount does not cause the electronic device 500 to display the next representation after 826m (e.g., because the duration of the content item corresponding to representation 826m causes the representation to extend beyond the predetermined amount by which representation 826j-q is scrolled). Figure 8I As shown, for example, in response to Figure 8H The input shown in the image and the scrolling representation of 826j-q reveal the information in... Figure 8H The invisible representations are 826p and 826q. Furthermore, in... Figure 8I In the middle, it indicates that the second 30-minute section, which immediately follows the first 30-minute section, is currently in focus.

[0331] In some implementation schemes, such as referring to Figures 8J to 8L As described, the electronic device 500 presents a user interface for changing channels, which includes channel indicators and previews of the content on the channels. Figure 8J For example, electronic device 500 displays a television program 802a. In some embodiments, when displaying television program 802a, the referenced above is not displayed. Figures 8A to 8B When the playback control element described in method 700 is activated, electronic device 500 detects a downward swipe of contact 803j via input device 510a. In some embodiments, in response to Figure 8J The input shown in the figure is presented by the electronic device 500. Figures 8K to 8L The channel shown changes the user interface.

[0332] Figure 8K The electronic device 500 is shown in response to Figure 8J The example shown illustrates how input changes the displayed channel in the user interface. Figure 8K As shown, in some embodiments, the channel-changing user interface includes an indication 830a-e of the channels accessible by the electronic device and an indication 832a-c of the content currently playing on the channel. In some embodiments, the channel indication 830a-e is as follows: Figure 8K The indicated channels are numerical indicators. In some embodiments, indicators 830a-e are textual indicators of channel names. In some embodiments, indicators 830a-e are images and / or icons corresponding to the channels. In some embodiments, when the user interface changes first, the representation 832b of the channel the user is currently viewing has the current focus 813k and includes the channel's (e.g., live) video content (e.g., with or without sound). In some embodiments, portions of representations 832a and 832c are portions of images corresponding to content on a channel adjacent to the channel currently being played by the electronic device 500. For example, the electronic device 500 is currently playing content 832b from channel 7 and displays portions of image 832a (e.g., static) corresponding to content on channel 6 and portions of image 832c (e.g., static) corresponding to content on channel 8. In some embodiments, the electronic device 500 scales down the currently presented content to fit into representation 832b, such that other representations 832a and 832c, as well as the channel indicators 830a-e, are displayed simultaneously with the content.

[0333] like Figure 8K As shown, electronic device 500 detects a downward swipe of contact 803k via input device 510a, corresponding to a request for a scrolling channel indication 830a-e and a representation 832a-c of the content on the channel. In some embodiments, in response to Figure 8K The input shown in the image updates the user interface of the electronic device 500. Figure 8L As shown. In some implementations, indicators 830a-e and 822a-c are indicated to roll at different speeds and / or at different distances in response to input (e.g., because they are different sizes).

[0334] Figure 8L The electronic device 500 is shown in response to Figure 8K The example shown illustrates how input updates the channel and changes the user interface. For instance, the channel indicators 830b-f and the representations of content on the channel 832b-d scroll, and the input focus 813L responds to... Figure 8LThe input shown is moved to representation 832c. In some embodiments, while displaying (e.g., statically) images 832b and 832d corresponding to channels 7 and 9, electronic device 500 plays content corresponding to channel 8 (e.g., with or without audio) within representation 832c, and updates the channel 8 indicator 830d to indicate that electronic device 500 is currently playing content from channel 8. In some embodiments, in response to detecting a selection of representation 832c (or a different representation 832), electronic device 500 stops the display of the channel-changing user interface and renders the content corresponding to representation 832c in full screen.

[0335] Figure 9 This is a flowchart illustrating a method for presenting a user interface for browsing and switching between content items available for playback, according to some embodiments. Method 900 is optionally performed on an electronic device (such as device 100, device 300, and device 500), as referenced above. Figures 1A to 1B , Figures 2 to 3 , Figures 4A to 4B and Figures 5A to 5C The operations in method 900 may be optionally combined, and / or the order of some operations may be optionally changed.

[0336] As described below, according to some embodiments, method 900 provides an electronic device that presents a user interface for browsing and switching between content items available for playback. This method reduces the cognitive burden on the user when interacting with the device user interface of this disclosure, thereby creating a more efficient human-computer interface. For battery-powered electronic devices, improving the efficiency of user interaction with the user interface saves power and increases the time between battery charging sessions.

[0337] In some implementations, such as in Figure 8AIn this embodiment, method 900 is performed at an electronic device (e.g., 500) that communicates with a display generating component (e.g., 504) and one or more input devices (e.g., 510b). In some embodiments, the electronic device is a mobile device (e.g., tablet, smartphone, media player, or wearable device), a computer (e.g., desktop computer, laptop computer), or a wearable device (e.g., watch, head-mounted device), optionally communicating with one or more of a mouse (e.g., external), a touchpad (optionally integrated or external), a remote control device (e.g., external), another mobile device (e.g., separate from the electronic device), a handheld device (e.g., external), and / or a controller (e.g., external, etc.), or a set-top box communicating with one or more input devices (e.g., remote control). In some embodiments, the display generating component is a display integrated with the electronic device (optionally a touchscreen display), an external display such as a monitor, projector, television, or a hardware component (optionally integrated or external) for projecting a user interface or making the user interface visible to one or more users.

[0338] In some implementations, such as in Figure 8A In this embodiment, an electronic device (e.g., 500) presents (902) content corresponding to the live media (e.g., 802a) via a display generating component (e.g., 504). In some embodiments, the live media includes content items presented at predetermined times, such as broadcast content items (e.g., wireless television, radio stations) and / or live streaming content items. In some embodiments, live media differs from on-demand media in that a user can initiate playback of on-demand media not limited to the scheduled broadcast or live streaming of the media, whereas playback of live media is limited to predetermined broadcast or live streaming times. In some embodiments, on-demand media may be rewound or fast-forwarded without restriction, but there are limitations on the distance a user can rewind or fast-forward the live media to the current playback position. For example, the live media may only be rewound for a threshold amount of time (e.g., 10, 30, 45 seconds, etc.; 1, 2, 3, 5, 10, 15 minutes, etc.).

[0339] In some implementations, such as in Figure 8AIn this embodiment, when presenting content (e.g., 802a), the electronic device (e.g., 500) simultaneously displays (e.g., 904) a playback control element (e.g., 808a) overlaying (e.g., 802a) (e.g., obscuring one or more portions of the content) on the content (906) via a display generation component (e.g., 504). In some embodiments, the playback control element is one or more of the following: a slider, fast forward, rewind, and / or selectable options for playing / pausing content items; audio options for presenting content items; and subtitle options for presenting content items. The playback control element optionally has one or more of the characteristics of a playback control element described with reference to method 700.

[0340] In some implementations, such as in Figure 8A In this implementation, when presenting content, an electronic device (e.g., 500) simultaneously displays (e.g., 904) multiple representations (e.g., 802a, 812c, 812d) of supplementary content corresponding to the live media (908) overlaid on (e.g., obscuring one or more portions of the content) via a display generation component (e.g., 504). In some embodiments, the representation of supplementary content corresponding to the live media is a representation of the live media currently being presented by another live media channel or source. For example, these representations include images corresponding to the live media, such as thumbnails of live video clips including still images corresponding to the live media and / or portions of live media currently being broadcast and / or streamed live. In some embodiments, the representation of supplementary content includes metadata such as a progress bar indicating the current playback position of the supplementary content, the name of the content, the channel or source presenting the content, the current score of a live sports game, etc. In some implementations, the progress bar indicates the current playback position of the broadcast content, regardless of whether the electronic device has already presented the content item (e.g., any part of the content item). In some implementations, in response to detecting the selection and / or focus of selectable options presented according to method 700, a representation of additional content corresponding to the live media is presented. In some implementations, multiple representations of the additional content are displayed below playback control elements overlaid on the content.

[0341] In some implementations, such as in Figure 8AIn this implementation, when simultaneously displaying a playback control element (e.g., 808a) overlaid on content (e.g., 802a) and multiple representations of supplementary content corresponding to the live media (e.g., 812a, 812c, 812d), the electronic device (e.g., 500) receives (910) input (e.g., via contact 803a) via one or more input devices (e.g., 510b). In some embodiments, the supplementary content corresponding to the live media is displayed in a first tab of the user interface overlaid on the content, and the input is an input corresponding to a request to present a second tab of the user interface overlaid on the content (e.g., an input to move the current focus from the first tab to the second tab). For example, the user interface includes a "Live" tab, which includes a representation of supplementary content corresponding to the live media; and a "Next" tab, which includes a representation of on-demand content items in the playback queue associated with the electronic device (e.g., a user account associated with the electronic device). In some embodiments, the representation of the supplementary content can be selected to stop the presentation of content and initiate the presentation of content corresponding to the selected representation.

[0342] In some implementations, in response to receiving input (912), the electronic device (e.g., 500) stops (914) the display of multiple representations (e.g., 812a, 812c, 812d) corresponding to additional content of the live media, such as in Figure 8A middle.

[0343] In some implementations, in response to receiving input (912), an electronic device (e.g., 500) displays (916) multiple representations of the on-demand content item overlaid on the content (e.g., 618e to 618h), such as in Figure 6G (While continuing playback of content corresponding to the live media). In some embodiments, the representation of the on-demand content item is displayed at the location where the representation of the live content channel was previously displayed (e.g., the location of the display of generating components, the location in the user interface including the playback of the live content, etc.). In some embodiments, the representation of the on-demand content item includes an image (e.g., a still image, video) corresponding to the on-demand content item. In some embodiments, the representation of the on-demand content item includes metadata, such as the name of the content item and a progress bar indicating the last position where the electronic device within the content stopped presenting the playback of the content (e.g., if the electronic device has already played a subset of the content item). In some embodiments, the representation can be selected to stop presenting the content without initiating the presentation of the corresponding content corresponding to the selected representation. In some embodiments, the representation of the on-demand content item is presented in response to detecting the selection and / or focus of the selectable options presented according to method 700. In some embodiments, multiple representations of the on-demand content item are displayed below a playback control element overlaid on the content.

[0344] The above-described method of presenting a representation of on-demand content in response to received input, and simultaneously presenting a representation of content corresponding to the live media overlaid on the live media, provides an efficient way to browse other available live and on-demand content while continuing to present content corresponding to the live media. This also reduces power consumption and extends the battery life of electronic devices by enabling users to use them more quickly and efficiently.

[0345] In some implementations, such as in Figure 8B In this implementation, supplementary content corresponding to the live media (e.g., 812a to 812d) is provided by multiple content sources (e.g., channels) selected by the user of the electronic device (e.g., 500). In some embodiments, the supplementary content corresponding to the live media is provided by the first multiple content sources based on the determination that the user has selected a first multiple content source. In some embodiments, the supplementary content corresponding to the live media is provided by the second multiple content sources based on the determination that the user has selected a second multiple content source. In some embodiments, the user selects multiple content sources by adding the selected content sources to a corresponding content source list (e.g., a saved content source list, a favorite content source list). In some embodiments, the supplementary content corresponding to the live media is multiple representations of live media content items, which, when selected, cause the electronic device to initiate playback of the live media content item corresponding to the selected representation.

[0346] The above-described method of presenting additional content from multiple content sources selected by the user of an electronic device provides an efficient way to access content from the content sources selected by the user when presenting content. This also reduces power consumption and extends the battery life of electronic devices by enabling users to use them more quickly and efficiently.

[0347] In some implementations, such as in Figure 8AIn this embodiment, before receiving an input (e.g., 803a) corresponding to the selection of a corresponding representation (e.g., 812b) of a corresponding content included in a plurality of representations (e.g., 812a to 812d) of supplementary content corresponding to live media, where the corresponding representation (e.g., 812b) of the corresponding content has a current focus (e.g., 813a), the electronic device (e.g., 500) simultaneously displays the corresponding content (e.g., 802a) via a display generation component (e.g., 504) without playing audio associated with the corresponding content (e.g., 802a), wherein a playback control element (e.g., 808a) and the plurality of representations of supplementary content (e.g., 812a to 812d) are overlaid on the corresponding content (e.g., 802a). In some embodiments, the electronic device initially displays the plurality of representations of supplementary content corresponding to live media overlaid on the corresponding content, wherein the current focus is directed to the corresponding representation of the corresponding content. In some implementations, before detecting input corresponding to the selection of the corresponding representation, the electronic device presents the image content of the corresponding content (e.g., one or more images or video content), but not the audio content of the corresponding content in the size and position to be displayed for the content corresponding to the live media, with playback control elements and representations of additional content overlaid on it.

[0348] In some implementations, such as in Figure 8A In this context, when displaying the corresponding content (e.g., 802a) without playing the audio associated with the corresponding content and when the corresponding representation (e.g., 812b) has current focus (e.g., 813a), the electronic device (e.g., 500) receives input via one or more input devices (e.g., 510b) corresponding to the selection of the corresponding representation (e.g., 812b) of the corresponding content (e.g., 802a).

[0349] In some embodiments, in response to receiving input corresponding to a selection of a corresponding representation of the corresponding content (e.g., 812b) (e.g., via contact 803a), the electronic device (e.g., 500) continues to display the corresponding content. In some embodiments, in response to receiving input corresponding to a selection of a corresponding representation of the corresponding content (e.g., 812b) (e.g., via contact 803a), the electronic device (e.g., 500) plays audio associated with the corresponding content (e.g., 802a). In some embodiments, the audio associated with the corresponding content is synchronized with the video content of the corresponding content. In some embodiments, the electronic device detects the selection of a second representation corresponding to the second content, rather than detecting the selection of the corresponding representation while the corresponding content is playing. In some embodiments, in response to detecting the selection of a second representation corresponding to the second content, the electronic device stops displaying the corresponding content, displays the second content at the size and position corresponding to the content of the live media and the representation of playback control elements and additional content displayed thereon, and plays the audio associated with the second content. In some implementations, the electronic device displays multiple representations of supplementary content corresponding to the live media overlaid on the second content, unless and until an input corresponding to a request to stop displaying the multiple representations of the supplementary content is detected or a predetermined time period (e.g., 1, 2, 3, 5, 10, 15 seconds, etc.) has elapsed in the absence of input.

[0350] The aforementioned approach, which initially plays the corresponding content without audio and initiates audio playback in response to the detection of a selection of a corresponding representation of the corresponding content, provides an efficient way for users to select alternative content to be played before presenting the audio associated with the corresponding content. This, in turn, reduces power consumption and extends the battery life of electronic devices by enabling users to use them more quickly and efficiently.

[0351] In some implementations, such as in Figure 8A In this context, multiple representations (e.g., 812a to 812d) corresponding to supplementary content of the live media include images corresponding to portions of the supplementary content currently available for live playback. In some embodiments, the images are video content that is a live preview of a current portion of the live media currently being broadcast or streamed. In some embodiments, the images are still images corresponding to specific portions of the live media (e.g., predetermined specific portions associated with each content time of the live media, portions broadcast when multiple representations are initially displayed, etc.).

[0352] The above-described method of including images corresponding to the corresponding portions of the supplementary content currently available for live playback in multiple representations of supplementary content provides an efficient way to indicate the content item corresponding to each representation. This, in turn, reduces power consumption and extends the battery life of electronic devices by enabling users to use them more quickly and efficiently.

[0353] In some implementations, such as in Figure 8A In this embodiment, displaying multiple representations of supplementary content (e.g., 812a to 812d) includes, based on determining that the corresponding representation of the corresponding content among the multiple representations of supplementary content has the current focus (e.g., 813a) of the electronic device (e.g., 500), displaying the corresponding representation (e.g., 812b) together with indications of metadata associated with the corresponding content (e.g., 816a, 816b). In some embodiments, the metadata indications include an indication of the content source (e.g., channel) providing the corresponding content and the name of the corresponding content. In some embodiments, if the corresponding content is a sports match, the metadata also includes indications of the current score of the sports match, the teams participating in the sports match, and / or the portion of the sports match currently available for replay (e.g., season, session, etc.). In some embodiments, the electronic device displays other representations corresponding to the live media, but does not display indications of metadata associated with the live media.

[0354] In some implementations, such as in Figure 8A In this embodiment, displaying multiple representations of additional content (e.g., 812a to 812d) includes: displaying the corresponding representation (e.g., 812a) based on the determination that the corresponding representation of the corresponding content (e.g., 812a) does not have the current focus of the electronic device (e.g., 500) (e.g., 813a), but not displaying an indication of the metadata associated with the corresponding content. In some embodiments, in response to an input corresponding to a request to move the current focus from the corresponding representation to a second representation, the electronic device stops displaying the indication of the metadata associated with the corresponding content and displays a second representation having an indication of the metadata associated with the content associated with the second representation.

[0355] The above-described method of displaying the corresponding representation of the corresponding content and an indication of the metadata associated with the corresponding content when the current focus is on the corresponding representation provides an efficient way to present metadata in a manner that does not obstruct other representations of additional content. This also reduces power consumption and extends the battery life of electronic devices by enabling users to use them more quickly and efficiently.

[0356] In some implementations, such as in Figure 8AIn this embodiment, multiple representations (e.g., 812a to 812d) corresponding to supplementary content of the live media include visual indications (e.g., 814a to 814d) of playback positions corresponding to portions of the supplementary content currently available for live playback. In some embodiments, the playback positions corresponding to the portions of the supplementary content currently available for live playback indicate portions of the live media that have been broadcast and / or streamed, as well as portions of the live media that will be broadcast and / or streamed in the future, regardless of whether the portions of the live media are consumed by an electronic device (e.g., a user account associated with the electronic device). In some embodiments, the visual indications of the playback positions corresponding to the portions of the supplementary content currently available for live playback are displayed as overlays on an image corresponding to the live media. In some embodiments, in response to detecting the selection of one of the representations of the supplementary content, the electronic device initiates playback of the corresponding supplementary content corresponding to the selected representation from the playback position indicated by the visual indication of the playback position included in the selected representation.

[0357] The aforementioned method of presenting visual indications of playback positions included in multiple representations of supplementary content provides an efficient way to indicate to the user which parts of the live media will be played in response to the detection of a selection of one of the representations. This also reduces power consumption and extends the battery life of electronic devices by enabling users to use them more quickly and efficiently.

[0358] In some implementations, such as in Figure 8A In this embodiment, while simultaneously displaying a playback control element (e.g., 808a) overlaid on content (e.g., 802a) and multiple representations of supplementary content corresponding to the live media (e.g., 812a to 812d), an electronic device (e.g., 500) receives a second input (e.g., via contact 803a) (or a sequence of one or more second inputs) via one or more input devices (e.g., 510b). In some embodiments, the second input corresponds to a request to move the current focus from an option associated with multiple representations of supplementary content corresponding to the live media to an option associated with information corresponding to the content. In some embodiments, the second input corresponds to a selection of an option associated with information corresponding to the content.

[0359] In some implementations, in response to receiving a second input (e.g., via contact 803a) (or a sequence of one or more second inputs), the electronic device (e.g., 500) stops displaying multiple representations corresponding to additional content on the live media, such as... Figure 6D As shown.

[0360] In some implementations, in response to receiving a second input (or a sequence of one or more second inputs), an electronic device (e.g., 500) displays information corresponding to the content (e.g., 602a) overlaid on the content (e.g., 602a), such as... Figure 6D In some implementations, information corresponding to the content is displayed in the user interface at multiple locations where additional content corresponding to the live media is displayed. In some implementations, the information includes one or more of the following: an image corresponding to the content item, a description of the content item, a score for the content item (e.g., if the content item is a sports match), an option to start playing the content item, and an option to view the user interface associated with the content item. The above-described manner of displaying information corresponding to the content provides an efficient way to present information while continuing to present the content, which in turn reduces power consumption and extends the battery life of electronic devices by enabling users to use them more quickly and efficiently.

[0361] In some implementations, such as in Figure 8B In this embodiment, while simultaneously displaying a playback control element (e.g., 808a) overlaid on content (e.g., 802a) and multiple representations of supplementary content corresponding to the live media (e.g., 812a to 812d), the electronic device (e.g., 500) receives a second input (e.g., via contact 803b) via one or more input devices (e.g., 510b) (e.g., a downward directional input received at an input device such as input device 510 or input device 511 (e.g., a swipe, selection of the down arrow key)). In some embodiments, displaying the second input (e.g., a downward directional input) will cause the electronic device to simultaneously present visual indications of the content guide user interface along with the playback control element and multiple representations of supplementary content overlaid on the content.

[0362] In some implementations, in response to receiving a second input, the electronic device (e.g., 500) stops simultaneously displaying playback control elements overlaid on the content and multiple representations of supplementary content corresponding to the live media, such as in Figure 8C In some implementations, the electronic device stops presenting content in response to receiving a second input. In other implementations, the electronic device continues to present content (e.g., a content guide user interface is displayed as an overlay on the content).

[0363] In some implementations, in response to receiving a second input, an electronic device (e.g., 500) displays a content guide user interface via a display generating component (e.g., 504). This content guide user interface includes an indication (e.g., 818a to 818e) of a corresponding content source (e.g., channel) associated with the corresponding content of the live media, and a representation (e.g., 820a to 820e) of the corresponding content, such as in… Figure 8C In some embodiments, in response to detecting the selection of a representation among the representations of the corresponding content, the electronic device initiates playback of the content source corresponding to the selected representation (e.g., content corresponding to the selected representation or a different content item from the same content source if content is currently playing). In some embodiments, in response to detecting the selection of an indication of a content source, the electronic device initiates playback of the content item from the content source corresponding to the selected indication. In some embodiments, in response to detecting the selection of a representation among the representations of the corresponding content or an indication of the corresponding content source, the electronic device stops displaying the content guide user interface.

[0364] The above-described method of responding to the second input to display the content guide user interface provides an efficient way to access the content guide from the user interface that includes the content. This also reduces power consumption and extends the battery life of electronic devices by enabling users to use them more quickly and efficiently.

[0365] In some implementations, such as in Figure 8J In this context, an electronic device (e.g., 500) receives a second input (e.g., via contact 803j) via one or more input devices (e.g., 510a) while displaying content (e.g., 802a) but not playback control elements and additional content corresponding to the live content (e.g., displaying content without other user interface elements or indications overlaying the content). In some embodiments, the second input is a down-oriented input, such as a downward swipe or selection of a down arrow button or key on an input device communicating with the electronic device.

[0366] In some embodiments, in response to receiving a second input, the electronic device (e.g., 500a) displays a user interface including multiple first representations (e.g., 830b, 830d) of a first content source (e.g., a channel) associated with live media, the multiple first representations being displayed in association with multiple representations (e.g., 832a, 832c) of corresponding supplementary content available from the currently available first content source for viewing. In some embodiments, the multiple first representations of the first content source are displayed in a corresponding order in a first row or column of the user interface, and the multiple representations of the corresponding supplementary content are displayed in a corresponding order in a second row or column of the user interface corresponding to the order of the first representations. For example, the electronic device displays a first column including...

Claims

1. A method comprising: At the electronic device that communicates with the display generation component and one or more input devices: When presenting content items of the corresponding content type, input is received via the one or more input devices; and In response to receiving the input, the following is displayed: Based on the determination that the corresponding content type is the first type: One or more first playback control elements corresponding to the first content type; and The first option corresponding to the first content corresponding to the first content type; and Based on the determination that the corresponding content type is a second content type different from the first content type: One or more second playback control elements that correspond to the second content type and are different from the one or more first playback control elements; and A second option that corresponds to a second content that is different from the first content and is of a second content type.

2. The method according to claim 1, wherein Based on the determination that the corresponding content type is a first type, the first content corresponding to the first content type includes a second content item in the playback queue associated with the user of the electronic device.

3. The method according to claim 1, further comprising: In response to receiving the input, a third option corresponding to the information about the content item is displayed.

4. The method according to claim 3, further comprising: When displaying a third option corresponding to information about the content item, input directed to the third option is received via the one or more input devices; and In response to receiving input that directs to a third option, a fourth and a fifth option are displayed simultaneously with the one or more first playback control elements or the one or more second playback control elements. The fourth option can be selected to play the content item from the beginning of the content item, and the fifth option can be selected to display a user interface associated with the content item, the user interface including additional information associated with the content item.

5. The method according to claim 1, wherein The content item is the first episode in the series of episode content, and based on the determination that the corresponding content type is the first content type, the first content corresponding to the first content type includes a second content item as an episode in the series of episode content, and the second content item includes a second episode in the series of episode content that is different from the first episode.

6. The method according to claim 5, wherein the corresponding content item is a first content item, the method further comprising: When the first option is displayed, input directed to the first option is received via the one or more input devices; and In response to receiving input directed to the first option, the following is displayed simultaneously with the one or more first playback control elements: As a representation of the second content item in a series of episodes, wherein a first representation of the first corresponding second content item is displayed without any indication of information associated with the first corresponding second content item, and the current focus of the electronic device is not directed to the first representation of the first corresponding second content item, and a second representation of the second corresponding second content item is displayed with an indication of information associated with the second corresponding second content item, and the current focus of the electronic device is directed to the second representation of the second corresponding second content item.

7. The method according to claim 1, wherein the corresponding content type is live content, the method further comprising: When the content item is presented: Receive input via the one or more input devices corresponding to a request to rewind the content item by a corresponding amount; and In response to receiving input corresponding to a request to rewind the content: If the corresponding amount is determined to be less than the threshold, the content will be rewound by the corresponding amount; and If the corresponding amount is determined to be greater than the threshold, then the content is not fast-forwarded by the corresponding amount.

8. The method of claim 1, wherein the first content type is live content, and the one or more first playback control elements comprise: The slider includes a first area, a second area, and a third area. The first area corresponds to an earlier playback position in the content item that cannot be rewound, the second area corresponds to an earlier playback position in the content item that can be rewound, and the third area corresponds to a future playback position of the content item.

9. The method according to claim 1, further comprising: In response to the input, the following is displayed: Based on the determination that the corresponding content type is live content, and based on the determination that skipping the replay position within the content item is unavailable: The display includes a slider that includes a first region corresponding to the playback position of the content item before its current playback position, and a second region corresponding to the playback position of the content item after its current playback position. The first and second areas of the slider are displayed using the same visual style.

10. The method according to claim 1, wherein: When displaying the corresponding playback control element corresponding to the corresponding content item: Based on the determination that a friend of the user of the electronic device has consumed a portion of the content item, the corresponding playback control element includes a first visual indication of the current playback position of the content item associated with the portion of the content item consumed by the friend, the first visual indication including a graphical representation of the friend.

11. The method of claim 10, further comprising: When displaying the corresponding playback control element which includes a first visual indication of the graphical representation of the friend, including the current playback position of the content item associated with the friend, a sequence of one or more inputs directed to the corresponding playback control element is received via the one or more input devices, the sequence of one or more inputs including inputs directed to the first visual indication of the current playback position of the content item associated with the portion of the content item consumed by the friend; and In response to receiving a sequence of one or more inputs: Stop displaying a first visual indication of the current playback position of the content item associated with the portion of the content item consumed by the friend, the first visual indication including a graphical representation of the friend; and A second visual indication of the current playback position of the content item associated with the portion of the content item consumed by the friend is displayed in association with the corresponding playback control element, without including a graphical representation of the friend.

12. The method of claim 10, further comprising: When displaying the corresponding playback control element, which includes a first visual indication of the current playback position of the content item associated with the portion of the content item consumed by the friend, input directed to the first visual indication of the current playback position of the content item associated with the portion of the content item consumed by the friend is received via the one or more input devices; and In response to receiving input that is directed to the first visual instruction: A visual indication of the friend's name is displayed in association with the corresponding playback control element.

13. The method according to claim 1, further comprising: When the content item is presented without displaying one or more corresponding control elements corresponding to the corresponding content type: Receive input via the one or more input devices corresponding to a request to update the current playback position in the content item by a predetermined amount; and In response to receiving an input corresponding to a request to update the current playback position in the content item by a predetermined amount: Update the current playback position in the content item by a predetermined amount; and The corresponding control element corresponding to the corresponding content type is displayed, but the corresponding option corresponding to the corresponding content is not displayed.

14. The method according to claim 1, further comprising: When one or more playback control elements corresponding to the aforementioned content type are displayed: Receive input via the one or more input devices that is directed to a first playback control element corresponding to the corresponding content type; In response to receiving input directed to the first playback control element corresponding to the respective content type: Based on the input, a thumbnail corresponding to the corresponding part of the content item is displayed near the first playback control element; and After a predetermined time has elapsed since the thumbnail display was initiated: the thumbnail display stops if it is determined that the thumbnail is displayed over a second playback control element in one or more playback control elements corresponding to the corresponding content type; and Based on the determination that the thumbnail is not displayed as an overlay on the second playback control element, the thumbnail remains displayed.

15. The method according to claim 1, further comprising: In response to receiving the input, one or more corresponding playback control elements corresponding to the corresponding content type are displayed, wherein: The one or more corresponding playback control elements include a slider, and In response to receiving the input, the current focus of the electronic device is initially directed to the slider.

16. The method according to claim 1, further comprising: In response to receiving the input, one or more options corresponding to the corresponding content of the corresponding content type are displayed, wherein: Based on the determination that one or more options are an option, the option is displayed as having a first visual characteristic; and Based on the determination that the one or more options are multiple options, the multiple options are displayed with a second visual characteristic that is different from the first visual characteristic.

17. The method according to claim 1, further comprising: When displaying one or more corresponding playback control elements corresponding to the aforementioned content type: Receive input via the one or more input devices corresponding to a request to perform an action regarding the content item; and In response to receiving input corresponding to a request to perform an action regarding the content item: Based on the determination that the action is unavailable: Abandoning the aforementioned action; and Simultaneously display a message indicating that the action is unavailable along with one or more corresponding playback control elements corresponding to the corresponding content type.

18. The method according to claim 1, further comprising: In response to receiving the input, one or more options corresponding to the corresponding content of the corresponding content type are displayed, wherein: Based on the determination that the source of the content item is a first source, the one or more corresponding options are one or more first corresponding options; and Based on the determination that the source of the content item is a second source, the one or more corresponding options are one or more second corresponding options.

19. The method of claim 18, wherein Based on the determination that the corresponding content type is a first content type, the one or more corresponding options include information options associated with information about the content item, episode options associated with episodes of the same series of episodes associated with the content item, and playback queue options associated with multiple third content items in the playback queue of the user of the electronic device.

20. The method of claim 18, wherein: Based on the determination that the corresponding content type is a second content type, the one or more corresponding options include information options associated with information about the content item, episode options associated with the chapter of the content item, and next queue options associated with multiple third content items in the replay queue.

21. The method according to claim 18, wherein: The one or more corresponding options associated with the corresponding content are displayed in a first area of ​​the user interface including the content item, and One or more corresponding options that are not associated with the corresponding content are not displayed in the first area of ​​the user interface.

22. An electronic device, comprising: One or more processors; Memory; and One or more programs, wherein the one or more programs are stored in the memory and configured to be executed by the one or more processors, the one or more programs including instructions for performing the method according to any one of claims 1-21.

23. A non-transitory computer-readable storage medium storing one or more programs, said one or more programs comprising instructions that, when executed by one or more processors of an electronic device, cause the electronic device to perform the method according to any one of claims 1-21.

24. A method comprising: At the electronic device that communicates with the display generation component and one or more input devices: Content corresponding to the live media is presented via the one or more display generation components; When presenting the content, the following items, which are overlaid on the content, are simultaneously displayed via the one or more display generation components: The playback control element of the content; and Multiple representations corresponding to additional content in live media; Input is received via the one or more input devices while simultaneously displaying the playback control element overlaid on the content and the plurality of representations corresponding to the additional content of the live media; as well as In response to receiving the input: Stop displaying the plurality of representations corresponding to additional content in the live media; as well as Displays multiple representations of on-demand content items overlaid on the content.

Images