User interface for browsing content from multiple content applications on electronic device

Abstract

The invention relates to a user interface for browsing content from multiple content applications on an electronic device. In some implementations, an electronic device presents media items from different media applications in a unified media browsing application. In some embodiments, an electronic device facilitates browsing media from different media applications based on media categories (e.g., movies, television programs, etc. In some embodiments, an electronic device facilitates setting a unified media browsing application that presents media items from different media applications in a unified media browsing user interface. In some embodiments, an electronic device displays a plurality of episodes in a collection of episode content (e.g., a television series) in a user interface for the collection of episode content. In some embodiments, an electronic device displays a representation of a live event media item accessible on the electronic device and provides access to the live event media item.

Description

[0001] This application is a divisional application of patent application No. 201780066823.6 entitled "User Interface for Browsing Content from Multiple Content Applications on an Electronic Device", which was filed on October 24, 2017, with international application number PCT / 2017 / 058132 and entered the Chinese national phase on April 26, 2019.

[0002] Cross-references to related applications

[0003] This application claims priority to U.S. Provisional Application Serial No. 62 / 413,333, filed October 26, 2016; U.S. Provisional Application Serial No. 62 / 423,150, filed November 16, 2016; U.S. Provisional Application Serial No. 62 / 556,912, filed September 11, 2017; and U.S. Patent Application Serial No. 15 / 719,404, filed September 28, 2017; all of which are incorporated herein by reference in their entirety. Technical Field

[0004] This invention relates in general to electronic devices that allow browsing and playing content, and to user interaction with such devices. Background Technology

[0005] In recent years, user interaction with electronic devices has increased significantly. These devices can include computers, tablets, televisions, multimedia devices, mobile devices, and so on.

[0006] In some cases, such devices access content or media (e.g., music, movies, TV shows, etc.) through content applications installed on the device and associated with the content provider, and user interaction with such devices requires the use of the content application to browse and play the content. Enhancing these interactions can improve the user experience and reduce user interaction time, which is especially important when the input device is battery powered. Summary of the Invention

[0007] Some embodiments described in this disclosure relate to one or more electronic devices that present media items from different media applications within a unified media browsing application, and one or more operations related to the foregoing optionally performed by these electronic devices. Some embodiments described in this disclosure relate to one or more electronic devices that facilitate browsing of media from different media applications based on media categories (e.g., movies, television programs, etc.), and one or more operations related to the foregoing optionally performed by these electronic devices. Some embodiments described in this disclosure relate to one or more electronic devices that facilitate the settings of a unified media browsing application for presenting media items from different media applications in a unified media browsing user interface, and one or more operations related to the foregoing optionally performed by these electronic devices. Some embodiments described in this disclosure relate to one or more electronic devices that display multiple episodes of each episode set in a user interface for each episode set (e.g., a television series), and one or more operations related to the foregoing optionally performed by these electronic devices. Some embodiments described in this disclosure relate to one or more electronic devices that display a representation of live event media items accessible on one or more electronic devices and provide access to these live event media items, and one or more operations related to the foregoing optionally performed by these electronic devices. The accompanying drawings and detailed descriptions provide a full description of the embodiments. It should be understood that the above-described invention does not limit the scope of this disclosure in any way. Attached Figure Description

[0008] To better understand the various embodiments described, reference should be made to the following detailed description in conjunction with the accompanying drawings, in which similar reference numerals indicate corresponding parts throughout the drawings.

[0009] Figure 1A This is a block diagram illustrating a multifunctional device with a touch-sensitive display according to some embodiments of the present disclosure.

[0010] Figure 1B This is a block diagram illustrating exemplary components for event handling according to some embodiments of the present disclosure.

[0011] Figure 2 A multifunctional device with a touch screen is shown according to some embodiments of the present disclosure.

[0012] Figure 3 This is a block diagram of an exemplary multifunctional device having a display and a touch-sensitive surface according to some embodiments of this disclosure.

[0013] Figure 4 An exemplary user interface for a multifunctional device having a touch-sensitive surface separate from the display is shown according to some embodiments of the present disclosure.

[0014] Figures 5A to 5B A block diagram of an exemplary architecture for a device according to some embodiments of the present disclosure is shown.

[0015] Figures 6A to 6LL Exemplary ways in which an electronic device according to some embodiments of the present disclosure presents suggested media items (e.g., movies, TV shows, etc.) to a user in a unified media browsing application are shown.

[0016] Figures 7A to 7L This is a flowchart illustrating a method for presenting suggested media items (e.g., movies, TV shows, etc.) to a user in a unified media browsing application according to some embodiments of the present disclosure.

[0017] Figures 8A to 8GG Exemplary ways in which electronic devices according to some embodiments of the present disclosure facilitate browsing media items by category are shown.

[0018] Figures 9A to 9I This is a flowchart illustrating a method for facilitating browsing of media items by category according to some embodiments of this disclosure.

[0019] Figures 10A to 10Z Exemplary ways in which electronic devices, according to some embodiments of the present disclosure, facilitate the setup of a unified media browsing application are shown.

[0020] Figures 11A to 11F This is a flowchart illustrating a method for facilitating the setup of a unified media browsing application according to some embodiments of this disclosure.

[0021] Figures 12A to 12V Exemplary ways in which an electronic device, according to some embodiments of the present disclosure, displays a representation of an episode in a collection of episode content are shown.

[0022] Figures 13A to 13E This is a flowchart illustrating a method for displaying a representation of a series in each episode content set according to some embodiments of this disclosure.

[0023] Figures 14 to 17 This is a functional block diagram of an electronic device according to some embodiments of the present disclosure.

[0024] Figures 18A to 18J Exemplary methods are shown for displaying on-site event media items accessible on the electronic device and providing access to these on-site event media items in an electronic device according to some embodiments of the present disclosure.

[0025] Figures 19A to 19K This is a flowchart illustrating, according to some embodiments of the present disclosure, the representation of live event media items accessible on an electronic device and methods for providing access to such live event media items. Detailed Implementation

[0026] The accompanying drawings, which form part of the following description of the embodiments and illustrate specific embodiments of alternative implementations by way of example, will be referenced in the description of the embodiments below. It should be understood that other embodiments and structural changes may be optionally used without departing from the scope of the disclosed embodiments. Furthermore, although the terms “first,” “second,” etc., are used in the following description to describe various elements, these elements should not be limited by the terms. These terms are only used to distinguish one element from another. For example, a first touch may be named a second touch and similarly, a second touch may be named a first touch, without departing from the scope of the various described embodiments. Both the first touch and the second touch are touches, but they are not the same touch.

[0027] The terminology used in the description of the various embodiments herein is for the purpose of describing particular embodiments only and is not intended to be limiting. As used in the description of the various embodiments and the appended claims, the singular forms “a” (“a”, “an”) and “the” are intended to include the plural forms as well, unless the context clearly indicates otherwise. It will also be understood that the term “and / or” as used herein refers to and covers any and all possible combinations of one or more of the items listed in connection with the description. It will also be understood that the terms “comprising” and / or “including” as used in this specification specify the presence of the stated features, integers, steps, operations, elements, and / or components, but do not exclude the presence or addition of one or more other features, integers, steps, operations, elements, components, and / or groups thereof.

[0028] Depending on the context, the term "if" may optionally be interpreted as meaning "when," "in," or "in response to determination" or "in response to detection." Similarly, depending on the context, the phrases "if determination..." or "if detection [the stated condition or event]" may optionally be interpreted as meaning "in response to determination..." or "in response to detection [the stated condition or event]."

[0029] Exemplary device

[0030] This document describes implementations of electronic devices, user interfaces for such devices, and related processes for using such devices. In some implementations, the device is a portable communication device, such as a mobile phone, that also includes other functions such as PDA and / or music player functionality. Exemplary implementations of portable multi-functional devices include, but are not limited to, those from Apple Inc. (Cupertino, California). Devices, iPod Equipment, and Device. Optionally, other portable electronic devices may be used, such as laptops or tablets with touch-sensitive surfaces (e.g., touchscreen displays and / or touchpads). It should also be understood that in some embodiments, the device is not a portable communication device, but rather a desktop computer or television with touch-sensitive surfaces (e.g., touchscreen displays and / or touchpads). In some embodiments, the device does not have a touchscreen display and / or touchpad, but is capable of outputting display information (such as the user interface of this disclosure) for display on a separate display device, and is capable of receiving input information from a separate input device having one or more input mechanisms (such as one or more buttons, touchscreen displays, and / or touchpads). In some embodiments, the device has a display, but is capable of receiving input information from a separate input device having one or more input mechanisms (such as one or more buttons, touchscreen displays, and / or touchpads).

[0031] In the following discussion, an electronic device including a display and a touch-sensitive surface is described. However, it should be understood that the electronic device optionally includes one or more other physical user interface devices, such as a physical keyboard, mouse, and / or joystick. Additionally, as mentioned above, it should be understood that the described electronic device, display, and touch-sensitive surface are optionally distributed across two or more devices. Therefore, as used in this disclosure, information on or displayed by the electronic device is optionally used to describe information output by the electronic device for display on a separate display device (touch-sensitive or non-touch-sensitive). Similarly, as used in this disclosure, input received on the electronic device (e.g., touch input received on a touch-sensitive surface of the electronic device) is optionally used to describe input received on a separate input device from which the electronic device receives input information.

[0032] The device typically supports a variety of applications, such as one or more of the following: drawing applications, rendering applications, word processing applications, website creation applications, disk editing applications, spreadsheet applications, game applications, phone applications, video conferencing applications, email applications, instant messaging applications, fitness support applications, photo management applications, digital camera applications, digital video camera applications, web browsing applications, digital music player applications, TV channel browsing applications, and / or digital video player applications.

[0033] Various applications running on the device optionally use at least one common physical user interface device, such as a touch-sensitive surface. One or more functions of the touch-sensitive surface and the corresponding information displayed on the device are optionally adjusted and / or varied for different applications, and / or adjusted and / or varied within the respective applications. In this way, the device's common physical architecture (such as the touch-sensitive surface) optionally utilizes a user interface that is intuitive and clear to the user to support various applications.

[0034] Now let’s turn our attention to implementations of portable or non-portable devices with touch-sensitive displays, but the device does not necessarily include a touch-sensitive display or a general display, as described above. Figure 1A This is a block diagram illustrating a portable or non-portable multi-functional device 100 with a touch-sensitive display 112 according to some embodiments. The touch-sensitive display 112 is sometimes referred to as a “touchscreen” for convenience, and is sometimes referred to as a touch-sensitive display system. Device 100 includes a memory 102 (which optionally includes one or more computer-readable storage media), a memory controller 122, one or more processing units (CPUs) 120, a peripheral interface 118, RF circuitry 108, audio circuitry 110, a speaker 111, a microphone 113, an input / output (I / O) subsystem 106, other input or control devices 116, and an external port 124. Device 100 optionally includes one or more optical sensors 164. Device 100 optionally includes one or more contact strength sensors 165 for detecting the intensity of contact on device 100 (e.g., a touch-sensitive surface, such as the touch-sensitive display system 112 of device 100). Device 100 optionally includes one or more haptic output generators 167 for generating haptic output on device 100 (e.g., generating haptic output on a touch-sensitive surface such as the touch-sensitive display system 112 of device 100 or the touchpad 355 of device 300). These components optionally communicate via one or more communication buses or signal lines 103.

[0035] As used in this specification and claims, the term "intensity" for contact on a tactile surface refers to the force or pressure (force per unit area) of a contact (e.g., finger contact) on a tactile surface, or to a substitute for the force or pressure of a contact on a tactile surface. The intensity of contact has a range of values ​​that includes at least four different values ​​and more typically hundreds of different values ​​(e.g., at least 256). The intensity of contact is optionally determined (or measured) using various methods and various sensors or combinations of sensors. For example, one or more force sensors below or adjacent to the tactile surface are optionally used to measure the force at different points on the tactile surface. In some embodiments, force measurements from multiple force sensors are combined (e.g., weighted average) to determine the estimated contact force. Similarly, the pressure-sensitive tip of a stylus is optionally used to determine the pressure of the stylus on the tactile surface. Alternatively, the size and / or variation of the contact area detected on the touch-sensitive surface, the capacitance and / or variation of the touch-sensitive surface near the contact, and / or the resistance and / or variation of the touch-sensitive surface near the contact may optionally be used as substitutes for the force or pressure of the contact on the touch-sensitive surface. In some embodiments, the substitute measurement of the contact force or pressure is used directly to determine whether an intensity threshold (e.g., the intensity threshold is described in units corresponding to the substitute measurement) has been exceeded. In some embodiments, the substitute measurement of the contact force or pressure is converted into an estimated force or pressure, and the estimated force or pressure is used to determine whether an intensity threshold (e.g., the intensity threshold is a pressure threshold measured in pressure units) has been exceeded. Using the intensity of the contact as an attribute of user input allows the user to access additional device functions that would otherwise be inaccessible to the user on a smaller device with limited physical space, which is used (e.g., on a touch-sensitive display) to display an indication and / or receive user input (e.g., via a touch-sensitive display, touch-sensitive surface, or physical / mechanical controls such as knobs or buttons).

[0036] As used in this specification and claims, the term "haptic output" refers to a physical displacement of the device relative to a previous position of the device, a physical displacement of a component of the device (e.g., a touch-sensitive surface) relative to another component of the device (e.g., the housing), or a displacement of a component relative to the center of mass of the device, which is detected by the user using the user's tactile sense. For example, when the device or a component of the device comes into contact with a touch-sensitive surface (e.g., a finger, palm, or other part of the user's hand), the haptic output generated by the physical displacement will be interpreted by the user as a tactile sensation corresponding to a perceived change in the physical characteristics of the device or a component of the device. For example, movement of a touch-sensitive surface (e.g., a touch-sensitive display or touchpad) may optionally be interpreted by the user as a "press-click" or "release-click" on a physically actuated button. In some cases, the user will feel a tactile sensation, such as a "press-click" or "release-click," even when a physically actuated button associated with a touch-sensitive surface that has been physically pressed (e.g., displaced) by the user's movement does not move. As another example, even when the smoothness of the tactile surface remains unchanged, movement of the tactile surface can optionally be interpreted or sensed by the user as the “roughness” of the tactile surface. While such interpretations of touch by users will be limited by their individualized sensory perceptions, many sensory perceptions of touch are common to most users. Therefore, when a tactile output is described as corresponding to a user’s specific sensory perception (e.g., “release click,” “press click,” “roughness”), unless otherwise stated, the generated tactile output corresponds to the physical displacement of the device or its components, which will generate the sensory perception described by a typical (or average) user.

[0037] It should be understood that device 100 is merely an example of a portable or non-portable multifunctional device, and device 100 may optionally have more or fewer components than shown, may optionally combine two or more components, or may optionally have different configurations or arrangements of these components. Figure 1A The various components shown are implemented in hardware, software, or a combination of both, including one or more signal processing and / or application-specific integrated circuits (ASICs). Furthermore, Figure 1A The various components shown are optionally implemented on two or more devices; for example, a display and audio circuitry on a display device, a touch-sensitive surface on an input device, and other components on device 100. In such embodiments, device 100 optionally communicates with the display device and / or input device to facilitate system operation as described herein, and the various components relating to display and / or input described herein are retained in device 100 or optionally included in the display and / or input device where appropriate.

[0038] Memory 102 optionally includes high-speed random access memory and also optionally includes non-volatile memory, such as one or more disk storage devices, flash memory devices, or other non-volatile solid-state memory devices. Memory controller 122 optionally controls other components of device 100 to access memory 102.

[0039] Peripheral interface 118 can be used to couple the device's input peripherals and output peripherals to CPU 120 and memory 102. One or more processors 120 run or execute various software programs and / or instruction sets stored in memory 102 to perform various functions of device 100 and process data.

[0040] In some implementations, the peripheral interface 118, CPU 120, and memory controller 122 are optionally implemented on a single chip, such as chip 104. In other implementations, they are optionally implemented on separate chips.

[0041] RF (Radio Frequency) circuit 108 receives and transmits RF signals, also known as electromagnetic signals. RF circuit 108 converts electrical signals into electromagnetic signals and vice versa, and communicates with communication networks and other communication devices via these electromagnetic signals. RF circuit 108 optionally includes well-known circuitry for performing these functions, including but not limited to antenna systems, RF transceivers, one or more amplifiers, tuners, one or more oscillators, digital signal processors, codec chipsets, Subscriber Identity Module (SIM) cards, memory, etc. RF circuit 108 optionally communicates wirelessly with networks and other devices, such as the Internet (also known as the World Wide Web (WWW)), intranets, and / or wireless networks (such as cellular telephone networks, wireless local area networks (LANs), and / or metropolitan area networks (MANs)). RF circuit 108 optionally includes well-known circuitry for detecting near-field communication (NFC) fields, such as through near-field communication radio components. Wireless communication may optionally employ any of a variety of communication standards, protocols, and technologies, including but not limited to Global System for Mobile Communications (GSM), Enhanced Data GSM Environment (EDGE), High-Speed ​​Downlink Packet Access (HSDPA), High-Speed ​​Uplink Packet Access (HSUPA), Evolution, Pure Data (EV-DO), HSPA, HSPA+, Dual-Unit HSPA (DC-HSPDA), Long Term Evolution (LTE), Near Field Communication (NFC), Wideband Code Division Multiple Access (W-CDMA), Code Division Multiple Access (CDMA), Time Division Multiple Access (TDMA), Bluetooth, Bluetooth Low Energy (BTLE), and Wi-Fi (e.g., IEEE 802.11a, IEEE 802.11b, IEEE 802.11g, IEEE...). 802.11n and / or IEEE 802.11ac), Voice over Internet Protocol (VoIP), Wi-MAX, email protocols (e.g., Internet Messaging Access Protocol (IMAP) and / or Post Office Protocol (POP)), instant messaging (e.g., Extensible Messaging and Presence Protocol (XMPP), Session Initiation Protocol for Instant Messaging and Presence with Extended Utility (SIMPLE), Instant Messaging and Presence Service (IMPS)), and / or Short Message Service (SMS), or any other suitable communication protocol that has not been developed as of the date of this document submission.

[0042] Audio circuitry 110, speaker 111, and microphone 113 provide an audio interface between the user and device 100. Audio circuitry 110 receives audio data from peripheral interface 118, converts the audio data into electrical signals, and transmits the electrical signals to speaker 111. Speaker 111 converts the electrical signals into sound waves that are audible to humans. Audio circuitry 110 also receives electrical signals converted from sound waves by microphone 113. Audio circuitry 110 converts the electrical signals into audio data and transmits the audio data to peripheral interface 118 for processing. Audio data is optionally retrieved by peripheral interface 118 from and / or transmitted to memory 102 and / or RF circuitry 108. In some embodiments, audio circuitry 110 also includes a headset jack (e.g., ...). Figure 2 (212 in the text). The headset jack provides an interface between the audio circuitry 110 and a removable audio input / output peripheral device, such as an output-only headphone or a headset with both output (e.g., a single-ear or dual-ear headphone) and input (e.g., a microphone).

[0043] I / O subsystem 106 couples input / output peripherals on device 100, such as touchscreen 112 and other input control devices 116, to peripheral interface 118. I / O subsystem 106 optionally includes display controller 156, optical sensor controller 158, intensity sensor controller 159, haptic feedback controller 161, and one or more input controllers 160 for other input or control devices. The one or more input controllers 160 receive electrical signals from / send electrical signals to the other input or control devices 116. Other input control devices 116 optionally include physical buttons (e.g., push-buttons, rocker buttons, etc.), dial pads, slide switches, joysticks, click dials, etc. In some alternative embodiments, one or more input controllers 160 are optionally coupled to (or not coupled to) any of the following: keyboard, infrared port, USB port, and pointing devices such as a mouse. One or more buttons (e.g., ... Figure 2 Optionally, 208) includes an increase / decrease button for volume control of speaker 111 and / or microphone 113. One or more buttons optionally include a push-button (e.g., Figure 2 (206 in the middle).

[0044] A quick press of the push button optionally unlocks the touchscreen 112 or optionally initiates a process of unlocking the device using gestures on the touchscreen, as described in U.S. Patent Application 11 / 322,549 (U.S. Patent No. 7,657,849), filed December 23, 2005, entitled "Unlocking a Device by Performing Gestures on an Unlock Image," the entire contents of which are incorporated herein by reference. A long press of the push button (e.g., 206) optionally powers the device 100 on or off. The function of one or more buttons is optionally user-customizable. The touchscreen 112 is used to implement virtual buttons or soft buttons and one or more soft keyboards.

[0045] The touch-sensitive display 112 provides input and output interfaces between the device and the user. As described above, the touch operation and display operation of the touch-sensitive display 112 are optionally separated from each other, such that the display device is used for display purposes, while the touch-sensitive surface (whether or not a display) is used for input detection purposes, and the described components and functions are modified accordingly. However, for the sake of brevity, the following description refers to the touch-sensitive display. The display controller 156 receives electrical signals from the touchscreen 112 and / or sends electrical signals to the touchscreen 112. The touchscreen 112 displays visual output to the user. The visual output optionally includes graphics, text, icons, video, and any combination thereof (collectively, "graphics"). In some embodiments, some or all of the visual output corresponds to user interface objects.

[0046] Touchscreen 112 has a touch-sensitive surface, sensor, or sensor array that accepts input from a user based on tactile and / or haptic contact. Touchscreen 112 and display controller 156 (along with any associated modules and / or instruction set in memory 102) detect contact on touchscreen 112 (and any movement or interruption of that contact) and translate the detected contact into interaction with user interface objects (e.g., one or more soft keys, icons, web pages, or images) displayed on touchscreen 112. In an exemplary embodiment, the contact point between touchscreen 112 and the user corresponds to the user's finger.

[0047] Touchscreen 112 optionally employs LCD (Liquid Crystal Display) technology, LPD (Light Emitting Polymer Display) technology, or LED (Light Emitting Diode) technology, but other display technologies are used in other embodiments. Touchscreen 112 and display controller 156 optionally employ any of a variety of touch sensing technologies now known or to be developed hereafter, along with other proximity sensor arrays or other elements for determining one or more points of contact with touchscreen 112, to detect contact and any movement or interruption therein. These various touch sensing technologies include, but are not limited to, capacitive, resistive, infrared, and surface acoustic wave technologies. In one exemplary embodiment, projected mutual capacitance sensing technology, such as that from Apple Inc. (Cupertino, California), is used. iPod The technology that was discovered.

[0048] In some embodiments of the touchscreen 112, the touch-sensitive display optionally resembles a multi-touch-sensitive touchpad described in the following U.S. patents: 6,323,846 (Westerman et al.), 6,570,557 (Westerman et al.), and / or 6,677,932 (Westerman et al.) and / or U.S. Patent Publication 2002 / 0015024A1, each of which is incorporated herein by reference in its entirety. However, the touchscreen 112 displays visual output from the device 100, while the touch-sensitive touchpad does not provide visual output.

[0049] In some embodiments, the touchscreen 112 has a touch-sensitive display as described in the following patent applications: (1) U.S. Patent Application No. 11 / 381,313, filed May 2, 2006, entitled “Multipoint Touch Surface Controller”; (2) U.S. Patent Application No. 10 / 840,862, filed May 6, 2004, entitled “Multipoint Touchscreen”; (3) U.S. Patent Application No. 10 / 903,964, filed July 30, 2004, entitled “Gestures For Touch Sensitive Input Devices”; (4) U.S. Patent Application No. 11 / 048,264, filed January 31, 2005, entitled “Gestures For Touch Sensitive Input Devices”; and (5) U.S. Patent Application No. 18, 2005, entitled “Mode-Based Graphical User Interfaces For Touch Sensitive”. U.S. Patent Application No. 11 / 038,590 entitled “Input Devices”; (6) U.S. Patent Application No. 11 / 228,758 entitled “Virtual Input Device Placement On A Touch Screen User Interface”, filed September 16, 2005; (7) U.S. Patent Application No. 11 / 228,700 entitled “Operation Of A Computer With A Touch Screen Interface”, filed September 16, 2005; (8) U.S. Patent Application No. 11 / 228,737 entitled “Activating Virtual Keys Of A Touch-Screen Virtual Keyboard”, filed September 16, 2005; and (9) U.S. Patent Application No. 11 / 367,749 entitled “Multi-Functional Hand-Held Device”, filed March 3, 2006. The entire contents of all these applications are incorporated herein by reference.

[0050] Touchscreen 112 optionally has a video resolution exceeding 100 dpi. In some embodiments, the touchscreen has a video resolution of approximately 160 dpi. Users optionally interact with touchscreen 112 using any suitable object or accessory such as a stylus, finger, etc. In some embodiments, the user interface is designed to operate primarily through finger-based touch and gestures, which may be less precise than stylus-based input due to the larger contact area of ​​a finger on the touchscreen. In some embodiments, the device translates coarse finger-based input into precise pointer / cursor positions or commands to perform the user-desired actions.

[0051] In some embodiments, in addition to the touchscreen, device 100 optionally includes a touchpad (not shown) for activating or deactivating specific functions. In some embodiments, the touchpad is a touch-sensitive area of ​​the device that, unlike the touchscreen, does not display visual output. The touchpad is optionally a touch-sensitive surface separate from the touchscreen 112, or an extension of the touch-sensitive surface formed by the touchscreen.

[0052] The device 100 also includes a power system 162 for supplying power to various components. The power system 162 optionally includes a power management system, one or more power sources (e.g., batteries, alternating current (AC)), a recharging system, a power fault detection circuit, a power converter or inverter, a power status indicator (e.g., light-emitting diodes (LEDs)), and any other components associated with the generation, management, and distribution of power in portable or non-portable devices.

[0053] The device 100 may optionally also include one or more optical sensors 164. Figure 1AAn optical sensor 164 is shown coupled to an optical sensor controller 158 in the I / O subsystem 106. The optical sensor 164 optionally includes a charge-coupled device (CCD) or a complementary metal-oxide-semiconductor (CMOS) phototransistor. The optical sensor 164 receives light projected through one or more lenses from the environment and converts the light into data representing an image. In conjunction with an imaging module 143 (also called a camera module), the optical sensor 164 optionally captures still images or video. In some embodiments, the optical sensor is located on the rear of the device 100, opposite to a touchscreen display 112 on the front of the device, allowing the touchscreen display to be used as a viewfinder for still image and / or video image acquisition. In some embodiments, the optical sensor is located on the front of the device, allowing images of the user to be optionally acquired for video conferencing while the user views other video conferencing participants on the touchscreen display. In some embodiments, the position of the optical sensor 164 can be changed by the user (e.g., by rotating the lenses and sensors within the device housing), allowing a single optical sensor 164 to be used in conjunction with the touchscreen display for both video conferencing and still image and / or video image acquisition.

[0054] The device 100 may optionally also include one or more contact strength sensors 165. Figure 1A A contact strength sensor 165 is shown coupled to a strength sensor controller 159 in I / O subsystem 106. The contact strength sensor 165 optionally includes one or more piezoresistive strain gauges, capacitive force sensors, electro-force sensors, piezoelectric sensors, optical force sensors, capacitive touch-sensitive surfaces, or other strength sensors (e.g., sensors for measuring the force (or pressure) of contact on a touch-sensitive surface). The contact strength sensor 165 receives contact strength information (e.g., pressure information or a substitute for pressure information) from the environment. In some embodiments, at least one contact strength sensor is arranged juxtaposed with or adjacent to a touch-sensitive surface (e.g., touch-sensitive display system 112). In some embodiments, at least one contact strength sensor is located on the rear of device 100 opposite to the touchscreen display 112 located on the front of device 100.

[0055] The device 100 optionally also includes one or more proximity sensors 166. Figure 1AA proximity sensor 166 coupled to a peripheral device interface 118 is shown. Alternatively, the proximity sensor 166 may optionally be coupled to an input controller 160 in an I / O subsystem 106. The proximity sensor 166 may optionally perform as described in the following U.S. patent applications: 11 / 241,839, entitled "Proximity Detector In Handheld Device"; 11 / 240,788, entitled "Proximity Detector In Handheld Device"; 11 / 620,702, entitled "Using Ambient Light Sensor To Augment Proximity Sensor Output"; 11 / 586,862, entitled "Automated Response To And Sensing Of User Activity In Portable Devices"; and 11 / 638,251, entitled "Methods And Systems For Automatic Configuration Of Peripherals", the entire contents of which are incorporated herein by reference. In some implementations, the proximity sensor is turned off and the touchscreen 112 is disabled when the multifunction device is placed near the user's ear (e.g., when the user is making a phone call).

[0056] The device 100 may optionally also include one or more tactile output generators 167. Figure 1A A haptic output generator coupled to a haptic feedback controller 161 in I / O subsystem 106 is shown. The haptic output generator 167 optionally includes one or more electroacoustic devices such as speakers or other audio components; and / or electromechanical devices for converting energy into linear motion, such as motors, solenoids, electroactive polymers, piezoelectric actuators, electrostatic actuators, or other haptic output generating components (e.g., components for converting electrical signals into haptic outputs on the device). A contact intensity sensor 165 receives haptic feedback generation instructions from a haptic feedback module 133 and generates a haptic output on device 100 that can be sensed by a user of device 100. In some embodiments, at least one haptic output generator is juxtaposed or adjacent to a haptic surface (e.g., haptic display system 112) and optionally generates the haptic output by moving the haptic surface vertically (e.g., in / outward from the surface of device 100) or laterally (e.g., backward and forward in the same plane as the surface of device 100). In some embodiments, at least one haptic output generator sensor is located on the rear of the device 100, opposite to the touch screen display 112 located on the front of the device 100.

[0057] The device 100 may optionally also include one or more accelerometers 168. Figure 1A An accelerometer 168 coupled to a peripheral device interface 118 is shown. Alternatively, the accelerometer 168 may optionally be coupled to an input controller 160 in an I / O subsystem 106. The accelerometer 168 may optionally perform as described in the following U.S. patent publications: U.S. Patent Publication 20050190059, entitled "Acceleration-based Theft Detection System for Portable Electronic Devices" and U.S. Patent Publication 20060017692, entitled "Methods and Apparatuses For Operating A Portable Device Based On An Accelerometer," both of which are incorporated herein by reference in their entirety. In some embodiments, information is displayed on a touchscreen display in portrait or landscape view based on analysis of data received from one or more accelerometers. In addition to one or more accelerometers 168, device 100 optionally includes a magnetometer (not shown) and a GPS (or GLONASS or other global navigation system) receiver (not shown) for obtaining information about the position and orientation (e.g., longitudinal or lateral) of device 100.

[0058] In some embodiments, the software components stored in memory 102 include an operating system 126, a communication module (or instruction set) 128, a contact / motion module (or instruction set) 130, a graphics module (or instruction set) 132, a text input module (or instruction set) 134, a Global Positioning System (GPS) module (or instruction set) 135, and an application program (or instruction set) 136. Furthermore, in some embodiments, memory 102 ( Figure 1A ) or 370 ( Figure 3 Storage device / global internal state 157, such as Figure 1A and Figure 3 As shown in the figure. Device / global internal state 157 includes one or more of the following: active application state, which indicates which applications (if any) are currently active; display state, which indicates what applications, views or other information occupy various areas of the touch screen display 112; sensor state, including information obtained from the device's various sensors and input control devices 116; and position information about the device's position and / or orientation.

[0059] The operating system 126 (e.g., Darwin, RTXC, LINUX, UNIX, OS X, iOS, WINDOWS, or embedded operating systems such as VxWorks) includes various software components and / or drivers for controlling and managing general system tasks (e.g., memory management, storage device control, power management, etc.) and facilitates communication between various hardware and software components.

[0060] The communication module 128 facilitates communication with other devices via one or more external ports 124 and includes various software components for processing data received by the RF circuitry 108 and / or the external ports 124. The external ports 124 (e.g., Universal Serial Bus (USB), FireWire, etc.) are adapted to be directly coupled to other devices or indirectly coupled via a network (e.g., the Internet, Wireless LAN, etc.). In some embodiments, the external port is a multi-pin (e.g., 30-pin) connector that is the same as or similar to and / or compatible with the 30-pin connector used on iPod (Apple Inc. trademark) devices.

[0061] The contact / motion module 130 optionally detects contact with the touchscreen 112 (in conjunction with the display controller 156) and other touch-sensitive devices (e.g., touchpads or physical click-based rotary dials). The contact / motion module 130 includes various software components for performing various operations related to contact detection, such as determining whether a contact has occurred (e.g., detecting a finger press event), determining the contact intensity (e.g., the force or pressure of the contact, or an alternative to force or pressure), determining whether there is movement of the contact and tracking movement on the touch-sensitive surface (e.g., detecting one or more finger drag events), and determining whether the contact has stopped (e.g., detecting a finger lift event or a contact break). The contact / motion module 130 receives contact data from the touch-sensitive surface. Determining the movement of the contact point optionally includes determining the rate (magnitude), velocity (magnitude and direction), and / or acceleration (change in magnitude and / or direction) of the contact point, the movement of which is represented by a series of contact data. These operations are optionally applied to a single contact (e.g., a single finger contact) or multiple simultaneous contacts (e.g., "multi-touch" / multiple finger contact). In some implementations, the contact / motion module 130 and the display controller 156 detect contact on the touchpad.

[0062] In some implementations, the contact / motion module 130 uses a set of one or more intensity thresholds to determine whether an operation has been performed by a user (e.g., determining whether the user has “clicked” an icon). In some implementations, at least a subset of the intensity thresholds is determined based on software parameters (e.g., the intensity thresholds are not determined by the activation threshold of a specific physical actuator and can be adjusted without changing the physical hardware of device 100). For example, the mouse “click” threshold of a touchpad or touchscreen display can be set to any threshold in a wide range of predefined thresholds without changing the touchpad or touchscreen display hardware. Additionally, in some specific implementations, the user of the device is provided with software settings for adjusting one or more intensity thresholds in a set (e.g., by adjusting the individual intensity thresholds and / or by adjusting multiple intensity thresholds at once using system-level clicks on the “intensity” parameter).

[0063] The touch / motion module 130 optionally detects the user's gesture input. Different gestures on a touch-sensitive surface have different contact patterns (e.g., different movements, timings, and / or intensities of the detected contact). Therefore, gestures are optionally detected by detecting specific contact patterns. For example, detecting a finger tap gesture includes detecting a finger press event, and then detecting a finger lift-off (lift-away) event at the same (or substantially the same) location as the finger press event (e.g., at the location of an icon). As another example, detecting a finger swipe gesture on a touch-sensitive surface includes detecting a finger press event, then detecting one or more finger drag events, and subsequently detecting a finger lift-off (lift-away) event.

[0064] The graphics module 132 includes various known software components for rendering and displaying graphics on the touchscreen 112 or other display, including components for altering the visual impact of the displayed graphics (e.g., brightness, transparency, saturation, contrast, or other visual properties). As used herein, the term "graphics" includes any object that can be displayed to a user, and includes, without limitation, text, web pages, icons (such as user interface objects including soft keys), digital images, videos, animations, and the like.

[0065] In some implementations, the graphics module 132 stores data representing the graphics to be used. Each graphic is optionally assigned a corresponding code. The graphics module 132 receives one or more codes from an application or the like to specify the graphic to be displayed, and, if necessary, also receives coordinate data and other graphic attribute data, and then generates screen image data for output to the display controller 156.

[0066] The haptic feedback module 133 includes various software components for generating instructions that are used by one or more haptic output generators 167 to produce haptic output at one or more locations on the device 100 in response to user interaction with the device 100.

[0067] Optionally, the text input module 134, a component of the graphics module 132, provides a soft keyboard for entering text in various applications (e.g., contacts 137, email 140, IM 141, browser 147, and any other application that requires text input).

[0068] GPS module 135 determines the location of the device and provides this information for use in various applications (e.g., to a phone 138 for location-based dialing; to a camera 143 as image / video metadata; and to applications that provide location-based services such as weather desktop apps, local yellow pages desktop apps, and map / navigation desktop apps).

[0069] Application 136 optionally includes the following modules (or instruction sets) or subsets or supersets thereof:

[0070] • Contacts module 137 (sometimes called address book or contact list);

[0071] • Telephone module 138;

[0072] • Video conferencing module 139;

[0073] • Email client module 140;

[0074] • Instant Messaging (IM) module 141;

[0075] Fitness support module 142;

[0076] • Camera module 143 for still images and / or video images;

[0077] • Image management module 144;

[0078] • Video player module;

[0079] Music player module;

[0080] • Browser module 147;

[0081] • Calendar module 148;

[0082] • Desktop mini-program module 149, which optionally includes one or more of the following: weather desktop mini-program 149-1, stock market desktop mini-program 149-2, calculator desktop mini-program 149-3, alarm clock desktop mini-program 149-4, dictionary desktop mini-program 149-5 and other desktop mini-programs obtained by the user, and desktop mini-programs created by the user 149-6;

[0083] • Desktop app creator module 150 for creating user-created desktop apps 149-6;

[0084] • Search module 151;

[0085] • Video and music player module 152, which combines a video player module and a music player module;

[0086] • Notepad module 153;

[0087] • Map module 154; and / or

[0088] • Online video module 155.

[0089] Examples of other applications 136 that may be optionally stored in memory 102 include other word processing applications, other image editing applications, drawing applications, rendering applications, Java-enabled applications, encryption, digital rights management, speech recognition, and speech duplication.

[0090] In conjunction with the touchscreen 112, display controller 156, touch / motion module 130, graphics module 132, and text input module 134, the contact module 137 is optionally used to manage an address book or contact list (e.g., in the application internal state 192 of the contact module 137 stored in memory 102 or memory 370), including: adding one or more names to the address book; deleting names from the address book; associating phone numbers, email addresses, physical addresses, or other information with names; associating images with names; categorizing and classifying names; providing phone numbers or email addresses to initiate and / or facilitate communication via telephone 138, video conferencing module 139, email 140, or IM 141; and so on.

[0091] Combining RF circuitry 108, audio circuitry 110, speaker 111, microphone 113, touchscreen 112, display controller 156, contact / motion module 130, graphics module 132, and text input module 134, telephone module 138 is optionally used to input character sequences corresponding to telephone numbers, access one or more telephone numbers in contact module 137, modify entered telephone numbers, dial corresponding telephone numbers, initiate conversations, and disconnect or hang up when a conversation is completed. As described above, wireless communication optionally uses any of a variety of communication standards, protocols, and technologies.

[0092] Combining RF circuitry 108, audio circuitry 110, speaker 111, microphone 113, touchscreen 112, display controller 156, optical sensor 164, optical sensor controller 158, contact / motion module 130, graphics module 132, text input module 134, contact module 137, and telephone module 138, video conferencing module 139 includes executable instructions to initiate, execute, and terminate video conferences between the user and one or more other participants based on user instructions.

[0093] Incorporating RF circuitry 108, touchscreen 112, display controller 156, touch / motion module 130, graphics module 132, and text input module 134, email client module 140 includes executable instructions for creating, sending, receiving, and managing emails in response to user commands. Combined with image management module 144, email client module 140 makes it very easy to create and send emails containing still images or video images captured by camera module 143.

[0094] In conjunction with RF circuitry 108, touchscreen 112, display controller 156, touch / motion module 130, graphics module 132, and text input module 134, instant messaging module 141 includes executable instructions for: inputting a character sequence corresponding to an instant message, modifying previously input characters, transmitting a corresponding instant message (e.g., using Short Message Service (SMS) or Multimedia Messaging Service (MMS) protocols for telephone-based instant messaging or using XMPP, SIMPLE, or IMPS for internet-based instant messaging), receiving an instant message, and viewing received instant messages. In some embodiments, the transmitted and / or received instant messages optionally include graphics, photographs, audio files, video files, and / or other attachments supported in MMS and / or Enhanced Messaging Services (EMS). As used herein, "instant message" means both telephone-based messages (e.g., messages sent using SMS or MMS) and internet-based messages (e.g., messages sent using XMPP, SIMPLE, or IMPS).

[0095] Incorporating RF circuitry 108, touchscreen 112, display controller 156, touch / motion module 130, graphics module 132, text input module 134, GPS module 135, map module 154, and music player module, fitness support module 142 includes executable instructions for creating fitness activities (e.g., with time, distance, and / or calorie burning goals); communicating with fitness sensors (executive devices); receiving fitness sensor data; calibrating sensors used to monitor fitness; selecting and playing music for fitness activities; and displaying, storing, and transmitting fitness data.

[0096] In conjunction with the touchscreen 112, display controller 156, optical sensor 164, optical sensor controller 158, contact / motion module 130, graphics module 132, and image management module 144, the camera module 143 includes executable instructions for: capturing still images or videos (including video streams) and storing them in memory 102, modifying the characteristics of still images or videos, or deleting still images or videos from memory 102.

[0097] In conjunction with the touchscreen 112, display controller 156, touch / motion module 130, graphics module 132, text input module 134, and camera module 143, the image management module 144 includes executable instructions for arranging, modifying (e.g., editing) or otherwise manipulating, marking, deleting, presenting (e.g., in a digital slideshow or album), and storing still images and / or video images.

[0098] Combining RF circuitry 108, touchscreen 112, display controller 156, contact / motion module 130, graphics module 132, and text input module 134, browser module 147 includes executable instructions for browsing the Internet (including searching, linking to, receiving, and displaying web pages or portions thereof, as well as attachments and other files linked to web pages) according to user instructions.

[0099] Combining RF circuitry 108, touchscreen 112, display controller 156, touch / motion module 130, graphics module 132, text input module 134, email client module 140, and browser module 147, calendar module 148 includes executable instructions to create, display, modify, and store calendars and associated data (e.g., calendar entries, to-dos, etc.) according to user instructions.

[0100] In conjunction with RF circuitry 108, touchscreen 112, display controller 156, touch / motion module 130, graphics module 132, text input module 134, and browser module 147, desktop applet module 149 is optionally a micro-application downloaded and used by a user (e.g., weather desktop applet 149-1, stock market desktop applet 149-2, calculator desktop applet 149-3, alarm clock desktop applet 149-4, and dictionary desktop applet 149-5) or a user-created micro-application (e.g., user-created desktop applet 149-6). In some embodiments, the desktop applet includes HTML (Hypertext Markup Language) files, CSS (Cascading Style Sheets) files, and JavaScript files. In some embodiments, the desktop applet includes XML (Extensible Markup Language) files and JavaScript files (e.g., Yahoo! desktop applet).

[0101] Combining RF circuitry 108, touchscreen 112, display controller 156, touch / motion module 130, graphics module 132, text input module 134, and browser module 147, the desktop applet creator module 150 can optionally be used by the user to create desktop applets (e.g., converting user-specified portions of a webpage into desktop applets).

[0102] In conjunction with the touchscreen 112, display controller 156, touch / motion module 130, graphics module 132, and text input module 134, the search module 151 includes executable instructions to search the memory 102 for text, music, sound, images, videos, and / or other files that match one or more search criteria (e.g., one or more user-specified search terms) according to user instructions.

[0103] Combining touchscreen 112, display controller 156, touch / motion module 130, graphics module 132, audio circuitry 110, speaker 111, RF circuitry 108, and browser module 147, video and music player module 152 includes executable instructions allowing users to download and play recorded music and other sound files stored in one or more file formats such as MP3 or AAC files, as well as executable instructions for displaying, presenting, or otherwise playing back video (e.g., on touchscreen 112 or on an external display connected via external port 124). In some embodiments, device 100 optionally includes the functionality of an MP3 player, such as an iPod (a trademark of Apple Inc.).

[0104] Combining the touchscreen 112, display controller 156, touch / motion module 130, graphics module 132, and text input module 134, the notepad module 153 includes executable instructions for creating and managing notes, to-do items, etc., according to user instructions.

[0105] Combining RF circuitry 108, touchscreen 112, display controller 156, touch / motion module 130, graphics module 132, text input module 134, GPS module 135, and browser module 147, map module 154 is optionally used to receive, display, modify, and store maps and map-related data (e.g., driving directions, data related to shops and other points of interest at or near a specific location, and other location-based data) according to user instructions.

[0106] Incorporating touchscreen 112, display controller 156, touch / motion module 130, graphics module 132, audio circuitry 110, speaker 111, RF circuitry 108, text input module 134, email client module 140, and browser module 147, the online video module 155 includes instructions for performing the following actions: allowing users to access, browse, receive (e.g., via streaming and / or downloading), play back (e.g., on the touchscreen or on an external display connected via external port 124), send emails with links to specific online videos, and otherwise manage online videos in one or more file formats such as H.264. In some embodiments, an instant messaging module 141 is used instead of the email client module 140 to send links to specific online videos. Additional descriptions of the online video application can be found in U.S. Provisional Patent Application No. 60 / 936,562, filed June 20, 2007, entitled “Portable Multifunction Device, Method, and Graphical User Interface for Playing Online Videos,” and U.S. Patent Application No. 11 / 968,067, filed December 31, 2007, entitled “Portable Multifunction Device, Method, and Graphical User Interface for Playing Online Videos,” the contents of which are incorporated herein by reference in their entirety.

[0107] Each of the modules and applications described above corresponds to an executable instruction set for performing one or more of the functions described above and the methods described in this patent application (e.g., computer-implemented methods and other information processing methods as described herein). These modules (e.g., instruction sets) need not be implemented as separate software programs, processes, or modules; therefore, various subsets of these modules may optionally be combined or otherwise rearranged in various embodiments. For example, a video player module may optionally be combined with a music player module into a single module (e.g., Figure 1A (e.g., video and music player module 152). In some embodiments, memory 102 optionally stores subgroups of the above-described modules and data structures. Additionally, memory 102 optionally stores other modules and data structures not described above.

[0108] In some implementations, device 100 is the only device that performs operations of a predefined set of functions via a touchscreen and / or touchpad. By using a touchscreen and / or touchpad as the primary input control device for operating device 100, the number of physical input control devices (e.g., push-buttons, dials, etc.) on device 100 is optionally reduced.

[0109] A predefined set of functions, uniquely performed via a touchscreen and / or touchpad, optionally includes navigation between user interfaces. In some embodiments, the touchpad, when touched by a user, navigates device 100 from any user interface displayed on device 100 to a main menu, home menu, or root menu. In such embodiments, a touchpad is used to implement a "menu button." In some other embodiments, the menu button is a physical push-button or other physical input control device, rather than a touchpad.

[0110] Figure 1B This is a block diagram illustrating exemplary components for event processing according to some embodiments. In some embodiments, memory 102 ( Figure 1A ) or memory 370 ( Figure 3 This includes an event classifier 170 (e.g., in operating system 126) and a corresponding application 136-1 (e.g., any one of the aforementioned applications 137 to 151, 155, 380 to 390).

[0111] Event classifier 170 receives event information and determines the application 136-1 and application view 191 of application 136-1 to which the event information should be delivered. Event classifier 170 includes event monitor 171 and event dispatcher module 174. In some embodiments, application 136-1 includes application internal state 192, which indicates one or more current application views displayed on touch-sensitive display 112 when the application is active or executing. In some embodiments, device / global internal state 157 is used by event classifier 170 to determine which application(s) is currently active, and application internal state 192 is used by event classifier 170 to determine the application view 191 to which the event information should be delivered.

[0112] In some implementations, the application internal state 192 includes additional information such as one or more of the following: recovery information to be used when the application 136-1 resumes execution, user interface state information indicating information being displayed by the application or information ready to be displayed by the application 136-1, a state queue for enabling the user to return to the previous state or view of the application 136-1, and a repeat / undo queue for the user's previous actions.

[0113] Event monitor 171 receives event information from peripheral device interface 118. The event information includes information about sub-events (e.g., user touches on touch-sensitive display 112 as part of a multi-touch gesture). Peripheral device interface 118 transmits information it receives from I / O subsystem 106 or sensors such as proximity sensor 166, one or more accelerometers 168, and / or microphone 113 (via audio circuitry 110). The information received by peripheral device interface 118 from I / O subsystem 106 includes information from touch-sensitive display 112 or touch-sensitive surfaces.

[0114] In some implementations, event monitor 171 sends requests to peripheral device interface 118 at predetermined intervals. In response, peripheral device interface 118 transmits event information. In other implementations, peripheral device interface 118 transmits event information only when a significant event occurs (e.g., receiving input above a predetermined noise threshold and / or receiving input for a predetermined duration).

[0115] In some implementations, the event classifier 170 also includes a hit view determination module 172 and / or an activity event recognizer determination module 173.

[0116] When the touch-sensitive display 112 displays more than one view, the hit view determination module 172 provides a software process for determining where a sub-event has occurred within one or more views. A view consists of controls and other elements that the user can see on the display.

[0117] Another aspect of the user interface associated with an application is a set of views, sometimes referred to herein as application views or user interface windows, in which information is displayed and touch-based gestures occur. The application view (of the corresponding application) in which a touch is detected optionally corresponds to a procedural level within the application's procedural or view hierarchy. For example, the lowest-level view in which a touch is detected is optionally referred to as the hit view, and the set of events identified as correct input is optionally determined at least in part based on the hit view of the initial touch that initiates a touch-based gesture.

[0118] The hit view determination module 172 receives information related to sub-events of touch-based gestures. When an application has multiple views organized in a hierarchical structure, the hit view determination module 172 identifies the hit view as the lowest-level view in the hierarchical structure from which the sub-events should be processed. In most cases, the hit view is the lowest-level view in which the initiating sub-event (e.g., the first sub-event in a sequence of sub-events forming an event or potential event) occurs. Once the hit view is identified by the hit view determination module 172, the hit view typically receives all sub-events related to the same touch or input source to which it was identified as the hit view.

[0119] The activity event recognizer determination module 173 determines which views(s) within the view hierarchy should receive a specific sub-event sequence. In some embodiments, the activity event recognizer determination module 173 determines that only the hit view should receive the specific sub-event sequence. In other embodiments, the activity event recognizer determination module 173 determines that all views including the physical location of the sub-event are actively participating views, and therefore determines that all actively participating views should receive the specific sub-event sequence. In other embodiments, even if the touch sub-event is entirely confined to the area associated with a particular view, higher views in the hierarchy will still remain actively participating views.

[0120] Event assigner module 174 assigns event information to event identifiers (e.g., event identifier 180). In embodiments that include active event identifier determination module 173, event assigner module 174 delivers event information to the event identifier determined by active event identifier determination module 173. In some embodiments, event assigner module 174 stores event information in an event queue, which is retrieved by the corresponding event receiver 182.

[0121] In some embodiments, operating system 126 includes event classifier 170. Alternatively, application 136-1 includes event classifier 170. In yet another embodiment, event classifier 170 is a standalone module or part of another module (such as contact / motion module 130) stored in memory 102.

[0122] In some embodiments, application 136-1 includes a plurality of event handlers 190 and one or more application views 191, each of which includes instructions for handling touch events occurring within a corresponding view of the application's user interface. Each application view 191 of application 136-1 includes one or more event recognizers 180. Typically, a corresponding application view 191 includes a plurality of event recognizers 180. In other embodiments, one or more of the event recognizers 180 are part of a separate module, such as a user interface toolkit (not shown) or a higher-level object from which application 136-1 inherits methods and other properties. In some embodiments, a corresponding event handler 190 includes one or more of the following: a data updater 176, an object updater 177, a GUI updater 178, and / or event data 179 received from an event classifier 170. Event handlers 190 optionally utilize or invoke the data updater 176, the object updater 177, or the GUI updater 178 to update the application's internal state 192. Alternatively, one or more application views in application view 191 include one or more corresponding event handlers 190. Additionally, in some embodiments, one or more of data updater 176, object updater 177, and GUI updater 178 are included in the corresponding application view 191.

[0123] The corresponding event recognizer 180 receives event information (e.g., event data 179) from the event classifier 170 and identifies events from the event information. The event recognizer 180 includes an event receiver 182 and an event comparator 184. In some embodiments, the event recognizer 180 also includes at least one subset of metadata 183 and event delivery instructions 188 (which optionally include sub-event delivery instructions).

[0124] Event receiver 182 receives event information from event classifier 170. The event information includes information about sub-events, such as touch or touch movement. Depending on the sub-event, the event information also includes additional information, such as the location of the sub-event. When the sub-event involves touch movement, the event information optionally also includes the rate and direction of the sub-event. In some embodiments, the event includes the device rotating from one orientation to another (e.g., from a longitudinal orientation to a lateral orientation, or vice versa), and the event information includes corresponding information about the device's current orientation (also referred to as device pose).

[0125] Event comparator 184 compares event information with predefined event or sub-event definitions and determines the event or sub-event based on the comparison, or determines or updates the state of the event or sub-event. In some embodiments, event comparator 184 includes event definition 186. Event definition 186 contains definitions of events (e.g., predefined sequences of sub-events), such as event 1 (187-1), event 2 (187-2), and others. In some embodiments, sub-events in event 187 include, for example, touch start, touch end, touch move, touch cancel, and multi-touch. In one example, event 1 (187-1) is defined as a double-click on a displayed object. For example, a double-click includes a first touch (touch start) of a predetermined duration on the displayed object, a first lift-off of a predetermined duration (touch end), a second touch (touch start) of a predetermined duration on the displayed object, and a second lift-off of a predetermined duration (touch end). In another example, event 2 (187-2) is defined as dragging on a displayed object. For example, dragging includes a touch (or contact) on a displayed object for a predetermined duration, movement of the touch on the touch-sensitive display 112, and lifting off the touch (end of touch). In some embodiments, the event also includes information for one or more associated event handlers 190.

[0126] In some implementations, event definition 187 includes definitions of events for corresponding user interface objects. In some implementations, event comparator 184 performs a hit test to determine which user interface object is associated with the sub-event. For example, in an application view (where three user interface objects are displayed on touch display 112), when a touch is detected on touch-sensitive display 112, event comparator 184 performs a hit test to determine which of the three user interface objects is associated with the touch (sub-event). If each displayed object is associated with a corresponding event handler 190, the event comparator uses the result of the hit test to determine which event handler 190 should be activated. For example, event comparator 184 selects the event handler associated with the sub-event and the object that triggered the hit test.

[0127] In some implementations, the definition of the corresponding event 187 also includes a delay action that delays the delivery of event information until it has been determined whether the sub-event sequence actually corresponds to or does not correspond to the event type of the event recognizer.

[0128] When the corresponding event recognizer 180 determines that the sub-event sequence does not match any event in event definition 186, the corresponding event recognizer 180 enters an event impossible, event failed, or event ended state, after which subsequent sub-events based on touch gestures are ignored. In this case, other event recognizers (if any) that remain active in the hit view continue to track and process the ongoing sub-events based on touch gestures.

[0129] In some embodiments, the corresponding event recognizer 180 includes metadata 183 having configurable attributes, flags, and / or lists instructing how the event delivery system should perform sub-event delivery to actively participating event recognizers. In some embodiments, metadata 183 includes configurable attributes, flags, and / or lists instructing how or how event recognizers can interact with each other. In some embodiments, metadata 183 includes configurable attributes, flags, and / or lists instructing whether sub-events are delivered to different levels in a view or programmatic hierarchy.

[0130] In some implementations, when one or more specific sub-events of an event are identified, the corresponding event recognizer 180 activates the event handler 190 associated with the event. In some implementations, the corresponding event recognizer 180 delivers event information associated with the event to the event handler 190. Activating the event handler 190 is different from sending (and delaying) the sub-events to the corresponding hit view. In some implementations, the event recognizer 180 issues a flag associated with the identified event, and the event handler 190 associated with that flag acquires the flag and executes a predefined procedure.

[0131] In some implementations, event delivery instruction 188 includes a sub-event delivery instruction that delivers event information about a sub-event without activating an event handler. Instead, the sub-event delivery instruction delivers the event information to an event handler associated with the sub-event sequence or to an actively participating view. The event handler associated with the sub-event sequence or the actively participating view receives the event information and performs a predetermined procedure.

[0132] In some implementations, data updater 176 creates and updates data used in application 136-1. For example, data updater 176 updates phone numbers used in contact module 137 or stores video files used in video player module. In some implementations, object updater 177 creates and updates objects used in application 136-1. For example, object updater 177 creates new user interface objects or updates the location of user interface objects. GUI updater 178 updates the GUI. For example, GUI updater 178 prepares display information and sends the display information to graphics module 132 for display on touch-sensitive display.

[0133] In some implementations, event handler 190 includes, or has access to, a data updater 176, an object updater 177, and a GUI updater 178. In some implementations, data updater 176, object updater 177, and GUI updater 178 are included in a single module of the corresponding application 136-1 or are included in application view 191. In other implementations, they are included in two or more software modules.

[0134] It should be understood that the above discussion regarding event handling for user touch on a touch-sensitive display also applies to other forms of user input used to operate the multifunction device 100 using an input device, and not all user input is initiated on the touchscreen. For example, mouse movement and mouse button presses optionally in conjunction with single or multiple keyboard presses or holds; touch movements on the touchpad, such as taps, drags, scrolls, etc.; stylus input; device movement; verbal commands; detected eye movements; biometric input; and / or any combination thereof may optionally be used as input corresponding to sub-events that define the event to be identified.

[0135] Figure 2 A portable or non-portable multifunction device 100 with a touchscreen 112 is shown according to some embodiments. As described above, the multifunction device 100 is described as having various structures shown (such as touchscreen 112, speaker 111, accelerometer 168, microphone 113, etc.); however, it should be understood that these structures optionally reside on separate devices. For example, display-related structures (e.g., display, speaker, etc.) and / or functions optionally reside on separate display devices, input-related structures (e.g., touch-sensitive surface, microphone, accelerometer, etc.) and / or functions optionally reside on separate input devices, and other structures and / or functions optionally reside on the multifunction device 100.

[0136] Touchscreen 112 optionally displays one or more graphics within user interface (UI) 200. In this embodiment and other embodiments described below, a user can select one or more graphics by gesturing over the graphics, for example, using one or more fingers 202 (not drawn to scale in the diagram) or one or more styluses 203 (not drawn to scale in the diagram). In some embodiments, selection of one or more graphics occurs when the user breaks contact with the graphics. In some embodiments, gestures optionally include one or more taps, one or more swipes (from left to right, from right to left, up and / or down), and / or scrolling (from right to left, from left to right, up and / or down) of a finger already in contact with device 100. In some embodiments or in some cases, unintentional contact with a graphic does not select the graphic. For example, a swipe gesture over an application icon optionally does not select the corresponding application when the gesture corresponding to selection is a tap.

[0137] Device 100 optionally also includes one or more physical buttons, such as a "home" button or a menu button 204. As previously described, menu button 204 is optionally used to navigate to any application 136 of a set of applications optionally executed on device 100. Alternatively, in some embodiments, the menu button is implemented as a soft key in a GUI displayed on touchscreen 112.

[0138] In one embodiment, device 100 includes a touchscreen 112, a menu button 204, a push-button 206 for powering on / off and locking the device, one or more volume control buttons 208, a SIM card slot 210, a headset jack 212, and a docking / charging external port 124. The push-button 206 is optionally used to power on / off the device by pressing the button and holding it in the pressed state for a predefined time interval; to lock the device by pressing the button and releasing it before the predefined time interval has elapsed; and / or to unlock the device or initiate an unlocking process. In another embodiment, device 100 also accepts voice input via microphone 113 for activating or deactivating certain functions. Device 100 also optionally includes one or more contact strength sensors 165 for detecting the intensity of contact on the touchscreen 112, and / or one or more haptic output generators 167 for generating haptic outputs for a user of device 100.

[0139] Figure 3This is a block diagram of an exemplary multifunctional device with a display and a touch-sensitive surface according to some embodiments. As mentioned above, device 300 does not necessarily include a display and a touch-sensitive surface; instead, in some embodiments, it optionally communicates with displays and touch-sensitive surfaces on other devices. Additionally, device 300 does not necessarily have to be portable. In some embodiments, device 300 is a laptop computer, desktop computer, tablet computer, multimedia player device (such as a television or set-top box), navigation device, educational device (such as a children's learning toy), gaming system, or control device (e.g., a home or industrial controller). Device 300 typically includes one or more processing units (CPUs) 310, one or more network or other communication interfaces 360, memory 370, and one or more communication buses 320 for interconnecting these components. The communication bus 320 optionally includes circuitry (sometimes referred to as a chipset) that interconnects system components and controls communication between system components. Device 300 includes an input / output (I / O) interface 330 with a display 340, which is typically a touchscreen display. I / O interface 330 may also optionally include keyboard and / or mouse (or other pointing device) 350 and touchpad 355, and haptic output generator 357 for generating haptic output on device 300 (e.g., similar to the above reference). Figure 1A The one or more tactile output generators 167 and sensors 359 (e.g., optical sensors, accelerometers, proximity sensors, touch sensors, and / or contact intensity sensors similar to those mentioned above) are described. Figure 1A The one or more contact strength sensors 165 mentioned above). Memory 370 includes high-speed random access memory, such as DRAM, SRAM, DDR RAM, or other random access solid-state memory devices; and optionally includes non-volatile memory, such as one or more disk storage devices, optical disk storage devices, flash memory devices, or other non-volatile solid-state storage devices. Memory 370 optionally includes one or more storage devices located remotely from CPU 310. In some embodiments, memory 370 stores programs, modules, and data structures or subsets thereof, said programs, modules, and data structures resembling portable or non-portable multifunction device 100. Figure 1A The memory 370 stores programs, modules, and data structures in the memory 102 of the portable or non-portable multifunction device 100. Additionally, the memory 370 optionally stores additional programs, modules, and data structures not present in the memory 102 of the portable or non-portable multifunction device 100. For example, the memory 370 of the device 300 optionally stores a drawing module 380, a rendering module 382, ​​a word processing module 384, a website creation module 386, a disk editing module 388, and / or a spreadsheet module 390, while the portable or non-portable multifunction device 100 ( Figure 1A The memory 102 may optionally not store these modules.

[0140] Figure 3 Each of the aforementioned identified elements is optionally stored in one or more of the previously mentioned memory devices. Each of the aforementioned identified modules corresponds to a set of instructions for performing the functions described above. The aforementioned identified modules or programs (i.e., instruction sets) need not be implemented as standalone software programs, processes, or modules; therefore, various subsets of these modules may optionally be combined or otherwise rearranged in various embodiments. In some embodiments, memory 370 optionally stores a subset of the aforementioned modules and data structures. Furthermore, memory 370 optionally stores additional modules and data structures not described above.

[0141] Figure 4 B shows a touch-sensitive surface 451 (e.g., separate from the display 450 (e.g., touchscreen display 112)). Figure 3 Devices such as tablets or touchpads (e.g., 355) Figure 3 An exemplary user interface on the device 300. The device 300 also optionally includes one or more contact intensity sensors (e.g., one or more sensors in sensor 357) for detecting the intensity of contact on the tactile surface 451 and / or one or more tactile output generators 359 for generating tactile output for the user of the device 300.

[0142] While some examples of input on a reference touchscreen display 112 (which combines a touch-sensitive surface and a display) are given below, in some implementations the device detects input on a touch-sensitive surface separate from the display, such as... Figure 4 As shown in the diagram. In some embodiments, the touch-sensitive surface (e.g., Figure 4 451) has a main shaft (e.g., Figure 4 452), the spindle corresponds to the spindle on the display (e.g., 450), Figure 4 (453 in the example). According to these embodiments, the device detects contact with the touch-sensitive surface 451 (e.g., ...). Figure 4 (460 and 462 in the text), the position of this contact corresponds to the corresponding position on the display (e.g., in...). Figure 4 In this context, 460 corresponds to 468, and 462 corresponds to 470. Thus, when the touch-sensitive surface (e.g., Figure 4 451) and the display of the multi-functional device ( Figure 4 When 450 is separated from the touch-sensitive surface, user input detected by the device (e.g., touches on 460 and 462 and their movement) is used by the device to manipulate the user interface on the display. It should be understood that similar methods may be optionally used for other user interfaces described herein.

[0143] Additionally, while the examples below are primarily given with reference to finger input (e.g., finger touch, single-finger tap, finger swipe), it should be understood that in some implementations, one or more of these finger inputs may be replaced by input from another input device (e.g., mouse-based input or stylus input). For example, a swipe gesture may optionally be replaced by a mouse click (e.g., instead of a touch), followed by movement of the cursor along the swipe path (e.g., instead of movement of the touch). Similarly, a tap gesture may optionally be replaced by a mouse click while the cursor is over the location of the tap gesture (e.g., instead of detection of touch, followed by cessation of touch detection). Likewise, when multiple user inputs are detected simultaneously, it should be understood that multiple computer mice may optionally be used simultaneously, or mouse and finger touch may optionally be used simultaneously.

[0144] As used herein, the term "focus selector" refers to an input element used to indicate the current portion of a user interface with which a user is interacting. In some implementations that include a cursor or other positional marker, the cursor acts as a "focus selector" such that when the cursor hovers over a particular user interface element (e.g., a button, window, slider, or other user interface element), a touch-sensitive surface (e.g., Figure 3 The touchpad 355 or Figure 4 When an input (e.g., a press input) is detected on the touch-sensitive surface 451 of the device, a specific user interface element is adjusted based on the detected input. This applies to touchscreen displays (e.g., those enabling direct interaction with user interface elements on a touchscreen display) that include... Figure 1AIn some embodiments of the touch-sensitive display system 112, a touch detected on the touchscreen acts as a "focus selector," causing the specific user interface element to be adjusted based on the detected input when input (e.g., a press input via a touch) is detected at the location of a specific user interface element (e.g., a button, window, slider, or other user interface element) on the touchscreen display. In some embodiments, focus moves from one area of ​​the user interface to another without corresponding movement of the cursor or movement of a touch on the touchscreen display (e.g., moving focus from one button to another using tab keys or arrow keys); in these embodiments, the focus selector moves according to the movement of focus between different areas of the user interface. Regardless of the specific form the focus selector takes, the focus selector is typically a user-controlled user interface element (or a touch on the touchscreen display) that transmits the user's expected interaction with the user interface (e.g., by indicating to the device the user interface element with which the user expects to interact). For example, when a press input is detected on a touch-sensitive surface (e.g., a touchpad or touchscreen), the position of the focus selector (e.g., a cursor, touch, or selection box) above the corresponding button will indicate to the user that they expect to activate the corresponding button (rather than other user interface elements shown on the device's display).

[0145] As used in the specification and claims, the term "characteristic intensity" of a contact refers to a characteristic of the contact based on one or more intensities of the contact. In some embodiments, the characteristic intensity is based on multiple intensity samples. The characteristic intensity is optionally based on a predefined number of intensity samples or a set of intensity samples collected over a predetermined time period (e.g., 0.05 seconds, 0.1 seconds, 0.2 seconds, 0.5 seconds, 1 second, 2 seconds, 5 seconds, 10 seconds) relative to a predefined event (e.g., after contact is detected, before contact is detected to be lifted away, before or after contact begins to move, before contact ends, before or after contact intensity is detected to increase and / or before or after contact intensity decreases). The characteristic intensity of the contact is optionally based on one or more of the following: the maximum value of the contact intensity, the mean value of the contact intensity, the average value of the contact intensity, the value at the top 10% of the contact intensity, the half maximum value of the contact intensity, the 90% maximum value of the contact intensity, etc. In some embodiments, the duration of the contact is used when determining the characteristic intensity (e.g., when the characteristic intensity is the average value of the contact intensity over time). In some implementations, the feature intensity is compared to a set of one or more intensity thresholds to determine whether the user has performed an action. For example, the set of one or more intensity thresholds may optionally include a first intensity threshold and a second intensity threshold. In this example, contact with a feature intensity not exceeding the first threshold results in a first action, contact with a feature intensity exceeding the first intensity threshold but not exceeding the second intensity threshold results in a second action, and contact with a feature intensity exceeding the second threshold results in a third action. In some implementations, a comparison between the feature intensity and one or more thresholds is used to determine whether to perform one or more actions (e.g., whether to perform the corresponding action or abandon performing the corresponding action) rather than to determine whether to perform the first action or the second action.

[0146] In some embodiments described herein, one or more operations are performed in response to detecting a gesture including a corresponding press input or in response to detecting a corresponding press input performed using a corresponding contact (or multiple contacts), wherein the corresponding press input is detected at least in part based on detecting that the intensity of the contact (or multiple contacts) increases to above a press input intensity threshold. In some embodiments, the corresponding operation is performed in response to detecting that the intensity of the corresponding contact increases to above a press input intensity threshold (e.g., a "downward stroke" of the corresponding press input). In some embodiments, the press input includes the intensity of the corresponding contact increasing to above a press input intensity threshold and the intensity of the contact subsequently decreasing to below the press input intensity threshold, and the corresponding operation is performed in response to detecting that the intensity of the corresponding contact subsequently decreases to below the press input threshold (e.g., an "upward stroke" of the corresponding press input).

[0147] In some implementations, the device employs intensity hysteresis to avoid unintended inputs sometimes referred to as "jitter," wherein the device defines or selects a hysteresis intensity threshold that has a predefined relationship with a press input intensity threshold (e.g., the hysteresis intensity threshold is X intensity units lower than the press input intensity threshold, or the hysteresis intensity threshold is 75%, 90%, or some reasonable percentage of the press input intensity threshold). Therefore, in some implementations, a press input includes an increase in the intensity of the corresponding contact above the press input intensity threshold and a subsequent decrease in the intensity of that contact below the hysteresis intensity threshold corresponding to the press input intensity threshold, and a corresponding operation is performed in response to detecting that the intensity of the corresponding contact subsequently decreases below the hysteresis intensity threshold (e.g., an "upstroke" of the corresponding press input). Similarly, in some implementations, a press input is detected only when the device detects that the contact intensity increases from an intensity equal to or below the hysteresis intensity threshold to an intensity equal to or above the press input intensity threshold and optionally the contact intensity subsequently decreases to an intensity equal to or below the hysteresis intensity threshold, and a corresponding operation is performed in response to detecting a press input (e.g., an increase or decrease in contact intensity depending on the environment).

[0148] For ease of explanation, optionally, the description of an operation triggered in response to a press input associated with a press input strength threshold or in response to a gesture including a press input is provided in response to detecting any of the following conditions: the contact strength increases to above the press input strength threshold, the contact strength increases from below a hysteresis strength threshold to above the press input strength threshold, the contact strength decreases to below the press input strength threshold, and / or the contact strength decreases to below the hysteresis strength threshold corresponding to the press input strength threshold. Additionally, in the example where the operation is described as being performed in response to detecting a decrease in contact strength below the press input strength threshold, the operation is optionally performed in response to detecting a decrease in contact strength below a hysteresis strength threshold corresponding to and less than the press input strength threshold.

[0149] Figure 5A A block diagram of an exemplary architecture for device 500 according to some embodiments of this disclosure is shown. Figure 5A In this implementation, media content or other content is optionally received by device 500 via network interface 502, which is optionally a wireless or wired connection. One or more processors 504 optionally execute any number of programs stored in memory 506 or a storage device, the programs optionally including instructions for performing one or more of the methods and / or processes described herein (e.g., method 700).

[0150] In some embodiments, the display controller 508 causes various user interfaces of this disclosure to be displayed on the display 514. Additionally, input to the device 500 is optionally provided by a remote controller 510 via a remote controller interface 512, which is optionally a wireless or wired connection. In some embodiments, input to the device 500 is provided by a multifunction device 511 (e.g., a smartphone) running a remote application that configures the multifunction device to simulate remote control functionality, as will be described in more detail below. In some embodiments, the multifunction device 511 corresponds to... Figure 1A and Figure 2 Equipment 100 and Figure 3 One or more devices in device 300. It should be understood that... Figure 5A The implementation scheme does not imply limitation on the features of the device described herein, and other components that are advantageous to other features described herein may also be optionally included. Figure 5A In the architecture. In some implementations, device 500 optionally corresponds to Figure 1A and Figure 2 Multifunctional device 100 and Figure 3 One or more of the devices in device 300; network interface 502 optionally corresponds to Figure 1A and Figure 2 The RF circuit 108, external port 124, and peripheral device interface 118 are included. Figure 3 One or more of the network communication interfaces 360; the processor 504 optionally corresponds to one or more of the following: Figure 1A One or more processors 120 and Figure 3 One or more CPUs 310; the display controller 508 optionally corresponds to one or more of the following: Figure 1A The display controller 156 and Figure 3 The I / O interface 330 and memory 506 optionally correspond to one or more of the following: Figure 1A The memory 102 and Figure 3 The memory 370 in the memory; the remote control interface 512 optionally corresponds to one or more of the following: Figure 1A The peripheral device interface 118 and I / O subsystem 106 (and / or its components) and Figure 3 The I / O interface 330; the remote control 512 optionally corresponds to and / or includes one or more of the following: Figure 1AThe system includes a speaker 111, a touch-sensitive display system 112, a microphone 113, one or more optical sensors 164, one or more contact intensity sensors 165, one or more tactile output generators 167, other input control devices 116, one or more accelerometers 168, a proximity sensor 166, and an I / O subsystem 106. Figure 3 The keyboard / mouse 350, touchpad 355, one or more haptic output generators 357, and one or more contact intensity sensors 359, and Figure 4 The touch-sensitive surface 451; and the display 514 optionally corresponds to one or more of the following: Figure 1A and 2 The touch-sensitive display system 112 in the middle, and Figure 3 The monitor in the middle is 340.

[0151] Figure 5B Exemplary structures of a remote controller 510 according to some embodiments of the present disclosure are shown. In some embodiments, the remote controller 510 optionally corresponds to Figure 1A and Figure 2 Multifunctional device 100 and Figure 3 One or more devices in device 300. Remote controller 510 optionally includes a touch-sensitive surface 451. In some embodiments, the touch-sensitive surface 451 is edge-to-edge (e.g., it extends to the edge of remote controller 510 such that there is virtually no or no surface of remote controller 510 between the touch-sensitive surface 451 and one or more edges of remote controller 510, such as...). Figure 5B(As shown). As described above in this disclosure, the touch-sensitive surface 451 is optionally capable of sensing contact and contact intensity (e.g., clicking the touch-sensitive surface 451). Furthermore, the touch-sensitive surface 451 optionally includes a mechanical actuator for providing physical button click functionality (e.g., the touch-sensitive surface 451 is "clickable" to provide a corresponding input to the device 500). The remote control 510 also optionally includes buttons 516, 518, 520, 522, 524, and 526. Buttons 516, 518, 520, 522, 524, and 526 are optionally mechanical buttons or alternative forms of mechanical buttons, which are capable of sensing contact or pressing with such buttons to initiate one or more corresponding actions, for example, on the device 500. In some implementations, a user's selection of the "Menu" button 516 navigates backward through the currently running application or the currently displayed user interface (e.g., backward to a user interface that preceded the currently displayed user interface), or navigates the device 500 to a user interface one level higher than the currently displayed user interface. In some implementations, a user's selection of the "Home" button 518 navigates the device 500 from any user interface displayed on the device 500 to the main, home, or root user interface (e.g., to the device 500's home screen, which optionally includes one or more applications accessible on the device 500). In some implementations, a user's selection of the "Play / Pause" button 520 toggles between playing and pausing a currently playing content item on the device 500 (e.g., optionally pausing the content item if it is playing on the device 500 when the "Play / Pause" button 520 is selected, and optionally playing the content item if it is paused on the device 500 when the "Play / Pause" button 520 is selected). In some embodiments, a user's selection of the "+" 522 or "-" 524 buttons increases or decreases the volume of audio reproduced by device 500 (e.g., the volume of content currently playing on device 500). In some embodiments, a user's selection of the "Audio Input" button 526 allows the user to provide audio input (e.g., voice input) to device 500, optionally to a voice assistant on the device. In some embodiments, remote control 510 includes a microphone via which the user provides audio input to device 500 when selecting the "Audio Input" button 526. In some embodiments, remote control 510 includes one or more accelerometers for detecting information about motion of the remote control.

[0152] User interface and related processes

[0153] Unified Media Browser

[0154] Users interact with electronic devices in a variety of different ways, including interacting with media (e.g., music, movies, etc.) that are available (e.g., stored or otherwise accessible) on the electronic device (e.g., as referenced). Figures 6A to 6LL , Figures 8A to 8GG , Figures 10A to 10Z , Figures 12A to 12V and / or Figures 18A to 18J (As described above). For example, a user can browse and play media accessible on an electronic device. In some cases, this media may be available through different media applications installed on the electronic device. For example, a first media application on the electronic device may optionally provide access to media from a first media provider, and a second media application on the electronic device may optionally provide access to media from a second media provider. However, in some cases, the user must browse media from each media application (and therefore the media provider) individually; however, the user may wish to browse media from different media applications within a unified media browsing user interface. The following embodiments provide a way for an electronic device to present suggested media items (e.g., movies, TV shows, etc.) from different media applications to the user within a unified media browsing application, thereby enhancing the user's interaction with the electronic device. Enhanced interaction with the device reduces the amount of time required for the user to perform operations, thereby reducing the device's power consumption and extending the battery life of battery-powered devices. It should be understood that people use devices. When a person uses a device, that person is optionally referred to as a user of the device.

[0155] Figures 6A to 6LL Exemplary methods by which electronic devices according to some embodiments of the present disclosure present suggested media items (e.g., movies, TV shows, etc.) to a user in a unified media browsing application are illustrated. The embodiments in these figures are used to illustrate the processes described below, including references to... Figures 7A to 7L The process described.

[0156] Figure 6A An exemplary display 514 is shown. Display 514 optionally displays one or more user interfaces including various content. Figure 6A In the example shown, display 514 displays on an electronic device (e.g., Figure 5AA unified media browsing application runs on an electronic device 500, and a display 514 is part of or connected to the electronic device. The electronic device can optionally access various media items (e.g., movies, TV shows, songs, etc.) via various media applications installed on the electronic device. These media applications provide the electronic device with access to media from corresponding media providers (e.g., a first application corresponding to a first media provider provides the electronic device with access to media from the first media provider, a second application corresponding to a second media provider provides the electronic device with access to media from the second media provider, etc.). The unified media browsing application can optionally be an application that acts as a centralized media navigation application, displaying a representation of the media items available from the various media applications installed on the electronic device to facilitate easy browsing and viewing of those media items by the user of the electronic device.

[0157] exist Figure 6A In this context, the Unified Media Browser application displays the Unified Media Browser user interface 602, which includes a top menu bar containing "Next," "Library," "Shop," and "Search" elements. Selecting different elements in the top menu bar optionally causes the Unified Media Browser application to display a user interface corresponding to the selected menu element. Figure 6A In this context, the "Next" menu element is selected, as indicated by the dashed border. Therefore, the Unified Media Browser application is displaying user interface 602, as described here. In some implementations, the electronic device hides the top menu bar after a menu item is selected (e.g., after a predetermined time). References will follow below. Figures 8A to 8GG Describe other details about the other menu elements in the top menu bar.

[0158] exist Figure 6A In this context, the user interface includes representations 606-1 to 606-6 of media items available from different media providers (e.g., representation 606-1 of media item A available from media provider 3, representation 606-2 of media item B available from media provider 1, etc.). Representation 606 includes information identifying the corresponding media item (e.g., "item A") and the media provider that provides them (e.g., "provider 3"). Figure 6AThe media items displayed may optionally be media items suggested by the electronic device to its user, and determined by the electronic device as suggested media items for various reasons, such as previous user actions associated with the media items and / or the user's previous media viewing activities. For example, the user may have partially watched some media items for them to be included in user interface 602, the user may have favorited some media items for them to be included in user interface 602, the user may have watched previous episodes of a TV series for the current / next episode to be included in user interface 602, etc. Representations 606-5 and 606-6 may optionally correspond to media already recommended to the user of the electronic device by a third party (e.g., a media provider). Figure 6A In the image, 606-5 and 606-6 are partially displayed in the user interface 602.

[0159] Representation 606 is overlaid on a background that includes representative content from a media item, corresponding to representation 606 currently having focus in user interface 602. Specifically, in Figure 6A In the user interface 602, representation 606-2 corresponding to media item B currently has focus (indicated by the dashed box within representation 606-2). Therefore, representation 606 is overlaid on a background including representative content from media item B (in... Figure 6A (As indicated by 610). Representative content may optionally be a still image (e.g., a pre-selected cover image associated with media item B, a still image from the current playback position in media item B, etc.) and / or video (e.g., a video preview of media item B, a video loop from the current playback position in media item B, etc.) corresponding to media item B. Figure 6A The background also includes information 612 corresponding to media item B, since the representation 606-2 corresponding to media item B has the current focus. Information 612 includes an indication of the title of media item B, an indication of the media provider (media provider 1) that provides the media item, an indication of why media item B is included as a suggested media item in user interface 602 (media item B was purchased by the user), and an indication of how much of media item B has been played by the electronic device. Figure 6A A progress bar (e.g., how much of media item B the user has watched), if present. Figure 6A Since media item B has been partially viewed, representation 606-2 also includes an indication (e.g., a progress bar) of how much of media item B the electronic device has played. In some embodiments, the progress indication included in the representation is only included in the representation when the representation has current focus (e.g., if representation 606-2 loses current focus, the electronic device may optionally stop displaying the progress indicator in representation 606-2).

[0160] When a different representation 606 in the user interface 602 gains current focus, the background of the user interface 602 changes accordingly. Moving the current focus indicator within the user interface 602 (e.g., from one representation 606 to another) is accomplished by directional input detected on the remote control device, such as a swipe detected on the touch-sensitive surface of the remote control device. The touch-sensitive surface 604 optionally corresponds to such a remote control device (e.g., the touch-sensitive surface 604 may optionally be included in a multifunction device configured to simulate a dedicated remote control function in the control electronics 500, or the touch-sensitive surface 604 may optionally be included in a dedicated remote control device of the control electronics 500). Devices including the touch-sensitive surface 604 optionally correspond to... Figure 1A Equipment 100 Figure 2 Equipment 100 Figure 3 Equipment 300 and Figure 5A One or more of devices 510 and 511.

[0161] exist Figures 6B to 6D In the process, a swipe of contact 608 from left to right has been detected on the touch-sensitive surface 604. In response, the electronic device moves its current focus from representation 606-2 to representation 606-3, which corresponds to media item C from media provider 2, as shown below. Figure 6D As shown. Therefore, the electronic device replaces the background of the user interface 602 with representative content from media item C, and updates information 612 to correspond to media item C (e.g., including the title of media item C, the indication of media provider 2, and an indication that media item C is a recommended media item because the user of the electronic device has favorited media item C). Information 612 does not include an indication of how much of media item C the user has watched, because the user has not yet started watching media item C (e.g., the electronic device has not yet started playing back media item C).

[0162] exist Figures 6E to 6G In the middle, another swipe from left to right by contact 608 has been detected on the touch-sensitive surface 604. In response, the electronic device similarly moves the current focus from representation 606-3 to representation 606-7, which corresponds to media item G from media provider 3, such as Figure 6G As shown. Therefore, the electronic device replaces the background of the user interface 602 with representative content from media item G, and updates information 612 to correspond to media item G (e.g., including the title of media item G, indication of media provider 3, indication that media item G is a recommended media item because the user of the electronic device has leased media item G, and indication of when the user's access to media item G expires). Figures 6E to 6GIn the middle, a swipe of contact 608 causes the electronic device to scroll past the last representation 606-4 displayed in the user interface 602. Therefore, the electronic device has scrolled to representation 606-7 in user interface 602 and has scrolled out of representation 606-1. Thus, Figures 6E to 6G This row of symbols representing the horizontal scrolling property of 606 is shown in user interface 602.

[0163] exist Figure 6H In the process, a top-to-bottom swipe of contact 608 has been detected on the touch-sensitive surface 604, causing the current focus to be navigated over the bottom edge of the user interface 602. In response, the electronic device scrolls through the user interface 602 to fully display representations 606-5 and 606-6 of recommended media items, and partially displays other representations of trending media items (e.g., popular movies). Figure 6H (in Chinese). As Figure 6H As a result of a top-to-bottom swipe of contact 608 on the touch-sensitive surface 604, the electronic device moves its current focus from representation 606-7 to representation 606-6, such as... Figure 6H As shown. Additionally, in response to a top-down swipe of contact 608, the background of user interface 602 corresponding to one of representations 606-2, 606-3, 606-4, and 606-7 scrolls user interface 602 upwards and outwards according to the amount of downward scrolling achieved by the swipe. With further top-down swipes causing further downward scrolling in user interface 602, the background of the user interface moves further upwards and out of user interface 602. In some embodiments, as the background of user interface 602 moves further upwards, it becomes increasingly blurred and / or transparent.

[0164] exist Figure 6I In the process, another top-to-bottom swipe of contact 608 has been detected on the touch-sensitive surface 604, causing the current focus to be navigated again across the bottom edge of the user interface 602. In response, the electronic device scrolls through the user interface 602 to fully reveal the representations 614-1 to 614-4 of trending media items (e.g., popular movies) in the user interface 602. Figure 6I (in Chinese). As Figure 6I As a result of a top-to-bottom swipe of contact 608 on the touch-sensitive surface 604, the electronic device moves its current focus from representation 606-6 to representation 614-3, which corresponds to media item K from content provider 3, such as... Figure 6HAs shown, and further, the background of user interface 602 is moved upwards and off the display. Indication 614 includes indications of the titles of trending media items (e.g., Item I, Item J, etc.) and indications of the media providers offering these trending media items (e.g., Media Provider 1, Media Provider 2, etc.). Trending media items may optionally differ before detecting touch input for scrolling across the edge of user interface 602 (e.g., as shown in Reference 1). Figure 6A The suggested media items initially displayed in user interface 602 are not selected for inclusion in user interface 602 based on the viewing activity of users of electronic devices. For example, trending media items are media items favored by other viewers, or media items that are otherwise selected by a third party (e.g., selected by the media provider to be included in user interface 602 to promote the media item).

[0165] exist Figures 6J to 6K In the process, another top-to-bottom swipe of contact 608 is detected on the touch-sensitive surface 604, causing the current focus to navigate again over the bottom edge of the user interface 602, and the electronic device further scrolls through the user interface 602 to reveal other representations 614-5 to 614-8 of the trending media items in the user interface 602 (e.g., Figure 6K (Popular TV shows). Furthermore, the electronic device moves the current focus from representation 614-3 to representation 614-7, which corresponds to media item O from media provider 2, such as... Figure 6K As shown, as further input is detected on the touch-sensitive surface 604 as scrolling past the bottom edge of the user interface 602, alternative representations of trending media items may be displayed in the user interface 602.

[0166] As mentioned earlier, electronic devices may optionally present media items as suggested media items (e.g., such as...) for various reasons (e.g., the user has rented the media item, the user has purchased the media item, the user has partially watched the media item, etc.). Figure 6A (As shown). In some implementations, the electronic device suggests a media item because the media item is part of a series of episode media (e.g., a television series, a miniseries, etc.), and the user of the electronic device has already watched previous media items in the series of episode media (e.g., earlier episodes of a television series). For example, in Figure 6L In the electronic device, the user interface 602 includes a representation 606-9 of suggested media item A-2 and a representation 606-10 of suggested media item A-1. Media item A-1 is optionally the first episode in the plot media item set A, and media item A-2 is optionally the second episode in the plot media item set A. The user has purchased and partially watched media item A-1, such as... Figure 6LAs shown in information 612. Because the user has already purchased and / or (at least partially) viewed media item A-1, the electronic device suggests media item A-2 to the user, such as... Figure 6L As shown. Furthermore, the electronic device already does this, even though the user watches media item A-1 through media provider 1, and media item A-2 can be obtained through a different media provider 3 instead of through media provider 1. Figures 6M to 6N In the process, a right-to-left swipe of contact 608 is detected on the touch-sensitive surface 604, which gives a representation 606-9 corresponding to media item A-2 (i.e., the current focus).

[0167] In some implementations, the electronic device prioritizes the display of suggested media items (representation 606) based on the time-related characteristics of those suggested media items. For example, in... Figure 6N In this context, media item A-2 is a new episode of episode media set A, specifically a new episode released today (e.g., the user of the electronic device has the right to view media item A-2 today because media provider 3 provides media item A-2 today). Thus, the electronic device prioritizes displaying representation 606-9 in representation 606, which corresponds to media item A-2. Specifically, the electronic device has placed representation 606-9 at the beginning of the suggested media item list, as shown below. Figure 6N As shown. Over time, the electronic device can optionally deselect the priority display of representation 606-9 within representation 606. For example, in Figure 6O Seven days have passed since media item A-2 was released or became available to the user of the electronic device. Therefore, the electronic device has removed representation 606-9 from the priority display of representation 606 and moved representation 606-9 further back into the list of suggested media items. Simultaneously, the electronic device will display representation 606-11 over representation 606-9, the former corresponding to media item Z, since media item Z was optionally added to the list of suggested media items by the electronic device only recently. It should be understood that, for the purposes of this disclosure, a user has the right to view a media item when subscribed to a media provider that allows the user to view a media item through that media provider, or when the user has purchased, rented, or otherwise accessed a playable copy of the media item (e.g., through a personal media server that includes a copy of the media item or a cloud storage account that has a copy of the media item). When the electronic device is associated with an account entitled to play a media item (e.g., logged into that account), the user (or the electronic device) additionally or alternatively has the right to view the media item.

[0168] As another example of an electronic device that prioritizes the display of suggested media items based on their time-related characteristics (representing 606), in some implementations, the electronic device prioritizes the display of suggested media items based on the length of time the user's access rights to the suggested media items will remain valid (e.g., because the user has rented a media item with a rental expiration date, because the media provider of the media item will cease providing the media item, etc.). For example, in Figure 6P In the list of suggested media items, the electronic device displays representation 606-2 corresponding to media item B as the second item. Furthermore, the user's access to media item B expires after 25 days, as indicated in information 612. Figure 6Q In this scenario, time has passed, and the user's access to media item B will expire in three days. Because this expiration time is shorter than a time threshold (e.g., five days), the electronic device prioritizes displaying display 606-2 in display 606 and displays display 606-2 at the top of the suggested media item list. As an example scenario, when a user first rents a movie, the movie has a high priority in the suggested media display (e.g., placed at the beginning of the "Next" queue), and as time goes on, the movie is gradually de-prioritized (e.g., moved from the beginning of the "Next" queue as other items are added to the "Next" queue based on user activity relative to other items). However, when the movie's rental period is nearing its end (e.g., the movie rental will expire in 3 days), the movie's priority is increased in the suggested media display (e.g., the movie is moved to the beginning of the "Next" queue) to remind the user that the rental is about to expire (e.g., the movie is moved to the beginning of the "Next" queue without any user activity regarding the movie). By prioritizing the display of certain media items based on time considerations, electronic devices can more effectively communicate the availability of media items to users, thus improving the efficiency of conveying this information to users.

[0169] In some implementations, detecting a selection input while the representation of the suggested media item has focus (e.g., on touch-sensitive surface 604) causes the electronic device to play the suggested media item. For example, in Figure 6R In the process, when the representation 606-2 corresponding to media item B from media provider 1 has the current focus, a click on the touch-sensitive surface 451 of the remote control 510 (corresponding to touch-sensitive surface 604 in the remaining figures) is detected. In response, the electronic device launches the media application corresponding to media provider 1 and plays media item B in that media application, such as... Figure 6S As shown. In some implementations, when the electronic device... Figure 6R Switch the unified media browsing application in the corresponding Figure 6SWhen a media application of media provider 1 is used, the navigation hierarchy of the media application (rather than the navigation hierarchy of the unified media browsing application) controls the electronic device's response to a navigation hierarchy change input detected at remote control 510. For example, in Figure 6T In the process, a click on the "Menu" button 516 of the remote control 510 is detected, which corresponds to a backward navigation input within the currently active navigation hierarchy on the electronic device (e.g., as referenced). Figure 5B (as described). In response to a click on the "Menu" button 516, the electronic device navigates backward within the media application corresponding to the media provider 1 (e.g., returns to the main menu of that media application), such as... Figure 6U As shown, instead of navigating back to the unified media browsing application that launched the media application, launching the media application from the unified media browsing application in this manner is optionally a "deep" link to the media application. In some implementations, the request to navigate back from a media item being played in the media application produces different responses based on how the user started playing the media item (e.g., if the user started playing the media item by selecting it within the app, the request to navigate back causes the device to return to the previous screen in the app, but if the user started playing the media item from the content aggregation user interface, the request to navigate back causes the device to return to that content aggregation user interface).

[0170] Contrary to the media's suggestion that electronic devices behave in the 606 situation, as referenced... Figures 6R to 6S As described above, when a trending media item is similarly selected, the electronic device may optionally not immediately begin playing the corresponding trending media item. For example, in Figure 6V In the text, the representation 614-3 corresponding to the trending media item K has the current focus. Figure 6W In the context of the device, when 614-3 has current focus, a click on the touch-sensitive surface 604 is detected. In response, the electronic device does not begin playing media item K, but instead displays a specification page corresponding to media item K. This page includes information 618 about media item K (e.g., genre, director, actors, user ratings, content ratings, length, release year, description, etc.) and information identifying media provider 3 (which media provider offered media item K). The specification page corresponding to media item K also includes a button 616, selecting which causes the electronic device to play media item K in the media application corresponding to media provider 3. The specification page also includes a button 617 for playing trailers / previews of media item K, a button 619 for browsing and selecting media items K and other media providers offering media item K and those offering it, and a button 621 for saving media item K (e.g., thus, adding the media item to...). Figure 6AThe suggested media item (606) is displayed together. Additionally, the specification page includes media items related to media item K (e.g., items AA, BB, CC, DD) (e.g., of the same type) and optional representations of the media items selected to navigate to the specification pages for those media items.

[0171] In some implementations, the electronic device displays representations of suggested media items in user interface 602, even if the media application providing these suggested media items is not installed on the electronic device. For example, in Figure 6Y In this implementation, the electronic device displays representation 606-6 corresponding to media item F as a suggested media item. Media item F is available via media provider 3. However, the media application corresponding to media provider 3 is not installed on the electronic device. The electronic device displays representation 606-6 anyway because displaying this representation allows the user to discover the existence of media item F and provides the user with the opportunity to install a media application to view media item F. In some implementations, representation 606-6 is included in representation 606 based on a previous user action that occurred on a second electronic device different from the electronic device (e.g., the user partially viewed the corresponding suggested media item on the second electronic device but not on the electronic device). In some implementations, user actions regarding media items on other devices cause those media items to be displayed among the suggested media items on the current electronic device because, for example, the suggested media item is associated with a user account that the user is logged into multiple electronic devices, including the current electronic device and the second electronic device.

[0172] exist Figure 6Z In the event that 606-6 has the current focus, a click on the touch-sensitive surface 604 is detected. In response, because the media application corresponding to media provider 3 is not installed on the electronic device, the electronic device displays a prompt 620, such as... Figure 6AA As shown, the prompt indicates that the media application corresponding to media provider 3 is not installed on the electronic device, and provides a button 622 for installing the media application and a button 624 for canceling the installation of the media application. Figure 6BB In the process, a selection of button 622 is detected, which causes the media application corresponding to media provider 3 to be installed on the electronic device. Figure 6CC In the process, after the media application corresponding to media provider 3 has been installed on the electronic device, the electronic device displays a prompt 621 indicating that the media application has been installed and providing a button 626 for authorizing the media application to provide access to its corresponding media (e.g., by providing the media application with login credentials that authenticate the user to media provider 3), and a button 628 for not authorizing the media application to provide access to its corresponding media. Figure 6DDIn the process, the selection of button 626 is detected, which authorizes the media application corresponding to media provider 3 to grant access to media from media provider 3, and in response to this authorization, the electronic device begins playing media item F without further input from the user, such as... Figure 6EE As shown. Therefore, after installation and login or registration via the media application, the electronic device immediately begins playing back the media item within that media application, instead of displaying the media application's navigation or initial startup user interface, such as the media application's home screen. This simplifies the user experience of viewing media items when the media application is first required to be installed. In some implementations, the user of the electronic device may have already shared user-specific information with the unified media browsing application (e.g., settings in the user's account logged in via the electronic device) with a previously authorized media provider 3. In such cases, in response to detection Figure 6Z In the context of option 606-6, the electronic device may optionally automatically install and / or authorize the media application corresponding to media provider 3 without requiring further user input, and begin playing media item F, such as... Figure 6EE As shown.

[0173] Re-reference Figure 6Y and 6Z The selection of one of the representations 606 may optionally cause the electronic device to produce different responses, depending on whether the electronic device has information about the user's current playback position in the media corresponding to the selected representation 606, and / or whether the user has permission to access the media corresponding to the selected representation 606. Specifically, in some embodiments, representation 606 corresponds to a series of episodes media (e.g., a television series with multiple episodes and / or seasons), rather than a specific episode within the series of episodes media. A user of the electronic device may have permission to watch zero, some, or all episodes in such a series, and the electronic device may or may not have information about which episodes in the series the user has already watched (e.g., the user's "current playback position" in the series of episodes media corresponds to the next episode in the series that the user has not yet watched. For example, if the user has already watched episodes 1 and 2, then episode 3 may optionally be the episode in the series where the user is currently playing). The table below summarizes the different responses of the electronic device to the selection of such representation 606.

[0174]

[0175]

[0176] In some implementations, the electronic device has a privacy media browsing mode during which the user's media viewing activity is not tracked and / or media items suggested to the user based on the user's media viewing activity are not displayed by the unified media browsing application in user interface 602. For example, in Figure 6FF In the middle, the electronic device disables private media browsing mode (in Figure 6FF When the suggested media item is displayed (represented by 630), the representation is 606. Figure 6GG In this process, when the privacy media browsing mode of the electronic device is disabled, the electronic device begins playing media item X from media provider 3 (e.g., in response to an input sequence detected on the touch-sensitive surface 604, searching for and playing media item X on the electronic device). After playing media item X, and while the privacy media browsing mode of the electronic device is disabled, the electronic device re-displays the user interface 602 with the suggested media item representation 606 before the playback of media item X has been completed (e.g., in response to an input sequence detected on the touch-sensitive surface 604, opening the unified media browsing application on the electronic device). Figure 6HH As shown, since the user partially viewed media item X, the electronic device includes representation 606-20 of media item X in representation 606 of the suggested media items. Furthermore, because media item X is the most recently added media item to representation 606 by the electronic device, representation 606-20 corresponding to media item X is displayed at the top of the suggested media item list.

[0177] exist Figure 6II In China, the privacy media browsing mode on electronic devices has been enabled (by...). Figure 6II (Instruction 630 in the text). In response, because the electronic device is now in private media browsing mode, the electronic device has stopped displaying the suggested media item representation 606 in the user interface 602, and instead displays the trending media item representation 614. When the electronic device is in private media browsing mode, if the user causes partial playback of a media item (e.g., media item W) on the electronic device, such as... Figure 6JJ As shown, this causes the user interface 602 to redisplay, as... Figure 6L As shown in K, and the private media browsing mode is disabled, such as Figure 6LL As shown, the electronic device will not include media item W as the suggested media item in representation 606, because media item W is played when the electronic device is in private media browsing mode, and when the electronic device is in private media browsing mode, the electronic device may optionally not track the user's media viewing activity.

[0178] Figures 7A to 7LThis is a flowchart illustrating a method 700 for presenting suggested media items (e.g., movies, TV shows, etc.) to a user in a unified media browsing application according to some embodiments of the present disclosure. Method 700 is optionally performed on an electronic device (such as device 100, device 300, or device 500), as described above. Figures 1A to 1B , Figures 2 to 3 and Figures 5A to 5B The operations in method 700 may be optionally combined, and / or the order of some operations may be optionally changed.

[0179] As described below, method 700 provides a way to present suggested media items to a user in a unified media browsing application. This method reduces the cognitive burden on the user when interacting with the device user interface of this disclosure, thereby creating a more efficient human-computer interface. For battery-powered electronic devices, improving the efficiency of user interaction with the user interface saves power and increases the time between battery charging cycles.

[0180] In some implementations, an electronic device (e.g., a set-top box, such as device 100, device 300, or device 500) communicating with a display (e.g., a television, such as display 514) and one or more input devices (e.g., a remote control, such as remote control 510, or a smartphone, such as device 511) displays (702) multiple representations of suggested media items available from different media sources on the electronic device in a user interface on the display (e.g., a media navigation user interface in which the user of the electronic device can browse media available on the electronic device). Figure 6A As shown (e.g., different media items on an electronic device obtained through different media providers and / or different media applications). In some embodiments, the representation of a media item may optionally include content (e.g., video and / or image) from the corresponding media item, and / or text information about the corresponding media item. In some embodiments, the suggested media items include only those that the user of the electronic device has access to, for example, because the user has purchased the media item or because a content provider provides access to the media item through a user subscription. In some embodiments, the multiple representations are overlaid on top of a first representative content (e.g., a hero image or video clip), the first representative content corresponding to the representation of the first media item currently in focus among the suggested media items, such as... Figure 6A As shown (for example, a user of an electronic device may optionally give focus to a media item via one or more navigation inputs provided to one or more input devices). The user interface may optionally display the content representing the media item currently in focus as a background behind a representation of the suggested media, such that when the media item in focus changes, the representative content as the background also changes accordingly, such as... Figure 6A As shown.

[0181] In some implementations, suggested media items are selected for display in the user interface based on different prior user actions associated with them. For example, a user may have partially watched some media items to have them included in the user interface, a user may have favorited some media items to have them included in the user interface, a user may have watched previous episodes of a TV series to have the current / next episode included in the user interface, etc. In some implementations, the prior user action associated with the suggested media item has occurred on the current electronic device, and in some implementations, the prior user action associated with the suggested media item has occurred on a different electronic device (e.g., another electronic device associated with the user that the user is logged into). In some implementations, when an electronic device determines that it will no longer suggest a particular media item to the user, the electronic device stops displaying that media item among the suggested media items. For example, the user has already watched the media item, the media item is no longer available (e.g., the rental has expired), etc.

[0182] In some implementations, when multiple representations of suggested media items are displayed overlaid on a first representative content in the user interface, the electronic device receives (704) input via one or more input devices, the input corresponding to a request to navigate among the multiple representations of the suggested media items, such as... Figures 6B to 6D As shown (e.g., horizontal or vertical scrolling through the representation of suggested media items causes the media item with focus to change). In some embodiments, in response to receiving an input (706) corresponding to a request to navigate among multiple representations of media items: the electronic device converts (708) the representation of a second media item among the multiple suggested media items to have focus instead of the first media item with focus (e.g., scrolling through suggested media items based on changing the scroll input of the media item with focus) and replaces (710) the display of the first representative content with a second representative content corresponding to the second media item, such as Figure 6D As shown (for example, when the media item with focus changes, the background of the user interface also changes to correspond to the newly focused media item). By doing so, the electronic device improves the efficiency with which information about which media item currently has focus is conveyed to the user, thereby improving the user-electronic device interaction.

[0183] In some implementations, the first representative content corresponding to the first media item includes (712) a still image corresponding to the first media item, and the second representative content corresponding to the second media item includes (714) a still image corresponding to the second media item, such as a reference. Figures 6A to 6DThe aforementioned (e.g., a pre-selected cover image corresponding to the first and second media items, a still image corresponding to the beginning of the first and second media items, or a still image corresponding to the current playback position within the partially viewed first and second media items). In some embodiments, the first representative content corresponding to the first media item includes (716) a video corresponding to the first media item, and the second representative content corresponding to the second media item includes (718) a video corresponding to the second media item (e.g., a video preview of the first and second media items (e.g., a trailer), a video loop at the current playback position within the partially viewed first and second media items, etc.). By including such representative content in the background of the unified media browsing user interface, the electronic device improves the efficiency of conveying information about the content of the currently focused media item to the user, thereby improving the user-electronic device interaction.

[0184] In some implementations, after receiving input corresponding to a request for navigation among multiple representations of the suggested media item, the electronic device receives (720) a second input via one or more input devices, the second input corresponding to a request for further navigation among multiple representations of the suggested media item, such as... Figures 6H to 6I As shown (e.g., further horizontal or vertical scrolling through representations of suggested media items). In some embodiments, in response to receiving a second input corresponding to a request for further navigation among multiple representations of suggested media items, the electronic device displays (722) one or more representations of trending media items available on the electronic device in the user interface, such as Figure 6J As shown (e.g., the selection of media items to be included in the user interface is not based on the user's viewing activity on the electronic device). For example, media favored by other viewers or media additionally selected by a third party may optionally be included in the trending media items. In some embodiments, the electronic device only displays media items that the user of the electronic device has access to, for example, because the user has purchased the media item or because a content provider provides access to the media item through a user subscription. In some embodiments, a representation of trending media items is displayed in the user interface only after receiving a second input corresponding to a request for further navigation among a plurality of suggested media items. By allowing the user to scroll through suggested media items to reveal trending media items, the electronic device improves the efficiency of conveying information about media items that the user may be interested in, thereby improving user-electronic device interaction.

[0185] In some implementations, the first media item is included (724) in the proposed media items because the user of the electronic device has selected the first media item to be included in the user interface, such as Figure 6DAs shown (e.g., the user explicitly selects the first media item to include in the user interface). For example, the user has already favorited the first media item via a specification page for the first media item, the user has provided a long press input on the first media item to display a context menu, from which the user adds the first media item to the user's favorite media items (when not on the specification page of the first media item), or the user has provided a voice command to the virtual assistant on the electronic device to "add it to my favorites" (when on the specification page of the first media item) or "add [media item name] to my favorites" (when not on the specification page of the first media item). In some implementations, based on the user's previous viewing activity with media on the electronic device, a second media item, such as (724) is included in the suggested media items. Figure 6A As shown (e.g., instead of including in the suggested media items based on the selection of a second media item). For example, the user of the electronic device has watched previous episodes of a television series, and the second media item is the next episode of that television series, such as... Figure 6L As shown, the user of the electronic device has partially viewed the second media item, such as... Figure 6A As shown, the user of the electronic device has rented / purchased a second media item, such as... Figure 6G As shown, by displaying these media items in a centralized user interface, although users interact in different ways, electronic devices improve the efficiency of conveying information about media items that the user may be interested in, thereby improving user-electronic device interaction.

[0186] In some implementations, the second media item is part of the plot media set (726), such as Figure 6L As shown (e.g., television series, miniseries, etc.). In some embodiments, the plot media collection includes (728) media items provided via a first content provider and a second content provider. In some embodiments, the second media item is provided via a second content provider (730) but not via the first content provider, such as... Figure 6L As shown. In some implementations, a second media item is selected (732) to be included in the suggested media items based on the user's viewing activity with respect to media items provided by a first content provider (but not by a second content provider) within the episode media set, such as Figure 6LAs shown. For example, a user of an electronic device watches a previous media item in a series of episode media provided by a first media provider (e.g., the user watches a previous episode of a TV series via a first media application on the electronic device that provides access to media from the first media provider), and a second media item is included in the user interface as if it were available through a second media provider, since the second media item is not available through the first media provider (e.g., selecting the second media item will provide the second media item for the user to watch via a second media application on the electronic device, instead of via the first media application on the electronic device). Therefore, in some implementations, although the media can be accessed through different media applications, the electronic device provides the user with easy access to the media, thereby improving user-electronic device interaction.

[0187] In some implementations, based on the determination that access to a corresponding media item in the suggested media items will expire within a predetermined time period (e.g., twelve hours, one day, three days, etc.) (e.g., lease expiration, availability expiration via streaming service, etc.), the electronic device prioritizes (734) displaying a representation of the corresponding media item in the representation of the suggested media items based on the impending expiration of access to the corresponding media item. Figure 6Q As shown (e.g., in front of or near the suggested media item list in the user interface). In some implementations, if access to a corresponding media item will not expire within a predetermined time period, the electronic device does not preferentially display the representation of that media item; for example, the corresponding media item may optionally be displayed in the suggested media item list, but outside the beginning of the list (e.g., the position of the representation of a second media item in the suggested media item list is selected based on the upcoming expiration of access to a second media item), such as... Figure 6P As shown.

[0188] In some implementations, if the electronic device determines that the corresponding media item in the suggested media item is a new episode (e.g., a newly released episode of a TV series, miniseries, etc.) in a plot media set that the user of the electronic device has been watching (e.g., the user has watched one or more previous episodes of that plot media set), and the user has not yet watched that new episode, then the electronic device prioritizes (736) displaying a representation of the corresponding media item in the representation of the suggested media item based on the recentity of the user's access to the corresponding media item, such as... Figure 6NThis can be shown (e.g., at the beginning or near the suggested media items list in the user interface). If the user has already viewed a particular media item, it may optionally not be displayed in a priority area of ​​the user interface; for example, it may be displayed in the suggested media items list, but if the user has partially viewed it, it may be displayed outside the beginning of the list, or if the user has finished viewing it, it may not be displayed at all. For example, the position of a second media item's representation in the suggested media items list may be chosen based on how recently the user has become entitled to access it (e.g., because the episode was just released on a content provider to which the user has a valid subscription). By prioritizing the display of certain media items based on time considerations, electronic devices more effectively communicate the availability of media items to the user, thus improving the efficiency of conveying this information to the user.

[0189] In some implementations, based on the determination (738) that the user of the electronic device has partially viewed the first media item, the first representative content corresponding to the first media item includes a visual indicator of the playback progress of the first media item, such as... Figure 6A As shown. In some embodiments, based on the determination (740) that the user of the electronic device has partially viewed the second media item, the second representative content corresponding to the second media item includes a visual indicator of the playback progress of the second media item (e.g., if the user has partially viewed the media item with the current focus, the background of the user interface includes a progress bar or other indicator indicating how much of the media the user has viewed). If the user has not partially viewed the media item with the current focus, the background may optionally not include such an indicator, such as... Figure 6D As shown. By including such indicators in the background of the user interface, electronic devices can more effectively convey media item information to the user, thereby improving the efficiency of conveying this information to the user.

[0190] In some implementations, the first representative content corresponding to the first media item includes (742) information indicating why the first media item is included in the proposed media item, and the second representative content corresponding to the second media item includes (744) information indicating why the second media item is included in the proposed media item, such as... Figures 6A to 6GThe background may optionally display information about why the media item currently in focus is included in the suggested content by the electronic device. For example, the background may optionally indicate that the user has favorited the media item, partially watched the media item, watched other media related to the media item, etc. For example, for partially watched media items, the information includes "Continue" and optionally includes playback progress information. For favorited media items, the information includes "Favorited" and optionally total playback time. For purchased media items, the information includes "Purchased" and optionally includes total playback time. For rented media items, the information includes "Rented" and optionally includes total playback time, rental expiration date (e.g., expiring in 20 days), and / or playback progress information. For purchased media items, the information includes "Purchased" and optionally includes total playback time. For media items corresponding to the next episode in the episode's media collection, the information includes "Next Episode" and optionally includes an indication of the media item's position in the episode's media collection (e.g., Season 5, Episode 2). For a media item corresponding to a newly offered episode in the episode's media collection, the information includes "New Episode" and optionally, an indication of the media item's position in the episode's media collection (e.g., Season 5, Episode 2). For a media item corresponding to a media item that will be removed from the subscription service, the information includes "Expiring Soon" and optionally, an indication of when the media item will be removed from the subscription service (available until October 30th). For a media item corresponding to an unavailable next episode in the episode's media collection that the user has not purchased or subscribed to, the information includes "Next Episode" and an indication that the user is not authorized to play the media item (e.g., purchased or subscribed). By including such information in the background of the user interface, electronic devices more effectively communicate media item information to users, thereby improving the efficiency of conveying such information to users.

[0191] In some implementations, the first representative content corresponding to the first media item includes (746) information indicating the source of the first media item, and the second representative content corresponding to the second media item includes (748) information indicating the source of the second media item, such as... Figures 6A to 6G As shown (for example, the background may optionally display information about the source of the media item currently in focus). For example, the background may optionally include the logo of a television channel that provides the media item, an icon of a media application that can be used to obtain the media, etc. By including such information in the background of the user interface, electronic devices more effectively convey media item information to the user, thereby improving the efficiency of conveying this information to the user.

[0192] In some implementations, the electronic device receives (750) input via one or more input devices corresponding to the selection of a corresponding representation of a respective media item in the suggested media items, such as Figure 6RAs shown (e.g., a click on a button on an input device when the corresponding representation has focus). In some embodiments, in response to receiving input (752) corresponding to a selection of a corresponding representation of a corresponding media item, the electronic device launches (754) a media application on the electronic device corresponding to that corresponding media item (e.g., an application different from the application in which the media item is displayed, or the same application as the application in which the media item is displayed), such as Figure 6S As shown. In some embodiments, the electronic device causes (756) to play back (756) the corresponding media item in the media application corresponding to the corresponding media item on the display, such as Figure 6S As shown.

[0193] In some implementations, the input corresponding to a request to navigate among a plurality of suggested media items corresponds to (758) a request to navigate among the plurality of suggested media items in a first direction, such as Figures 6B to 6D As shown (e.g., input includes horizontal right / left scroll input). In some embodiments, the electronic device receives (760) a second input via one or more input devices corresponding to a request for further navigation among a plurality of suggested media items in a second direction different from the first direction, such as Figures 6H to 6I As shown (e.g., the second input includes a vertical right / left scroll input). In some embodiments, in response to receiving a second input corresponding to a request for further navigation among a plurality of suggested media items, the electronic device displays (762) in the user interface one or more representations of additional suggested media items available on the electronic device, wherein the representations of said additional suggested media items (e.g., items not in the "next" queue) are displayed in the user interface only after the second input is received, such as Figures 6H to 6I As shown (e.g., scrolling past the originally suggested media item results in the display of additional suggested media items). In some examples, these media items are not selected based on previous user actions associated with them. In some implementations, additional suggested media items include trending media items (media items favored by other viewers), media items selected for advertising by content providers or other third parties, etc. In some implementations, the electronic device receives (764) input via one or more input devices corresponding to the selection of a second corresponding representation of a second corresponding media item among the additional suggested media items, such as... Figure 6W As shown (e.g., a click on a button on an input device when the corresponding representation has focus). In some embodiments, in response to receiving input corresponding to a selection of a second corresponding representation of a second corresponding media item, the electronic device displays (766) a media information page corresponding to the second corresponding media item on a display, such as Figure 6XAs shown (e.g., optionally as a user interface for a dedicated specification page for the second corresponding media item). For example, the specification page includes information about the second corresponding media item and a selectable power indication, which, when selected, causes the second corresponding media item to be played on the electronic device.

[0194] In some implementations, when a media application corresponding to a particular media item is displayed on the screen, the electronic device receives (768) input via one or more input devices corresponding to a request for backward navigation on the electronic device, such as... Figure 6T As shown (e.g., selection of button 516 on remote control 510, input corresponding to an input for moving backward in a navigation hierarchy, etc.). In some embodiments, in response to receiving an input corresponding to a request for backward navigation on the electronic device, the electronic device navigates backward (770) within a media application based on that input, such as... Figure 6U As shown (for example, a link to a media application is a "deep" link, such that when a user enters the media application to play a corresponding media item, the navigation hierarchy of the media application controls the electronic device's response to navigation input detected at the input device). However, in some embodiments, backward navigation input received within the media application navigates back to the user interface displaying a representation of the suggested media item, rather than navigating backward within the media application.

[0195] In some implementations, based on a previous user action that occurred on a second electronic device different from the electronic device, the corresponding suggested media item is included (772) in the suggested media item, such as Figure 6Y As shown (e.g., the user partially viewed the suggested media item on a second electronic device instead of the current electronic device). In some embodiments, user actions on other devices regarding media items cause those media items to be displayed among the suggested media items on the current electronic device because (e.g.) the suggested media item is associated with a user account that the user is logged into multiple electronic devices, including the current electronic device and the second electronic device. In some embodiments, no media application (774) is installed on the electronic device to provide the corresponding suggested media items, such as... Figure 6Y As shown (e.g., a corresponding suggested media item is displayed as a suggested media item on an electronic device, even if no media application for viewing that corresponding suggested media item is installed on that electronic device). In some embodiments, a corresponding media application used to provide the corresponding suggested media item may be installed on a second electronic device. Displaying the corresponding suggested media item allows the user to discover its existence and provides the user with the opportunity to install a media application to view the corresponding suggested media item, thereby improving user-electronic device interaction.

[0196] In some implementations, the electronic device receives (776) input via one or more input devices corresponding to the selection of a corresponding representation of the suggested media item, such as Figure 6Z As shown (e.g., a click on a button on an input device when the corresponding representation has focus). In some embodiments, in response to receiving input corresponding to a selection of a corresponding representation of a suggested media item, the electronic device displays a prompt on the display to install the corresponding media application on the electronic device, such as... Figure 6AA As shown (for example, because no media application for viewing the corresponding media item is installed on the electronic device, the user is prompted to install a media application for viewing the corresponding media item when selecting the corresponding media item for playback).

[0197] In some implementations, the electronic device receives (778) an input sequence via one or more input devices corresponding to inputs that have been installed on the electronic device and that have authorized the corresponding media application on the electronic device, such as... Figures 6BB to 6DD As shown (e.g., the user installs and logs in to a media application or registers for services provided by the media application). In some implementations, after the corresponding media application is installed and authorized on the electronic device, the electronic device begins to play back (780) the corresponding media item on the display without further user intervention, such as Figure 6EE As shown (for example, after installation and login or registration via a media application, the electronic device immediately begins playing media items within that media application, rather than displaying the media application's navigation or initial startup user interface, such as the media application's home screen). Therefore, after installing and authorizing the corresponding media application, optional further user action is not required before the corresponding media item is played on the electronic device. This result simplifies the user experience of viewing media items when the media application is first required to be installed, thereby improving user-electronic device interaction.

[0198] In some implementations, the electronic device receives (782) input via one or more input devices corresponding to a first action regarding a respective media item not included in the suggested media item, such as Figure 6GG As shown (e.g., the user partially views the corresponding media item, the user favorites the corresponding media item, etc.). In some embodiments, after receiving input corresponding to a first action about the corresponding media item, the electronic device displays (784) a user interface on the display that includes multiple representations of suggested media items (e.g., after taking a first action about the corresponding media item, the user redisplays the media navigation user interface of the media browsing application), the multiple representations of suggested media items including representations of the corresponding media item, such as... Figure 6HHAs shown (for example, a media item becomes a suggested media item due to a user's action on that media item).

[0199] In some implementations, when the user interface is displayed on a monitor, the electronic device receives (786) input via one or more input devices to enable a privacy media browsing mode on the electronic device, such as... Figure 6II As shown (e.g., selecting the privacy browsing mode switch in the settings of a media browsing application). In some implementations, in response to receiving input (788) to enable privacy media browsing mode on the electronic device, the electronic device enables (790) privacy media browsing mode on the electronic device and replaces (792) multiple representations of suggested media items in the user interface with a second plurality of representations of second suggested media items that were not selected to be included in the user interface based on previous user actions associated with these media items, such as... Figure 6II As shown. For example, in a private media browsing mode, the electronic device may optionally not provide the user with recommended media items selected and / or specific to the user based on the user's media viewing activity. Instead, the electronic device provides recommended media items that are popular with other viewers (e.g., trending media items), or media items otherwise selected by a third party, such as... Figure 6II As shown.

[0200] In some implementations, when a privacy media browsing mode is enabled on an electronic device, the electronic device receives (794) a second input via one or more input devices corresponding to a first action regarding a second corresponding media item not included in the suggested media items, such as Figure 6JJ As shown (e.g., the user partially views the second corresponding media item, the user favorites the second corresponding media item, etc.). In some implementations, after receiving the second input, the electronic device receives (796) input via one or more input devices to disable the privacy media browsing mode on the electronic device, such as... Figure 6LL As shown. In some implementations, in response to receiving input (798) to disable the privacy media browsing mode on the electronic device, the electronic device disables (798-2) the privacy media browsing mode on the electronic device and redisplays (798-4) multiple representations of suggested media items in the user interface, the multiple representations of suggested media items excluding a representation of a second corresponding media item, such as Figure 6LL As shown (when the electronic device is in privacy media browsing mode, the electronic device may optionally not track the user's media viewing actions). For example, even if the user has taken an action regarding a second corresponding media item, an action that would normally result in the second corresponding media item being included in the suggested media items in the media browsing application, the electronic device will not include the second corresponding media item in the suggested media items because the user took the action while the electronic device was in privacy media browsing mode.

[0201] In some implementations, when a privacy media browsing mode is enabled on an electronic device, the electronic device receives (798-6) input via one or more input devices to disable the privacy media browsing mode on the electronic device, such as... Figure 6LL As shown (e.g., deselecting the privacy browsing mode switch in the settings of a media browsing application). In some implementations, in response to receiving input to disable the privacy media browsing mode on the electronic device (798-8), the electronic device disables (798-10) the privacy media browsing mode on the electronic device and redisplays (798-12) multiple representations of suggested media items in the user interface, such as Figure 6LL As shown (for example, when the privacy media browsing mode is disabled, the electronic device may optionally revert to displaying suggested media items to the user based on the user's media viewing activity selections and / or user-specific suggestions). This privacy media browsing feature of the electronic device allows users to browse and view media items on the electronic device without the electronic device tracking these activities unintentionally, thereby improving user-electronic device interaction.

[0202] It should be understood that, Figures 7A to 7L The specific order in which the operations described herein are presented is merely exemplary and is not intended to indicate that the described order is the only possible order in which these operations can be performed. Those skilled in the art will conceive of various ways to reorder the operations described herein. Furthermore, it should be noted that the details of other processes described herein in conjunction with other methods (e.g., methods 900, 1100, 1300, and 1900) are similarly applicable to the above-described combinations. Figures 7A to 7L The method 700. For example, the unified media browsing application and user interface, suggested media items, trending media items, media applications, representations of suggested and trending media items, and media providers described above with reference to method 700 may optionally have one or more of the features of the unified media browsing application and user interface, suggested media items, trending media items, representations of suggested and trending media items, and media providers described herein with reference to other methods described herein (e.g., methods 900, 1100, 1300, and 1900). For the sake of brevity, these details will not be repeated here.

[0203] The operations in the above information processing method can optionally be implemented by running one or more functional modules in an information processing device, such as a general-purpose processor (e.g., as described above). Figure 1A , Figure 3 , Figure 5A and Figure 14 (as described above) or application-specific chips. Furthermore, the above references... Figures 7A to 7L The operation is optionally performed by Figures 1A to 1BThe components depicted herein are used for implementation. For example, display operation 702, receive operation 704, conversion operation 708, and replacement operation 710 are optionally implemented by event classifier 170, event recognizer 180, and event handler 190. Event monitor 171 in event classifier 170 detects contact on touch-sensitive surface 604, and event dispatcher module 174 transmits event information to application 136-1. The corresponding event recognizer 180 of application 136-1 compares the event information with the corresponding event definition 186 and determines whether a first contact at a first location on the touch-sensitive surface corresponds to a predefined event or sub-event, such as a selection of an object on the user interface. When a corresponding predefined event or sub-event is detected, event recognizer 180 activates the event handler 190 associated with the detection of that event or sub-event. Event handler 190 optionally utilizes or invokes data updater 176 or object updater 177 to update the application's internal state 192. In some embodiments, event handler 190 accesses the corresponding GUI updater 178 to update the content displayed by the application. Similarly, those skilled in the art will clearly understand how this can be done based on... Figures 1A to 1B The components depicted in the diagram are used to perform other processes.

[0204] Category-based media browsing

[0205] Users interact with electronic devices in a variety of different ways, including interacting with media (e.g., music, movies, etc.) that are available (e.g., stored or otherwise accessible) on the electronic device (e.g., as referenced). Figures 6A to 6LL , Figures 8A to 8GG , Figures 10A to 10Z , Figures 12A to 12V and / or Figures 18A to 18J (As described above). For example, a user can browse and play media accessible on an electronic device. The user may wish to browse such media by category (e.g., movies, TV shows, etc.). The embodiments described below provide ways for electronic devices to facilitate browsing media items by category, thereby enhancing user interaction with the electronic device. Enhanced interaction with the device reduces the amount of time required for the user to perform actions, thereby reducing the device's power consumption and extending the battery life of battery-powered devices. It should be understood that people use devices. When a person uses a device, that person is optionally referred to as the user of the device.

[0206] Figures 8A to 8GG The accompanying drawings illustrate exemplary ways in which electronic devices, according to some embodiments of the present disclosure, facilitate browsing media items by category. The embodiments in these drawings are used to illustrate the processes described below, including references to... Figures 9A to 9H The process described.

[0207] Figure 8AAn exemplary display 514 is shown. Display 514 optionally displays one or more user interfaces including various content. Figure 8A In the example shown, display 514 displays on an electronic device (e.g., Figure 5A Unified Media Browser applications running on electronic devices (e.g., as referenced) Figures 6A to 6LL The unified media browsing application (as described above), display 514 is part of the electronic device, or display 514 is connected to the electronic device. Figure 8A In the unified media browsing application, a unified media browsing user interface 802 is displayed for browsing various media accessible on electronic devices. User interface 802 includes optional user interface elements 804-1 to 804-4 in a top menu bar, which are used for navigation within the unified media browsing application, and will be described in more detail below. Additionally, as referenced... Figures 6A to 6LL In some embodiments, the electronic device stops displaying the top menu bar after one of the user interface elements 804 is selected (e.g., within a predetermined time after selection). Figure 8A In the image, the user interface element 804-1 corresponding to the suggested media item is currently selected (indicated by the dashed border), and the electronic device is displaying representations 806-1 to 806-6 of the suggested media items and representations 815-1 to 815-4 of the trending media items (e.g., as shown in the reference). Figures 6A to 6LL The suggested media items and trending media items), and the representation 815-3 corresponding to media item K has the current focus (indicated by the dashed box within representation 815-3). Figure 8A In this embodiment, it is suggested that the representation of media items 806 and the representation of trending media items 815 be displayed in a row. In some implementations, the electronic device only displays the representations 806 and 815 of media items that the user of the electronic device has the right to access (e.g., the user has a subscription to a media provider that provides access to media items to the electronic device, the user has purchased media items, etc.), and does not display the representations of media items that the user of the electronic device does not have the right to access.

[0208] In some implementation schemes, selection Figure 8A The representation of trending media items causes electronic devices to display the specification page corresponding to that trending media item. For example, in Figure 8B In the context of media item K, when representation 815-3 has the current focus, a click on the touch-sensitive surface 604 is detected. In response, the electronic display shows the specification page corresponding to media item K, such as... Figure 8C As shown, this page includes, as referenced Figure 6X The various information and user interface objects described above. The specification page corresponding to media item K also includes button 808, selecting which will cause the electronic device to play media item K, such as... Figures 8C to 8D As shown.

[0209] In some implementations, users of the electronic device can scroll through a representation 815 of trending media items to reveal user interface elements in user interface 802 for browsing media items by category. For example, in Figures 8E to 8H In this process, a top-to-bottom swipe of contact 608 is detected on the touch-sensitive surface 604. In response, the electronic device scrolls through a representation 815 of trending media items to reveal additional trending media items (e.g., popular TV shows) in the user interface 802, ultimately displaying user interface elements 812-1 to 812-4 corresponding to categories of suggested media available on the electronic device. For example, user interface element 812 includes user interface element 812-1 corresponding to movies, user interface element 812-2 corresponding to TV shows, user interface element 812-3 corresponding to news programs, and user interface element 812-4 corresponding to sports programs. Figure 8H As shown, the user interface element 812 corresponding to the media category is displayed in a row, similar to the display method of the suggested media item representation 806.

[0210] Selecting one of the user interface elements 812 causes the electronic device to display media items of the selected category that can be evaluated by the electronic device. For example, in Figure 8I In the context of the movie user interface element 812-1 having current focus, a click on the touch-sensitive surface 604 is detected. In response, the electronic device replaces the display of the trending media item representation 815 and the media category user interface element 812 with representations 814-1 to 814-12 of the media items in the movie category, as shown below. Figure 8J As shown. In some embodiments, the representation 814 of media items in the movie category is displayed using the same spatial arrangement as the representation 815 of trending media items and / or the user interface element 812 of media categories (e.g., rows). Additionally, in Figure 8J The text indicates that the media item in 814 can optionally differ from that in... Figures 8E to 8G The display shows media items representing 806 and / or 815, ensuring that the same media item is not displayed multiple times when a user browses media in the unified media browse application. For example... Figure 8J As shown, in some implementations, film media item 814 is displayed in groups based on one or more shared features (e.g., awards, popularity, high ratings, etc.).

[0211] Similar to a reference Figures 8E to 8H The user can scroll through the representation 814 of media items in the selected category to reveal user interface elements in the user interface 802 for browsing media items by subcategory of the selected category. For example, in Figures 8K to 8LIn the process, a top-to-bottom swipe of contact 608 is detected on the touch-sensitive surface 604. In response, the electronic device scrolls through the representation 814 of the media item in the movie category to reveal user interface elements 816-1 to 816-4 in the user interface 802 corresponding to the subcategories of movie media available on the electronic device. For example, user interface element 816 includes user interface element 816-1 corresponding to a drama film, user interface element 816-2 corresponding to a comedy film, user interface element 816-3 corresponding to a suspense film, and user interface element 816-4 corresponding to an action film. Figure 8L As shown, the user interface elements 816 corresponding to the media subcategories are displayed in rows, similar to the display of suggested media items 806, trending media items 815, and movie media items 814. Additionally, similar to the above, selecting one of the user interface elements 816 causes the electronic device to display media items of the selected subcategories that can be evaluated by the electronic device (e.g., similar to the reference). Figures 8I to 8J The above).

[0212] In some implementations, a user can scroll past a representation 806 of suggested media items, a representation 815 of trending media items, and a user interface element 812 for browsing media items by category to reveal additional representations of suggested media items grouped by category in the user interface 802 (e.g., categories different from those represented by user interface element 812). For example, in Figures 8M to 8P In the process, a top-to-bottom swipe of contact 608 is detected on the touch-sensitive surface 604. In response, the electronic device scrolls through the media item representation 806, the trending media item representation 815, and the user interface element 812 to display the user-suggested music and video trending media item representations 818-1 to 818-4 in the user interface 802. Figure 8P As shown, the representation 818 corresponding to music video media items is displayed in rows, similar to the display of the suggested media item representation 806, the trending media item representation 815, and the user interface element 812 corresponding to the media category. Additionally, similar to the above, selecting one of the representations 818 causes the electronic device to display the specification page corresponding to the selected media item (e.g., similar to the reference). Figures 8B to 8C (as stated). In Figure 8Q In the process, another top-to-bottom swipe of contact 608 is detected on the touch-sensitive surface 604 to reveal additional trending media items, which are in the documentary category of the media items, similar to those described above. The additional trending media items may optionally be accessed via the user interface 802 in response to further scrolling.

[0213] As described above, in some cases, the electronic device displays a media category user interface element 812 for a given media category, through which media items in that media category can be browsed (e.g., user interface element 812-1 for browsing movies), and in other cases, the media category user interface element 812 for a given media category is not displayed (e.g., instead, the electronic device displays a representation of the media items in the given media category as a row in the user interface 802 without first requiring selection of the media category user interface element 812 for browsing media items in that category). Figures 8P to 8Q The representation of music video and documentary media items (818) in the media category. In some implementations, if a sufficient number (e.g., more than three, five, or ten) of suggested media items are in a given media category, the electronic device displays the media category user interface element 812 for that media category; otherwise, the electronic device displays the representation of those media items directly in the user interface 802 without grouping the suggested media items after the corresponding user interface element 812. For example, in Figure 8R In this context, three suggested media items are included in the "Sports" media category. Because three media items are below the threshold number of media items used to create the user interface element 812 for the "Sports" category (e.g., four media items), the electronic device does not display the "Sports" user interface element 812. Instead, it displays the representations 818-9 to 818-11 of the sports media items in a single line in the user interface 802, as shown below. Figure 8R As shown. However, if the "Sports" category includes four suggested media items, such as Figure 8S As shown, the electronic device displays user interface element 812-4 corresponding to the "Sports" category, and does not display the sports media item in a single line of the user interface 802, as shown. Figure 8T As shown.

[0214] In some implementations, the electronic device has the ability to enforce media restrictions (e.g., user-set) to limit access to media with specific content ratings (e.g., R-rated, PG-13, etc.). When such media restrictions are in effect, the electronic device can optionally omit the restricted media items from its suggested and / or trending media items. For example, in Figure 8U In this case, no media restrictions are in effect (as indicated by 820), and the electronic device displays a representation of trending media items 815 in the user interface 802. Figure 8V In this context, media restrictions have been established, limiting user access to media rated PG-13 or lower (represented by 820). Therefore, the electronic device no longer displays the suggested media item representations 815-2 and 815-5 in the user interface 802, which correspond to media items with an R rating.

[0215] exist Figure 8W In the process, input has been detected that the user interface element 804-2 corresponding to the media library has been selected. Therefore, the electronic device displays representations 822-1 to 822-8 of the media items in the media library in the user interface 802. The media library optionally includes media items that the user of the electronic device has selected to include in the media library, for example, by purchasing media items, by renting media items, or by adding media items to their favorites. Figure 8W As shown. The media library is optionally associated with... Figure 8A The suggested media items are a collection of different media items, because the media library may or may not include suggested media items due to explicit user actions relative to those media items, as previously described. When the media library user interface element 804-2 is selected, the user interface 802 also includes a selectable power representation 824 for sorting media items in the media library based on various features such as title, date the item was added to the media library, type of media item (e.g., movie, TV show, etc.), and content rating.

[0216] exist Figure 8X In the process, input to select user interface element 804-3 is detected. This user interface element corresponds to a media application that is not installed on the electronic device and provides access to media on the electronic device. Therefore, the electronic device displays representations 826-1 to 826-4 of media applications that are not installed on the electronic device. For example, media application A, which provides access to media from media provider 1, is not installed on the electronic device; therefore, the electronic device displays representation 826-1 corresponding to media application A, which provides access to media from media provider 1 in user interface 802 when user interface element 804-3 is selected. The electronic device similarly displays representations 826-2 to 826-4 of media applications that are not installed on the electronic device. As shown in 828, the user of the electronic device has the right to access media through media providers 1, 3, and 4. Thus, some representations 826 correspond to media applications that grant the user the right to access media (e.g., media applications A and C), and some representations 826 correspond to media applications that do not grant the user the right to access media (e.g., media applications B-1 and B-2).

[0217] The electronic device also displays representations 830-1 and 830-2 corresponding to media subscriptions available to the user of the electronic device. For example, representation 830-1 corresponds to a media subscription of media provider 4, and representation 830-2 corresponds to a media subscription of media provider 5. Each representation 830 includes visual indications (e.g., images, videos) of the corresponding subscribed media available to the user of the electronic device (e.g., visual indications D-1 and D-2 in representation 830-1, and visual indications E-1 and E-2 in representation 830-2). These visual indications may optionally be pre-selected cover art or images for those subscribed media and / or video previews for those subscribed media. In this way, the electronic device provides the user with easily visible information about the media that the user can access. Representation 826 can be selected to install a corresponding media application on the electronic device, and representation 830 can be selected to subscribe to the corresponding media subscription on the electronic device.

[0218] In some implementations, the electronic device will not display representations of applications that grant the user of the electronic device access to media (e.g., due to a subscription to a media provider corresponding to those applications), even if those media applications are not installed on the electronic device. For example, in Figure 8Y In this context, the user has the right to access media through media providers 1, 3, and 4. Therefore, the electronic device does not display representations 826-1 and 826-4, which correspond to the applications of the media providers that the user already has the right to access, and does not display representation 830-1, which corresponds to the media subscription that the user already has with media provider 4.

[0219] In some implementations, media from a given media provider can be accessed through multiple media applications. For example, in Figure 8Y In this configuration, both media applications B-1 and B-2 can provide access to the media of media provider 2. For example, media provider 2 can have a first application and a second application, the first application providing access to its media based on a user's subscription to a cable television company (e.g., indirectly subscribing to media provider 2 via a user's subscription to the cable television company or another similar entity with an arrangement to provide media from media provider 2 to its customers), and the second application providing access to its media based on a user's direct subscription to media provider 2. In this case, once the user has installed one of the media applications B-1 and B-2, the electronic device can optionally stop displaying a representation of the other media application in the user interface 802. For example, in... Figure 8ZIn the event that the display 826-2, corresponding to media application B-1, has a front focus, a click on the touch-sensitive surface 604 is detected. In response, the electronic device downloads and / or installs media application B-1, and stops the display of display 826-2 and display 826-3, which correspond to media application B-2, as shown below. Figure 8AA As shown.

[0220] exist Figure 8BB Input is detected in the user interface element 804-4, which is used by the electronic device to search for accessible media. Therefore, the electronic device displays a search interface on the display 514. This search interface includes a search field 836 for providing search criteria and displays representations 834-1 to 834-4 of the media items generated by the search. As shown in 828, the user has access to media from media providers 1, 3, and 4. Furthermore, the search interface includes user-configurable options for searching all media accessible to the electronic device, or only searching for those media accessible to the electronic device that the user has access to. Figure 8BB In this context, the search is not limited to media that the user of the electronic device has the right to access (as indicated by 832). Therefore, in response to the search term "comedy" entered into search field 836, the electronic device displays search results for media items that can be accessed through media providers 1, 2, and 3, even if the user does not have the right to access the media through media provider 2.

[0221] However, in some implementations, the electronic device searches for media items that the user has the right to access, but not those that the user does not have the right to access. For example, in Figure 8CC In this context, the search is limited to media that the user of the electronic device has the right to access (as indicated by 832). Therefore, in response to the "comedy" search condition entered into the search field 836, the electronic device only displays representations 834-1 and 834-3 corresponding to media items from media providers 1 and 3, but does not display representations 834-2 and 834-4 corresponding to media items from media provider 2.

[0222] In some implementations, media restrictions based on content ratings that limit media playback can take effect while the electronic device is performing a media item search. For example, in Figure 8DD In this context, media restrictions effectively limit playback to media with a PG-13 rating or lower (represented by 820). However, in some implementations, the electronic device performs a search and displays representation 834 generated by the search, regardless of the in effect media restrictions. For example, in... Figure 8DDIn the search results, the electronic device displays representations 834-1 and 834-4, even though these representations correspond to media items with an R rating. However, selecting these representations will not result in playback of those media items, while selecting the search result representation corresponding to a media item allowed by the media restrictions will result in playback of those media items. For example, in Figure 8EE In the event that the representation 834-1 corresponding to media item A in R-level has a front focus, a click on the touch-sensitive surface 604 is detected. In response, instead of playing media item A, the electronic device displays a visual indication that media item A is subject to media restrictions, such as... Figure 8FF As shown. In some implementations, if the search is limited to authorized media (by...) Figure 8GG If the 832 instruction is specified, the electronic device will not display search results for media that the user of the electronic device does not have permission to view, such as... Figure 8GG As shown.

[0223] Figures 9A to 9I This is a flowchart illustrating a method 900 for facilitating browsing of media items by category according to some embodiments of this disclosure. Method 900 can optionally be implemented in electronic devices such as device 100, device 300, or device 500 (as referenced above). Figures 1A to 1B , Figures 2 to 3 as well as Figures 5A to 5B The operation is performed at (as described above). Some operations in method 900 may be optionally combined, and / or the order of some operations may be optionally changed.

[0224] As described below, method 900 provides a way to facilitate browsing media items by category. This method reduces the cognitive burden on users when interacting with the device user interface of this disclosure, thereby creating a more efficient human-computer interface. For battery-powered electronic devices, improving the efficiency of user interaction with the user interface saves power and increases the time between battery charging cycles.

[0225] In some implementations, an electronic device (e.g., a set-top box, such as device 100, device 300, or device 500) communicating with a display (e.g., a television, such as display 514) and one or more input devices (e.g., a remote control, such as remote control 510, or a smartphone, such as device 511) receives (902) a request via one or more input devices for a user-suggested media item displayed on the display as an electronic device, such as... Figure 8AThis is illustrated as (e.g., a request to launch and display a unified media browsing application on an electronic device, which displays media available on the electronic device from different media providers and / or different media applications, such as those described in method 700). In some embodiments, the media displayed by the electronic device is media that the electronic device determines the user would be interested in based on the user's previous media viewing actions. In some embodiments, in response to receiving a request to display suggested media items, the electronic device displays (904) (e.g., within a media browsing application running on the electronic device, which differs from applications on the electronic device corresponding to media providers and providing media from those content providers) a first plurality of representations of suggested media items in a media navigation user interface on the display, such as Figure 8A As shown (e.g., a representation of each media item suggested). In some embodiments, the representation includes images and / or videos from the suggested media, and / or text information about the suggested media. In some embodiments, the representation is displayed in rows in the media navigation user interface. In some embodiments, the representation can be selected to play the corresponding media item and / or display additional information about the corresponding media item, such as... Figures 8B to 8D As shown.

[0226] In some implementations, when the first plurality of representations of suggested media items are displayed, the electronic device receives (906) navigation input via one or more input devices, corresponding to a request to scroll through the first plurality of representations of suggested media items, such as Figures 8E to 8H As shown (e.g., a swipe input detected on the touch-sensitive surface of one or more input devices, used to move the current focus from one representation to another based on the magnitude and / or direction of the swipe input). In some embodiments, in response to receiving the navigation input, the electronic device scrolls (908) through a first plurality of representations of suggested media items to reveal a plurality of media category user interface elements corresponding to the media category of the suggested media in the media navigation user interface, wherein, prior to receiving the navigation input, a plurality of representations of media items are displayed without displaying the media category user interface elements, such as Figures 8E to 8H This is illustrated in the following ways: (e.g., user interface elements corresponding to TV programs, user interface elements corresponding to movies, user interface elements corresponding to children's content, user interface elements corresponding to an editable collection of content, etc.). In some implementations, user interface elements corresponding to media categories are displayed in the media navigation user interface with the same spatial layout as those corresponding to the suggested media (e.g., as visual blocks in a visual block row).

[0227] In some implementations, when a media category user interface element is displayed, the electronic device receives (910) input via one or more input devices to select the corresponding media category user interface element among the plurality of media category user interfaces, such as Figure 8I As shown (e.g., a click or tap is detected on the touch-sensitive surface of one or more input devices while the corresponding user interface element is currently selected), the corresponding media category user interface element corresponds to the corresponding category of media within a media category. In some embodiments, in response to receiving input selecting the corresponding user interface element, the electronic device replaces (912) the first plurality of representations of the suggested media item and the media category user interface element in the media navigation user interface with a second plurality of representations of suggested media items corresponding to suggested media items in the corresponding media category, such as... Figures 8I to 8J As shown (e.g., when a user selects a specific category of media, the media navigation user interface updates to display a representation of the media corresponding to the selected media category). In some embodiments, the representation of media items corresponding to the selected media category is displayed in the media navigation user interface with the same spatial layout as the representation corresponding to the suggested media and / or media category (e.g., as a visual block in a visual block row). In some embodiments, the corresponding media category is a media filter, and the suggested media items eligible to be displayed in a second plurality of suggested media items are a subset of the suggested media items eligible to be displayed in the first plurality of suggested media items. In this way, the electronic device improves the user's ability to easily browse and discover media by category, thereby improving the efficiency of user-electronic device interaction. In some embodiments, suggested media items in the corresponding media category are not included in the suggested media items (918) (e.g., media items displayed when a content category is selected may optionally not be displayed in the original media navigation user interface before that content category is selected). Therefore, when browsing media in the media navigation user interface, the user of the electronic device may optionally not see a given media item twice, thereby improving the efficiency of user-electronic device interaction.

[0228] When displaying media category user interface elements, the electronic device may optionally receive (914) a second navigation input via one or more input devices, corresponding to a request to scroll through the media category user interface elements, such as... Figures 80 to 8Q As shown (e.g., a swipe input detected on the touch-sensitive surface of one or more input devices). In response to receiving a second navigation input, the electronic device optionally scrolls (916) past the media category user interface element to reveal a third plurality of suggested media items in the media navigation user interface, different from the first and second plurality of suggested media items, such as Figures 80 to 8QAs shown (for example, additional suggested media items may optionally appear below the media category user interface element in the media navigation user interface, and / or to the left or right of the media category user interface element). In this way, electronic devices improve the user's ability to easily browse and discover additional media by category, thereby improving the efficiency of user-electronic device interaction.

[0229] In some implementations, based on the determination that a given media category for recommended media includes a greater than a threshold number of media items (e.g., five, ten, or fifteen), a media category user interface element corresponding to that given media category is included in the plurality of media category user interface elements, and the representation of the media items included in that given media category for recommended media is not displayed in the media navigation user interface (920), such as Figures 8S to 8T As shown (for example, if a category has a sufficient number of media items associated with it, the category is shown as a category user interface element, and the media items in that category are optionally displayed only after the user selects the category user interface element). In some embodiments, depending on whether a given media category for recommending media includes fewer than a threshold number of media items (e.g., five, ten, or fifteen), the media category user interface element corresponding to that given media category is not included in the plurality of media category user interface elements, and a representation of the media items included in that given media category for recommending media is displayed in the media navigation user interface (922), such as Figure 8R As shown (for example, if a category does not have enough media items associated with it, the category will not be displayed as a category user interface element, and the media items in that category may optionally be displayed in the media navigation user interface so that users can browse these media items). In this way, the electronic device intelligently presents media items to the user in a way that makes these media items easier to browse, thereby improving the efficiency of user-electronic device interaction.

[0230] In some implementations, the proposed media items include media items that the user of the electronic device has the right to access on the electronic device (e.g., the user has a subscription to a media provider that provides the user with access to the media items, the user has purchased the media items, etc.), and exclude (e.g., not include) media items that the user of the electronic device does not have the right to access on the electronic device (924) (e.g., the electronic device only suggests media that the user has the right to access).

[0231] The electronic device may optionally receive (926) input via one or more input devices of a corresponding representation of a corresponding media item in a first or second plurality of representations of a selected suggested media item, such as Figure 8BAs shown (e.g., a click on a button on an input device when the corresponding representation has focus). In response to receiving input selecting a corresponding representation of a media item, the electronic device may optionally display (928) a page corresponding to the corresponding media item on the display, the page including information about the corresponding media item and selectable display representations, when which the display representation is selected, the corresponding media item is played on the electronic device, such as... Figure 8C As shown (e.g., a user interface, which may optionally be a dedicated specification page for the corresponding media item). In some embodiments, the electronic device receives (930) a selection of the selectable power representation via one or more input devices, such as Figure 8C As shown (e.g., a click on a button on an input device when the selectable display has focus). In response to receiving a selection of the selectable display, the electronic device may optionally play (932) a corresponding media item on the electronic device, such as... Figure 8D As shown. In this way, electronic devices facilitate the understanding and playback of media items on electronic devices, thereby improving the efficiency of user-electronic device interaction.

[0232] In some implementations, the first plurality of representations of the suggested media item includes a representation of the suggested media item displayed in a corresponding area (e.g., in a row) of the media navigation user interface, which corresponds to the corresponding media category (934) of the suggested media, such as Figures 8P to 8Q As shown (for example, suggested media can be displayed in rows corresponding to the categories of suggested media, such as popular movies, popular TV shows, genres (sports, news, etc.), application-specific content (new content on media provider 1, new content on media provider 2, etc.), golf, etc.). In this way, electronic devices improve the user's ability to easily browse and discover media by category, thereby improving the efficiency of user-electronic device interaction.

[0233] When a second plurality of representations of suggested media items corresponding to suggested media items in a corresponding media category (e.g., media items displayed after the user has selected a media category) are displayed in the media navigation user interface, the electronic device optionally receives (936) a second navigation input corresponding to a request to scroll through the second plurality of representations of suggested media items via one or more input devices, such as Figures 8J to 8LAs shown (e.g., a swipe input detected on the touch-sensitive surface of one or more input devices, the swipe input being used to move the current focus from one representation to another based on the magnitude and / or direction of the swipe input). In response to receiving a second navigation input, the electronic device optionally scrolls (938) through a second plurality of representations of suggested media items to display a second plurality of media category user interface elements corresponding to media subcategories of the respective media category (e.g., media category user interface elements corresponding to other media categories within the selected media category) in the media navigation user interface, wherein the second plurality of representations of suggested media items are displayed before receiving the second navigation input, without displaying the second plurality of media category user interface elements, such as... Figures 8J to 8L As shown (e.g., if a movie is the selected category, it is further filtered by type; if a TV show is the selected category, it is further filtered by type; if children are the selected category, it is further filtered by age range; and so on). In this way, electronic devices improve the user's ability to easily browse and discover media by category, thereby improving the efficiency of user-electronic device interaction. Additionally, displaying suggested content before showing category filter options provides users with a content-first experience, which increases the number of playable media items displayed on the screen and reduces the amount of user input before the user selects playable media items for playback, thus improving device usability.

[0234] In some implementations, based on the determination that media restrictions are effective on electronic devices (e.g., parental restrictions, or other restrictions that prevent viewing of media with specific content ratings, such as movies rated R or higher), the suggested media items corresponding to the first and second multiple representations of the suggested media items exclude (e.g., do not include) media items restricted by media restrictions (940), such as... Figure 8V As shown (for example, if media restrictions are in place, the media displayed in the media navigation user interface is limited to media allowed by the media restrictions). Therefore, in some implementations, users can browse only the media allowed by the media restrictions. In this way, the electronic device improves the user's ability to easily browse and discover unrestricted media, thereby improving the efficiency of user-electronic device interaction.

[0235] When media restrictions are in effect on an electronic device, the electronic device may optionally receive (942) input via one or more input devices corresponding to a request to perform a search across media items accessible to the electronic device, such as... Figure 8DD As shown (e.g., input for searching a specific media item, input for searching media items with specific characteristics (such as comedy movies), etc.). In response to receiving input corresponding to a request to search for media items accessible across electronic devices, the electronic device may optionally search (944) for media items accessible to the electronic device, including media items subject to media restrictions, such as... Figure 8DD As shown (e.g., even where media restrictions are in effect, regardless of the media restrictions, a search performed on the electronic device will search for all media accessible to the electronic device). In some implementations, searching for media items accessible to the electronic device includes: searching for media items that the user of the electronic device has the right to access on the electronic device, without searching for media items that the user of the electronic device does not have the right to access on the electronic device (946), such as... Figure 8CC As shown (e.g., regardless of media restrictions, a search for media is performed across media, but only for media that the user is authorized to view). Therefore, electronic devices allow users to discover media that is restricted by media restrictions and / or is authorized, thereby improving the user's ability to discover authorized media on the electronic device and enhancing the efficiency of user-electronic device interaction.

[0236] Although media restrictions are effective on the electronic device, the electronic device may optionally receive (948) input via one or more input devices corresponding to a request to play a search result media item generated by the search (e.g., selection of a search result media item after the electronic device displays the search result media item in response to a media search performed by the user), wherein the search result media item is subject to media restrictions on the electronic device, such as... Figure 8EE As shown (e.g., a search result media item is not permitted by media restrictions because its content rating is outside the allowed content rating range). In response to receiving a request to play the search result media item, the electronic device may optionally display (950) a visual indication on the display that the search result media item is restricted by media restrictions on the electronic device, without playing the search result media item on the electronic device, such as... Figure 8FF As shown (for example, if a user selects a restricted media item from the search results to play, the electronic device displays a warning that the media item is restricted and will not play it). In this way, the electronic device improves the user's ability to determine that media is restricted and / or that the media restriction is in place, thereby improving the efficiency of user-electronic device interaction.

[0237] In some implementations, the media navigation user interface also includes a library user interface element corresponding to a media library (e.g., a collection of media items), which includes media items that the user of the electronic device has selected to be included in the media library (952), such as... Figure 8WAs shown (e.g., media items that the user has already favorited (or otherwise specified to be included in the media library), purchased, or rented). The media library may optionally be a collection of media items different from the suggested media items, since the media library may optionally contain media items due to explicit user actions relative to those media items, while suggested media items may or may not be included in the suggested media items due to explicit user actions relative to those media items. In some embodiments, the electronic device receives (954) input to select a library user interface element via one or more input devices (e.g., a click on a button on an input device when the library user interface element has focus). In response to receiving input to select a library user interface element, the electronic device may optionally replace (956) the representation of the suggested media item in the media navigation user interface with multiple representations of media items that the user of the electronic device has already selected for inclusion in the media library, such as... Figure 8W As shown in the diagram. In some implementations, the media library includes one or more optional display representations for categorizing the media library by title, date, etc. Therefore, the electronic device provides an interface that allows users to easily browse the media specified in the media library, thereby improving the efficiency of user-electronic device interaction.

[0238] In some implementations, the media navigation user interface also includes a store user interface element that corresponds to a media application that provides media that the user of the electronic device does not have permission to view (958), such as... Figure 8X As shown (e.g., an application that the user has not yet purchased or downloaded, does not have subscription access to, etc.). In some embodiments, the electronic device receives (960) input for selecting a library store user interface element via one or more input devices (e.g., a click on a button on an input device when the store user interface element has focus). In response to receiving input for selecting a store user interface element, the electronic device may optionally replace (962) the representation of suggested media items in the media navigation user interface with multiple representations of a media application that provides media that the user of the electronic device does not have permission to view, such as... Figure 8X As shown in the diagram. In some embodiments, multiple representations of the media application are displayed, but not representations of the media application through which the user of the electronic device has the right to access the media (964), such as... Figure 8Y As shown in the diagram (e.g., only representations of applications through which the user does not have permission to access content are displayed). In this way, the electronic device provides the user with quick access to media applications that are not installed on the electronic device and / or through which the user does not have permission to access media, thereby improving the efficiency of user-electronic device interaction.

[0239] In some implementations, the representation of a media application includes one or more representations corresponding to a media subscription available to the user of the electronic device (e.g., a subscription to an application on which media is available, such as media provider 1, media provider 2), wherein the corresponding representation corresponding to the corresponding media subscription available to the user includes a corresponding visual indication of the media accessible to the user via the corresponding media subscription (966), such as in Figure 8X As shown (e.g., a representation of a media subscription includes an indication of the media a user will be able to access when the user subscribes to a media subscription). For example, a representation of media provider 1 may optionally include a graphic of programs available from media provider 1, a representation of media item 2 may optionally include a graphic of programs available from media provider 2, and so on. In this way, the electronic device provides easily accessible information about the media a user can access by subscribing to a given media provider, thereby improving the efficiency of user-electronic device interaction.

[0240] In some implementations, the user of the electronic device has a subscription to a media provider that offers access to media to the user via multiple media applications, including a first set of media applications not installed on the electronic device (968), such as... Figure 8Y As shown (e.g., the user is a customer of a cable television company, and the user's account with the cable television company allows the user to view media from multiple media applications (such as an application for a first media provider, an application for a second media provider, etc.)). In some embodiments, multiple representations of the media applications are displayed, but the representation of the media application in the first group of media applications (970) is not displayed, such as... Figure 8Y As shown (for example, even if the first set of media applications is not installed on the electronic device, the first set of media applications may optionally not be displayed in the store user interface because the user already has the right to access content through those applications due to the user's account with the cable TV company. In this way, the electronic device does not display information that the user of the electronic device may not be interested in (e.g., a representation that the user already has the right to access media through the media applications), thereby improving the efficiency of user-electronic device interaction.

[0241] In some implementations, multiple corresponding provider media applications provide access to media items from the corresponding media provider. These media applications include a first media application that provides access to media items from the corresponding media provider and a second media application that provides access to media items from the corresponding media provider (972), such as... Figures 8X to 8ZAs shown (e.g., a given media provider has multiple media applications capable of providing access to media on the media provider). For example, a media provider may have a first application and a second application, the first application providing access to media based on a user's subscription to a cable television company (e.g., indirectly subscribing to the media provider via the user's subscription to the cable television company), and the second application providing access to media based on a direct subscription to the media provider. In some embodiments, the first media application is installed on an electronic device, and the user of the electronic device has a subscription to the first media application to provide access to media items from the respective media provider (974), such as... Figures 8Y to 8Z As shown (e.g., a media application that the user has downloaded and authenticated, through which they can access media from a media provider). In some embodiments, the second media application is not installed on the electronic device (976), such as... Figures 8Y to 8Z As shown (e.g., other media applications that are not downloaded, installed, and / or authenticated on the electronic device for accessing media from the media provider). In some embodiments, multiple representations of the media application are shown, but a second media application (978) is not shown, such as Figure 8Z As shown (e.g., even if some media applications used to access media from a given media provider are not installed on the electronic device, they may optionally not be displayed in the store user interface because the user has already installed and authenticated other media applications used to access media from a given media provider). In some implementations, multiple representations of the media applications are displayed, without displaying any representations of the multiple corresponding provider media applications. In this way, the electronic device does not display information that the user of the electronic device may not be interested in (e.g., duplicate representations of media applications), thereby improving the efficiency of user-electronic device interaction.

[0242] In some implementations, the media navigation user interface also includes search user interface elements for searching media accessible by the electronic device (980), such as... Figure 8BB As shown in the diagram. In some embodiments, the electronic device receives (982) input to select a library search user interface element via one or more input devices (e.g., a click on a button on an input device when the search user interface element has focus). In response to receiving input to select a search user interface element, the electronic device may optionally replace (984) the representation of suggested media items in the media navigation user interface with a search interface for searching media accessible to the electronic device, the search interface including user-configurable options for searching media accessible to the electronic device or searching only media accessible to the electronic device and which the user of the electronic device has the right to access, such as... Figure 8BBAs shown (e.g., the user has the option to search for all media accessible by the electronic device or only search for media that the user is authorized to view). In some embodiments, as previously described (e.g., as described in step 942), a search is performed from the search interface when media restrictions are in effect on the electronic device. In such embodiments, this search may optionally search for all media accessible by the electronic device, regardless of media restrictions, such as... Figure 8DD And as shown in step 942. In some implementations, if a user attempts to play a media item that is restricted by media limitations found through a search (e.g., as described in step 948), the electronic device displays a warning that the media item is restricted and will not play the media item, as previously described. Figure 8FF As shown in step 950.

[0243] It should be understood that, Figures 9A to 9I The specific order in which the operations are described herein is merely exemplary and not intended to indicate that the order is the only order in which the operations can be performed. Those skilled in the art will conceive of various ways to reorder the operations described herein. Furthermore, it should be noted that the details of other processes described herein in conjunction with other methods (e.g., methods 700, 1100, 1300, and 1900) are similarly applicable to the above-described combinations. Figures 9A to 9I The method 900. For example, the unified media browsing application and user interface, suggested media items, trending media items, media applications, representations of suggested and trending media items, and media providers described above with reference to method 900 may optionally have one or more of the features of the unified media browsing application and user interface, suggested media items, trending media items, representations of suggested and trending media items, and media providers described herein with reference to other methods described herein (e.g., methods 700, 1100, 1300, and 1900). For the sake of brevity, these details will not be repeated here.

[0244] The operations in the above information processing method can optionally be implemented by running one or more functional modules in an information processing device, such as a general-purpose processor (e.g., as described above). Figure 1A , Figure 3 , Figure 5A and Figure 15 (as described above) or application-specific chips. Furthermore, the above references... Figures 9A to 9I The described operation can optionally be... Figures 1A to 1BThe components depicted are used to implement this. For example, receiving operations 902, 906, and 910, display operation 904, scrolling operation 908, and replacement operation 912 are optionally implemented by an event classifier 170, an event recognizer 180, and an event handler 190. An event monitor 171 in the event classifier 170 detects contact on the touch-sensitive surface 604, and an event dispatcher module 174 transmits the event information to the application 136-1. The corresponding event recognizer 180 of the application 136-1 compares the event information with a corresponding event definition 186 and determines whether a first contact at a first location on the touch-sensitive surface corresponds to a predefined event or sub-event, such as a selection of an object on the user interface. When a corresponding predefined event or sub-event is detected, the event recognizer 180 activates the event handler 190 associated with the detection of that event or sub-event. The event handler 190 optionally utilizes or invokes a data updater 176 or an object updater 177 to update the application's internal state 192. In some embodiments, event handler 190 accesses the corresponding GUI updater 178 to update the content displayed by the application. Similarly, those skilled in the art will clearly understand how this can be done based on... Figures 1A to 1B The components depicted in the diagram are used to perform other processes.

[0245] Unified Media Browser Application Settings

[0246] Users interact with electronic devices in a variety of different ways, including interacting with media (e.g., music, movies, etc.) that are available on the electronic device (e.g., stored or otherwise accessible). For example, a user can browse and play media accessible on the electronic device (e.g., as referenced) within a unified media browsing application. Figures 6A to 6LL , Figures 8A to 8GG , Figures 10A to 10Z , Figures 12A to 12V and / or Figures 18A to 18J (as described above). However, in some cases, in order to browse media from different media applications within a unified media browsing application, authorization from the user may be required to allow the corresponding media provider to share user-specific information with the unified media browsing application (e.g., information related to the user's actions relative to the media on those media providers). The embodiments described below provide ways for electronic devices to facilitate the setup of a unified media browsing application, thereby enhancing user interaction with the electronic device. Enhanced interaction with the device reduces the amount of time required for the user to perform operations, thereby reducing the device's power consumption and extending the battery life of battery-powered devices. It should be understood that people use devices. When a person uses a device, that person is optionally referred to as the user of the device.

[0247] Figures 10A to 10ZExemplary ways in which electronic devices, according to some embodiments of the present disclosure, facilitate the setup of a unified media browsing application are illustrated. The embodiments in these figures are used to illustrate the processes described below, including references to... Figures 11A to 11F The process described.

[0248] Figure 10A An exemplary display 514 is shown. Display 514 optionally displays one or more user interfaces including various content. Figure 8A In the example shown, display 514 displays an electronic device (e.g., Figure 5A The electronic device 500 has a home screen user interface 1005n, and a display 514 is part of the electronic device or connected to the electronic device. The user interface 1005 may optionally be an application browsing user interface of the electronic device's operating system, which includes icons for different applications installed on the electronic device, which can be selected to launch their corresponding applications on the electronic device. For example, the user interface 1005 includes icons 1018-1 to 1018-5, which can be selected to launch different applications on the electronic device. Icon 1018-1 can be selected to launch a unified media browsing application (e.g., see reference...). Figures 6A to 6LL The unified media browsing application can be accessed by selecting icon 1018-2 to launch the settings application (e.g., through which one can optionally access...). Figure 10Q In the settings user interface 1003, one can select icon 1018-3 to launch the media application corresponding to media provider 1, select icon 1018-4 to launch the media application corresponding to media provider 2, and select icon 1018-5 to launch the media application corresponding to media provider 3. Figure 10K In the middle, icon 1018-3 has the current focus, as indicated by the dashed box within icon 1018-3.

[0249] User interface 1005 also includes an area above icon 1018 (e.g., a "top layer" area), which optionally displays one or more user interface elements corresponding to the application whose icon 1018 currently has focus. For example, in Figure 10AIn the interface 1005, icon 1018-3 corresponding to media provider 1 has the current focus. Therefore, the electronic device displays representations 1023-1 to 1023-4 of media items accessible from media provider 1 in the "top layer" area of ​​the user interface 1005. Representation 1023 optionally includes information identifying each media item (e.g., text information) and / or information about the content of each media item (e.g., a video preview of the media item, a still image of the media item, etc.). In some embodiments, the "top layer" area is a scrollable area that includes representations of suggested media items for the currently highlighted application on the home screen, and swiping up moves the current focus to a representation of one of the suggested media items. Selecting that representation (e.g., by tapping or clicking on a remote control) causes the device to begin playing the media item corresponding to the representation of the suggested media item with the current focus.

[0250] exist Figure 10B In the process, a right-to-left swipe touch 608 is detected on the touch-sensitive surface 604, which causes the icon 1018-1 corresponding to the Unified Media Browser application to have current focus. Therefore, the electronic device displays user interface elements 1020-1 and 1020-2 corresponding to the Unified Media Browser application in the "top layer" area of ​​the user interface 1005. Figure 10L In this context, the Unified Media Browser application is not authorized to act as a centralized media navigation application that displays representations of media items available from various media applications installed on the electronic device (e.g., as described later). Therefore, user interface element 1020 represents information items related to the Unified Media Browser application and not representations of media items that can be viewed within the Unified Media Browser application once authorized. Specifically, for example, user interface element 1020-1 is a video (or a link to a video) describing how to set up the Unified Media Browser application, and user interface element 1020-2 is a video (or a link to a video) describing how to use the Unified Media Browser application. When the Unified Media Browser application has current focus, swiping up moves the current focus to a representation of one of the information items related to the Unified Media Browser application. After selecting that representation (e.g., by tapping or clicking on a remote control), the device begins playing the media item (e.g., a demo video) corresponding to the information item related to the Unified Media Browser application with current focus.

[0251] exist Figure 10B In the process, after a right-to-left swipe contact 608 is detected on the touch-sensitive surface 604, a click is detected on the touch-sensitive surface 604, thereby selecting indication 1018-1. Therefore, the electronic device launches and displays the Unified Media Browser application, such as... Figure 10C As shown. In Figure 10C In this context, the unified media browsing application is not authorized to act as a centralized media navigation application that displays representations of media items available from various media applications installed on an electronic device, in order to facilitate easy browsing and viewing of those media items by the user of the electronic device. Therefore, the user interface 1002 displayed by the unified media browsing application includes buttons 1007 for setting up and / or authorizing the unified media browsing application to do so. Additionally, the user interface 1002 includes information items 1006 and 1008 related to the unified media browsing application. Specifically, the user interface 1002 includes item 1006 (a video (or a link to a video) describing how to set up the unified media browsing application) and item 1008 (a video (or a link to a video) describing how to use the unified media browsing application). Item 1008 has... Figure 10C The current focus is on button 1007, and items 1006 and 1008 are overlaid on the background image / video corresponding to the "How to Use" video for item 1008, as shown below. Figure 10C As indicated by 1011 in [reference needed]. Prior to setting up / authorizing a unified media browsing application, in some embodiments, the user interface 1002 does not include a representation of media available from various media applications installed on the electronic device. However, in some embodiments, the user interface 1002 includes a partial representation of trending media items (e.g., popular movies), such as [reference needed]. Figure 10C As shown.

[0252] exist Figure 10D In this process, a swipe contact 608 from left to right is detected on the touch-sensitive surface 604 to move the current focus to the button 1007, and a click on the touch-sensitive surface 604 is detected when the button 1007 has the current focus. In response, the electronic device initiates a process to allow browsing of media available from various media applications installed on the electronic device within a unified media browsing application. For example, such as... Figure 10E As shown, in response to Figure 10DSelecting button 1007 on the device displays dialog box 1012, which includes a row of representations 1010-1 to 1010-3 for media providers 1, 2, and 3. Representation 1010 corresponds to a media provider, and media from that provider will be available for browsing in the Unified Media Browser application after setup / authorization. Representation 1010 may optionally be a text and / or graphic representation of the media provider (e.g., the media provider's logo, the icon of the media application corresponding to the media provider, etc.). If the list of media providers is long (e.g., longer than a threshold (such as five, ten, or fifteen), this row of representations 1010 is animated to scroll horizontally, automatically displaying all representations 1010 over time. Alternatively, dialog box 1012 includes a "View All" button 1015, which can be selected to expand dialog box 1012, displaying all media providers to be added to the Unified Media Browser application in a grid of representations 1010. In some implementations, multiple representations 1010 of an application correspond to applications associated with a user's account on an electronic device, such as applications downloaded on an electronic device logged into the user's account, or applications downloaded on other electronic devices also associated with the user's account (e.g., logged into the user's account). In some implementations, multiple representations 1010 of an application correspond to applications downloaded on electronic devices and logged into by the user (e.g., the user has provided access credentials to the application, enabling the application to provide access to its corresponding media). Dialog box 1012 also includes a button 1014 selectable to authorize the media provider corresponding to representation 1010 to share user-specific information with the unified media browsing application (e.g., information related to actions the user performs with respect to media on those media providers, such as media purchase activities, media rental activities, media collection / bookmarking activities, media viewing activities, etc.).

[0253] exist Figure 10F In the context of the application, when button 1014 has current focus, a click on the touch-sensitive surface 604 is detected. As described above, selecting button 1014 authorizes media providers 1, 2, and 3 (corresponding to representation 1010) to share user-specific information with the unified media browsing application. Upon receiving the aforementioned authorization, the unified media browsing application stops displaying. Figures 10C to 10D The button 1007 and information items 1006 and 1008 shown are displayed, and representations of media items accessible from media providers 1, 2, and 3 are displayed. For example, as... Figure 10GAs shown, user interface 1002 now includes representations 1004-1 to 1004-6 of various media items accessible from media providers 1, 2, and 3. Initially, after authorizing the unified media browsing application as described above, representation 1004 optionally corresponds to trending media items (e.g., media items not selected for inclusion in user interface 1002 based on the user's viewing activity on the electronic device, such as popular TV shows). For example, trending media items may optionally be media items favored by other viewers, or media items additionally selected by a third party (e.g., media items selected for inclusion in user interface 1002 by the media provider to promote the media item). When the user of the electronic device takes an action relative to the media items accessible on the electronic device (e.g., watching a media item, renting a media item, purchasing a media item, etc.), the media items selected for inclusion in user interface 1002 based on the user's viewing activity will replace the trending media items in user interface 1002, as will be described in more detail below.

[0254] As an alternative to selecting button 1007 to set up and authorize the Unified Media Browser application, selecting a representation of a media item in the Unified Media Browser application may also trigger the settings / authorization of the Unified Media Browser application. For example, in Figures 10H to 10I In the process, a downward swipe contact 608 is detected on the touch-sensitive surface 604, and as a result, the electronic device scrolls through the user interface 1002, causing the display 1004-11 corresponding to popular TV programs to have current focus. Figure 10J In the process, a selection of representation 1004-11 was detected. In response, the electronic device displays dialog box 1012, as follows: Figure 10K As shown, and after authorization, the Unified Media Browser application is displayed, such as... Figure 10L As shown above, the media item selected to be included in the user interface 1002 based on the user's viewing activity will replace... Figure 10L The trending media items in the user interface 1002, as will now be described.

[0255] For example, in Figure 10M In this process, the electronic device plays media item B via media provider 3 in a media application corresponding to media provider 3 (e.g., in response to user input for viewing media item B). After media item B has been partially viewed on the electronic device, a representation 1005-1 corresponding to media item B from media provider 3 is included in the user interface 1002, such as... Figure 10N As shown. Specifically, the trending media item L is represented by 1004-6 (in... Figure 10LThe media item B (in the middle) has been removed from the user interface 1002 (e.g., pushed away from the edge of the user interface 1002), and the representation 1005-1 of the media item B that the user partially viewed has been added to the user interface 1002. Because the user's viewing activity caused an additional representation of the media item to be added to the user interface 1002, the additional representation of the trending media item will be similarly replaced in the user interface 1002. For example, in Figure 10O In this process, the electronic device plays media item A in a media application corresponding to media provider 2 via media provider 2 (e.g., in response to user input for viewing media item A). After media item A is partially viewed on the electronic device, a representation 1005-2 corresponding to media item A from media provider 2 is included in the user interface 1002, such as... Figure 10P As shown, another representation of the trending media item in user interface 1002 (e.g., representation 1004-5 of trending media item K) is used. In some embodiments, even after the "next" content selected based on the user's activity relative to the content has pushed the trending content off the screen, the user can scroll past the next content (e.g., by swiping right on a touch-sensitive surface) to redisplay the trending content on the display and allow the "next" content to scroll off the display. In some embodiments, the trending content changes based on the aggregated activity of multiple users (e.g., the trending content indicates content viewed by a large number of users over a predetermined time period, such as the past hour, day, week, or month).

[0256] In some implementations, the electronic device provides a settings user interface for individually managing authorizations for sharing user-specific information with the unified media browsing application for each media provider. For example, in Figure 10Q In this context, the user interface 1003 is a settings user interface. The user interface 1003 can optionally be the user interface of the unified media browsing application itself, or the user interface of the operating system of an electronic device outside the unified media browsing application. The user interface 1003 enables the user to individually authorize or revoke the authorization of media providers 1, 2, and 3 to share user-specific information with the unified media browsing application. For example, in... Figure 10Q In the user interface 1003, there are switchers 1016-1, 1016-2, and 1016-3. Switcher 1016-1 is used to authorize or revoke authorization for the media provider 1 to share user-specific information with the unified media browsing application (in... Figure 10Q (Unauthorized in China), Switch 1016-2 is used to authorize or revoke the authorization of Media Provider 2 to share user-specific information with the Unified Media Browser application (in... Figure 10Q (Authorized in China), Switch 1016-3 is used to authorize or revoke the authorization of media provider 3 and the unified media browsing application to share user-specific information (in China). Figure 10Q(Unauthorized). The user interface 1003 may also optionally include a toggle 1016-4 and a button 1017, the toggle 1016-4 being used to enable or disable a private media browsing mode on the electronic device (in... Figure 10Q (Disabled in China), see reference Figures 6FF to 6LL As described, button 1017 can optionally delete all user data related to media viewing activities on electronic devices.

[0257] Figure 10R A home screen user interface 1005 of an electronic device is shown. In response to an input detected on the remote control corresponding to a request to navigate back to the home screen user interface 1005, navigation to the home screen user interface 1005 can optionally be achieved from a unified media browsing application (e.g., selecting the "home" button 518 or the "menu" button 516 on the remote control 510 when in the unified media browsing application, as shown in the reference). Figure 5B (As described). In Figure 10R In this context, the Unified Media Browser application has been authorized to act as a centralized media navigation application that displays representations of media items available from various media applications installed on electronic devices (e.g., see reference). Figures 10C to 10L (as described), and icon 1018-1 corresponding to the Unified Media Browser application continues to have the current focus. Since the Unified Media Browser application is now authorized, the electronic device replaces the display of (1022-1 to 1022-4) representations of media items from media providers 1, 2, and 3 in the "top-level" area of ​​user interface 1005, accessible from within the Unified Media Browser application. Figure 10B The display of user interface element 1020 as described in the document.

[0258] exist Figure 10S In this context, after the unified media browsing application is authorized to act as a centralized media navigation application, a media application corresponding to media provider 4 is installed on the electronic device, as indicated by adding icons 1018-6 to the user interface 1005. Therefore, media provider 4 has not yet been authorized to share user-specific information with the unified media browsing application. The electronic device may optionally request such authorization the next time the unified media browsing application or the media application corresponding to media provider 4 is launched. In some embodiments, the electronic device requests such authorization when a media item provided by media provider 4 is selected for playback in the unified media browsing application. For example, in... Figure 10O In the context of the unified media browsing application, a click on the touch-sensitive surface 604 is detected when the icon 1018-1, corresponding to the unified media browsing application, has current focus. In response, the electronic device launches the unified media browsing application, such as... Figure 10U As shown. In Figure 10U In the event that the display 1004-20 corresponding to media item ZZ from media provider 4 has current focus, a click on the touch-sensitive surface 604 is detected. In response, the electronic device prompts the user to authorize media provider 4 to share user-specific information with the unified media browsing application, such as... Figure 10V As shown. Specifically, the electronic device displays prompt 1024, button 1026, and button 1027. Prompt 1024 includes a representation of media provider 4, button 1026 authorizes media provider 4 to share user-specific information with the unified media browsing application, and button 1027 prevents media provider 4 from sharing user-specific information with the unified media browsing application. Figure 10W In the context of a touch-sensitive surface 604, when button 1026 has current focus, a click is detected on the touch-sensitive surface 604, and as a result, media provider 4 is authorized to share user-specific information with the unified media browsing application. In response to... Figure 10W Selecting button 1026, and without further user input, the electronic device begins playing media item ZZ from media provider 4, such as... Figure 10X As shown.

[0259] In some implementations, where the unified media browsing application is not yet authorized to act as a centralized media navigation application as described above, the electronic device responds differently to the launch of the unified media browsing application (e.g., as referenced). Figures 10A to 10C As described, this depends on whether a media application is currently installed on the electronic device and / or the number of times the Unified Media Browser application has been launched when it is first launched. For example, when the Unified Media Browser application is launched for the first time without a media application installed on the electronic device, the Unified Media Browser application may optionally display a dialog box containing information related to the Unified Media Browser application, such as... Figure 10Y As shown, but without displaying any specific media applications that a user can install on their electronic device.

[0260] However, when the Unified Media Browser application is launched a second time (and optionally subsequently) without any media application installed on the electronic device, the Unified Media Browser application optionally displays a dialog box indicating a specific media application (e.g., a featured media application, or a media application that is part of a specific media application bundle or package, such as a sports package or movie package), which the user can install on the electronic device to begin using the Unified Media Browser application with those applications, such as... Figure 10ZAs shown (e.g., representations of media applications corresponding to media providers 5, 6, and 7). Users may optionally be able to install media applications individually (e.g., by individually selecting a representation of a media application) to initiate authorization for a unified media browsing application with the selected media application / provider (e.g., similar to... as shown in the reference). Figures 10E to 10G As described), or by installing all media applications presented in the dialog box (e.g., by selecting the "Download All" link in the dialog box), to initiate authorization for a unified media browsing application with all displayed media applications / providers (e.g., similar to reference...). Figures 10E to 10G (As described). In this way, after the user has already launched the unified media browsing application at least once, the electronic device only prompts the user to download / install the media application, thus avoiding unnecessary inconvenience to the user by presenting this information.

[0261] It should be noted that in some implementations, when no media application is installed on the electronic device, the electronic device displays a message upon first launching the unified media browsing application. Figure 10Z Instead of waiting until the second launch of the Unified Media Browser application (e.g., the electronic device does not display a dialog box), a dialog box will appear. Figure 10Y (The dialog box).

[0262] In some implementations, when the unified media browsing application is not yet authorized to act as a centralized media navigation application as described above, the electronic device may optionally display the unified media browsing application upon first launch, provided that one or more media applications are installed on the electronic device. Figure 10C The user interface, and the user can initiate, as referenced Figures 10D to 10G The aforementioned authorization of the unified media browsing application (e.g., authorization of a unified media browsing application that has one or more media applications already installed on an electronic device). Subsequently, the user is able to browse various media items within the unified media browsing application, as described in the reference. Figures 10A to 10X As described. In response to the subsequent launch of the unified media browsing application when a media application is installed on an electronic device, the electronic device may optionally display... Figure 10Z A dialog box to promote or offer additional media applications (e.g., media applications not yet installed on the electronic device) that users can download to their electronic devices and access through their authorized unified media browsing application.

[0263] Figures 11A to 11F This is a flowchart illustrating a method 1100 for facilitating the setup of a unified media browsing application according to some embodiments of the present disclosure. Method 1100 may optionally be implemented in an electronic device such as device 100, device 300, or device 500 (as referenced above). Figures 1A to 1B , Figures 2 to 3 as well as Figures 5A to 5B The operation is performed at (as stated above). Some operations in method 1100 may be combined, and / or the order of some operations may be changed.

[0264] As described below, method 1100 provides a way to facilitate the setup of a unified media browsing application. This method reduces the cognitive burden on the user when interacting with the device user interface of this disclosure, thereby creating a more efficient human-computer interface. For battery-powered electronic devices, improving the efficiency of user interaction with the user interface saves power and increases the time between battery charging cycles.

[0265] In some implementations, an electronic device (e.g., a set-top box, such as device 100, device 300, or device 500) communicating with a display (e.g., a television, such as display 514) and one or more input devices (e.g., a remote control, such as remote control 510; or a smartphone, such as device 511) receives (1102) input (e.g., selecting buttons displayed in a user interface including multiple representations on the display) corresponding to a request to set up a unified media browsing application to browse media corresponding to multiple applications that provide access to media from multiple media providers, such as... Figure 10D As shown (e.g., a login or initialization button is displayed in a unified media browsing application running on an electronic device, and the user selects the login or initialization button to set up the unified media browsing application). In some embodiments, multiple applications include a first application and a second application, the first application providing access to first media from a first media provider, and the second application providing access to second media from a second media provider, such as... Figure 10E As shown in the diagram. The unified media browsing application optionally acts as a centralized application through which media available via multiple different applications is browsed, as described in methods 700 and 900. Before the user authorizes the unified media browsing application to display media available via multiple different applications, the unified media browsing application optionally displays a button, such as... Figure 10C As shown in the image. After the Unified Media Browser application is authorized to display media available through multiple different applications, the Unified Media Browser application can optionally stop displaying the button, as shown. Figure 10G As shown in the image.

[0266] In response to receiving input corresponding to a request to configure the unified media browsing application to browse media corresponding to multiple applications providing access to media from multiple media providers, the electronic device initiates (1104) a process allowing browsing of media accessible via multiple applications on the electronic device within the unified media browsing application, such as... Figures 10E to 10F As shown (e.g., the process of an electronic device authorizing a unified media browsing application to display media available via multiple different applications during initiation). In some embodiments, the unified media browsing application is different from the multiple applications through which the media can be accessed. In some embodiments, initiating the process of authorizing browsing of media in the unified media browsing application includes the electronic device simultaneously displaying on a display a representation of a first media provider (1106), a representation of a second media provider (1107) (e.g., a list of different applications on the electronic device through which media can be accessed, and the unified media browsing application will display from these applications the media that can be viewed by the user in the unified media browsing application), and an optional display (1109), such as... Figure 10E As shown in the diagram. In some embodiments, the list of different applications includes images (e.g., application icons for those applications) and / or text (e.g., the names of those applications) corresponding to those applications. In some embodiments, optional functionality may indicate, when selected, granting authorization to multiple media providers to share user-specific information with the unified media browsing application, such as... Figure 10F As shown, this information includes: user-specific information from a first media provider corresponding to user actions (e.g., purchasing, renting, bookmarking / adding to favorites, watching, etc.) related to media available via a first application, and user-specific information from a second media provider corresponding to user actions (e.g., purchasing, renting, bookmarking / adding to favorites, watching, etc.) related to media available via a second application. In this way, the electronic device provides a simple process for authorizing a unified media browsing application and provides easily accessible information about the media providers as part of the authorization, thereby improving the efficiency of user-electronic device interaction.

[0267] In some implementations, multiple representations of the application correspond to applications associated with a user's account on an electronic device, such as applications downloaded on an electronic device logged into the user's account, or applications downloaded on other electronic devices also associated with the user account (1108) (e.g., logged into the user account). In some implementations, multiple representations of the application correspond to applications downloaded on electronic devices and logged into by the user (e.g., the user has provided the application with an access certificate, enabling the application to provide access to its corresponding media) (1110).

[0268] Before initiating the process of allowing browsing of media accessible via multiple applications on an electronic device within the unified media browsing application, the unified media browsing application may optionally display (1112) information items related to the unified media browsing application on the display, such as... Figure 10C As shown in the examples (e.g., demo videos showing how the unified media browsing application operates, instructional videos describing how to set up the unified media browsing application, etc.). In some implementations, the unified media browsing application does not display media accessible via multiple applications, such as media accessible via multiple applications, before initiating the process of allowing the unified media browsing application to provide browsable media. Figure 10C As shown in the diagram. After the user selects to grant authorization to multiple media providers to share user-specific information with the unified media browsing application, the unified media browsing application optionally displays (1114) a representation on the display of media items accessible from the multiple applications, such as... Figure 10G As shown (for example, after the Unified Media Browser application has been authorized to display browsable media, information items related to the Unified Media Browser application may optionally be replaced with browsable media from multiple applications).

[0269] In response to detecting a selection to grant authorization to multiple media providers to share user-specific information with the unified media browsing application, the unified media browsing application may optionally display (1116) trending media items on the display, such as Figure 10G As shown (e.g., viewing activities of users not based on electronic devices are selected to be included in media items in the unified media browsing application). For example, media favored by other viewers or media additionally selected by third parties may be optionally included in trending media items. After detecting the selection of an indication to authorize multiple media providers to share user-specific information with the unified media browsing application, the electronic device optionally detects (1118) one or more user actions that cause the unified media browsing application to include additional media items, such as Figure 10MAs shown (e.g., collection, viewing, rental, purchase, etc. of additional media items). In response to detecting one or more user actions, the electronic device may optionally replace the display of the representation of the trending media item with the representation of the additional media item in the unified media browsing application, such as... Figure 10N As shown in the diagram. For example, when a user's action causes more media items to be added to the unified media browsing application, the user's media items replace trending media items (e.g., when a user's media items replace trending media items, the trending media items are pushed away from the screen edge). In this way, the electronic device is converted to displaying media items that the user may be particularly interested in (e.g., because these media items are selected based on user actions), which makes these media items easily accessible to the user and thus improves the efficiency of user-electronic device interaction.

[0270] In some implementations, the input corresponding to the request to set up the unified media browsing application is a selection of a button displayed in the user interface of the unified media browsing application (1122), such as... Figure 10D As shown (for example, a button may optionally appear in a user interface that, once the user grants permission, displays a representation of media accessible via multiple applications. In some embodiments, representations of the first media provider and the second media provider are displayed in a single row of representations of multiple media providers (1124), such as...) Figure 10E As shown in the diagram. If more than a threshold number (e.g., 5, 8, or 10) of media providers are to be added to the unified media browsing application, in some implementations, a row of media provider representations is animated to scroll through the media provider representations.

[0271] In some implementations, the electronic device receives (1126) input via one or more input devices to select an optional display representation, which authorizes multiple media providers to share user-specific information with a unified media browsing application, such as... Figure 10F As shown (e.g., a click on a button on the input device when the optional display has focus). In response to receiving input selecting an optional display, the electronic device optionally displays (1128) a unified media browsing application, such as a display, that includes a representation of media items accessible from multiple applications. Figure 10GAs shown in the diagram (e.g., after the user has authorized media providers to share user-specific information with the unified media browsing application, the unified media browsing application displays representations of media from those applications). The unified media browsing application and its displayed user interface (including representations of media items) may optionally be the unified media browsing application and corresponding user interface described in methods 700 and 900. Therefore, the electronic device provides a simple process for allowing the unified media browsing application to display representations of media items from multiple media providers, thereby improving the efficiency of user-electronic device interaction.

[0272] After detecting a selection to grant authorization to multiple media providers to share user-specific information with a unified media browsing application, the electronic device may optionally download (1130) a corresponding application that provides access to media from the respective media providers, such as... Figure 10S As shown (e.g., after a user downloads a media application to an electronic device after the authorized media provider shares user-specific information with the unified media browsing application). In some implementations, after downloading the corresponding application, the electronic device launches (1132) the unified media browsing application or the corresponding application on the electronic device, such as Figure 10U As shown (e.g., the user launches a unified media browsing application or a corresponding application). In response to launching a unified media browsing application or a corresponding application on the electronic device (or, in response to detecting input requesting playback of a media item using the corresponding application within the unified media browsing application), the electronic device optionally displays (1134) an optional power indication on the display, such as... Figure 10V As shown in the diagram. When the optional display is selected, the optional display can optionally authorize the corresponding media provider to share user-specific information with the unified media browsing application. This user-specific information includes user-specific information from the corresponding media provider corresponding to user actions (e.g., purchasing, renting, saving / bookmarking, watching, etc.) related to media available through the corresponding application. Figure 10V As shown in the diagram. In some implementations, since the corresponding application is downloaded after the user provides initial authorization to share user-specific information with the unified media browsing application, the corresponding application may optionally require additional authorization as described above. Therefore, the electronic device provides a simple process for authorizing the media provider corresponding to the newly downloaded application to share user-specific information with the unified media browsing application, thereby improving the efficiency of user-electronic device interaction.

[0273] In some implementations, the electronic device displays (1136) an application browsing user interface (e.g., a home screen of the electronic device including icons of different applications installed on the electronic device, which can be selected to launch their corresponding applications on the electronic device) on a display, where the optional representation can be selected to open the corresponding application on the electronic device, and the optional representation includes an optional representation of a unified media browsing application, where the optional representation of the unified media browsing application can be selected to open the unified media browsing application on the electronic device, such as... Figure 10A As shown in the diagram. When an optional representation of the unified media browsing application has focus, the electronic device may optionally display (1138) one or more user interface elements corresponding to the unified media browsing application in the application browsing user interface, such as... Figure 10B and Figure 10R As shown (e.g., displayed in a designated area of ​​the application browsing user interface, which is separate from the area in the application browsing user interface where optional representations are displayed, such as the top area of ​​the application browsing user interface). In some embodiments, when an optional representation of the unified media browsing application loses focus (e.g., the user has moved the focus cursor away from the optional representation of the unified media browsing application), the electronic device stops displaying the user interface elements corresponding to the unified media browsing application. In some embodiments, user interface elements corresponding to the unified media browsing application are not displayed until the optional representation of the unified media browsing application has focus (1140), such as... Figure 10A As shown in the image.

[0274] In some implementations, prior to initiating the process of allowing browsing of media accessible via multiple applications on an electronic device within the unified media browsing application, the user interface elements corresponding to the unified media browsing application are information items related to the unified media browsing application (1142), such as... Figure 10B As shown in the examples (e.g., demo videos showing how a unified media browsing application operates, instructional videos describing how to set up a unified media browsing application, etc.). In some implementations, the application browsing user interface does not display a representation of media accessible through multiple applications before initiating the process of allowing the unified media browsing application to provide browsable media, such as... Figure 10B As shown in the diagram. In some implementations, after the user selects to authorize multiple media providers to share user-specific information with the unified media browsing application, the user interface elements corresponding to the unified media browsing application are representations of media items accessible from the multiple applications (1144), such as... Figure 10RAs shown (for example, after the unified media browsing application has been authorized to display browsable media, the information items related to the unified media browsing application may optionally be replaced with representations of browsable media from multiple applications). Therefore, through the application browsing user interface of the electronic device, the electronic device provides the user with easily accessible indications of whether the unified media browsing application has been authorized, information items related to the unified media browsing application, and / or media items accessible from the unified media browsing application, thereby improving the efficiency of user-electronic device interaction.

[0275] In some implementations, the electronic device displays (1146) a settings user interface on a display (e.g., a settings user interface that is the user interface of the electronic device's operating system but not the user interface of the unified media browsing application), which is used to individually authorize multiple media providers to share corresponding user-specific information with the unified media browsing application, such as... Figure 10Q As shown in the diagram. In some embodiments, the settings user interface is the user interface of the unified media browsing application; however, in other embodiments, the settings user interface is the user interface of the electronic device's operating system, but not the user interface of the unified media browsing application. In some embodiments, the settings user interface includes a first switch for authorizing a first media provider to share user-specific information from the first media provider corresponding to user actions relative to media available via the first application (1148), such as... Figure 10Q As shown (e.g., a user can individually allow or disallow the first media provider to share user-specific information with the unified media browsing application, such that media from the first application will or will not be included in the unified media browsing application). In some embodiments, the user interface is configured to include a second switch for authorizing the second media provider to share user-specific information from the second media provider corresponding to user actions relative to media available via the second application (1150), such as... Figure 10Q As shown (for example, a user can individually allow or disallow a second media provider to share user-specific information with a unified media browsing application, such that media from the second application may or may not be included in the unified media browsing application). In this way, the electronic device provides a centralized location for managing authorizations for sharing user-specific information, thereby improving the efficiency of user-electronic device interaction.

[0276] It should be understood that, Figures 11A to 11FThe specific order in which the operations described herein are performed is merely exemplary and not intended to indicate that the order is the only possible order in which these operations can be performed. Those skilled in the art will conceive of various ways to reorder the operations described herein. Furthermore, it should be noted that the details of other processes described herein in conjunction with other methods (e.g., methods 700, 900, 1300, and 1900) are similarly applicable to the above-described combinations. Figures 11A to 11F The method 1100. For example, the unified media browsing application and user interface, suggested media items, trending media items, media applications, representations of suggested and trending media items, and media providers described above with reference to method 1100 may optionally have one or more of the features of the unified media browsing application and user interface, suggested media items, trending media items, representations of suggested and trending media items, and media providers described herein with reference to other methods described herein (e.g., methods 700, 900, 1300, and 1900). For the sake of brevity, these details will not be repeated here.

[0277] The operations in the above information processing method can optionally be implemented by running one or more functional modules in an information processing device, such as a general-purpose processor (e.g., as described above). Figure 1A , Figure 3 , Figure 5A and Figure 16 (as described above) or application-specific chips. Furthermore, the above references... Figures 11A to 11F The operation is optionally performed by Figures 1A to 1B The components depicted are used to implement this. For example, receiving operation 1102 and initiating operation 1104 are optionally implemented by event classifier 170, event recognizer 180, and event handler 190. Event monitor 171 in event classifier 170 detects contact on touch-sensitive surface 604, and event dispatcher module 174 transmits event information to application 136-1. The corresponding event recognizer 180 of application 136-1 compares the event information with the corresponding event definition 186 and determines whether a first contact at a first location on the touch-sensitive surface corresponds to a predefined event or sub-event, such as a selection of an object on the user interface. When a corresponding predefined event or sub-event is detected, event recognizer 180 activates the event handler 190 associated with the detection of that event or sub-event. Event handler 190 optionally utilizes or invokes data updater 176 or object updater 177 to update the application's internal state 192. In some embodiments, event handler 190 accesses the corresponding GUI updater 178 to update the content displayed by the application. Similarly, those skilled in the art will clearly understand how it can be based on Figures 1A to 1B The components depicted in the diagram are used to perform other processes.

[0278] User interface for TV series content

[0279] Users interact with electronic devices in many different ways, including interacting with content or media (e.g., music, movies, etc.) that are available on the electronic device (e.g., stored or otherwise accessible), such as via different content providers and corresponding content applications (e.g., see reference). Figures 6A to 6LL , Figures 8A to 8GG , Figures 10A to 10Z , Figures 12A to 12V and / or Figures 18A to 18J (As described above). For example, a user can browse and play content accessible on an electronic device. However, a user may want to view information about a collection of content (e.g., television series, miniseries, etc.) from a user interface dedicated to that collection of content. The embodiments described below provide a way for an electronic device to display a representation of a series within a collection of content, thereby enhancing user interaction with the electronic device. Enhanced interaction with the device reduces the amount of time required for the user to perform actions, thereby reducing the device's power consumption and extending the battery life of battery-powered devices. It should be understood that people use devices. When a person uses a device, that person is optionally referred to as a user of the device.

[0280] Figures 12A to 12V Exemplary ways in which an electronic device, according to some embodiments of the present disclosure, displays a representation of a TV series in a collection of TV series content are shown. The embodiments in these figures are used to illustrate the processes described below, including references to… Figures 13A to 13E The process described.

[0281] Figure 12A An exemplary display 514 is shown. Display 514 optionally displays one or more user interfaces including various content. Figure 12A In the example shown, display 514 shows a user interface 1202 for a given set of episode content (e.g., television programs, miniseries, etc.). User interface 1202 may optionally be a dedicated specification page for the set of episode content. This is in response to a unified media browsing application on an electronic device (e.g., as referenced). Figures 6A to 6LL , Figures 8A to 8GG and / or Figures 10A to 10Z The selection of a representation of the collection of TV show content displayed in the unified media browsing application (as described above) may optionally display a user interface 1202. The user interface 1202 may optionally be a specification page including information about TV programs, such as information about the seasons and / or episodes of the TV programs. Figure 12AIn this user interface 1202, the title of the series content collection (content collection A), a description and type of the series content collection, and information about the seasons in the series content collection. The user interface 1202 also includes a "Smart Play" button, a "Favorite" button, and a "Buy Season" button. Selecting the "Smart Play" button causes the electronic device to play the next episode of the series content collection (e.g., the episode after the last episode the user watched), selecting the "Favorite" button causes the electronic device to favorite the series content collection (e.g., to make it appear as suggested content in a unified media browsing application), and selecting the "Buy Season" button allows the user to purchase access to one or more seasons of the series content collection (if the user does not yet have access to those seasons).

[0282] User interface 1202 also includes representations 1204-1 to 1204-4 of episodes from the first season of content set A and representations 1204-5 to 1204-8 of episodes from the second season of content set A. Representations 1204 also include visual indications 1208 indicating the content provider of the corresponding episode is available therethrough; however, it should be understood that representations 1204 do not necessarily need to include visual indications 1208 (e.g., the display of visual indications 1208 is optional). For example, representation 1204-2 corresponding to episode 2 of season 1 includes indication 1208 indicating that episode 2 of season 1 is available through content provider 1. Some episodes may be available through multiple content providers. For example, representation 1204-3 corresponding to episode 3 of season 1 includes indication that episode 3 of season 1 is available through content providers 1 and 2. In some embodiments, indication 1208 is a text indication and / or a graphic indication (e.g., the logo of the corresponding content provider). In addition, some shows have multiple versions available for viewing on electronic devices (e.g., extended cut, standard cut, director's cut, etc.), while others have a single version available for viewing. For example, the first episode of season 1 and the first episode of season 2 each have two versions available for viewing (e.g., version A and version B), while the rest of the shows have one version available for viewing (e.g., version A).

[0283] exist Figure 12AIn this context, the user of the electronic device has the right to watch content from content providers 1, 2, and 3 (e.g., the user has a content subscription with content providers 1, 2, and 3), as indicated by 1206. It should be understood that in some implementations, a "user entitled to watch content / media items" refers to an electronic device associated with an account entitled to play content / media items (e.g., logged into that account). The user can obtain each episode in content set A through at least one of content providers 1, 2, and 3. Therefore, the user can access all episodes in content set A, and the electronic device displays a representation 1204 with the same visual characteristics (e.g., all representations are displayed in color (as opposed to grayscale used for episodes the user does not have the right to watch), or are displayed without any markings or other indications requiring payment or subscription to watch the episodes).

[0284] exist Figure 12B In this context, the user is only authorized to watch content from content providers 1 and 3, as indicated by 1206. Therefore, the user is no longer authorized to watch Season 2 Episode 3 and Season 2 Episode 4. Consequently, the electronic device displays representations 1204-7 and 1204-8 corresponding to Season 2 Episode 3 and Season 2 Episode 4, respectively. Representations 1204-7 and 1204-8 have different visual characteristics from representations 1204-1 to 1204-6 corresponding to the episodes the user is authorized to watch. For example, the electronic device displays a "Purchase" label in representations 1204-7 and 1204-8 to indicate to the user that they are not authorized to watch Season 2 Episode 3 and Season 2 Episode 4 and must purchase access to those episodes (or otherwise subscribe to them from the content providers).

[0285] Furthermore, in some implementations, the order of indication 1204 in indication 1208 is based on the user's right to watch corresponding episodes on various content providers. For example, visual indications for content providers on which the user has the right to watch episodes are displayed first, followed by visual indications for preferred content providers (if any) that require the user to purchase or otherwise pay for access to the episodes (e.g., a third party has been designated as a preferred content provider), and then visual indications for content providers on which the user does not have the right to watch episodes. For example, in Figure 12B In this context, instruction 1208 in 1204-5 includes an instruction for content provider 3 displayed first, an instruction for content provider 2 displayed second, and an instruction for content provider 4 listed last, because the user has the right to access the content through content provider 3 and not through content provider 2 or 4. Content provider 2 is optionally the preferred content provider, and content provider 4 is optionally not the preferred content provider; therefore, content provider 2 is optionally displayed before content provider 4.

[0286] In some implementations, 1204 can be selected to play its corresponding episode on an electronic device. For example, in Figure 12C In the context of the event, when the display 1204-2 corresponding to Season 1 Episode 2 has the current focus, a click on the touch-sensitive surface 604 is detected. Since Season 1 Episode 2 is only available through content provider 1 and has only a single available version (Version A), in response to the selection of display 1204-2, the electronic device plays Season 1 Episode 2 of Version A in the media application corresponding to content provider 1, as shown below. Figure 12D As shown in the image.

[0287] exist Figure 12E In the context of Season 1 Episode 1, when display 1204-1 has the current focus, a click on the touch-sensitive surface 604 is detected. However, compared to Season 1 Episode 2, both versions of Season 1 Episode 1 are available for viewing (both via content provider 1). Since multiple versions of Season 1 Episode 1 are available for viewing, in response to a selection of display 1204-1, the electronic device displays display 1210-1 for version A of Season 1 Episode 1, and display 1210-2 for version B of Season 1 Episode 1, as follows. Figure 12F As shown in the image, 1210-1 and 1210-2 can both be selected to play the corresponding version of Season 1 Episode 1 on electronic devices. Furthermore, 1210-1 and 1210-2 include various information about the version of Season 1 Episode 1, including version information (e.g., extended cut, director's cut, etc.), images corresponding to the different versions, and information about the content providers through which the various versions are available. Figure 12F In the text, version A corresponding to episode 1 of season 1, number 1210-1 has the current focus.

[0288] exist Figure 12G In the middle, a light swipe contact 608 from left to right is detected on the touch-sensitive surface 604, which makes representation 1210-2, corresponding to version B of season 1 episode 1, have the current focus. Figure 12H In the context of the event, when 1210-2 is currently focused, a click on the touch-sensitive surface 604 is detected. In response, the electronic device plays episode 1 of season 1 of version B in the media application corresponding to content provider 1. Figure 12I As shown in the image.

[0289] In some implementations, if a representation of a series with multiple available versions and / or accessibility via multiple content providers is selected, the electronic device displays an optional representation for each version and / or an optional representation corresponding to each content provider, even if the user of the electronic device does not have permission to watch the version on the content provider and / or access the content. For example, in Figure 12JIn the context of Season 2, Episode 1, when representation 1204-5 has the current focus, a click on touch-sensitive surface 604 is detected. (As shown in the original text...) Figure 12J As shown, Season 2 Episode 1 has two available versions (e.g., Version A and Version B) and is available through multiple content providers (e.g., Content Providers 2, 3, and 4).

[0290] In response to the selection of representation 1204-5, the electronic device displays representations 1210-3 to 1210-5 corresponding to different content providers / versions associated with Season 2, Episode 1. Specifically, the electronic device displays representation 1210-3 corresponding to Version A of Season 2, Episode 1, which is available through Content Provider 3 (through which the user of the electronic device has the right to access the content). The electronic device also displays representation 1210-4 corresponding to Version B of Season 2, Episode 1, which is available through Content Provider 2 (through which the user of the electronic device has the right to access the content). Finally, the electronic device additionally displays representation 1210-5 corresponding to Version A of Season 2, Episode 1, which is available through Content Provider 4 (through which the user of the electronic device does not have the right to access the content). Therefore, even if the user of the electronic device does not have the right to access its corresponding episode, the electronic device displays representations 1210-4 and 1210-5. However, to indicate to a user that they have access to certain versions / content providers instead of others, the electronic device displays representation 1210-3 (corresponding to authorized content) with different visual characteristics than representations 1210-4 and 1210-5 (which do not correspond to authorized content) (e.g., colored vs. grayscale, without a "Purchase Required" label vs. with a "Purchase Required" label, etc.). Representation 1210-3 can be selected to play Season 2, Episode 1 of Version A via Content Provider 3 (e.g., as referenced). Figures 12H to 12I (As described). Optionally, 1210-4 and 1210-5 can be selected to purchase and then watch their respective episodes, and / or subscribe to content providers 2 and 4 respectively and then watch their respective episodes.

[0291] For example, in Figure 12L In the process, a light swipe contact 608 from left to right is detected on the touch-sensitive surface 604, and in response, representation 1210-4 corresponding to version B of season 2, episode 1 from content provider 2 gains current focus. Figure 12M In the context of touch-sensitive surface 604, when 1210-4 is currently focused, a click is detected. In response, Figure 12NIn this context, the electronic device displays a page through which the user can: purchase Season 2, Episode 1 of Version B (e.g., by selecting button 1250) to watch the series; subscribe to content provider 2 to watch the series (e.g., by selecting button 1252); or cancel the request to watch the series (e.g., by selecting button 1254, which optionally returns the electronic device to...). Figure 12L (Display).

[0292] exist Figure 12N In the event that button 1250 has current focus, a click on touch-sensitive surface 604 is detected. In response, the user has now purchased access to version B of season 2, episode 1 from content provider 2. In some implementations, if the content application for watching season 2, episode 1 of version B via content provider 2 is not installed on the electronic device, a click on the touch-sensitive surface 604 is detected. Figure 12N The selection of button 1250 in the electronic device display (in) Figure 12O (In the middle) Users can either install content applications (e.g., by selecting button 1256) or not install applications (e.g., by selecting button 1258, which optionally returns the electronic device to...) Figure 12L The page that displays (the information). Figure 12O In the event that button 1256 has current focus, a click on touch-sensitive surface 604 is detected. In response, without further user input, the electronic device downloads and / or installs a content application for content provider 2 and begins playing episode 1 of season 2 of version B within the content application. Figure 12P As shown in the diagram. In some implementations, if the content application for content provider 2 is already installed on the electronic device, then... Figure 12N Selecting button 1250 allows the electronic device to immediately (e.g., without further user input) play Season 2, Episode 1 of Version B in the content application, such as... Figure 12P As shown, but not displayed Figure 12O The page.

[0293] In some cases, users can subscribe to content provider 2 to watch episode 1 of season 2 of version B. For example, in Figure 12Q In the event that the button 1252, used to subscribe to content provider 2, has current focus, a click on the touch-sensitive surface 604 is detected. In response, the electronic device displays (on...) Figure 12R A page through which a user can confirm a subscription request to content provider 2 (e.g., by selecting button 1260) or cancel a subscription request (e.g., by selecting button 1262, which optionally returns the electronic device to...). Figure 12Q (Display). In Figure 12RIn the process, a click on the touch-sensitive surface 604 is detected when the button 1260 used to confirm a subscription to content provider 2 has current focus. In some implementations, if the content application for watching Season 2 Episode 1 of version B via content provider 2 is not installed on the electronic device, a click on the touch-sensitive surface 604 is detected. Figure 12R The selection of button 1260 on the electronic device allows the user to subscribe to and display content from content provider 2. Figure 12S (In the middle) Users can either install content applications (e.g., by selecting button 1256) or not install applications (e.g., by selecting button 1258, which optionally returns the electronic device to...) Figure 12Q The page that displays (the information). Figure 12S In the event that button 1256 has current focus, a click on touch-sensitive surface 604 is detected. In response, the electronic device downloads and / or installs a content application for content provider 2, and without further user input, begins playing episode 1 of season 2 of version B within the content application. Figure 12T As shown in the diagram. In some implementations, if the content application for content provider 2 is already installed on the electronic device, then... Figure 12R Selecting button 1260 on the electronic device allows the user to subscribe to content provider 2 and immediately (e.g., without further user input) play episode 1 of season 2 of version B in the content application, such as... Figure 12T As shown, but not displayed Figure 12S The page.

[0294] In some implementations, when the content application for content provider 2 is not installed on the electronic device, the subscription to content provider 2 and the installation of the corresponding content application are simplified to a response to a single input. For example, if the content application for content provider 2 is not installed on the electronic device, then... Figure 12Q Selecting button 1252 (e.g., for subscribing to content provider 2) causes the electronic device to display (in) Figure 12U (in Chinese) A page through which users can: confirm their subscription request to content provider 2 (e.g., by selecting button 1260, as shown in the reference). Figure 12R (as described); confirm the subscription request to content provider 2 and install the content application for content provider 2 (e.g., by selecting button 1264); or cancel the subscription request (e.g., by selecting button 1262, which optionally returns the electronic device to...). Figure 12Q (Display). In Figure 12UIn the event that button 1264 has current focus, a click on touch-sensitive surface 604 is detected. In response, without further user input, the electronic device allows the user to subscribe to, download, and / or install a content application for content provider 2, and begins playing episode 1 of season 2 of version B within the content application. Figure 12V As shown in the image.

[0295] Figures 13A to 13E This is a flowchart illustrating a method for displaying a representation of a series in a collection of series content according to some embodiments of the present disclosure. Method 1300 may optionally be implemented in an electronic device such as device 100, device 300, or device 500 (as referenced above). Figures 1A to 1B , Figures 2 to 3 as well as Figures 5A to 5B The operation is performed at (as stated above). Some operations in method 1300 may be optionally combined, and / or the order of some operations may be optionally changed.

[0296] As described below, method 1300 provides a way to display a representation of episodes within a collection of episode content. This method reduces the cognitive burden on users when interacting with the device user interface of this disclosure, thereby creating a more efficient human-computer interface. For battery-powered electronic devices, improving the efficiency of user interaction with the user interface saves power and increases the time between battery charging cycles.

[0297] In some implementations, an electronic device (e.g., a set-top box, such as device 100, device 300, or device 500) communicating with a display (e.g., a television, such as display 514) and one or more input devices (e.g., a remote control, such as remote control 510; or a smartphone, such as device 511) displays (1302) a use...

Claims

1. A method comprising: At an electronic device in communication with a display and one or more input devices: receiving, via the one or more input devices, a request to display suggested media items on the display; In response to receiving a request to display suggested media items on the display, displaying a plurality of representations of suggested media items available via the electronic device via different media sources in a media suggestion user interface on the display, comprising: based on determining that a media item corresponding to a first live event media item for a first event that satisfies first selection criteria of a user of the device is viewable via the electronic device, simultaneously displaying in the media suggestion user interface on the display a representation of the first live event media item and a corresponding representation of an on-demand media item suggested for the user based on second selection criteria; as well as Based on determining that media items corresponding to live event media items of an event that meets the first selection criteria of a user of the device are not available for viewing via the electronic device, representations of multiple on-demand media items recommended for the user based on the second selection criteria are simultaneously displayed in the media suggestion user interface on the display, without displaying representations of the live event media items on the display.

Images